User Profiles of a Smartphone Application to Support Drug Adherence — Experiences from the iNephro Project

Abstract

Purpose

One of the key problems in the drug therapy of patients with chronic conditions is drug adherence. In 2010 the initiative iNephro was launched (www.inephro.de). A software to support regular and correct drug intake was developed for a smartphone platform (iOS). The study investigated whether and how smartphone users deployed such an application.

Methods

Together with cooperating partners the mobile application “Medikamentenplan” (“Medication Plan”) was developed. Users are able to keep and alter a list of their regular medication. A memory function supports regular intake. The application can be downloaded free of charge from the App Store™ by Apple™. After individual consent of users from December 2010 to April 2012 2042338 actions were recorded and analysed from the downloaded applications. Demographic data were collected from 2279 users with a questionnaire.

Results

Overall the application was used by 11688 smartphone users. 29% (3406/11688) used it at least once a week for at least four weeks. 27% (3209/11688) used the application for at least 84 days. 68% (1554/2279) of users surveyed were male, the stated age of all users was between 6–87 years (mean 44). 74% of individuals (1697) declared to be suffering from cardiovascular disease, 13% (292) had a previous history of transplantation, 9% (205) were suffering from cancer, 7% (168) reported an impaired renal function and 7% (161) suffered from diabetes mellitus. 69% (1568) of users were on <6 different medications, 9% (201) on 6 – 10 and 1% (26) on more than 10.

Conclusion

A new smartphone application, which supports drug adherence, was used regularly by chronically ill users with a wide range of diseases over a longer period of time. The majority of users so far were middle-aged and male.

About the Authors:

Stefan Becker

* E-mail: [email protected]

Affiliations Department of Internal Medicine I, Marienhospital Herne, University Hospital, Ruhr University Bochum, Herne, Germany, Department of Nephrology, University Duisburg-Essen, Essen, Germany

Andreas Kribben

Affiliation: Department of Nephrology, University Duisburg-Essen, Essen, Germany

Sven Meister

Affiliation: Fraunhofer Institute for Software and Systems Engineering, Dortmund, Germany

Clarissa Jonas Diamantidis

Affiliation: Division of Nephrology, University of Maryland School of Medicine, Baltimore, Maryland, United States of America

Nicole Unger

Affiliation: Department of Internal Medicine I, Marienhospital Herne, University Hospital, Ruhr University Bochum, Herne, Germany

Anna Mitchell

Affiliation: Department of Nephrology, University Duisburg-Essen, Essen, Germany

Introduction

Patients with chronic illnesses such as hypertension and chronic kidney disease are often burdened by high comorbidity and reduced awareness of their medical conditions, which creates a challenging environment in which to promote medication compliance [1]. Complexities of daily life, shifting priorities, and frequent poly-pharmacy likely contribute to patients' inability to deal adequately with their medical conditions [2]. Frequent encounters with the medical system, which result in dosage adjustments, add to the problems with medication compliance in these patients [3].

Novel tools are needed to address the requirements of these chronically ill patients. From a technical perspective, the “ideal system” would enable the user to easily 1) recognize and understand all necessary input components (i.e. drugs) and their changes, 2) treat these components as integral parts of their day to day activities and 3) record vital signs and possibly share them with the treating physician. The solution for such a tool is beyond the possibilities of a pencil, a piece of paper and an alarm clock.

“Mobile Computing”, which is a broad term comprised of various forms of hardware (i.e. smartphones, tablet computer) is presently one of the most important technological trends and offers promise for a “system solution” for patients with chronic disease [4]. It allows the user to download mobile applications (“apps”) via the Internet, which can then be applied for various activities of daily life [5]. In Germany the proportion of smartphones has increased rapidly over the past years and is now estimated to be a 55% market share of all sold cell phones [6]. Worldwide there were almost 6 billion mobile phones being used in late 2011, more than one billion of these had broadband capabilities and 43.6 billion mobile applications were downloaded in the 12 months ending September 2012 [7], [8]. With the global prevalence of mobile technology, accessing health-related applications via mobile phone seems a logical step in the patients' management of their own medical conditions [7]. According to a US study, 25% of smartphone users were already using such health applications and almost half of those asked would be interested in doing so [9]. In this paper, we introduce a novel mobile application called “Medikamentenplan” (“Medication Plan”), which was developed to support medication compliance and vital sign documentation. We describe its implementation and acceptance in a representative German population subset. Pre-specified main endpoints of the statistical analysis were the frequency and intensity of use and the users' demographic characteristics.

Materials and Methods

Ethics

The Ethics Committee of the Medical Faculty of Essen University was consulted and a formal written waiver for the need of ethics approval was issued (13-5373-BO).

In 2010 the “Medication Plan” application was specified for iOS by the Department of Nephrology, Essen University Hospital, Essen, Germany, in cooperation with the companies DigitalOffice (Dortmund, Germany), Bergisch Media (Heiligenhaus, Germany) and Digitalpocket (Bochum, Germany) and the support of the German Society of Nephrology. “Medication Plan” is a native smartphone application, which allows users to maintain and alter a drug therapy plan on their personal device (fig. 1). An online drug database customized by the Department of Nephrology at Essen University Hospital, facilitates the entries. Users may specify intake requirements according to the medication regimen issued by the prescribing physician and the patients' own personal needs (e.g. how long to take the medication, medication dosage, whether to take on an empty stomach, how often to take, and at what time). A memory function and local push-notification alert remind users to take their medications at the pre-specified time. No permanent Internet connection is necessary and all data is stored locally on the device itself, reducing the possibility of erroneous transmission of personal health information. Users can enter vital sign data, and trends are presented graphically. If required, data can then be attached as csv-files and e-mailed to third parties.

[Figure omitted. See PDF.]

Figure 1. Generating a medication plan on the smartphone (exemplary screenshots).

https://doi.org/10.1371/journal.pone.0078547.g001

The application was released first as a 1.0 version in the German-language App Store™ by Apple™ on December 14, 2010 and was available for download free of charge (http://itunes.apple.com/de/app/inephro-medikamentenplan/id405270576?mt=8 #). The application was actively advertised by the German Society of Nephrology (DGfN) by press releases and on its website (http://www.dgfn.eu/aktuell/inephro.html). This triggered a series of further articles in newspapers, television, patient self-help groups and blogs [10]–[15]. Interestingly after a positive article by a renowned consumer protection association (“Stiftung Warentest”) a significant increase of downloads could be detected [11]. Three additional updates were issued, which included enhancement of the medication specification requested by a large number of users, as well as the removal of software “bugs”. Prior to using the application a disclaimer as well as an agreement for a subsequent anonymous analysis of user data had to be consented by the user via activation of a hyperlink (implementation by QUEST objects GmbH, Tübingen). Additionally users were invited to voluntarily and anonymously fill in an online questionnaire, which had to be actively accessed by another hyperlink. The unique identifier numbers (UDID) of the respective iPhones were irreversibally encrypted by a MD5 message-digest algorithm (MD5-Hash). The activitiy of the encrypted UDID was then tracked (“creation”, “modification”, or “deletion” of drug information, as well as the “confirmation” of drug adherence within the application “Medication Plan”). Activity of the respective, encrypted UDID addresses and if available, associated demographic information were analysed using self-implemented software of Fraunhofer ISST, Dortmund, Germany, and GraphPad Prism version 6.0 for Macintosh, GraphPad Software, San Diego California U.S.A. Chi-square Test was performed by VassarStats (http://vassarstats.net/odds2×2.html). Data are presented as descriptive statistics and relative values were calculated using the corresponding sample.

Results

As of April 2, 2012, “Medication Plan” was downloaded and used by 11688 smartphone users. 29% (3406) used the application at least once a week for at least 28 days and in 27% (3209) of cases any activity was recorded for at least 84 days (table 1). 19% (2279) of users provided demographic data via the anonymous online questionnaire. 68% (1554) of survey respondents were male. 49% (1122) of users had finished secondary school as highest educational qualification, 18% (420) had finished school with qualifications for university studies and 26% (589) were holding a university degree (table 1). The majority of users were suffering from cardiovascular disease (table 2). The stated age of all users was between 6–87 years (mean 44). 27% of users were 55 years or older (data from 16, fig. 2). 1095 Regular users (defined as applying the software at least once a week for at least 28 days) deployed the software temporarily, and specified their age (fig. 3). At 28 days after download 23% (124/530) of users <50 years and 28% (156/565) of users >50 years were still using the application at least once a week (p>0.05). The proportion of older users applying regularly “Medication Plan” at 165 days was significantly higher (<50 years: 9% (46/530) and >50 years 15% (82/565); p<0.004). After 365 days only 1% (6/530) of users <50 years and >50 years (4/565) were regularly using the application (fig. 3). Out of 2279 users approximately two thirds (69%; 1568) were taking 1 – 5 different medications a day. 9% (201) stated to be taking 6 – 10 and 1% (26) were on more than 10 drugs per day. Interestingly, 21% (484/2279) were not on any medication at all. From 196 feedback e-mails 68% (134) presented ideas for further development, 28% (55) referred to software bugs and 4% (7) were inquiries on software function. Table 3 summarizes the different suggestions and requests for further development.

[Figure omitted. See PDF.]

Figure 2. Relative proportion by age of users of "Medication Plan" who provided demographic data (n = 2279) and all smartphone users (*Federal Statistical Office, 2011 [11]).

https://doi.org/10.1371/journal.pone.0078547.g002

[Figure omitted. See PDF.]

Figure 3. 1095 regular users (defined as applying "Medication Plan" at least once a week for at least 28 days) specified their age.

At 28 days after download 23% (124/530) of users <50 years and 28% (156/565) of users >50 years were still using the application at least once a week (p>0.05). The proportion of older individuals using “Medication Plan” at 165 days was significantly higher (<50 years: 9% (46/530) and >50 years 15% (82/565); p<0.004*). After 365 days only 1% of regular users <50 years (6/530) as well as >50 years (4/565) were using the application.

https://doi.org/10.1371/journal.pone.0078547.g003

[Figure omitted. See PDF.]

Table 1. User activity over time and demographic characteristics in smartphone users, who downloaded and used "Medication Plan from 12/14/2010 - 04/02/2012 (* regular use was defined as using the application at least once a week for at least 28 days, § percent of 2279 users who provided personal information).

https://doi.org/10.1371/journal.pone.0078547.t001

[Figure omitted. See PDF.]

Table 2. Diseases declared by users (multiple entries possible).

https://doi.org/10.1371/journal.pone.0078547.t002

[Figure omitted. See PDF.]

Table 3. Topics of Feedback-Mails proposing further development of the application.

https://doi.org/10.1371/journal.pone.0078547.t003

Discussion

The present study is the first to describe the implementation of a mobile application to support drug adherence published in a public app–store. We analysed frequency and intensity of the app's use and also evaluated the demographic profile of its users.

Brief review of findings and comparison to prior studies

The overall interest in the app of more than 11000 users was remarkable. However, download rates of other health-related apps, which targeted individuals with acute rather than chronic medical conditions have been reported to be much higher [7]. A software targeting chronically ill patients may at present only draw limited public interest, likely due to the epidemiological factors discussed below. Also, the application was published only in the German-language App Store™ by Apple™, which undoubtedly restricted its reach. Today there is still a threefold “digital divide” between age groups, sexes and according to education levels: Currently, the majority of German smartphone users are younger than 35 years although use in individuals older than 45 years is increasing steadily [16]. This is similarly reflected in the US trend of usage [17]. Compared with the average age of German smartphone users, the users of “Medication Plan” were older [16]. Two factors, likely, have contributed to this. Firstly it seems natural, since the prevalence of chronic diseases like hypertension or chronic ischemic heart disease grows with age [18]: In Germany 49% of women and 41% of men between 45 and 65 years declare to be suffering from chronic conditions [19]. More than half of the population are affected in the age cohort above 65 years [19]. Secondly, the German Society of Nephrology and several self-help groups actively advertised or reported on the application. This will probably have helped to draw the attention of older users. The fact that more than two thirds of our users were male illustrates the “digital divide” between the sexes. Women in general are still less interested in using the mobile Internet than men, as shown by surveys both from the German federal statistics institute and data from the US [5], [16]. In Germany at present especially older women use the mobile Internet significantly less than men [16]. A further schism exists between individuals with higher education and those with only basic qualifications. Among our users the proportion of university graduates was higher compared to the general population (28% vs. 13%) [20].

Regular use of the application decreased considerably within the first 2 months and lasted for more than a year only in a few cases. This finding is consistent with other studies citing a high attrition rate for internet interventions [21], which may be a reflection of an early interest in the novelty of the application, with a decline in eagerness as the newness of the intervention wears off. At present there is no scientific data on why people stop using mobile health applications. In a commercial survey by the Consumer Health Information Corporation (CHIC) on the use of healthcare apps in 2011 users reported "not user friendly" and "found a better one" as the most frequent reasons for no longer using an app (32% and 34% respectively). 26% of health apps were used only once after download. The drop out rate recorded in this survey was 74% (of 395 participants) by 10th use [22]. The fact that "Medication Plan" was not used permanently might therefore reflect deficits in usability and the necessity to continuously monitor customer/patients' demands. A criticism in usability might be that the app requires to set end dates for the medication. However, the aspect of an “unlimited therapy duration” was not raised in feedback mails. Others have found that most patients value interactive systems, i.e. devices that will give feedback - in this case on correct drug intake, a feature as yet not included in "Medication Plan" [23], [24]. Also, patients seem to prefer to use m-health in conjunction with visits to their doctors - another element which was not part of our study [23], [24]. In essence, use of this app can be seen as an expression of patients' wishes to improve the effectiveness of their treatment by improving their adherence. The most favourable - if speculative - explanation for the decline in use of "Medication Plan" is that it may only have been used temporarily as a "learning tool" at least by some patients: Once habituation to correct drug intake had been achieved, assistance may no longer have been regarded as necessary. Following this train of thought the fact that older individuals seemed to be using the app for a longer period than younger users may reflect a lesser slope in the learning curve of older users and the temporary adoption of the app as a "companion tool". Furthermore experiences from an “Ambient Assisted Living Project”, which is dedicated to the needs of an older group of users, report that the acceptance of 7-inch tablet PCs is very high [25]. In this context further studies should explore the possibilities of tablet computers for elderly and multimorbid users and patients' motivation for using an app like "Medication Plan". In summary, most of the users seem to have been “early adopters” of a new service: middle-aged male and - derived from the relatively small number of daily taken pills - comparatively healthy [26].

Conclusion

Use of the Internet and of smartphones to deliver health care is growing rapidly. Electronic devices are increasingly used by both health care providers and patients as communication tools [27]. Providers using mobile communication technology to connect with their patients achieve an improved overall patient-provider communication, strengthened patient autonomy, and empowered patients to tackle daily health issues [28]–[33]. Studies from various clinical contexts, in which text-messaging services were introduced, reported improved medication adherence [34]–[39]. They also showed that electronic self-documentation can be an effective tool in the management of chronic conditions (i.e. self measurement of blood glucose in diabetes patients) [40].

In the present climate it seems likely that health-related mobile computing applications will increasingly play a role for elderly and chronically ill users for a variety of reasons. Currently, most of the hardware and commercially successful applications are likely to be targeting younger (between 18 – 40 years) and healthy individuals because they constitute the majority of contemporary smartphone users [5], [16]. However, the young and middle-aged of today are the senior citizens of tomorrow. This cohort effect will alter the demographics of those who rely on information technology and who increasingly integrate the mobile internet into their daily lives [7], [41].

Future developments should take into consideration that generally Internet use is inversely correlated with an increasing number of medical conditions and lack of financial resources [42]. Also, a decrease of associated costs of mobile devices, i.e. costs for smartphones and tablet computers, may be essential to mitigate the “digital divide": Others have suggested that a portion of the population on the socioeconomic margin may miss out on the benefits of technologies due to prohibitive factors such as device cost [43], [44]. This is supported by the suggestion of "Medication Plan"-users to publish a similar application for other, possibly cheaper systems, as borne out in the mail requests.

In many cases the choice of consumers to download our application seems to have been promoted by media recommendations. This reflects the element of novelty in apps like "Medication Plan". We believe that some form of guidance and possibly coaching by the medical profession will - for the time being - be necessary to establish health-related apps as a fixture in patient care. In order to ensure that relevant technical standards are met, one may discuss whether health care-related apps generally require a conformity assessment and how to best communicate quality standards to consumers.

Many ideas of our users arose around the problem of importing their individual medication plan into the smartphone. Our vision for the future involves an automatic transfer of therapy plans issued by physicians onto mobile devices via electronic health records. This would promote acceptance and decrease the number of associated transmission errors. Applications will have to be tailored closely to the specific demands of sick individuals to be accepted as part of their often complicated day-to day routines [45], [46]. Not overloading an application with functionality seems vital, when developing for elderly users with chronic conditions. A low-threshold service to allow a provider-patient connection with a smartphone application could be a promising approach.

Our data allow a fleeting glimpse into the future, where "mobile health" will not replace the doctor-patient relationship, but will hopefully help to establish more effective and efficient treatment and accelerate e-health strategies.

Acknowledgments

This project was realised as a result of input from multidisciplinary network. Henry Vossiek (DigitalOffice, Dortmund, Germany), Moritz Meschonat (Digitalpocket, Bochum, Germany) Dennis von Almsick and Birger Stöckelmann (Bergisch Media GmbH, Heiligenhaus, Germany) and Knut Lambert (QUEST-objects GmbH, Tübingen, Germany) realised the technical concept and development of “Medication Plan”. We would like to thank Prof. Gabriele Franke (University of Applied Science Magdeburg-Stendal, Germany) and Prof. Christian Johner (University of Applied Science Konstanz, Germany) for ideas and discussion and the German Society of Nephrology (DGfN) for its support in promoting the application.

Author Contributions

Analyzed the data: SB AK SM CD NU AM. Wrote the paper: SB AK SM CD NU AM.

Citation: Becker S, Kribben A, Meister S, Diamantidis CJ, Unger N, Mitchell A (2013) User Profiles of a Smartphone Application to Support Drug Adherence — Experiences from the iNephro Project. PLoS ONE 8(10): e78547. https://doi.org/10.1371/journal.pone.0078547

References

1. Vrijens B, Vincze G, Kristanto P, Urquhart J, Burnier M (2008) Adherence to prescribed antihypertensive drug treatments: longitudinal study of electronically compiled dosing histories. BMJ Clinical research ed. 2008 336(7653): 1114–7.2.

2. Becker S, Mitchell A, Konigsmann T, Kribben A, Erbel R (2012) Mobile applications and management of hypertension: Possibilities, problems and perspectives. Herz. 2012. Epub 2012/10/12.

3. Osterberg L, Blaschke T (2005) Adherence to medication. The New England journal of medicine. 2005 353(5): 487–97.

4. Trill R (2008) eHealth ist die Zukunft – ein Blick bis ins Jahr 2015. Jäckel (Hrsg.) Telemedizinführer Deutschland, Bad Nauheim, Ausgabe 2008 Seite: 102–106.

5. Sarasohn-Kahn J (2010) How smartphones are changing health care for consumers and providers. California HealthCare Foundation, Oakland, CA. Available at http://www.chcf.org/publications/2010/04/how-smartphones-are-changing-health-care-for-consumers-and-providers. Accessed 08/18/2013.

6. Bundesverband Informationswirtschaft (2012) Telekommunikation und neue Medien e.V. (2012) Zeitenwende auf dem Handy-Markt. Available at: http://www.bitkom.org/de/presse/74532_71243.aspx. Accessed 08/18/2013.

7. PriceWaterhouseCoopers (2012) Emerging mHealth: Paths for growth. Available at: http://www.pwc.com/en_GX/gx/healthcare/mhealth/assets/pwc-emerging-mhealth-full.pdf. Accessed 08/18/2013.

8. TechCrunch (2013) ABI: 43.6B App Downloads In Year To Sept 2012, Apple Leads Google + Microsoft Overall, But Microsoft Tops For Innovation. Available at: http://techcrunch.com/2013/01/02/abi-43-6b-app-downloads-worldwide-in-year-to-sept-2012-apple-leads-google-and-microsoft-overall/. Accessed 08/18/2013.

9. Fronstin P (2011) Findings from the 2011 EBRI/MGA Consumer Engagement in Health Care Survey. EBRI issue brief/Employee Benefit Research Institute. 2011(365): 1–26.

10. Deutsches Aerzteblatt (2011) Smartphone-App: Erinnerung an die Medikamenteneinnahme. 108(21): A-1178/B-979/C-979. Available at: http://www.aerzteblatt.de/archiv/91483. Accessed 08/18/2013.

11. Stiftung Warentest (2011) App für Medikamente. Test 06/2011. Available at: http://www.test.de/gesundheit-kosmetik/meldungen/Erinnerung-App-fuer-Medikamente--4240639-4240643/. Accessed 08/18/2013.

12. FOCUS Magazin (2011) APP DER WOCHE: Tabletten-Planer. Issue 09/26/2011. Available at: http://www.focus.de/digital/handy/app-der-woche/app-der-woche-tabletten-planer_aid_668745.html. Accessed 08/18/2013.

13. Rundfunk Berlin-Brandenburg(2011) “PRAXIS Service über die App Medikamentenplan“. Program of 02/06/2011. Available at: http://www.rbb-online.de/rbbpraxis/rbb_praxis_service/internet-telemedizin/gesundheits_apps.html. Accessed 08/18/2013.

14. Gesundheit.nrw (2011) Apps im Test – iNephro Medikamentenplan. Available at: http://blog.gesundheit.nrw.de/?p=491. Accessed 08/18/2013.

15. Medical Tribune(2011) „Nachhilfe für vergessliche Patienten Handy erinnert an Tabletten!“ Available at: http://www.inephro.de/fileadmin/user_upload/images_content/MTD_2012_08_S05_pdf_1.pdf. Accessed 08/18/2013.

16. Federal Statistical Office (2011) Mobile Internetnutzung über das Handy 2010 stark gestiegen. https://www.destatis.de/DE/PresseService/Presse/Pressemitteilungen/2011/02/PD11_060_63931.html. Accessed 08/18/2013.

17. Smith A (2013) 46% of American adults are smartphone owners. Pew Internet & American Life Project. Available: http://pewinternet.org/Reports/2012/Smartphone-Update-2012/Findings.aspx. Accessed 08/18/2013.

18. Schafer I, Hansen H, Schon G, Hofels S, Altiner A, et al.. (2012) The influence of age, gender and socio-economic status on multimorbidity patterns in primary care. First results from the multicare cohort study. BMC health services research. 2012;12:89. Epub 2012/04/05.

19. Robert Koch Institut (2012) Daten und Fakten: Ergebnisse der Studie »Gesundheit in Deutschland aktuell 2010«. Beitraege zur Gesundheitsberichterstattung des Bundes RKI, Berlin. 2012.

20. Federal Statistical Office (2011) Bevölkerung nach Bildungsabschluss in Deutschland. Available at: http://de.statista.com/statistik/daten/studie/1988/umfrage/bildungsabschluesse-in-deutschland/. Accessed 08/18/2013.

21. Boulos MN, Wheeler S, Tavares C, Jones R (2011) How smartphones are changing the face of mobile and participatory healthcare: an overview, with example from eCAALYX. Biomedical engineering online. 2011 10: 24.

22. Consumer Health Information Corporation (2011) Motivating Patients to Use Smartphone Health Apps. Available at: http://www.consumer-health.com/press/2008/NewsReleaseSmartPhoneApps.php. Accessed 08/18/2013.

23. Kripalani S, Yao X, Haynes RB (2007) Interventions to enhance medication adherence in chronic medical conditions: a systematic review. Archives of internal medicine. 2007. ;167(6):540–50. Epub 2007/03/29.

24. Rai A, Chen L, Pye J, Baird A (2013) Understanding determinants of consumer mobile health usage intentions, assimilation, and channel preferences. Journal of medical Internet research. 2013. ;15(8):e149. Epub 2013/08/06.

25. Wojciechowski M, Ristok H, Brandes M, Lange B, Baumgarten B (2011) Architecture of the 'Daily Care Journal' for the support of health care networks; Wichert, R.; Eberhardt, B.; Verband der Elektrotechnik, Elektronik, Informationstechnik -VDE-; Bundesministerium für Bildung und Forschung -BMBF-, Deutschland: Ambient Assisted Living. 4. AAL-Kongress 2011: Berlin, Germany, January 25–26, 2011, Berlin: Springer, 2011 (Advanced technologies and societal change 1).

26. Rogers EM (1962) Diffusion of Innovations. Free Press of Glencoe, Macmillan Company.

27. Buntin MB, Burke MF, Hoaglin MC, Blumenthal D (2011) The benefits of health information technology: a review of the recent literature shows predominantly positive results. Health Aff (Millwood). 2011. ;30(3):464–71. Epub 2011/03/09.

28. Downer SR, Meara JG, Da Costa AC, Sethuraman K (2006) SMS text messaging improves outpatient attendance. Australian health review: a publication of the Australian Hospital Association. 2006. ;30(3):389–96. Epub 2006/08/02.

29. Weaver A, Young AM, Rowntree J, Townsend N, Pearson S, et al. (2006) Application of mobile phone technology for managing chemotherapy-associated side-effects. Annals of oncology: official journal of the European Society for Medical Oncology/ESMO. 2007. ;18(11):1887–92. Epub 2007/10/09.

30. Fjeldsoe BS, Marshall AL, Miller YD (2009) Behavior change interventions delivered by mobile telephone short-message service. American journal of preventive medicine. 2009 36(2): 165–73.

31. Rodgers A, Corbett T, Bramley D, Riddell T, Wills M, et al. (2005) Do u smoke after txt? Results of a randomised trial of smoking cessation using mobile phone text messaging. Tobacco control. 2005. ;14(4):255–61. Epub 2005/07/28.

32. Kerwin M, Nunes F, Silva PA (2012) Dance! Don't Fall - preventing falls and promoting exercise at home. Studies in health technology and informatics. 2012;177:254–9. Epub 2012/09/04.

33. Hurling R, Catt M, Boni MD, Fairley BW, Hurst T, et al. (2007) Using Internet and mobile phone technology to deliver an automated physical activity program: randomized controlled trial. Journal of medical Internet research. 2007. ;9(2):e7. Epub 2007/05/05.

34. Kelly JD, Giordano TP (2011) Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders. AIDS (London, England). 2011;25(8):1137; reply 8–9.

35. Mulvaney SA, Anders S, Smith AK, Pittel EJ, Johnson KB (2012) A pilot test of a tailored mobile and web-based diabetes messaging system for adolescents. Journal of telemedicine and telecare. 2012. ;18(2):115–8. Epub 2012/03/03.

36. Pop-Eleches C, Thirumurthy H, Habyarimana JP, Zivin JG, Goldstein MP, et al. (2011) Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders. AIDS (London, England). 2011 25(6): 825–34.

37. Vervloet M, Linn AJ, van Weert JC, de Bakker DH, Bouvy ML, et al.. (2012) The effectiveness of interventions using electronic reminders to improve adherence to chronic medication: a systematic review of the literature. J Am Med Inform Assoc. 2012.

38. Vervloet M, van Dijk L, Santen-Reestman J, van Vlijmen B, van Wingerden P, et al.. (2012) SMS reminders improve adherence to oral medication in type 2 diabetes patients who are real time electronically monitored. International journal of medical informatics. 2012.

39. Arora S, Peters AL, Agy C, Menchine M (2012) A mobile health intervention for inner city patients with poorly controlled diabetes: proof-of-concept of the TExT-MED program. Diabetes technology & therapeutics. 2012;14(6):492–6. Epub 2012/04/25.

40. Lane SJ, Heddle NM, Arnold E, Walker I (2006) A review of randomized controlled trials comparing the effectiveness of hand held computers with paper methods for data collection. BMC medical informatics and decision making. 2006 6: 23.

41. Boulos MN, Wheeler S, Tavares C, Jones R (2011) How smartphones are changing the face of mobile and participatory healthcare: an overview, with example from eCAALYX. Biomedical engineering online. 2011 10: 24.

42. Choi NG, Dinitto DM (2011) The digital divide among low-income homebound older adults: Internet use patterns, eHealth literacy, and attitudes toward computer/Internet use. Journal of medical Internet research. 2013. ;15(5):e93. Epub 2013/05/04.

43. Fortney JC, Burgess JF Jr, Bosworth HB, Booth BM, Kaboli PJ (2011) A re-conceptualization of access for 21st century healthcare. Journal of general internal medicine. 2011. ;26 Suppl 2:639–47. Epub 2011/10/19.

44. Lopez L, Green AR, Tan-McGrory A, King R, Betancourt JR (2011) Bridging the digital divide in health care: the role of health information technology in addressing racial and ethnic disparities. Joint Commission journal on quality and patient safety/Joint Commission Resources. 2011. ;37(10):437–45. Epub 2011/10/22.

45. Diamantidis CJ, Zuckerman M, Fink W, Aggarwal S, Prakash D, et al. (2013) Usability testing and acceptance of an electronic medication inquiry system for CKD patients. American journal of kidney diseases: the official journal of the National Kidney Foundation. 2013. ;61(4):644–6. Epub 2012/11/20.

46. Diamantidis CJ, Zuckerman M, Fink W, Hu P, Yang S, et al. (2012) Usability of a CKD educational website targeted to patients and their family members. Clinical journal of the American Society of Nephrology: CJASN. 2012. ;7(10):1553–60. Epub 2012/07/17.