Systematic review of patient and caregivers’ satisfaction with telehealth videoconferencing as a mode of service delivery in managing patients’ health

Abstract

Telehealth is an alternative method of delivering health care to people required to travel long distances for routine health care. The aim of this systematic review was to examine whether patients and their caregivers living in rural and remote areas are satisfied with telehealth videoconferencing as a mode of service delivery in managing their health. A protocol was registered with PROSPERO international prospective register of systematic reviews (#CRD42017083597) and conducted in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. A systematic search of Ovid Medline, Embase, CINAHL, ProQuest Health Research Premium Collection, Joanna Briggs Institute and the Cochrane Library was conducted. Studies of people living in rural and remote areas who attended outpatient appointments for a health condition via videoconference were included if the studies measured patient and/or caregivers’ satisfaction with telehealth. Data on satisfaction was extracted and descriptively synthesised. Methodological quality of the included studies was assessed using a modified version of the McMaster Critical Review Forms for Quantitative or Qualitative Studies. Thirty-six studies of varying study design and quality met the inclusion criteria. The outcomes of satisfaction with telehealth were categorised into system experience, information sharing, consumer focus and overall satisfaction. There were high levels of satisfaction across all these dimensions. Despite these positive findings, the current evidence base lacks clarity in terms of how satisfaction is defined and measured. People living in rural and remote areas are generally satisfied with telehealth as a mode of service delivery as it may improve access to health care and avoid the inconvenience of travel.

About the Authors:

Joseph F. Orlando

Contributed equally to this work with: Joseph F. Orlando, Matthew Beard, Saravana Kumar

Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

* E-mail: [email protected]

Affiliation: Physiotherapy Department, Royal Adelaide Hospital, Adelaide, Australia

ORCID logo http://orcid.org/0000-0002-9908-2135

Matthew Beard

Contributed equally to this work with: Joseph F. Orlando, Matthew Beard, Saravana Kumar

Roles Conceptualization, Funding acquisition, Supervision, Writing – original draft, Writing – review & editing

Affiliation: Physiotherapy Department, Royal Adelaide Hospital, Adelaide, Australia

Saravana Kumar

Contributed equally to this work with: Joseph F. Orlando, Matthew Beard, Saravana Kumar

Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Writing – original draft, Writing – review & editing

Affiliation: School of Health Sciences, University of South Australia, Adelaide, Australia

ORCID logo http://orcid.org/0000-0002-4003-4411

Introduction

People living in rural and remote areas travel long distances to access health care not readily available in their local communities. The inconvenience and cost of travel [1, 2], absenteeism from work and family [1, 3, 4] and dependence on caregivers for transport or childcare [1, 4] create barriers to access. Vulnerable groups are placed under additional hardship, including people from low socioeconomic backgrounds [5], indigenous communities [6, 7], children and the elderly [8], people with disability [9] and people with multiple co-morbidities [10].

Telehealth is an alternative mode of service delivery that enables people living in rural and remote areas to access health care within their local communities. Telehealth refers to remote service delivery utilising information and communication technologies such as telephone, videoconferencing, electronic messaging or digital monitoring to improve health outcomes [11]. With the improving internet and infrastructure, videoconferencing in particular has gained increasing prominence in the delivery of telehealth. It may be seen to retain the benefits of traditional face-to-face appointments through real-time visual cues important for rapport building, clinical observation, visual assessment and sharing of resources or education materials [12, 13]. This is possible because, unlike pre-recorded formats such as the use of facsimile, videoconferencing allows for bi-directional and synchronous real-time communication between two or more stakeholders. Delivering health care in local community or directly into one’s home via videoconferencing can address inequalities and potentially reduce pressure on health services dealing with the rise in chronic conditions [14]. Telehealth may be a viable alternative to face-to-face appointments [11, 13, 15, 16].

Patient satisfaction is important for telehealth to be a viable mode of service delivery. Satisfaction with health care is closely linked to improved patient engagement and treatment compliance for a spectrum of conditions in different clinical settings [17, 18]. There is a large body of literature examining patient satisfaction with telehealth, but these studies are limited by poor methodological quality as they are often pilot studies set in experimental and temporal contexts [19]. Two previous reviews of the literature have reported high levels of patient satisfaction with telehealth. For example, Hilgart et al. [20] found common factors of satisfaction with technology, education and information provided, communication and avoidance of patient travel. Similarly, Kruse et al. [21] identified common factors of patient satisfaction related to health outcomes, modality use and preference, low cost and communication. While these findings are relevant, these literature reviews are limited due to methodological concerns with regards to absence of formal critical appraisal of the included literature as well as publication bias, such that searching was limited to only two databases and there was no searching of the grey literature [20, 21].

Therefore, the purpose of this systematic review was to address the current knowledge gap on patient satisfaction with telehealth, in particular through the use of videoconferencing, using robust methodology and also include caregivers’ satisfaction with regards to this mode of service delivery. As patients’ experiences living with a health condition and accessing health care are shared by caregivers [22, 23], this systematic review explored both stakeholders’ perspectives with telehealth.

Materials and methods

A protocol was registered with PROSPERO international prospective register of systematic reviews (#CRD42017083597). This review was conducted and reported in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement [24]. Please refer to S1 File.

Search strategy

Six electronic databases were searched, including: Ovid Medline, Embase, CINAHL, ProQuest Health Research Premium Collection, Joanna Briggs Institute and the Cochrane Library. The following search terms were used with MESH headings as relevant: telehealth, exp telemedicine, exp teleconsult, exp remote consultation, exp videoconferencing, exp patient satisfaction, exp caregivers, exp rural health, exp rural population, exp rural health services (S2 File). The search was limited to humans, English language and published between January 2003 to December 2017. Grey literature searching was undertaken using a commonly available internet search engine (Google). Pearling of reference lists of included studies was performed to identify additional articles.

All search results were pooled and duplicates removed. Titles and abstracts were screened before analysing the full texts to determine their eligibility. The screening process was undertaken by two independent reviewers (JO and SK). Any disagreements were resolved and discussed with a third reviewer (MB), where required.

Study selection

All forms of prospective, primary research studies were considered. Secondary research, such as literature reviews, were excluded but their reference lists were searched to identify additional studies. Studies were included if patients and/or their caregivers living in rural and remote areas accessed health care for a clinical condition. Rural and remote included inner regional, outer regional, remote or very remote areas, but not metropolitan or urban areas. There was no exclusion of participant age. Studies were included if the intervention was delivered remotely using videoconferencing technology. While telehealth is not limited to videoconferencing, given the focus of this review was on videoconferencing, the term telehealth henceforth refers to videoconferencing. The telehealth intervention had to occur as part of an outpatient appointment between the patient in their home or local health care centre and a health care provider at another centre. Consultations from inpatient or emergency department were excluded as were use of videoconferencing for administrative purposes, such as scheduling of appointments. Patient and/or caregivers’ satisfaction utilising videoconferencing was the outcome of interest. Any quantitative and/or quantitative measure was included. Please refer to PICOT table in S2 File.

Methodological quality assessment

A modified version of the McMaster Critical Appraisal Tools for Quantitative Studies [25] and Qualitative Studies [26] were used to assess the methodological quality of included studies depending on their study design. Quantitative studies were assessed over eight main components including: study purpose, literature review, study design, sample, outcomes, intervention, results and conclusions. The individual components were rated as ‘yes’, ‘no’, ‘not addressed’ or ‘not applicable’. A score of ‘1’ was given to ‘yes’, ‘0’ to ‘no’ and ‘not-addressed’ while items rated as ‘not applicable’ were omitted from the total score; the maximum total score being 14.

Qualitative studies were assessed over eight components including: study purpose, literature review, study design, sampling, data collection, data analysis, overall rigor and conclusions. The individual components were rated and scored as per quantitative studies; the maximum total score being 22. The methodological assessment of the included studies was undertaken by two independent reviewers (JO and SK). Any disagreements were resolved and discussed with a third reviewer (MB), where required. Studies were not excluded based on the methodological quality score.

Data extraction

The data were extracted and collated into bespoke Microsoft Excel spreadsheets and the following domains of data were extracted from each study: study design; participants’ information (age, gender), sample size, country, clinical service, outcome measures and findings. Studies were categorised based on the dimensions of satisfaction results compared. Given the nature of the review question, a meta-analysis was not undertaken and instead a descriptive synthesis was used.

Data synthesis

As means of interpretation of findings and implications for clinical practice, various dimensions of satisfaction were generated: system experience, information sharing, consumer focus and overall satisfaction. These dimensions were adapted from a research model shown to influence users’ satisfaction in a community-based telehealth program [27]. The model proposed by Hsieh et al. [27] provided a framework to synthesise the data for this systematic review given the paucity of literature that defines the construct of satisfaction with telehealth.

Results

Search results

The initial search identified 535 studies. After pooling searches and removing duplicates, titles and abstracts were screened leaving 64 potentially relevant studies. Pearling through reference lists identified five additional studies. The full-texts were retrieved and assessed for eligibility and 36 studies were identified as being eligible for review. The literature selection process is outlined in Fig 1.

[Figure omitted. See PDF.]

Fig 1. CONSORT diagram.

https://doi.org/10.1371/journal.pone.0221848.g001

Study characteristics

Table 1 provides an overview of the included studies. The included studies were published between 2003 and 2017. There were five clinical trials, 26 observational (cohort) studies and five qualitative studies. The majority of studies were conducted in the United States of America (n = 19), followed by Canada (n = 7) and Australia (n = 6). The cumulative number of participants across all studies totalled 3607. Thirty-four studies included patients while four studies set in paediatric or geriatric settings included the caregivers of patients.

[Figure omitted. See PDF.]

Table 1. Summary of individual studies.

https://doi.org/10.1371/journal.pone.0221848.t001

All studies utilised videoconferencing technologies to provide outpatient appointments between patients in their local health care centre and a health care provider at another centre. The clinical areas included medical specialties (n = 11), rehabilitation (n = 5), genetic counselling (n = 5), oncology (n = 4), mental health (n = 4), primary care (n = 2), obstetrics and gynaecology (n = 2), pharmacy (n = 1), dermatology and general surgery (n = 1) and anaesthetics (n = 1). Details of the videoconferencing technology were provided in two-thirds of studies. These studies used a monitor and camera linked to a computer that operated via an Integrated Services Digital Network. Few studies explicitly stated use of a dedicated broadband internet connection allowing data encryption. Additional digital equipment, such as handheld cameras, otoscopes and electronic stethoscopes were used by 10% of studies. The services were physician-led in almost half of the studies, followed by allied health (for example, genetic counsellor, psychologist, speech pathologist), nurse and multi-disciplinary teams. A nurse or telehealth technician was available onsite with the patient in one third of studies to assist with appointment scheduling, technology assistance or patient examination.

Patient and caregivers’ satisfaction with telehealth were measured using a range of different methods such as questionnaires (n = 28), numerical rating scores (n = 3), semi-structured interviews (n = 4) and focus groups (n = 1). The measures used were often developed for each study’s unique setting, resulting in heterogeneity of measures.

Methodological quality assessment

The results of the assessment of methodological quality are outlined in Tables 2 and 3. There was significant variation in the methodological quality scores. Of the 31 quantitative studies, 15 scored greater than 70% while 16 scored below 70%. Amongst the quantitative research designs, studies were scored lower due to inadequate reporting of outcome measure reliability and validity, lack of justification of sample size, drop-outs and inappropriate statistical methods. Amongst the five studies using qualitative research methodologies, three scored great than 70% while two scored below 70%. Studies scored lower due to small sample sizes, inadequate descriptions of data collection procedures and lack of rigour in the data analysis process.

[Figure omitted. See PDF.]

Table 2. Methodological quality of quantitative studies based on the McMaster critical appraisal tool.

https://doi.org/10.1371/journal.pone.0221848.t002

[Figure omitted. See PDF.]

Table 3. Methodological quality of qualitative studies based on the McMaster critical appraisal tool.

https://doi.org/10.1371/journal.pone.0221848.t003

System experience

System experience was the most commonly measured dimension of satisfaction appearing in 29 studies (81%). It included the audio-visual quality of videoconferencing [28–45], accessibility of a service in one’s local health care centre [31, 35, 37, 38, 40, 44–51], time and cost savings for patients [33, 36, 39–41, 43, 45, 46, 50, 52], patient comfort in participating in telehealth [34, 37, 39, 41–43, 53–57], technical support and operations [28, 29, 31, 32, 35, 48, 53] and usability of telehealth technology [41, 54, 56]. There were high levels of satisfaction across all these domains, especially with regards to service accessibility. This was linked to convenience of attending an appointment in one’s local community, saving travel time and costs [31, 35, 36, 42, 47, 51].

There were minor accounts of discomfort with screen formatting and using equipment [42, 53, 57]. Reduced audio-visual quality also affected satisfaction and patient and caregivers’ ability to participate in the appointment [38].

Information sharing

Satisfaction with information sharing was measured by 21 studies (58%). It included the communication quality between the patient and health care provider [30, 33, 34, 37, 40, 43, 44, 46, 48, 50, 53, 54, 56, 58, 59, 60], patient confidentiality [28, 32, 33, 36, 37, 40, 44, 46, 49, 50, 53, 58, 59], thoroughness of clinical assessment [34, 36, 40, 41, 43, 44, 50], information completeness [33, 36, 40, 44] and usefulness [50, 56, 58, 60] and patient comprehension [28, 33, 36, 40, 43]. There were high levels of satisfaction across all these domains.

Communication between the patient and health care provider positively influenced satisfaction with telehealth by enabling patients to feel listened to, have their concerns addressed, have time to ask questions and participate in the information sharing and decision making. Patients were mostly satisfied that information was safely shared and remained confidential, though there were minor reports that videoconferencing might increase the risk of breach of confidentiality of patients’ health information [53]. Two studies reported that the anonymity of telehealth was helpful in discussing personal information that were perceived to be more difficult to discuss face-to-face [42, 51]. In absence of physical examination, some patients remained neutral or less satisfied with telehealth reporting 33–75% dissatisfaction [36, 40, 50]. One study found patients preferred to have their local doctor or nurse present during the telehealth appointment [33].

Consumer focus

Satisfaction with consumer focus was measured by 17 studies (47%). It included adherence to patient-centred care [30, 32–36, 39, 40, 42–44, 49–51, 53, 56, 60, 61], health care provider empathy and rapport with the patient [31–33, 36, 37, 40, 44, 49, 54, 58, 60], quality of care [32, 35, 46], local health care provider support [40], emotional support [45], professionalism [58] and health care provider cultural competence [61]. Patients and caregivers were satisfied across all these domains of consumer focus with telehealth.

Patient centred-care was a large domain within consumer focus. It measured services’ responsiveness to patient preferences, needs and values. While face-to-face appointments were preferred, telehealth remained a satisfactory option through avoided travel and costs from attending an appointment in an urban centre [36, 39, 40, 43]. The studies were unclear why face-to-face appointments were preferred in these settings but hypothesised an older demographic [43], the perceived need to develop rapport with the health care provider [36] and unfamiliarity with telehealth [40] as factors potentially influencing patient choices. There were accounts of improved self-efficacy in managing one’s condition via telehealth [36, 42, 50], enjoyment of the telehealth experience [30, 61], positive attitudes of receiving health care via telehealth [30] and agreement that patient treatment needs were being met [32, 34, 60]. There were only minor reports of telehealth being less personal [42] and unable to provide psychosocial support [45].

Overall satisfaction

Overall satisfaction was measured by 24 studies (67%). This gross measure was measured in a number of ways, including on a numeric rating scale, as a specific question within a satisfaction questionnaire and qualitatively through semi-structured interviews. Numeric rating scale was used by three studies [47, 62, 63] ranging from 4.45 to 4.7 out of 5. Respondents of questionnaires scored greater than 80% agreement in overall satisfaction [28, 33, 35–37, 42, 46, 48–50, 53, 54, 56–59]. In the semi-structured interviews, 81% of participants reported being satisfied with the telehealth experience [31].

Summary of results

Summarising the findings from quantitative and qualitative research, there is consistent evidence that telehealth has an overall positive impact on patient and caregivers’ satisfaction. System experience seems to enhance better access to health care for patients and their caregivers living in rural and remote areas highlighting that distance may no longer be a barrier. Telehealth also appears to enhance communication and engagement between health care providers and patients and their caregivers, especially through real-time videoconferencing. Irrespective of information and communication technologies, consumer focus remained a critical aspect of how a service was delivered. Consumer focus should not be compromised with the advances in information and communication technologies; but rather improve the functional delivery of telehealth.

Discussion

While telehealth has been promoted as a viable and alternative mode of service delivery, especially for people living in rural and remote areas to access health care within their local communities, to date there has been limited quality research to evaluate and report on patient and caregivers’ satisfaction with telehealth. This systematic review aimed to address this knowledge gap, with a particular focus on videoconferencing, and identified a large body of evidence consisting of 36 studies of varying designs from a range of clinical settings. The summarised findings indicate that patients and caregivers were indeed satisfied with telehealth due to a range of reasons. Specifically, attending an appointment in one’s local community via telehealth outweighed the inconvenience of travelling long distances to an urban centre for the same appointment. This was especially highlighted for people with chronic conditions [36, 41, 46, 50], parents with young children [30, 31, 38] and caregivers of elderly patients [48]. As this systematic review had a focus on videoconferencing, these findings are limited to this modality of telehealth and cannot be generalised to other modalities of telehealth.

Technology plays a crucial role in addressing barriers to health care access for people living in rural and remote areas. Videoconferencing enables real-time audio-visual communication with outcomes not significantly different from face-to-face appointments [13]. Informed by this view, there is an increasing body of research examining the impact of home-based telehealth [56, 64–67]. Advances in technology and improved consumer internet connectivity and computer literacy may empower people in rural and remote areas to manage their health conditions by better connecting to health care services [68, 69].

Despite advances in technology, a number of challenges are known to influence the success and sustainability of telehealth in rural and remote areas. Governance and stakeholder support; demonstrated economic value with consistent activity reimbursement capacity; service adaptability to the targeted population; and efficient administrative and clinical processes are some of the known challenges to using telehealth [70, 71]. In addition, not all jurisdictions may be appropriately resourced with infrastructure technology. Whilst the case for telehealth from the patient’s perspective is strengthened from this review, most of the studies were set in high-income countries with few from low-income countries [38, 52, 66]. One study set in India was influenced by an interrupting satellite signal and inconsistent audio-visual quality [38]. Poor infrastructure technology in these settings, in addition to higher running costs and low technical expertise present limitations for telehealth delivery and access [11, 72].

While technology undoubtedly is critical and is a valuable tool to address the tyranny of distance, importantly it should be complemented with the functional aspects of service delivery. Health care provider communication and empathy are universal to health care and relate directly to patient and caregivers’ satisfaction [73–76]. The findings from this review reinforce the need for health care providers to actively engage and partner with patients when face-to-face appointments have been substituted for videoconferencing. Telehealth can still remain a personal experience through elements of the communication skills that include listening to patients, providing adequate time for patient questioning, investing time in building patient rapport, involving caregivers in the appointment and emphasising patient choice. How well the telehealth experience aligned with patient values and expectations may causally influence their satisfaction as well as health care outcomes.

This systematic review demonstrates the positive impact on patient and caregivers’ satisfaction with telehealth and builds on the findings from previous systematic reviews [20, 21]. This review grouped patient satisfaction with telehealth into four dimensions: system experience, information sharing, consumer focus and overall satisfaction. While a true construct of satisfaction remains debateable from a methodological point of view [77], the findings from this review add to the current knowledge base on satisfaction being a multi-dimensional construct.

Limitations

As with any research, there are limitations to this systematic review. While the systematic searching of the literature identified a large body of evidence to inform the review topic, there were concerns regarding the methodological quality of the included studies. The areas of concern include small sample sizes and heterogeneity in terms of how satisfaction was defined and measured, at times using psychometrically untested instruments. In some studies, satisfaction was not the primary outcome of interest but rather a secondary measure resulting in limited reporting of relevant data. While this systematic review process was underpinned by best practice in the conduct of systematic reviews (PRISMA), likely publication and language bias should be acknowledged. While strategies were implemented to avoid publication bias, such as grey literature and secondary searching, due to the complexity and imprecise nature of searching and identifying grey literature, especially when investigating a complex and undefined concept such as satisfaction, some publications may have been missed.

Implications for practice

There is a large body of evidence to indicate that patients and caregivers are generally satisfied with telehealth. This complements the widely held view that telehealth can play an important role for supporting rural and remote patients where clinically appropriate and hence avoid the inconvenience of travel to an urban centre for a face-to-face appointment. While health care providers should not underestimate patients’ ability to engage with technology, this could be complemented with functional aspects of care, as they would in a face-to-face appointment. Given patient and caregivers’ satisfaction with telehealth, health services could feel confident that this form of service delivery enables health care for patients in rural and remote areas and is not a barrier from the patient and/or caregivers’ perspective. While telehealth does not replace face-to-face appointments, it does offer an alternative mode of service delivery that when integrated into an established service could form part of patient choice when clinically safe and appropriate. Aligning a health care service with patients’ expectations and needs can lead to overall patient satisfaction.

Implications for research

Growing evidence supports the use of telehealth from both the patient and caregivers’ perspectives. However methodological concerns of the current evidence may guide the direction of future research. Future research should address the question of how to accurately measure satisfaction given this is a routinely used measure in health service. Similarly, future research may also improve the current evidence base by reporting on follow-up research, which investigate if patient and caregivers’ satisfaction with telehealth can be sustained over the long term.

Supporting information

[Figure omitted. See PDF.]

S1 File. PRISMA checklist.

https://doi.org/10.1371/journal.pone.0221848.s001

(DOC)

S2 File. Appendix.

https://doi.org/10.1371/journal.pone.0221848.s002

(DOCX)

Citation: Orlando JF, Beard M, Kumar S (2019) Systematic review of patient and caregivers’ satisfaction with telehealth videoconferencing as a mode of service delivery in managing patients’ health. PLoS ONE 14(8): e0221848. https://doi.org/10.1371/journal.pone.0221848

References

1. Moffatt JJ, Eley DS. The reported benefits of telehealth for rural Australians. Aust Health Rev 2010;34: 276–281. pmid:20797357

2. Wade VA, Karnon J, Elshaug AG, Hiller JE. A systematic review economic analyses of telehealth services using real time video communication. BMC Health Service Res 2010;10: 233.

3. Cottrell MA, Hill AJ, O'Leary SP, Raymer ME, Russell TG. Service provider perceptions of telerehabilitation as an additional service delivery option within an Australian neurosurgical and orthopaedic physiotherapy screening clinic: a qualitative study. Musculoskelet Sci Pract 2017;32: 7–16. pmid:28787636

4. Harrison TN, Sacks DA, Parry C, Macias M, Ling Grant DS, Lawrence JM. Acceptability of virtual prenatal visits for women with gestational diabetes. Womens Health Issues 2017;27: 351–355. pmid:28153743

5. Jang-Jaccard J, Nepal S, Alem L, Li J. Barriers for delivering telehealth in rural Australia: a review based on Australian trials and studies. Telemed J E Health 2014;20: 496–504. pmid:24801522

6. McBain-Rigg KE,Veitch C. Cultural barriers to health care for Aboriginal and Torres Strait Islanders in Mount Isa. Aust J Rural Health 2011;19: 70–74. pmid:21438948

7. Hiratsuka V, Delafield R, Starks H. Patient and provider perspectives on using telemedicine for chronic disease management among Native Hawaiian and Alaska Native people. Int J Circumpolar Health 2013;72: 21401.

8. Syed ST, Gerber BS, Sharp LK. Traveling towards disease: transportation barriers to health care access. J Community Health 2013;38: 976–993. pmid:23543372

9. Iezzoni LI, Killeen MB, O’Day BL. Rural residents with disabilities confront substantial barriers to obtaining primary care. Health Service Res 2006;4: 1258–1275.

10. Bradford NK, Caffery LJ, Smith AC. Awareness, experiences and perceptions of telehealth in a rural Queensland community. BMC Health Service Res 2015;15: 427.

11. World Health Organization. Telemedicine: opportunities and developments in Member States: report on the second global survey on eHealth: Global Observatory for eHealth Series, volume 2. 2010. Available from: http://apps.who.int/iris/bitstream/handle/10665/44497/9789241564144_eng.pdf;jsessionid=739641AF82AA4B3B5E5365C4889CF777?sequence=1 Accessed 18 March 2018.

12. Johnston S, MacDougall M, McKinstry B. The use of video consulting in general practice: semi-structured interviews examining acceptability to patients. J Innov Health Inform 2016;23: 493–500.

13. Raven M, Butler C, Bywood P. Video-based telehealth in Australian primary health care: current use and future potential. Aust J Prim Health 2013;19: 283–286. pmid:24134865

14. Dorsey ER, Topol EJ. State of telehealth. New Engl J Med 2016;375: 154–161. pmid:27410924

15. Wakerman J, Humphreys JS, Wells R, Kuipers P, Entwistle P, Jones J. Primary health care delivery models in rural and remote Australia—a systematic review. BMC Health Service Research 2008;8: 276.

16. Henry BW, Block DE, Ciesla JR, Kuipers P, Entwistle P, Jones J. Clinician behaviors in telehealth care delivery: a systematic review. Adv Health Sci Educ 2017;22: 869–888.

17. Hirsh AT, Atchison JW, Berger JJ, Lafayette-Lucey A, Bulcourf BB, Robinson ME. Patient satisfaction with treatment for chronic pain predictors and relationship to compliance. Clin J Pain 2005;21: 302–310. pmid:15951647

18. Barbosa CD, Balp MM, Kulich K, Germain N, Rofail D. A literature review to explore the link between treatment satisfaction and adherence, compliance, and persistence. Patient Pref Adherence 2012;6: 39–48.

19. Ekeland AG, Bowes A, Flottorp S. Methodologies for assessing telemedicine: a systematic review of reviews. Int J Med Inform 2012;81: 1–11. pmid:22104370

20. Hilgart JS, Hayward JA, Coles B. Telegenetics: a systematic review of telemedicine in genetics services. Genet Med 2012;14: 765–776.

21. Kruse CS, Krowski N, Rodriguez B. Telehealth and patient satisfaction: a systematic review and narrative analysis. BMJ Open 2017;7: e016242. pmid:28775188

22. Innes A, Morgan D, Kostineuk J. Dementia care in rural and remote settings: a systematic review of informal/family caregiving. Maturitas 2011;68: 34–46. pmid:21093996

23. Butow PN, Phillips F, Schweder J, White K, Underhill C, Goldstein D et al. Psychosocial well-being and supportive care needs of cancer patients living in urban and rural/regional areas: a systematic review. Support Care Cancer 2012;20: 1–22.

24. Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. The PRISMA Group: preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009;6: e1000097. pmid:19621072

25. Law M, Stewart D, Pollock N, Letts L, Bosch J, Westmorland M et al. Critical review form-quantitative studies. McMaster University. 1998. Available from: https://srs-mcmaster.ca/wp-content/uploads/2015/04/Critical-Review-Form-Quantitative-Studies-English.pdf Accessed 30 December 2017.

26. Letts L, Wilkins S, Law M, Stewart D, Bosch J, Westmorland M. Guidelines for critical review form: qualitative studies (version 2.0). McMaster University. 2007. Available from: https://srs-mcmaster.ca/wp-content/uploads/2015/04/Critical-Review-Form-Qualitative-Studies-Version-2-1.pdf Accessed 30 December 2017.

27. Hsieh HL, Tsai CH, Chih WH, Lin HH. Factors affecting success of an integrated community-based telehealth system. Technol Health Care 2015;23: S189–S196. pmid:26410483

28. Mashru J, Kirlew M, Saginur R, Schreiber YS. Management of infectious diseases in remote northwestern Ontario with telemedicine videoconference consultations. J Telemed Telecare 2017;23: 83–87. pmid:26748393

29. Burns CL, Ward EC, Hill AJ, Malcolm K, Bassett L, Kenny LM, et al. A pilot trial of a speech pathology telehealth service for head and neck cancer patients. J Telemed Telecare 2012;18: 443–446. pmid:23209274

30. Grogan-Johnson S, Alvares R, Rowan L, Creaghead N. A pilot study comparing the effectiveness of speech language therapy provided by telemedicine with conventional on-site therapy. J Telemed Telecare 2010;16: 134–139. pmid:20197354

31. Hanlon-Dearman A, Edwards C, Schwab D. ‘‘Giving voice”: evaluation of an integrated telehealth community care model by parents/ guardians of children diagnosed with fetal alcohol spectrum disorder in Manitoba. Telemed J E Health 2014;20: 478–484. pmid:24568178

32. Hassija C,Gray MJ. The effectiveness and feasibility of videoconferencing technology to provide evidence-based treatment to rural domestic violence and sexual assault populations. Telemed J E Health 2011;17: 309–315. pmid:21457012

33. Mooi JK, Whop LJ, Valery PC, Sabesan SS. Teleoncology for Indigenous patients: the responses of patients and health workers. Aust J Rural Health 2012;20: 265–269. pmid:22998201

34. Morland LA, Mackintosh MA, Greene CJ, Rosen CS, Chard KM, Resick P et al. Cognitive processing therapy for posttraumatic stress disorder delivered to rural veterans via telemental health: a randomized noninferiority clinical trial. J Clin Psychiatry 2014;75: 470–476. pmid:24922484

35. Polinski JM, Barker T, Gagliano N, Sussman A, Brennan TA, Shrank WH. Patients’ satisfaction with and preference for telehealth visits. J Gen Intern Med 2016;31: 269–75. pmid:26269131

36. Poulsen KA, Millen CM, Lakshman UI, Buttner PG, Roberts LJ. Satisfaction with rural rheumatology telemedicine service. Int J Rheum Dis 2015;18: 304–314. pmid:25530007

37. Qiang JK, Marras C. Telemedicine in Parkinson's disease: a patient perspective at a tertiary care centre. Parkinsonism Relat Disord 2015;21: 525–528. pmid:25791380

38. Ramkumar V, Selvakumar K, Vanaja CS, Hall JW, Nagarajan R, Neethi J et al. Parents' perceptions of tele-audiological testing in a rural hearing screening program in South India. Int J Pediatr Otorhinolaryngol 2016;89: 60–66. pmid:27619030

39. Roberts S, Spain B, Hicks C, London J, Tay S. Telemedicine in the Northern Territory: an assessment of patient perceptions in the preoperative anaesthetic clinic. Aust J Rural Health 2015;23: 136–141. pmid:25615954

40. Sabesan S, Simcox K, Marr I. Medical oncology clinics through videoconferencing: an acceptable telehealth model for rural patients and health workers. Intern Med J 2012;42: 780–785. pmid:21627743

41. Schein RM, Schmeler MR, Saptono A, Brienza D. Patient satisfaction with telerehabilitation assessments for wheeled mobility and seating. Assistive Technology 2010;22: 215–222. pmid:21306067

42. Simpson S, Bell L, Knox K, Mitchell D. Therapy via videoconferencing: a route to client empowerment? Clin. Psychol. Psychother 2005;12: 156–165.

43. Ward EC, Burns CL, Theodoros DG, Russell TG. Evaluation of a clinical service model for dysphagia assessment via telerehabilitation. Int J Telemed Appl 2013: 918526. pmid:24381589

44. Weinerman B, Den Duyf J, Hughes A, Robertson S. Can subspecialty cancer consultations be delivered to communities using modern technology?—a pilot study. Telemed J E Health 2005;11: 608–615. pmid:16250826

45. Zilliacus EM, Meiser B, Lobb E, Kirk J, Warwick L, Tucker K. Women’s experience of telehealth cancer genetic counseling. J Genet Couns 2010;19: 463–472. pmid:20411313

46. Davis LE, Coleman J, Harnar J, King MK. Teleneurology: successful delivery of chronic neurologic care to 354 patients living remotely in a rural state. Telemed J E Health 2014;20: 473–477. pmid:24617919

47. Lea DH, Johnson JL, Ellingwood S, Allan W, Patel A, Smith R. Telegenetics in Maine: successful clinical and educational service delivery model developed from a 3-year pilot project. Genet Med 2005;7: 21–27. pmid:15654224

48. Powers BB, Homer MC, Morone N, Edmonds N, Rossi MI. Creation of an interprofessional teledementia clinic for rural veterans: preliminary data. J Am Geriatr Soc 2017; 65: 1092–1099. pmid:28295142

49. Saifu HN, Asch SM, Goetz MB, Smith JP, Graber CJ, Schaberg D et al. Evaluation of human immunodeficiency virus and hepatitis C telemedicine clinics. Am J Manag Care 2012;18: 207–212. pmid:22554009

50. Siminerio L, Ruppert K, Huber K, Toledo FG. Telemedicine for reach, education, access, and treatment (TREAT): linking telemedicine with diabetes self-management education to improve care in rural communities. Diabetes Educ 2014;40: 797–805. pmid:25253624

51. Grindlay K, Lane K, Grossman D. Women’s and providers’ experiences with medical abortion provided through telemedicine: a qualitative study. Womens Health Issues 2013;23: e117–e122. pmid:23410620

52. AlAzab R, Khader Y. Telenephrology application in rural and remote areas of Jordan: benefits and impact on quality of life. Rural Remote Health 2016;16: 3646. pmid:26745230

53. Bradbury A, Patrick-Miller L, Harris D, Stevens E, Egleston B, Smith K et al. Utilizing remote real-time videoconferencing to expand access to cancer genetic services in community practices: a multicenter feasibility study. J Med Internet Res 2016;18: e23. pmid:26831751

54. López C, Valenzuela JI, Calderón J, Velasco AF, Fajardo R. Telephone survey of patient satisfaction with realtime telemedicine in a rural community in Colombia. J Telemed Telecare 2011;17: 83–87. pmid:21139016

55. Mendez I, Jong M, Keays-White D, Turner G. The use of remote presence for health care delivery in a northern Inuit community: a feasibility study. Int J Circumpolar Health 2013;72: 21112.

56. Meropol NJ, Daly MB, Vig HS, Manion FJ, Manne SL, Mazar C et al. Delivery of Internet-based cancer genetic counselling services to patients’ homes: a feasibility study. J Telemed Telecare 2011;17: 36–40. pmid:21097566

57. Watanabe SM, Fairchild A, Pituskin E, Borgersen P, Hanson J, Fassbender K. Improving access to specialist multidisciplinary palliative care consultation for rural cancer patients by videoconferencing: report of a pilot project. Support Care Cancer 2013;21: 1201–1207. pmid:23161339

58. Friesner D, Scott DM. Exploring the formation of patient satisfaction in rural community telepharmacies. J Am Pharm Assoc 2009;49: 509–518.

59. Abrams DJ, Geier MR. A comparison of patient satisfaction with telehealth and on-site consultations: a pilot study for prenatal genetic counselling. J Genet Couns 2006;15: 199–205. pmid:16779676

60. Saqui O, Chang A, McGonigle S, Purdy B, Fairholm L, Baun M et al. Telehealth videoconferencing: improving home parenteral nutrition patient care to rural areas of Ontario, Canada. J Parenter Enteral Nutr 2007;31: 234–239.

61. Tokuda L, Lorenzo L, Theriault A, Taveira TH, Marquis L, Head H et al. The utilization of video-conference shared medical appointments in rural diabetes care. Int J Med Inform 2016;93: 34–41. pmid:27435945

62. Ferris DG, Litaker MS, Gilman PA. Patient acceptance and the psychological effects of women experiencing telecolposcopy and colposcopy. J Am Board Fam Pract 2003;16: 405–411. pmid:14645331

63. Hilty DM, Nesbitt TS, Kuenneth CA. Rural versus suburban primary care needs, utilization, and satisfaction with telepsychiatric consultation. J Rural Health 2007;23: 163–165. pmid:17397373

64. Collins T, Burns CL, Ward EC, Comans T, Blake C, Kenny L et al. Home-based telehealth service for swallowing and nutrition management following head and neck cancer treatment. J Telemed Telecare 2017;23: 866–872. pmid:29081270

65. Dodakian L, McKenzie AL, Le V, See J, Pearson-Fuhrhop K, Burke Quinlan Eet al. A home-based telerehabilitation program for patients with stroke. Neurorehabil Neural Repair 2017;31: 923–933. pmid:29072556

66. Gros DF, Lancaster CL, López CM, Acierno R. Treatment satisfaction of home-based telehealth versus in-person delivery of prolonged exposure for combat-related PTSD in veterans. J Telemed Telecare 2018;24: 51–55. pmid:27672059

67. Interian A, King AR, St. Hill LM. Evaluating the implementation of home-based videoconferencing for providing mental health services. Psychiatry Service 2018;69: 69–75.

68. Calvillo J, Roman I, Roa LM. How technology is empowering patients? A literature review. Health Expect 2015;18: 643–652. pmid:23711169

69. Tennant B, Stellefson M, Dodd V, Chaney B, Chaney D, Paige S et al. eHealth Literacy and Web 2.0 Health Information Seeking Behaviors Among Baby Boomers and Older Adults. J Med Internet Res 2015;17: e70. pmid:25783036

70. Bradford NK, Caffery LJ, Smith AC. Telehealth services in rural and remote Australia: a systematic review of models of care and factors influencing success and sustainability. Rural Remote Health 2016;16: 4268. pmid:27817199

71. Brophy PD. Overview on the challenges and benefits of using telehealth tools in a pediatric population. Adv Chronic Kidney Dis 2017;24: 17–21. pmid:28224938

72. Scott RE, Mars M. Telehealth in the developing world: current status and future prospects. Smart Homecare Technol Telehealth 2015;3: 25–37.

73. Lorié A, Reinero DA, Phillips M, Zhang L, Riess H. Culture and nonverbal expressions of empathy in clinical settings: a systematic review. Patient Educ Couns 2017;100: 411–424. pmid:27693082

74. October TW, Hinds PS, Wang J, Dizon ZB, Cheng YI, Roter DL. Parent satisfaction with communication is associated with physician patient-centered communication patterns during family conferences. Pediatr Crit Care Med 2016;17: 490–497. pmid:27058750

75. Ruberton PM, Huynh HO, Miller TA, Kruse E, Chancellor J, Lyubomirsky S. The relationship between physician humility, physician–patient communication, and patient health. Patient Educ Couns 2016;99: 1138–1145. pmid:26830544

76. Ventres WB, Frankel RM. Shared Presence in Physician-Patient Communication: A Graphic Representation. Fam Syst Health 2015;33: 270–279. pmid:26075882

77. Gill L, White L. A critical review of patient satisfaction. Leadersh Health Service 2009;22: 8–19.