Published on 21.05.19 in Vol 21, No 5 (2019): May
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/13117, first published Dec 12, 2018.
Theories Predicting End-User Acceptance of Telemedicine Use: Systematic Review
Background: Only a few telemedicine applications have made their way into regular care. One reason is the lack of acceptance of telemedicine by potential end users.
Objective: The aim of this systematic review was to identify theoretical predictors that influence the acceptance of telemedicine.
Methods: An electronic search was conducted in PubMed and PsycINFO in June 2018 and supplemented by a hand search. Articles were identified using predefined inclusion and exclusion criteria. In total, two reviewers independently assessed the title, abstract, and full-text screening and then individually performed a quality assessment of all included studies.
Results: Out of 5917 potentially relevant titles (duplicates excluded), 24 studies were included. The Axis Tool for quality assessment of cross-sectional studies revealed a high risk of bias for all studies except for one study. The most commonly used models were the Technology Acceptance Model (n=11) and the Unified Theory of Acceptance and Use of Technology (n=9). The main significant predictors of acceptance were perceived usefulness (n=11), social influences (n=6), and attitude (n=6). The results show a superiority of technology acceptance versus original behavioral models.
Conclusions: The main finding of this review is the applicability of technology acceptance models and theories on telemedicine adoption. Characteristics of the technology, such as its usefulness, as well as attributes of the individual, such as his or her need for social support, inform end-user acceptance. Therefore, in the future, requirements of the target group and the group’s social environment should already be taken into account when planning telemedicine applications. The results support the importance of theory-guided user-centered design approaches to telemedicine development.
J Med Internet Res 2019;21(5):e13117
Definition and Delimitation of Telemedicine and Related Terms
Telemedicine, as well as every other digital health technology, comes with the promise of changing care delivery for the better, be it by reaching traditionally underserved regions  or populations [ ] or by enhancing patient-provider communication to facilitate shared decision making [ ].
Digital health care is known under various terms, for example, telemedicine, electronic health (eHealth), telehealth, or, as new digital devices came to be used, mobile health (mHealth). This study focused on telemedicine, as telemedicine involves health care services being delivered by health care providers in a patient-centered manner, from a geographical distance, using ICT (Information and Communication Technology) . The term is hereby clearly delimitated from other modes of digital care delivery. eHealth, for example, also encompasses electronic management of patient data, whereas telehealth covers the use of Internet of Things to enable self-management of health and the quantified self [ ].
Acceptance and Diffusion of Telemedicine
The possibly high potential of telemedicine can only be fulfilled if telemedicine reaches a high diffusion throughout the health care system. Nevertheless, although being used for over 50 years now , telemedicine still does not mostly overcome the pilot project stage [ ] and therefore never prevails in regular care [ , ]. Among the most commonly used applications are those enabling digital data storage and exchange or telecounseling for diagnostic purposes [ , ]. Those, however, are not covered by the definition of telemedicine, as care is not directly delivered to the patient. Therefore, patient acceptance is not a relevant factor for those applications.
Rogers argues that innovations that are compatible with their environment are more easily adopted than those that are not suitable to past experiences of the adoption units . However, telemedicine entails changes in patient-provider communication, patient assessment, and engagement [ , ]. As Riley et al argue, many of the applications deploy so-called cues to action, demanding behavior change by the end user [ ].
Therefore, it is necessary to study the factors influencing end-user acceptance of telemedicine, even more so as acceptance is a prerequisite for adoption of an innovation and therefore its diffusion . Nevertheless, acceptance is often reduced to the study of the usability, that is, certain design features of technology [ ]. For the implementation of Health Information Systems, Ifinedo finds factors influencing Canadian nurses’ acceptance to go way beyond technical features [ ]. Therefore, Hastall et al call for a holistic assessment of acceptance, incorporating not only features of the technology but also characteristics of the end user [ ]. When structuring this holistic approach by studying individual, social, environmental, and technological factors of acceptance they recur on behavioral models of acceptance that have been proven to be effective in predicting behavior change in all sorts of health interventions—for example, by Sahay et al [ ].
Theoretical Background of Technology Acceptance
The oldest yet still widely used model for health behavior change is the Health Belief Model (HBM) that focuses on the individual assessment of vulnerability, outcomes and costs of behavior change, and external cues toward behavior change . It can be applied, in combination with other theories, to explain user’s acceptance of wearables [ ], which suggests transferability to telemedicine.
On the basis of the focus of the HBM on individual perceptions, the Theory of Reasoned Action (TRA) was formulated, also focusing on the attitude toward the intended outcome behavior but adding measures of subjective norm, that is, the perception of the behavior in question by those whose opinion is valued by the individual . TRA is applicable for predicting attitude toward the use of a teleconsultation system in neurology [ ]. Perceived control over one’s own health was added to the theory later on, developing the Theory of Planned Behavior (TPB) [ ]. The TPB is applicable to the use of fitness apps [ ]. TRA and TPB constructs were used by Davis to explain acceptance of technology as a precondition for its use. The Technology Acceptance Model (TAM), along with several additions, defines use as predicted by attitude toward the use, which again is a function of perceived usefulness and perceived ease of use, both being value judgements of the design features [ ]. The TAM was further developed by Venkatesh, adding several components from previous behavioral theories, such as performance and outcome expectancy from the Social Cognitive Theory [ ] and subjective norm from TRA and TPB [ ]. His final model is called the Unified Theory of Acceptance and Use of Technology (UTAUT). As relevant predictors of acceptance vary between these 2 models, so do the definitions of technology acceptance within the models. Although in the TAM, acceptance is defined as “actual system use” [ ], in the UTAUT, it is defined as “use behavior” [ ]. Nevertheless, both models aim to study acceptance. Both TAM and UTAUT have been used excessively to explain the use of several digital health applications, such as data sharing systems [ ] and assessment tools for cognitive functions [ ].
In contrast to the aforementioned theories, where acceptance or use is a dependent variable, Normalization Process Theory postulates that collective action—that is, for the purpose of this paper, technology use—is one of several highly interconnected variables. Among them are group processes and organizing structures .
In addition to the predictors derived from the theories and models, other variables may have the potential to determine individual peoples’ willingness to use telemedicine. The nonadoption, abandonment, scale-up, spread, and sustainability (NASSS) framework lists several possible domains challenging the implementation process of telemedicine. The individual end user, on whom this study focuses, according to the NASSS framework, interacts with the organizational and societal context and is constrained by his or her medical status, as well as technological features . The authors of the NASSS framework conclude that there is a lack of theoretical foundation for individual adoption processes. Such, the UTAUT is especially suitable to close this research gap, as it also encompasses the organizational and technological infrastructure in which the individual acceptance unit lives [ ].
There is scarce evidence on which theory or model of technology acceptance or health behavior change is best suited to explain the acceptance and therefore use of telemedicine, as defined above [, ]. Lai gives a comprehensive review on existing technology acceptance models and theories [ ]. Evidence synthesis of theoretical predictors can be found solely for the acceptance of health information systems, such as eHealth records [ ], yet it is not found for telemedicine defined as narrow as it is defined by Sood et al [ ].
Individual studies that focus on theoretical components as predictors of the acceptance of telemedicine exist. However, there is still no systematic overview of theoretical components that are able to empirically explain the acceptance of telemedicine. This study aimed to fill this void by answering the following research question:
Which theoretical components are empirically associated with end-user acceptance of telemedicine?
This systematic review was conducted according to the standardized strategy provided by the Cochrane Collaboration , and it also follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist [ ]. A review protocol was created a priori and published at Prospero (Number CRD42018098658).
Inclusion and Exclusion Criteria
The Population, Intervention, Comparison, Outcome, and Study Design (PICOS) criteria were used for deriving the inclusion and exclusion criteria for the review . As this review aimed to explain the acceptance of telemedicine, and not the effectiveness, the comparison was omitted. The population studied included patients and health care providers as well as their respective direct social environment. As the term telemedicine is not consistently used, it cannot be clearly delimitated from related terms. Therefore, terms such as eHealth and mHealth were also part of the search strategy. Studies examining telemedicine that was used to deliver health care services in a patient-centered manner over a geographical distance were included. If this was not the case, those studies were excluded during the full-text assessment at the latest. Only studies aiming to explain end-user acceptance as a primary outcome using a theoretical underpinning were included. As the explanatory power of theoretical components was to be identified, only quantitative research designs were included. The same is true for studies published in English and German and for studies published in peer-reviewed journals. A further specification of the inclusion and exclusion criteria can be found in .
The search string was a combination of the building blocks of the PICOS. Electronic searches were conducted in PubMed, as it is the most important and conclusive database for medical research, and PsycINFO in June 2018. PsycINFO was chosen as it is a database for psychological research, and it was therefore deemed likely to list studies featuring theoretical foundations for technology acceptance. For PubMed, Medical Subject Headings terms were used, whereas for PsycINFO, the functional equivalent, that is, the Thesaurus, was used. The term telemedicine is used ambiguously and partly synonymously with others . As there are applications that are not explicitly called telemedicine but meet the telemedicine definition [ ], different digital health terms, such as eHealth, mHealth, and telehealth, were included in the search string. The database-specific search strings can be found in the appendix (see ).
A hand search was conducted. In addition to a forward search in Web of Science, major publications in the field of telemedicine were searched, such as Telemedicine and eHealth and the Journal of Medical Internet Research. In addition, a search took place in the Institute of Electrical and Electronics Engineers Xplore database, which appears not to be designed for comprehensive search strings. To cover the research fields of informatics and information systems, a hand search was also conducted in the journals Management Information Systems Quarterly and the American Journal of Information Systems. References of the included studies were assessed to identify landmark studies, that is, those cited by more than one of the included papers.
|Category||Inclusion criteria||Exclusion criteria|
|Population||Patients, social environment (relatives and peers or peer groups), and health care providers||Nonhuman populations, not patients, not health care providers, and veterinarians|
|Intervention||Telemedicine-delivered patient-centered health care services with involvement of health care providers||No telemedicine, that is, no patient-centered health care services delivered, no involvement of health care providers|
|Outcome||Acceptance of health technologies on the basis of theoretical components||No theory-based factors (derived from correlations, causal models, eg, multivariate regression analyses or Structural Equation Modeling or effect strengths calculated from group comparisons), no statements about acceptance, and theories|
|Study design||Intervention studies (randomized or nonrandomized controlled trials), observational studies (cohort studies, cross-sectional studies, and case-control studies), and studies published in English or German language||Qualitative studies (in-depth interviews, expert interviews, focus groups, and delphi), reviews, editorials, letters to the editor, studies not published in English or German, or not published in peer-reviewed journals|
Identification and Selection of Studies
Predefined inclusion criteria were applied independently by 2 raters (LH and HL) to screen for potentially relevant titles and abstracts within all studies obtained from the database and the hand search. In a next step, all possibly eligible studies were subsequently screened as full texts, also by 2 independent reviewers (LH and HL). Articles that did not meet the aforementioned inclusion criteria were excluded. Each of the 2 reviewers documented the reasons for exclusion so that a direct comparison was possible and a transparent procedure was ensured. Any disagreement over the suitability of certain studies was discussed among the raters and resolved by consensus.
Data Extraction and Presentation
Study characteristics (bibliographical information, study design, study population, type of telemedicine application, theoretical model or theory, and statistical methods) were extracted independently by the 2 reviewers (LH and HL). Statistical methods encompassed the dependent variable, significant predictors (rooted within theory), and measures for internal consistency and reliability as reported by the authors of the included studies, as well as the statistical analysis conducted. Disagreements were discussed, and a consensus between both extractors was reached. The entire extraction table was discussed by all authors (LH, HL, and MS). Only those predictors rooted within acceptance theories or models were extracted, which eliminated those added by the authors of the included studies to increase the variance explained. Both restrictions are in line with the research question.
For all theories discovered, as well as all the significant predictors, first frequencies and then variances explained and effect strengths were presented in tables. Afterward, median variance that was explained by each study, and median effect strengths of the theoretical predictors used within each study were also calculated and presented in tables. The median is a proper measure, as it is “the middle score of a set of ordered observations” . Therefore, all statistical values for variance explained (R²) and each predictor (odds ratios [ORs] and betas) were listed and the middle value was either discernible (in an uneven list of values) or calculated as the arithmetic mean of the 2 middle values (in an even list of values) [ ].
Assessment of Methodological Quality
Quality assessment was conducted using the Appraisal Tool for Cross-Sectional Studies (AXIS Tool) for quantitative studies . Quality assessment was conducted by 2 authors (LH and HL) independently. The focus of the assessment procedure was on methodological issues, such as the selection of study participants, the reliability and validity of the outcome measurements, and the consideration of potential confounding factors and bias in the results. On the basis of these criteria, an evaluation was carried out on a 2-step scale from 0=not satisfyingly explained to 1=satisfyingly explained. If items concerning methods and results (as explained above) were all rated 1, the risk of bias within the results of the study was deemed low, otherwise, it was deemed high.
The electronic database search resulted in 6188 potentially eligible articles. A hand search resulted in a total of 13 additional studies. After removing 283 duplicates, 5821 articles were excluded by independent screening of titles and abstracts. Of the resulting 97 full texts, 73 were excluded, as they did not meet the inclusion criteria. The main reason for study exclusion was the use of an inadequate intervention, that is, the intervention studied did not fall within the definition of telemedicine (36 times). For studies where the full text was not available, the authors were contacted. Owing to nonresponse, 7 full texts could not be procured until the end of August 2018.
Finally, 24 papers met the predefined inclusion criteria and formed the basis for data extraction. A total of 20 of the papers resulted from the application of the search strings in PubMed and PsycINFO, whereas 4 additional ones were uncovered by hand search. A total of 3 of the 4 were found in relevant journals in the field of telemedicine and information systems research and by checking references of the included studies for landmark studies, the third relevant study was included. The PRISMA flow chart inshows the process of the study selection.
A list of studies excluded during full-text screening, complete with the reasons for exclusion, can be found in the appendix (see). shows the most important data extracted for each study. For a list of all extracted data, please see .
|Author (year); Journal||Theoretical model or theory||Components of the model or theory with significant explanatory power||Effect strength and significancea|
|Health care provider|
|Asua et al (2012); BMC Medical Informatics and Decision Making||TAMb; DOIc; TIBd||PUe (TAM); PEOUf (TAM); Extended TAM: Compatibility (DOI); Facilitators (TIB)||Original Technology Acceptance Model: PU: ORg 5.28h (95% CI 3.14 to 10.01); PEOU: OR 1.93i (95% CI 1.11 to 2.37); Final Model: Nagelkerke R²=0.63; Extended TAM: PU: OR 2.65i (95% CI 1.15 to 6.12); Compatibility: OR 3.06j (95% CI 1.30 to 7.18); Facilitators: OR 4.90h (95% CI 2.38 to 10.09); Final model: Nagelkerke R²=0.72|
|Gagnon et al (2012); Telemedicine and e-health||TAM||PU (TAM); Modified model: Facilitators (TIB)||Original Technology Acceptance Model:; PU: OR 5.28h (95% CI 2.12 to 13.11); Nagelkerke R²=0.42; Modified model: Facilitators: OR 4.96j (95% CI 1.59 to 15.55); Final model: Nagelkerke R²=0.54|
|Hennemann et al (2017); Journal of Health Communication||UTAUTk||SIl; PEm||SI: beta=.37h (95% CI 0.25 to 0.61); PE: beta=.28h (95% CI 0.12 to 0.44); Final model: R²=0.63|
|James et al (2016); Journal of Diabetes Science and Technology||TAM||PEOU; SNn||Independent Predictors of Diabetes Educators’ Intentions to Use; Apps: PEOU: OR 1.15i (95% CI 1.07 to 1.31); Final model: R²=0.71; Video conferencing:; PEOU: OR 1.21h (95% CI 1.08 to 1.35); SN: OR 1.21j (95% CI 1.07 to 1.37); Final model: R²=0.68|
|Kuhn et al (2015); Professional Psychology: Research and Practice||DOI||Complexity||Complexity: OR .35h (95% CI 0.23 to 0.55); Final model: Nagelkerke R²=0.53|
|Orruño et al (2011); Journal of Telemedicine and Telecare||TAM; TIB; TRAo||PU (TAM); PEOU (TAM); Facilitators (TIB)||Original Technology Acceptance Model; PU on intention: OR 8.4,h (95% CI 3.4 to 21.0); PEOU on intention: OR 7.4,h (95% CI 2.9 to 19.0); Nagelkerke R²=0.71; Modified Technology Acceptance Mode: Facilitators on intention: OR 9.9h (95% CI 2.80 to 34.94); Final model: Nagelkerke R²=0.78|
|Saigi-Rubió et al (2014); Implementation Science||TAM; DOI; TRA; TPB; TRp||Level of ICT use (TR); Optimism (TR)||Technology Readiness Index: Level of ICT Use (Spain): b=2.661j; Level of ICT Use (Columbia): b=1.212j; Optimism (Bolivia): b=0.484h; Final model: Nagelkerke R² (Spain): 0.275; Nagelkerke R² (Columbia): 0.161; Nagelkerke R² (Bolivia): 0.197|
|Saigi-Rubió et al (2016); International Journal of Technology Assessment in Health Care||TAM; TPB; TRA||PU (cost reduction, quality of care; TAM); ATTq (confidentiality and security; TAM); SNr (patients, medical staff; TRA)||PU (cost reduction) on BIs: b=1.342i; ATT (security and confidentiality) on BI: b=0.798i; SN (patients) on BI: b=.583j; SN (medical staff) on BI: b=1.005j; Moderations: SN (patients)xPU (quality of care) on BI: b=.347j; SN (patients)xPU (cost reduction) on BI: b=.462i; SN (medical stuff)xPU (quality of care) on BI: b=.366i; SN (medical stuff)xPU (cost reduction) on BI: beta=.488i; SN (administration)xPU (cost reduction) on BI: beta=.571i; Final model: Nagelkerke R²=0.481; CI NSt|
|Spaulding et al (2005); Journal of Telemedicine and Telecare||DOI||Relative advantage (provider); Relative advantage (patient); Observability; Trialability; Opinion leader present||Relative advantage (provider): r=0.42i; Relative advantage (patient): r=0.42i; Observability: r=0.57i; Trialability: r=0.44i; Opinion leader present: r=0.52i; CI NS|
|van Houwelingen et al (2015); Journal of Gerontological Nursing||UTAUT||PU; EEu; SI||PU: beta=.435h; EE: beta=.28h; SI: beta=.216i; Final model: R²=0.54; CI NS|
|Vanneste et al (2013); BMC Medical Informatics and Decision Making||UTAUT; SCTv||FCw (UTAUT); SE (SCT)||FC: beta=.287h; SE: beta=.218h; Final model: R²=0.308; CI NS|
|Zhang et al (2010); Computers, Informatics, Nursing||TAM 2||SN; IMx; PEOU; PU||SN: beta=.323j; IM: beta=.227j; PEOU: beta=.35j; PU: beta=.422h; R²=0.375; CI NS|
|Cajita et al (2017); Journal of Cardiovascular Nursing||TAM; TIB||PEOU (TAM); PU (TAM)||Block 5: change in R²=0.095h; PEOU: beta=.16h (95% CI 0.07 to 0.24); Block 6: change in R²=0.130h; PU: beta=.33h (95% CI 0.24 to 0.41), Final model: R²=0.353|
|de Veer et al (2015); BMC Health Services Research||UTAUT||PE; EE; SE||PE: Block 2: beta=.52h; Block 3: beta=.24h; Block 4: beta=.24h; Final model: beta=.24h; EE: Block 3: beta=.42h; Block 4: beta=.42h; Final model: beta=.35h; SE: Final model beta=.01j; Final model: R²=0.41; CI NS|
|Dockweiler et al (2017); Gesundheitswesen||UTAUT||PE; EE||PE (5 significant variables); average effect: OR 11.325i (95% CI 2.666 to 49.015); EE (2 significant variables); average effect: OR 0.121i (95% CI 0.022 to 0.685); Final model: R²= 0.765|
|Dou et al (2017); JMIR Mhealth Uhealth||TAM; TAM 2; Dual-Factor model; HBMy||PU (TAM); PHTz (HBM); Resistance to change (Dual-Factor Model)||PU on intention to use: beta=.616j; PHT on intention to use: beta=.305j; resistance to change on intention to use: beta=−.149i; Final model: R²=0.412; CI NS|
|Hennemann et al (2016); Journal of Medical Internet Research||UTAUT||SI; PE; EE||SI: beta=.39j (95% CI 0.3 to 0.54); PE: beta=.31h (95% CI 0.19 to 0.43); EE: beta=.22h (95% CI 0.09 to 0.31); Final model: R²=0.78|
|Hossain et al (2018); Telemedicine and e-Health||UTAUT; TAM||Social reference (means SI; UTAUT); ATT (TAM); FC (UTAUT)||SR: OR 9.73j (95% CI 4.16 to 22.78); ATT: OR 4.56j (95% CI 2.71 to 7.66); FC: OR 3.92i (95% CI 1.29 to 11.95); Final model: R²=0.55|
|Huygens et al (2015); Interactive Journal of Medical Research||UTAUT||EE; PE; FC; SI; ATT||Service to ask questions by internet via email or a website: EE: OR 5.46 (95% CI 3.27 to 9.13); PE: OR 5.47 (95% CI 3.44 to 8.70); ATT: OR 5.85 (95% CI 3.63 to 9.43); FC: OR 7.91 (95% CI 4.53 to 13.82); SI: OR 4.34 (95% CI 2.46 to 7.68); No levels of significance reported|
|Lin and Yang (2009); Telemedicine and e-Health||TAM||PU; ATT; SN; PEOUxATT; PUxATT; SNxATT||Direct effects: ATTon BI (lambda=.76j); SN on BI (lambda=.16i); Total effects; ATT on BI (lambda=.76j); PU on BI (lambda=.62j); SN on BI (lambda=.42j); PEOU on BI (lambda=.3j); Final Model: R²=0.8; CI NS|
|Peeters et al (2012); Journal of Clinical Nursing||DOI||Relative advantage; Compatibility; Complexity; Observability||Relative advantage: beta=.17i; Compatibility: beta=.2j; Complexity: beta=.19j; Observability: beta=.34h; Final model: R²=0.61; CI NS|
|Rho et al (2015); Cluster Computing||UTAUT||PE; EE; SI; FC on EE; FC on PE||PE: beta=.345j; EE: beta=.227i; SI: beta=.246i; FCxPE on BI: beta=.176j; FCxEE on BI : beta=.153j; Final model: R²=0.44; CI NS|
|Zhang et al (2017); Informatics for Health and Social Care||TAM; SCT; PMT||PU (TAM); PEOU (TAM)*PU; SE (Protection Motivation Theory)*PEOU*PU* AI; RE (Response Efficacy)*PEOU*PU*AI; RE (Protection Motivation Theory)*PEOU*PU* AI||Direct effect:; PU: beta=.3h; Moderator:; PUxSE: beta=.145j; PUxRE: beta=.359h; Final model: R²=0.501; CI NS|
|Jen and Hung (2010); Telemedicine and e-Health||TPB; TAM||ATT; PU; PEOU||BI of adopting Mobile Health Services is explained directly by ATT; ATT on BI (beta=.547j); Final model: R²=0.641 of the variance in BI; CI NS|
aItalics serve as subheadings for stepwise models.
bTAM: Technology Acceptance Model.
cDOI: Diffusion of Innovations Theory.
dTIB: Theory of Interpersonal Behavior.
ePU: Perceived Usefulness.
fPEOU: Perceived Ease of Use.
gOR: odds ratio.
kUTAUT: Unified Theory of Acceptance and Use of Technology.
lSI: Social Influence.
mPE: Performance Expectancy.
nSN: Social Norm.
oTRA: Theory of Reasoned Action.
pTR: Technology Readiness.
rSN: Social Norm.
sBI: Behavioral Intention.
tNS: not specified.
uEE: Effort Expectancy.
vSCT: Social Cognitive Theory.
wFC: Facilitating Conditions.
yHBM: Health Belief Model.
zPHT: perceived health threat.
The publishing years ranged from 2005 to 2017. Among the included studies, the Netherlands (4 times) and Spain (4 times) stand out. Only 1 study comes from a developing country, that is, Bangladesh. The number of journals from different research fields shows the conclusiveness of the conducted search.
All studies were cross-sectional studies. The number of participants ranged from 84 to 1014 (mean n=266.25 (SD 210.07), median n=228). Accordingly, acceptance was tested for using inferential statistics in all cases. Only 1 study did not apply causal statistics but merely a correlation analysis . Of the remaining 22, 7 conducted complex models of causality, Structural Equation Modeling (SEM) or Path Modeling. For the statistical analysis conducted within each study, see .
Only 1 study relied completely on an existing, previously tested questionnaire for the applied theory or model . All other studies applied self-developed questionnaires. However, a total of 3 studies did not specify how their questionnaire was tested for validity and reliability [ - ]. Of the remaining 20, 6 [ , - ]—those using SEM—applied confirmatory factor analysis, whereas the others relied on Cronbach alpha statistics [ , , - ].
The population is balanced regarding health care providers and patients, as both were studied 11 times. Only 1 study focused on the social environment, namely relatives, as the key population.
Only 8 of the included studies reported a mean age, ranging from 43.53 to 77.8 years. This led to an overall mean age of 53.72 (n=8) years. The overall mean age for patients was 61.93 years, whereas the overall mean age for health care providers was 47.1 years. The remaining 15 studies reported age groups with different cohorts, which makes it impossible to include them into calculations of an overall mean age.
The overall percentage of female participants was higher among the 10 studies focusing on health care providers (1 did not report on gender) than among the 11 studying patients’ acceptance (77.3 vs 41.4).
A wide variety of telemedicine applications were analyzed within the included studies. First, it should be noted that of the 24 studies, in 8 cases, the authors did not specify the type of telemedicine application they were studying, that is, they used generic terms such as eHealth [- ] or telemedicine [ , , ]. A total of 6 studies focused on mobile apps [ - , , , ], whereas 3 were concerned with applications based on internet devices, such as Web-based aftercare [ , , ]. A total of 2 applications were used for monitoring of disease parameters [ , ]. A total of 4 more applications targeted certain diseases [ , - ].
It is also noteworthy that even if a certain telemedicine application was focused on, sometimes the application did not (yet) exist. Instead, certain features were shown to the participants, who were then asked to imagine whether they would be willing to use the would-be application [, ].
Although it was intended beforehand to study acceptance relative to broader categories of telemedicine applications , the sometimes quite generic terms used in the included studies do not allow for such a nuanced analysis. For an overview of telemedicine applications studied, see .
Along with the concrete telemedicine application, a target disease or medical condition for which telemedicine was supposed to be used was also not stated in 8 of the included studies [- , - , , ]. A total of 8 studies dealt with the acceptance of telemedicine applications for chronic diseases, such as diabetes [ , ]. Furthermore, in 3 cases, mental health conditions were studied [ , , ]. Among the remaining medical conditions targeted were skin lesions [ ] and heart failure [ ]. For an overview of medical conditions studied, see .
Relevant Models and Predictors
Frequency of and Variance Explained by Theories and Models
The results are presented as follows: First, frequencies of the acceptance theories and models used within the 24 included studies are reported, along with their median variance explained, as calculated by the authors. Calculations were thought to be justified, as the theories and models studied proved applicable across a wide variety of telemedicine and medical conditions. Afterward, frequencies and median effect strengths of the predictors found to be significant by the included studies are presented. Throughout the Results section, a distinction regarding relevance of the theories and predictors will be made according to health care providers, patients, and their social environment (see).
As depicted in, the TAM is used 11 times within the included studies of this review, and therefore most often. The UTAUT, however, is used 9 times. It should be mentioned that the UTAUT was used 7 times, without any additional predictors from other models, whereas the same is true for the TAM only in 4 cases. Instead, it is used with a variety of other models, among them are the TRA [ , ] and the TPB [ ]. The so-called TAM 2, an extension of the original TAM, [ ] was used 2 times within the included studies.
Contradictory to that, the TAM still has the highest amount of variance explained among all the models included in this review: A median R² of 0.68 is achieved by the TAM, compared with an R² of 0.59 for the UTAUT. The TAM was used more often than the UTAUT, whether in combination or not.
The Diffusion of Innovations Theory by Rogers was used to explain acceptance far less (3 times), yet it still reaches a median R² of 0.57, which is, in part, because of the fact it was once used in combination with the TAM .
There was no other theory or model used alone, except for the TAM or the UTAUT, the Theory of Interpersonal Behavior (TIB) being one of the remaining, which was used in combination with others most often—3 times [, , ].
The most powerful combination of models is based on the TAM, adding components of the TIB and the TRA, with a variance explained of R²=0.78 . This R², however, is still lower than the one achieved by Lin and Yang, using only the TAM, which was 0.8 [ ]. The only significant predictor added by the TIB, according to Orruño et al, is the presence of facilitators. The TRA does not add significant predictors at all.
The TAM was used to explain acceptance of health care providers 7 times and 3 times for the acceptance of patients. The median proportion of variance explained by the TAM was higher for health care providers (R²=0.63) than for patients (R²=0.501).
The UTAUT was used more often to explain acceptance of patients than of health care providers (5 vs 3 times). For patients, its median explanatory power is also higher (R²=0.55) than for health care providers (R²=0.54). For frequencies of the models and theories, as well as their median variance explained, seeand . A complete list of combined models and theories can be found in the appendix ( ).
|Model/Theory||Frequency of use|
|Dual factor model||1|
|Health Belief Model||1|
|Protection Motivation Theory||1|
|Social Cognitive Theory||2|
|Technology Acceptance Model 2||2|
|Theory of Interpersonal Behavior||2|
|Theory of Planned Behavior||2|
|Theory of Reasoned Action||2|
|Diffusion of Innovations Theory||3|
|Unified Theory of Acceptance and Use of Technology||9|
|Technology Acceptance Model||11|
|Model/Theory and variance explained (per author)||Median variance explained|
|Technology Acceptance Model|
|0.35 (Cajita et al)||0.68|
|0.42 (Gagnon et al)||0.68|
|0.63 (Asua et al)||0.68|
|0.68 (James et al)||0.68|
|0.71 (James et al)||0.68|
|0.71 (Orruño et al)||0.68|
|0.80 (Lin and Yang)||0.68|
|Unified Theory of Acceptance and Use of Technology|
|0.41 (de Veer et al)||0.59|
|0.44 (Rho et al)||0.59|
|0.54 (van Houwelingen et al)||0.59|
|0.63 (Hennemann et al)||0.59|
|0.77 (Dockweiler et al)||0.59|
|0.78 (Hennemann et al)||0.59|
|Diffusion of Innovations Theory|
|0.53 (Kuhn et al)||0.57|
|0.61 (Peeters et al)||0.57|
|Technology Acceptance Model 2|
|0.38 (Zhang et al)||0.38|
Frequency and Effect Strength of the Significant Predictors
UTAUT adds, among others, the predictor social influence to the basic TAM predictors. As a result, it accounts for the perception of an item of technology by others, whose opinion is valued by the individual. The predictor was uncovered as a significant predictor by 6 of the included studies and comprises the attitudes of colleagues, patients, or the direct social environment, such as families and friends, toward telemedicine [, , ]. The predictors performance expectancy, effort expectancy, and facilitating conditions (sometime just called facilitators), all part of the UTAUT, were used 6 times as well.
The predictor mentioned as significant most often (11 times) was perceived usefulness, which is not part of the UTAUT but of the original TAM. It reaches both high ORs (when logistic regression was performed) and high betas (when multiple linear regression was performed). From a patient perspective, usefulness is achieved when, for example, telemedicine use improves quality of life or makes the care process more convenient for the patient . For health care providers, according to the studies included, usefulness is mainly associated with streamlining care processes, such as diagnosis and monitoring of disease parameters [ , ]. The other TAM predictor, perceived ease of use, was discovered to be significant 6 times. It mostly covers the degree of training it would take, both patients and health care professionals, to understand and learn how to use the telemedicine application in question [ , ], and it is sometimes used synonymously with effort expectation [ ].
Attitude was a significant predictor in 6 cases. However, in some of the proposed SEMs, it was circumvented in favor of direct effects of perceived usefulness  and perceived ease of use [ ]. Yet, attitude is the predictor with the highest beta, with regard to the studies using multiple linear regression (median beta=.76).
When studying both median ORs and median betas, only the height of the numbers is reasonably interpretable, as calculation of both values differs greatly. Then, Perceived usefulness is the most important predictor for acceptance by health care providers, with a median OR of 5.28 and a median beta of .43 (as calculated by the authors).
Taking into account both OR and beta, there are 2 almost equally important predictors for patient acceptance of telemedicine: performance expectancy, with a median OR of 8.4 and a median beta of .3, and social influence, with a median OR of 7.04 and a median beta of .25. Patients expect telemedicine to help them cope with their health problems and thereby improve their health [, ].
For relatives, attitude toward an mHealth care service used to connect their elderly family members with health care providers is the most important predictor (beta=.55). Lin and Yang operationalize attitude as the willingness to use a telemedicine application, as it is considered the ideal solution for a given health problem . As this was the only study focusing on the social environment of patients, no further analysis was conducted.
The dependent variables used in the 24 studies do not always fit those intended by the authors of the original model. Intention to use telemedicine (or synonyms such as behavioral intention) was used 19 times, probably as only 2 studies reported actual use of their application [, ], the actual dependent variable in the TAM. Acceptance and adoption were each used once. For a complete list of frequencies and effect strengths of all predictors, see . The following predictors are not listed as they were each mentioned only once in the included studies: Perceived Health Threat (beta=.305), Resistance to Change (beta=.149), Trialability (r=0.44), Opinion Leader present (r=0.52), Image (beta=.227), Optimism (beta=.484).
|Factors affecting telemedicine acceptance||P value, median||n||Odds ratio, median||Beta/lambda, median||b, median||r, median|
|Perceived ease of use||.01||6||1.57||.26||—||—|
|Attitude to use||.01||6||5.21||.76||—||—|
|Level of ICT use||.018||2||—||—||1.94||—|
aNo data provided.
Methodological Quality Assessment
All but 1 study have a considerable risk for bias, as there is only 1 study in which all AXIS items from the Methods and Results section could be rated 1, which is the study on mHealth use intention of heart failure patients by Cajita et al . It achieves 19 from a total of 20 points.
The objective of each study (24 times rated with 1), study design (24), sample size (24), as well as sample frame (22), was well described in most studies. Moreover, questions dealing with the measurement of outcome variables and the determination of statistical significance could always be rated 1.
Only a few studies have taken measures to address and categorize nonresponders. The evaluation of question 11—whether there was sufficient description of the study design and statistical methods applied to derive the results—shows that only about half of the studies have sufficiently described those, which is because of the fact that these studies have not reported any CIs or nonsignificant results. This diminishes the possibility to repeat their results. Moreover, half of the studies do not score high on questions 13 and 14, as their response rate is low, and there is no information provided about nonresponders, raising the question of nonresponse bias. Overall, the 24 included studies reached an AXIS score of 15.67. An overview of the rating for quality assessment according to the AXIS Tool can be found in the appendix ().
Importance of Acceptance Theories and Models in General
The results of the 24 original studies included in this systematic review support Hastall et al’s demands for a holistic analysis of technology acceptance in health care by relying on a theoretical background .
The UTAUT was used more often to explain acceptance for patients than for health care providers, which is likely because of the fact that the UTAUT includes variables of the construct, social influence. Those are also more important for patients than for providers. For health care providers, the TAM has the highest variance explained, relying also on the predictor perceived usefulness, which reaches both high ORs and betas.
It is noteworthy that, although it is still the most commonly used model, the TAM is combined with further predictors 7 times. Those predictors borrow heavily from the TIB, TPB, and TRA, thereby enabling the original TAM to also incorporate factors of acceptance not only rooted within technology but also rooted within the individual as the end user. The high prevalence of the UTAUT, used 9 times and only 2 times in combination, also adds to the importance of such factors, being a far more holistic model than the TAM. Together, these findings support Karsh’s statement that acceptance is not solely achieved by improving usability . Apart from that, they fulfill, in parts, the demand articulated by Riley et al for development and validation of novel health behavior theories for mobile interventions. Such theories should, according to the authors, include features and attributes of the technology as well as characteristics of the end users [ ].
Differences Between Patients and Health Care Professionals
Among the predictors added to the TAM, which are already part of the UTAUT, the most prevalent are those covering the social and organizational environment of the individual, for example, social influence and facilitating conditions. The latter supports results from qualitative observational research on telehealth readiness by older patients done by van Houwelingen et al. The authors conclude the need for easily available sources for technological support in case of problems with technology use . Social influence, when phrased positively, can be understood as social support, and it was uncovered to be an important factor in technology acceptance, for example, for Web-based interventions for pregnant women by Berg et al [ ]. Venkatesh et al included social influences into the UTAUT to pay respect to the fact that individuals’ acceptance behavior is being influenced by what they assume others might think about them when using a certain technology [ ]. The results presented here show this is also true for telemedicine. However, they contradict those presented by Boessen et al, who state that intrinsic motivation to use a self-management tool trumps the perception of others, which serves as extrinsic motivation [ ]. However, Peeters et al show that for people living alone, the positive effects of telemedicine use are much more observable (as defined by Diffusion of Innovations Theory), and so they were also more willing to adopt home telecare than those living with a partner or relative [ ]. Although these results seem contradictory to the importance of social influence, they give another meaning to the concept, showing that telemedicine can, when used properly, provide social contact where there is none.
Social influence appears to be more important for patients than for health care providers. For the latter, perceived usefulness is the most important predictor (studying median ORs and betas), which is in line with the results provided by Mothuy-Blanc et al. They show that whether psychotherapists are willing to use telepsychotherapy is predicted only by whether they find it useful . As the provision of the best treatment to the patient is every health care provider’s primary concern, these results are not surprising. This can also explain why the TAM, focusing on perceived usefulness and perceived ease of use, is much more important for health care providers than for patients.
Performance expectancy is an important predictor for both patients’ and providers’ acceptance. This makes their individual expectations toward the outcome of telemedicine use an important focus for further research, even though it is contradictory to the results of Koivumäki et al. They found no significant influence of performance expectancy on the adoption of digital preventive services .
The data presented here show the importance of easy-to-use applications, as perceived ease of use was shown to be a significant predictor 6 times, as well as effort expectancy. Scheibe et al show that design features, such as simple, intuitive menus, large icons and high color contrasts, are especially important for older users . As time is always scarce in health care provision, easy-to-use technology is also important for health care providers. De Angelis et al can even show that health care providers are willing to disseminate health information via Facebook, mainly as the Social Network is easy to use [ ].
Practicability of Technology Acceptance Models and Theories
On a more general level, the results presented here show that technology acceptance theories, as well as their basic behavioristic underpinnings, are applicable to the study of acceptance of telemedicine, even though they are quite old (the TAM was formulated in 1989, and the TRA was formulated in 1975). This is true despite the fact that none of those models and theories were originally formulated to fit health care technologies.
Moreover, the theories and models analyzed here are applicable to health care providers and patients alike, not to mention special types of diseases or telemedicine applications. There seems to be no special diagnosis that impacts acceptance and its preconditions, although it is noteworthy that there were not any studies focusing on telemedicine for patients with a cognitive impairment applicable for analysis. A pooling of data to calculate medians therefore seemed feasible.
Although an analysis of acceptance regarding different types of telemedicine applications was intended, only a superficial count of applications studied was feasible because of a lack of specification in some studies. However, no matter what kind of application was studied, the theories and models are applicable. If any insights can be gained from the few studies analyzing acceptance of a certain type of application, it is that acceptance is less of an issue when the basic device used is already familiar to the end user from everyday life, such as mobile phones or Web portals . The results provided by Saigí-Rubió et al in their study from 2014 further stress this point, as they find previous use of ICT in their everyday life to be a significant predictor for physicians’ telemedicine use [ ].
The applicability of the UTAUT, according to the variance explained, stresses the importance of holistic models of acceptance, incorporating not only characteristics of the individual adopter but also of his or her direct or indirect social environment. Facilitating conditions, being mentioned 6 times as relevant predictors, refer to the technological as well as the organizational infrastructure fostering acceptance. In a qualitative study by Cimperman et al, cost of the technology in use was mentioned as a major concern of older adults , which may appeal to funding agencies, such as insurance companies, to provide financial support.
It should be noted in this context that, although standardized and well-tested questionnaires exist for the TAM , as well as for the UTAUT [ ] and the Diffusion of Innovations Theory [ ], only 1 author cited here fully relied on the UTAUT questions suggested by Venkatesh et al in the original publication [ ]. The remaining authors either made additions or changed the wording of several items. As none of the above mentioned models—nor the questionnaires used to test them—were originally developed for health care technologies, additions and changes to the questionnaires seem logical.
From a purely scientific standpoint, this research is proof that testing of theories and models in a variety of settings can be done by applying a systematic review of empirical studies, that is, by solely relying on secondary data.
This study has several limitations. First, papers not published in English or German were excluded, which may constitute a selection bias (language bias). Although a comprehensive search strategy has been used, and an additional hand search was conducted, it is possible that some relevant studies were missed if the specific keywords were used neither by the authors nor by the databases searched. Apart from that, a publication bias toward positive results cannot be precluded.
All included studies were cross-sectional studies. It should be noted that acceptance or the decision to adopt an innovation is a dynamic process, taking place over time , especially when health behavior change is going hand in hand with it [ ]. Such processes cannot be captured with a cross-sectional study that, by nature, only covers 1 point in time [ ].
Another limitation might be that acceptance cannot be fully evaluated regarding different medical conditions, as these were not often indicated in the included studies. The same is true for concrete applications. Acceptance is most likely rated differently when the subject is given the chance to use a real application instead of having to rate acceptance of hypothetical applications or generic terms such as eHealth or telemedicine.
Furthermore, age and gender could be confounders in the interpretation of the results, as they differ in the individual studies. However, because of questionnaires tailored specifically for each research interest in each included study, the theories, models, and predictors are applicable despite such heterogeneity in demographic variables.
In terms of quality assessment, the AXIS tool does not provide a numerical scale for assessing quality of the studies. Thus, a subjective rating, depending on the research interest, is required. Although the authors of the tool state that this subjectivity provides greater flexibility in assessing the quality of a study , this can still be a limitation.
Owing to the heterogeneity across the statistical methods within the included studies, a meta-analysis could not be performed. The medians, as well as the SDs calculated here, are an approximation, based on the overall applicability of the theories and models. It shows that the theories and models, as well as the predictors, can be compared.
The review strictly followed the PRISMA. We deployed a concise and literature-based search string, which was critically reviewed by several peers. The methodology applied for this review was checked for validity by the PROSPERO foundation, where a protocol was registered beforehand. A thorough quality assessment with a focus on methodological issues was conducted for each included study.
Further Research Needs
As demonstrated in the review, social influence, also called social support, represents an important factor in telemedicine acceptance. The acceptance of telemedicine may benefit from the support of others perceived as important by the unit of adoption. In addition, telemedicine should be perceived as useful by the users or those who recommend them. All in all, models that are explicitly suited for health care technologies, such as telemedicine, need to be developed and empirically tested. The Health Information Technology Acceptance Model proposed by Kim et al in 2012 can serve as suitable model . Even though it is based on existing technology acceptance and health behavioral theories, it was used in none of the studies found in this review.
This review highlights a lack of methodologically adequate studies. Future studies should have a longitudinal design and should consider the dimension of time, to allow for measuring the influence of mid- and long-term use of an innovation . An important issue for further research in theory-based approaches to the measurement of acceptance is that the studies should examine acceptance of real telemedicine applications.
Complex, interdependent interactions within an organizational setting should also be tested for. The Normalization Process Theory can be helpful in this endeavor, as it proposes a nonlinear understanding of acceptance . Theoretical factors promoting the implementation of telemedicine within a whole health care organization are not covered by the primary aim of this review. Yet, information about them can be derived, insofar as they can be subsumed under facilitating conditions. Little information was also found on predictors of telemedicine acceptance for relatives and peers of the primary users. Applying the NASSS framework, Greenhalgh et al find the complex interactions among the 6 levels, especially the organizations and the wider policy system, to be severely hindering telemedicine implementation [ ]. The role of a supportive policy system as a predictor for telemedicine acceptance in a health care organization has been shown to be especially important in developing countries by Zailani et al. In addition, the authors stress the importance of the existing health culture as a mediator between individual technology assessment and telemedicine acceptance [ ]. A more thorough investigation of the role played by the social environment of the end user, especially relatives, should also be conducted. Finally, the research presented here stops with the acceptance of telemedicine. However, another prerequisite of sustained use is task performance, that is, the ability to successfully use a technology [ ]. Little research has been done on task performance in telemedicine use. However, Serrano and Karahanna have shown, on the basis of the task-individual-technology-fit theory, that skills in acquiring knowledge, problem-solving, and presenting solutions influence the successful use of teleconsulting systems [ ]. Taking these results as a starting point, a shift from acceptance to performance research is feasible.
The results of this systematic review indicate that acceptance of telemedicine can be examined by using technology acceptance theories and models. On the basis of the included studies, acceptance was most often predicted by perceived usefulness, social influences, and attitude. To examine how adoption processes evolve over time, longitudinal research on existing applications would be advisable in the future. A brief summary of the study results can be found in.
The authors wish to thank Stefanie Deckert, Patrick Timpel, Brita Sedlmayr and Hannes Schlieter for their valuable input to both the design of the study and the manuscript. The work for this review was partly funded by the European Social Fund and the Free State of Saxony (Grant no. 100310385).
LH and HL participated in the design of the study and also conducted the search. LH, HL, and MS were responsible for critical evaluation, analysis, and presentation of the results. LH, HL, and MS drafted the manuscript, critically evaluated the article, and gave their final approval before submission.
Conflicts of Interest
Multimedia Appendix 1
Database-specific search strings.PDF File (Adobe PDF File), 30KB
Multimedia Appendix 2
Excluded full texts with reasons for exclusion.PDF File (Adobe PDF File), 85KB
Multimedia Appendix 3
Complete list of data extracted from all 24 included studies.PDF File (Adobe PDF File), 104KB
Multimedia Appendix 4
List of models and theories used in combination.PDF File (Adobe PDF File), 25KB
Multimedia Appendix 5
Results of quality assessment according to the Appraisal Tool for Cross-Sectional Studies.PDF File (Adobe PDF File), 89KB
- Jang-Jaccard J, Nepal S, Alem L, Li J. Barriers for delivering telehealth in rural australia: a review based on Australian trials and studies. Telemed J E Health 2014 May;20(5):496-504. [CrossRef] [Medline]
- Akinlotan M, Bolin JN, Helduser J, Ojinnaka C, Lichorad A, McClellan D. Cervical cancer screening barriers and risk factor knowledge among uninsured women. J Community Health 2017 Aug;42(4):770-778 [FREE Full text] [CrossRef] [Medline]
- Eysenbach G. What is e-health? J Med Internet Res 2001;3(2):E20 [FREE Full text] [CrossRef] [Medline]
- Sood S, Mbarika V, Jugoo S, Dookhy R, Doarn CR, Prakash N, et al. What is telemedicine? A collection of 104 peer-reviewed perspectives and theoretical underpinnings. Telemed J E Health 2007 Oct;13(5):573-590. [CrossRef] [Medline]
- Otto L, Harst L, Schlieter H, Wollschlaeger B, Richter P, Timpel P. Towards a Unified Understanding of eHealth and Related Terms – Proposal of a Consolidated Terminological Basis. In: Proceedings of the 11th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2018). Setúbal: SCITEPRESS; 2018 Presented at: 11th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2018); January 19-21 , 2018; Funchal, Portugal.
- Singh G, O'Donoghue J, Soon CK. Telemedicine: issues and implications. Technol Health Care 2002;10(1):1-10. [Medline]
- Huang F, Blaschke S, Lucas H. Beyond pilotitis: taking digital health interventions to the national level in China and Uganda. Global Health 2017 Jul 31;13(1):49 [FREE Full text] [CrossRef] [Medline]
- Boonstra A, van Offenbeek M. Towards consistent modes of e-health implementationtructurational analysis of a telecare programme's limited success. Inform Syst J 2010 Nov;20(6):537-561. [CrossRef]
- van Dyk L. A review of telehealth service implementation frameworks. Int J Environ Res Public Health 2014 Jan 23;11(2):1279-1298 [FREE Full text] [CrossRef] [Medline]
- Atlas of eHealth country profiles. The use of eHealth in support of universal health coverage 2015. In: Global Observatory for eHealth. Geneva, Switzerland: World Health Organisation (WHO); 2015.
- Global diffusion of eHealth. Making universal health coverage achievable. In: Global Observatory for eHealth. Geneva, Switzerland: World Health Organisation (WHO); 2015.
- Rogers EM. Diffusion of Innovations. New York: Free Press; 1995.
- Aguilar KM, Campbell RS, Fiester A, Simpson RL, Hertel C. Bringing care home: how telemonitoring can expand population health management beyond the hospital. Nurs Adm Q 2014;38(2):166-172. [CrossRef] [Medline]
- Esser PE, Goossens RH. A framework for the design of user-centred teleconsulting systems. J Telemed Telecare 2009;15(1):32-39. [CrossRef] [Medline]
- Riley WT, Rivera DE, Atienza AA, Nilsen W, Allison SM, Mermelstein R. Health behavior models in the age of mobile interventions: are our theories up to the task? Transl Behav Med 2011 Mar;1(1):53-71 [FREE Full text] [CrossRef] [Medline]
- Karsh B. Beyond usability: designing effective technology implementation systems to promote patient safety. Qual Saf Health Care 2004 Oct;13(5):388-394 [FREE Full text] [CrossRef] [Medline]
- Ifinedo P. Empirical study of Nova Scotia nurses' adoption of healthcare information systems: implications for management and policy-making. Int J Health Policy Manag 2017 Aug 13;7(4):317-327 [FREE Full text] [CrossRef] [Medline]
- Hastall M, Dockweiler C, Mühlhaus J. Achieving end user acceptance: Building blocks for an evidence-based user-centered framework for health technology development and assessment. Cham, Switzerland: Springer; 2017 Presented at: 11th International Conference on Universal Access in Human-Computer Interaction UAHCI; July 9–14, 2017; Vancouver, BC, Canada p. 13-25.
- Sahay TB, Ashbury FD, Roberts M, Rootman I. Effective components for nutrition interventions: a review and application of the literature. Health Promot Pract 2006 Oct;7(4):418-427. [CrossRef] [Medline]
- Rosenstock IM. Historical origins of the Health Belief Model. Health Educ Monogr 1974 Dec;2(4):328-335. [CrossRef]
- Zhang M, Luo M, Nie R, Zhang Y. Technical attributes, health attribute, consumer attributes and their roles in adoption intention of healthcare wearable technology. Int J Med Inform 2017 Dec;108:97-109. [CrossRef] [Medline]
- Fishbein M, Ajzen I. Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research. Boston, MA: Addison Wesley; 1975.
- Araújo MT, Paiva T, Jesuino JC, Magalhães M. General practitioners and neurotelemedicine. Stud Health Technol Inform 2000;78:45-67. [Medline]
- Ajzen I. From intentions to actions: a theory of planned behavior. In: Kuhl J, Beckmann J, editors. Action Control: From Cognition To Behavior (Springer Series In Social Psychology). Berlin: Springer; 1985:11-39.
- Herrmann LK, Kim J. The fitness of apps: a theory-based examination of mobile fitness app usage over 5 months. Mhealth 2017;3:2 [FREE Full text] [CrossRef] [Medline]
- Davis F. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q 1989 Sep;13(3):319-340. [CrossRef]
- Bandura A. Social Foundations Of Thought And Action: A Social Cognitive Theory. Upper Saddle River, NJ: Prentice Hall; 1986.
- Venkatesh V, Morris M, Davis G, Davis F. User acceptance of information technology: toward a unified view. MIS Q 2003;27(3):425-478. [CrossRef]
- Vanneste D, Vermeulen B, Declercq A. Healthcare professionals' acceptance of BelRAI, a web-based system enabling person-centred recording and data sharing across care settings with interRAI instruments: a UTAUT analysis. BMC Med Inform Decis Mak 2013;13:129 [FREE Full text] [CrossRef] [Medline]
- Costa CR, Iglesias MJ, Rifón LE, Carballa MG, Rodríguez SV. The acceptability of TV-based game platforms as an instrument to support the cognitive evaluation of senior adults at home. PeerJ 2017;5:e2845 [FREE Full text] [CrossRef] [Medline]
- May C, Finch T. Implementing, embedding, and integrating practices: an outline of Normalization Process Theory. Sociology 2009 Jun 15;43(3):535-554. [CrossRef]
- Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, et al. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res 2017 Nov 01;19(11):e367 [FREE Full text] [CrossRef] [Medline]
- Wade V, Gray L, Carati C. Theoretical frameworks in telemedicine research. J Telemed Telecare 2017 Jan;23(1):181-187. [CrossRef] [Medline]
- Whitten P, Johannessen LK, Soerensen T, Gammon D, Mackert M. A systematic review of research methodology in telemedicine studies. J Telemed Telecare 2007;13(5):230-235. [CrossRef] [Medline]
- Lai PC. the literature review of technology adoption models and theories for the novelty technology. JISTEM 2017 Apr 30;14(1):21-38. [CrossRef]
- Garavand A, Mohseni M, Asadi H, Etemadi M, Moradi-Joo M, Moosavi A. Factors influencing the adoption of health information technologies: a systematic review. Electron Physician 2016 Aug;8(8):2713-2718 [FREE Full text] [CrossRef] [Medline]
- Higgins JPT. Cochrane Handbook for Systematic Reviews of Interventions. Chichester: John Wiley & Sons; 2010.
- Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Br Med J 2009;339:b2535 [FREE Full text] [Medline]
- Bashshur R, Shannon G, Krupinski E, Grigsby J. The taxonomy of telemedicine. Telemed J E Health 2011;17(6):484-494. [CrossRef] [Medline]
- Field A. Discovering Statistics Using IBM SPSS Statistics: North American Edition. Los Angeles: Sage Publications Ltd; 2018:1025.
- Downes MJ, Brennan ML, Williams HC, Dean RS. Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS). BMJ Open 2016 Dec 08;6(12):e011458 [FREE Full text] [CrossRef] [Medline]
- Spaulding RJ, Russo T, Cook DJ, Doolittle GC. Diffusion theory and telemedicine adoption by Kansas health-care providers: critical factors in telemedicine adoption for improved patient access. J Telemed Telecare 2005;11(Suppl 1):107-109. [CrossRef] [Medline]
- Saigi-Rubió F, Jiménez-Zarco A, Torrent-Sellens J. Determinants of the intention to use telemedicine: evidence from primary care physicians. Int J Technol Assess Health Care 2016 Jan;32(1-2):29-36. [CrossRef] [Medline]
- Huygens MW, Vermeulen J, Friele RD, van Schayck OC, de Jong JD, de Witte LP. Internet services for communicating with the general practice: barely noticed and used by patients. Interact J Med Res 2015;4(4):e21 [FREE Full text] [CrossRef] [Medline]
- Rho M, Kim H, Chung K, Choi I. Factors influencing the acceptance of telemedicine for diabetes management. Cluster Comput 2015 Mar 12;18(1):321-331. [CrossRef]
- Jen W, Hung M. An empirical study of adopting mobile healthcare service: the family's perspective on the healthcare needs of their elderly members. Telemed J E Health 2010;16(1):41-48. [CrossRef] [Medline]
- Zhang H, Cocosila M, Archer N. Factors of adoption of mobile information technology by homecare nurses: a technology acceptance model 2 approach. Comput Inform Nurs 2010;28(1):49-56. [CrossRef] [Medline]
- Zhang X, Han X, Dang Y, Meng F, Guo X, Lin J. User acceptance of mobile health services from users' perspectives: the role of self-efficacy and response-efficacy in technology acceptance. Inform Health Soc Care 2017 Mar;42(2):194-206. [CrossRef] [Medline]
- Lin S, Yang H. Exploring key factors in the choice of e-health using an asthma care mobile service model. Telemed J E Health 2009 Nov;15(9):884-890. [CrossRef] [Medline]
- de Veer AJ, Peeters JM, Brabers AE, Schellevis FG, Rademakers JJ, Francke AL. Determinants of the intention to use e-Health by community dwelling older people. BMC Health Serv Res 2015 Mar 15;15:103 [FREE Full text] [CrossRef] [Medline]
- Hennemann S, Beutel ME, Zwerenz R. Ready for eHealth? Health professionals' acceptance and adoption of eHealth interventions in inpatient routine care. J Health Commun 2017 Mar;22(3):274-284. [CrossRef] [Medline]
- Hossain N, Yokota F, Sultana N, Ahmed A. Factors influencing rural end-users' acceptance of e-health in developing countries: a study on portable health clinic in bangladesh. Telemed J E Health 2018 Apr 17:-. [CrossRef] [Medline]
- Cajita MI, Hodgson NA, Budhathoki C, Han H. Intention to use mHealth in older adults with heart failure. J Cardiovasc Nurs 2017 Feb 28:E7. [CrossRef] [Medline]
- Kuhn E, Crowley J, Hoffman J, Eftekhari A, Ramsey K, Owen J, et al. Clinician characteristics and perceptions related to use of the PE (prolonged exposure) coach mobile app. Prof Psychol Res Pr 2015 Dec;46(6):437-443. [CrossRef]
- Hennemann S, Beutel ME, Zwerenz R. Drivers and barriers to acceptance of web-based aftercare of patients in inpatient routine care: a cross-sectional survey. J Med Internet Res 2016 Dec 23;18(12):e337 [FREE Full text] [CrossRef] [Medline]
- Asua J, Orruño E, Reviriego E, Gagnon MP. Healthcare professional acceptance of telemonitoring for chronic care patients in primary care. BMC Med Inform Decis Mak 2012 Nov 30;12:139 [FREE Full text] [CrossRef] [Medline]
- Gagnon MP, Orruño E, Asua J, Abdeljelil AB, Emparanza J. Using a modified technology acceptance model to evaluate healthcare professionals' adoption of a new telemonitoring system. Telemed J E Health 2012;18(1):54-59 [FREE Full text] [CrossRef] [Medline]
- James S, Perry L, Gallagher R, Lowe J. Diabetes educators' intended and reported use of common diabetes-related technologies: discrepancies and dissonance. J Diabetes Sci Technol 2016 Dec;10(6):1277-1286 [FREE Full text] [CrossRef] [Medline]
- Orruño E, Gagnon MP, Asua J, Ben Abdeljelil A. Evaluation of teledermatology adoption by health-care professionals using a modified Technology Acceptance Model. J Telemed Telecare 2011;17(6):303-307. [CrossRef] [Medline]
- Dockweiler C, Kupitz A, Hornberg C. [Acceptance of online-based therapy by patients with light to moderate depressive disorders]. Gesundheitswesen 2017 Nov 10:1013-1022. [CrossRef] [Medline]
- van Houwelingen CT, Barakat A, Best R, Boot WR, Charness N, Kort HS. Dutch nurses' willingness to use home telehealth: implications for practice and education. J Gerontol Nurs 2015 Apr;41(4):47-56. [CrossRef] [Medline]
- Peeters JM, de Veer AJ, van der Hoek L, Francke AL. Factors influencing the adoption of home telecare by elderly or chronically ill people: a national survey. J Clin Nurs 2012 Nov;21(21-22):3183-3193. [CrossRef] [Medline]
- Dou K, Yu P, Deng N, Liu F, Guan Y, Li Z, et al. Patients' acceptance of smartphone health technology for chronic disease management: a theoretical model and empirical test. JMIR Mhealth Uhealth 2017 Dec 06;5(12):e177 [FREE Full text] [CrossRef] [Medline]
- Venkatesh V, Davis F. A theoretical extension of the technology acceptance model: four longitudinal field studies. Manage Sci 2000 Feb;46(2):186-204. [CrossRef]
- van Houwelingen CT, Ettema RG, Antonietti MG, Kort HS. Understanding older people's readiness for receiving telehealth: mixed-method study. J Med Internet Res 2018 Apr 06;20(4):e123 [FREE Full text] [CrossRef] [Medline]
- Berg M, Linden K, Adolfsson A, Lundin CS, Ranerup A. Web-based intervention for women with type 1 diabetes in pregnancy and early motherhood: critical analysis of adherence to technological elements and study design. J Med Internet Res 2018 May 02;20(5):e160 [FREE Full text] [CrossRef] [Medline]
- Boessen AB, Vermeulen J, de Witte LP. Acceptance and usability of a home-based monitoring tool of health indicators in children of people with dementia: a Proof of Principle (POP) study. Patient Prefer Adherence 2017;11:1317-1324 [FREE Full text] [CrossRef] [Medline]
- Monthuy-Blanc J, Bouchard S, Maïano C, Séguin M. Factors influencing mental health providers' intention to use telepsychotherapy in First Nations communities. Transcult Psychiatry 2013 Apr;50(2):323-343. [CrossRef] [Medline]
- Koivumäki T, Pekkarinen S, Lappi M, Väisänen J, Juntunen J, Pikkarainen M. consumer adoption of future MyData-based preventive eHealth services: an acceptance model and survey study. J Med Internet Res 2017 Dec 22;19(12):e429 [FREE Full text] [CrossRef] [Medline]
- Scheibe M, Reichelt J, Bellmann M, Kirch W. Acceptance factors of mobile apps for diabetes by patients aged 50 or older: a qualitative study. Med 2 0 2015 Mar 02;4(1):e1 [FREE Full text] [CrossRef] [Medline]
- De Angelis G, Davies B, King J, Wells GA, Brosseau L. The use of social media by arthritis health professionals to disseminate a self-management program to patients: a feasibility study. Digit Health 2017;3:2055207617700520 [FREE Full text] [CrossRef] [Medline]
- Jun S, Plint AC, Campbell SM, Curtis S, Sabir K, Newton AS. Point-of-care cognitive support technology in emergency departments: a scoping review of technology acceptance by clinicians. Acad Emerg Med 2018 May;25(5):494-507. [CrossRef] [Medline]
- Saigí-Rubió F, Torrent-Sellens J, Jiménez-Zarco A. Drivers of telemedicine use: comparative evidence from samples of Spanish, Colombian and Bolivian physicians. Implement Sci 2014 Oct 08;9:128. [CrossRef] [Medline]
- Cimperman M, Brenčič MM, Trkman P, Stanonik MD. Older adults' perceptions of home telehealth services. Telemed J E Health 2013 Oct;19(10):786-790 [FREE Full text] [CrossRef] [Medline]
- Atkinson NL. Developing a questionnaire to measure perceived attributes of eHealth innovations. Am J Health Behav 2007;31(6):612-621. [CrossRef] [Medline]
- Schwarzer R. Modeling health behavior change: how to predict and modify the adoption and maintenance of health behaviors. Appl Psychol 2008 Jan;57(1):1-29. [CrossRef]
- Kim J, Park H. Development of a health information technology acceptance model using consumers' health behavior intention. J Med Internet Res 2012;14(5):e133 [FREE Full text] [CrossRef] [Medline]
- Abramson EL, Silver M, Kaushal R. Meaningful use status and participation in health information exchange among New York State hospitals: a longitudinal assessment. Jt Comm J Qual Patient Saf 2014 Oct;40(10):452-453. [Medline]
- Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, et al. Analysing the role of complexity in explaining the fortunes of technology programmes: empirical application of the NASSS framework. BMC Med 2018 May 14;16(1):66 [FREE Full text] [CrossRef] [Medline]
- Zailani S, Gilani MS, Nikbin D, Iranmanesh M. Determinants of telemedicine acceptance in selected public hospitals in Malaysia: clinical perspective. J Med Syst 2014 Sep;38(9):111. [CrossRef] [Medline]
- Serrano C, Karahanna E. The compensatory interaction between user capabilities and technology capabilities in influencing task performance: an empirical assessment in telemedicine consultations. MIS Q 2016;40(3):597-621. [CrossRef]
|eHealth: electronic health|
|HBM: Health Belief Model|
|ICT: Information and Communication Technology|
|mHealth: mobile health|
|NASSS: nonadoption, abandonment, scale-up, spread, and sustainability|
|OR: odds ratio|
|PICOS: Population, Intervention, Comparison, Outcome, and Study Design|
|PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses|
|SEM: Structural Equation Modeling|
|TAM: Technology Acceptance Model|
|TIB: Theory of Interpersonal Behavior|
|TPB: Theory of Planned Behavior|
|TRA: Theory of Reasoned Action|
|UTAUT: Unified Theory of Acceptance and Use of Technology|
Edited by G Eysenbach; submitted 12.12.18; peer-reviewed by A Ekeland, T Rashid Soron, X Guo, F Saigí-Rubió, S Shah; comments to author 14.02.19; revised version received 08.03.19; accepted 29.03.19; published 21.05.19
©Lorenz Harst, Hendrikje Lantzsch, Madlen Scheibe. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 21.05.2019.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.