Advertisement: Preregister now for the Medicine 2.0 Congress
Online Communication Between Doctors and Patients in Europe: Status and Perspectives
Silvina Santana1, PhD; Berthold Lausen2, PhD; Maria Bujnowska-Fedak3, PhD; Catherine Chronaki4, MSc; Per Egil Kummervold5, PhD; Janne Rasmussen6, MA; Tove Sorensen7, MSc
1Institute of Electronics Engineering and Telematic of Aveiro and Department of Economics, Management and Industrial Engineering, University of Aveiro, Aveiro, Portugal
2Department of Mathematical Sciences, University of Essex, Colchester, United Kingdom
3Department of Family Medicine, Wrocław Medical University, Wrocław, Poland
4Institute of Computer Science, Foundation for Research and Technology-Hellas, Heraklion, Greece
5Institute of Clinical Medicine, University of Tromsø and Norwegian Centre for Integrated Care and Telemedicine, University Hospital of North-Norway, Tromsø, Norway
6Odense University Hospital, Odense, Denmark
7Norwegian Centre for Integrated Care and Telemedicine, University Hospital of North-Norway, Tromsø, Norway
Institute of Electronics Engineering and Telematic of Aveiro and Department of Economics, Management and Industrial Engineering
University of Aveiro
Campus de Santiago
Phone: 351 234 370840
Fax: 351 234 370545
Background: Use of the Internet for health purposes is steadily increasing in Europe, while the eHealth market is still a niche. Online communication between doctor and patient is one aspect of eHealth with potentially great impact on the use of health systems, patient-doctor roles and relations and individuals’ health. Monitoring and understanding practices, trends, and expectations in this area is important, as it may bring invaluable knowledge to all stakeholders, in the Health 2.0 era.
Objective: Our two main goals were: (1) to investigate use of the Internet and changes in expectations about future use for particular aspects of communication with a known doctor (obtaining a prescription, scheduling an appointment, or asking a particular health question), and (2) to investigate how important the provision of email and Web services to communicate with the physician is when choosing a new doctor for a first time face-to-face appointment. The data come from the second survey of the eHealth Trends study, which addressed trends and perspectives of health-related Internet use in Europe. This study builds on previous work that established levels of generic use of the Internet for self-help activities, ordering medicine or other health products, interacting with a Web doctor/unknown health professional, and communicating with a family doctor or other known health professional.
Methods: A representative sample of citizens from seven European countries was surveyed (n = 7022) in April and May of 2007 through computer-assisted telephone interviews (CATI). Respondents were questioned about their use of the Internet to obtain a prescription, schedule an appointment, or ask a health professional about a particular health question. They were also asked what their expectations were regarding future use of the Internet for health-related matters. In a more pragmatic approach to the subject, they were asked about the perceived importance when choosing a new doctor of the possibility of using email and the Web to communicate with that physician. Logistic regression analysis was used to draw the profiles of users of related eHealth services in Europe among the population in general and in the subgroup of those who use the Internet for health-related matters. Changes from 2005 to 2007 were computed using data from the first eHealth Trends survey (October and November 2005, n = 7934).
Results: In 2007, an estimated 1.8% (95% confidence interval [CI], 1.5 - 2.1) of the population in these countries had used the Internet to request or renew a prescription; 3.2% (95% CI 2.8 - 3.6) had used the Internet to schedule an appointment; and 2.5% (95% CI 2.2 - 2.9) had used the Internet to ask a particular health question. This represents estimated increases of 0.9% (95% CI 0.5 - 1.3), 1.7% (95% CI 1.2 - 2.2), and 1.4% (95% CI 0.9 - 1.8). An estimated 18.0% (95% CI 17.1 - 18.9) of the populations of these countries expected that in the near future they would have consultations with health professionals online, and 25.4% (95% CI 24.4 - 26.3) expected that in the near future they would be able to schedule an appointment online. Among those using the Internet for health-related purposes, on average more than 4 in 10 people considered the provision of these eHealth services to be important when choosing a new doctor.
Conclusions: Use of the Internet to communicate with a known health professional is still rare in Europe. Legal context, health policy issues, and technical conditions prevailing in different countries might be playing a major role in the situation. Interest in associated eHealth services is high among citizens and likely to increase.
(J Med Internet Res 2010;12(2):e20)
Online physician-patient interaction; email communication; online prescription ordering; scheduling appointments online; eHealth services utilization and trends; Internet; Europe; survey; logistic regression analysis
Quality health care depends on successful communication between health professionals and patients . As the use of Web tools becomes more pervasive in health and medicine as represented by the concepts Health 2.0  and Medicine 2.0 , and patients become more empowered, all parties need to adjust to a new form of participatory health care. These new environments are likely to promote more personalized health care, increased collaboration, and better health education. Expected outcomes are not only improved health but also more efficiency in the use of scarce resources, improved trust between stakeholders, and greater convenience , the essence of quality health care. Prior work suggests that online communication tools such as the Web and email can play important roles in enhancing access to health care and health information, in facilitating clinical management , and in increasing the effectiveness of practice administration. Such tools might even play roles in reducing health system expenditure  and in increasing overall efficiency . However, a number of barriers and risks have also been identified [7-15]. Evidence from recent fieldwork is mixed, probably because assessment has involved varying methodologies, settings, systems, and perspectives [5,6,13,16-19].
Some studies have indicated that demand for online communication is strong among patients [20,21] and that, among Internet users, willingness to pay for Web portal services does not appear to vary significantly with age . In one study of pediatric primary care, parents were particularly enthusiastic about the possibility of communicating online with their child’s physician , stating that the ability to communicate online might be a reason to choose a particular pediatrician, even though the majority said they were unwilling to pay for such access . In another study, older patients responded that they would like to use email to communicate with their physicians .
Regarding level of actual use, some studies of providers and consumers have found that online correspondence among patients and physicians, both solicited and unsolicited, has increased dramatically, while other studies have found this type of communication to be more limited. In New Zealand, for example, 68% of the 80 general practitioners interviewed in one study had never used email to communicate with their patients, and only 4% had used it regularly . An investigation conducted in the east of Scotland found similar levels of use . On the other hand, a cross-sectional study involving all physicians at the Finnish Student Health Service found that 79% of these physicians use email to communicate with patients  the same level reported by other studies of email communication in similar settings . Studies involving the general population have reported much lower but also disparate levels of use. An online survey conducted in the United States in 2006, found that while only up to 4% of adults use or have access to online services for communicating with their physicians, most would like to communicate with their physicians in this way. In fact, the majority stated that the availability of online services would influence their choice of health care provider to some extent . Meanwhile, results from the Health Information National Trends Surveys, HINTS 2003 and HINTS 2005,  showed that in 2003, 7% of American Internet users had used email or the Internet to communicate with a physician or a physician’s office in the past 12 months, a proportion that had increased significantly to 10% by 2005. In Europe, the World Health Organization (WHO)/European Survey on eHealth Consumer Trends (eHealth Trends)  found that the estimated percentage of the population that had approached a family doctor or other known health professional through the Internet, even if only to read their website, had increased from 3.6% in 2005 to 6.9% in 2007, while the percentage of those interacting with a Web doctor or health professional they had never met increased from 8.2% to 11.1% over the same period. Results from a 2007 online survey of Dutch primary care patients with chronic complaints , a relevant target group for e-consultations, revealed that 90% had had no prior experience with such a service.
By the time of the second eHealth Trends survey, European countries had established priorities and strategies for eHealth . However, the conditions reported to have been in place in the seven countries that participated in the eHealth Trends survey were very different. In Denmark, several initiatives were in place that aimed at the development of common standards, concepts, and classifications; good integration between electronic health records (EHR) and other health information systems; and the implementation of an Internet-based health care data network. The Danish public national health portal, Sundhed.dk, had been launched in 2003 .
In Germany, the two pillars of modernization identified were the establishment of an information and communication technology (ICT) infrastructure and the implementation of a private electronic patient record. The latter, to be introduced in four stages, would allow the provision of administrative data and transmission of electronic prescriptions, among other things . With respect to a legal and regulatory framework, national legislation addressing telemedicine and eHealth service provision was in place. The German Medical Association's professional code of conduct (Berufsordnung der Ärztekammer) restricted the exchange of health-related email between doctor and patient to situations where there had been previous face-to-face contact.
In Greece, plans for the period 2006 to 2007 aimed at strengthening standardization and communication infrastructures and preparing the path for national integration by 2015. The plan was to do this through spearheading pilot projects linked to Europe-wide efforts with health insurance cards, e-prescription, and telemedicine .
In Latvia, development of telemedicine and provision of health care services online were two of the priorities defined, but by April 2007 the assessment of progress achieved so far was considered irrelevant given that the implementation plan was to have been ready at the end of 2006. As of 2007, there was no legal framework specific for eHealth or telemedicine practice available .
In Norway, the implementation of a national eGovernment information portal serving all sectors, including health, that might give access to e-prescription, the implementation of eResept (for electronic communication of prescription information), and the clarification of responsibility, rules, guidelines, and costs in connection with telemedicine consultations were among future activities to be developed. Legislative research started during spring 2006 to determine ways in which existing legislation was hindering progress in eHealth .
In Poland, development of electronic communication in health care, telemedicine services, and a central health care portal were some of the strategic targets in the national eHealth roadmap, but by 2007 much seemed to be still at the conceptual phase, and no specific legal framework for eHealth was available .
In Portugal, the promotion of telemedicine initiatives and development of e-prescription functionalities were some of the future activities envisaged . There was no legal framework specific for eHealth or telemedicine practice, but online interaction in general involving personal data exchange and diffusion, such as eHealth services, come under very strict legislation that discourages online communication with patients in a clinical setting, especially in private and small practices.
Technical and legal differences in European countries exist together with spreading use of the Internet and email in Europe and the increased potential of these technologies to change the boundaries of communication within medical practice as well as several dimensions of the patient-physician relationship. Therefore, there is an urgent need to investigate how such services are being used, appraised, and valuated by European citizens.
For this paper, we used data of the second eHealth Trends survey that were not analyzed in previous work . We used these data to investigate in the seven participating countries use of the Internet and email to interact with known health professionals for specific online services. First, we report on current levels of use of the Internet to obtain a prescription, schedule an appointment, or to ask a particular health question. We also report on changes in Internet use and expectations about future use that have occurred over the 18 month period following the first eHealth survey administered in 2005 in the seven countries. In addition, we report the importance of the availability of email and Web services for communicating with the physician when choosing a doctor for a first-time face-to-face appointment. Finally, using the results of logistic regression analysis of the data, we draw profiles of the potential consumers of related eHealth services. The discussion focuses on implications for citizens, health care providers, policy makers, and other stakeholders across Europe.
Participants and Procedures
Residents of Denmark, Germany, Greece, Latvia, Norway, Poland, and Portugal participated in the study. The questionnaire was administered through computer-assisted telephone interviews (CATI). The survey was conducted in April and May 2007 to reach a target of a representative sample of 1000 complete questionnaires in each participating country. Because the 2005 eHealth Trends survey was found to be skewed for some age groups, the 2007 survey used quotas based on census data. Six groups were defined based on age and gender specific to each country, and random digit dialing within strata was used to ensure a randomized representative sample (for more details see ). In total, 7022 questionnaires were completed, corresponding to an average response rate of 36% of the 22,867 individuals contacted in the seven countries (for more details see ).
Multimedia Appendix 1 shows the frequencies of respondents across age groups by gender and the sociodemographic variables included in the 2007 questionnaire. For comparison, we present the frequencies and percentages of the subjective health status of the European Social Survey (ESS) (September 2006 through March 2007). The eHealth Trends survey used the same question to report subjective health as the ESS, but the ESS used face-to-face interviews at home, with a reported response rate above 60%. The ESS did not cover Greece and Latvia. For the other five countries both studies obtained similar patterns.
The level of Internet use to obtain a prescription, schedule an appointment, or ask a particular health question was assessed by Question A: “In which connection and for what purpose have you approached your family doctor, specialist, or other health professional(s) via the Internet?” The various nonexclusive possibilities included: “request or renew prescription via email or web,” “schedule an appointment,” and “ask a particular health question.” Expectations about future use were appraised by Question B: “Given that you were provided the possibility, state how likely it is that you will do the following during the next year: (1) have consultations with a health professional online and (2) make, cancel, or change an appointment with your family doctor, specialist, or other health professionals online?” The response categories ranged from 1 (“unlikely”) to 5 (“very likely”). The importance attributed by European residents to the provision of email and Web services to communicate with the physician when choosing a new doctor was measured by Question C: “If you were to find a new doctor, state the importance of the following factors for your decision: (1) the possibility of requesting or renewing prescriptions via email or Web, (2) the possibility of scheduling or changing an appointment online, and (3) the possibility of communicating by email.” The response categories ranged from 1 (“not important”) to 5 (“important”).
The focus on factors influencing the choice of a new doctor is relevant to our study. In this way, aspects such as previous experience with a health care provider, either at a clinical or administrative level that might lead to dependence and loyalty, are not considered, and we intended the question to address respondents’ perceptions, attitudes, and expectations created through other mechanisms, such as their own experience with online services, knowledge about the experiences of others, or exposure to related information from mass media.
The questionnaire was designed in English and translated to the language or languages of the participant countries by means of a dual focus method, which strives for conceptual correspondence in addition to equivalence in wording and grammar .
Tables 1 to 3 and Multimedia Appendices 2 to 6 provide 95% confidence intervals (CI) derived from Gaussian approximations of the distribution of the sum of strata frequencies or sum of ratios of strata frequencies. P values of two-sided tests are not given. For each test, significant test results are reported when the null is not inside the 95% interval. Differences (2007 minus 2005) were computed using poststratified data of the first eHealth Trends survey (October to November 2005) in the analyses (Tables 1 to 3 and Multimedia Appendices 2 to 6). Poststratified weighting of the 2005 distribution was defined by weights based on the 2007 distribution that used six age groups (15-25, 26-35, 36-45, 46-55, 56-65 and 66-80 years) by gender. This was done in order to separate real effects from minor changes introduced by sample construction (for more details see ). Binary outcomes of question C were analyzed as dependent variables by logistic regression on demographic, socioeconomic, and health variables. We fitted full models including all independent variables reported in Table 4 and Multimedia Appendix 7. Interaction terms were not fitted. We investigated two different groups: the total sample, which represented the general population, and a subsample of respondents who reported that they had used the Internet for health-related matters in the past. For each factor level, the odds ratio (OR) and 95 % confidence interval of the odds ratio were reported. Factors were tested with type II hypotheses (function Anova, R package: car version 1.2-7) (R Foundation for Statistical Computing, Vienna, Austria). Type-II hypotheses test each term after all others but ignore the term’s higher-order relatives. No variables had more than 5% missing data.
All analyses were performed with SPSS version 16.0 (SPSS Inc, Chicago, IL, USA) and R version 2.8.1 (R Foundation for Statistical Computing, Vienna, Austria) .
Patterns of Use of the Internet to Communicate With Known Health Professionals
Table 1 shows the prevalence of Internet use in 2007 to request or renew a prescription via email or the Web, schedule an appointment, or ask a particular health question, as well as the changes in the period between the two surveys in the seven European countries (for detailed results for each country, see Multimedia Appendices 2 to 4).
[view this table]
|Table 1. Patterns of use of the Internet to communicate with known health professional|
The highest levels of Internet use were found in Denmark where, in 2007, an estimated 7.4% (95% CI 5.8 - 9.1) of the population reported having approached a family doctor, specialist, or other health professional via email or the Web to request or renew a prescription, 9.9% (95% CI 8.0 - 11.8) to schedule an appointment, and 6.7% (95% CI 5.1 - 8.2) to ask particular health questions. The lowest levels of Internet use in 2007 were found in Portugal, with an estimated use for these purposes of 0%, 0.4% (95% CI 0.1 - 0.7), and 0.7% (95% CI 0.3 - 1.1), respectively. The subgroup of health-related Internet users, who were experienced in looking for information on health matters on the Internet, were more active in using eHealth services than the population in general.
Expectations Regarding Future Use of eHealth Services
Table 2 shows the estimated percentages of European citizens and of European health-related Internet users expecting to have consultations with a health professional online or schedule an appointment with a family doctor, specialist, or other health professional online in the near future in 2007, as well as the mean changes in their expectations from 2005 to 2007 in the seven countries. Detailed results for each country are shown in Multimedia Appendices 5 and 6.
[view this table]
|Table 2. Expectations regarding future use of eHealth services|
Among the general population, results showed a decrease in the average percentage of citizens stating they were likely to have consultations with a health professional online and a nonsignificant increase in the average percentage of citizens that believed they were likely to schedule an appointment online in the near future. In the subsample of health-related Internet users, average percentages decreased in the two situations. Denmark stands out as the country where citizens’ expectations had increased most since 2005. In 2007, an estimated 26.2% (95% CI 23.5 - 28.8) of Danes stated they were very likely to have consultations with a health professional online in the year following the survey, and an estimated 36.8% (95% CI 33.9 - 39.7) stated they were very likely to schedule or change an appointment online. This corresponds to estimated mean increases of 5.3% (95% CI 1.5 - 9.0) and 7.3% (95% CI 3.3 - 11.3) respectively from 2005 to 2007.
On the other hand in Poland, citizens’ expectations had decreased the most since 2005. In 2007, an estimated 25% (95% CI 22.3 - 27.7) of Poles stated they were very likely to have consultations with a health professional online in the year following the survey, representing a decrease of 13.3% (95% CI -17.3 to -9.4) from 2005, and 27.3% (95% CI 24.6 - 30.0) affirmed they were very likely to schedule or change an appointment online, a decrease of 8.7% (95% CI -12.7 to -4.7) since 2005. In 2005, however, Polish citizens’ expectations were highest among the European countries studied. In most of the seven countries (as shown in Multimedia Appendices 5 and 6), increases were more pronounced among the general population, while decreases were more pronounced among those using the Internet for health-related purposes. The exception was Latvia, where the average percentage of health-related Internet users expecting to be able to schedule an appointment with a health professional online had increased by 4.9% (95% CI -1.1 to 11.0) from 2005 to 2007.
Importance of eHealth Services When Choosing a New Doctor
Table 3 shows the estimated mean percentages of European citizens and of European health-related Internet users that rated the importance of various eHealth services (using email or the Web) when choosing a new doctor at 4 or 5 (important) on a scale of 5 points in 2005 and 2007 and the mean changes from 2005 to 2007.
[view this table]
|Table 3. Importance of eHealth services when choosing a new doctor in 2007 and changes from 2005 to 2007|
Scheduling or changing an appointment online and communicating with a health professional by email are the most appealing services. In 2007, the former was rated as important by 38.3% (95% CI 37.2 - 39.4) of citizens, corresponding to 2690 individuals and representing a mean change of 3.2% (95% CI 1.8 - 4.7) from 2005. The possibility of communicating by email was valued by a mean percentage of 37.7% (95% CI 36.6 - 38.7) citizens in 2007, corresponding to 2644 individuals and representing a mean change of 3.2% (1.7 - 4.7) from 2005, while the possibility of requesting or renewing prescriptions via email or the Web was quoted as an important factor in their decision by 28.4% (95% CI 27.4 - 29.4) of citizens, corresponding to 1996 individuals and representing a mean change of 2.6% (95% CI 1.2 - 4.0) from 2005. Changes are less significant among health-related Internet users. On average in 2007, half of the population reported that the possibility of having access to at least one eHealth service was important in their decision, while among health-related Internet users the number rises to 7 of every 10 respondents.
Characteristics of Survey Participants who Value eHealth Services When Choosing a New Doctor
Table 4 reports the results of logistic regression analyses that examined relationships between demographic, socioeconomic, and health variables, and the outcomes of the question concerning the importance of eHealth services when choosing a new doctor in the subsample of Internet users for matters related to health or illness. (For detailed results with respect to the general population see Multimedia Appendix 7.)
The estimated odds ratios indicated that those health-related Internet users who appreciated most the possibility of requesting or renewing a prescription via email or the Web when choosing a new doctor were under 25 (OR = 1.97, 95% CI 1.27 - 3.06), had secondary school education (OR = 1.37, 95% CI 1.10 - 1.71) and probably lived in main cities (OR = 1.39, 95% CI 1.08 - 1.78). Among the general population, young, well-educated (OR = 1.68, 95% CI 1.43 - 1.97) working people (OR = 1.27, 95% CI 1.08 - 1.46) no older than 25 (OR = 3.00, 95% CI 2.28 - 3.95) were most interested in this eService. In general, odds ratios for age and education are lower in the subsample, reflecting smaller differences between the groups. In the subsample of health-related Internet users, those valuing most the possibility of scheduling an appointment online were aged 26 to 35 (OR = 2.75, 95% CI 1.81 - 4.19), had no disability or diagnosed illness (OR = 0.67, 95% CI 0.54 - 0.84), and lived in main cities (OR = 1.66, 95% CI 1.30 - 2.11). Multimedia Appendix 7 shows that among the general population young people up to 25 years old (OR = 4.95, 95% CI 3.78 - 6.48) still in education (OR = 1.34, 95% CI 1.07 - 1.68), having some higher education (OR = 1.61, 95% CI 1.38 - 1.87), and living in main cities (OR = 1.30, 95% CI 1.09 - 1.55) were those most frequently interested in the service. The possibility of communicating with a health professional by email seemed particularly appealing to well-educated (OR = 1.93, 95% CI 1.66 - 2.25) working citizens (OR = 1.41, 95% CI 1.22 - 1.62) up to 25 years old (OR = 3.54, 95% CI 2.72 - 4.60). In the restricted sample, we observed significant results for those with secondary education (OR = 1.58, 95% CI 1.28 - 1.96).
[view this table]
|Table 4. Characteristics of health-related Internet users who value eHealth services when choosing a new doctor in 2007|
Use of the Internet to communicate with a known health professional is still rare in Europe, but interest in using it is high and likely to increase. Denmark is the only country in which consistent increases were found in all the variables under analysis in the 18 months between the two surveys.
Patterns of Internet Use to Communicate With Known Health Professionals
As expected, the estimated level of use of the Internet to request or renew prescriptions via email or the Web, schedule an appointment, or ask a known health professional a particular health question is still very low in the seven countries. Although not directly comparable, these results are in line with other reports of the use of these means to communicate with a doctor or a doctor’s practice in the United States . One question remains: were the reasons for such low use the same in the two settings? In Europe, technologies that enable electronic storage of administrative patient data and of medical patient data seem to be available , at least in countries like Denmark, Norway, the United Kingdom, Sweden, the Netherlands, and Germany, although in Germany these technologies are not as available as in the other countries. However, use of email to communicate with patients may be in contravention of health authority policy. Benchmarking studies have confirmed that using the Internet or electronic health networks to email patients about health or even administrative issues is very rare (around 3%) in general practitioners’ practices throughout Europe , Denmark (at about 60%) being a clear exception.
In the United States, as early as 2001, the Institute of Medicine asserted that “patients should receive care whenever they need it and in many forms, not just face-to-face visits” and that “access to care should be provided over the Internet, by telephone, and by other means .” Meanwhile, the level of adoption of other health information technology by the health sector is still low and will likely remain slow unless significant financial incentives are made available [45,46]. Reported experiences with Web messaging have been promoted and financially supported by some health plans in the United States . Many aspects of electronic communication related to reimbursement, legal issues, trust, and security remain unclear and need to be addressed.
The change in use during the 18 months between the two eHealth Trends surveys in Europe is statistically significant, even though certainly not impressive. However, the real relevance of this change must be analyzed in the light of the legal and regulatory environment prevailing in Europe and the policies governing health care delivery in the participating countries, as well as the technological achievements in each country. Despite the stated intentions , so far little seems to have changed in most of the countries studied. In Greece, for example, the legal framework for e-prescription and reimbursement is still incomplete.
According to a federal government report issued in Germany in April 2009 , the electronic health card is being piloted there, and electronic prescription has not been implemented so far. While email is available for interaction with most practitioners in Germany, it is not normally used for consultation but for administrative requests only, while the directive from the German Medical Association regarding email communication between doctor and patient remains .
In Poland, there are still no specific policies or legal regulations that could encourage online or even telephone medical consultations. Currently, basic online eHealth services are rare and there are few services offering online interaction with general practitioners. In 2004 the Ministry of Health issued an internal document called “Poland: eHealth Strategy for 2004-2006,” which stated that strategies for eHealth are part of the broader effort focused on development of the information society in Poland . This might be the reason why the number of Poles expecting to use eHealth services in the year following the survey was the highest among the European countries studied in the 2005 survey. However, in spite of many promises and assurances from the government, the situation has not changed during the last 2 years and it still lacks regulation. Such regulations could solve the legal problems associated with eHealth consultations, enabling eHealth services to be officially implemented and reimbursed. On the other hand, attempts to implement and develop a registry of health services based on the use of electronic health insurance cards have been underway for the last ten years , but there is still no common and functional EHR system. These situations are probably part of the explanation for such a large decrease in citizens’ expectations in Poland in the 18 months between the two surveys.
In Norway, direct communication between patients and health professionals is limited to making appointments. It is illegal in Norway to communicate about personal health matters (ie, providing personally identifiable information) via email unless a special encrypted service is used. So far, only a minority of general practitioners’ (GP) offices in Norway offer this service.
In Portugal, the implementation of a national EHR system is currently under public discussion, while specific legislation for eHealth is still missing.
Expectations Regarding Future Use of eHealth Services
Overall, the citizens of the seven countries surveyed seemed to have had low expectations regarding the likelihood of having consultations with health professionals or being able to schedule appointments online in the period from 2005 to 2007. A study conducted in the United Kingdom in 2003  concluded at the time that “patients simply doubted whether it was possible for the National Health Service and technology to cope with patients ordering prescriptions, emailing GPs, and booking appointments online.” Therefore, further work is needed to assess how our results should be interpreted, whether as a sign of doubt regarding the capacity of health systems and technology to handle such demands, as a reaction to the current level of provision, or as a barometer of the need and intention to use. Meanwhile, it is almost impossible not to question the extent to which the delay in implementation of the “information society” in many European countries is lowering the expectations of their citizens and cooling down enthusiasm for these new services. This may be the reason why the decrease in expectations concerning the use of eHealth services in the near future is higher among those experienced in using the Internet for health-related matters.
Importance of eHealth Services When Choosing a New Doctor
Nevertheless, the percentage of citizens that considered the availability of such eHealth services to be important when choosing a new doctor increased significantly by around 3% from 2005 to 2007. On average, in 2007, more than one third of the overall population seemed to be interested in the possibility of renewing a prescription, scheduling an appointment, or asking their doctors health questions online. This suggests that an attractive market for health organizations using the Internet as part of their business models is developing in Europe. Further research is needed to find out if European citizens would be willing to pay for access to such services, as has been reported in studies conducted in the United States .
A pilot study conducted in Poland and Greece showed that three out of four Greek patients (73.2%), once they felt comfortable with telemedicine (28% of the general population), were willing to pay €10 for each online consultation. The percentage of Polish respondents comfortable with telemedicine (35.5%) that were willing to pay for remote medical consultation was found to be somewhat lower (58.3%) but still significant. Among the general population in Poland and in Greece, 1 in 5 respondents said they were willing to pay €10 for a medical online consultation .
The situation in Denmark was shown to be remarkable compared with that in the other countries and deserves special mention. Not only was use of the Internet for renewing prescriptions, scheduling appointments, and asking health professionals about health questions reported to be higher, but Danes stood out as having had the highest expectations regarding the possibility of using particular eHealth services in the near future.
Five major factors seem to facilitate a positive environment for eHealth services: regulation/legal framework; reimbursement schemes; security and trust/infrastructure; the eHealth portal; and maturity in Internet adoption and usage.
In Denmark, the collective agreement (CA) between the General Practitioners Association and Danish Regions, via The Regions Salary and Fee Committee (RLTN), specifically addressed and set the terms for electronic communication in general practitioner practices. The CA stated that electronic communication (appointment booking, repeat prescription, and email consultation) must be offered to clinic patients by no later than January 1, 2009, although it was possible to apply for dispensation of the rule. Email consultation must be of a simple, concrete, and nonurgent nature without the need for further information. Lab results can also be offered via email after agreement with the patient. Email consultations are to be reimbursed by a fixed fee. Appointment booking and repeat prescriptions are considered a general service and are not reimbursed.
Security requirements have been established in Denmark. For a patient, there are two ways of sending an email to the doctor: through the eHealth portal sundhed.dk , which requires a digital signature, or through the doctor’s own website, which requires logging in. In both cases the email is written on a Web interface where it is Secure Sockets Layer (SSL) encrypted. It is actually converted to an EDIFACT, so it goes directly into the doctor’s information system. The patient receives an ordinary email announcing that there is now a reply to the email from the doctor, and the patient can then log in again either through sundhed.dk or the doctor’s own website to read the message.
Sundhed.dk  is the official Danish eHealth portal for the public Danish health care services (sundhed means “health” in Danish) that have been brought together on the Internet by the portal. This makes it possible for patients, their families, and health care professionals to access information and to communicate with each other. Use is registered and logged for security. Access to the restricted area (based on proof of employment) is possible for all health care professionals (eg, general practitioners, specialist doctors, dentists, physiotherapists, psychologists, and chiropractors) and organizations (eg, hospitals, pharmacies, and municipalities). Organizations such as municipalities can register for the digital signature as a single unit and assign staff approved by the authorities to it.
Regulatory and technical conditions are echoed by the maturity of the Danish in Internet adaptation and usage . Many daily activities both private and work-related normally take place on the Internet, including public administration. Therefore, using it to communicate with the health care sector is a natural consequence. Secondly, thanks to sundhed.dk, Danes are now familiar with health services and information available online. A survey on the use of electronic services in general practitioner clinics published in December 2007  also clearly showed the same pattern, reporting an increase of more than 75% from 2006 to 2007. However, in the public health care sector, development of electronic patient health record systems has been slow due to the level of decentralized decision-making regarding ICT investment. Pressure for interoperability and the structural reform taking place have either delayed or put many ICT projects in eHealth on hold .
Characteristics of Survey Participants Who Value eHealth Services When Choosing a New Doctor
From the results of logistic regression analysis, we know that, at least for now, the most prevailing characteristics of European citizens for whom availability of eHealth services are important in their decision when choosing a new doctor are age and having completed higher education. This profile changes slightly for those interested in the possibility of scheduling or changing an appointment online to include being a student and living in a main city, while for those interested in communicating by email with the physician, the profile includes being employed. Many reasons may be invoked to explain these findings. For example, younger people may feel more at ease with technology and have a natural predisposition to test new solutions, and people with higher education are likely to have more access to technology. The shortage of time experienced by most professionals may also explain their desire to communicate with their physicians by email.
For the subsample of health-related Internet users, the most interesting findings are the difference in the impact of age on each dependent variable and the interest shown by those having completed secondary school education. That is, the possibility of requesting or renewing prescriptions via email or the Web was attractive to young people up to 25 years old, the possibility of scheduling or changing an appointment online appealed most to those in the 26 to 35 age group, and the possibility of communicating by email--probably a more engaging and demanding activity in terms of responsibility, appealed most to those between 36 and 45 years old. Regarding level of education, we found that among those with access to the Internet, citizens with secondary school education seemed more eager for eHealth services than those with higher education. This finding probably reflects the greater difficulty people with lower levels of education have in reconciling work and visits to the doctor and their lower economic power to pay for health care. This interesting line of research deserves more thorough study in the future. Place of residence also had an influence on these profiles, with those living in big cities giving more value to the possibility of requesting or renewing prescriptions via email or the Web and the possibility of scheduling or changing an appointment online, while there was an indication that communicating by email with the doctor was more appealing to those living in villages. It seems that those who may have easier access to health care appreciate the Internet for simplifying administrative tasks, while those for whom personal contact with health professionals is more difficult because of the distance are more likely to appreciate email communication.
As we could not find any other reported studies of use of the same eHealth services, benchmarking of our results can be done only to a limited extent. Compared with our findings, a study conducted in 2005  showed that online American women were more likely than men to have communicated with a health care provider through the Internet; education was not associated with online patient-provider communication in the multivariate model, age was not a predictor of behaviour, and use of online patient-provider communication was higher among Internet users experiencing health problems or with significant medical histories. A Dutch study of nonusers of e-consultations  showed that the elderly, less-educated individuals, chronic medication users, and frequent GP visitors were more motivated to use the service. Several studies have found that online women were more likely than men to search for health information [31,55,56]. However, besides differences at the demographic level, we did not find evidence of higher interest in the eHealth services we studied among those feeling in poor health, those suffering from a disability or long-term illness, or those associated with someone close who is disabled or suffering from long-term illness. In fact, having no disability was found to be a predictor of interest in the possibility of scheduling appointments online.
Study Contributions and Limitations
The study reported here is novel both in its aim and dimension.
To our knowledge, by the time of the second survey, no reports were available in the literature regarding the extent to which attempts being made by governments in Europe to implement eHealth services were reaching the population at large. Nor was it known the extent to which citizens and even health providers were conscious of what was technically or legally feasible. In fact, recent work confirms that this is still the case in other settings . Therefore, this work represents a timely assessment of conditions being experienced by citizens in the seven countries and of how they perceived and internalized what they knew about efforts being made.
Results are based on representative samples of the populations in seven European countries. In these countries there has been a lack of empirical evidence regarding citizens’ attitudes and expectations towards online interaction with known health professionals and the present levels of use of specific eHealth services. However, the surveys did not cover all European countries. In addition, the possibility of generalizing the results may be hindered by the survey response rate.
The data used in this article was collected within the WHO/European survey on eHealth consumer trends, in part financed by the Program of Community Action in the Field of Public Health eHealth (2003-2008) of the Health and Consumer Protection Directorate General, Directorate C, EC. The funding sources had no role in the design and conduct of the study; the collection, management, analysis, and interpretation of the data; nor the preparation, review, or approval of the manuscript. We acknowledge the contributions of other members of the project group for their efforts in design and data collection: Hege Andreassen, Roxana C Dumitru, António Sousa Pereira, Per Hjortdahl, Angelina Kouroubali, Hans-Ulrich Prokosch, Iveta Pudule, Andrzej Staniszewski, Henning Voss and Silje C. Wangberg.
Conflicts of Interest
Multimedia Appendix 1
Frequencies of age groups by gender and of sociodemographic variables per country, in 2007[JPEG file (JPEG Image), 160 KB]
Multimedia Appendix 2
Observed frequency and percentage of citizens who have requested or renewed prescription via email or web in 2007 in each country and changes from 2005 to 2007[JPEG file (JPEG Image), 60 KB]
Multimedia Appendix 3
Observed frequency and percentage of citizens who have scheduled an appointment via the Internet in 2007 in each country and changes from 2005 to 2007[JPEG file (JPEG Image), 61 KB]
Multimedia Appendix 4
Observed frequency and percentage of citizens who have asked a particular health question to their family doctor, specialist or other health professional via the Internet in 2007 in each country and changes from 2005 to 2007[JPEG file (JPEG Image), 66 KB]
Multimedia Appendix 5
Observed frequency and percentage of citizens expecting to have consultations with health professional online in the year following the survey in 2007 in each country and changes from 2005 to 2007[JPEG file (JPEG Image), 70 KB]
Multimedia Appendix 6
Observed frequency and percentage of citizens expecting to schedule an appointment online in the year following the survey in 2007 in each country and changes from 2005 to 2007[JPEG file (JPEG Image), 67 KB]
Multimedia Appendix 7
Characteristics of European citizens prizing eHealth services when choosing a new doctor in 2007[JPEG file (JPEG Image), 107 KB]
- . On information to patients and patient empowerment. Comité Permanent des Médicins Européens/Standing Committee of European Doctors 2004 Sep 11.
- Hughes B, Joshi I, Wareham J. Health 2.0 and Medicine 2.0: tensions and controversies in the field. J Med Internet Res 2008;10(3):e23 [FREE Full text] [Medline] [CrossRef]
- Eysenbach G. Medicine 2.0 Congress website launched (and Definition of Medicine 2.0 / Health 2.0). Gunther Eysenbach’s Random Research Rants. 2008. URL: http://gunther-eysenbach.blogspot.com/2008/03/medicine-20-congress-website-launched.html [WebCite Cache]
- Car J, Sheikh A. Email consultations in health care: 1--scope and effectiveness. BMJ 2004 Aug 21;329(7463):435-438 [FREE Full text] [Medline] [CrossRef]
- Baker L, Rideout J, Gertler P, Raube K. Effect of an Internet-based system for doctor-patient communication on health care spending. J Am Med Inform Assoc 2005;12(5):530-536 [FREE Full text] [Medline] [CrossRef]
- McGeady D, Kujala J, Ilvonen K. The impact of patient-physician web messaging on healthcare service provision. Int J Med Inform 2008 Jan;77(1):17-23. [Medline] [CrossRef]
- Bauchner H, Adams W, Burstin H. "You've got mail": issues in communicating with patients and their families by e-mail. Pediatrics 2002 May;109(5):954-956 [FREE Full text] [Medline] [CrossRef]
- Kassirer JP. Patients, physicians, and the Internet. Health Aff (Millwood) 2000;19(6):115-123 [FREE Full text] [Medline] [CrossRef]
- Borowitz SM, Wyatt JC. The origin, content, and workload of e-mail consultations. JAMA 1998 Oct 21;280(15):1321-1324 [FREE Full text] [Medline] [CrossRef]
- Katz SJ, Moyer CA. The emerging role of online communication between patients and their providers. J Gen Intern Med 2004 Sep;19(9):978-983 [FREE Full text] [Medline] [CrossRef]
- Spielberg AR. On call and online: sociohistorical, legal, and ethical implications of e-mail for the patient-physician relationship. JAMA 1998 Oct 21;280(15):1353-1359. [Medline] [CrossRef]
- Smith JJ, Berlin L. E-mail consultation. AJR Am J Roentgenol 2002 Nov;179(5):1133-1136 [FREE Full text] [Medline]
- Liederman EM, Lee JC, Baquero VH, Seites PG. Patient-physician web messaging. The impact on message volume and satisfaction. J Gen Intern Med 2005 Jan;20(1):52-57 [FREE Full text] [Medline] [CrossRef]
- Delbanco T, Sands DZ. Electrons in flight--e-mail between doctors and patients. N Engl J Med 2004 Apr 22;350(17):1705-1707. [Medline] [CrossRef]
- Patt MR, Houston TK, Jenckes MW, Sands DZ, Ford DE. Doctors who are using e-mail with their patients: a qualitative exploration. J Med Internet Res 2003 May 15;5(2):e9 [FREE Full text] [Medline] [CrossRef]
- Sittig DF. Results of a content analysis of electronic messages (email) sent between patients and their physicians. BMC Med Inform Decis Mak 2003 Oct 1;3(1):11 [FREE Full text] [Medline] [CrossRef]
- Gaster B, Knight CL, DeWitt DE, Sheffield JVL, Assefi NP, Buchwald D. Physicians' use of and attitudes toward electronic mail for patient communication. J Gen Intern Med 2003 May;18(5):385-389 [FREE Full text] [Medline] [CrossRef]
- Katz SJ, Nissan N, Moyer CA. Crossing the digital divide: evaluating online communication between patients and their providers. Am J Manag Care 2004 Sep;10(9):593-598 [FREE Full text] [Medline]
- Nordqvist C, Hanberger L, Timpka T, Nordfeldt S. Health professionals' attitudes towards using a Web 2.0 portal for child and adolescent diabetes care: qualitative study. J Med Internet Res 2009;11(1):e12. [Medline] [CrossRef]
- Virji A, Yarnall KSH, Krause KM, Pollak KI, Scannell MA, Gradison M, et al. Use of email in a family practice setting: opportunities and challenges in patient- and physician-initiated communication. BMC Med 2006;4(1):18 [FREE Full text] [Medline] [CrossRef]
- Lin CT, Wittevrongel L, Moore L, Beaty BL, Ross SE. An Internet-based patient-provider communication system: randomized controlled trial. J Med Internet Res 2005;7(4):e47 [FREE Full text] [Medline] [CrossRef]
- Adler KG. Web portals in primary care: an evaluation of patient readiness and willingness to pay for online services. J Med Internet Res 2006;8(4):e26 [FREE Full text] [Medline] [CrossRef]
- Kleiner KD, Akers R, Burke BL, Werner EJ. Parent and physician attitudes regarding electronic communication in pediatric practices. Pediatrics 2002 May;109(5):740-744 [FREE Full text] [Medline] [CrossRef]
- Anand SG, Feldman MJ, Geller DS, Bisbee A, Bauchner H. A content analysis of e-mail communication between primary care providers and parents. Pediatrics 2005 May;115(5):1283-1288 [FREE Full text] [Medline] [CrossRef]
- Singh H, Fox SA, Petersen NJ, Shethia A, Street RL. Older patients' enthusiasm to use electronic mail to communicate with their physicians: cross-sectional survey. J Med Internet Res 2009;11(2):e18 [FREE Full text] [Medline] [CrossRef]
- Goodyear-Smith F, Wearn A, Everts H, Huggard P, Halliwell J. Pandora's electronic box: GPs reflect upon email communication with their patients. Inform Prim Care 2005;13(3):195-202. [Medline]
- Neville RG, Marsden W, McCowan C, Pagliari C, Mullen H, Fannin A. A survey of GP attitudes to and experiences of email consultations. Inform Prim Care 2004;12(4):201-206. [Medline]
- Castrén J, Niemi M, Virjo I. Use of email for patient communication in student health care: a cross-sectional study. BMC Med Inform Decis Mak 2005 Jan 27;5(1):2 [FREE Full text] [Medline] [CrossRef]
- Cummings J. Few patients use or have access to online services for communicating with their doctors, but most would like to. The Wall Street Journal Online 2006;5(16).
- Beckjord EB, Finney Rutten LJ, Squiers L, Arora NK, Volckmann L, Moser RP, et al. Use of the internet to communicate with health care providers in the United States: estimates from the 2003 and 2005 Health Information National Trends Surveys (HINTS). J Med Internet Res 2007;9(3):e20 [FREE Full text] [Medline] [CrossRef]
- Kummervold PE, Chronaki CE, Lausen B, Prokosch HU, Rasmussen J, Santana S, et al. eHealth trends in Europe 2005-2007: a population-based survey. J Med Internet Res 2008;10(4):e42 [FREE Full text] [Medline] [CrossRef]
- Nijland N, van Gemert-Pijnen JEWC, Boer H, Steehouder MF, Seydel ER. Increasing the use of e-consultation in primary care: results of an online survey among non-users of e-consultation. Int J Med Inform 2009 Oct;78(10):688-703. [Medline] [CrossRef]
- eHealth ERA. 2007. Database of European eHealth priorities and strategies. URL: http://www.ehealth-era.org/database/database.html [WebCite Cache]
- . Sundhedsstyrelsen. 2003 May. National IT Strategy for the Danish Health Care Service 2003 - 2007. URL: http://www.sst.dk/publ/Publ2004/National_IT_strategy.pdf [WebCite Cache]
- Stroetmann KA, Lilischkis S. eHealth ERA. 2007. eHealth strategy and implementation activities in Germany: Report in the framework of the eHealth ERA project URL: http://www.ehealth-era.org/database/documents/ERA_Reports/Germany_eH-ERA_Country_Report_final_30-06-2007.pdf [WebCite Cache]
- Doupi P. eHealth ERA. 2007. eHealth strategy and implementation activities in GREECE URL: http://www.ehealth-era.org/database/documents/ERA_Reports/Greece_eHealth-ERA_Country_Report_Final_21-05-2007.pdf [WebCite Cache]
- Duplaga M, Leszczuk M, Wirska A, Bukowczan S, Andrychiewicz A. eHealth ERA. 2007. eHealth strategy and implementation activities in Latvia. URL: http://www.ehealth-era.org/database/documents/ERA_Reports/eH-ERA_Latvia_report_April%202007.pdf [WebCite Cache]
- eHealth ERA. 2007. eHealth priorities and strategies in European countries:act sheet: Norway URL: http://www.ehealth-era.org/database/documents/factsheets/Norway.pdf [WebCite Cache]
- Duplaga M, Leszczuk M, Wirska A, Kozierkiewicz A, Trąbka W. eHealth ERA. 2007. eHealth strategy and implementation activities in Poland: Report in the framework of the eHealth ERA project URL: http://www.ehealth-era.org/database/documents/ERA_Reports/eH-ERA_Poland_report_January%20%202007.pdf [WebCite Cache]
- Monteagudo JL, Moreno O. eHealth ERA. 2007. eHealth strategy and implementation activities in Portugal: Report in the framework of the eHealth ERA project URL: http://www.ehealth-era.org/database/documents/ERA_Reports/Portugal_eHealth-ERA_country_report_final_01-06-2007.pdf [WebCite Cache]
- Erkut S, Alarcón O, Coll C, Tropp L, Garcia H. The dual-focus approach to creating bilingual measures. J Cross Cult Psychol 1999;30(2):206-218. [CrossRef]
- . R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2008.
- Meyer I. Benchmarking ICT use among General Practitioners in Europe, European Commission. Bonn, Germany: Information Society and Media Directorate General and Empirica; 2008.
- . Crossing the Quality Chasm. Washington, DC: National Academy Press; 2001.
- Poon EG, Jha AK, Christino M, Honour MM, Fernandopulle R, Middleton B, et al. Assessing the level of healthcare information technology adoption in the United States: a snapshot. BMC Med Inform Decis Mak 2006;6(1):1 [FREE Full text] [Medline] [CrossRef]
- Jha AK, DesRoches CM, Campbell EG, Donelan K, Rao SR, Ferris TG, et al. Use of electronic health records in U.S. hospitals. N Engl J Med 2009 Apr 16;360(16):1628-1638 [FREE Full text] [Medline] [CrossRef]
- . eHealth ERA report. 2007 Mar. eHealth Priorities and Strategies in European Countries. Towards the Establishment of a European eHealth Research Area. URL: http://ec.europa.eu/information_society/activities/health/docs/policy/ehealth-era-full-report.pdf [WebCite Cache]
- Bundesministerium für Gesundheit, Tests bestanden - Einführung der Karte kann beginnen. 2009 URL: http://www.bmg.bund.de/cln_110/nn_1211088/SharedDocs/Standardartikel/DE/AZ/E/Glossar-Elektronische-Gesundheitskarte/Karte-im-Test.html?__nnn=true [WebCite Cache]
- eUser Public Online Services and User Orientation. 2005 Aug. Country Brief: Germany. URL: http://www.euser-eu.org/ShowCase.asp?CaseID=1659&LevelCodeID=81&print=YES [WebCite Cache]
- . National Health Service. 2003. The Public View on Electronic Health Records. URL: http://www.dh.gov.uk/prod_consum_dh/groups/dh_digitalassets/@dh/@en/documents/digitalasset/dh_4055046.pdf [WebCite Cache]
- Chronaki C, Roumeliotaki T, Bujnowska-Fedak M, Staniszewski A. E-Health consumer attitudes in Poland and Greece: a comparison. In: Cunningham P, Cunnigham M, editors. Collaboration and the Knowledge Economy: Issues, Applications, Case Studies. Amsterdam, Netherlands: IOS Press;36-42 .
- sundhed.dk. 2009. The Danish eHealth Portal. URL: https://www.sundhed.dk/ [WebCite Cache]
- sundhed.dk. 2007. Kontakten til lægen bliver stadig mere elektronisk. URL: https://www.sundhed.dk/Artikel.aspx?id=10635.1 [WebCite Cache]
- eUser Public Online Services and User Orientation. 2005 Aug. Country Brief: Denmark URL: http://www.euser-eu.org/eUSER_eHealthCountryBrief.asp?CaseID=2217&CaseTitleID=1058&MenuID=118 [WebCite Cache]
- Andreassen HK, Bujnowska-Fedak MM, Chronaki CE, Dumitru RC, Pudule I, Santana S, et al. European citizens' use of E-health services: a study of seven countries. BMC Public Health 2007;7(1):53 [FREE Full text] [Medline] [CrossRef]
- Rutten LJF, Squiers L, Hesse B. Cancer-related information seeking: hints from the 2003 Health Information National Trends Survey (HINTS). J Health Commun 2006;11 Suppl 1(1):147-156. [Medline] [CrossRef]
|CATI: Computer-Assisted Telephone Interviews|
|EHR: Electronic Health Records|
|ESS: European Social Survey|
|ICT: Information and Communication Technology|
|HINTS: Health Information National Trends Survey|
|SSL: Secure Sockets Layer|
|WHO: World Health Organization|
|Edited by L Van Gemert-Pijnen; submitted 06.06.09; peer-reviewed by N Nijland, K Adler; comments to author 12.08.09; revised version received 20.11.09; accepted 02.12.09; published 15.06.10|
Please cite as:
Santana S, Lausen B, Bujnowska-Fedak M, Chronaki C, Kummervold PE, Rasmussen J, Sorensen T
Online Communication Between Doctors and Patients in Europe: Status and Perspectives
J Med Internet Res 2010;12(2):e20
END, compatible with Endnote
BibTeX, compatible with BibDesk, LaTeX
RIS, compatible with RefMan, Procite, Endnote, RefWorks
Add this article to your Mendeley library
Add this article to your CiteULike library
Copyright©Silvina Santana, Berthold Lausen, Maria Bujnowska-Fedak, Catherine Chronaki, Janne Rasmussen, Tove Sorensen. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 15.06.2010
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.