JMIR Publications

Select Journals for Content Updates

When finished, please click submit.

This paper is in the following e-collection/theme issue:

    Original Paper

    eHealth Trends in Europe 2005-2007: A Population-Based Survey

    1Norwegian Centre for Telemedicine, University Hospital of North-Norway, Tromsø, Norway

    2Institute of Computer Science, Foundation for Research and Technology-Hellas, Heraklion, Crete, Greece

    3Department of Medical Informatics, Biometrics and Epidemiology, Unit for Biometrics and Epidemiology, Erlangen, Germany

    4Department of Medical Informatics, Biometrics and Epidemiology, Unit for Medical Informatics, Erlangen, Germany

    5MedCom International, MedCom, Odense, Denmark

    6DEGEI/IEETA, University of Aveiro, Aveiro, Portugal

    7Department of Family Medicine, Wrocław Medical University, Wrocław, Poland

    Corresponding Author:

    Per Egil Kummervold, MA

    Norwegian Centre for Telemedicine

    University Hospital of North-Norway

    PO Box 35

    N-9038 Tromsø

    Norway

    Phone: +47 77 75 40 00

    Fax:+47 77 75 40 98

    Email:


    ABSTRACT

    Background: In the last decade, the number of Internet users worldwide has dramatically increased. People are using the Internet for various health-related purposes. It is important to monitor such use as it may have an impact on the individual’s health and behavior, patient-practitioner roles, and on general health care provision.

    Objectives: This study investigates trends and patterns of European health-related Internet use over a period of 18 months. The main study objective was to estimate the change in the proportion of the population using the Internet for health purposes, and the importance of the Internet as a source of health information compared to more traditional sources.

    Methods: The survey data were collected through computer-assisted telephone interviews. A representative sample (N = 14,956) from seven European countries has been used: Denmark, Germany, Greece, Latvia, Norway, Poland, and Portugal. The European eHealth Consumer Trends Survey was first conducted in October-November 2005 and repeated in April-May 2007. In addition to providing background information, respondents were asked to rate the importance of various sources of health information. They were also queried as to the frequency of different online activities related to health and illness and the effects of such use on their disposition.

    Results: The percentage of the population that has used the Internet for health purposes increased from an estimated 42.3% (95% CI [Confidence Interval] 41.3 - 43.3) in 2005 to an estimated 52.2% (95% CI 51.3 - 53.2) in 2007. Significant growth in the use of the Internet for health purposes was found in all the seven countries. Young women are the most active Internet health users. The importance of the Internet as a source of health information has increased. In 2007, the Internet was perceived as an important source of health information by an estimated 46.8% (95% CI 45.7 - 47.9) of the population, a significant increase of 6.5 % (95% CI 4.9 - 8.1) from 2005. The importance of all the traditional health information channels has either decreased or remained the same. An estimated 22.7% (95% CI 21.7 - 23.6) are using it for more interactive services than just reading health information.

    Conclusion: The Internet is increasingly being used as a source of health information by the European population, and its perceived importance is rising. Use of the Internet for health purposes is growing in all age groups and for both men and women, with especially strong growth among young women. We see that experienced Internet health users are also using the Internet as an active communication channel, both for reaching health professionals and for communicating with peers.

    J Med Internet Res 2008;10(4):e42)

    doi:10.2196/jmir.1023

    KEYWORDS



    Introduction

    In recent years, the number of Internet users has increased considerably and the Internet is being used for various health purposes [1-5]. Health professionals, patient organizations, and the pharmaceutical industry are using the Internet as a medium for communicating health information [6-9]. For patients the most obvious use is as a source of health information. Nevertheless, we also see that they use it for accessing and managing their own personal health record [10-13], for purchasing health products and services, and for communicating with peers and health professionals [14,15].

    However, most of the literature on this issue comes from the United States. Studies on the use of Internet-based technologies for health purposes within Europe are still rare [16,17]. To chart the European status of this development, a survey in Denmark, Germany, Greece, Latvia, Norway, Poland, and Portugal was conducted in 2005 as the first phase of the WHO eHealth Consumer Trends Survey funded by the European Commission. This baseline study showed that even if there were considerable regional differences, a significant proportion of citizens in all the countries studied were using Internet for health purposes [18-20].

    To study the pace and direction of the European citizens’ appraisal of eHealth services, we repeated the survey in 2007. In addition to studying trends in the general population, the study also focuses on whether the type and frequency of health-related activities on the Internet change as the medium matures and Internet users become more experienced. In doing so, we hope to shed some light on the future of Internet-based services for health and illness.


    Methods

    Participants and Procedure

    The first survey was conducted in the period from October to November 2005. Random digit dialling in strata was used to ensure a randomized representative sample of the seven participating countries. Sampling continued until we had approximately 1000 completed interviews per country, except for Portugal where the limit was increased to 2000 complete interviews, as health-related Internet use was expected to be low.

    The second survey took place in April and May 2007. Experiences from the first survey showed that the sample was skewed for some age groups. In 2007, quotas were therefore constructed based on census data for age and gender to make sure the data were more representative in this regard. This ensured that the sample had the same distribution age (six groups) and gender as the census. As described below, weighting were used on the 2005 data to adjust them accordingly. The target sample size was set to 1000 for all countries in 2007.

    Mobile phone numbers were included in Norway, Denmark, and Latvia. In the other countries only landline telephones were included since it was difficult to get a reliable sample based on mobile phones in these countries in 2005. In the countries where mobile phones were included, the telephone penetration was close to 100% for Norway and Denmark, while it was around 93% in Latvia. In the countries where only landline telephones were used, the telephone penetration was estimated for 2005/2007 to be 87/82% in Greece, 63/64% in Poland, and 65/60% in Portugal. In Germany is was close to 100%.

    To get a response rate for telephone interviews comparable to ordinary interviews can be challenging. In 2005, we were not able to get comparable numbers from all countries allowing us to give an exact response rate. This procedure was improved for 2007. Problems reaching the target person can be divided into two groups. The first is “no contact”, including incorrect numbers, disconnected numbers, and answering machines. When we are doing stratified sampling with no additional details about the person we are calling, this group also contains people not in the target group. This group was on average 58% of the total numbers called (min: 36% in Germany, max: 76% in Denmark). If we want a response rate comparable to ordinary interviews, it is reasonable to exclude this group. We should then calculate the response rate of the people that actually had a chance to participate.

    The second group is “non-responses”, including people not wanting to participate in interviews, people not having time to participate, language problems, interrupted interviews, and people being too sick to participate. Using this number for calculation, we get an average response rate of 36% (min: 17% in Greece, max: 60% in Latvia).

    National ethics committees in all the participating countries were informed and had no objections to the study. The data was analysed using the SPSS software version 15.0 and R version 2.5.1.

    Measures

    The questionnaire used in the study was designed for computer-assisted telephone interviews (CATI). The questionnaire was first designed in English. A dual-focus approach was then used for translating it into the languages of the seven European countries participating in the survey: Denmark, Germany, Greece, Latvia, Norway, Poland, and Portugal. The dual-focus approach strives for conceptual equivalence rather than wording and grammar, and is a modification of the back-translation method [21]. After the translation, the questionnaire was piloted with 100 individuals in Norway.

    Internet use for health purposes was measured with the question, “How often do you use the Internet to get information about health or illness?”. The response alternatives were: “Every day”, “Every week”, “Every month”, “Every six months”, “Every year”, “Less than once a year”, and “Never”. All not answering “Never” were coded as having used the Internet for health purposes. To measure the importance of different health information channels, the respondents were asked to rate their importance on a scale going from 1 “not important” to 5 “important”.

    Data Analyses

    Mainly the analyses compare change in proportion from 2005 to 2007. Secondly, differences in proportions by demographic variables such as age and gender are assessed. Significant change is judged by non-overlapping confidence intervals (CI). All reported CI’s are 95%. The CIs are derived by Gaussian approximations of the distribution of the sum of strata frequencies or sum of ratios of strata frequencies. P-values of two sided tests are not given. Significant test results are reported when the null is not inside the 95% interval.

    The 2005 data were weighted based on the 2007 distribution regarding age and gender. The reason for weighting the data was to distinguish real effects from minor changes in the demographics of the samples. The weighting also corrected for differing sample sizes, mainly Portugal in 2005. Unfortunately, the weighting means that it would be confusing to state absolute numbers of respondents to each question for 2005.

    All countries contribute equally to the grand total, but numbers weighted for population size are also stated in Table 1.

    Logistic regression analysis was calculated using employment status, year, gender, and age as dependent variables for the independent variables Internet user, Internet health users, and users of interactive Internet health services. For each variable, we report odds ratios and 95% confidence intervals of the odds ratios.


    Results

    General Trends

    On average, the percentage of the population that had used the Internet for health purposes increased from 42.3% (41.3 - 43.3)in 2005 to 52.2% (51.3 - 53.2) in 2007 (Table 1). There were regional differences. The lowest 2007 use was registered in Greece at 32.1% (29.5 - 34.7) and Portugal at 38.3% (35.6 - 41.0). The highest use was recorded in Denmark at 71.6% (69.1 - 74.1) and Norway at 66.8% (64.2 - 69.5) [22].

    Significant growth in the use of Internet for health purposes was found in all the seven countries participating in the survey, with an average growth of 9.9% (8.5 - 11.3). Highest growth was noted in Germany (12.2%), Poland (11.8%), and Latvia (11.3%), whereas the lowest growth was noted in Portugal (9.1%), Greece (8.9%), and Norway (6.6%).

    Table 1. Internet health users in the seven European countries—trends 2005 and 2007 (an expanded version that also includes Internet users is available as Multimedia Appendix 1)
    View this table

    Demographics

    In 2005, there were significantly more men using the Internet in all age groups. This difference seems to have diminished and was no longer significant in 2007 for the youngest age group (15 - 25 years). Of women aged 15 - 25 years, 83.5% used the Internet for health purposes in 2007. The corresponding proportion for men was 72.4%. At the other end of the age scale (66 - 80 years), we saw the opposite effect, where 22.6% of men and 9.9% of women used the Internet for health purposes (Figure 1, Multimedia Appendix 3). The same effect was visible in 2005, but it was not so clear.

    Figure 1. Internet and Internet health usage in 2005 and 2007, by age and gender (numbers are available in Multimedia Appendices 2 and 3)
    View this figure

    The Internet as a Source of Health Information

    The participants rated the importance of various sources of health information on a scale from 1 to 5. The top two alternatives (4 = important and 5 = very important) were recoded as “important” in Table 2. The Internet had a 6.5% (5.0 - 8.1) increase, and in 2007 was characterized as important by 46.8% (45.7 - 47.9) of the population. Direct contact with health professionals, although decreasing from 2005, was still perceived as the most important source of health information with 73.8% (72.8 - 74.8) describing it as important. It was followed by “family, friends, and colleagues” at 63.8% (62.8 - 64.9). The sharpest decline was observed in newspapers and magazines, which had a 5.1% (3.5 - 6.7) decrease to 48.2% (47.0 - 49.3).

    Table 2. Importance of various sources for health information
    View this table

    There is considerable variation in the importance placed on the Internet as a source of health information within the seven European countries studied. In Denmark currently, the Internet is already considered the second most important source, preceded only by “health professionals”. At the other end of the scale, in Greece, the Internet is considered the least important source of information about health and health-related problems (Multimedia Appendix 4). All countries do, however, show significant growth in the importance placed on the Internet, with the exception of Germany where the increase is not significant.

    Usage Patterns

    The percentage of consumers using the Internet for health purposes in other, more interactive, ways did increase from 15.3% (14.5 - 16.1) in 2005 to 22.7% (21.7 - 23.6) in 2007 (Table 3). In 2007 a total of 9.9% (9.2 - 10.6) have participated in health related forums or self-help activities more than once a year. The study also shows that 8.5% (7.8 - 9.1) order medical health products online, 11.1% (10.4 - 11.8) have online communication with health professionals whom they have not previously met, and 6.9% (6.3 - 7.4) have used the Internet to interact with known health professionals. The use of all interactive, health-related online services increased significantly. Multimedia Appendix 5 also includes the numbers for the subsamples of Internet users and Internet health users.

    Table 3. Percentage of consumers who are using interactive Internet health services at least once a year (Multimedia Appendix 5 shows the percentages for Internet users and Internet health users)
    View this table

    From a country-specific point of view (Multimedia Appendix 6), we observed large increases in specific interactive activities in Denmark and Germany. In Denmark the percentage of Internet users who approach a family doctor or other known health professional online has increased by 12.2% (9.1 - 15.2) to 20.1% (17.6 - 22.6) in 2007. In Germany the percentage of Internet users ordering medicine or other health products has increased by 6.2% (3.1 - 9.3) to 17.7% (15.3 - 20.1) in 2007.

    Using logistic regression models (Table 4), we analysed trends from 2005 to 2007, looking at age, gender, and employment status and their effect on the use of the Internet, Internet health information, and interactive health services. The logistic analysis shows no significant effect of gender on the use of the Internet. There is, however, a significant interaction effect between gender and age, where the proportion of men is largest in the highest age groups. Employment status is also a significant factor, since a very large proportion of students are using the Internet.

    For the Internet health user, the gender difference is much clearer, since women are using the Internet significantly more (OR = 2.92, 95% CI 2.36 - 3.62). Age seems to have less effect in predicting numbers of Internet health users than in predicting Internet users. There has been significant growth in the number of Internet users, Internet health users, and people using interactive Internet health services. There seems to be significant growth in the number of men using interactive health services as well.

    Table 4. Factors affecting Internet usage, Internet health usage, and the use of interactive health services. Sample is based on all respondents in all seven countries (N = 14,955).
    View this table

    Discussion

    A majority of our European study population now uses the Internet for health purposes. We have seen a significant increase in all countries (Table 1).To a great extent this increase in use can be explained by improved Internet access.

    In Denmark, Germany, Greece, and Portugal, we see that growth in the number of Internet health users is larger relatively speaking than growth in the number of Internet users. This might indicate that new Internet services for health users have been launched in these countries. In Denmark and Germany, our results also show a significant increase in one of the interactive health services. The relatively large increase in Internet users buying medicines online in Germany is matched by the growing eCommerce market for medicine since new legislation was introduced in 2004 [23,24]. In Denmark, we observe an increase in online communication with known health professionals as more and more GPs offer services to meet the expectations of their patients and to implement these services before January 2009, when it will become mandatory for GPs to offer online services [25].

    Demographics

    There is still a majority of men representing Internet users in the seven countries studied. However, the difference between men and women is diminishing in younger age groups, and the 2007 survey did not show any significant difference between male and female Internet users for respondents aged between 15 and 25. Nearly all in this age group do have access to the Internet. It is therefore logical that it is among the oldest users that we have the largest growth potential.

    The gender differences in Internet health use should be seen in the context of overall Internet use. Elderly people and women are traditionally overrepresented as health care receivers. This notion stands in contrast to the characteristics of the average Internet user. Internet health users are a combination of these factors. Looking at the youngest age group, we saw in 2005 that there were more women than men using Internet health services. The difference was 7.6% (4.6 - 10.7). In 2007, this difference increased to 11.1% (8.3 - 13.9). In other words, young women were already overrepresented as Internet health users in 2005, and it seems like this tendency increased in 2007.

    In the logistic regression in Table 4, some interesting interaction effects can also be observed. While we can see an overall growth in Internet health usage among women, this does not apply to the oldest age group. Here the growth is largest among men, and it is not growth that can be explained by growth in general Internet usage. It is difficult to say why this is happening. One explanation might be that it is due to specific Internet services that target elderly men. Another might be that using the Internet for specific purposes like health is of greater interest to users in older age groups. The first adopters of the Internet in these groups were men, and perhaps they are now among those who use it for health purposes.

    The Internet as a Source of Health Information

    The importance of the Internet as a source of health information is growing. The absolute numbers for this kind of Internet use in every country seem to rely on how the scale for ranging the importance of health information channels is interpreted. It seems more reliable to focus on the relative importance of the Internet as a health information source (compared to the traditional ones) in a specific country and on the change within that country from 2005 to 2007. From this perspective, it is interesting to notice that the greatest change in the importance of the Internet actually occurs in the countries that already had a high Internet health usage in 2005.

    In Denmark for instance, the Internet was the second most important source of health information in 2007—outranked only by information from health professionals. Both in Norway and in Denmark, the Internet is now considered more important as a source of health information than television and radio. The aggregated results for all the countries show that, even if the Internet is at the bottom of the list, there is just a small, non-significant difference between the Internet and more traditional media such as books, newspapers, and magazines. As the latter media decrease in importance and the Internet increases, it is legitimate to predict that the Internet might surpass them over the next few years.

    Interactive Use of the Internet for Health Purposes

    More in-depth analysis of the actual eHealth activities performed by the Internet health users in our two surveys reveals a tendency toward more “advanced” and more interactive use of the Internet for health purposes. Rather than using the Internet to search for and read health information, people are increasingly taking part in online communication with peers, unknown professionals, and their family doctors. In addition, the Internet is being used by more people for ordering medical health products.

    Beckjord [5] estimates that 7% of US Internet users communicated online with a health care provider in 2003, and this increased to 10% in 2005. Since our study distinguishes between known health professionals and medical personnel whom patients meet only online, and since the study period is different, it is hard to make a direct comparison. Multimedia Appendix 5 extends Table 3 to give numbers for the Internet users only. This shows that interaction with Web doctors and other health professionals whom patients have not personally met did increase from 13.2% to 16.8% from 2005 to 2007. Communication with family doctors or other known health professionals increased from 5.0% to 9.7%. Even if the studies are not directly comparable, they give an indication that the average use in our seven European countries is not falling behind the average for the US.

    However, both in the US and in Europe, it does seem that the overall trend is moving toward an increase in communication with health personnel over the Internet. The main factor driving this trend is patient demand for such services. In general it appears that patients are considerably more positive in their attitudes toward online communication than physicians are [26]. Other factors influencing this development are legislation, tariffs, and technical limitations. We see that the legislators are starting to take the consequences of this trend into account in Denmark, where all general practitioners will be obligated to offer eHealth-services to patients in 2009 [25].

    We can, therefore, see a general growth in the use of the Internet for health purposes which parallels an increase in more interactive use. Even if our study does not follow the same individuals over time, it seems logical to assume that simply browsing for health information is the starting point. It seems that, when Internet users become more experienced and comfortable with opportunities provided by the Web, they also start to use it for two-way communication, either with peers in forums or with health professionals. This could be called the second generation of Internet health users, and the trend which we detect in Web use for health purposes parallels the current movement in general Internet use toward more interactive usage of the so-called Web 2.0.

    Nevertheless, the Internet is still a relatively young medium, and its widespread use in some countries at present might still be limited by bandwidth and technical difficulties. We therefore expect that the proportion of more interactive Internet health use will grow significantly in the years to come. Additionally, health services which today still seem to be in a more or less premature phase, or are only recognized by a minority of the population, such as online access to one’s medical record from a health care provider or even managing one’s own personal health record, will gain in importance in the coming years.

    With the current movement of mass software providers such as Microsoft and Google into the health care market [27], we will probably see a tendency among Internet health users to demand a more equitable role in their health care process. As stated by Ball and Lillis in 2001, new eHealth technologies provide opportunities for more empowered patients, and physicians need to be prepared for the likelihood that patients will start acting more as consumers [28] and challenge the current asymmetry of knowledge [29] in order to achieve a much fuller participation in health care decision-making processes.

    Limitations

    The WHO eHealth consumer trends survey is based on previous surveys carried out in Norway as well as in Europe. Particular attention was devoted to the questionnaire addressing cultural differences with the dual-focus method and pilot surveys. Some variables turned out to be difficult to include in this comparison. One of them was education. There are seven independent educational systems in the countries studied. We used ISCED codes [30] in order to compare education across countries. The codes are fairly complicated to use, and we detected variations in how they were interpreted over the course of two years. We therefore decided to drop this variable in the analysis.

    Another useful variable in the analysis would have been household income. In several of the countries in the study it would, however, have been inappropriate to ask about this in a telephone interview. Even if the question were included in the first Norwegian study, we would have had to drop it in the international questionnaire.

    There was an interval of 18 months between the surveys. This is a fairly short time period, and many of the effects studied may not have been significant in such a short time span.

    Another limitation of the study is the use of CATI and the sizable percentage of the population which cannot be reached using landline phones. The lack of public mobile-phone directories in several of the countries studied made it hard drawing representative samples. We used strata in compensation for this in 2007. Our main focus in this article is changes between 2005 and 2007. We were therefore especially concerned that such differences could be caused by demographic variation in the samples and chose to use weighting of the 2005 data, as described in Methods. This is not ideal, but we are confident that, in our situation, this did improve the quality of the analysis.

    Conclusion

    The perceived importance of the Internet as a health information source is increasing. There is relative growth in all age groups and for both men and women in Internet use for health purposes, with especially strong growth among young women. Along with this growth, we also see that the second generation of Internet health users is using the Internet for more than just reading information. They are using the Internet as a channel, for direct communication with health professionals as well as with peers.

    Our research has now been able to detect small trends over a two-year period. It will be important to follow up on this research in upcoming years and evaluate whether this trend in second-generation Internet health users continues. Physicians need to be aware of their patients’ use of such new technologies, since this might lead to much better informed patients and requests from patients for more interactive, Internet-based communication pathways.

    Acknowledgments

    This article forms part of the WHO/European survey on e-health consumer trends, in part financed by the Program of Community Action in the Field of Public Health E-health (2003 - 2008) of the Health and Consumer Protection Directorate General, Directorate C, EC. The funding source had no involvement in the study design or interpretation of the data. We acknowledge the contributions of the other members of the project group: Hege Andreassen, Maria Magdalena Bujnowska-Fedak, Per Hjortdahl, Iveta Pudule, Birgitte Lolan Ravn, Tove Sørensen, and Rolf Wynn.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Internet users and Internet health users in the seven European countries—Trends 2005 and 2007

    PDF file (Adobe PDF), 129 KB

    Multimedia Appendix 2

    Internet users by age and gender

    PDF (Adobe PDF), 105 KB

    Multimedia Appendix 3

    Internet health users by age and gender

    PDF (Adobe PDF), 105 KB

    Multimedia Appendix 4

    Importance of the Internet in various countries

    PDF file (Adobe PDF), 92 KB

    Multimedia Appendix 5

    Expanded version of Table 3—percentage of consumers who are using interactive Internet health services at least once a year

    PDF file (Adobe PDF), 107 KB

    Multimedia Appendix 6

    Total and estimated relative frequency of Internet health users and Internet users who are using at least one of the interactive services at least once a year

    PDF file (Adobe PDF), 139 KB

    Multimedia Appendix 7

    Questionnaire in English (used as basis for translation in 2007)

    PDF file (Adobe PDF), 326 KB

    References

    1. Eysenbach G, Kohler Ch. What is the prevalence of health-related searches on the World Wide Web? Qualitative and quantitative analysis of search engine queries on the internet. AMIA Annu Symp Proc 2003:225-229 [FREE Full text] [Medline]
    2. Baker L, Wagner TH, Singer S, Bundorf MK. Use of the Internet and e-mail for health care information: results from a national survey. JAMA 2003 May 14;289(18):2400-2406 [FREE Full text] [Medline] [CrossRef]
    3. Hesse BW, Nelson DE, Kreps GL, Croyle RT, Arora NK, Rimer BK, et al. Trust and sources of health information: the impact of the Internet and its implications for health care providers: findings from the first Health Information National Trends Survey. Arch Intern Med 2005;165(22):2618-2624 [FREE Full text] [Medline] [CrossRef]
    4. Ybarra ML, Suman M. Help seeking behavior and the Internet: a national survey. Int J Med Inform 2006 Jan;75(1):29-41. [Medline] [CrossRef]
    5. Beckjord EB, Finney Rutten LJ, Squiers L, Arora NK, Volckmann L, Moser RP, et al. Use of the internet to communicate with health care providers in the United States: estimates from the 2003 and 2005 Health Information National Trends Surveys (HINTS). J Med Internet Res 2007;9(3):e20 [FREE Full text] [Medline] [CrossRef]
    6. Baker L, Rideout J, Gertler P, Raube K. Effect of an Internet-based system for doctor-patient communication on health care spending. J Am Med Inform Assoc 2005;12(5):530-536 [FREE Full text] [Medline] [CrossRef]
    7. Bovi AM. Council on Ethical and Judicial Affairs of the American Medical Association. Ethical guidelines for use of electronic mail between patients and physicians. Am J Bioeth 2003;3(3):W-IF2. [Medline]
    8. Brooks RG, Menachemi N. Physicians' use of email with patients: factors influencing electronic communication and adherence to best practices. J Med Internet Res 2006;8(1):e2 [FREE Full text] [Medline] [CrossRef]
    9. Sittig DF, King S, Hazlehurst BL. A survey of patient-provider e-mail communication: what do patients think? Int J Med Inform 2001 Apr;61(1):71-80. [Medline] [CrossRef]
    10. Sittig DF. Personal health records on the internet: a snapshot of the pioneers at the end of the 20th Century. Int J Med Inform 2002 Apr;65(1):1-6. [Medline] [CrossRef]
    11. Kim MI, Johnson KB. Personal health records: evaluation of functionality and utility. J Am Med Inform Assoc 2002;9(2):171-180 [FREE Full text] [Medline] [CrossRef]
    12. Simons WW, Mandl KD, Kohane IS. The PING personally controlled electronic medical record system: technical architecture. J Am Med Inform Assoc 2005;12(1):47-54 [FREE Full text] [Medline] [CrossRef]
    13. Ball MJ, Smith C, Bakalar RS. Personal health records: empowering consumers. J Healthc Inf Manag 2007;21(1):76-86. [Medline]
    14. Houston TK, Sands DZ, Jenckes MW, Ford DE. Experiences of patients who were early adopters of electronic communication with their physician: satisfaction, benefits, and concerns. Am J Manag Care 2004 Sep;10(9):601-608 [FREE Full text] [Medline]
    15. Adler KG. Web portals in primary care: an evaluation of patient readiness and willingness to pay for online services. J Med Internet Res 2006;8(4):e26 [FREE Full text] [Medline] [CrossRef]
    16. Hüfken V, Deutschmann M, Baehring T, Scherbaum W. Use of the internet for health care information: results from a national telephone survey. Soz Präventivmed 2004:381-390.
    17. Eysenbach G, Köhler C. How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. BMJ 2002 Mar 9;324(7337):573-577 [FREE Full text] [Medline] [CrossRef]
    18. Andreassen HK, Bujnowska-Fedak MM, Chronaki CE, Dumitru RC, Pudule I, Santana S, et al. European citizens' use of E-health services: a study of seven countries. BMC Public Health 2007;7(1):53 [FREE Full text] [Medline] [CrossRef]
    19. Dumitru RC, Bürkle T, Potapov S, Lausen B, Wiese B, Prokosch HU. Use and perception of internet for health related purposes in Germany: results of a national survey. Int J Public Health 2007;52(5):275-285. [Medline] [CrossRef]
    20. Santana S, Sousa Pereira A. How the Portuguese are using the Internet for health purposes. In: Cunningham P, Cunningham M, editors. Exploiting the Knowledge Economy: Issues, Applications and Case Studies. Volume 3. Amsterdam, The Netherlands: IOS Press; 2006:1021-1026.
    21. Erkut S, Alarcón O, Coll C, Tropp LR, Garcia H. The dual-focus approach to creating bilingual measures. J Cross Cult Psychol 1999:206-218. [CrossRef]
    22. Andreassen HK, Sørensen T, Kummervold PE. eHealth Trends across Europe 2005-2007. Preliminary report of the “WHO/European eHealth Consumer Trends Survey”. Norwegian Centre for Telemedicine.   URL: http://www.telemed.no/getfile.php/551132.357.sersvdpxyp/EHT+preliminary+report+final_5_2.pdf [accessed 2008 Nov 1] [WebCite Cache]
    23. Boom-Zeiten für Versand-Apotheken. Bitkom.   URL: http://www.bitkom.org/de/presse/43408_40696.aspx [accessed 2008 Nov 1] [WebCite Cache]
    24. Internet-Strukturdaten Repräsentative Umfrage - IV. Quartal 2006. Forschungsgruppe Wahlen.   URL: http://www.forschungsgruppe.de/Studien/Internet-Strukturdaten/web_IV_06.pdf [accessed 2008 Nov 1] [WebCite Cache]
    25. . Landsoverenskomsten 01-04-2006. § 39 Tilrettelæggelse af lægebetjening i dagtiden og link er nedenstående. laeger.dk.   URL: http:/​/www.​laeger.dk/​portal/​page/​portal/​LAEGERDK/​LAEGER_DK/​LOEN_OVERENSKOMSTER/​PLO/​LANDSOVERENSKOMSTEN2006/​OVERENSKOMSTEN/​PARAGRAF_39 [accessed 2008 Nov 1] [WebCite Cache]
    26. Katz SJ, Nissan N, Moyer CA. Crossing the digital divide: evaluating online communication between patients and their providers. Am J Manag Care 2004 Sep;10(9):593-598 [FREE Full text] [Medline]
    27. Lohr S. Microsoft rolls out personal health records. New York Times. 2007 Oct 4.   URL: http://www.nytimes.com/2007/10/04/technology/04nd-soft.html [WebCite Cache]
    28. Ball MJ, Lillis J. E-health: transforming the physician/patient relationship. Int J Med Inform 2001 Apr;61(1):1-10. [Medline] [CrossRef]
    29. Sadan B. Patient empowerment and the asymmetry of knowledge. Stud Health Technol Inform 2002;90:514-518. [Medline]
    30. International Standard Classification of Education. UNESCO.   URL: http://www.unesco.org/education/information/nfsunesco/doc/isced_1997.htm [accessed 2008 Nov 1] [WebCite Cache]


    Abbreviations

    CATI: computer-assisted telephone interviews
    GP: general practitioner
    ISCED: International Standard Classification of Education
    WHO: World Health Organization


    Edited by G Eysenbach; submitted 07.01.08; peer-reviewed by E Beckjord, L Spero; comments to author 16.01.08; revised version received 01.07.08; accepted 15.10.08; published 17.11.08

    © Per Egil Kummervold, Catherine E Chronaki, Berthold Lausen, Hans-Ulrich Prokosch, Janne Rasmussen, Silvina Santana, Andrzej Staniszewski, Silje Camilla Wangberg. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 17.11.2008.  

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.