Background: Millions of consumers have accessed health information online. However, little is known about their health status.
Objective: To explore use of Internet health information among those who were sicker (fair/poor general health status) compared with those reported being healthier.
Methods: A national, random-digit telephone survey by the Pew Internet & American Life Project identified 521 Internet users who go online for health care information. Our primary independent variable was general health status rated as excellent, good, fair, or poor. Patterns of Internet use, and types of information searched were assessed.
Results: Among the 521 users, 64% were female, most (87%) were white, and median age was 42 years. Most individuals indicated that they learned something new online (81%) and indicated that they believe most information on the Internet (52%). Compared with those with excellent/good health, those with fair/poor health (N = 59) were relative newcomers to the Internet but tended to use the Internet more frequently, were more likely to use online chats, were less likely to search for someone other than themselves, and were more likely to talk about the new information with their physician (odds ratio 3.3 [95% confidence interval 1.8-6.3]), after adjustment for age, education and income.
Conclusions: Health care professionals should be aware that their sicker patients are more likely to ask them about information they found online. Physicians, public health professionals, and eHealth developers should work together to educate patients about searching for health information online and to provide tools for them to navigate to the highest quality information.
Health information on the Internet is pervasive with thousands of Web sites, chat rooms, and support groups . Some in the medical community have espoused the potential positive impact of the Internet on increasing health education and promoting self-care [ ]. Others have cautioned about the public health risks of the varying quality of health information [ ]. Despite these potential risks, millions of Americans have used the Internet to search for health information [ ]. A previous survey using a convenience sample of primary care patients at one hospital-based practice suggests that most users rate the quality of Internet-based health information equivalent to information from their doctor [ ]. Education of the public about how to evaluate the quality of the health information online is needed [ ].
Users of Internet-based health information tend to reflect the higher-income, higher-education status associated with having Internet access . However, little else is known about individuals who are searching for health information on the Internet. Are they mostly individuals with poor health and/or current illnesses (ie, our patients), or well individuals looking to stay well? Also, do the experiences online of patients with poor health differ from those without disease (eg, are sicker patients searching for different information, participating in support groups more often)? Answering these research questions may help physicians better understand what their patients are doing and may help public health practitioners better target their educational strategies about health information online.
To answer these questions, we took advantage of data collected in a national random-digit telephone survey by the Pew Internet & American Life Project related to use of health information online. Our objectives were to explore (1) Internet use characteristics of, (2) types of information sought by, and (3) impact of the Internet health information on the health care experience of individuals with poorer health (ie, fair/poor health) compared with those who reported better health.
To obtain a representative sample of Americans who use the Internet, a national survey was conducted by the Pew Internet & American Life Project using a random-digit sample of telephone numbers selected from telephone exchanges in the continental United States. Between March and July 2000, Princeton Survey Research Associates conducted telephone interviews with Internet users 18 and over. Among these, 2027 individuals who used Internet-based health information were identified using the question, "Please tell me if you ever do any of the following when you go online - look for health or medical information?"
In August 2000, a follow-up telephone survey focusing on Internet health information use was conducted. After approximately 500 interviews were completed with individuals who had previously reported looking for health or medical information, recruitment was closed. While collecting this sample, an additional 144 individuals who participated in the original survey declined to participate. Data from the baseline and follow-up telephone interviews were stripped of unique identifying information for analysis. The Pew data are publicly available for download  and the authors received assistance in understanding the sampling frame and data structure from Susannah Fox at the Pew Internet & American Life Project and Jonathon Best of Princeton Survey Research Associates. The database included age, gender, race, education, income, a global rating of health status, patterns of Internet use, types of information searched and the impact of Internet health information on their knowledge and on their health care experience.
Assessment of Health Status (Primary Independent Variable)
Our primary variable of interest, self-reported global health status, was based on a single question, "In general, how would you rate your own health — excellent, good, only fair, or poor?" Single global ratings of health status such as this have been recommended to reflect the wide variation in values of individuals and are in some respects superior to more complex measures [, ]. A similar-format single-question global health rating is included on the SF-36, the National Health and Nutrition Examination Survey, and the Behavioral Risk Factor Surveillance System [ ]. Single-item self-rated health status, or health-related quality of life, is as valid and reliable as more complex measurements and has been highly correlated with many diseases and health outcomes in previous studies [ , ]. Thus, individuals with global health ratings of fair or poor are likely to have chronic disease or acute medical illnesses and higher mortality [ ].
Patterns of Internet Use, Type of Health information, and Impact
To assess patterns of Internet health information use, participants were asked when they started using the Internet, how frequently they used the Internet to look for advice or information about health or health care, and the number of Web sites they visited the last time they went looking for health information. Participants were also asked if they believe the information they see on the Internet, if they participated in online chat rooms and whether they were looking for health information online for themselves or someone else. The type of information searched, such as general health information, information about fitness or nutrition, or specific information on a health condition, doctor, or hospital was assessed. The impact of Internet health information on knowledge was assessed by asking if participants had learned anything new from the online health information. Participants were then asked if the health information "has improved the way you take care of your health." Because Internet health information may have an impact on the physician-patient relationship, the survey also included the question, "Did you later talk to a doctor or nurse about the information you got online?"
First, demographic characteristics including age, gender, race, income, and education were compared among those with health status ratings of excellent, good, and fair/poor using Mantel-Haenzel χ2 trend statistics. To compare our sample of Internet users with other patient surveys, the percentages of individuals with fair or poor health status and associated demographic characteristics in this sample were compared with the percentages noted in the year 2000 Behavioral Risk Factor Surveillance System (BRFSS) .
The patterns of demographic characteristics associated with global health status in our study were used to confirm the reliability of this measure compared with previous studies. Health status rating has been associated with education, age, and income in previous research [, , ].
The frequency of those with fair/poor, good, and excellent health status reporting each pattern, type of information, and impact variable described above was compared using Mantel-Haenzel χ2 trend statistics . Responses to questions related to pattern of Internet use were dichotomized based on distribution of responses for use as dependent variables in logistic regression. For variables associated with health status in univariate analysis at P<= .2, a series of logistic regression analyses were used to assess the association of our primary independent variable, health status, with each of the dichotomized pattern, type of information and impact dependent variables after adjustment for demographic characteristics. Each model was developed by introducing variables individually and then in combination to assess for evidence of interaction. To test for significance of trend across health status categories, health status was incorporated into the models as a continuous variable. The Pearson χ2 statistic was calculated for each multivariable model to test goodness of fit, and area under the Receiver Operating Characteristics curve (c statistic) was also calculated to assess discriminative power [ ]. Pearson χ2P> .1 indicates an adequate fit of the model to the data.
Our sample of 521 Internet users who access health information online identified from this national survey were mostly female (N = 331 [64%]) and had a median age of 42 years. Only 38 individuals (7%) were African American, 5 were Asian, and 20 were other nonwhite races. Compared with the original sample of 2027 Internet health information users, the 521 individuals who agreed to the follow-up survey were similar in ethnic distribution, educational level, and their frequency of Internet use, but those who completed the follow-up were slightly older (median age 42 vs 39, P< .01).
Ninety-nine percent (N = 520) of the participants in the focused Internet health information follow-up survey rated their health status. Based on this single-item global health status question, we identified 59 individuals (12%) with fair/poor health, 257 (49%) with good health, and 204 (39%) with excellent health. Associations of health status with demographics are summarized in. Compared to the 12% with fair/poor health in this sample, a similar 13.5% of the respondents to the 2000 BRFSS, reported fair or poor health. However, only 28% of individuals in the BRFSS were college graduates compared with 46% in our sample; and 33% of BRFSS participants had household incomes over $50,000 compared with 48% in our study.
|N(%)||Excellent (%)||Good (%)||Fair/Poor (%)|
|Overall||521||204 (39)||257 (49)||59 (12)|
|Male||189 (36)||69 (34)||95 (37)||25 (42)|
|Female||331 (64)||135 (66)||162 (63)||34 (58)|
|White||437 (87)||171 (88)||216 (86)||50 (88)|
|Black||38 (8)||13 (7)||20 (8)||5 (9)|
|Other||25 (5)||9 (5)||14 (6)||2 (5)|
|18-34||149 (29)||60 (29)||177 (30)||12 (20)|
|35-54||297 (54)||114 (56)||150 (58)||33 (56)|
|55 and older||74 (14)||30 (15)||30 (12)||14 (23)|
|Less than college||272 (54)||93 (47)||136 (54)||43 (75)|
|College graduate||233 (46)||103 (53)||116 (46)||14 (25)|
|Less than $30,000||154 (30)||54 (26)||73 (28)||26 (44)|
|$30,000-$50,000||117 (22)||39 (19)||65 (25)||13 (22)|
|Over $50,000||250 (48)||111 (54)||119 (46)||20 (34)|
|Yes||343 (32)||139 (29)||167 (34)||37 (35)|
|No||161 (68)||57 (71)||84 (66)||20 (65)|
* Total N varies slightly due to small number of missing values (less than 2%).
† Mantel-Haenzel χ2 test for trend P< .01.
‡ Mantel-Haenzel χ2 test for trend P< .05.
Health Status and Patterns of Internet Use
A significant dose-response association was seen with shorter history of Internet use and lower health status (). Compared with those in excellent health, those with fair/poor health and those with good health were less likely to have begun using the Internet over a year ago after adjusting for education, age, and income in multivariable logistic regression — see OR (odds ratio) and CI (Confidence Interval) data in : OR is 0.5 (95% CI, 0.2-1.00) and 0.6 (95% CI, 0.4-0.9) for fair/poor health and good health respectively; P for trend < .01.
In contrast, there was a stepwise trend toward more-frequent current use of the Internet for health information among those with poorer health. Those with fair/poor health status were more likely to participate in online chat rooms compared with those with excellent health, but were less likely to have looked for health information for someone other than themselves (, ).
|Goodness of fit|
|Health Status||Adjusted Odds ratio||Pearson\'s χ2||c|
|Used the Internet over a year ago||Excellent||Referent|
|Use the Internet to look for health information about once a week||Excellent||Referent|
|Searched for health information for a child, parent or someone else||Excellent||Referent|
|Participated in online support group for people who are concerned about the same health issues||Excellent||Referent|
|Used online chat rooms||Excellent||Referent|
|Sought information about specific doctors, or hospitals||Excellent||Referent|
|Sought information about medicines or treatments for an illness or conditionSECT||Excellent||Referent|
|Discussed Internet information with Physician or Nurse?||Excellent||Referent|
* Total N varies slightly due to small number of missing values (less than 2%)
† Logistic regression models developed for each Internet information "pattern/type/impact" characteristic associated with health status at P<= 0.2 in univariate χ2. Each adjusted odds ratio is from a separate logistic regression analysis with dichotomized Internet information "pattern/type/impact" characteristic as dependent variable and with health status as the primary independent variable, adjusted for income, age, education.
‡ Test for trend P< .01.
§ Test for trend P< .05.
The majority (52%) of these 521 Internet health information users indicated that they could believe most of the information on the Internet and this did not differ by health status. Only 30% had visited more than 4 Web sites the last time they searched for health information and this did not differ by health status. Few individuals (N = 49 [9%]) were using e-mail with their doctors ().
Type of Information Searched
Participants were asked to describe the information they were looking for the last time they went online for health information (). A consistent, stepwise association of lower health status with more frequent reporting of searching for information about specific physicians, hospitals, medications, and treatments was seen. All groups frequently reported looking for information about specific illnesses. In multivariable analysis, those with poorer health status were again more likely to be searching for specific health information the last time they went online ( ).
Impact of Internet Health Information
Most individuals (N = 420 [81%]) indicated that they "learned something new" the last time they went online (). This report of increased knowledge did not seem to vary by health status. Health status was not related to the self-reported usefulness of the Internet health information. However, the majority (52%) of the 59 individuals with fair/poor health status reported later talk to a doctor or nurse about the Internet health information, whereas less than a third of those with higher health status reported talking to a doctor or nurse. After adjustment for age, gender, and education, those with fair/poor health were considerably more likely to communicate with a health care provider (OR 3.3 [95% CI, 1.8-6.3]) compared with those with excellent health ( ).
In this telephone survey of 520 current Internet health information users, the majority of individuals reported that they learned something new and trusted the information they found. Consistent with our results, prior surveys of primary care patients using the Internet for health information also suggested that most users rate the quality of information as very good or excellent . Our analysis also provides new data that significant differences exist between sicker patients and those with better self-reported health status in that sicker patients were more-frequent users of Internet health information, more likely to search for specific information, more frequently participating in chats, and more likely to discuss the information they found online with their health care provider.
Over half (52%) of the individuals reported that they could believe all or almost all the information online, but a minority (30%) reported "comparison shopping" for information by looking at multiple Web sites to gather information the last time they went foraging for health information. This provides further evidence that additional public health strategies should be developed to teach users about the variation in quality of information and to help them find quality online information. The majority (80%) of our 520 health information seekers found the information through a search engine. The effectiveness of searching through a search engine is limited, with only 20% of the top links leading to relevant content . Although quality information does exist on the Internet, one systematic review indicated that 24% of the clinical elements felt important by experts were not included in the Web sites found by major search engines [ ]. Some Web sites have begun to voluntarily comply with standards of ethics and quality [ ]. Current research aims to develop digital quality seals that can be assigned by third-party raters and help consumers navigate to the best information [ , ]. Efforts to evaluate Web sites and accredit those who meet standards are also ongoing [ , ].
Those with fair/poor health were more likely to search for specific information on their doctor and medications and were more likely to speak to their health care provider about the information they found online. Providers should anticipate that their patients with chronic illnesses may present with information from the Internet. Because the sicker patients were relative newcomers to the Internet and currently frequently used the Internet to find health information, they may be particularly at risk for accessing less than optimal-quality health information. Physicians are a particularly valued source of information for patients and thus the office visit may be an excellent opportunity to educate patients about the variable quality of health information available and to direct patients toward higher-quality information. Thus, physicians should also be educated about Internet-based health information so they may better teach their patients.
The global health status assessment used in this study was reliable when compared to previous studies. The pattern of demographics associated with lower health status, suggests that the health status variable is functioning as seen in previous studies [, ]. Also, the percentage of individuals with fair or poor health in this study was similar to that seen in the Behavioral Risk Factor Surveillance System [ ]. Participants in our sample did vary from those in the BRFSS in that they were more educated and from a higher socio-economic status. .It is possible that other chronically ill patients with lower socio-economic status would be motivated to search for health information online but do not have access to the information due to the disparities in Internet access.
The demographics of many sicker patients (ie, lower income and lower education) identified in this and other research may make those with chronic disease particularly vulnerable to the disparities in access and barriers to understanding the various health Web sites . In addition to the limits of access due to the "digital divide," health literacy also limits access to online health information [ , ]. Further research is needed to extend Internet access to those on the wrong side of the digital divide and to expand the range of Web sites for those with lower health literacy [ ].
Strengths and Limitations
Our study has several limitations. The survey did not record specific diseases. Although consistent with prior studies, it is possible that using the measure of health status as a surrogate for illness and chronic disease has resulted in some misclassification [, ]. In addition, the exact Web sites, chat rooms, and search engines that individuals were visiting were unknown. This study is a cross-sectional assessment and inferences of causality cannot be made. Our project focused on current Internet information seekers and is thus not generalizable to individuals who are not currently using the Internet for health information.
A strength of this study is the random-digit, population-based method used to identify this group of users. This increases the likelihood that our sample is representative of the population of Internet users, and thus enhances generalizability. Although this method of sampling misses individuals without telephones, we think it unlikely that many households without telephones have Internet access. Based on a search of the National Library of Medicine's PubMed database as of June 2002, the current study is the first to assess the particular patterns, type of information, and impact of online health information on those with poor health status. Previous research on use of the Internet among patients has been based on convenience samples . In addition, the level of detail within this exploratory analysis provides pilot data on which to build future research related to tailoring information to the health information needs of those with poor health status.
Our study provides preliminary data on the experiences of online health information seekers. Although the majority of participants were in good health, those individuals with apparent illnesses were more-frequent users of the health information, and were more likely to combine their information seeking with their health care experience. Because the sicker patients are frequent users of specific Internet health information, they may be a population especially vulnerable to the varying availability and quality of Internet health information.
Very few individuals had used the Internet as a portal to communicate with their health care providers, but those with fair/poor health were more likely to communicate in person with their health care providers about the Internet health information they found. Thus, health care professionals should be aware that their patients with lower health status who have used the Internet for health information are likely the ones to come to them to discuss the information they have found. When presented with health information from the Internet, physicians can use this as a "teachable moment" and take the opportunity to educate their patients about the variability of information quality, and point patients toward appropriate sites. Physicians, public health professionals, and eHealth developers should work together to educate patients about searching for health information online and to provide tools for them to navigate to the highest quality information. Future studies should prospectively assess the impact of Internet-based health information on health care utilization and outcomes.
Assistance in understanding the data structure and sampling frame of the Pew Internet & American Life Survey was provided by Susannah Fox at the Pew Internet & American Life Project and Jonathan Best of Princeton Survey Research Associates.
Conflicts of Interest
- Eng TR. The eHealth Landscape: A Terrain Map of Emerging Information and Communication Technologies in Health and Health Care. Princeton, NJ: The Robert Wood Johnson Foundation; 2001. URL: http://www.rwjf.org/publications/publicationsPdfs/eHealth.pdf
- Kaplan B, Brennan PF. Consumer informatics supporting patients as co-producers of quality. J Am Med Inform Assoc 2001 Aug;8(4):309-316. [PMC] [Medline]
- Ferguson T. Health online and the empowered medical consumer. Jt Comm J Qual Improv 1997 May;23(5):251-257. [Medline]
- Brennan PF. Health informatics and community health: support for patients as collaborators in care. Methods Inf Med 1999 Dec;38(4-5):274-278. [Medline]
- Kiley R. Finding health information on the Internet: health consumers. Hosp Med 2000 Nov;61(11):799-801. [Medline]
- Mcleod SD. The quality of medical information on the Internet. A new public health concern. Arch Ophthalmol 1998 Dec;116(12):1663-1665. [Medline]
- Hoffman-goetz L, Clarke JN. Quality of breast cancer sites on the World Wide Web. Can J Public Health 2000 Aug;91(4):281-284. [Medline]
- Berland GK, Elliott MN, Morales LS, Algazy JI, Kravitz RL, Broder MS, et al. Health information on the Internet: accessibility, quality, and readability in English and Spanish. JAMA 2001 May 23;285(20):2612-2621. [Medline] [CrossRef]
- Fox S. The online health care revolution: How the web helps Americans take better care of themselves. Washington, DC: The Pew Internet & American Life Project; 2000. URL: http://www.pewinternet.org/reports/pdfs/PIP_Health_Report.pdf
- Diaz JA, Griffith RA, Ng JJ, Reinert SE, Friedmann PD, Moulton AW. Patients' use of the Internet for medical information. J Gen Intern Med 2002 Mar;17(3):180-185. [Medline] [CrossRef]
- Oravec JA. On the "proper use" of the Internet: self-help medical information and on-line health care. J Health Soc Policy 2001;14(1):37-60. [Medline] [CrossRef]
- Eysenbach G, Köhler C. How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. BMJ 2002 Mar 9;324(7337):573-577 [FREE Full text] [PMC] [Medline]
- Houston TK, Ehrenberger HE. The potential of consumer health informatics. Semin Oncol Nurs 2001 Feb;17(1):41-47. [Medline]
- ; Pew Internet Project. Our data. URL: http://www.pewinternet.org/datasets/index.asp [accessed 2002 Jul 29]
- Gill TM, Feinstein AR. A critical appraisal of the quality of quality-of-life measurements. JAMA 1994 Aug 24;272(8):619-626. [Medline] [CrossRef]
- Fayers PM, Sprangers MAG. Understanding self-rated health. Lancet 2002 Jan 19;359(9302):187-188. [Medline] [CrossRef]
- Krause NM, Jay GM. What do global self-rated health items measure? Med Care 1994 Sep;32(9):930-942. [Medline]
- Bosworth HB, Siegler IC, Brummett BH, Barefoot JC, Williams RB, Clapp-channing NE, et al. The association between self-rated health and mortality in a well-characterized sample of coronary artery disease patients. Med Care 1999 Dec;37(12):1226-1236. [Medline] [CrossRef]
- Ware JE. The status of health assessment 1994. Annu Rev Public Health 1995;16(1):327-354. [Medline] [CrossRef]
- ; National Center for Chronic Disease Prevention & Health Promotion. Behavioral Risk Factor Surveillance System. URL: http://apps.nccd.cdc.gov/brfss/index.asp [accessed 2002 Jul 29]
- Gold M, Franks P, Erickson P. Assessing the health of the nation. The predictive validity of a preference-based measure and self-rated health. Med Care 1996 Feb;34(2):163-177. [Medline] [CrossRef]
- Goodman E. The role of socioeconomic status gradients in explaining differences in US adolescents' health. Am J Public Health 1999 Oct;89(10):1522-1528. [Medline]
- Rosner B. Fundamentals of Biostatistics, 4th edition. Belmont, CA: Duxbury Press; Jun 1995.
- Centor RM. Signal detectability: the use of ROC curves and their analyses. Med Decis Making 1991 Jun;11(2):102-106 [FREE Full text] [Medline]
- Boyer C, Selby M, Appel RD. The Health On the Net Code of Conduct for medical and health web sites. Medinfo 1998(9 Pt 2):1163-1166. [Medline]
- Eysenbach G, Diepgen T, Lampe K, Brickley D. EU-project medCERTAIN: Certification and Rating of Trustworthy and Assessed Health Information on the Net. Stud Health Technol Inform 2000;77:279-283. [Medline]
- Eysenbach G, Yihune G, Lampe K, Cross P, Brickley D. MedCERTAIN: quality management, certification and rating of health information on the Net. Proc AMIA Symp 2000:230-234. [Medline]
- ; URAC. Home page. URL: http://www.urac.org/ [accessed 2002 Jul 29]
- ; Hi-Ethics. Home page. URL: http://www.hiethics.com/ [accessed 2002 Jul 29]
- Leaffer TR. Quality of health information on the Internet. JAMA 2001 Nov 7;286(17):2094-2095. [Medline]
- Brodie M, Flournoy RE, Altman DE, Blendon RJ, Benson JM, Rosenbaum MD. Health information, the Internet, and the digital divide. Health Aff (Millwood) 2000 Dec;19(6):255-265 [FREE Full text] [Medline] [CrossRef]
- Burstin H. Traversing the digital divide. Health Aff (Millwood) 2000 Dec;19(6):245-249. [CrossRef]
- Bernhardt JM. Health education and the digital divide: building bridges and filling chasms. Health Educ Res 2000 Oct;15(5):527-531. [Medline] [CrossRef]
|BRFSS: Behavioral Risk Factor Surveillance System|
|OR: Odds Ratio|
Edited by G Eysenbach; submitted 29.05.02; peer-reviewed by K Dyer, J Licciardone, G Eysenbach; comments to author 09.07.02; revised version received 20.07.02; accepted 22.07.02; published 22.11.02Copyright
© Thomas K Houston, Jeroan J Allison. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 22.11.2002. Except where otherwise noted, articles published in the Journal of Medical Internet Research are distributed under the terms of the Creative Commons Attribution License (http://www.creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited, including full bibliographic details and the URL (see "please cite as" above), and this statement is included.