JMIR Publications

Select Journals for Content Updates

When finished, please click submit.

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

This paper is in the following e-collection/theme issue:

    Original Paper

    Online Access to Doctors' Notes: Patient Concerns About Privacy

    1Harborview Medical Center, University of Washington School of Medicine, Seattle, WA, United States

    2Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, United States

    3College of Nursing and Health Sciences, University of Massachusetts, Boston, MA, United States

    4Group Health Research Institute, Group Health Cooperative, Seattle, WA, United States

    5Geisinger Health System, Danville, PA, United States

    Corresponding Author:

    Elisabeth Vodicka, MHA

    Harborview Medical Center

    University of Washington School of Medicine

    325 Ninth Avenue

    Seattle, WA, 98104

    United States

    Phone: 1 781 258 7501

    Fax:1 206 744 6097

    Email:


    ABSTRACT

    Background: Offering patients online access to medical records, including doctors’ visit notes, holds considerable potential to improve care. However, patients may worry about loss of privacy when accessing personal health information through Internet-based patient portals. The OpenNotes study provided patients at three US health care institutions with online access to their primary care doctors’ notes and then collected survey data about their experiences, including their concerns about privacy before and after participation in the intervention.

    Objective: To identify patients’ attitudes toward privacy when given electronic access to their medical records, including visit notes.

    Methods: The design used a nested cohort study of patients surveyed at baseline and after a 1-year period during which they were invited to read their visit notes through secure patient portals. Participants consisted of 3874 primary care patients from Beth Israel Deaconess Medical Center (Boston, MA), Geisinger Health System (Danville, PA), and Harborview Medical Center (Seattle, WA) who completed surveys before and after the OpenNotes intervention. The measures were patient-reported levels of concern regarding privacy associated with online access to visit notes.

    Results: 32.91% of patients (1275/3874 respondents) reported concerns about privacy at baseline versus 36.63% (1419/3874 respondents) post-intervention. Baseline concerns were associated with non-white race/ethnicity and lower confidence in communicating with doctors, but were not associated with choosing to read notes or desire for continued online access post-intervention (nearly all patients with notes available chose to read them and wanted continued access). While the level of concern among most participants did not change during the intervention, 15.54% (602/3874 respondents, excluding participants who responded “don’t know”) reported more concern post-intervention, and 12.73% (493/3874 respondents, excluding participants who responded “don’t know”) reported less concern.

    Conclusions: When considering online access to visit notes, approximately one-third of patients had concerns about privacy at baseline and post-intervention. These perceptions did not deter participants from accessing their notes, suggesting that the benefits of online access to medical records may outweigh patients’ perceived risks to privacy.

    J Med Internet Res 2013;15(9):e208)

    doi:10.2196/jmir.2670

    KEYWORDS



    Introduction

    Secure patient portals—tethered Web-based applications that enable patients to access their health information online—can give patients more control over their personal health information by improving their access to medical records [1-9]. A Markle Foundation survey of 1580 US adults in 2008 found that nearly half were interested in using an online patient portal and among those not interested, concern for privacy was the main deterrent to adoption [10]. While patients want easy access to their health information, including their doctors’ visit notes, concerns about the privacy of online medical data could limit the utility of patient portals [3,10,11]. Understanding patients’ views toward privacy is especially important in the case of visit notes, which often contain detailed personal information about patients’ medical, social, and family histories.

    Despite calls for more discussion of patients’ privacy concerns in primary care settings [12-16], little research has addressed the concerns that arise when patients are given online access to their health information. Existing studies are primarily qualitative or opinion-based [8,17-19] or limited to a single health care institution [2,3,20,21]. Most have examined issues of privacy related to health information exchange or personal health information in general. None discuss privacy in the context of providing patients with electronic access to their visit notes.

    This paper describes patient-reported concerns about privacy prior to and after participation in OpenNotes, a 1-year quasi-experimental study in which patients were offered online access to the outpatient clinic notes written by their primary care doctors (“visit notes”). Study procedures are fully described in prior publications and briefly summarized in the next section for context [22-25]. A priori, we generated several research questions to guide our analyses: What percentage of patients report concerns about privacy at baseline, and what are the characteristics of patients according to their level of concern? Did their attitudes change during participation in OpenNotes, and if so, in what direction? Were concerns about privacy at baseline associated with their use of visit notes, their likelihood of showing or discussing notes with others, or their desire for continued online access to notes after the intervention concluded?


    Methods

    Setting

    We surveyed primary care doctors and their patients in three locations: Beth Israel Deaconess Medical Center (BIDMC), a teaching hospital of Harvard Medical School, and community practices affiliated with BIDMC in urban and suburban Boston, MA; Geisinger Health System (GHS), a rural integrated health services organization serving patients in central and northeastern Pennsylvania; and the adult medicine and HIV/AIDS clinics at Harborview Medical Center (HMC), a county hospital affiliated with the University of Washington that serves primarily safety-net populations in Seattle, WA. Each participating institution received approval for the study from its Institutional Review Board.

    Study Design

    To be eligible for OpenNotes, patients at BIDMC and GHS had to be current users of their sites’ patient portals, through which they could message their doctors, schedule appointments, and view components of their medical records (such as medication lists and test results). OpenNotes patients at HMC gained first-time access to their hospital’s patient portal when they enrolled in the study. At all three sites, study participants gained first-time access to notes written by their doctors following the clinic visits that occurred during the intervention.

    We surveyed patients both before and after the year-long OpenNotes study to gauge their attitudes toward and experiences with gaining online access to their visit notes. We used portal tracking data to confirm whether notes were generated for each participant during the intervention and whether participants chose to view notes that were available.

    Study Participants

    For this report, we examined data from patients who completed the OpenNotes intervention, responded to both the baseline and 1-year post-intervention surveys, and completed the privacy questions on the surveys. We did not include patients who were excluded from participation (ie, denied online access to notes) by their doctors, who withdrew from the study, who moved or died during the intervention, or whose portal accounts became inactive during the study period. Information about the differences among patients by participation status and site has been published previously [22-25].

    As described previously [23,25], 13,564 patients who completed the study had one or more notes made available during the year-long intervention period. Among those, 41.05% (5568/13,564) submitted a post-intervention survey. Further, 28.56% (3874/13,564) submitted both a baseline and a post-intervention survey with privacy questions completed; they constitute the study sample for this analysis.

    Patient Survey

    Before developing the patient surveys, we conducted focus groups and individual interviews at the study sites to ensure that the surveys encompassed the major worries, expectations, and perceived benefits of online access to visit notes. Concern for the privacy of individual information was voiced by some patients during these focus groups and was particularly prevalent among patients at HMC [26]. The concerns about “privacy” that patients identified included login security, accessing their information in a public location (eg, library or hospital resource center), privacy breaches (eg, hackers or unauthorized hospital employees reading their medical information), and provision of their medical information to external organizations such as insurance companies and governmental agencies [26].

    Based on focus group findings, we included an item addressing concerns about privacy in the baseline and post-intervention surveys, with responses on a 5-point Likert scale (baseline survey question: “If I could read my doctor’s notes, I would be concerned about my privacy: Agree, Somewhat Agree, Somewhat Disagree, Disagree, Don’t Know” and post-intervention survey question: “As a result of reading/having access to my doctor’s notes, I am concerned about my privacy: Agree, Somewhat Agree, Somewhat Disagree, Disagree, Don’t Know”).

    In the baseline and post-intervention surveys, we also used the validated Ambulatory Care Experiences Survey (ACES) [27] and Perceived Efficacy in Patient-Physician Interactions (PEPPI) [28] instruments to assess participants’ level of trust in and interactions with their providers. The ACES instrument addresses patients’ self-reported quality of interaction and communication with their doctors, and PEPPI addresses levels of self-efficacy in communicating with doctors. Patients were also asked in the surveys to self-report demographic information including age, sex, race/ethnicity, education level, employment status, Internet use, and health status.

    In the post-intervention survey, we asked patients a series of questions about whether or not they accessed their doctors’ notes (ie, “Did you look at any of your visit notes [on the secure patient portal]?”: Yes; No; I did not have any notes to look at because I did not see my doctor since notes were made available”), whether they would like OpenNotes to continue (ie, “I would like to continue to be able to see my doctor’s notes online: Yes, No”), and whether they shared their notes with others (ie, “Did you show or discuss your visit notes with other people? Yes, No, Don’t Know/Don’t Remember”).

    As described in previous publications, we pre-tested the survey questions with patients for clarity and incorporated changes based on the patient feedback received. We conducted additional testing of online versions of the surveys prior to administering the surveys to participating patients [25]. See Multimedia Appendices 1 and 2 for the baseline and post-intervention survey instruments.

    Statistical Analysis

    To assess patient characteristics associated with concerns about privacy, we performed a chi-square analysis on categorical variables, with age, race/ethnicity, employment, and self-reported health variables dichotomized for analytic purposes. To evaluate perceived confidence in doctor-patient communication and trust in doctors, we report quartile scores of the ACES and PEPPI summary measures. We also performed logistic regression models to determine whether age, sex, education, race/ethnicity, frequency of Internet use, and PEPPI scores were independently associated with the likelihood of having concerns about privacy at baseline. We performed McNemar’s test for paired data to determine whether patient attitudes toward privacy changed or persisted over the course of the intervention.

    We analyzed data at both aggregated binary categories (collapsed categories into “Agree/Somewhat Agree” and “Disagree/Somewhat Disagree”) and disaggregated levels (“Agree”, “Somewhat Agree”, “Somewhat Disagree”, and “Disagree”). Unless otherwise stated, “concern for privacy” is reported as an aggregated percentage of both “Agree” and “Somewhat Agree” survey responses for improved clarity, and the findings were similar. For data that yielded significantly different results in the aggregate vs disaggregate, we report the findings separately. We used a confidence interval (CI) of 95% and defined statistical significance as a P value less than .05. All statistical analyses were conducted using SAS software, version 9.3.


    Results

    Privacy Concerns by Demographics

    At baseline, about one-third of participants reported concerns about privacy related to online access to visit notes (Table 1). Compared to participants without such worries, they were more likely to be non-white, have fewer years of education (high school/GED or less), attend BIDMC, and report lower levels of trust and confidence in communication with their doctor. More modest associations were found according to age and sex (women worried more than men, under age 55 worried more than age 55 or older). We found no difference in levels of concern according to self-reported health status.

    Following multivariable adjustment, differences according to gender, race/ethnicity, and confidence in communication remained significant (Table 2). Women were more likely to be concerned about privacy than men (adjusted OR 1.18, 95% CI 1.03-1.36). Non-white patients had greater concerns than white patients (adjusted OR 1.56, 95% CI 1.21-2.01). Patients who had less self-confidence about communicating with their doctors, based on their PEPPI scores, were more concerned about privacy than others who had more self-confidence about communication (adjusted OR 1.72, 95% CI 1.41-2.09 comparing lowest quartile to highest quartile of PEPPI score).

    Privacy Concerns and Use/Perception of OpenNotes

    Baseline concerns about privacy were not associated with whether or not patients reported that they accessed their notes during the intervention or shared their notes with others (Table 3). Similarly, 99% of patients wanted continued access to their notes after the intervention concluded, regardless of concerns about privacy at baseline. At the end of the study, only 27 patients (1%) disagreed with the statement “having online access to my doctor’s notes is a good idea.” Among this very small subgroup, 8 patients (30%) were concerned about privacy.

    Privacy Concerns at Baseline and Post-Intervention

    We found a modest increase in reported concerns about privacy following the intervention, with 32.91% (1275/3874) of patients concerned at baseline, and 36.63% (1419/3874) concerned after the intervention (χ2stat=436.4; P<.001; Figure 1).

    For most patients, individual responses regarding privacy concern did not change over the course of the study period: 19% (750/3874) of patients reported concern at both baseline and post-intervention, and 45% (1757/3874) consistently reported none or little concern at baseline and post-intervention (Figure 2).

    However, 28% (1095/3874) of patients reported changes in their level of concern from the beginning to the end of the study (see Multimedia Appendix 3 for individual patient responses at baseline versus their responses post-intervention). Patients who were concerned about privacy at baseline but not concerned post-intervention (12.73%, 493/3874) were slightly more likely to be younger or female compared to those whose level of concern remained unchanged (χ2stat=7.50; P=.006; χ2stat=8.63; P=.003; data not shown). In contrast, those whose attitudes shifted from being not concerned at baseline to being concerned post-intervention (15.54%, 602/3874) were slightly more likely to be older than those whose level of concern remained constant (χ2stat=16.66; P<.001; data not shown). Other attitudes and behaviors—for example, whether or not patients read their notes, wanted continued access to their notes, thought online access was a good idea, or shared their notes with others—were not significantly associated with changes in patients’ attitudes toward privacy (data not shown).

    Table 1. Characteristics of patient respondents, stratified by baseline survey responses to statement: “If I could read my doctors’ notes, I would be concerned about my privacy” (N=3874).
    View this table
    Table 2. Associations of characteristics with baseline privacy concernsa (N=3816).
    View this table
    Table 3. Post-intervention attitudes and behaviors regarding OpenNotes (N=3874).
    View this table
    Figure 1. Patients' level of agreement with statements regarding concern about privacy on baseline and post-intervention surveys (N=3874).
    View this figure
    Figure 2. Change in individual patients' reported concern about privacy from baseline to post-intervention (N=3874).
    View this figure

    Discussion

    Principal Findings

    Overall, approximately one-third of patients at baseline reported concerns about privacy when considering gaining online access to their doctors’ visit notes. Nevertheless, this did not deter patients from accessing their notes and other medical information. Rather, nearly all patients wanted access to continue after the intervention despite the fact that nearly a third continued to worry about privacy. These findings are consistent with prior literature suggesting that patients want easy online access to their health information, despite concerns that might accompany such access [1,11,15,17,29].

    The advancement of technologies such as patient portals carries the potential for a digital divide [30-36]. In our study sample that largely comprised experienced portal users, baseline concerns about privacy were more likely among individuals of non-white race/ethnicity, people reporting lower levels of self-confidence in communication, and those with less trust in their doctors. Lower education levels were also modestly associated with concerns about privacy. These associations are consistent with prior literature indicating that patients in these sociodemographic groups are, on the whole, less likely to enroll in patient portals and share personal health information [1,16,20,30-32,37,38]. Future research should consider whether worries regarding privacy might increase barriers to enrollment in patient portals among vulnerable populations, what factors associated with these sociodemographic groups contribute to privacy concerns, and how such concerns can be addressed.

    Our study describes patients’ attitudes toward privacy before and after gaining online access to their doctors’ notes; however, it does not explore the reasons behind their concerns. The word “privacy” in itself carries different meanings for different people, and it may matter more to those who feel well than to individuals who are chronically or emergently ill [3,11]. But why did some patients become more concerned about privacy after a year’s experience with OpenNotes, while others became less concerned? Did their mode of access (eg, home computer, mobile device, shared computer in a library or other public space) influence levels of concern about privacy? As patient portals become more prevalent, doctors’ notes may become a common record component included in the information available to patients online. As such, how can doctors, administrators, and policy makers better address the future portal needs of patients, and how can they ensure that patients feel safe and secure logging on to read what the doctor has written?

    Limitations

    While this research study gathered perspectives from 3874 patients at three diverse sites and included highly vulnerable patients, several limitations should be highlighted. First, participants at two sites (BIDMC and GHS) had been using patient portals before the study began and may be considered early and experienced adopters of such technology. Other literature demonstrates that individuals who use patient portals are typically less worried about privacy than nonusers [6,10], suggesting that the levels of concern reported by a substantial proportion of our respondents may not represent the general population. Nonetheless, while HMC patients received access to online health records for the first time through OpenNotes, they reported levels of concern on par with the average level of concern of registered portal users across study sites (approximately 33%; see Table 1).

    In addition, the percentage of participants responding to both the pre- and post-intervention surveys was low, albeit consistent with other Internet-based surveys of patients [3]. And finally, while the topic of privacy was addressed in focus groups with patients before developing our survey [26] (a finding consistent with other focus group research on patient portals [39]) and the survey questions were vetted prior to administration, it is important to reiterate that the phrasing of the privacy question was used for the first time in the OpenNotes survey. Patients may not distinguish between the privacy risks of digitizing their health records (eg, hospital breaches of data security) and the risks of accessing those records online (eg, forgetting to log off a public computer, printing sensitive information). As a result, self-reported concerns about privacy may reflect diverse interpretations of potential associated risks.

    Conclusions

    As patient portals and shared medical records proliferate, health professionals need to be aware of patients’ feelings about privacy. Our findings suggest that concerns about privacy among portal users do not deter them from accessing their visit notes and health information online. However, our findings also highlight the need to identify and address such concerns among specific demographic groups, particularly racial and ethnic minorities, patients with lower levels of education, and those with less trust in their doctors and lower confidence in their ability to communicate with them. If efforts to involve patients more actively in their care through Internet-based technologies are to move ahead, we need a far deeper understanding of the complex nature of “privacy” and how it interacts with the transparency that open visit notes represent.

    Acknowledgments

    The primary funding sources for this project were Robert Wood Johnson Foundation’s Pioneer Portfolio, Drane Family Fund, Koplow Charitable Foundation, and National Cancer Institute grant K05CA104699 (J Elmore).

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Baseline survey instrument.

    PDF File (Adobe PDF File), 513KB

    Multimedia Appendix 2

    Post-intervention survey instrument.

    PDF File (Adobe PDF File), 81KB

    Multimedia Appendix 3

    Individual patient matched baseline and post-intervention response to survey question: "I am concerned about my privacy" (N=3874).

    PDF File (Adobe PDF File), 64KB

    References

    1. Wen KY, Kreps G, Zhu F, Miller S. Consumers' perceptions about and use of the internet for personal health records and health information exchange: analysis of the 2007 Health Information National Trends Survey. J Med Internet Res 2010;12(4):e73 [FREE Full text] [CrossRef] [Medline]
    2. Zulman DM, Nazi KM, Turvey CL, Wagner TH, Woods SS, An LC. Patient interest in sharing personal health record information: a web-based survey. Ann Intern Med 2011 Dec 20;155(12):805-810. [CrossRef] [Medline]
    3. Hassol A, Walker JM, Kidder D, Rokita K, Young D, Pierdon S, et al. Patient experiences and attitudes about access to a patient electronic health care record and linked web messaging. J Am Med Inform Assoc 2004;11(6):505-513 [FREE Full text] [CrossRef] [Medline]
    4. Ralston JD, Hirsch IB, Hoath J, Mullen M, Cheadle A, Goldberg HI. Web-based collaborative care for type 2 diabetes: a pilot randomized trial. Diabetes Care 2009 Feb;32(2):234-239 [FREE Full text] [CrossRef] [Medline]
    5. Simon SR, Evans JS, Benjamin A, Delano D, Bates DW. Patients' attitudes toward electronic health information exchange: qualitative study. J Med Internet Res 2009;11(3):e30 [FREE Full text] [CrossRef] [Medline]
    6. Undem T. California HealthCare Foundation. Oakland, CA; 2010 Apr. Consumers and Health Information Technology: A National Survey   URL: http:/​/www.​chcf.org/​~/​media/​MEDIA%20LIBRARY%20Files/​PDF/​C/​PDF%20ConsumersHealthInfoTechnologyNationalSurvey.​pdf [accessed 2012-03-06] [WebCite Cache]
    7. Patel VN, Abramson E, Edwards AM, Cheung MA, Dhopeshwarkar RV, Kaushal R. Consumer attitudes toward personal health records in a beacon community. Am J Manag Care 2011 Apr;17(4):e104-e120 [FREE Full text] [Medline]
    8. Woods SS, Schwartz E, Tuepker A, Press NA, Nazi KM, Turvey CL, et al. Patient experiences with full electronic access to health records and clinical notes through the My HealtheVet Personal Health Record Pilot: qualitative study. J Med Internet Res 2013;15(3):e65 [FREE Full text] [CrossRef] [Medline]
    9. Agarwal R, Anderson C, Zarate J, Ward C. If we offer it, will they accept? Factors affecting patient use intentions of personal health records and secure messaging. J Med Internet Res 2013;15(2):e43 [FREE Full text] [CrossRef] [Medline]
    10. Markle Foundation. 2008 Jun 01. Americans overwhelmingly believe electronic personal health records could improve their health   URL: http://www.markle.org/sites/default/files/ResearchBrief-200806.pdf [accessed 2012-02-21] [WebCite Cache]
    11. Walker J, Ahern DK, Le LX, Delbanco T. Insights for internists: "I want the computer to know who I am". J Gen Intern Med 2009 Jun;24(6):727-732 [FREE Full text] [CrossRef] [Medline]
    12. Fontaine P, Ross SE, Zink T, Schilling LM. Systematic review of health information exchange in primary care practices. J Am Board Fam Med 2010;23(5):655-670 [FREE Full text] [CrossRef] [Medline]
    13. Kaelber DC, Jha AK, Johnston D, Middleton B, Bates DW. A research agenda for personal health records (PHRs). J Am Med Inform Assoc 2008;15(6):729-736 [FREE Full text] [CrossRef] [Medline]
    14. Reti SR, Feldman HJ, Ross SE, Safran C. Improving personal health records for patient-centered care. J Am Med Inform Assoc 2010;17(2):192-195 [FREE Full text] [CrossRef] [Medline]
    15. Kahn JS, Hilton JF, Van Nunnery T, Leasure S, Bryant KM, Hare CB, et al. Personal health records in a public hospital: experience at the HIV/AIDS clinic at San Francisco General Hospital. J Am Med Inform Assoc 2010;17(2):224-228 [FREE Full text] [CrossRef] [Medline]
    16. Teixeira PA, Gordon P, Camhi E, Bakken S. HIV patients' willingness to share personal health information electronically. Patient Educ Couns 2011 Aug;84(2):e9-12 [FREE Full text] [CrossRef] [Medline]
    17. Chhanabhai P, Holt A. Consumers are ready to accept the transition to online and electronic records if they can be assured of the security measures. MedGenMed 2007;9(1):8 [FREE Full text] [Medline]
    18. Powell J, Fitton R, Fitton C. Sharing electronic health records: the patient view. Inform Prim Care 2006;14(1):55-57. [Medline]
    19. Halamka JD, Mandl KD, Tang PC. Early experiences with personal health records. J Am Med Inform Assoc 2008;15(1):1-7 [FREE Full text] [CrossRef] [Medline]
    20. Wagner PJ, Dias J, Howard S, Kintziger KW, Hudson MF, Seol YH, et al. Personal health records and hypertension control: a randomized trial. J Am Med Inform Assoc 2012;19(4):626-634 [FREE Full text] [CrossRef] [Medline]
    21. Ralston JD, Martin DP, Anderson ML, Fishman PA, Conrad DA, Larson EB, et al. Group health cooperative's transformation toward patient-centered access. Med Care Res Rev 2009 Dec;66(6):703-724. [CrossRef] [Medline]
    22. Delbanco T, Walker J, Darer JD, Elmore JG, Feldman HJ, Leveille SG, et al. Open notes: doctors and patients signing on. Ann Intern Med 2010 Jul 20;153(2):121-125. [CrossRef] [Medline]
    23. Delbanco T, Walker J, Bell SK, Darer JD, Elmore JG, Farag N, et al. Inviting patients to read their doctors' notes: a quasi-experimental study and a look ahead. Ann Intern Med 2012 Oct 2;157(7):461-470. [CrossRef] [Medline]
    24. Walker J, Leveille SG, Ngo L, Vodicka E, Darer JD, Dhanireddy S, et al. Inviting patients to read their doctors' notes: patients and doctors look ahead: patient and physician surveys. Ann Intern Med 2011 Dec 20;155(12):811-819. [CrossRef] [Medline]
    25. Leveille SG, Walker J, Ralston JD, Ross SE, Elmore JG, Delbanco T. Evaluating the impact of patients' online access to doctors' visit notes: designing and executing the OpenNotes project. BMC Med Inform Decis Mak 2012;12:32 [FREE Full text] [CrossRef] [Medline]
    26. Dhanireddy S, Walker J, Reisch L, Oster N, Delbanco T, Elmore JG. The urban underserved: attitudes towards gaining full access to electronic medical records. Health Expect 2012 Jun 28. [CrossRef] [Medline]
    27. Safran DG, Karp M, Coltin K, Chang H, Li A, Ogren J, et al. Measuring patients' experiences with individual primary care physicians. Results of a statewide demonstration project. J Gen Intern Med 2006 Jan;21(1):13-21 [FREE Full text] [CrossRef] [Medline]
    28. Maly RC, Frank JC, Marshall GN, DiMatteo MR, Reuben DB. Perceived efficacy in patient-physician interactions (PEPPI): validation of an instrument in older persons. J Am Geriatr Soc 1998 Jul;46(7):889-894. [Medline]
    29. Nazi KM, Hogan TP, McInnes DK, Woods SS, Graham G. Evaluating patient access to Electronic Health Records: results from a survey of veterans. Med Care 2013 Mar;51(3 Suppl 1):S52-S56. [CrossRef] [Medline]
    30. Lyles CR, Harris LT, Jordan L, Grothaus L, Wehnes L, Reid RJ, et al. Patient race/ethnicity and shared medical record use among diabetes patients. Med Care 2012 May;50(5):434-440. [CrossRef] [Medline]
    31. Weingart SN, Rind D, Tofias Z, Sands DZ. Who uses the patient internet portal? The PatientSite experience. J Am Med Inform Assoc 2006;13(1):91-95 [FREE Full text] [CrossRef] [Medline]
    32. Sarkar U, Karter AJ, Liu JY, Adler NE, Nguyen R, Lopez A, et al. The literacy divide: health literacy and the use of an internet-based patient portal in an integrated health system-results from the diabetes study of northern California (DISTANCE). J Health Commun 2010;15 Suppl 2:183-196 [FREE Full text] [CrossRef] [Medline]
    33. Fowles JB, Kind AC, Craft C, Kind EA, Mandel JL, Adlis S. Patients' interest in reading their medical record: relation with clinical and sociodemographic characteristics and patients' approach to health care. Arch Intern Med 2004 Apr 12;164(7):793-800. [CrossRef] [Medline]
    34. Ammenwerth E, Schnell-Inderst P, Hoerbst A. The impact of electronic patient portals on patient care: a systematic review of controlled trials. J Med Internet Res 2012;14(6):e162 [FREE Full text] [CrossRef] [Medline]
    35. Yamin CK, Emani S, Williams DH, Lipsitz SR, Karson AS, Wald JS, et al. The digital divide in adoption and use of a personal health record. Arch Intern Med 2011 Mar 28;171(6):568-574. [CrossRef] [Medline]
    36. Horvath M, Levy J, L'Engle P, Carlson B, Ahmad A, Ferranti J. Impact of health portal enrollment with email reminders on adherence to clinic appointments: a pilot study. J Med Internet Res 2011;13(2):e41 [FREE Full text] [CrossRef] [Medline]
    37. Lyles CR, Sarkar U, Ralston JD, Adler N, Schillinger D, Moffet HH, et al. Patient-provider communication and trust in relation to use of an online patient portal among diabetes patients: The Diabetes and Aging Study. J Am Med Inform Assoc 2013 May 15. [CrossRef] [Medline]
    38. Goel MS, Brown TL, Williams A, Cooper AJ, Hasnain-Wynia R, Baker DW. Patient reported barriers to enrolling in a patient portal. J Am Med Inform Assoc 2011 Dec;18 Suppl 1:i8-12 [FREE Full text] [CrossRef] [Medline]
    39. Luque AE, van Keken A, Winters P, Keefer MC, Sanders M, Fiscella K. Barriers and Facilitators of Online Patient Portals to Personal Health Records Among Persons Living With HIV: Formative Research. JMIR Res Protoc 2013;2(1):e8. [CrossRef] [Medline]


    Abbreviations

    ACES: Ambulatory Care Experiences Survey
    BIDMC: Beth Israel Deaconess Medical Center
    GED: General Educational Development test of high-school level academic skills
    GHS: Geisinger Health System
    HMC: Harborview Medical Center
    OR: odds ratio
    PEPPI: Perceived Efficacy in Patient-Physician Interactions score


    Edited by G Eysenbach; submitted 15.04.13; peer-reviewed by L Laranjo, B Brumen; comments to author 15.06.13; revised version received 28.06.13; accepted 30.06.13; published 26.09.13

    ©Elisabeth Vodicka, Roanne Mejilla, Suzanne G Leveille, James D Ralston, Jonathan D Darer, Tom Delbanco, Jan Walker, Joann G Elmore. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 26.09.2013.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.