Published on 03.06.19 in Vol 21, No 6 (2019): June
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/13313, first published Jan 07, 2019.
Unintended Consequences of Nationwide Electronic Health Record Adoption: Challenges and Opportunities in the Post-Meaningful Use Era
The US health system has recently achieved widespread adoption of electronic health record (EHR) systems, primarily driven by financial incentives provided by the Meaningful Use (MU) program. Although successful in promoting EHR adoption and use, the program, and other contributing factors, also produced important unintended consequences (UCs) with far-reaching implications for the US health system. Based on our own experiences from large health information technology (HIT) adoption projects and a collection of key studies in HIT evaluation, we discuss the most prominent UCs of MU: failed expectations, EHR market saturation, innovation vacuum, physician burnout, and data obfuscation. We identify challenges resulting from these UCs and provide recommendations for future research to empower the broader medical and informatics communities to realize the full potential of a now digitized health system. We believe that fixing these unanticipated effects will demand efforts from diverse players such as health care providers, administrators, HIT vendors, policy makers, informatics researchers, funding agencies, and outside developers; promotion of new business models; collaboration between academic medical centers and informatics research departments; and improved methods for evaluations of HIT.
J Med Internet Res 2019;21(6):e13313
When humans created the cities to enable surplus food, labor division, and trade, the city itself generated new modalities of problems such as disease and violence. The American sociologist Robert K. Merton (1910-2013) coined the term unintended consequences (UCs) to describe these antagonistic elements inherent in any human endeavor . The health care industry, which in the United States has reached near universal adoption of electronic health record (EHR) systems, is no exception.
Calls for nationwide adoption of EHRs  finally came to fruition when the US Congress passed the Health Information Technology for Economic and Clinical Health (HITECH) Act into law in 2009 [ ], establishing the Meaningful Use (MU) program. As a result of MU, EHR adoption among US hospitals increased an impressive 8-fold in 6 years, and today, 9 in 10 hospitals use a government-certified EHR, and adoption among office-based physicians is above 80% [ ]. However, although successful in promoting its intended consequences (EHR adoption and use), the program, and other contributing factors, also produced important UCs, with effects that range from the health system level all the way to the point of care level. Many recent publications have criticized MU and particularly EHRs; however, little attention has been dedicated to promoting effective solutions. Although previous articles have elicited emerging health information technology (HIT) UCs such as decreased patient-provider interaction, security breaches, and overdependence on technology [ ] and proposed a research agenda to fixing the EHR [ ], such reports were produced during the MU implementation, and therefore, their conclusions were made before the US health system had been exposed to the effects of nationwide EHR adoption. On the basis of our own experiences from large-scale HIT adoption projects and a collection of key studies in HIT evaluation, we discuss the most prominent UCs of MU ( ) and provide recommendations for future research to empower the broader medical and informatics communities to realize the full potential of a now digitized health system.
Unintended Consequence 1: Failed Expectations
Recent systematic reviews have found that most HIT evaluations published before MU reported predominantly positive outcomes [, ]. These outcomes served as the foundation for the MU program and have produced a hype around HIT. Such a hype led to a nationwide adoption of commercial EHRs with high expectations for improving the US health care cost and quality [ ]. However, after 4 years of nationwide EHR adoption, health care in the United States is still the most expensive and lags behind in some quality outcomes when compared with other developed countries [ ], which indicates that the expected benefits of a digital health system have not yet materialized [ - ]. As the adoption of commercial EHRs increased, new, unanticipated modalities of problems emerged [ ]. The first systematic review of HIT impact published after MU continued to find mostly positive results; however, it also reported that 19% of the studies found no significant HIT impact, and the lack of negative outcomes is likely explained by publication bias [ ].
The same systematic reviews that have reported positive findings have also reported several mixed results, which leaves unanswered questions as to the impact of HIT on quality, productivity, and safety. Furthermore, studies from other industries demonstrate that IT adoption rarely produces positive results if not accompanied by complementary factors or investments . Several internal and external factors have been identified as potentially affecting care outcomes during HIT interventions [ ], which suggests that previous studies may have been subjected to similar context-dependent factors, as they are common to HIT interventions [ , ]. Pre-MU studies are being criticized for relying on weak research designs such as short-term pretest-posttests and for the use of a small set of nonconsensus measurements [ , , ]. The latter is an important barrier to the reproducibility of studies [ ] and to the comparison of outcomes across studies [ ], which prevents more comprehensive assessments of HIT impact and produces questions regarding the strength of the evidence supporting HIT effectiveness [ ]. The lack of consistent evidence resulting from the use of poorly designed studies indicates that what others have called positive outcomes [ , ] are in fact putative outcomes. It has been estimated that without improved research methods, around 100 hypotheses per year will continue to be tested without providing any valuable knowledge [ ].
With insufficient evidence to support the hype around HIT and generalizable effects of HIT across care outcomes, settings, and EHR systems, an important question remains unanswered: was the over 20-billion-dollar investment in HIT from the America Recovery and Reinvestment Act (ARRA) worth it?
The Path Forward
Implementation of a new EHR will inevitably add to the complexity of the several aspects of care, and as users adapt to the system, they demand new customizations . These customizations are often added to updated EHR versions that demand extensive local testing and an implementation process almost as complex, risky, and labor intensive as the implementation of a newly adopted EHR. In such a scenario, simple pretest-posttest designs are ineffective [ ]. A paradigm shift on the choice of research designs for HIT studies is needed to produce more longitudinal evaluations able to detect time-sensitive effects common to HIT interventions [ ] and to assess a large set of measures capable of detecting the diverse effects of such interventions [ , ]. Furthermore, as HIT interventions are subject to context-dependent factors, assessment of potential covariates is of paramount importance, as demonstrated elsewhere [ ]. A better understanding of the full impact of HIT on the US health system will demand more comprehensive evaluations that assess a large sample of agreed-upon measures shared across researchers to allow comparison of outcomes across studies by future systematic reviews—and potential meta-analyses. In addition to increasing our understating of HIT impact on a national scale, such an approach has the potential to produce compelling evidence to the need for improving HIT effectiveness and can lead us to a more realistic assessment of the real value of the ARRA investment in HIT.
Unintended Consequence 2: Electronic Health Record Market Saturation
The time frame to implement MU’s certification criteria was constrained, and the larger EHR vendors more rapidly complied with the criteria, contributing to an increased adoption of systems with established market share . In 2017, the top 3 US HIT vendors shared 66% of the EHR market for acute care hospitals, which includes most large academic medical centers [ , ]. Given the complexity and high cost involved in implementing a commercial EHR, health care organizations are unlikely to change an EHR vendor anytime soon, causing a saturation of the US EHR market.
The Path Forward
As new, expensive EHR implementations become rarer, EHR vendors will be forced to find new business models to remain profitable. This path is evolving through initiatives such as the Substitutable Medical Applications & Reusable Technologies (SMART), which coupled with data standards, such as Fast Healthcare Interoperability Resources (FHIR), is enabling development of third-party applications seamlessly connected to commercial EHRs. Such applications have the potential to replace or augment commercial EHRs’ functionality, in a model similar to the mobile phone industry . To providers, such an approach represents an interesting opportunity to expand, customize, or replace EHR functionality as needed; to EHR vendors, it represents an opportunity to diversify their products, solutions, and sources of income. However, the saturation of the national market has produced a situation analogous to an oligopoly, and the path to producing new business models is unclear. Although some vendors seem to be open to the idea of having external applications connected to their EHR, others intend to charge providers per FHIR transaction, which will eventually hamper use of external applications. In addition, the 2 leading US EHR vendors are increasing their global presence [ ], which may help to keep them financially sustainable and postpone the development of new business models. With an increased bargaining power of these vendors, the success of initiatives such as SMART on FHIR may emerge from the tension between providers’ needs and vendors’ desire to keep control over their products [ ].
Some researchers have suggested that the use of similar systems across the country will create opportunities for human factors researchers by facilitating comparison of similar functionality ; however, such opportunities may not reach fruition because of local configurations that allow the same product to be implemented in completely different ways across clients [ ]. Overcoming the vendor oligopoly will demand development of informatics solutions proved to be more effective than current systems’ functionality, which leads us to the next UC: innovation vacuum.
Unintended Consequence 3: Innovation Vacuum
As EHR adoption has primarily been achieved through financial incentives, the cycle of technological innovation typical of other industries has not been observed in the US HIT sector. As a result, commercial EHRs were adopted before fixing widely known problems such as poor usability , which has been associated to patient harm [ , ], and suboptimal clinical decision support (CDS) systems [ ] such as excessive, overzealous alerts frequently ignored by providers [ ]. In addition, a recent evaluation of EHR certification criteria concluded that the certification process is not designed to prevent patient harm [ ]. Specifically, the report found that the usability testing required does not include a representative sample, does not include real clinical scenarios, and does not simulate changes added through system configuration by local clients.
The accelerated adoption also affected benchmarking organizations such as Intermountain Healthcare, Partners Healthcare, and the Veterans Health Administration that have traditionally promoted most HIT innovations . These organizations decided to replace their systems with commercial EHRs, putting an end to the homegrown systems’ era. As a result, some of these organizations decided to dissolve their informatics departments [ , ], decreasing their investment in informatics innovation.
With widespread adoption of suboptimal and poorly tested systems, along with traditional innovators stepping aside, fixing the EHR now is a bit like fixing an airplane midflight, and without a pilot.
The Path Forward
At least 2 panels at recent American Medical Informatics Association annual symposia have presented informatics innovations in the post-MU era with clients of 1 large HIT vendor, and most innovations included SMART on FHIR apps [, ]. Panelists have pointed out that as commercial EHRs can properly handle capabilities such as billing, data storage, and privacy regulations, informatics innovators tend to be freer to innovate in the post-MU era. However, as previously mentioned, most HIT vendors are not yet fully open to seamless interface with external apps. In addition, FHIR is a standard under development, and a substitute for the traditional innovators is yet to be found. To aggravate the problem, most contracts signed between providers and HIT vendors include clauses that hamper transparency by preventing providers from sharing usability and safety issues that could otherwise advance EHR design [ ].
There was a natural reason for having most HIT innovations coming from benchmarking organizations: neither HIT vendors nor academic departments have seamless access to clinicians at the point of care, where informatics applications are put to the test. In naturalistic settings, iterations between clinicians and informaticists facilitate an understanding of users’ needs to inform EHR development. Academic informatics departments could serve as a natural replacement for the traditional innovators by promoting cutting-edge research toward fixing the EHR, coupled with more robust HIT evaluations. However, this replacement will demand a closer relationship between academic departments and their medical centers. In US universities, these departments tend to function as independent organizations, which hampers researchers’ access to HIT resources and clinicians at the point of care. Work in such a direction has started [- ] and serves as example of the path needed to design new business models, fostering innovation and transparency, and fixing the EHR.
Unintended Consequence 4: Physician Burnout
The accelerated adoption of commercial EHRs coincided (and likely was programmed to coincide) with the implementation of the Affordable Care Act (ACA). The slow, but steady, implementation of pay-for-performance payment models has given rise to the EHR-based quality measurement . The push for reporting clinical performance generates an increased demand for capturing accurate, structured data [ ], and the use of suboptimal EHRs in these tasks has contributed to the so called EHR-associated physician burnout [ ]. The use of clinical documentation for nonclinical purposes is increasing and is source of frustration among physicians [ , ]. This is reinforced by the fact that electronic clinical notes generated in the United States are significantly longer than similar documentation in other developed countries [ ]. Recent studies have found that in the post-MU and ACA era, for every hour of patient contact time, physicians may spend up to 2 hours on electronic documentation [ , ]. The documentation burden has been so intense that in some cases, physicians intentionally close slots in their agenda to complete electronic documentation of previous patients [ ].
The Path Forward
In addition to simplifying billing requirements  and developing informatics solutions to extract quality indicators from clinical documentation [ ], a fundamental redesign of the EHR to improve data entry and retrieval is needed. The structured and static format of current EHR interfaces force physicians to record clinical data through predefined and strict functionality dependent on the current desktop kit (pointer + keyboard + monitor with a cluttered EHR interface). For physicians to keep the richer narrative of their clinical assessments while decreasing the documentation burden, EHRs must demand less typing and clicking [ ]. New technologies such as conversational speech recognition (CSR) have recently achieved human parity with regards to transcription error rate [ ] and have tremendous potential for substantially decreasing typing and clicking. However, CSR solutions may be compromised by the fact that clinicians may make conscious decisions about what information to communicate to patients and to document in the EHR [ ]. Therefore, there are opportunities for research exploring what information clinicians document (or not) in the EHR and what information they do not communicate verbally to the patient but document in their clinical notes [ ]; such findings will inform development of CSR and other data-entry solutions capable of handling such situations. Regarding data retrieval, EHR content retrieved by physicians is influenced by their tasks or information goals [ , ]; however, such stimuli are not captured by current EHRs. Future research should investigate how EHRs can support data retrieval with intelligent stimulus- or goal-oriented functionality that allows a holistic view of the patient and flexible navigation across the record [ ] to hopefully decrease the documentation burden and its contribution to the next UC: data obfuscation.
Unintended Consequence 5: Data Obfuscation
Physicians frequently create their clinical notes by using the patient’s previous note, a practice known as copy-and-paste.  As a result, they often produce (and later deal with) uninformative, bloated notes that often contain redundant information and errors [ , ]. In addition, these notes do not provide the data in a way that increases clinicians’ situational awareness (ie, the perception and comprehension of relevant information necessary to take action) [ ], and in some cases may never be read [ ]. The problem is aggravated by overwhelming CDS alerts and reminders; many clinicians complain that such alerts make them vulnerable to information overload, which might lead them to miss important information [ ]. The obfuscation of relevant data resulting from bloated records has been reported [ , ], associated with potential safety hazards [ ] and with delayed or incorrect decisions at the point of care [ ].
The Path Forward
Some proposed solutions to highlighting relevant data include tailoring physicians’ use of EHRs to document what they are thinking about the patient’s situation , transferring some data entry to patients [ ], or new policies to facilitate health information exchange (HIE) [ , , ]. Such proposals are unlikely to succeed in isolation as they require clinicians to enter or import even more information into already bloated records. In addition, the effectiveness of HIE seems to be understudied [ ]; although some studies report HIE-associated improvements [ ], others report the opposite [ ].
Concise documentation that highlights relevant data will come from smarter EHRs that actively participate in patient care ; however, to be smarter, EHRs must be able to capture and process more information about the patient’s context and clinicians’ reasoning. Previous studies suggest that clinicians seem to always know something that is only partially represented in or is missing entirely from the EHR [ , ]. For example, EHRs are incapable of understanding why clinicians order what they order, or how current symptoms are related to previous problems. Although most EHRs allow medical records to be structured on a problem-oriented basis, such structure does not capture the reasoning behind the relationship between problems and other clinical concepts. For example, a medication can be linked to a problem, indicating that it was ordered to treat a particular problem, but the reasoning (why) behind the choice for this particular medication is not captured by the EHR. If such data were captured, several opportunities for informatics research would emerge to apply (and improve) computational methods (eg, machine learning, natural language processing, and text generation methods) to empower the EHR to use patient’s care context data. Context-rich data could be used to facilitate note creation, to create automatic notes ready for review, and to increase the accuracy of CDS, potentially mitigating the already infamous alert fatigue [ ]. However, 2 major challenges remain: (1) A formal representation of the semantic relationships between clinical concepts (eg, symptoms, findings, problems, diagnoses, and treatments) does not exist and (2) Effective methods for capturing and representing clinicians’ reasoning need to be developed [ ]. EHR vendors have avoided this path to avert coliability for medical errors when eventual system failures lead to misleading recommendations [ , ]. What vendors have avoided translates into several opportunities for informatics researchers. The development of a formal representation of clinicians reasoning seems to be a promising alternative to empower EHRs to represent patients’ situation [ ]. However, the application of such a representation into actual patient data will demand new, more effective data-entry approaches [ ], improvements to data visualization [ ], and computational methods [ ].
On balance, despite the unexpected effects and challenges of nationwide EHR adoption, several opportunities for developing more effective EHRs and evaluation methods are likely to emerge from the forces promoting progress. The UCs here discussed do not intend to be exhaustive; other consequences may be revealed as new, more robust HIT evaluations are reported. We hypothesize that overcoming these UCs will likely require a path reverse to the one that produced them. By creating smarter clinical information systems with more intuitive navigation and data entry functionality, clinicians could save time searching, synthesizing, and documenting data in the EHR, which would contribute to alleviate data obfuscation and mitigate burnout. Such systems will likely come from external applications developed through cutting-edge research conducted in academic medical centers that tend to be a natural replacement for earlier informatics innovators. These applications, if successfully implemented and evaluated, may back providers up on their demands to have most large EHR vendors opening their platforms, which would facilitate the development of new business models and decrease market oligopoly. Finally, by accumulating evidence of the effectiveness of these applications, in isolation and in conjunction with commercial EHRs, a better understanding of the true positive effects of HIT can be obtained by future systematic reviews and meta-analyses.
The multiple efforts proposed here will demand collaboration between diverse players such as health care providers, administrators, HIT vendors, policy makers, informatics researchers, funding agencies, and outside developers toward a single goal: to realize the full potential of a digitized health system.
This work was supported by research funds from the Informatics Institute of the University of Alabama at Birmingham.
Conflicts of Interest
- Garfield E. The unintended and unanticipated consequences of Robert K Merton. Soc Stud Sci 2016 Jun 29;34(6):845-853. [CrossRef]
- Institute of Medicine. The Computer-based Patient Record: An Essential Technology for Health Care. Revised Edition. Dick RS, Steen EB, Detmer DE. editors. Washington, DC: National Academy Press; 1997.
- United States Department of Health and Human Services. HITECH Act § 13400(5) URL: https://www.hhs.gov/sites/default/files/ocr/privacy/hipaa/understanding/coveredentities/hitechact.pdf [accessed 2019-05-10] [WebCite Cache]
- The Office of the National Coordinator for Health Information Technology. Health IT Dashboard URL: https://dashboard.healthit.gov/quickstats/quickstats.php [accessed 2019-05-10] [WebCite Cache]
- Sittig DF, Wright A, Ash J, Singh H. New unintended adverse consequences of electronic health records. Yearb Med Inform 2016 Nov 10(1):7-12. [CrossRef] [Medline]
- Payne TH, Corley S, Cullen TA, Gandhi TK, Harrington L, Kuperman GJ, et al. Report of the AMIA EHR-2020 Task Force on the status and future direction of EHRs. J Am Med Inform Assoc 2015 Sep;22(5):1102-1110. [CrossRef] [Medline]
- Buntin MB, Burke MF, Hoaglin MC, Blumenthal D. The benefits of health information technology: a review of the recent literature shows predominantly positive results. Health Aff (Millwood) 2011 Mar;30(3):464-471 [FREE Full text] [CrossRef] [Medline]
- Jones SS, Rudin RS, Perry T, Shekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med 2014 Jan 7;160(1):48-54. [CrossRef] [Medline]
- Hillestad R, Bigelow J, Bower A, Girosi F, Meili R, Scoville R, et al. Can electronic medical record systems transform health care? Potential health benefits, savings, and costs. Health Aff (Millwood) 2005;24(5):1103-1117 [FREE Full text] [CrossRef] [Medline]
- Papanicolas I, Woskie LR, Jha AK. Health care spending in the United States and other high-income countries. J Am Med Assoc 2018 Mar 13;319(10):1024-1039. [CrossRef] [Medline]
- Colicchio TK, Fiol GD, Stoddard GJ, Narus SP. Evaluation of a systematic methodology to detect in near real-time performance changes during electronic health record system implementations: a longitudinal study. AMIA Annu Symp Proc 2017;2017:595-604 [FREE Full text] [Medline]
- Colicchio TK, Del Fiol G, Scammon DL, Facelli JC, Bowes WA, Narus SP. Comprehensive methodology to monitor longitudinal change patterns during EHR implementations: a case study at a large health care delivery network. J Biomed Inform 2018 Jul;83:40-53. [CrossRef] [Medline]
- Murphy DR, Meyer AN, Russo E, Sittig DF, Wei L, Singh H. The burden of inbox notifications in commercial electronic health records. JAMA Intern Med 2016 Apr;176(4):559-560 [FREE Full text] [CrossRef] [Medline]
- Bryant AD, Fletcher GS, Payne TH. Drug interaction alert override rates in the Meaningful Use era: no evidence of progress. Appl Clin Inform 2014;5(3):802-813 [FREE Full text] [CrossRef] [Medline]
- Kruse CS, Beane A. Health information technology continues to show positive effect on medical outcomes: systematic review. J Med Internet Res 2018 Feb 05;20(2):e41 [FREE Full text] [CrossRef] [Medline]
- Brynjolfsson E, Hitt LM. Beyond the productivity paradox. Commun ACM 1998 Aug;41(8):49-55. [CrossRef]
- Colicchio TK, Borbolla D, Colicchio VD, Del Fiol G, Scammon DL, Facelli JC, et al. Looking Behind the Curtain: Identifying Factor Affecting Care Outcomes During a Large Commercial EHR Implementation. eGEMs 2019 May 06;7((1): 21):1-12 [FREE Full text]
- Jones SS, Heaton PS, Rudin RS, Schneider EC. Unraveling the IT productivity paradox--lessons for health care. N Engl J Med 2012 Jun 14;366(24):2243-2245. [CrossRef] [Medline]
- Wachter RM, Howell MD. Resolving the productivity paradox of health information technology: a time for optimism. J Am Med Assoc 2018 Jul 03;320(1):25-26. [CrossRef] [Medline]
- Colicchio TK, Facelli JC, Del Fiol G, Scammon DL, Bowes WA, Narus SP. Health information technology adoption: understanding research protocols and outcome measurements for IT interventions in health care. J Biomed Inform 2016 Dec;63:33-44 [FREE Full text] [CrossRef] [Medline]
- Ioannidis JP. Why most published research findings are false. PLoS Med 2005 Aug;2(8):e124 [FREE Full text] [CrossRef] [Medline]
- Koppel R. Is healthcare information technology based on evidence? Yearb Med Inform 2013;8:7-12. [Medline]
- Rudin RS, Jones SS, Shekelle P, Hillestad RJ, Keeler EB. The value of health information technology: filling the knowledge gap. Am J Manag Care 2014 Nov;20(11 Spec No. 17):eSP1-eSP8 [FREE Full text] [Medline]
- Harrison MI, Koppel R, Bar-Lev S. Unintended consequences of information technologies in health care--an interactive sociotechnical analysis. J Am Med Inform Assoc 2007;14(5):542-549 [FREE Full text] [CrossRef] [Medline]
- Lagarde M. How to do (or not to do) ... Assessing the impact of a policy change with routine longitudinal data. Health Policy Plan 2012 Jan;27(1):76-83. [CrossRef] [Medline]
- Hacker K, Penfold R, Zhang F, Soumerai SB. Impact of electronic health record transition on behavioral health screening in a large pediatric practice. Psychiatr Serv 2012 Mar;63(3):256-261 [FREE Full text] [CrossRef] [Medline]
- Joseph S, Sow M, Furukawa MF, Posnack S, Chaffee MA. HITECH spurs EHR vendor competition and innovation, resulting in increased adoption. Am J Manag Care 2014 Sep;20(9):734-740 [FREE Full text] [Medline]
- HIMSS Analytics. Which EHR vendor boosts the most hospital clients URL: https://www.beckershospitalreview.com/healthcare-information-technology/himss-analytics-which-ehr-vendor-boasts-the-most-hospital-clients.html [accessed 2019-05-10] [WebCite Cache]
- KLAS Research. Hospital EMR Market Share URL: https://klasresearch.com/report/us-hospital-emr-market-share-2018/1279 [accessed 2019-05-10] [WebCite Cache]
- Mandel JC, Kreda DA, Mandl KD, Kohane IS, Ramoni RB. SMART on FHIR: a standards-based, interoperable apps platform for electronic health records. J Am Med Inform Assoc 2016 Sep;23(5):899-908 [FREE Full text] [CrossRef] [Medline]
- KLAS Research. EMR Global Market URL: https://klasresearch.com/report/global-emr-market-share-2017/1192 [accessed 2019-05-10] [WebCite Cache]
- Koppel R, Lehmann CU. Implications of an emerging EHR monoculture for hospitals and healthcare systems. J Am Med Inform Assoc 2015 Mar;22(2):465-471. [CrossRef] [Medline]
- Middleton B, Bloomrosen M, Dente MA, Hashmat B, Koppel R, Overhage JM, et al. Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. J Am Med Inform Assoc 2013 Jun;20(e1):e2-e8 [FREE Full text] [CrossRef] [Medline]
- Howe JL, Adams KT, Hettinger AZ, Ratwani RM. Electronic health record usability issues and potential contribution to patient harm. J Am Med Assoc 2018 Dec 27;319(12):1276-1278 [FREE Full text] [CrossRef] [Medline]
- Ratwani RM, Savage E, Will A, Fong A, Karavite D, Muthu N, et al. Identifying electronic health record usability and safety challenges in pediatric settings. Health Aff (Millwood) 2018 Dec;37(11):1752-1759. [CrossRef] [Medline]
- Ash JS, Sittig DF, Campbell EM, Guappone KP, Dykstra RH. Some unintended consequences of clinical decision support systems. AMIA Annu Symp Proc 2007:26-30 [FREE Full text] [Medline]
- Baysari MT, Tariq A, Day RO, Westbrook JI. Alert override as a habitual behavior-a new perspective on a persistent problem. J Am Med Inform Assoc 2017 Dec 01;24(2):409-412. [CrossRef] [Medline]
- The Pew Trusts. Ways to Improve Electronic Health Record Safety URL: https://www.pewtrusts.org/en/research-and-analysis/reports/2018/08/28/ways-to-improve-electronic-health-record-safety [accessed 2019-05-10] [WebCite Cache]
- Evans RS. Electronic health records: then, now, and in the future. Yearb Med Inform 2016 May 20;Suppl 1:S48-S61. [CrossRef] [Medline]
- Bowes WA. Impacts of EHR certification and meaningful use implementation on an integrated delivery network. AMIA Annu Symp Proc 2014;2014:325-332 [FREE Full text] [Medline]
- DeseretNews. Intermountain Healthcare to Outsource 98 Information Technology Employees URL: https://www.deseretnews.com/article/900014140/98-intermountain-healthcare-information-technology-employees-being-outsourced.html [accessed 2019-05-10] [WebCite Cache]
- AMIA Annual Symposium 2015. URL: https://www.amia.org/amia2015/panels [accessed 2019-05-10] [WebCite Cache]
- AMIA Annual Symposium 2018. Agenda URL: https://symposium2018.zerista.com/event/member/507934 [accessed 2019-05-10] [WebCite Cache]
- Ratwani R, Hodgkins M, Bates D. Improving electronic health record usability and safety requires transparency. J Am Med Assoc 2018 Dec 25;320(24):4. [Medline]
- Crump J, Del Fiol G, Williams M, Freimuth R. Prototype of a Standards-Based EHR and Genetic Test Reporting Tool Coupled with HL7-Compliant Infobuttons. AMIA Jt Summits Transl Sci Proc 2018;2017:330-339 [FREE Full text] [Medline]
- Bergquist T, Buie R, Li K, Brandt P. Heart on FHIR: integrating patient generated data into clinical care to reduce 30 day heart failure readmissions (Extended Abstract). AMIA Annu Symp Proc 2017;2017:2269-2273 [FREE Full text] [Medline]
- Sinha S, Jensen M, Mullin S, Elkin P. Safe Opioid Prescription: a SMART on FHIR approach to clinical decision support. Online J Public Health Inform 2017 Sep 08;9(2):A. [Medline]
- Cusack CM, Hripcsak G, Bloomrosen M, Rosenbloom ST, Weaver CA, Wright A, et al. The future state of clinical data capture and documentation: a report from AMIA's 2011 Policy Meeting. J Am Med Inform Assoc 2013 Jan 1;20(1):134-140 [FREE Full text] [CrossRef] [Medline]
- Shanafelt TD, Dyrbye LN, West CP. Addressing physician burnout: the way forward. J Am Med Assoc 2017 Dec 07;317(9):901-902. [CrossRef] [Medline]
- Ho Y, Gadd C, Kohorst K, Rosenbloom S. A qualitative analysis evaluating the purposes and practices of clinical documentation. Appl Clin Inform 2014;5(1):153-168 [FREE Full text] [CrossRef] [Medline]
- Koopman R, Steege L, Moore J, Clarke M, Canfield S, Kim M, et al. Physician information needs and Electronic Health Records (EHRs): time to reengineer the clinic note. J Am Board Fam Med 2015;28(3):316-323 [FREE Full text] [CrossRef] [Medline]
- Downing N, Bates D, Longhurst C. Physician burnout in the electronic health record era. Ann Intern Med 2019 Feb 05;170(3):216-217. [CrossRef] [Medline]
- Sinsky C, Colligan L, Li L, Prgomet M, Reynolds S, Goeders L, et al. Allocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties. Ann Intern Med 2016 Dec 06;165(11):753-760. [CrossRef] [Medline]
- Arndt BG, Beasley JW, Watkinson MD, Temte JL, Tuan W, Sinsky CA, et al. Tethered to the EHR: primary care physician workload assessment using EHR event log data and time-motion observations. Ann Fam Med 2017 Sep;15(5):419-426 [FREE Full text] [CrossRef] [Medline]
- Wachter R, Goldsmith J. Harvard Business Review. 2018. To combat physician burnoutimprove care, fix the electronic health record URL: https://hbr.org/2018/03/to-combat-physician-burnout-and-improve-care-fix-the-electronic-health-record [accessed 2019-05-14] [WebCite Cache]
- Xiong W, Droppo J, Huang X, Seide F, Seltzer M, Stolcke A. arXivcs Internet. 2016. Achieving Human Parity in Conversational Speech Recognition URL: http://arxiv.org/abs/1610.05256 [accessed 2018-04-25]
- Tuepker A, Zickmund S, Nicolajski C, Hahm B, Butler J, Weir C. Providers? Note-Writing Practices for Post-traumatic Stress Disorder at Five United States Veterans Affairs Facilities. J Behav Health Serv Res 2016 Jul 01;43(3):42. [Medline]
- Colicchio T, Cimino JJ. Clinicians' reasoning as reflected in electronic clinical note-entry and reading/retrieval: a systematic review and qualitative synthesis. J Am Med Inform Assoc 2019 Feb 01;26(2):172-184. [CrossRef] [Medline]
- Rizvi RF, Harder KA, Hultman GM, Adam TJ, Kim M, Pakhomov SV, et al. A comparative observational study of inpatient clinical note-entry and reading/retrieval styles adopted by physicians. Int J Med Inform 2016 Jun;90:1-11. [CrossRef] [Medline]
- Wright M, Dunbar S, Macpherson B, Moretti E, Del Fiol G, Bolte J, et al. Toward designing information display to support critical care. A qualitative contextual evaluation and visioning effort. Appl Clin Inform 2016 Dec 05;7(4):912-929 [FREE Full text] [CrossRef] [Medline]
- Siegler EL, Adelman R. Copy and paste: a remediable hazard of electronic health records. Am J Med 2009 Jun;122(6):495-496. [CrossRef] [Medline]
- Wrenn J, Stein D, Bakken S, Stetson P. Quantifying clinical narrative redundancy in an electronic health record. J Am Med Inform Assoc 2010;17(1):49-53 [FREE Full text] [CrossRef] [Medline]
- Hammond KW, Helbig ST, Benson CC, Brathwaite-Sketoe BM. Are electronic medical records trustworthy? Observations on copying, pasting and duplication. AMIA Annu Symp Proc 2003:269-273 [FREE Full text] [Medline]
- Lenert L. Toward medical documentation that enhances situational awareness learning. AMIA Annu Symp Proc 2016;2016:763-771 [FREE Full text] [Medline]
- Hripcsak G, Vawdrey DK, Fred MR, Bostwick SB. Use of electronic clinical documentation: time spent and team interactions. J Am Med Inform Assoc 2011;18(2):112-117 [FREE Full text] [CrossRef] [Medline]
- Singh H, Spitzmueller C, Petersen NJ, Sawhney MK, Sittig DF. Information overload and missed test results in electronic health record-based settings. JAMA Intern Med 2013 Apr 22;173(8):702-704 [FREE Full text] [CrossRef] [Medline]
- Tsou A, Lehmann C, Michel J, Solomon R, Possanza L, Gandhi T. Safe practices for copy and paste in the EHR. Systematic review, recommendations, and novel model for health IT collaboration. Appl Clin Inform 2017 Dec 11;8(1):12-34 [FREE Full text] [CrossRef] [Medline]
- Partnership for Health IT Patient Safety. 2016 Feb. Health IT Safe Practices: Toolkit for the Safe Use of Copy and Paste URL: https://www.ecri.org/Resources/HIT/CP_Toolkit/Toolkit_CopyPaste_final.pdf [accessed 2019-05-10] [WebCite Cache]
- Bowman S. Impact of electronic health record systems on information integrity: quality and safety implications. Perspect Health Inf Manag 2013;10:1c [FREE Full text] [Medline]
- Singh H, Giardina T, Meyer A, Forjuoh S, Reis M, Thomas E. Types and origins of diagnostic errors in primary care settings. JAMA Intern Med 2013 Mar 25;173(6):418-425 [FREE Full text] [CrossRef] [Medline]
- Halamka JD, Tripathi M. The HITECH era in retrospect. N Engl J Med 2017 Sep 07;377(10):907-909. [CrossRef] [Medline]
- Rahurkar S, Vest JR, Menachemi N. Despite the spread of health information exchange, there is little evidence of its impact on cost, use, and quality of care. Health Aff (Millwood) 2015 Mar;34(3):477-483. [CrossRef] [Medline]
- Frisse ME, Johnson KB, Nian H, Davison CL, Gadd CS, Unertl KM, et al. The financial impact of health information exchange on emergency department care. J Am Med Inform Assoc 2012;19(3):328-333 [FREE Full text] [CrossRef] [Medline]
- Lang E, Afilalo M, Vandal AC, Boivin J, Xue X, Colacone A, et al. Impact of an electronic link between the emergency department and family physicians: a randomized controlled trial. Can Med Assoc J 2006 Jan 31;174(3):313-318 [FREE Full text] [CrossRef] [Medline]
- Cimino JJ. Improving the electronic health record--are clinicians getting what they wished for? J Am Med Assoc 2013 Mar 13;309(10):991-992 [FREE Full text] [CrossRef] [Medline]
- Her Q, Amato M, Seger D, Beeler P, Slight S, Dalleur O, et al. The frequency of inappropriate nonformulary medication alert overrides in the inpatient setting. J Am Med Inform Assoc 2016 Sep;23(5):924-933. [Medline]
- Koppel R, Kreda D. Health care information technology vendors' "hold harmless" clause: implications for patients and clinicians. J Am Med Assoc 2009 Mar 25;301(12):1276-1278. [CrossRef] [Medline]
- Wachter R. The Digital Doctor: hope, hype, and harm at the dawn of medicine?. The Digital Doctor: McGraw-Hill, New York; 2015:1260019608-1260019690.
- Cimino J, Li Z, Weng C. An exploration of the terminology of clinical cognition and reasoning. AMIA Annu Symp Proc 2018;2018:321-329 [FREE Full text] [Medline]
- Nolan ME, Siwani R, Helmi H, Pickering BW, Moreno-Franco P, Herasevich V. Health IT usability focus section: data use and navigation patterns among medical ICU clinicians during electronic chart review. Appl Clin Inform 2017 Dec;8(4):1117-1126. [CrossRef] [Medline]
|ACA: Affordable Care Act|
|ARRA: America Recovery and Reinvestment Act|
|CDS: clinical decision support|
|CSR: conversational speech recognition|
|EHR: electronic health record|
|FHIR: Fast Healthcare Interoperability Resources|
|HIE: health information exchange|
|HIT: health information technology|
|HITECH: Health Information Technology for Economic and Clinical Health|
|MU: Meaningful Use|
|SMART: Substitutable Medical Applications & Reusable Technologies|
|UCs: unintended consequences|
Edited by G Eysenbach; submitted 07.01.19; peer-reviewed by A Martínez-García, N Delvaux, B Vaes; comments to author 28.03.19; revised version received 09.04.19; accepted 26.04.19; published 03.06.19
©Tiago K Colicchio, James J Cimino, Guilherme Del Fiol. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 03.06.2019.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.