Maintenance Note

On Friday, August 31, 2018 at 12:00 pm Eastern Time, JMIR will be completing a server migration to improve site stability and user experience. We expect to be back online Friday, August 31, 2018 at 5:00 pm Eastern Time. Should any problems arise our technical team will be using the weekend to resolve them, and users will be able to access our site by Sunday, September 2, 2018 at 1:00pm Eastern Time.

Who will be affected?


Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 07.08.18 in Vol 20, No 8 (2018): August

Preprints (earlier versions) of this paper are available at, first published Mar 20, 2018.

This paper is in the following e-collection/theme issue:

    Original Paper

    Forecasting the Maturation of Electronic Health Record Functions Among US Hospitals: Retrospective Analysis and Predictive Model

    1Center for Population Health IT, Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States

    2Strategic Management Program, Foster School of Business, University of Washington, Seattle, WA, United States

    3The University of Sydney Business School, Sydney, Australia

    4Department of Family Medicine, College of Medicine, The Ohio State University, Columbus, OH, United States

    5Department of Biomedical Informatics, College of Medicine, The Ohio State University, Columbus, OH, United States

    6Department of Health Care Organization and Policy, School of Public Health, University of Alabama Birmingham, Birmingham, AL, United States

    *all authors contributed equally

    Corresponding Author:

    Hadi Kharrazi, MHI, MD, PhD

    Center for Population Health IT

    Department of Health Policy and Management

    Johns Hopkins Bloomberg School of Public Health

    624 N Broadway

    Office 606

    Baltimore, MD, 21205-2103

    United States

    Phone: 1 443 287 8264

    Fax:1 410 955 0470



    Background: The Meaningful Use (MU) program has promoted electronic health record adoption among US hospitals. Studies have shown that electronic health record adoption has been slower than desired in certain types of hospitals; but generally, the overall adoption rate has increased among hospitals. However, these studies have neither evaluated the adoption of advanced functionalities of electronic health records (beyond MU) nor forecasted electronic health record maturation over an extended period in a holistic fashion. Additional research is needed to prospectively assess US hospitals’ electronic health record technology adoption and advancement patterns.

    Objective: This study forecasts the maturation of electronic health record functionality adoption among US hospitals through 2035.

    Methods: The Healthcare Information and Management Systems Society (HIMSS) Analytics’ Electronic Medical Record Adoption Model (EMRAM) dataset was used to track historic uptakes of various electronic health record functionalities considered critical to improving health care quality and efficiency in hospitals. The Bass model was used to predict the technological diffusion rates for repeated electronic health record adoptions where upgrades undergo rapid technological improvements. The forecast used EMRAM data from 2006 to 2014 to estimate adoption levels to the year 2035.

    Results: In 2014, over 5400 hospitals completed HIMSS’ annual EMRAM survey (86%+ of total US hospitals). In 2006, the majority of the US hospitals were in EMRAM Stages 0, 1, and 2. By 2014, most hospitals had achieved Stages 3, 4, and 5. The overall technology diffusion model (ie, the Bass model) reached an adjusted R-squared of .91. The final forecast depicted differing trends for each of the EMRAM stages. In 2006, the first year of observation, peaks of Stages 0 and 1 were shown as electronic health record adoption predates HIMSS’ EMRAM. By 2007, Stage 2 reached its peak. Stage 3 reached its full height by 2011, while Stage 4 peaked by 2014. The first three stages created a graph that exhibits the expected “S-curve” for technology diffusion, with inflection point being the peak diffusion rate. This forecast indicates that Stage 5 should peak by 2019 and Stage 6 by 2026. Although this forecast extends to the year 2035, no peak was readily observed for Stage 7. Overall, most hospitals will achieve Stages 5, 6, or 7 of EMRAM by 2020; however, a considerable number of hospitals will not achieve Stage 7 by 2035.

    Conclusions: We forecasted the adoption of electronic health record capabilities from a paper-based environment (Stage 0) to an environment where only electronic information is used to document and direct care delivery (Stage 7). According to our forecasts, the majority of hospitals will not reach Stage 7 until 2035, absent major policy changes or leaps in technological capabilities. These results indicate that US hospitals are decades away from fully implementing sophisticated decision support applications and interoperability functionalities in electronic health records as defined by EMRAM’s Stage 7.

    J Med Internet Res 2018;20(8):e10458





    Technology policy in health care has profoundly affected service delivery and operational efficiencies [1,2]. The period from 2006 to 2016 saw a dramatic increase in electronic health record (EHR) adoption as well as expansion of its functionality [3]. These improvements are attributable to dual environmental pressures [4]. On one hand, the US government put policies into place that provided financial benefits to hospitals for adopting EHRs that met certain criteria [5,6]; on the other hand, internal pressures to adopt EHRs were significant as health systems sought to establish a competitive advantage through operational benefits associated with EHRs [7].

    Research in the health care field has closely linked EHR technology adoption to business and clinical outcomes [8-10]. As a result, traditional innovation diffusion analysis, when applied to health care, is complicated by the dynamics found as multiple and varied EHR functionalities are introduced over time. These dynamics represent an opportunity to explore alternative conceptual and analytic approaches to examining technology diffusion and policy interactions.

    Adoption of Electronic Health Records Among US Hospitals

    The Health Information Technology for Economic and Clinical Health (HITECH) Act [11] was signed into law with the dual aims of accelerating EHR adoption and promoting their “meaningful use” (MU) by US hospitals [12]. HITECH appropriated billions of dollars to create financial incentives for hospitals that implement EHRs, which meet certain criteria designed to have a meaningful impact on care quality and cost [13]. Hospitals had to attest to MU Stage 2 program eligibility by 2016 to qualify and participate in the reward payments schema [14].

    The impact of the HITECH Act has been evaluated in the health services literature so that policymakers can assess the extent to which their intended EHR adoption goals are being realized [15]. Indeed, the HITECH policy resulted in a rapid adoption of EHRs among nonfederal hospitals, increasing the adoption rate from 9.4% in 2008 to 83.8% in 2015 [3]. However, the EHR adoption rates were not equally distributed among all types of hospitals (eg, rural vs urban hospitals) [16], and certain functionalities were adopted earlier than others (eg, MU-mandated functions vs more advanced functions) [17,18].

    Challenges With Using Meaningful Use Data to Assess Electronic Health Record Adoption

    In the research literature that focuses on EHR technology adoption, analyses frequently rely on MU data for measuring current use percentages in a binary fashion [3]. In particular, the extant literature on EHR adoption has focused on the transition from paper to electronic data collection or the adoption of a specific function within an EHR [19]. As the adoption of a basic EHR became commonplace, researchers began to frame EHR adoption in terms of its ability to support specific tasks (eg, integrating clinical decision support [CDS] into clinical workflow; automating the collection of patient-reported outcomes; capturing high-quality data for clinical trials; and integrating population health management efforts) [20-26].

    Concurrently, hospital planners adopted maturity models that sought to frame EHR implementation as a journey rather than an endpoint. The Healthcare Information and Management Systems Society (HIMSS) Analytics’ Electronic Medical Record Adoption Model (EMRAM) [27] was developed by information technology (IT) and care delivery experts based on the observation that best practices in the industry were path dependent [28,29]. The EMRAM model identifies technological waypoints along an organization’s adaptation journey that are sequential, specific, and measurable [27,28]. For example, closed-loop medical administration requires that decision support software be implemented prior to installing bar code readers that match patients to the prescription drugs they are receiving (ie, need for one level of technology before another level can be adopted as required and measured by the EMRAM model).

    Using Diffusion of Innovation Models to Predict Electronic Health Record Maturation

    Diffusion of innovation model produces “technology sophistication forecasts” that predict the degree to which a market or sector has and will adopt sequentially higher levels of functionality in the near future [29,30]. The diffusion of innovation literature and associated methods are critical to understanding and prediction of adoption dynamics. Taken together, these methodological approaches and conceptual frameworks offer a foundation upon which researchers can study the diffusion of innovation in cases where the supporting infrastructure is not replaced, a frequent condition of the Bass model [31]. Furthermore, IT platforms such as EHRs, one where the hardware requirements become secondary to the software innovation, represent a new domain for modeling adoption dynamics using common diffusion models [32].

    The purpose of this study was to explore when hospitals will achieve critical EHR functionality. HIMSS Analytics’ EMRAM data and Bass diffusion models were used to assess current EHR capability levels and forecast future diffusion of EHR functionality levels.



    In this study, we explored US hospitals’ EHR technology adoption and implementation patterns accounting for functionality and application upgrades. We used the HIMSS EMRAM data to observe the granular change or progression of EHR functionality among hospitals. The same dataset was used to train the Bass diffusion model and then predict the EMRAM score (ie, the level of EHR functionality) for each hospital. The forecasted scores were aggregated across all hospitals within each future year to depict a national picture of EHR functionality improvements until 2035. We assumed no change in future policies that would affect health IT efforts or EHR functionality (eg, no new MU incentives). Similarly, no dramatic advancement in the technology itself is modeled (eg, effective Natural Language Processing or Artificial Intelligence) as such innovations would change the diffusion curves.

    Data Sources

    We used the HIMSS Analytics’ EMRAM data since it provides an MU-comparable EHR adoption measure that takes a more granular approach to assessing functionality uptake (Table 1) [27]. EMRAM data are collected annually across all participating hospitals and are made publically available to interested researchers. HIMSS promulgates its “Annual Study,” which is designed to capture a realistic portrait of the hospital’s IT landscape. The data are submitted via a Web-based portal, phone, or spreadsheets [27]. Given the benchmarking value of these reports, a growing number of hospitals have participated in EMRAM’s Annual Study since 2006. In 2014, over 5402 hospitals (86% of total US hospitals) completed the Annual Study. See Multimedia Appendix 1 for additional details about the EMRAM model and its stages of EHR maturation.

    Theoretical Justification

    Modeling the EHR diffusion using an adaptation approach requires two components. First, the technology must track progression through the diffusion stages as set by the “Diffusion of Innovation” theorem, resulting in an “S-curve” to measure the functional form of analysis appropriately [33]. Second, the assumption that new technologies completely displace prior generations needs to be relaxed [34]. Under these two conditions, the Bass “BB-01” model is an appropriate analytic approach to evaluate the diffusion of EHR as it adheres to these requirements [35]. See Multimedia Appendix 2 for additional details of the theoretical justification of using the Bass model to forecast EHR functionality improvement among hospitals.

    Statistical Analysis

    The EMRAM data were used as the basis of BB-01 statistical analyses, with estimates calculated in Microsoft Excel using nonlinear regression estimates. Visual Basic, Solver, and the SAS Model Procedure were also used to train and estimate several parameters used by the Bass model [34,35]. The algorithms and macros are publicly available [36]. See Multimedia Appendix 2 for additional details of algorithms used to train the model and predict EHR functionality adoption rates (ie, aggregated EMRAM scores).

    Table 1. Summary of Electronic Medical Record Adoption Model (EMRAM) stages.
    View this table


    Study Populations and Base Adoption Rates

    On average, approximately 5200 hospitals were represented in the EMRAM data across the years studied (2006-2014). The percentage of hospitals achieving various EMRAM stages varied across years (Figure 1). More than 96% of hospitals were identified to be in Stage 3 or below in 2006, while this number decreased to approximately 31% in 2014. Less than 4% of hospitals were in Stage 4 or higher in 2004, while this number dramatically increased across the consequent years: ~6% in 2008, ~20% in 2010, ~38% in 2012, and ~68% in 2014.

    Model Performance

    The overall model produced an adjusted R-squared of .91, suggesting a high model fit. Table 2 provides the estimates for the external motivation coefficient (p) and internal motivation coefficient (q) used in the final model (see Multimedia Appendix 2 for additional details). The two motivation coefficients show trends moving in opposite directions. For the earlier stages (ie, EMRAM Stages 1-3), the external influence is the primary motivation for EHR adoption. Starting with Stage 3, the internal influence metric begins to play a more impactful role, and eventually, it becomes the more important factor for EHR functionality adoption in Stages 4 and 5. Given the small number of hospitals that have achieved Stage 6 or 7, interpretation of the motivation coefficients was not undertaken for these stages.

    Electronic Health Record Maturation Forecast

    The forecast used EMRAM data from 2006 to 2014 to estimate adoption levels to the year 2035. Table 3 offers a high-level snapshot of the forecasted EHR functionality progression from 2006 to 2035.

    Figure 1 depicts the forecasted EHR functionality (ie, EMRAM stages) among US hospitals, assuming no major policy or technological changes in the future. Stages 0 and 1 seem to reach their peaks in the first year of observation as the use of EHRs predates 2006 (when HIMSS began to collect adoption data). By 2007, Stage 2 reaches its peak as well. Stage 3 reaches its peak by 2011, while Stage 4 reaches its peak in 2014. The first three stages create a graph that exhibits an “S-curve,” with inflection point being the peak diffusion rate. Assuming current diffusion trajectories, the forecast predicts that Stage 5 will reach its peak by the year 2019 and Stage 6 by the year 2026. Although this forecast extends to the year 2035, no peak was readily observed for Stage 7. A considerable number of hospitals (800+) will stall their EHR adoption at Stage 5, while a higher number of hospitals (2200+) will remain in Stage 6 over an expanded period of time until 2035 (Figure 2).

    Figure 3 depicts the cumulative volume of hospitals adopting EHRs with higher levels of functionality over the forecasted years. The cumulative volume of hospitals in Stage 4 is constant between the years 2010 and 2014; however, the volume of Stage 5 continues to grow. This is a clear indication of leapfrogging, suggesting that adopters either skipped Stage 4 or moved concomitantly with technology adoption for both Stages 4 and 5. Based on the analysis, most hospitals will be focused on the higher stages (Stages 5, 6, and 7) by the year 2025. It is also clear that Stage 7 will not reach a maximum or plateau by the end of the forecast window (Figure 3).

    Figure 1. Historical Electronic Medical Record Adoption Model stages among US hospitals from 2006 to 2014.
    View this figure
    Table 2. Parameter estimation and model performance.
    View this table
    Table 3. Electronic Health Record (EHR) adoption milestones based on Electronic Medical Record Adoption Model stages.
    View this table
    Figure 2. Electronic health record functionality-level adoption among US hospitals using the Electronic Medical Record Adoption Model maturation stages (2014-2035 years are forecasted using the Bass model; vertical-axis represents the number of hospitals).
    View this figure
    Figure 3. Cumulative electronic health record functionality-level adoption among US hospitals using the Electronic Medical Record Adoption Model maturation stages (2014-2035 years are forecasted using the Bass model; vertical-axis represents the cumulative number of hospitals).
    View this figure


    Principal Findings

    EHR is a technology platform that allows for the integration of both hardware and software applications designed to improve care quality and increase operational efficiency. To those ends, the United States has introduced policies designed to promote EHRs’ increasingly sophisticated functions. EHRs within hospitals are a prime example of a technology that is adopted and, then, repeatedly updated. This study seeks to outline a direction for future research critical to understanding the dynamics that drive EHR innovation among US hospitals.

    We utilized the HIMSS Analytic EMRAM data to assess the EHR functionality levels retrospectively and train the Bass model of diffusion to forecast the adoption of new EHR functionality among US hospitals for the next two decades. The Bass model generated a good explanatory power, and the external and internal influence coefficients mapped closely to the existing regulatory environment. The forecast estimates were also consistent with other literature.

    The findings can be evaluated and interpreted in two temporal categories: the retrospective pattern of EHR functionalities identified among the hospitals and the forecasted adoption pattern of EHR functionalities prospectively.

    Retrospective Diffusion Pattern of Electronic Health Record Functionalities (2006-2016)

    Given that EHRs had been discussed at the national level for decades before 2006, having Stage-2 as the most prevalent stage in that year is reasonable; however, it is interesting to note that the curve for Stage 1 never exceeded the curve for Stage 0. This phenomenon is the hallmark of leapfrogging and suggests that hospitals moved from Stage 0 directly to Stage 2 or Stage 3 (ie, hospitals adopted multiple generations of functionalities simultaneously rather than adapting them in separate phases). There are two potential explanations for the simultaneous, multistage adoption in the lower EMRAM levels: EHR vendors integrating multiple functions upfront and hospitals being overtly motivated by external factors (eg, MU incentives).

    First, EHR vendors may have introduced multiple functions at once. As part of the MU program, the US government introduced an EHR vendor certification regime [37]. Its purpose was to assure hospitals that the EHR platforms would be capable of accommodating future innovations that were likely to be made mandatory features. All of the functionalities and clinical applications delineated in the HIMSS Analytics’ EMRAM Stages 1 through 3 were required components in order for an EHR vendor to be successfully certified [38].

    Second, hospitals may have wanted to move through the early stages quickly (Table 2). Considering that the external motivation measures for EMRAM Stages 1 through 3 (ie, p-coefficient: Stage 1 = .234; Stage 2 = .680; and Stage 3 = .255; Table 2) were higher than the internal motivation measures (ie, q-coefficient: Stage 1 = .000; Stage 2 = .000; and Stage 3 = .120; Table 2), the federal government’s MU rewards appeared to have played a significant role in accelerating EHR diffusion. Many hospitals and health systems were incentivized to purchase all or most of the required EHR functionalities from a single vendor rather than having to acquire them separately and in multiple phases [39-41]. This strategy made it possible for hospitals to complete multiple levels at once, allowing them to collect the reward payments in a shorter period [7].

    Additionally, hospitals with more recent EHR adoptions may have taken a simultaneous, multistage form in that product vendors began bundling functionalities and clinical capabilities together in a more holistic fashion [41,42]. Similar patterns have occurred in other technologies such as personal computers or mobile phones. Originally, personal computers were sold with little more than an operating system. Consumers had to buy software programs (eg, internet browsers) to be able to use the machine. Later, personal computers came with many preinstalled applications so that consumers could start using their new machines “out-of-the-box.” The net effect is that state-of-the-art information platforms’ minimum feature sets encompass multiple generations of earlier innovations as a technology matures. It is likely that EHR vendors followed a similar pattern of increased technological sophistication as a matter of normal business prior to 2006 [43].

    Prospective Diffusion Pattern of Electronic Health Record Functionalities (2016-2035)

    The government’s MU program did not provide rewards or incentives for the later EMRAM stages (ie, Stages 4 through 7). As a result, one of the previously noted major external motivations for adopting higher EHR functionalities was not in play. The BB-01 model effectively controls for this change in motivational factors, suggesting that internal motivation measures play a significantly large role in EHR functionality and clinical application adoption (Table 2). This can be interpreted as hospitals reaching the later EMRAM stages because they are “mission driven” (ie, internally motivated) to adopt the more sophisticated functionalities into their EHR platforms.

    The lack of additional EHR incentives in this period will potentially cause internal factors to become the main driver for hospitals to adopt new EHR features. In this scenario, hospitals should observe the imminent need to request and adopt new EHR functionalities to achieve their higher-order goals (eg, quality improvement). For example, EMRAM’s Stage 6 of EHR maturation requires the full adoption of CDS systems across the entire health care system for a variety of clinical practice guidelines. However, if the desired outcomes of a health system, either cost or clinical outcomes, are not aligned with such decision support enhancements in the underlying EHR platform, the hospitals may not have the internal pressure or desire to adopt the new EHR functionalities. Indeed, a complex series of internal factors may disincentivize such progression through EHR functionalities, specifically in a volatile health care market (eg, the cost of aggregating data and embedding a full array of CDS in clinical workflow may outpace the immediate benefits for the hospital). Hence, a considerable number of hospitals are forecasted not to reach Stage 6 by 2035 (Figures 2 and 3). In such a context, EMRAM’s Stage 7 requirements can be harder to achieve as it further pushes the tradeoff between internal factors and expected outcomes by introducing more sophisticated EHR functionalities such as centralized data warehouses that can be readily used for analytical purposes as well as fully interoperable EHRs across hospitals (Table 1; see Multimedia Appendix 1).

    Stage 7 of EMRAM requires the development of EHR-derived centralized data warehouses along with extensive analytic infrastructure by hospitals. Although the need for data analytics has grown tremendously among health care providers over the last decade [44], the value of such efforts is not clear for all types of hospitals [17]. On one end of this spectrum, academic medical centers and integrated or value-based delivery systems have realized the need for advanced analytics to push forward with their academic research agenda and quality improvement efforts, hence, accepting or planning for the development of centralized EHR-derived data warehouses. However, on the other end of this spectrum, with fewer internal incentives, smaller critical access and rural or community hospitals may not see the added value of investment in developing complex and often expensive EHR-derived data warehouses, unless the EHR vendors offer it as part of their basic or routine updates without additional charges (eg, EHR vendors attempting to keep their market share). The lack of immediate need for advanced EHR-derived analytics should be further investigated as a potential factor in impeding the attainment of EMRAM’s Stage 7 among underresourced hospitals.

    Another major milestone of EMRAM’s Stage 7 for EHR maturation is the interoperability of EHRs among health care providers as well as integration of EHRs with local and regional health information exchanges (Table 1). The challenge of achieving wide interoperability in the health care sector, including hospitals, is a well-known fact, and a variety of causes have been studied (eg, lack of clear guidelines in the MU program) [7,45]. The federal government has extensively persuaded health care providers to adopt interoperability by providing roadmaps and facilitating the development and adoption of new information exchange standards [46]; however, hospital-based EHRs are still largely not interoperable with other settings [45,47,48]. Not reaching Stage 7 of EHR maturity by 2035 is concerning as the continued lack of interoperability may adversely affect patient safety, clinical outcomes, and population health management efforts [48,49]. Future studies should investigate and measure the levels of EHR interoperability among US hospitals and attempt to identify internal and external factors that may impede them from reaching—or drive them to reach—the highest EMRAM score. In addition, hospitals have varying level of capital assets, resources, and IT-driven mindsets that may lead to different adoption patterns of EHR functionalities. Future research should also investigate and discover EHR maturation patterns that are unique to specific hospital groups.



    Bass model [35] has been used to forecast technology diffusion in a variety of scientific domains [50-52]. The model positions the adoption of technology as either focused on consumers’ replacement of existing products or the adoption of a new technology [34,53]. Furthermore, the more recent Bass “BB-01 Generations” analytic framework, which was used in this study, can be used to model the technological diffusion rates for repeated adoptions where customers upgrade a product as it undergoes rapid technological improvements [35]. However, similar to other simulation studies, the theoretical limits of the Bass model also limit the validity of the results and, consequently, the generalizability of the study [54].


    We assumed no change in future policies or external factors that may affect EHR functionality advancements or health IT adoption generally (eg, no new MU incentives; stable EHR market for hospital settings) [55]. New health IT policies may change the adoption rate of new EHR functionalities, specifically when incentives are directed for hospitals that are predicted to not achieve the higher stages of EHR maturation [43,56]. Therefore, the findings of this study should be interpreted within the limits of these assumptions and should be updated regularly when new EMRAM data becomes available after the roll out of such policies (eg, Centers for Medicare and Medicaid policies) [57]. Nonetheless, the likelihood of an exogenous factor supporting and reinforcing the adoption of advanced EHR functions is higher than that of a factor demoting the adoption of such functions (eg, more affordable IT infrastructure such as cloud-based EHRs).

    Data Source

    EMRAM does not include EHR adoption data for 2004 and 2005 when health IT policies started to take effect [7]. As this study used data starting in 2006, we could not observe some of the early dynamics that were derived from policies enacted before 2006. Furthermore, this study relies on the definitions and order of stages as defined by HIMSS Analytics in EMRAM (Table 1). Future studies can explore the impact on EHR functionality forecasts if some of these stages were collapsed into fewer categories, if external datasets are merged and used (eg, American Hospital Association’s IT survey) [58], or if new methods are applied to break down the challenges of adopting EHRs into more refined internal or external factors [18].


    This study only focuses on inpatient hospital settings and excludes the potential effect of EHR adoption trends in outpatient setting on hospitals. Future studies should investigate the interaction regarding adopting new EHR functionalities between inpatient and outpatient settings [59] (eg, hospitals joining a value-based network may require adopting new EHR functionalities such as higher interoperability with other participating health care providers).


    This study sought to examine when more advanced features of EHRs will be adopted by US hospitals. Using the HIMSS EMRAM data and Bass diffusion models, we were able to forecast the adoption of EHR capabilities from a paper-based environment (Stage 0) to an environment where only electronic information is used to document and direct care delivery (Stage 7). According to the forecast, the majority of hospitals will not reach Stage 7 of EHR maturity by 2035, given that there are no major policy changes.


    We acknowledge the support of the Healthcare Information and Management Systems Society (HIMSS) in providing the research team with the EMRAM data.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    HIMSS Analytics’ Electronic Medical Record Adoption Model Stages.

    PDF File (Adobe PDF File), 48KB

    Multimedia Appendix 2

    Evolution of the diffusion model.

    PDF File (Adobe PDF File), 60KB


    1. Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, et al. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med 2006 May 16;144(10):742-752. [Medline]
    2. Thune T, Mina A. Hospitals as innovators in the health-care system: A literature review and research agenda. Research Policy 2016 Oct;45(8):1545-1557. [CrossRef]
    3. Henry J, Pylypchuk Y, Searcy T, Patel V. The Office of the National Coordinator for Health Information Technology. 2016 May. Adoption of Electronic Health Record Systems among U.S. Non-Federal Acute Care Hospitals: 2008-2015   URL: https:/​/dashboard.​​evaluations/​data-briefs/​non-federal-acute-care-hospital-ehr-adoption-2008-2015.​php [accessed 2018-03-20] [WebCite Cache]
    4. Geels FW, Schot J. Typology of sociotechnical transition pathways. Research Policy 2007 Apr;36(3):399-417. [CrossRef]
    5. Blind K, Petersen SS, Riillo CA. The impact of standards and regulation on innovation in uncertain markets. Research Policy 2017 Feb;46(1):249-264. [CrossRef]
    6. Werfel SH, Jaffe AB. Induced innovation and technology trajectory: Evidence from smoking cessation products. Research Policy 2013 Feb;42(1):15-22. [CrossRef]
    7. Jones SS, Rudin RS, Perry T, Shekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med 2014 Jan 7;160(1):48-54. [CrossRef] [Medline]
    8. Ashraf S, Moore C, Gupta V, Chowdhury A, Azad AK, Singh N, et al. Overview of a multi-stakeholder dialogue around Shared Services for Health: the Digital Health Opportunity in Bangladesh. Health Res Policy Syst 2015 Dec 09;13:74 [FREE Full text] [CrossRef] [Medline]
    9. Black AD, Car J, Pagliari C, Anandan C, Cresswell K, Bokun T, et al. The impact of eHealth on the quality and safety of health care: a systematic overview. PLoS Med 2011 Jan;8(1):e1000387 [FREE Full text] [CrossRef] [Medline]
    10. García-Romero A, Escribano Á, Tribó JA. The impact of health research on length of stay in Spanish public hospitals. Research Policy 2017 Apr;46(3):591-604. [CrossRef]
    11. US Department of Health and Human Services. Health Information Technology for Economic and Clinical Health (HITECH) Act, Title XIII of Division A and Title IV of Division B of the American Recovery and Reinvestment Act of 2009 (ARRA). 2009.   URL: https:/​/www.​​sites/​default/​files/​ocr/​privacy/​hipaa/​understanding/​coveredentities/​hitechact.​pdf [accessed 2018-07-18] [WebCite Cache]
    12. Maxson E, Jain S, Kendall M, Mostashari F, Blumenthal D. The regional extension center program: helping physicians meaningfully use health information technology. Ann Intern Med 2010 Nov 16;153(10):666-670. [CrossRef] [Medline]
    13. Buntin MB, Burke MF, Hoaglin MC, Blumenthal D. The benefits of health information technology: a review of the recent literature shows predominantly positive results. Health Aff (Millwood) 2011 Mar;30(3):464-471 [FREE Full text] [CrossRef] [Medline]
    14. Office of the National Coordinator for Health Information Technology (ONC)‚ Department of Health and Human Services. Health information technology: standards, implementation specifications, and certification criteria for electronic health record technology, 2014 edition; revisions to the permanent certification program for health information technology. Final rule. Fed Regist 2012 Sep 04;77(171):54163-54292 [FREE Full text] [Medline]
    15. Millenson ML. The long wait for medical excellence. Health Aff (Millwood) 2013 Oct;32(10):1757-1760. [CrossRef] [Medline]
    16. DesRoches CM, Worzala C, Joshi MS, Kralovec PD, Jha AK. Small, nonteaching, and rural hospitals continue to be slow in adopting electronic health record systems. Health Aff (Millwood) 2012 May;31(5):1092-1099 [FREE Full text] [CrossRef] [Medline]
    17. Adler-Milstein J, DesRoches CM, Kralovec P, Foster G, Worzala C, Charles D, et al. Electronic Health Record Adoption In US Hospitals: Progress Continues, But Challenges Persist. Health Aff (Millwood) 2015 Dec;34(12):2174-2180. [CrossRef] [Medline]
    18. Chan KS, Kharrazi H, Parikh MA, Ford EW. Assessing electronic health record implementation challenges using item response theory. Am J Manag Care 2016 Dec 01;22(12):e409-e415 [FREE Full text] [Medline]
    19. Holden RJ, Karsh BT. The technology acceptance model: its past and its future in health care. J Biomed Inform 2010 Feb;43(1):159-172 [FREE Full text] [CrossRef] [Medline]
    20. Bae J, Huerta TR, Ford EW. Cardiovascular disease documentation and counseling in electronic medical records. Prev Med 2016 Jul;88:27-32. [CrossRef] [Medline]
    21. Fiks AG, Grundmeier RW, Mayne S, Song L, Feemster K, Karavite D, et al. Effectiveness of decision support for families, clinicians, or both on HPV vaccine receipt. Pediatrics 2013 Jun;131(6):1114-1124 [FREE Full text] [CrossRef] [Medline]
    22. Bae J, Ford EW, Kharrazi HHK, Huerta TR. Electronic medical record reminders and smoking cessation activities in primary care. Addict Behav 2018 Feb;77:203-209. [CrossRef] [Medline]
    23. Wu AW, Kharrazi H, Boulware LE, Snyder CF. Measure once, cut twice--adding patient-reported outcome measures to the electronic health record for comparative effectiveness research. J Clin Epidemiol 2013 Aug;66(8 Suppl):S12-S20 [FREE Full text] [CrossRef] [Medline]
    24. Kharrazi H, Chi W, Chang HY, Richards TM, Gallagher JM, Knudson SM, et al. Comparing Population-based Risk-stratification Model Performance Using Demographic, Diagnosis and Medication Data Extracted From Outpatient Electronic Health Records Versus Administrative Claims. Med Care 2017 Aug;55(8):789-796. [CrossRef] [Medline]
    25. Kharrazi H, Weiner JP. IT-enabled Community Health Interventions: Challenges, Opportunities, and Future Directions. EGEMS (Wash DC) 2014;2(3):1117 [FREE Full text] [CrossRef] [Medline]
    26. Kharrazi H, Wang C, Scharfstein D. Prospective EHR-based clinical trials: the challenge of missing data. J Gen Intern Med 2014 Jul;29(7):976-978 [FREE Full text] [CrossRef] [Medline]
    27. The Healthcare Information and Management Systems Society (US). 2015. ELECTRONIC MEDICAL RECORD ADOPTION MODEL: HIMSS Analytics EMR Adoption Model (EMRAM)   URL: [accessed 2018-03-20] [WebCite Cache]
    28. Chen C, Hsu C, Worley J. Evaluation systems of the electronic medical records: a comparative study. Paper presented at 2013 IEEE 4th International Conference on Software Engineering and Service Science; Beijing, China 2013:558-564 [FREE Full text] [CrossRef]
    29. Vergne J, Durand R. The path of most persistence: An evolutionary perspective on path dependence and dynamic capabilities. Organization Studies 2011 Mar 24;32(3):365-382. [CrossRef]
    30. Sood A, James GM, Tellis GJ, Zhu J. Predicting the path of technological innovation: SAW vs. Moore, Bass, Gompertz, and Kryder. Marketing Science 2012 Nov;31(6):873-1025. [CrossRef]
    31. Hauser J, Tellis GJ, Griffin A. Research on innovation: a review and agenda for marketing science. Marketing Science 2006 Nov;25(6):687-717. [CrossRef]
    32. Jiang B, Jerath K, Srinivasan K. Firm strategies in the “mid tail” of platform-based retailing. Marketing Science 2011 Sep;30(5):757-994. [CrossRef]
    33. Rogers EM. Diffusion of Innovations, 5th Edition. New York: Free Press; 2003.
    34. Bass FM. A New Product Growth for Model Consumer Durables. Management Science 2004 Dec;50(12_supplement):1763-1893. [CrossRef]
    35. Bass P, Bass F. Diffusion of technology generations: A model of adoption and repeat sales. 2001.   URL: [accessed 2018-07-18] [WebCite Cache]
    36. Bass's BRI. Available at. The Bass Model   URL: [accessed 2018-07-18] [WebCite Cache]
    37. D'Amore JD, Mandel JC, Kreda DA, Swain A, Koromia GA, Sundareswaran S, et al. Are Meaningful Use Stage 2 certified EHRs ready for interoperability? Findings from the SMART C-CDA Collaborative. J Am Med Inform Assoc 2014;21(6):1060-1068 [FREE Full text] [CrossRef] [Medline]
    38. Krist AH, Beasley JW, Crosson JC, Kibbe DC, Klinkman MS, Lehmann CU, et al. Electronic health record functionality needed to better support primary care. J Am Med Inform Assoc 2014;21(5):764-771. [CrossRef] [Medline]
    39. Gardner E. Big bang. Small hospital tackles big HIS project. Health Data Manag 2010 Feb;18(2):56-59. [Medline]
    40. Huerta TR, Thompson MA, Ford EW, Ford WF. Implementing electronic lab order entry management in hospitals: Incremental strategies lead to better productivity outcomes. International Journal of Information Management 2013 Feb;33(1):40-47. [CrossRef]
    41. Ford EW, Menachemi N, Huerta TR, Yu F. Hospital IT adoption strategies associated with implementation success: implications for achieving meaningful use. J Healthc Manag 2010;55(3):175-188; discussion 188. [Medline]
    42. Nelson RR, Buterbaugh K, Perl M, Gelijns AC. How medical know-how progresses. Research Policy 2011 Dec;40(10):1339-1344. [CrossRef]
    43. Barrett AK. Electronic Health Record (EHR) Organizational Change: Explaining Resistance Through Profession, Organizational Experience, and EHR Communication Quality. Health Commun 2018 Apr;33(4):496-506. [CrossRef] [Medline]
    44. Brennan PF, Chiang MF, Ohno-Machado L. Biomedical informatics and data science: evolving fields with significant overlap. J Am Med Inform Assoc 2018 Jan 01;25(1):2-3. [CrossRef] [Medline]
    45. Adler-Milstein J, Embi PJ, Middleton B, Sarkar IN, Smith J. Crossing the health IT chasm: considerations and policy recommendations to overcome current challenges and enable value-based care. J Am Med Inform Assoc 2017 Sep 01;24(5):1036-1043. [CrossRef] [Medline]
    46. The OOTNCFHIT. The Office of the National Coordinator for Health Information Technology (ONC). Connecting health and care for the nation: a shared nationwide interoperability roadmap   URL: https:/​/www.​​sites/​default/​files/​hie-interoperability/​nationwide-interoperability-roadmap-final-version-1.​0.​pdf [WebCite Cache]
    47. Swain M, Charles D, Patel V, Searcy T. ONC Data Brief. 2015 Apr. Health Information Exchange among U.S. Non-federal Acute Care Hospitals: 2008-2014   URL: [accessed 2018-03-20] [WebCite Cache]
    48. Samarath A, Sorace J, Patel V, Boone E, Kemper N, Rafiqi F, Yencha R, Kharrazi H. 2016. Measurement of interoperable electronic health care records utilization   URL: [accessed 2018-06-18] [WebCite Cache]
    49. Kharrazi H, Lasser EC, Yasnoff WA, Loonsk J, Advani A, Lehmann HP, et al. A proposed national research and development agenda for population health informatics: summary recommendations from a national expert workshop. J Am Med Inform Assoc 2017 Jan;24(1):2-12 [FREE Full text] [CrossRef] [Medline]
    50. Easingwood CJ, Mahajan V, Muller E. A nonuniform influence innovation diffusion model of new product acceptance. Marketing Science 1983 Aug;2(3):203-317. [CrossRef]
    51. Bawa K, Shoemaker R. The effects of free sample promotions on incremental brand sales. Marketing Science 2004 Aug;23(3):275-467. [CrossRef]
    52. Manchanda P, Xie Y, Youn N. The role of targeted communication and contagion in product adoption. Marketing Science 2008 Nov;27(6):949-1136. [CrossRef]
    53. Sillup GP. Forecasting the adoption of new medical technology using the Bass model. J Health Care Mark 1992 Dec;12(4):42-51. [Medline]
    54. Norton JA, Bass FM. A diffusion theory model of adoption and substitution for successive generations of high-technology products. Management Science 1987 Sep;33(9):1069-1207. [CrossRef]
    55. Butler M. Journal of AHIMA. CMS to end Meaningful Use in 2016   URL: [accessed 2018-03-20] [WebCite Cache]
    56. Heath ML. IT cultural conflict, trust belief in IT artifacts, and user involvement: conceptual study of Meaningful Use resistance. In: MWAIS 2015 Proceedings. 2015 Presented at: The Midwest United States Association for Information Systems; 2015; Pittsburg, KS   URL:
    57. Centers for Medicare and Medicaid Services. MACRA: Delivery system reform, Medicare payment reform.   URL: https:/​/www.​​medicare/​quality-initiatives-patient-assessment-instruments/​value-based-programs/​macra-mips-and-apms/​macra-mips-and-apms.​html [accessed 2018-07-18] [WebCite Cache]
    58. American Hospital Association. AHA Data Products   URL: [accessed 2018-03-20] [WebCite Cache]
    59. Sholler D. Resistance to mandatory technology use - the case of EMR in the United States healthcare industry. In: MCIS 2016 Proceedings. 2016 Presented at: Mediterranean Conference on Information Systems; 2016; Paphos, Cyprus   URL:


    CDR: clinical data repository
    CDS: clinical decision support
    EHR: electronic health record
    EMRAM: Electronic Medical Record Adoption Model
    HIMSS: Healthcare Information and Management Systems Society
    IT: information technology
    MU: Meaningful Use
    PACS: picture archive and communication systems

    Edited by G Eysenbach; submitted 20.03.18; peer-reviewed by C Jung, K Ford-Eickhoff; comments to author 23.05.18; revised version received 01.06.18; accepted 16.06.18; published 07.08.18

    ©Hadi Kharrazi, Claudia P Gonzalez, Kevin B Lowe, Timothy R Huerta, Eric W Ford. Originally published in the Journal of Medical Internet Research (, 07.08.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.