Background: The potential of blockchain technology to achieve strategic goals, such as value-based care, is increasingly being recognized by both researchers and practitioners. However, current research and practices lack comprehensive approaches for evaluating the benefits of blockchain applications.
Objective: The goal of this study was to develop a framework for holistically assessing the performance of blockchain initiatives in providing value-based care by extending the existing balanced scorecard (BSC) evaluation framework.
Methods: Based on a review of the literature on value-based health care, blockchain technology, and methods for evaluating initiatives in disruptive technologies, we propose an extended BSC method for holistically evaluating blockchain applications in the provision of value-based health care. The proposed method extends the BSC framework, which has been extensively used to measure both financial and nonfinancial performance of organizations. The usefulness of our proposed framework is further demonstrated via a case study.
Results: We describe the extended BSC framework, which includes five perspectives (both financial and nonfinancial) from which to assess the appropriateness and performance of blockchain initiatives in the health care domain.
Conclusions: The proposed framework moves us toward a holistic evaluation of both the financial and nonfinancial benefits of blockchain initiatives in the context of value-based care and its provision.
The health care sector has recently been focused on two related challenges: the transition to value-based care and the use of innovative technologies (such as blockchain technology) to facilitate the delivery of health care. The transition to value-based care, which aims to improve the value of care while providing it at a lower cost, places new demands on health care information systems (IS)  that current health information technology infrastructure is not designed to support [ ]. Adler-Milstein et al [ ] identified three major stakeholder groups that must be supported in achieving value-based care: patients, providers, and researchers. Disruptive technologies such as blockchain offer the potential to support these currently inadequately supported stakeholder groups with Health Information Technology (IT) infrastructure.
Blockchain technology, widely celebrated as a technological revolution, is creating unprecedented hype and optimism . Blockchain is a distributed database that maintains a continuously growing list of data records that are secured from tampering and revision [ , ]. A global survey documents the widespread application of blockchain in domains such as health care, manufacturing, legal, government, not for profit, retail, real estate, tourism, and media [ ]. The potential of this technology to aid organizations in achieving strategic goals like value-based care is increasingly being recognized by health care providers and other stakeholders (eg, payers, shareholders, accreditation agencies) [ ]. However, Iansiti and Lakhani [ ] note that practitioners are uncertain about the impact that disruptive technologies such as blockchain might have on organizational performance. Current research and practice lack comprehensive approaches to evaluating the benefits of blockchain and developing appropriate use cases of blockchain applications for value-based care [ ].
As IT is increasingly becoming a strategic necessity for improving services and reducing medical errors , comprehensive approaches to evaluating the appropriateness and value of disruptive technologies such as blockchain are needed. An evaluation approach should facilitate the assessment of both technical and nontechnical (eg, legal, data ownership and privacy, security) implications. To address this need, we assessed two sets of existing evaluation frameworks: technology evaluation methods (the Zachman framework, human-computer interaction [HCI] guidelines, and the technology-centric framework) and comprehensive evaluation methods (total quality management [TQM], the European foundation quality management excellence model (EFQMEM), the performance pyramid, and the performance prism). Based on this assessment, we identified deficiencies in the existing evaluation methods and subsequently developed an approach that extends the balanced scorecard (BSC) framework that addresses these deficiencies.
The BSC, developed by Robert Kaplan and David Norton nearly two decades ago , provides organizations with a structured approach to assessing both the financial and nonfinancial dimensions of organizational initiatives and processes in terms of strategic outcomes. Beyond the purely accounting-based measures traditionally used, the BSC is balanced in that it provides a comprehensive view of organizational performance. It translates high-level organizational vision and strategy into a holistic set of performance and action measures [ ]. The BSC is a practical method that is applicable within the health care service sector and health care organizations, and it has previously been used to assess clinical outcomes, for example [ ]. However, it has not yet been used to evaluate disruptive innovations, such as blockchain, that can improve patient care and reduce costs but that have regulatory, financial, and operational implications.
A myriad of seemingly promising blockchain projects are being implemented in the health care domain, often without careful consideration of the applicability of the technology . Moreover, questions still linger for early adopters of this technology: “How does an organization holistically assess the performance of blockchain technology in the health care domain?” and “Does the introduction of blockchain technology align with the strategic priorities of a health care organization?”. Answering these questions is critical for health care organizations to achieve the health care IT mission identified by the US federal government, namely: "Improve the health and well-being of individuals and communities through the use of technology and health information that is accessible when and where it matters most" [ ].
We sought to answer the above questions through our assessment of existing evaluation frameworks and the development of a new framework that can guide the comprehensive evaluation of the value of blockchain initiatives that seek to enable the delivery of value-based care.
In the sections below, we first discuss the relevant literature on value-based health care and blockchain technology. We then assess existing evaluation frameworks and present our framework, which extends the BSC by addressing some of its limitations. Further, we customize the framework to the context of blockchain applications in health care settings. We then present an illustrative case study on the application of the framework in a pharmaceutical supply chain organization. Finally, we discuss the implications of our framework for both researchers and practitioners.
Information Technology Support for Transitioning to Value-Based Health Care
Health care value, defined as health outcomes (including quality of care achieved per dollar spent), has become a cornerstone of the strategy to restructure the US health care system [- ]. One of the proposed frameworks for improving health care value is the value-based care model [ ]. Value-based care attempts to advance the triple aim of providing better care for individuals, improving population health management strategies, and reducing health care costs. Value-based care models center on patient outcomes and how well health care providers can improve quality of care using measures such as reduced hospital readmissions, improved timeliness and safety of care, more equitable care, shared decision-making, and improved preventative care [ ]. This model ties payments for care delivery to the quality of care provided, and rewards providers for both efficiency and effectiveness [ ].
Unlike more traditional approaches, value-based care is driven by data because providers must report to payers on specific metrics and demonstrate improvement. Providers are required to use IT systems to track and report metrics such as hospital readmissions, adverse events, population health, and patient engagement. Further, providers are incentivized to use evidence-based medicine, engage patients, upgrade health care IT, use data analytics, and receive payments electronically. When patients receive more coordinated, appropriate, and effective care, providers are rewarded. To achieve these goals, health care organizations need a digital infrastructure that facilitates the provision of comprehensive, affordable, accessible, effective, and error-free care.
While significant progress has been made in digitizing the US health care system, today’s health IT infrastructure largely remains a collection of systems that were not designed to support the transition to value-based care . In fact, prior literature has identified a health IT chasm, which refers to the gaps between the current health IT ecosystem (see ) and the system that is needed for value-based care [ , - ].
In fact, a recent study identified several gaps from the perspectives of three stakeholder groups. From the patient perspective, patients are unable to access electronic medical records from most providers, and most care providers do not provide functionalities for patients to submit patient-generated data. Only a small percentage of patients receive clinical trial information from their primary physician, and an even smaller percentage participate in biobanks . From the provider perspective, due to the lack of standardized application interfaces providers have difficulty accessing external data, which hinders the advanced analytics on which personalized assistance is based [ ]. In addition, manual credentialing (typically takes more than 120 days) and administration of contracts is complicated and inefficient. Further, pharmaceutical providers find it challenging to ensure the authenticity of pharmacy products due to a lack of transparency in current supply chain systems. Finally, from the researchers’ perspective, it is difficult for them to track investigational products to ensure data authenticity, and payments to investigators are delayed due to manual processing [ ]. The health IT environment is immature, provides few safeguards for safety and effectiveness, and provides very limited integration of applications used in clinical care or research.
Prior literature has also identified specific goals (eg, improving patients’ access to clinical data, improving patient’s ability to submit and access data via mobile health technology, more readily engaging patients in clinical research) for addressing the needs of each of these stakeholder groups . Blockchain technology may help achieve these goals.
Blockchain for Enabling Value-Based Care
Blockchain consists of blocks that hold batches of individual transactions. Each block contains a timestamp and a link to a previous block [, ]. The most salient benefit of blockchain is decentralization and the elimination of a trusted centralized third party in distributed applications. Thus, multiple parties can conduct transactions in a distributed environment without the need for a centralized authority, thereby avoiding a single point of both trust and failure. The absence of a centralized processing entity may reduce time and costs. A consensus mechanism is used to reconcile any discrepancies that may arise between participants in a blockchain network.
Iansiti and Lakhani  summarized five basic principles underlying blockchain technology: a distributed database, peer-to-peer transmission, transparency with pseudonymity, irreversibility of records, and computational logic. These unique characteristics of blockchain technology enable the development of solutions that reduce uncertainty and ambiguity and enhance security of stored transactional information by providing full transparency and a single truth for all network participants [ ]. Although blockchain technology enjoys the benefits of decentralization, it often comes at the cost of scalability. Blockchains are typically incapable of processing large numbers of transactions in a timely manner [ ]. The trustless peer-to-peer network infrastructure, which requires information to be propagated to and validated at each node, is the root of this problem. Several solutions (eg, off-chain transactions, sharding, and a provably neutral cloud) have been proposed to address this issue. For example, Leung et al proposed a design that minimizes storage, bootstrapping costs, and bandwidth costs of joining a network by 90% [ ]. Such advances are essential for blockchain to realize its disruptive potential [ ]. However, effective management of personal health records using blockchain technology still requires improvements such as reduced data size, strengthened personal information protection, and reduced operational costs [ ].
Despite its technological infancy, experimental adoption and customization of blockchain technology appears to be fully underway in the health care domain . One of the most impactful health care applications is expected to be the management of electronic health records (EHRs). The decentralization, immutability, traceability, security, and privacy of blockchain make it well suited for the storing, managing, and sharing of patient-centric data among stakeholders [ - ]. Aligning with the requirements of the European General Data Protection Regulation (GDPR), blockchain can be used to build health care platforms that empower patients to control how their data are used and ensure that sensitive personal data are not revealed without the patients’ consent [ , , ]. Guardtime [ , ], MedRec [ ], the Gem Health Network [ ], Patientory, and IBM’s Watson [ ] are some of the key projects in this ecosystem.
Another salient application domain of blockchain is supply chain management in the pharmaceutical industry. Because of the immutability and traceability of blockchain, any modification of a prescription by any party in the supply chain can be detected, which, in turn, can help address the severe problem of counterfeit medications [, , ]. In addition, in biomedical research and education, blockchain could facilitate the elimination of falsification of data or the exclusion of undesirable results from clinical trials [ ]. Benchoufi [ ] and Nugent et al [ ] illustrated the ability to trace patients’ consent and provide data transparency in clinical trials. Moreover, insurance claim processing is a promising area for blockchain applications because of its transparency, decentralization, immutability, and auditability; a few prototype implementations, such as MIStore [ ] and Politdok’s initiative partnered with Intel [ ], have been reported [ ]. Other promising areas include remote patient monitoring [ ] and precision medicine [ ].
Blockchain technology has the potential to address some of the gaps in the current health IT ecosystem, thereby supporting the three important stakeholder groups involved in value-based care . identifies these gaps and highlights what blockchain can do to address these gaps. Based on a careful study of the needs of the three stakeholder groups, we further outline in the appendix how specific characteristics of blockchain technology may help meet these needs. We also list some proof-of-concept systems that provide some of the desired functionalities.
While blockchain offers the potential to address issues (eg, interoperability, difficulty in providing optimal personalized care due to lack of comprehensive medical records, and maintaining integrity of records) that are critical for effective value-based care , there is limited research comprehensively evaluating the financial and nonfinancial benefits of blockchain solutions in health care [ ]. A review of the literature on value-based health care strongly suggests the need for a framework to holistically evaluate the impacts of technologies such as blockchain. Existing evaluation mechanisms (such as the Level of Information System interoperability reference model [ ]) have focused on the operational aspects of blockchain. Motivated by the need for a framework to guide the strategic evaluation of blockchain applications within a health care organization, we extend the BSC approach, which is an already well-established performance evaluation system. Specifically, our approach integrates financial and nonfinancial perspectives (ie, internal processes, learning and growth, external perspectives, and customer perspectives), which are parts of the original BSC, with an external perspective that incorporates the viewpoints of external stakeholders and regulators, especially because of the significant role these parties play in health care delivery. In the following section, we illustrate the use of our framework with a blockchain application for managing a pharmaceutical supply chain.
Performance Evaluation of Health Care Blockchain Implementations and the Balanced Scorecard
Traditional performance measurement systems have either focused purely on financial factors, ignoring the value of nonfinancial factors , or have focused solely on the effectiveness of the technical system without considering the external or financial implications. Health care organizations have been using economic evaluations for health care decision-making for several decades. During this period, increased pressure on health care budgets has necessitated the consideration of cost-effectiveness in addition to clinical effectiveness. Economic evaluation approaches have also been applied to other health care–related decision-making in terms of funding, reimbursement, and new technologies [ , ]. Even comprehensive evaluation approaches that include cost-consequences analysis, cost-minimization analysis, cost-effectiveness analysis, cost-utility analysis, and cost-benefit analysis [ ] are focused on financial factors and give limited consideration to nonfinancial aspects of evaluation targets. For example, Zachman’s framework [ ] evaluates business-IT alignment in detail but lacks a holistic governance framework. Similarly, the human-computer interaction [ ] and technology-centric frameworks [ ] provide insights into developing intuitive and interactive IS, but they do not focus on assessing the impact of these systems from external and financial perspectives. Additionally, the interrelationships between the various functional areas in an organization are overlooked in these frameworks. For example, a blockchain implementation in one functional area, such as improving patients’ access to their own medical records, may have major impacts in other areas, such as customer service management, internal processes for quality assurance, security checks, or external partnerships (with, say, insurance companies or pharmacies). Finally, the knowledge that results from the long-term growth of organizations or the ability to deal with future threats also needs to be factored into the performance evaluation [ ]. The BSC has dual functions as a performance framework and a management methodology, and thus can tackle the shortcomings of traditional performance measurement systems. These shortcomings include the lack of consideration of nonfinancial factors and the lack of strategic focus. Our evaluation suggests that the BSC addresses both shortcomings and is well suited for the evaluation of disruptive technologies, especially in the dynamic environment in which health care organizations operate.
Our comparison of the various performance measurement systems, as presented in, suggests that BSC is an appropriate approach for evaluating blockchain initiatives in achieving value-based care for the following reasons. We compared BSC with two sets of existing methods, namely, technology evaluation methods (the Zachman framework, HCI, and the technology-centric framework) and comprehensive performance evaluation methods (TQM, the European foundation quality management excellence model, the performance pyramid, and the performance prism) [ - ]. Technology evaluation methods typically do not provide a holistic view (such as the consideration of external or customer perspectives) and therefore are not appropriate in our setting. Among the comprehensive evaluation methods, TQM’s narrow focus on internal process is inadequate, and the European foundation quality management excellence model, designed to improve TQM, lacks a strategic focus. Although both the BSC and the performance pyramid use strategic mapping to link strategy to operational metrics, prior research suggests that the performance pyramid is less effective and harder to understand than the BSC [ ]. Moreover, although the performance prism considers stakeholders’ perspectives, it does not provide adequate guidelines and neglects to show how the proposed measures can be operationalized [ ]. Thus, our comparison of the various technical and comprehensive performance evaluation methods suggests that, among them, the BSC is the most suited to evaluate the performance of disruptive technologies (such as blockchain) in value-based care initiatives.
Organizations in multiple domains, including health care, have adopted the BSC [, ]. In increasingly dynamic business environments, traditional performance evaluation approaches may not work well due to the uncertainty involved in ascertaining both the costs and benefits of new technologies, such as blockchain. However, both theoretical research and practitioner articles support the use of the BSC for evaluating IT initiatives in such contexts. For example, Gartner [ ] notes that performance measurement solutions deployed within an organization should include a spectrum of leading measures rather than focusing on lagging financial indicators. To provide a holistic assessment, Gartner [ ] recommends using the BSC to measure return on investment (ROI) and the business value of IT services because it enables the consideration of both financial and nonfinancial perspectives and helps develop relevant metrics [ ]. Researchers also recognize the BSC framework as a holistic approach that provides managers with a structure to develop metrics that reflect performance from various perspectives [ ], hence our selection of the BSC as the basis for the development of our approach to evaluating blockchain applications.
The BSC measures the performance of organizations from the following four linked and balanced perspectives:
- Financial: How do we increase value for our shareholders (or providers of financial resources)?
- Customer: How well do we satisfy our customers’ needs?
- Internal: How well do we perform key internal operational processes? To satisfy our customers, in what processes must we excel?
- Learning and growth: Are we able to sustain innovation, change, and continual improvement? Do we have the basic infrastructure in place to improve, create, value, and achieve our mission?
Some limitations of the traditional BSC have received attention in the literature [, ]. One major concern is that the environment external to the organizations, including key groups of stakeholders, is not represented in the framework. For example, Mohobbot [ ] points out that the BSC is unable to answer questions concerning the impact of external competitors. Moreover, the BSC does not consider the extended value chain, in which supplier and employee contributions are very significant [ ]. This issue is exacerbated in the health care domain due to the complex interactions among the wide variety of organizations and stakeholders that are part of the ecosystem. For example, Norreklit [ ] identifies crucial stakeholders like public authorities and suppliers, but other external stakeholders may include insurers, physicians, hospitals, clinics, laboratories, clinical research organizations, supply chain logistics stakeholders (such as pharmaceutical manufacturers, distributors, and retailers), government and regulatory agencies, and charities. To account for the impact of external stakeholders, we extended the BSC with an additional perspective, namely the external and regulatory perspective (see ). This perspective seeks to answer the following question: "How well does the organization improve value creation through external partnerships while ensuring regulatory compliance?"
By integrating financial measures with other crucial performance indicators concerning patients, organizational learning, growth and innovation, internal processes, and external perspectives, this extended BSC framework offers health care organizations a comprehensive view of the performance of blockchain applications.
In this study we adopted a for-profit health care organization’s view, as a majority of current blockchain implementations are in for-profit organizations.
From a value-based perspective, one of the key questions health care organizations should ask is: "How do health care organizations use blockchain applications to generate more profits at lower cost?" Typically, the focus of the financial perspective in the BSC has been on traditional financial metrics such as ROI and net income. In the context of value-based health care, patient-centric metrics such as gross revenue, adjusted cost per discharge, in-patient or out-patient revenue mix, contract allowances, discounts as a percentage of operating patient revenue , patient-payer mix, Medicare or Medicaid mix, average length of stay, and occupancy rate all deserve consideration.
The auditability and traceability features of blockchain enable more secure and efficient revenue management. As it does not require an intermediary, blockchain can support health care financing tasks, such as automatic claims processing using smart contracts [, ], preauthorization of payments [ ], and alternative payment models [ ]. A distributed ledger makes claims processing and payment transactions more efficient and cost-effective. Replacing redundant health care intermediaries (namely, organizations that operate between stakeholders and institutions but that add little value to the health care value chain [ ]) with transparent blockchain technology could facilitate processes like real-time claims adjudication [ ]. With the data provenance benefits offered by blockchain, providers and patients could have enhanced accessibility to patient data. Blockchain technology can also help eliminate information asymmetry and mistrust between stakeholders in the health care ecosystem. With the innate immutability, transparency, and traceability provided by blockchain technology, medical products can be traced from manufacturer to patient, thereby reducing medication and medical equipment fraud. However, in the short-term, the adoption of blockchain technology will likely involve significant investments in application development, and their integration with legacy systems might initially undermine the financial benefit to shareholders.
Customer (Patient) Perspective
From a value-based care perspective, one of the key questions health care organizations should ask is: "How can we improve our service to customers and satisfy customer needs via blockchain applications?" Improving the performance of health care information systems that support the provision of effective and efficient care to patients is critical for achieving this goal. The patient-centric care paradigm requires the sharing of patients’ EHRs, which raises issues such as privacy, confidentiality, integrity, availability, and security . As a valuable personal asset, health care data should be owned and controlled by customers (patients) easily and securely without violating their privacy [ ]. With blockchain-supported applications such as FHIRChain and Blockchain-Based Multi-level Privacy-Preserving Location Sharing Scheme (BMPLS), which simplify data authentication and authorization, patients can control access to their medical data easily and quickly. According to a seminal paper on IS success [ ], user satisfaction is affected by information quality, system quality, and service quality. Blockchain enables health care stakeholders to access complete, relevant, and secure data on patients, thereby improving information quality. Health care organizations can overcome common challenges, such as data segregation, and achieve better integration of patients’ medical data. Blockchain supports data immutability and auditability, thereby improving service quality (eg, reliability, responsiveness, and rapport) of medical IS [ ], and as a result health care organizations can enhance their medical service quality and thereby patient satisfaction. Blockchain can help health care organizations easily integrate various elements of clinical data, which can enable medical professionals to make accurate diagnoses at low cost.
From a value-based care perspective, one of the key questions that health care organizations should ask is: "What internal processes can blockchain improve to satisfy our customers and the population in general?" Effective internal business processes are critical for providing products and services that satisfy health care organizations’ customers’ needs in a fiscally responsible manner. These effective processes can be reliable indicators of future financial and operational success . With blockchain applications, health care organizations can build time-stamped, tamper-proof, immutable ledger systems that will improve organizations’ auditing and reporting capabilities. These capabilities are crucial for identifying failures in internal processes and remedying those failures. Some benefits that accrue with improvements to internal processes include reduced length of patient stay, accuracy of services provided (both primary and ancillary), optimal surgical capacity utilization, and timeliness of services [ ].
A variety of internal processes are candidates for improvements using blockchain technology. Using smart contracts, organizations can encode internal logic (eg, validating identity and tracking the participation of various stakeholders. such as patients and health providers), which will enhance service quality. Service quality can be reflected in measures such as reductions in diagnostic errors, readmission rates, and data security incidents, all of which lower costs. Value for customers can also be improved by instituting newer internal processes, such as Hitech service (eg, digitization of wellness check in Mount Sinai’s Lab 100 ). Access to longitudinal medical charts using blockchain applications (such as those implemented in FHIRChain) can help health care organizations achieve optimal results with Hitech services, thereby enabling effective long-term care for chronic illnesses (eg, diabetes). Further, such charts can be useful in designing effective population outreach programs. Finally, using peer-to-peer network-enabled blockchain applications (eg, BMPLS), health care organizations can leverage newer mechanisms of health care delivery, such as telecare, to increase their reach, thereby improving health equity while providing care at a reduced cost.
From a value-based care perspective, one of the key questions health care organizations should ask is: "How can we leverage external partnerships to create value while ensuring regulatory compliance, thus satisfying our customers and the general population?" Creating effective partnerships with external stakeholders (eg, payers, accreditation bodies) while remaining compliant with regulations is critical for value creation. These partnerships enable health care organizations to supply products and services that satisfy customer needs in a fiscally and legally responsible manner.
Some multi-level, privacy-preserving. location-sharing blockchain applications (eg, BMPLS) enable interoperability with external systems, thereby enabling access to multi-dimensional medical charts from various stakeholders that can improve long-term medical care at a low cost. Through external partnerships, these health care organizations can seek to create value by taking a proactive role in providing care to their customers (say, by tracking customers’ lifestyle and suggesting changes). Naturally, such partnerships can enable future financial and operational success through service innovation, which can help build deeper long-term relationships with customers. Additionally, having access to multi-dimensional population health data will enable health care providers to design outreach services that benefit the community as a whole. Blockchain solutions may also include smart contracts that help meet security and privacy mandates. Further, through the standardization of smart contracts at both the provider’s and the external partner’s end, interoperability of medical systems for value creation can be achieved.
Learning and Innovation Perspective
From a value-based care perspective, one of the key questions health care organizations should ask is: "How can we use blockchain applications to improve the learning capabilities that lead to growth and innovation?" Blockchain applications can help health care organizations reassess their resources, from employee capabilities to health care delivery processes, and align them to the organization’s strategy.
Blockchain enables health care stakeholders to learn and to improve their services, thereby enhancing their competitiveness and sustainability. The systems interoperability enabled by blockchain technology can help health care professionals learn about opportunities to innovate their services. Blockchain technology also supports organizations in reassessing existing processes and resources and identifying opportunities for improvement. For example, auditability and traceability improved by blockchain can help streamline insurance claim processes and make them easier to manage. Blockchain can also significantly reduce administration costs and potentially eliminate some intermediaries that were previously needed for data integration. Aggregated health care data can help health care organizations reconfigure their procedures and innovate medical services for patients. With enhanced traceability and transparency supported by blockchain, organizations can learn how to optimize the health care supply chain.
Interrelationships Among Perspectives
The BSC does not explicitly consider the interactions and trade-offs between perspectives. In dynamic environments, correctly identifying and addressing trade-offs between perspectives can help organizations accurately evaluate the target system and develop effective incentives to improve overall organizational performance. Focusing on the financial perspective alone may motivate organizations to reduce nonfinancial investments that could produce long-term benefits. In particular, if a nonfinancial perspective has no contemporaneously congruent relationship with financial perspective, managers may reduce investments that improve performance in other areas for short-term benefits.
Our approach suggests that in addition to evaluating value-based care with respect to each perspective, health care organizations need to examine the interrelationship among the five perspectives. For example, efforts to improve the efficiency of internal processes (eg, improving quality process within a unit) with blockchain applications can help health care organizations enhance their learning capabilities (eg, creating quality management processes at the organizational level).
While developing relevant key metrics for each perspective (see) is crucial for the effective use of the BSC, it is also important to carefully examine the relationships among the perspectives to understand how focus on one affects performance in others in both the short and long term (see for some of the tradeoffs that merit consideration). The relationship is dependent on case characteristics and is therefore not conclusive. For example, as health care organizations learn how to better use blockchain applications, they can use this knowledge to improve their internal processes. Efficient and effective processes can lead to improved service quality, thereby increasing customer satisfaction and revenue in the long term. In turn, organizations can invest more resources in identifying opportunities to learn and develop blockchain applications across the various units. Similarly, an existing health care system may provide a moderate level of data protection that can be achieved with minimal investment, moderate levels of customer satisfaction, and minimal changes to internal processes and learning capabilities. When providing more secure protection of patients’ medical data becomes a top priority for compliance with external and regulatory requirements, organizations may consider adopting a blockchain solution. From the financial perspective, adopting blockchain applications may have a negative impact on organizations as it increases costs in the short term. In addition, blockchain adoption may decrease customer satisfaction in the short term until customers become familiar with the new systems and realize value through capabilities such as ease of access and control. These short-term negative impacts from the customer and on financial perspectives may delay the adoption of improvements to internal processes. In the long term, however, improvements to internal processes that are facilitated by the technology may positively affect customer satisfaction. In addition, process improvements can facilitate learning capabilities, which, in turn, positively affect internal processes and organizational finances in the long term.
Case Study: Analysis of the Proposed Extended Balanced Scorecard with a Blockchain Implementation in Health Care
What follows is a case study applying the BSC framework to the implementation of a blockchain in health care. PharmaChain Inc is a business unit that manages aviation and trucking transportation within the supply chain journey for pharmaceuticals. PharmaChain Inc prides itself on maintaining pharmaceutical supply chain industry certification to handle high-value, temperature-sensitive cargo. The highest impact of blockchain implementation is providing greater visibility and transparency, thereby ensuring the safe transportation of life-saving pharmaceuticals. Business leaders suggest that this blockchain application use case, managing aviation and trucking of pharmaceutical products from manufacturers to health care providers, serves as an example of PharmaChain Inc’s commitment to pursuing high impact innovation.
While stakeholders often have varying perspectives and goals, this use case illustrates significant benefits for two important stakeholder groups, namely, customers and providers. The varying stakeholder goals within supply chains results in operational complexity when the process is desynchronized. Blockchain technology helps standardize stakeholder interactions, contributing mutual benefit to the provider and the customer. Standardization of interactions, in turn, reduces human intervention and results in accrual of added business value to all stakeholders. Seefor a summary of the case study.
Customers are at the center of all decisions at PharmaChain Inc. PharmaChain Inc is committed to customer service and innovation, and these two values guide its decision to strengthen its pharmaceutical transportation services. The blockchain solution enables customers to track and trace their temperature-regulated pharmaceutical products, thereby increasing consumer confidence. As an additional benefit, the organization receives positive media attention regarding its commitment to safely transporting pharmaceutical products, which positively strengthens the company’s relationship with its customer base. Thus, the customer gains real-time access via mobile device or desktop computer to trustworthy information via the blockchain, and the need to contact customer service, which can be time consuming for the customer and costly for the company, is removed.
PharmaChain Inc explores various parts of the internal and external process to solve customer challenges. Blockchain aids in the reduction of lags in the internal processes between temperature measurement and timely corrective actions. Those lags may have otherwise resulted in increased liability, loss of product efficacy, and product destruction. This implementation facilitates the monitoring of the pharmaceutical products’ exposure to undesirable conditions (such as temperature extremes and delays in transit).
Conversely, blockchain delivers external process improvements leveraged to resolve legal and compliance issues more rapidly, ultimately allowing lifesaving medicine to reach patients more quickly by eliminating customary hold times in customs. A blockchain initiative was selected to improve visibility and facilitate trust among stakeholders (eg, manufacturers, distributors, transporters, government agencies, and pharmacies). If the freight forwarders do not produce and submit customs approval forms in a timely fashion, the pharmaceutical products cannot be released, with the duration of the hold potentially affecting the quality of the product and negatively affecting the customer experience. A trusted blockchain minimizes the standard 4- to 8-hour hold duration necessary to verify the validity of the customs approval submitted by the freight forwarder, and improved compliance also helps increase trust among external partners.
Learning and Growth (Innovation) Perspective
Blockchain applications support PharmaChain Inc in improving its learning capabilities by enabling it to analyze its business processes and optimize them. The learning capabilities can be extended beyond pharmaceutical products, resulting in organizational efficiencies. The growth opportunity within blockchain applications is enabling traceability along the supply chain journey. Traceability helps reduce fraud in the pharmaceutical supply chain, which is a major societal benefit. Encouraged by the success of the initiative, the organization is deploying blockchain across multiple business products, especially for high value activities and products like pet transportation and food items.
For PharmaChain Inc, pharmaceuticals represent one of its highest grossing revenue centers among all its shipping products. With a supply chain industry ripe for innovation, PharmaChain Inc accepts that a financial investment must be made to realize the key benefits of blockchain technology. Blockchain technology reduces the risk of theft and fraud as pharmaceutical products move through multiple warehouses along the supply chain, thus justifying the financial investment. The blockchain solution implemented by PharmaChain Inc positively impacts customer service and internal and external processes, increasing reliability and thereby reducing long-term costs. The risk of theft is minimized due to the automation of security controls, facilitated by the blockchain implementation. In addition, the cost of physical tracking of shipments is also minimized. The organization anticipates a lift of 10% in pharmaceutical sales over an 18-month period due to the initiative.
Tradeoffs Between the Perspectives
Transparency is one of the key characteristics of blockchain that helps to facilitate value within health care. Transparency helps ensure the authenticity of the pharmaceutical products while providing a lone source of the truth for the pharmacy supply chain network. However, transparency comes with tradeoffs between the value-based perspectives. For example, transparency replaces the concept of need to know that previously existed between the internal operational perspective and the customer perspective. Prior to the adoption of the blockchain solution, process improvements that were necessary to address internal operational failure were implemented only when the benefits outweighed the costs. With the introduction of blockchain, increased transparency may increase the exposure of failures in internal operations to the entire supply chain network, which, in turn, may reduce confidence in PharmaChain Inc. Therefore, any deficiencies identified in internal processes will be addressed more rapidly. While this increases the cost of the pharmacy product in the short term, it is likely to improve performance in the long term. Since blockchain in pharmaceuticals is transformational in providing trusted information, positive media attention that results from being an innovator in the industry provides additional opportunities for expanding the customer base.
Thus, PharmaChain Inc needs to continuously balance competing demands to improve internal operations and to innovate. Blockchain innovations require financial and human capital investments, which compete with the demands to improve existing internal systems. Thus, at least in the short term, increased quality of services provided to the customer (for example, via the ability to track and trace pharmaceutical products) may negatively affect the financial metrics. However, the benefits are expected to significantly increase financial performance in the long term as the blockchain technology enables PharmaChain Inc to offer superior services in comparison to its competition, thus providing PharmaChain Inc the opportunity to strengthen its competitive position in the industry.
Thus, we provide a comprehensive framework that can be used to evaluate blockchain implementation in the value-based health care context, and our study contributes to research streams on blockchain technology, the balanced scorecard framework, and value-based care.
First, our framework can help decision makers in health care organizations evaluate the feasibility and utility of various blockchain proposals that seek to address the health IT chasm reported in prior research . We examined the health IT chasm from three stakeholder perspectives to identify how blockchain-based solutions can resolve these issues based on existing use cases ( ). However, because this disruptive technology is still in its infancy, having a holistic view of the value of blockchain applications is critical to making informed strategic investment decisions [ , ]. Our framework will aid health care organizations in holistically considering the implications of blockchain technology from five critical perspectives. While prior literature has identified three groups of stakeholders central to the delivery of value-based care [ ], our study additionally highlights the critical role of external stakeholders and regulations.
In addition, our study extends the BSC framework by emphasizing the importance of the external perspective within the health care domain. The health care domain is a dynamic environment marked by changing regulations as well as competitive forces that are charting the course of the industry more rapidly than ever before. Regulatory compliance and value-based provision of services and products are two salient considerations in the health care industry. While value can be created through external partnerships, interoperability among IT systems and regulatory compliance are two areas of concern that constrain such partnerships. Blockchain’s inherent characteristics, such as transparency, immutability, and traceability, facilitate interoperability and enable health care organizations to both cocreate value with their external stakeholders and comply with regulations. Considering the influence of the external environment on a health care organization’s existence, our framework enables the examination of the external perspective when evaluating the performance of blockchain-based HIT solutions.
Third, with their emphasis on value-based care, health care organizations need to develop integrated health care IT infrastructure that can improve services and reduce medical errors. Blockchain, with its inherent trust- and security-promoting qualities, has the potential to significantly affect various areas of value provision for patients in health care. While many performance evaluation solutions exist, our study demonstrates the unique aspects of BSC in evaluating IT initiatives for enabling value-based care. The BSC framework enables the consideration of both financial and nonfinancial dimensions of IT initiatives in the short term as well as the long term. When compared with other performance evaluation solutions (such as Zachman’s framework, the HCI framework, or the technology-centric framework), our extended BSC framework facilitates consideration of the external perspective. It also defines and assesses performance against operational metrics for each of the five critical perspectives. In addition, our approach highlights the importance of the interrelationships among the perspectives, thus offering another critical extension of the BSC approach. The BSC, however, is limited in its ability to build intuitive and interactive systems like those that HCI and other frameworks provide. Thus, we recommend combining the BSC approach with other appropriate framework(s) to meet an organization’s unique needs.
Finally, our case study illustrates how the proposed framework can be utilized to evaluate a health care blockchain application in the for-profit sector. Our approach can also be extended to not-for-profit organizations, which prioritize social goals over financial goals. In such organizations, the financial perspective can be modified to focus on financial sustainability by establishing metrics such as cost reduction, revenue growth, and cost of stakeholder engagement. Similarly, the customer perspective may be widened to include additional stakeholders, such as donors, funding sources, community, volunteers, and employees, that are critical to such organizations .
Conflicts of Interest
How blockchain can empower value-based care.PDF File (Adobe PDF File)230 KB
Assessment of performance evaluation frameworks.PDF File (Adobe PDF File)188 KB
Metrics (KPIs) per perspectives.PDF File (Adobe PDF File)182 KB
Relationship matrix among perspectives.PDF File (Adobe PDF File)104 KB
- Adler-Milstein J, Embi PJ, Middleton B, Sarkar IN, Smith J. Crossing the health IT chasm: considerations and policy recommendations to overcome current challenges and enable value-based care. J Am Med Inform Assoc 2017 Sep 01;24(5):1036-1043. [CrossRef] [Medline]
- Mettler M. Blockchain technology in healthcare: the revolution starts here. : The revolution starts here. 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom) IEEE; 2016 Presented at: IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom); 14-16 Sept. 2016; Munich, Germany p. 1-3 URL: https://ieeexplore.ieee.org/document/7749510 [CrossRef]
- Nakamoto S. Bitcoin. 2008. Bitcoin: a peer-to-peer electronic cash system URL: https://bitcoin.org/bitcoin.pdf [accessed 2018-12-10]
- Kim HM, Laskowski M. Toward an ontology-driven blockchain design for supply-chain provenance. Intell Sys Acc Fin Mgmt 2018 Mar 28;25(1):18-27. [CrossRef]
- Marr B. Forbes. 2018. 35 Amazing real world examples of how blockchain is changing our world URL: https://www.forbes.com/sites/bernardmarr/2018/01/22/35-amazing-real-world-examples-of-how-blockchain-is-changing-our-world/#1f18c5943b56 [accessed 2018-11-10]
- Lagasse J. Healthcare Finance. 2017. Curisium raises $3.5 million to bring blockchain to value-based contracting URL: https://www.healthcarefinancenews.com/news/curisium-raises-35-million-bring-blockchain-value-based-contracting [accessed 2018-11-20]
- Iansiti M, Lakhani KR. The truth about blockchain. Harvard Business Review 2017;95(1):118-127 [FREE Full text]
- Glaser F. Pervasive decentralisation of digital infrastructures: a framework for blockchain enabled system and use case analysis. 2017 Presented at: 50th Hawaii International Conference on System Sciences; Jan 1 2017 - Jan 7 2017; Hawaii URL: https://aisel.aisnet.org/hicss-50/da/open_digital_services/4/ [CrossRef]
- LeRouge C, Mantzana V, Wilson EV. Healthcare information systems research, revelations and visions. European Journal of Information Systems 2017 Dec 19;16(6):669-671. [CrossRef]
- Kaplan RS, Norton DP. The balanced scorecard: measures that drive performance. Harvard Business Review 1992;70(1):71-79 [FREE Full text]
- Jain R, Benbunan-Fich R, Mohan K. Assessing Green IT Initiatives Using the Balanced Scorecard. IT Prof 2011 Jan;13(1):26-32. [CrossRef]
- Voelker KE, Rakich JS, French GR. The balanced scorecard in healthcare organizations: a performance measurement and strategic planning methodology. Hosp Top 2001;79(3):13-24. [CrossRef] [Medline]
- Slabodkin G. A work in progress: blockchain. Health Data Management 2017;25(3):37-39.
- ONC HHS. The Office of the National Coordinator for Health Information Technology. 2015. Federal health IT strategic plan URL: https://www.healthit.gov/sites/default/files/9-5-federalhealthitstratplanfinal_0.pdf [accessed 2018-11-20]
- Patel MS, Davis MM, Lypson ML. The VALUE Framework: training residents to provide value-based care for their patients. J Gen Intern Med 2012 Sep;27(9):1210-1214 [FREE Full text] [CrossRef] [Medline]
- Porter ME. What Is Value in Health Care? N Engl J Med 2010 Dec 23;363(26):2477-2481. [CrossRef]
- Tseng EK, Hicks LK. Value Based Care and Patient-Centered Care: Divergent or Complementary? Curr Hematol Malig Rep 2016 Aug;11(4):303-310. [CrossRef] [Medline]
- Porter ME. A strategy for health care reform--toward a value-based system. N Engl J Med 2009 Jul 09;361(2):109-112. [CrossRef] [Medline]
- LaPointe J. Revcycle Intelligence. 2016 Jun 07. What is value-based care, what it means for providers? URL: https://revcycleintelligence.com/features/what-is-value-based-care-what-it-means-for-providers [accessed 2018-12-10]
- Office of the National Coordinator for Health Information Technology. 2015. U.S. hospital adoption of patient engagement functionalities URL: https://dashboard.healthit.gov/quickstats/pages/FIG-Hospital-Adoption-of-Patient-Engagement-Functionalities.php [accessed 2018-11-20]
- Zhang J, Xue N, Huang X. A Secure System For Pervasive Social Network-Based Healthcare. IEEE Access 2016;4:9239-9250. [CrossRef]
- Engelhardt MA. Hitching Healthcare to the Chain: An Introduction to Blockchain Technology in the Healthcare Sector. TIM Review 2017 Oct 27;7(10):22-34. [CrossRef]
- Ekblaw A, Azaria A, Halamka J, Lippman A. A case study for blockchain in healthcare:. 2016 Presented at: Proceedings of IEEE Open & Big Data Conference; Aug 22, 2016 - Aug 24, 2016; Vienna, Austria.
- Dey T, Jaiswal S, Sunderkrishnan S, Katre N. HealthSense: a medical use case of Internet of Things and blockchain. 2017 Presented at: International conference on intelligent sustainable systems (ICISS); Dec 7, 2017 - Dec 8, 2017; Palladam, India. [CrossRef]
- Ichikawa D, Kashiyama M, Ueno T. Tamper-Resistant Mobile Health Using Blockchain Technology. JMIR Mhealth Uhealth 2017 Jul 26;5(7):e111 [FREE Full text] [CrossRef] [Medline]
- Saravanan M, Shubha R, Marks A, Iyer V. SMEAD: a secured mobile enabled assisting device for diabetics monitoring. 2017 Presented at: IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS); Dec 17, 2017 - Dec 20, 2017; Bhubaneswar, India p. 1-6. [CrossRef]
- Carson B, Romanelli G, Walsh P, Zhumaev A. McKinsey & Company. 2018. Blockchain beyond the hype: what is the strategic business value? URL: https://cybersolace.co.uk/CySol/wp-content/uploads/2018/06/McKinsey-paper-about-Blockchain-Myths.pdf [accessed 2018-11-20]
- Genestier P, Zouarhi S, Limeux P, Excoffier D, Prola A. Blockchain for consent management in the ehealth environment?: a nugget for privacy and security challenges. Journal of the International Society for Telemedicine and eHealth 2017;5:1-4 [FREE Full text]
- Chandler N. Gartner. 2010 Apr 02. Solutions for scorecards and strategy management URL: https://www.gartner.com/en/documents/1334316/solutions-for-scorecards-and-strategy-management [accessed 2018-12-10]
- Nørreklit H. The Balanced Scorecard: what is the score? A rhetorical analysis of the Balanced Scorecard. Accounting, Organizations and Society 2003 Aug;28(6):591-619. [CrossRef]
- Glover D, Hermans J. Improving the traceability of the clinical trial supply chain. Applied Clinical Trials 2017;26(12):36-39 [FREE Full text]
- Funk E, Riddell J, Ankel F, Cabrera D. Blockchain Technology: A Data Framework to Improve Validity, Trust, and Accountability of Information Exchange in Health Professions Education. Acad Med 2018 Dec;93(12):1791-1794. [CrossRef] [Medline]
- Moreira C, Farley M, Gebreyes K, McDonnell W. PwC. 2018. A prescription for blockchain and healthcare: reinvent or be reinvented URL: https://www.pwc.com/us/en/health-industries/health-research-institute/assets/pdf/pwc-hri-a-prescription-for-blockchain-in-healthcare_27sept2018.pdf [accessed 2018-12-10]
- Androulaki E, Barger A, Bortnikov V, Cachin C, Christidis K, De Caro A, et al. Hyperledger fabric: A distributed operating system for permissioned blockchains. In: www.hyperledger.org.: ACM; 2018 Presented at: Thirteenth EuroSys Conference; April 23, 2018 - April 26, 2018; Porto, Portugal. [CrossRef]
- Bocek T, Rodrigues B, Strasser T, Stiller B. Blockchains everywhere - a use-case of blockchains in the pharma supply-chain. 2017 Presented at: IFIP/IEEE Symposium on Integrated Network and Service Management; May 8, 2017 - May 12, 2017; Lisbon, Portugal. [CrossRef]
- HealthIT.: IBM; 2016. Blockchain: the chain of trust and its potential to transform healthcare – our point of view URL: https://www.healthit.gov/sites/default/files/8-31-blockchain-ibm_ideation-challenge_aug8.pdf [accessed 2018-12-11]
- Nugent T, Upton D, Cimpoesu M. Improving data transparency in clinical trials using blockchain smart contracts. F1000Res 2016;5:2541 [FREE Full text] [CrossRef] [Medline]
- Benchoufi M, Ravaud P. Blockchain technology for improving clinical research quality. Trials 2017 Jul 19;18(1):335 [FREE Full text] [CrossRef] [Medline]
- Hollan J, Hutchins E, Kirsh D. Distributed cognition: toward a new foundation for human-computer interaction research. ACM Trans. Comput.-Hum. Interact 2000;7(2):174-196. [CrossRef]
- Zhang A, Lin X. Towards Secure and Privacy-Preserving Data Sharing in e-Health Systems via Consortium Blockchain. J Med Syst 2018 Jun 28;42(8):140. [CrossRef] [Medline]
- Yue X, Wang H, Jin D, Li M, Jiang W. Healthcare Data Gateways: Found Healthcare Intelligence on Blockchain with Novel Privacy Risk Control. J Med Syst 2016 Oct;40(10):218. [CrossRef] [Medline]
- Cichosz SL, Stausholm MN, Kronborg T, Vestergaard P, Hejlesen O. How to Use Blockchain for Diabetes Health Care Data and Access Management: An Operational Concept. J Diabetes Sci Technol 2019 Mar;13(2):248-253 [FREE Full text] [CrossRef] [Medline]
- Carson B, Romanelli G, Walsh P, Zhumaev A. McKinsey & Company. 2018. Blockchain beyond the hype: what is the strategic business value? URL: https://cybersolace.co.uk/CySol/wp-content/uploads/2018/06/McKinsey-paper-about-Blockchain-Myths.pdf [accessed 2018-12-10]
- Agbo C, Mahmoud Q, Eklund J. Blockchain Technology in Healthcare: A Systematic Review. Healthcare (Basel) 2019 Apr 04;7(2):56 [FREE Full text] [CrossRef] [Medline]
- Leung D, Suhl A, Gilad Y, Zeldovich N. Network and Distributed Systems Security (NDSS) Symposium. 2019. Vault: fast bootstrapping for the algorand cryptocurrency URL: https://people.csail.mit.edu/nickolai/papers/leung-vault.pdf [accessed 2019-05-20]
- Kuzmanovic A. Net neutrality. Commun. ACM 2019 Apr 24;62(5):50-55. [CrossRef]
- Park YR, Lee E, Na W, Park S, Lee Y, Lee J. Is Blockchain Technology Suitable for Managing Personal Health Records? Mixed-Methods Study to Test Feasibility. J Med Internet Res 2019 Feb 08;21(2):e12533 [FREE Full text] [CrossRef] [Medline]
- Kuo T, Kim H, Ohno-Machado L. Blockchain distributed ledger technologies for biomedical and health care applications. J Am Med Inform Assoc 2017 Nov 01;24(6):1211-1220 [FREE Full text] [CrossRef] [Medline]
- Liu W, Zhu S, Mundie T, Krieger U. Advanced block-chain architecture for e-health systems. : IEEE; 2017 Presented at: IEEE 19th International Conference on e-Health Networking, Applications and Services, Healthcom; Oct 12, 2017 - Oct 15, 2017; Dalian, China p. 37-42. [CrossRef]
- Roman-Belmonte JM, De la Corte-Rodriguez H, Rodriguez-Merchan EC. How blockchain technology can change medicine. Postgrad Med 2018 May;130(4):420-427. [CrossRef] [Medline]
- Angraal S, Krumholz HM, Schulz WL. Blockchain Technology: Applications in Health Care. Circ Cardiovasc Qual Outcomes 2017 Sep;10(9):1-3. [CrossRef] [Medline]
- Zhou L, Wang L, Sun Y. MIStore: a Blockchain-Based Medical Insurance Storage System. J Med Syst 2018 Jul 02;42(8):149 [FREE Full text] [CrossRef] [Medline]
- Miller R. TechCrunch. PokitDok teams with Intel on healthcare blockchain solution URL: https://techcrunch.com/2017/05/10/pokitdok-teams-with-intel-on-healthcare-blockchain-solution/ [accessed 2018-12-11]
- Schumacher A. Blockchain Research Institute.: Brightline; 2018. Reinventing healthcare on the blockchain - toward a new era in precision medicine URL: https://www.brightline.org/resources/reinventing-healthcare-on-the-blockchain/ [accessed 2018-12-11]
- Vazirani AA, O'Donoghue O, Brindley D, Meinert E. Implementing Blockchains for Efficient Health Care: Systematic Review. J Med Internet Res 2019 Feb 12;21(2):e12439 [FREE Full text] [CrossRef] [Medline]
- Meinert E, Alturkistani A, Brindley D, Knight P, Wells G, Pennington ND. The technological imperative for value-based health care. Br J Hosp Med (Lond) 2018 Jun 02;79(6):328-332. [CrossRef] [Medline]
- Sullivan SD, Watkins J, Sweet B, Ramsey SD. Health technology assessment in health-care decisions in the United States. Value Health 2009 Jun;12 Suppl 2:S39-S44 [FREE Full text] [CrossRef] [Medline]
- Chernew ME, Rosen AB, Fendrick AM. Value-based insurance design. Health Aff (Millwood) 2007;26(2):w195-w203. [CrossRef] [Medline]
- Drummond M, Sculpher M, Claxton K, Stoddart G, Torrance G. Methods for the Economic Evaluation of Health Care Programmes. Oxford: Oxford University Press; 2015.
- Sowa JF, Zachman JA. Extending and formalizing the framework for information systems architecture. IBM Syst. J 1992;31(3):590-616. [CrossRef]
- O'Brien MA, Rogers WA, Fisk AD. Developing a Framework for Intuitive Human-Computer Interaction. Proc Hum Factors Ergon Soc Annu Meet 2008 Sep;52(20):1645-1649 [FREE Full text] [CrossRef] [Medline]
- Cheng LC, Gibson ML, Carrillo EE, Fitch G. A technology‐centric framework for investigating business operations. Industr Mngmnt & Data Systems 2011 Apr 26;111(4):509-530. [CrossRef]
- Hoque Z. Total quality management and the balanced scorecard approach: a critical analysis of their potential relationships and directions for research. Critical Perspectives on Accounting 2003 Jul;14(5):553-566. [CrossRef]
- Hasan N. University of Birmingham. 2006. Developing a balanced scorecard model for evaluation of project management and performance URL: https://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.494604 [accessed 2018-12-10]
- Metawie M, Gilman D. Problems with the implementation of performance measurement systems in the public sector where performance is linked to pay: A literature review drawn from the UK. 2005 Presented at: 3rd Conference on Performance Measurement and Management Control; Sept 22, 2005 - Sept 23, 2005; Nice, France URL: http://citeseerx.ist.psu.edu/viewdoc/citations?doi=10.1.1.104.9267
- Enwere EN, Keating EA, Weber RJ. Balanced scorecards as a tool for developing patient-centered pharmacy services. Hosp Pharm 2014 Jun;49(6):579-584 [FREE Full text] [CrossRef] [Medline]
- Zelman WN, Pink GH, Matthias CB. Use of the balanced scorecard in health care. J Health Care Finance 2003;29(4):1-16. [Medline]
- Bandopadhyay T. Gartner. 2013 Dec 6. I&O Teams Can Build Balanced Scorecards for Business Cases on IT Services Transitioning to the Cloud.
- Schelp J, Stutz M. Via Nova Architectura. 2007. A balanced scorecard approach to measure the value of enterprise architecture URL: https://www.alexandria.unisg.ch/213190/1/SchelpStutz.2007-BalancedScorecardApproach.pdf [accessed 2018-12-15]
- Rillo M. Limitations of balanced scorecard. 2004 Presented at: Proceedings of the 2nd Scientific and Educational Conference, Business Administration: Business in a Globalizing Economy; Jan 30, 2004 - Jan 31, 2004; Parnu p. 155-161.
- Banker R, Chang H, Janakiraman S, Konstans C. A balanced scorecard analysis of performance metrics. European Journal of Operational Research 2004 Apr;154(2):423-436 [FREE Full text] [CrossRef] [Medline]
- Mohobbot A. The balanced scorecard (BSC): a critical analysis. Journal of Humanities and Social Sciences 2004;18:219-232.
- Akkermans H, Van Oorschot K. Developing a balanced scorecard with system dynamics. Journal of the Operational Research Society 2002;40(56):931-941 [FREE Full text]
- Grigoroudis E, Orfanoudaki E, Zopounidis C. Strategic performance measurement in a healthcare organisation: A multiple criteria approach based on balanced scorecard. Omega 2012 Jan;40(1):104-119. [CrossRef]
- Culver K. HealthIT. 2016. Blockchain technologies: a whitepaper discussing how the claims process can be improved URL: https://www.healthit.gov/sites/default/files/3-47-whitepaperblockchainforclaims_v10.pdf [accessed 2019-04-12]
- Yip K. HealthIT. 2017. Blockchain and alternative payment models URL: https://www.healthit.gov/sites/default/files/15-54-kyip_blockchainapms_080816.pdf [accessed 2019-09-14]
- Pankomera R, van Greunen D. Privacy and security issues for a patient-centric approach in public healthcare in a resource constrained setting. In: IEEE. 2016 Presented at: IST-Africa Week Conference; May 11, 2016 - May 13, 2016; Durban, South Africa.
- DeLone WH, McLean ER. The DeLone and McLean model of information systems success: a ten-year update. Journal of Management Information Systems 2003;19(4):9-30. [CrossRef]
- Kettinger, Lee. Zones of Tolerance: Alternative Scales for Measuring Information Systems Service Quality. MIS Quarterly 2005;29(4):607-623. [CrossRef]
- Hu C. Business Insider. 2018 Aug 10. Mount Sinai teamed up with the designers who created projects for Nike and Beyonce to build a futuristic, new clinic ? and it?s reimagining how healthcare is delivered URL: https://www.businessinsider.com.au/inside-mount-sinais-lab100s-clinic-of-the-future-2018-8 [accessed 2018-12-10]
- Zhang P, Walker M, White J, Schmidt D, Lenz G. Metrics for assessing blockchain-based healthcare decentralized apps. 2017 Presented at: IEEE 19th International Conference on E-Health Networking, Applications and Services (Healthcom); Oct 12, 2017 - Oct 15, 2017; Dalian, China. [CrossRef]
- Somers AB. Shaping the balanced scorecard for use in UK social enterprises. Social Enterprise Journal 2005 Mar;1(1):43-56. [CrossRef]
|BMPLS: Blockchain-Based Multi-level Privacy-Preserving Location Sharing Scheme|
|BSC: Balanced Scorecard|
|EHR: electronic health record|
|EFQMEM: European Foundation Quality Management Excellence Model|
|GDPR: European General Data Protection Regulation|
|HCI: human-computer interaction|
|HIT: Health Information Technology|
|IS: Information Systems|
|IT: Information Technology|
|ONC: Office of the National Coordinator for Health Information Technology|
|ROI: return on investment|
|TQM: total quality management|
Edited by K Clauson, P Zhang; submitted 01.02.19; peer-reviewed by H Oh, C Reis, K McLeroy; comments to author 01.04.19; revised version received 27.05.19; accepted 16.07.19; published 27.09.19Copyright
©Rongen Zhang, Amrita George, Jongwoo Kim, Veneetia Johnson, Balasubramaniam Ramesh. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 27.09.2019
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.