Published on 24.04.20 in Vol 22, No 4 (2020): April
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/16324, first published Sep 18, 2019.
Improving the Theoretical Understanding Toward Patient-Driven Health Care Innovation Through Online Value Cocreation: Systematic Review
Background: Patient participation in the health care domain has surged dramatically through the availability of digital health platforms and online health communities (OHCs). Such patient-driven service innovation has both potential and challenges for health care organizations. Over the last 5 years, articles have surfaced that focus on value cocreation in health care services and the importance of engaging patients and other actors in service delivery. However, a theoretical understanding of how to use OHCs for this purpose is still underdeveloped within the health care service ecosystem.
Objective: This paper aimed to introduce a theoretical discussion for better understanding of the potential of OHCs for health care organizations, in particular, for patient empowerment.
Methods: This literature review study involved a comprehensive search using 12 electronic databases (EMBASE, PsycINFO, Web of Science, Scopus, ScienceDirect, Medical Literature Analysis and Retrieval System Online, PubMed, Elton B Stephens Co [academic], Cumulative Index of Nursing and Allied Health Literature, Accelerated Information Sharing for Law Enforcement, Association for Computing Machinery, and Google Scholar) from 2013 to 2019. A total of 1388 studies were identified from the database search. After removing duplicates and applying inclusion criteria, we thematically analyzed 56 articles using the Braun and Clarke thematic analysis approach.
Results: We identified a list of 5 salient themes: communication extension, improved health literacy for patients and health care organizations, communication transparency with patients, informational and social support for patients, and patient empowerment in self-management. The most frequent theme was communication extension, which covers 39% (22/56) of the literature. This theme reported that an extension of communication between patients, caregivers, and physicians and organizations led to new opportunities to create value with minimal time and cost restrictions. Improved health literacy and communication transparency with patients were the second and third most frequent themes, respectively, covering 26% (15/56) and 25% (14/56) of the literature, respectively. The frequency of these themes indicated that the use of OHCs to generate new knowledge from patients’ interactions helped health care organizations to customize treatment plans and establish transparent and effective communication between health care organizations and patients. Furthermore, of the 56 studies, 13 (23%) and 10 (17%) studies contended the opportunity of using OHCs in terms of informational and emotional support and empowering patients in their self-management of diseases.
Conclusions: This review enables better understanding of the current state of the art of the online value cocreation and its potential for health care organizations. This study found that the opportunities for health care organizations through enhancement of patient participation and their cocreation of value in digital health platforms have been rapidly increasing. The identified gaps and opportunities in this study would identify avenues for future directions in modernized and more effective value-oriented health care informatics research.
J Med Internet Res 2020;22(4):e16324
The health care industry is under increasing pressure in terms of enhancing their service provision and quality with meeting the growing demands. This is because of population growth and the rise of chronic diseases  besides other factors. To respond to these pressures, the health care industry is continuously digitizing its service provisions to provide for more effective and cost-efficient care models, as well as self-care management for personalized health care [ ]. As part of the digitization, health care organizations are establishing online health communities (OHCs) as part of their service offering [ ] to cocreate value. An OHC refers to a group of people who interact with each other in online environments about similar health issues [ ]. This is reflected in the health care literature with growing emphasis on health value cocreation and the benefits of consumer value cocreation in the health domain [ , ]. Historically, value creation was conceptualized as company centric with the value being provided by the company to the customer. More recently, cocreation is viewed as an appropriate customer-centric mechanism for health care organizations in which value is created with customers rather than for customers [ , ]. In the context of OHCs, the interaction between stakeholders within online platforms can create values that allow stakeholders to share their knowledge and experiences [ ]. Through creating value by working with health care organizations, a patient can likely raise their feelings about the existential quality of life, improve the attainment of life goals, and support and reduce their psychological and physical distress [ ]. OHCs can provide peer health knowledge, emotional support, and improve self-care for patients with chronic diseases, especially for lifestyle-related diseases such as cancer, obesity or type 2 diabetes [ ]. For patients with chronic diseases, OHCs provide a set of anecdotal information [ , ], which helps patients increase their positive emotional experience and attitude toward chronic diseases, engaging them in the activities of the community [ ]. Empowering patients improves their role in cocreating, co-designing, and co-delivering health services [ ]. In addition, patient empowerment contributes to enhancing the quality of care and health outcomes [ , ]. For instance, OHC users with chronic diseases become more knowledgeable, feel better socially supported, and have improved behavioral and clinical outcomes compared with nonusers [ ].
Over the last 5 years, the number of articles that focus on value cocreation in the health care services has increased, highlighting the significance of the collaboration and cocreation of value within the health care service ecosystem between the patients and health care providers [, ]. In our last paper, we systematically reviewed the literature regarding the role of OHCs as facilitators of value cocreation in the health care service ecosystem within the last 5 years [ ]. The findings showed that OHCs provide opportunities for members to cocreate value ubiquitously along with providing members with online informational and emotional support. However, the ability of health care organizations to engage patients in the health care service coproduction and value cocreation has been largely overlooked [ - ]. Due to the importance and apparent oversight of value cocreation for health care organizations, this paper sought to address the following research question: To what extent could online value cocreation add value for health care organizations?
To produce new insights into this research question, this study performed a descriptive literature review to investigate the potential of online value cocreation for health care organizations, identifying the current state of knowledge and the opportunities for health care organizations to engage in online value cocreation.
Value Cocreation in Health Care
Technological developments promoted a shift from a health care model dominated by professionals toward a patient-centered model in which patients and professionals collaborate to create a service that offers the most optimal health care solution . In recent years, the health care domain has undergone a number of transformations because of the recent advances in technology [ ]. In addition, significant priorities for service marketing research include the role of consumers in the cocreation of value within the service sector, the transformative potential of services, and the interface between consumer communities and organizations [ ]. This is also reflected in health research with some research evidencing the need for health care service providers and physicians to understand the patient and their role in the provision of health information [ , , ]. The positive impact of collaborations among patients, physicians, and other actors on health outcomes has justified the significance given to the health care domain in investigating the cocreation of value [ ]. Value cocreation in health care is a framework that integrates quality enhancement efforts by health care community staff members with patients’ engagement to promote innovation in creating value [ ]. Value cocreation refers to the process through which health care providers collaboratively engage with customers to create value [ ]. Organizations are increasingly offering value cocreation opportunities to create more value for both customers and themselves [ - ]. Hence, the provider should take a holistic view of service delivery and consider the important factors in the clinical encounter for empowering patients to assume an active participatory role. Information technology can nurture better health care along with cost reduction and develop service innovation [ , ]. Recently, online community research has gradually started to focus on value cocreation and community outcomes [ ]. OHCs provide opportunities for stakeholders such as patients, physicians, caregivers, and health care organizations to access and share health information as well as contribute to the value cocreation process, diminish geographical barriers, and provide informational, social, and emotional support [ , ].
Online Health Communities as Platforms for Value Cocreation
With the rapid growth of social media technology, OHCs provide opportunities for fostering cocreation among the different stakeholders in health care [, ]. OHCs are a particular form of special interest community, centered on a shared interest in health conditions and diseases [ ]. The primary objective of the most OHCs is to provide a platform for patients regarding interacting with each other to obtain emotional support and disease management and care [ ]. Participation in OHCs leads to additional activities carried out by patients, which add value to the patient-provider interactions [ ]. Research showed that the more effort patients put into value cocreation activities, the more likely they are to continue with the health care provider, to return to the health care provider when they need treatment in the future, and to recommend the provider to others [ ]. In the context of service-dominant logic, which is focused on patients’ contribution to the value creation, the customer is always a cocreator of value [ ]. In essence, OHCs are changing the way patients treat and manage their health [ ]. These communities facilitate self-management through health information exchange and disease experiences [ ]. The prominent characteristics of online communities are strong social relationship among members, community-specific organizational structure and way of discussion, history sharing, community rituals, and common online meeting space [ ]. All these characteristics support identity for the community, provide a long-lasting relationship between participants, and foster strong member commitment to community purposes [ ]. Several studies have focused on the benefits of OHCs, including (a) availability of health-related information especially for people who live in remote areas, facilitating information and social support without the need for driving long distance for face-to-face support group [ , ]; (b) access to health-related information with minimum cost [ ]; (c) accessibility to experience-based health information, sharing daily coping habits and user experiences with symptoms [ , ]; and (d) decrease in the feeling of loneliness, creating social interactions among patients with a stigmatized medical condition and avoiding asking for help outside of the online community [ , ]. By empowering patients in OHCs, it is possible to activate value cocreation path between them and health care organizations [ ]. As such, by enabling patients to support each other in OHCs, organizations can also indirectly improve customers’ ties with the product and with the organization [ ]. Accordingly, OHCs offer cocreation of value opportunities among patients, physicians, and health care organizations to improve health care outcomes [ ]. This process, in turn, fosters patients’ access to health information [ ].
Health Care Organizations and Online Value Cocreation
To date, many health care organizations are rapidly recognizing the importance of OHCs as a significant platform of complementary service to improve the total quality of health care services . Although the advantages of using OHCs for health care providers are promising, health care organizations frequently discounted OHCs’ information because of the lack of clinical training of contributors and perceived lower quality of online health information [ ]. Health care organizations also experience barriers regarding privacy, confidentiality, reputation management, and the dissemination of inaccurate health information [ - ]. Many health care providers worry about broadcasting misinformation and its negative influence on patients’ health decisions [ , , ]. Some patients contended that the risk of misinformation in OHCs might be reduced by the participation of health care organization in the conversation. In return, health care organizations could receive valuable experience-based health information from patients, saving organizational resources [ ]. The diverse needs of various patients prevent the setup of a single, one-size-fits-all community; rather, cognitive- and affective-related values in a community depend on who participate in the community, the foundation of their relationship, and their activities such as sharing experiences, assessing new ideas, and recommending alternative treatments. Therefore, the complexity of digital services, which involve different goals of interaction among different actors, demands a more granular view of value cocreation in online communities [ ]. Although numerous businesses have started to harness the advance potential of online communities by utilizing them as an online environment for customer co-innovation and value cocreation, health care organizations are lagging behind [ , ]. Hence, health care organizations can extend a better understanding of various types of consumer value cocreation that is enabled by OHCs [ ]. To address these gaps and to deeply understand the potential of online value cocreation for health care organizations, our main objective was as follows: to identify the salient themes of the current literature regarding the potential of online value cocreation for health care organizations.
To identify the potential of online value cocreation for health care organizations, we needed to investigate the current literature. For doing so, a descriptive literature review is one of the suitable methods for providing a broad and comprehensive background about the current state of the art . We employed Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist to guide our systematic review of relevant peer-reviewed literature [ ]. The main aim of the PRISMA is to assist authors in improving the reporting of systematic review and meta-analysis [ ]. The following sections explain the article selection process and review protocol.
Search Method and Article Selection
The purpose of this study was to critically appraise extant work to answer the following question: to what extent could online value cocreation add value for health care organizations? To retrieve relevant articles, we reviewed several academic databases and derived database search terms. The search terms were derived based on keywords in the research question (online value cocreation and health care organizations). However, we did not merely focus on these particular keywords because some related papers discussed the same concepts using different terms. For instance, some articles discussed value cocreation activities in internet-based forums by various stakeholders without using specific terms such as online value cocreation or health care ecosystem. Hence, to ensure that relevant papers are not neglected, we broadened the search keywords and their synonyms to gather a comprehensive pool of related papers for this study (see). Based on our research aim, a search string was defined using Boolean operators such as “AND” and “OR”: (“online value co-creation” OR “value co-creation”) AND (“healthcare organisation” OR “healthcare service providers”) AND (“healthcare service ecosystem”). The variants of the search terms in were applied in different databases. In addition, we considered social science databases such as PsycINFO and EMBASE in terms of covering special studies in psychology and behavioral science. We also looked at controlled vocabularies such as Medical Subject Headings and thesaurus for a more complete search. In addition, three prominent researchers in the field of information systems (IS) and health informatics were asked to recommend any additional studies that met the inclusion criteria.
The searching process was complemented with articles identified from the reference lists as well as searching within the table of contents of selected journals. The outcome of phase 1 yielded 1040 papers after the removal of duplicates. Two scholars separately reviewed the abstracts of each paper and determined if the paper was relevant using the following inclusion criteria: (1) articles were written in English, (2) articles were published between 2013 and 2019, (3) articles focused on the role of health care organizations in the online value cocreation, and (4) articles employed quantitative or qualitative research studies that focused on the use of digital health platforms in value cocreation. During this process, the reference lists of the papers were also checked to identify other articles that are potentially eligible for inclusion. This returned 6 new papers. The two reviewers agreed with each other on the final pool of articles: 281 were identified to be eligible for inclusion in this review. Upon applying the inclusion criteria to the full-text papers, 56 articles were determined to be relevant.(adapted from Nili et al [ ]) illustrates the article selection process, and denotes the number of relevant articles retrieved per database. In addition, a summary of the characteristics of the relevant papers is detailed in .
Data Analysis Approach
To answer the research question, we conducted a thematic analysis following the 6 steps of coding proposed by Braun and Clarke  to explore the major themes regarding the potential of online value cocreation for health care organizations. Thematic analysis is a technique that is commonly used to identify, analyze, and report patterns (themes) within data [ ]. This technique is an inductive approach and involves coding all sections of findings, discussion, and conclusion of all selected papers (N=56). Applying this method needs careful reading and rereading of the data [ ] to identify the explicit and implicit meaning embedded within the text [ ]. The 6 steps of thematic analysis process defined by Braun and Clarke [ ] are collecting data, generating initial codes, searching for themes, reviewing themes, defining and naming themes, and writing the report ( ). We used NVivo 12 (a qualitative data analysis software; QSR International, Melbourne, Australia) as a repository for storing the articles, and all coding was manually performed.
During the first step, we performed a preliminary analysis of the relevant articles and recorded our notes through memo and annotation features of NVivo and marked ideas for coding in the next step. In the second step, post familiarization with the data, we manually generated an initial list of codes. In total, 112 initial codes were generated. In the third step, after generating initial codes, we refocused the analysis process on the broader level of themes, rather than codes, sorting the different codes into potential themes and subthemes. This was facilitated by creating a thematic map by utilizing the mind map features of NVivo to visualize codes and themes. The thematic map revealed 10 themes and 41 miscellaneous codes. In the fourth step, we reviewed and refined themes. In the reviewing process, we reviewed all themes to make sure they followed a coherent pattern. During this phase, two themes collapsed into each other because of their common content. In the refining process, we recoded some additional data that have been missed in earlier stages, resulting in 11 themes. In the fifth step, defining and refining needs to be applied to our themes. In doing so, we named and defined themes . We also performed a detailed analysis of each theme to ensure that the theme was relevant to the research question and that only minimal overlap existed between themes. Another significant factor in this stage is the naming of themes. Names of themes should be concise and punchy and should directly define what the theme is about [ ]. In doing so, we named the themes that reflect the answer to our research question. The results of this stage revealed 5 themes (see ). In the sixth step of the thematic analysis, we provided a concise, coherent, and logical report to summarize the themes as presented in the following sections.
|Theme||Description||Subthemes||Coverage of the final selection (N=56), n (%)|
|Communication extension||Digital health platforms such as OHCsa extend communication from the traditional power balance face-to-face consultation between patients and health care professionals to online interactions for facilitating dialogues between stakeholders.||22 (39)|
|Improved health literacy for patients and health care organizations||The use of digital platforms such as OHCs to generate new knowledge from patients’ interactions and help health care organizations to customize treatment plans, offering some online advice especially for patients with a chronic disease.||15 (26)|
|Communication transparency with patients||The use of digital platforms such as OHCs establishes transparent and effective communication between patient and patient, patient and physicians, and patient and health care organizations.||14 (25)|
|Informational and social support for patients||The use of digital platforms such as OHCs by health care organizations provides informational and social support, which increases the quality of services and patient satisfaction.||13 (23)|
|Patient empowerment in self-management||The use of digital platforms such as OHCs to engage patients in the value cocreation process, assisting them in their self-management of diseases.||10 (17)|
aOHCs: online health communities.
Trustworthiness is a key factor in a qualitative content analysis because text can have multiple meanings and diverse interpretation . It is contended that if the analysis process provides adequate details, the validity of the research will be assured [ ]. Accordingly, this research explicates the process of coding step by step to establish the trustworthiness of the study. In terms of testing the trustworthiness of the findings, we employed percent agreement as our method of intercoder reliability checking [ ]. Percent agreement is a useful method of checking the reliability of the qualitative findings of less sensitive (eg, literature review) IS projects [ ], where the original analyst and a second person compare the findings of their analyses for a sample of papers. The two scholars, experienced in qualitative research and thematic analysis, who checked different parts (paper selection and inclusion and exclusion criteria) placed particular emphasis on reviewing all codes, categories, and themes. They looked at the themes of the study and the way they have originated from categories and codes. During the first meeting, the percent agreement was 75%, and after the second meeting, that is, discussion on the essence of the themes, the general consensus was achieved and the overall results were 100%, making us confident about the reliability of our literature review.
Through performing the thematic analysis, we identified 5 main themes: communication extension, improve health literacy, communication transparency with patients, patient empowerment in self-management, and informational and social support for the patient. Each theme consisted of several subthemes which are presented in. The following sections provide more detail into each of them.
As evidenced in, communication extension was the most explored theme (22/56, 39%) followed by improved health literacy (15/56, 26%), communication transparency with patients (14/56, 25%), informational and social support for patients (13/56, 23%), and patient empowerment in self-management (10/56, 17%).
OHCs provide an opportunity for stakeholders to extend their communication from traditional approach, which comprises few face-to-face scheduled consultations, to effective interactions among the patient, health care professionals, and health care organizations within digital health platforms. In fact, OHCs have a potential to connect members who would never have met each other because of geographical distance. Communication extension assists health care organizations to empower patients to interact with health care professionals and organizations . In this regard, OHCs can contribute to unleashing the provision of health care services and facilitate resource exchange and peer-to-peer social support. In essence, communication extension brings the patients into focus, and OHCs offer a mechanism for value cocreation among stakeholders with minimal time and cost restriction [ , , , - ]. The vast majority of the literature emphasizes information accessing and creating, sharing, and recombination of resources [ , ]. OHCs assist patients to produce health information by sharing their health experiences and cocreate a value within these platforms [ ]. Resource exchanges are the mutual actions taken by stakeholders in the health care service ecosystem to access, monitor, share, and integrate resources [ , , ]. In fact, the communication extension provides health care organizations with the opportunity to look beyond the patient portal and consider how technology nurtures consumers’ relationship, engagement, and contributions as well as the health care organizations to better understand the value cocreation process that occurs within digital health platforms [ , ].
Improved Health Literacy of Patients and Health Care Organizations
As indicated in the previous theme, health care organizations need to empower and engage patients in the value cocreation process. However, insufficient organizational health literacy impoverishes the ability of a health care organization to fulfill this task . Health care organizations need to educate patients on their innovation that they are planning to offer to patients, and patients need to educate health care organizations in the context of their everyday use of innovation [ ]. OHCs can be an effective tool for knowledge sharing and peer education, and it has the potential to impact patients’ health literacy [ , ]. The new knowledge generated from those patient interactions in OHCs assists health care organizations to customize treatment plans, offering some online treatment options especially for patients with a chronic disease [ ]. Some papers contend that by enhancing health literacy, it would be possible to decrease the use of medical services, improving value cocreation with stakeholders and, ultimately, improving the efficiency of the health care system [ , , , ]. One of the most relevant papers in this review contends that knowledge should flow both ways. It means that patients should be educated by health care organizations and vice versa [ ]. In fact, interactions between patients and health care organizations in digital health platforms enable organizations to collect patients’ health-related experiences and information. Therefore, health care organizations benefit from digital health platforms such as OHCs that improve the patient’s ability to use digital platforms to find relevant health-related information and to apply the gained knowledge to address a health issue, which is known as eHealth literacy in the literature.
Communication Transparency With Patients
Communication transparency between patients and health care organizations is a viable method to provide health care organizations, health care professionals, and patients with new opportunities to cocreate value [, ]. In this regard, OHCs can provide a proper, transparent, and effective communication between stakeholders [ ]. The better health care organizations can effectively interact with patients in OHCs, the more online value will be created. Transparent communication and interaction between health care organizations and patients within OHCs are the fundamental building blocks for online value cocreation. One of the most important elements of having transparent and effective communication is trust. Trust can serve as a significant mechanism in reducing the uncertainty and complexity of exchange and enhancing the credibility of online health information [ ]. The level of trust affects patients’ behavior with health care organizations. The transparency of communication is critical for a successful and sustainable response to patients’ health problems. This feature enables both health care organizations and patients to interact directly, allowing them to be actively involved with the value cocreation process [ ].
Informational and Social Support for Patients
OHCs provide opportunities for stakeholders such as patients, physicians, caregivers, and health care organizations to access and share health information as well as contribute to the value cocreation process, diminish geographical barriers, and provide informational, social, and emotional support [, ]. Value cocreation process occurs when organizations, stakeholders, and users integrate and renew each other’s resources [ ]. In this context, OHCs have immense potential to facilitate the process of value cocreation among actors in the health care ecosystem as well as provide an additional mechanism for obtaining informational and emotional support. Due to the nature of OHCs that provides access to information and coordinated social interaction, they constitute an alternative solution for patients’ needs, such that they likely improve the well-being of individuals and society as a whole [ ]. In fact, OHCs have developed as a part of the supplementary service of many health care organizations, where patients are directed to the health care organization’s OHC to receive socioemotional support. OHCs are the major source of informational, social, and emotional support for people with health problems, and members of such communities interact with other stakeholders to seek, receive, and provide different types of supports (informational, social, and emotional) [ , , ]. Users of OHCs participate and experience the various types of value cocreation via social support exchange within these types of communities [ ]. Health care organizations can motivate patients in OHCs’ activities by providing positive feedback to patients who are using digital health platforms. These types of feedback increase the patient’s motivation and serve as a signal that the health care organization approves and welcomes patients’ activities in the health care domain [ ].
Patient Empowerment in Self-Management
OHCs empower patients in the self-management process through the exchange of health-related information and patient experiences. In other words, OHCs can be used to actively engage and empower patients in their health care journey. Engagement in health care service innovation enables health care organizations to be more proactive, establishing and supporting effective approaches for online value cocreation. The empowerment of patients leads to improving the patients’ role in value cocreation . The patient’s empowerment and engagement contribute to enhancing the quality of health care outcome, and health care organizations have started to recognize the significance of patient empowerment as a driver of patient-centered care. Self-management is where health care organizations can enhance patient participation, supporting patients in controlling their lives [ ]. Helping patients with chronic diseases such as type 2 diabetes or asthma to self-manage their condition leads to enhanced quality of care and decreases cost and inappropriate use of health care resources [ ].
The goal of this study was to improve the theoretical understanding toward patient-driven health care innovation and in this case, identifying the potential of online value cocreation for health care organizations. We conducted a descriptive review of the published papers on the potential of online value cocreation for health care organizations. After analyzing a large number of studies, we now, understand the significance of the digital health platforms in the value cocreation process for both health care organizations and patients by identifying the salient themes of the current literature. These themes were communication extension, improved health literacy for patients and health care organizations, communication transparency with patients, informational and social support for patients, and patient empowerment in self-management.
Numerous public and nonprofit health care organizations have started to embrace OHCs to support patients’ requirements to locate others with similar health issues and share experiences at a peer-to-peer level . Accordingly, we believe health care organizations perceive OHCs as a tool for extending the communication from the traditional power balanced between health care professionals and patients to online interaction among all stakeholders within the health care service ecosystem, empowering patients in their self-management of diseases by cocreating social and emotional value within OHCs, informationally and socially supporting patients, and establishing transparent communication with patients. Health care organizations might benefit from the interaction between members in OHCs. For example, by monitoring the user-generated content within the community, organizations can gain a deeper and better understanding of members’ needs and finally co-innovate and coproduce health services with customers. This generated knowledge enhances members’ and organizations’ health literacy, helping patients in the decision-making process regarding health care services. In essence, productive collaboration with multiple stakeholders improves the resource, competencies, and capabilities, which fosters values in the cocreation process [ , ]. On the basis of our findings and in line with recommendations to the industry, we propose that health care organizations can prioritize the findings of this study (themes). By prioritizing the salient themes, health care organizations can leverage the potential of online value cocreation to improve their service quality and patient empowerment. According to the recent studies, “the organizations that have been shifting their strategies toward value-based care generally share certain advantages: financial stability, positive relationship with physicians, advanced information systems and (often) affiliation with health plan” [ ]. Therefore, this study elucidates the potential that OHCs provide to health care organizations to engage in the value cocreation process. We employed the findings of this review in the real-world program for diabetes group education through conceptualizing OHCs and their potential for this cohort.
Strengths and Limitations
There are multiple strengths of this systematic review. It was conducted based on the PRISMA guidelines. It employed a rigorous and extensive search strategy to identify the most relevant outlets. Paper selection process based on the inclusion criteria, paper codding, and theme identification were conducted in duplicate by two members of the research team independently to ensure the accuracy of the findings. This study yielded beneficial findings that enabled us to synthesize and present the current state of the art of the potential of online value cocreation for health care organizations. Although this literature review sheds light on the potential of online value cocreation for health care organizations, some limitations of our review need to be considered. Our inclusion criteria limited our review results to only English-language articles and published, peer-reviewed literature between 2013 and 2019. Hence, these restrictions might have led to an exclusion of relevant literature.
Directions for Future Studies
This review helped us to explore some interesting directions for future work. Future studies can delve into providing a holistic view of the importance of health service coproduction and value cocreation in shaping a dynamic health care ecosystem [- ]. There is also a lack of understanding on how interactions among stakeholders, especially at the meso and macro levels, contribute to the emergence of value cocreation [ ]. Another avenue for future research is to investigate the perspective in which health care organizations are able to engage indirectly in online value cocreation. In fact, the cocreation of value through engagement in health care warrants more detailed exploration and highlights the need for more empirical analysis and data on this significant area in health care services [ ]. Only a few studies explored the value cocreation at higher levels of health care service ecosystems such as the meso and macro levels. Accordingly, future research can examine the online value cocreation in the health care service ecosystem in the higher levels of the service ecosystem. Future research should be directed toward improving understanding of the engagement level of health care organizations in value cocreation through OHCs. In particular, enhanced understanding of health care organizations’ participation determinants in online value cocreation process and the factors that underpin this phenomenon is required. This may involve future studies with a long follow-up period. The following recommendations for future work might be useful for both health care researchers and organizations:
- Investigate how health care organizations indirectly engage with online value cocreation process. Identify their challenges and policies for online activities in the virtual communities.
- Enhance understanding of the level of engagement of health care organizations in online value cocreation and explore health care organizations’ participation determinants in the online value cocreation process.
- Develop strategies to boost ongoing engagement of health care consumers. This will empower patients in their self-management of chronic diseases.
- Increase understanding of how health care organizations encourage health care consumers in the health care service coproduction and co-innovation through OHCs.
- Implement security and data privacy rules considering health care organizations’ perspectives on OHCs, trust-building measures, and challenges associated with the privacy in OHCs.
The findings of this study enrich our understanding of online value cocreation and its potential for health care organizations by providing a rich review of the literature in online value cocreation. The health care domain can be conceived as a cocreating service system based on the engagement of health care organizations and patients, caregivers, and health care professionals. In this regard, digital platform is one of the most prevalent sources of interaction and online value cocreation. Accordingly, this study aims to improve theoretical understanding toward a patient-driven innovation, such as OHCs, from the value cocreation lenses. Our findings reveal that to foster the implementation of an effective service ecosystem, health care organizations should be able to empower both patients and health care professionals to allow them to actively participate in value cocreation processes in digital platforms such as OHCs. We contend that the outcomes of our study can provide a bird’s-eye view for health care organizations to leverage OHCs for improving their business intelligence along with patient empowerment. Our findings would be useful for health care organization policymakers on how digital health platforms such as OHCs facilitate the value cocreation for health care organizations. Moreover, the findings of this study would be able to guide health care organizations in choosing and implementing strategies and features in their online communities that lead to positive outcomes. Here, we argue that existing OHCs can assist researchers and health care organizations not only by identifying the benefits and potential but also by facilitating value cocreation in the health care service ecosystem.
Conflicts of Interest
The variant of search terms in different databases.DOCX File , 14 KB
Profile characteristics of selected papers.DOCX File , 13 KB
- OECD. OECD iLibrary. Health Spending URL: https://www.oecd-ilibrary.org/social-issues-migration-health/health-spending/indicator/english_8643de7e-en [accessed 2018-09-14]
- Caulfield BM, Donnelly SC. What is Connected Health and why will it change your practice? QJM Int J Med 2013;106(8):703-707. [CrossRef] [Medline]
- Nambisan P. Enabling consumer-driven service innovation in health care: the role of online Health Information Technologies (HIT). In: Nambisan S, editor. Information Technology and Product Development. Boston, MA: Springer; 2010:159-177.
- Wang X, Zhao K, Street N. Analyzing and predicting user participations in online health communities: a social support perspective. J Med Internet Res 2017 Apr 24;19(4):e130 [FREE Full text] [CrossRef] [Medline]
- Janamian T, Crossland L, Jackson CL. Embracing value co-creation in primary care services research: a framework for success. Med J Aust 2016 Apr 18;204(7 Suppl):S5-11. [CrossRef] [Medline]
- McColl-Kennedy JR. Health care in service science special issue of Australasian Marketing Journal. Australas Mark J 2014 Aug;22(3):165-167. [CrossRef]
- Prahalad CK, Ramaswamy V. Co‐creating unique value with customers. Strategy Leadersh 2004;32(3):4-9. [CrossRef]
- Vargo SL, Lusch RF. The four service marketing myths: remnants of a goods-based, manufacturing model. J Serv Res 2004;6(4):324-335. [CrossRef]
- Hardyman W, Daunt KL, Kitchener M. Value co-creation through patient engagement in health care: a micro-level approach and research agenda. Public Manag Rev 2015;17(1):90-107. [CrossRef]
- Loane SS, Webster CM. Consumer-to-consumer value within social networks. Mark Rev 2014;14(4):444-459. [CrossRef]
- Nambisan P, Nambisan S. Models of consumer value cocreation in health care. Health Care Manage Rev 2009;34(4):344-354. [CrossRef] [Medline]
- Russo G, Tartaglione AM, Cavacece Y. Empowering patients to co-create a sustainable healthcare value. Sustain 2019;11(5):1315. [CrossRef]
- Vilhauer RP. Perceived benefits of online support groups for women with metastatic breast cancer. Women Health 2009;49(5):381-404. [CrossRef] [Medline]
- Qiu B, Zhao K, Mitra P, Wu D, Caragea C, Yen J, et al. Get Online Support, Feel Better -- Sentiment Analysis and Dynamics in an Online Cancer Survivor Community. In: Proceedings of the 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third International Conference on Social Computing. 2011 Presented at: SocialCom'11; October 9-11, 2011; Boston. [CrossRef]
- Hilliard ME, Sparling KM, Hitchcock J, Oser TK, Hood KK. The emerging diabetes online community. Curr Diabetes Rev 2015;11(4):261-272 [FREE Full text] [CrossRef] [Medline]
- Palumbo R. The Bright Side and the Dark Side of Patient Empowerment: Co-creation and Co-destruction of Value in the Healthcare Environment. Switzerland: Springer; 2017.
- Aung E, Donald M, Coll JR, Williams GM, Doi SA. Association between patient activation and patient-assessed quality of care in type 2 diabetes: results of a longitudinal study. Health Expect 2016 Apr;19(2):356-366 [FREE Full text] [CrossRef] [Medline]
- Schmidt M, Eckardt R, Scholtz K, Neuner B, von Dossow-Hanfstingl V, Sehouli J, PERATECS Group. Patient empowerment improved perioperative quality of care in cancer patients aged ≥ 65 years - a randomized controlled trial. PLoS One 2015;10(9):e0137824 [FREE Full text] [CrossRef] [Medline]
- Bronstein J. Is this OCD?: Exploring conditions of information poverty in online support groups dealing with obsessive compulsive disorder. Inform Res 2014;19(4):-.
- Dodds SL. Semantic Scholar.: Massey University; 2015. Consumer Value and Value Co-Creation in Complementary and Alternative Medicine (CAM) Health Services: A Thesis Presented in Partial Fulfilment of the Requirements for the Degree of Doctor of Philosophy in Marketing URL: https://pdfs.semanticscholar.org/aca0/a9d513c3e16905ace29081e01ced3d59b65f.pdf?_ga=2.239037376.1106761467.1581948404-1679671381.1567599385 [accessed 2020-02-17]
- Aghdam AR, Watson J, Ziaimatin H. Online Value Co-Creation in the Healthcare Service Ecosystem: A Review. In: Proceedings of the 2018 Australasian Conference on Information Systems. 2018 Presented at: ACIS'18; Dec 3-5, 2018; Sydney.
- Forouzandeh S, sheikhahmadi A, Rezaei Aghdam A, Xu S. New centrality measure for nodes based on user social status and behavior on Facebook. Int J of Web Inf Syst 2018;14(2):158-176 [FREE Full text] [CrossRef]
- Palumbo R. Contextualizing co-production of health care: a systematic literature review. Int J Public Sec Manag 2016;29(1):72-90. [CrossRef]
- Sharma S, Conduit J, Hill SR. Organisational capabilities for customer participation in health care service innovation. Australas Mark J 2014;22(3):179-188. [CrossRef]
- Willis C, Saul J, Bitz J, Pompu K, Best A, Jackson B. Improving organizational capacity to address health literacy in public health: a rapid realist review. Public Health 2014 Jun;128(6):515-524. [CrossRef] [Medline]
- Camacho N, Landsman V, Stremersch S. The connected patient. In: The Connected Customer: The Changing Nature of Consumer and Business Markets. Abingdon-on-Thames: Routledge Academic; 2010:107-139.
- Osei-Frimpong K, Wilson A, Lemke F. Patient co-creation activities in healthcare service delivery at the micro level: the influence of online access to healthcare information. Technol Forecast Soc Change 2018 Jan;126:14-27. [CrossRef]
- Ostrom AL, Parasuraman A, Bowen DE, Patrício L, Voss CA. Service research priorities in a rapidly changing context. J Serv Res 2015;18(2):127-159. [CrossRef]
- Nambisan S, Nambisan P. How to profit from a better 'virtual customer environment'. MIT Sloan Manag Rev 2008 Mar;49(3):53-61 [FREE Full text]
- Nambisan S. Designing virtual customer environments for new product development: toward a theory. Acad Manag Rev 2002;27(3):392-413. [CrossRef]
- Holman H, Lorig K. Patients as partners in managing chronic disease. Partnership is a prerequisite for effective and efficient health care. Br Med J 2000 Feb 26;320(7234):526-527 [FREE Full text] [CrossRef] [Medline]
- Sabadosa KA, Batalden PB. The interdependent roles of patients, families and professionals in cystic fibrosis: a system for the coproduction of healthcare and its improvement. BMJ Qual Saf 2014 Apr;23(Suppl 1):i90-i94. [CrossRef] [Medline]
- Vennik FD, Adams SA, Faber MJ, Putters K. Expert and experiential knowledge in the same place: patients' experiences with online communities connecting patients and health professionals. Patient Educ Couns 2014 May;95(2):265-270. [CrossRef] [Medline]
- Durugbo C, Pawar K. Visualising the Co-Creation Process. In: Proceedings of the 2012 18th International ICE Conference on Engineering, Technology and Innovation. 2012 Presented at: ICE'12; June 18-20, 2012; Munich, Germany. [CrossRef]
- Payne AF, Storbacka K, Frow P. Managing the co-creation of value. J Acad Mark Sci 2007 Aug;36(1):83-96. [CrossRef]
- Lusch RF, Nambisan S. Service innovation: a service-dominant logic perspective. Manag Inf Syst Q 2015;39(1):155-175. [CrossRef]
- Goh JM, Gao G, Agarwal R. The creation of social value: can an online health community reduce rural-urban health disparities? Manag Inf Syst Q 2016;40(1):247-263. [CrossRef]
- van Oerle S, Lievens A, Mahr D. Value co-creation in online healthcare communities: the impact of patients’ reference frames on cure and care. Psychol Mark 2018;35(9):629-639. [CrossRef]
- Yan Z, Wang T, Chen Y, Zhang H. Knowledge sharing in online health communities: a social exchange theory perspective. Inf Manag 2016;53(5):643-653. [CrossRef]
- Amann J. Democratising healthcare: The role of eHealth technologies in driving patient participation. EMJ Innov 2017;1(1):40-46 [FREE Full text]
- van Oerle S. Value Co-Creation in Online Health Communities: The Role of Participants’ Posts, Network Position and Behavioral Patterns. Antwerp, Belgium: UAntwerp; 2016.
- Nambisan P, Gustafson D, Pingree S, Hawkins R. Patients' sociability and usability experience in online health communities: impact on attitudes towards the healthcare organisation and its services. Int J Web Based Commun 2010;6(4):395-409. [CrossRef]
- Hartmann BJ, Wiertz C, Arnould EJ. Exploring consumptive moments of value-creating practice in online community. Psychol Mark 2015;32(3):319-340. [CrossRef]
- Sweeney JC, Danaher TS, McColl-Kennedy JR. Customer effort in value cocreation activities: improving quality of life and behavioral intentions of health care customers. J Serv Res 2015;18(3):318-335. [CrossRef]
- Chen L, Straub DW. The Impact of Virtually Crowdsourced Social Support on Individual Health: Analyzing Big Datasets for Underlying Causalities. In: Proceedings of the Twenty-first Americas Conference on Information Systems. 2015 Presented at: AMCIS'15; August 13-15, 2015; Puerto Rico.
- Willis E. The making of expert patients: the role of online health communities in arthritis self-management. J Health Psychol 2014 Dec;19(12):1613-1625. [CrossRef] [Medline]
- Stanoevska-Slabeva K, Schmid BF. A Typology of Online Communities and Community Supporting Platforms. In: Proceedings of the 34th Annual Hawaii International Conference on System Sciences. 2001 Presented at: HICSS'01; January 6, 2001; Maui, HI, USA. [CrossRef]
- Mazzoni D, Cicognani E. Sharing experiences and social support requests in an internet forum for patients with systemic lupus erythematosus. J Health Psychol 2014 May;19(5):689-696. [CrossRef] [Medline]
- Parrish ES, Cornelious L. Perceptions regarding online support, illness, information, and awareness of women with cancer. J Behav Stud Bus 2015 Feb;8:1 [FREE Full text]
- Litchman ML, Rothwell E, Edelman LS. The diabetes online community: older adults supporting self-care through peer health. Patient Educ Couns 2018 Mar;101(3):518-523. [CrossRef] [Medline]
- Ciasullo MV, Cosimato S, Palumbo R, Storlazzi A. Value co-creation in the health service ecosystems: the enabling role of institutional arrangements. Int Bus Res 2017;10(12):222. [CrossRef]
- Serbanati LD, Ricci FL, Mercurio G, Vasilateanu A. Steps towards a digital health ecosystem. J Biomed Inform 2011 Aug;44(4):621-636 [FREE Full text] [CrossRef] [Medline]
- Amann J, Rubinelli S. Views of community managers on knowledge co-creation in online communities for people with disabilities: qualitative study. J Med Internet Res 2017 Oct 10;19(10):e320 [FREE Full text] [CrossRef] [Medline]
- Rupert DJ, Moultrie RR, Read JG, Amoozegar JB, Bornkessel AS, O'Donoghue AC, et al. Perceived healthcare provider reactions to patient and caregiver use of online health communities. Patient Educ Couns 2014 Sep;96(3):320-326. [CrossRef] [Medline]
- Moorhead SA, Hazlett DE, Harrison L, Carroll JK, Irwin A, Hoving C. A new dimension of health care: systematic review of the uses, benefits, and limitations of social media for health communication. J Med Internet Res 2013 Apr 23;15(4):e85 [FREE Full text] [CrossRef] [Medline]
- Munson SA, Cavusoglu H, Frisch L, Fels S. Sociotechnical challenges and progress in using social media for health. J Med Internet Res 2013 Oct 22;15(10):e226 [FREE Full text] [CrossRef] [Medline]
- Moturu ST, Liu H. Quantifying the trustworthiness of social media content. Distrib Parallel Databases 2011;29(3):239-260. [CrossRef]
- Bosslet GT, Torke AM, Hickman SE, Terry CL, Helft PR. The patient-doctor relationship and online social networks: results of a national survey. J Gen Intern Med 2011 Oct;26(10):1168-1174 [FREE Full text] [CrossRef] [Medline]
- Abirami A, Askarunisa A. Sentiment analysis model to emphasize the impact of online reviews in healthcare industry. Online Inf Rev 2017;41(4):471-486. [CrossRef]
- Esquivel A, Meric-Bernstam F, Bernstam EV. Accuracy and self correction of information received from an internet breast cancer list: content analysis. Br Med J 2006 Apr 22;332(7547):939-942 [FREE Full text] [CrossRef] [Medline]
- Chandler JD, Lusch RF. Service systems: a broadened framework and research agenda on value propositions, engagement, and service experience. J Serv Res 2015;18(1):6-22. [CrossRef]
- Amann J, Zanini C, Rubinelli S. What online user innovation communities can teach us about capturing the experiences of patients living with chronic health conditions. A scoping review. PLoS One 2016;11(6):e0156175 [FREE Full text] [CrossRef] [Medline]
- Paré G, Trudel M, Jaana M, Kitsiou S. Synthesizing information systems knowledge: a typology of literature reviews. Inf Manag 2015;52(2):183-199. [CrossRef]
- Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med 2009 Jul 21;6(7):e1000100 [FREE Full text] [CrossRef] [Medline]
- Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006 Jan;3(2):77-101. [CrossRef]
- Nili A, Tate M, Johnstone D. The process of solving problems with self-service technologies: a study from the user’s perspective. Electron Commer Res 2018;19(2):373-407. [CrossRef]
- Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods 2006;5(1):80-92. [CrossRef]
- Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today 2004 Feb;24(2):105-112. [CrossRef] [Medline]
- Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs 2008 Apr;62(1):107-115. [CrossRef] [Medline]
- Rantala K, Karjaluoto H. Combining Digitization with Healthcare Service Processes: Value Co-creation Opportunities Through Standard Work. In: Proceedings of the 30th Bled eConference. 2017 Presented at: 8thInternational Research Conference Management Challenges in the 21stCentury,; June 18 - 21, 2017; Bled, Slovenia. [CrossRef]
- Hajli MN, Sims J, Featherman M, Love PE. Credibility of information in online communities. J Strateg Mark 2015;23(3):238-253. [CrossRef]
- Nambisan S, Nambisan P. How should organizations promote equitable distribution of benefits from technological innovation in health care? AMA J Ethics 2017 Nov 1;19(11):1106-1115 [FREE Full text] [CrossRef] [Medline]
- Pikkarainen M, Ervasti M, Hurmelinna-Laukkanen P, Nätti S. Orchestration roles to facilitate networked innovation in a healthcare ecosystem. Technol Innov Manag Rev 2017;7(9):30-43. [CrossRef]
- Bornkessel A, Furberg R, Lefebvre RC. Social media: opportunities for quality improvement and lessons for providers-a networked model for patient-centered care through digital engagement. Curr Cardiol Rep 2014 Jul;16(7):504. [CrossRef] [Medline]
- Spanò R, Di Paola N, Bova M, Barbarino A. Value co-creation in healthcare: evidence from innovative therapeutic alternatives for hereditary angioedema. BMC Health Serv Res 2018 Jul 20;18(1):571 [FREE Full text] [CrossRef] [Medline]
- Beirão G, Patrício L, Fisk RP. Value cocreation in service ecosystems: investigating health care at the micro, meso, and macro levels. J Serv Manag 2017;28(2):227-249. [CrossRef]
- Kuenne C, Agarwal R. Online Innovation Intermediaries as a Critical Bridge between Patients and Healthcare Organizations. In: Proceedings of the 12th International Conference on Wirtschaftsinformatik. 2015 Presented at: WI'15; March 4-6, 2015; Osnabrück, Germany.
- Petrakaki DI. Producing Communal Health Through Self Care: The Emergence of Digital Patient Activism. In: Proceedings of the 25th European Conference on Information Systems. 2017 Presented at: ECIS'17; June 5-10, 2017; Portugal.
- Agarwal N, Soh C, Yeow A. Value Co-creation in Service Ecosystems: A Member Perspective. In: Proceedings of the Thirty Seventh International Conference on Information Systems. 2016 Presented at: ICS'16; December 11-14, 2016; Dublin.
- Zainuddin N, Tam L, McCosker A. Serving yourself: value self-creation in health care service. J Serv Mark 2016;30(6):586-600. [CrossRef]
- Palumbo R, Annarumma C, Musella M. Exploring the meaningfulness of healthcare organizations: a multiple case study. Int J Public Sec Manag 2017;30(5):503-518. [CrossRef]
- Tartaglione AM, Cavacece Y, Cassia F, Russo G. The excellence of patient-centered healthcare: investigating the links between empowerment, co-creation and satisfaction. TQM J 2018;30(2):153-167. [CrossRef]
- van der Eijk M, Faber MJ, Aarts JW, Kremer JA, Munneke M, Bloem BR. Using online health communities to deliver patient-centered care to people with chronic conditions. J Med Internet Res 2013 Jun 25;15(6):e115 [FREE Full text] [CrossRef] [Medline]
- Volland D, Eurich M. ICT-enabled Value Creation in Community Pharmacies: an Applied Design Science Research Approach. In: Proceedings of the Thirty Fifth International Conference on Information Systems. 2014 Presented at: ICIS'14; 11/12/2014; Auckland.
- Cubaka VK, Schriver M, Cotton P, Nyirazinyoye L, Kallestrup P. Providers' perceptions of communication with patients in primary healthcare in Rwanda. PLoS One 2018;13(4):e0195269 [FREE Full text] [CrossRef] [Medline]
- Ramaswamy V, Ozcan K. The Co-Creation Paradigm. Redwood City: Stanford Business Books; 2014.
- Zhao J, Wang T, Fan X. Patient value co-creation in online health communities: social identity effects on customer knowledge contributions and membership continuance intentions in online health communities. J Serv Manag 2015;26(1):72-96. [CrossRef]
- Loane SS, Webster CM, D’Alessandro S. Identifying consumer value co-created through social support within online health communities. J Macromark 2014;35(3):353-367. [CrossRef]
- Chung JE. Patient-provider discussion of online health information: results from the 2007 Health Information National Trends Survey (HINTS). J Health Commun 2013;18(6):627-648. [CrossRef] [Medline]
- Stewart Loane S, Webster CM. Social capital and consumer value co-created within an online health community. J Nonprofit Public Sec Mark 2017;29(3):317-345. [CrossRef]
- Ramaswamy V, Chopra N. Building a culture of co-creation at Mahindra. Strateg Leader 2014;42(2):12-18. [CrossRef]
- Kaiser LS, Lee TH. Harvard Business Review. 2015 Oct 8. Turning Value-Based Health Care into a Real Business Model URL: https://hbr.org/2015/10/turning-value-based-health-care-into-a-real-business-model [accessed 2020-02-17]
- Annarumma C, Palumbo R. Contextualizing health literacy to health care organizations: exploratory insights. J Health Manag 2016;18(4):611-624. [CrossRef]
- Pappa GL, Cunha TO, Bicalho PV, Ribeiro A, Silva AP, Meira W, et al. Factors associated with weight change in online weight management communities: a case study in the LoseIt Reddit community. J Med Internet Res 2017 Jan 16;19(1):e17 [FREE Full text] [CrossRef] [Medline]
- Frow P, McColl-Kennedy JR, Payne A. Co-creation practices: their role in shaping a health care ecosystem. Ind Mark Manag 2016;56:24-39. [CrossRef]
|IS: information systems|
|OHC: online health community|
|PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses|
Edited by E Borycki; submitted 18.09.19; peer-reviewed by G Deckard, S Forouzandeh, P Naraei, N Sundar Rajan, P Balasooriya, N Hasan, S Xu; comments to author 30.11.19; revised version received 02.12.19; accepted 10.12.19; published 24.04.20
©Atae Rezaei Aghdam, Jason Watson, Cynthia Cliff, Shah Jahan Miah. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 24.04.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.