The Karma system is currently undergoing maintenance (Monday, January 29, 2018).
The maintenance period has been extended to 8PM EST.

Karma Credits will not be available for redeeming during maintenance.
Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 23.10.18 in Vol 20, No 10 (2018): October

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/11006, first published May 09, 2018.

This paper is in the following e-collection/theme issue:

    Original Paper

    Oncology Patient Interest in the Use of New Technologies to Manage Their Disease: Cross-Sectional Survey

    Corresponding Author:

    Vicente Escudero-Vilaplana, PharmD, PhD

    Hospital General Universitario Gregorio Marañón

    Calle de Dr Esquerdo 46

    Madrid, 28007

    Spain

    Phone: 34 915867714 ext 477714

    Email:


    ABSTRACT

    Background: Information and communication technologies (ICTs) in oncology can revolutionize the medical care of cancer patients. ICTs can promote patients’ empowerment and real-time disease monitoring. There is limited information about the impact of ICTs in cancer patients or their level of interest in using these tools for greater management of their condition.

    Objective: This study aimed to understand the ICT usage profile in hematology-oncology patients to identify their needs and determine their level of interest in these technologies as a means of managing their disease.

    Methods: A 28-item questionnaire was drawn up by a multidisciplinary team including pharmacists and oncologists. The questions were organized into 3 blocks, which were as follows: block A—sociodemographic characteristics; block B—use of ICTs when searching for health-related information; and block C—usage preferences for health apps. Hematology-oncology patients receiving treatment between May and July 2017 were included. A paper copy of the questionnaire was handed over to patients in either the day hospital or the pharmaceutical care consultancy in pharmacy services.

    Results: A total of 650 questionnaires were handed out, with a participation of 94.0% (611/650). Patient sociodemographic characteristics were as follows: mean age was 57.8 years (age range: 19-91). Of 611 participants, 40.7% (249/611) had a university education, and 45.1% (276/611) of participants reported their overall state of health to be good. Results from use of ICTs when searching for health-related information were as follows: 87.1% (532/611) of participants were interested in being informed about health-related matters. Of all participants, 75.5% (532/611) sought information from health professionals and 61.3% (375/611) on the internet. Before going to their doctor’s appointment, 21.8% (133/611) of patients looked up information about their disease or treatment on the internet. This access to the internet rose to 50.9% (311/611) after their first medical appointment with their oncologist. Usage preferences for health apps were as follows: 82.7% (505/611) had a smartphone, whereas 20.3% (124/611) had a health app installed. Overall, 81.5% (498/611) would use an app if their health professional recommended it to them, but 39.6% (242/611) were not willing to pay for it.

    Conclusions: The hematology-oncology patients showed a great deal of interest in searching for health-related information by means of ICTs, especially using smartphones and apps. The issues that drew the most interest in terms of apps were appointment management, advice on disease management, and communication with health professionals. Free access to these features and the recommendation by a health professional are important factors when it comes to their use. Therefore, the health care provider is a key element in the recommendation of ICTs, providing their knowledge and experience concerning their correct usage.

    J Med Internet Res 2018;20(10):e11006

    doi:10.2196/11006

    KEYWORDS



    Introduction

    Population aging, improvements in public health care, and therapeutic advances have given rise to an epidemiological pattern that is mainly represented by chronic diseases. This new patient profile introduces additional requirements in terms of patient care (as it corresponds to more detailed health information) and greater opportunities for communication and even novel telecare services. In this regard, information and communication technologies (ICTs) are bringing about a revolution in the management of chronic patients, acting as a source of information on one hand, while providing real-time monitoring for health professionals and two-way communication between both parties on the other [1-3]. The report Los Ciudadanos ante la e-Sanidad (Public Opinion on eHealth Care) by the Spanish National Observatory of Telecommunications and Information Society (ONTSI) estimated that 70.4% of the Spanish population owns a smartphone, and 74.4% of internet users refer to the internet for health-related information [4].

    The introduction of mobile health has meant the classic features of ICTs (content, chats, and contacts) could be focused toward providing services for patients. The use of wireless and portable devices (smartphones, tablets, wearables, and smartwatches) facilitates the collection, processing, and transmission of health information of patient through mobile phone apps and remote monitoring devices. All these features can present several advantages such as developing the active role of patients in their own health care and affording health professionals’ real-time access to patient clinical information [5-8].

    Oncology is one of the medical fields that could benefit the most from these new tools [3,6]. Although cancer is associated with a high rate of morbidity and mortality, ongoing advances are producing higher survival rates, converting some of these diseases from fatal to chronic conditions [9]. In addition, patients are increasingly resorting to apps in search of information given the complexity of treatment and the numerous unknowns they must confront [3,10,11].

    Currently, a wide range of health apps are available, particularly ones designed especially for oncology patients [3,12]. These apps have several features and functions, from the simplest intended for accessing information, to the more complex apps that can help guide the diagnosis or perform patient follow-up [3]. However, many of the apps are developed without taking into account preferences and/or needs of a patient [10]. In fact, only 40% of those available are considered to have any value for addressing health issues, and just 2% provide two-way communication between the patient and health professional [12]. Many of these apps also suffer from a lack of scientific validity and reliability. A review conducted in November 2014 found that only 48.8% of apps designed for cancer patients had been developed by health professionals [3]. As these tools are not being regulated by the relevant institutions, the main onus falls on health professionals to ensure the validity of the apps they recommend or prescribe to their patients [2,3,10]. The first step when prescribing a quality ICT is awareness of the true impact these technologies are having on lives of patients.

    Therefore, our aim was to understand the usage profile of information and communication technologies in oncology patients to identify their needs and determine their degree of interest in these technologies as a means of managing their disease.


    Methods

    A 28-item questionnaire was designed by a multidisciplinary team, including pharmacists and oncologists, with experience of ICTs applied to the field of oncology. The questions were organized into the following 3 blocks: block A—sociodemographic characteristics of a patient (questions 1-9), block B—use of ICTs when searching for health-related information (questions 10-21), and block C—usage preferences for health apps (questions 22-28). The design of the questionnaire considered the model form created by ONTSI [4] and incorporated advice from a management consultancy firm specializing in process design, implementation, and improvement. With respect to the types of questions, the questionnaire comprised dichotomous (questions 2, 3, 6, 12, 18, 20, 22, and 27) with true or false response options or polytomous (questions 4-5, 7-10, 11, 13-17, 19, 21, and 23-26) categorical variables. A total of 10 patients completed a draft paper questionnaire to validate the fact that it was well understood.

    Hematology-oncology patients in antineoplastic therapy (chemotherapy, immunotherapy, oral targeted therapies, and hormone therapy) and/or support therapy were included. Patients younger than 18 years and those who would have had trouble understanding the questions because of language or cultural barriers were excluded. Participation was voluntary and anonymous. The inclusion period ran from May to July 2017. A paper copy of the questionnaire was handed over to every patient in the day hospital (administration or waiting rooms) or the pharmaceutical care consultancy in the outpatient pharmacy services area. Alternatively, patients could take the questionnaire home and return it filled out at their next appointment.

    The questionnaire was approved by the clinical research ethics committee of the hospital, project code EHPHDO2017, and conducted in accordance with the ethical principles laid down by the Declaration of Helsinki. It did not include any information about the personal data of patients to ensure data confidentiality.

    Data were analyzed using the software SPSS version 21.0 (IBM Corp) for Windows. The variables were analyzed using descriptive statistics. Normality was analyzed by means of the Kolmogorov-Smirnov test. Numeric variables were compared with Student t test or the Mann-Whitney test. The association between qualitative variables was studied using Pearson chi-square test or Fisher exact test. Missing data were handled with simple imputation method. The corresponding measures of association and risk were calculated along with their CIs. Results with a value of P<.05 were considered statistically significant.


    Results

    Patients’ Sociodemographic Characteristics

    A total of 650 questionnaires were handed out, with a participation of 94% (we finally analyzed 611 questionnaires). Sociodemographic characteristics of patients are shown in Table 1. The mean age of patients was 57.8 years (range: 19-91). Of all participants, 61.9% (378/611) were women, 89.5% (547/611) lived with other people, and 40.7% (249/611) had a university education. Overall, 29.2% (179/611) of cases corresponded to hematologic tumors. Among nonhematologic tumors, the most frequent were breast (124/611, 20.3%), colorectal (113/611, 18.5%), and lung (60/611, 9.8%). Over half of the patients considered their state of health was either good (45.1%, 276/611) or very good (7.8%, 48/611).

    Use of Information and Communication Technologies When Searching for Health-Related Information

    Figure 1 shows the frequency with which patients used different ICTs to search for information on the internet. With regard to health-related information, 87.1% (532/611) of patients were interested in staying informed about health issues. Of all subjects, 75.5% (462/611) sought information from health professionals and 61.3% (375/611) on the internet. Of these, 71.2% (436/611) searched through Google and 21.9% (134/611) by means of social networks (YouTube, Twitter, and Facebook, among others), 20.3% (124/611) used medical societies, and 20.1% (123/611) sought information via patient-advocacy groups.

    In response to the question concerning the reasons why patients looked for health information, 49.2% (301/611) replied they wanted to obtain information about disease prevention, healthy lifestyles, and health care, and 47.2% (289/611) were seeking information about the treatment their doctor had prescribed for them. We observed statistically significant differences depending on the level of education, age, sex, and tumor type. First, patients with secondary or university education and younger patients searched for more information on health (P<.001). Women sought more information regarding alternative medicines (P<.001) and how to get in touch with other people with similar health problems (P=.04). Patients with breast cancer were more likely to seek information about their treatment (P=.03) and alternative medicines (P<.001) than those with other types of tumor.

    As for the question regarding whether the information they found on the internet was easy to understand, 10.8% (66/611) of patients replied “always.” A higher proportion of young patients and those with secondary or university education responded “always” than those in other demographic groups (P<.001). For the question as to whether participants trusted the information they found on the internet, overall 21.1% (129/611) responded “no,” but this was a statistically more frequent reply among older patients (P<.001).

    Before going to their doctor’s appointment, 21.8% (133/611) of patients turned to the internet for information about their disease and/or treatment, an action that was more common in younger participants (P<.001). After their appointment, 50.9% (311/611) of participants referred to the internet, again this was more typical among younger patients, as well as those with secondary or university education (P<.001). The rest of the responses to questions covering the use of ICTs when looking for information on health issues are detailed in Table 2.

    Usage Preferences for Health Apps

    Table 3 shows the results for preferences regarding the use of health apps. Of all participants surveyed, 82.7% (505/611) had a smartphone and 20.3% (124/611) had a health app. With respect to mobile phone use, 56.7% (347/611) of participants used theirs to access the internet and 42.8% (262/611) to use apps, among other functions. Of the variables analyzed here, we found that younger patients used apps to obtain information about their illness and its treatment (P=.01) and to manage their medical appointments and record and monitor their symptoms (P<.01) with a greater frequency than the other sociodemographic groups. Furthermore, patients with secondary or university education were more likely to use apps for disease prevention, health problems, and improving their lifestyle (P=.004), as well as for managing their appointments with the health care center or health professional (P=.03) than patients with different levels of education.

    Figure 2 presents the reasons why our patients used health apps and their usage preferences. We observed that patients with secondary and/or university education were statistically more inclined than other the patient groups to use apps to manage medical appointments (P<.01), record and monitor their medication (P<.01), get in contact with health professionals (P<.01), and facilitate their remote monitoring (P=.02).

    Table 1. Sociodemographic characteristics of patients (N=611).
    View this table
    Figure 1. Frequency with which patients used different information and communication technologies to search for information on the internet.
    View this figure
    Table 2. Frequency of using new technologies to consult internet for oncohematological patients (N=611).
    View this table
    Table 3. Usage preferences for health apps (N=611).
    View this table
    Figure 2. Reasons why patients used a health app, and things they wish the app could help them with.
    View this figure

    Discussion

    Principal Findings and Comparison With Prior Work

    To our knowledge, this is the first survey aimed to identify the needs and interests of hematology-oncology patients in the ICT as a means of managing their disease. In this survey conducted in 611 patients, we observed that most of the patients (505/611, 82.7%) owned a smartphone. Furthermore, almost half of patients use their mobile, which was the most popular device among the different options, to perform internet searches every day.

    Use of Information and Communication Technologies When Searching for Health-Related Information

    We have seen that health is a cause for concern for 86.9% (531/611) of our patients. Traditionally, patients have tried to physically obtain medical information from ordinary health professionals (doctors, pharmacists, and nurses) [2,4,13]. However, the expansion and generalization of the use of ICTs has implied a radical change in how we obtain information about health and manage diseases [3,4,5,12,14]. Despite the fact that professional health care is still the main resource to obtain information on the pathology, 61.3% (375/611) of our patients turn to the internet to perform a query; similar data were reported by LC et al [15].

    In addition, in this study, we have noted that 21.8% (133/611) of patients look up facts about their disease before visiting the doctor, a figure that can rise to 50% after their appointment. These data are akin to those reported by ONTSI [4]. This highlights the growing interest shown by patients and could represent a problem because of the heterogeneous nature of the data. The internet, without the necessary knowledge, is not the most reliable source of health-related information [10,13]. Of all participants in our survey, 71.2% (436/611) used search engines such as Google, and 10.1% (62/611) employed apps to look for information. However, only 10.8% (66/611) always found the information easy to understand. In this regard, the health professional must assume a proactive role when recommending the most reliable websites or apps and adapt them to the understanding of a patient [3]. According to the ONTSI, 38.9% of patients would like their doctor to recommend devices or apps to help them manage their health [4], yet only 10% to 20% of health professionals recommend websites, devices, or apps to their patients [4,16].

    Usage Preferences for Health Apps

    If we analyze interests of our patients, more than 40% (244/611) would like to be able to communicate with their health professional by means of an app or via email, a figure close to the 37.3% detailed in the ONTSI report published in April 2016 [4]. At this time, only 20.3% (124/611) of patients have a health-related app although 81.5% (498/611) would use them if recommended by their health care provider. There must be a certain guarantee about the accuracy and quality of the information on the apps, so this does not become a barrier for their own prescription. In a review of apps focused on cancer patients, it was found that only 48.8% were developed with the participation of a health care organization, only half of the apps had been updated in the last year, while 30% had not been updated for over 2 years [3].

    Despite the interest these new technologies generate, the cost is a key factor governing their use. Considering the average price of apps designed for cancer patients is €2.15 [3], half of all patients would not download them if they had to pay this amount. Probably, this is because there is a culture among Spanish patients and relatives that everything provided by hospitals is paid for by the social security system and they have never had to pay for anything.

    Finally, it is worth highlighting that although the world of apps is evolving considerably, they do not actually cover all our patients’ needs [17,18]. Obtaining information about a disease or its treatment would interest 50% of our patients, which is more than the 28.1% reported by Soler et al [19]; however, less than 20% used apps for this purpose. Moreover, remote monitoring by health professionals is currently one of the least used functions, although it has the greatest potential for use [20-23], as 1 in 3 patients would like to have an app with this feature. Providing a new means of communication through ICTs could offer patients the opportunity to get involved in their disease and assume more responsibility with regard to monitoring their health, thus promoting patient empowerment [5,6,10,24,25]. That is why an easy-to-use app would prove to be a complete tool for this type of patient [3,5,6,13]. To date, existing apps for cancer patients concentrate solely on isolated problems—they do not cover all the needs associated with hematology-oncology patients [3,21-24].

    Limitations

    The survey is a type of quantitative research to obtain a large amount of information that objectively can be extrapolated. However, there are other qualitative techniques such as interviews or discussion groups that allow us to know in-depth the perceptions of patients. This type of technique can complete the surveys so that the analysis of the results is much more complete. The results of this survey are being taken into account in a larger project that we are carrying out. The aim of this project was to improve the integral circuit of oncohematological patient care. The semistructured interview methodology with groups of patients is being used. Another limitation of the survey was the number of questions, which could complicate its degree of fulfillment. The questionnaire was therefore handed out at the oncology day hospital so that patients could complete it while they received chemotherapy. Participants could also take the questionnaire home with them and return it completed at their next appointment that resulted in a very low percentage of dropouts. On the other hand, as the survey included new terms that were unfamiliar to some participants, they may not have understood some of the questions while completing the questionnaire. To overcome this limitation, the survey was mainly conducted in the oncology day hospital or outpatient clinic where collaborating researchers were available to help resolve any doubts patients may have had. The questionnaire also included a telephone number patients could call to clear up any doubts or questions that may arise while completing it at home. Finally, questions were completed by patients in Spain in the day hospital or the pharmaceutical care consultancy at pharmacy services. Thus, part of the results may not be representative of other cancer patients in different health systems. However, because we have described exhaustively the working methodology and the complete survey has been published, this work could be reproduced at any center.

    Conclusions

    The results of the survey show that hematology-oncology patients are very interested in finding health-related information via ICTs, especially using smartphones and apps. These apps, which are presented as tools that cover these needs, are used as both a source of information and as a new communication channel between patients and health professionals. Free access to apps is still an important factor when it comes to promoting their use and reaching a greater number of users. The app features that draw the most interest are appointment management, advice on disease management, and personalized communication with health professionals. However, many of the apps available have not been validated or updated and do not offer any alternatives to medical care. Therefore, the health professional plays an essential role in recommending and validating these tools to ensure they are of high quality standards.

    Acknowledgments

    The authors would like to thank the team at Speak Talk Communicate SL for their help preparing the manuscript and Gesco Consultores for advice on the survey. This project was supported by iPharma (Pharmacy Innovation Center at the Hospital General Universitario Gregorio Marañón) through funding received from ERDF Project PI13/02056; aid co-financed by the European Regional Development Fund “ERDF, a way of making Europe.”

    Conflicts of Interest

    None declared.

    References

    1. García Cuyás F, de San Pedro M, Ledesma Castelltor A. Las TICs y la gestión de pacientes crónicos. Sociedad Española Informática Salud 2014;105:11-13 [FREE Full text]
    2. Cepeda Díez JM, Meijome Sánchez XM, Santillán García A. Innovaciones en salud y tecnologías: las cosas claras. Rev enferm CyL 2012;4(1):28-32 [FREE Full text]
    3. Collado-Borrell R, Escudero-Vilaplana V, Ribed-Sánchez A, Ibáñez-García S, Herranz-Alonso A, Sanjurjo-Sáez M. Smartphone applications for cancer patients; what we know about them? Farm Hosp 2016 Jan 01;40(1):25-35 [FREE Full text] [CrossRef] [Medline]
    4. Los CALES. Ontsi.red. Opiniones y expectativas de los ciudadanos sobre el uso y aplicación de las TIC en el ámbito sanitario   URL: http://www.ontsi.red.es/ontsi/sites/ontsi/files/los_ciudadanos_ante_la_e-sanidad.pdf [WebCite Cache]
    5. Sawesi S, Rashrash M, Phalakornkule K, Carpenter JS, Jones JF. The impact of information technology on patient engagement and health behavior change: a systematic review of the literature. JMIR Med Inform 2016;4(1):e1 [FREE Full text] [CrossRef] [Medline]
    6. Weaver A, Young AM, Rowntree J, Townsend N, Pearson S, Smith J, et al. Application of mobile phone technology for managing chemotherapy-associated side-effects. Ann Oncol 2007 Nov;18(11):1887-1892 [FREE Full text] [CrossRef] [Medline]
    7. Kruse CS, Beane A. Health information technology continues to show positive effect on medical outcomes: systematic review. J Med Internet Res 2018 Feb 05;20(2):e41 [FREE Full text] [CrossRef] [Medline]
    8. Carroll JK, Moorhead A, Bond R, LeBlanc WG, Petrella RJ, Fiscella K. Who uses mobile phone health apps and does use matter? A secondary data analytics approach. J Med Internet Res 2017 Apr 19;19(4):e125 [FREE Full text] [CrossRef] [Medline]
    9. Phillips JL, Currow DC. Cancer as a chronic disease. Collegian 2010;17(2):47-50. [Medline]
    10. Bender JL, Yue RY, To MJ, Deacken L, Jadad AR. A lot of action, but not in the right direction: systematic review and content analysis of smartphone applications for the prevention, detection, and management of cancer. J Med Internet Res 2013;15(12):e287 [FREE Full text] [CrossRef] [Medline]
    11. Highland J, Clemens H. Docplayer. Mandated benefit review of SB 1070: An act relative to oral cancer therapy   URL: http:/​/docplayer.​net/​20040894-Mandated-benefit-review-of-sb-1070-an-act-to-relative-to-oral-cancer-therapy.​html [accessed 2018-03-21] [WebCite Cache]
    12. Aitken M, Lyle J. Microsites.schott. Patient Adoption of mHealth: Use, Evidence and Remaining Barriers to Mainstream Acceptance   URL: http:/​/microsites.​schott.com/​d/​studentchallenge/​346d3edb-327f-42ad-b3b5-d859b8c4cf6f/​1.0/​ims_report_patient_adoption_of_mhealth.​pdf [WebCite Cache]
    13. Mira JJ, Pérez-Jover V, Lorenzo S. [Navigating on the internet in search of health information: all that glitters is not gold] [Article in Spanish]. Aten Primaria 2004 Apr 30;33(7):391-399 [FREE Full text] [Medline]
    14. Kessel KA, Vogel MM, Kessel C, Bier H, Biedermann T, Friess H, et al. Mobile health in oncology: a patient survey about app-assisted cancer care. JMIR Mhealth Uhealth 2017 Jun 14;5(6):e81 [FREE Full text] [CrossRef] [Medline]
    15. An LC, Wallner L, Kirch MA. Online social engagement by cancer patients: a clinic-based patient survey. JMIR Cancer 2016 Aug 19;2(2):e10 [FREE Full text] [CrossRef] [Medline]
    16. Krebs P, Duncan DT. Health app use among US mobile phone owners: a national survey. JMIR Mhealth Uhealth 2015;3(4):e101 [FREE Full text] [CrossRef] [Medline]
    17. Robbins R, Krebs P, Jagannathan R, Jean-Louis G, Duncan DT. Health app use among US mobile phone users: analysis of trends by chronic disease status. JMIR Mhealth Uhealth 2017 Dec 19;5(12):e197 [FREE Full text] [CrossRef] [Medline]
    18. Halwas N, Griebel L, Huebner J. eHealth literacy, internet and eHealth service usage: a survey among cancer patients and their relatives. J Cancer Res Clin Oncol 2017 Nov;143(11):2291-2299. [CrossRef] [Medline]
    19. Soler Montaner I, García Muñoz S, Sangrador Pelluz C, Soler Montaner B, Soler Company E. SEFAF. Valencia. Spain: Sociedad Española de Farmacoterapia y Atención Farmacéutica (SEFAF); 2014. Paciente al día, atención farmacéutica al día. Impacto de las TIC en las estrategias de mejora de la adherencia terapéutica   URL: http:/​/sefaf.​com/​wp-content/​uploads/​2017/​07/​Paciente-al-d%C3%ADa-Atenci%C3%B3n-Farmac%C3%A9utica-al-d%C3%ADa.​pdf [accessed 2018-09-25] [WebCite Cache]
    20. Iqvia. The Growing Value of Digital Health: Evidence and Impact on Human Health and the Healthcare System   URL: https://www.iqvia.com/institute/reports/the-growing-value-of-digital-health [WebCite Cache]
    21. Voruganti T, Husain A, Grunfeld E, Webster F. Disruption or innovation? A qualitative descriptive study on the use of electronic patient-physician communication in patients with advanced cancer. Support Care Cancer 2018 Mar 04:2785-2792. [CrossRef] [Medline]
    22. Grünloh C, Myreteg G, Cajander Å, Rexhepi H. "Why Do They Need to Check Me?" Patient participation through eHealth and the doctor-patient relationship: qualitative study. J Med Internet Res 2018 Jan 15;20(1):e11 [FREE Full text] [CrossRef] [Medline]
    23. Kessel KA, Vogel MM, Schmidt-Graf F, Combs SE. Mobile apps in oncology: a survey on health care professionals' attitude toward telemedicine, mHealth, and oncological apps. J Med Internet Res 2016 Nov 24;18(11):e312 [FREE Full text] [CrossRef] [Medline]
    24. Ernsting C, Dombrowski SU, Oedekoven M, O Sullivan JL, Kanzler M, Kuhlmey A, et al. Using smartphones and health apps to change and manage health behaviors: a population-based survey. J Med Internet Res 2017 Apr 05;19(4):e101 [FREE Full text] [CrossRef] [Medline]
    25. Liu HY, Lee WC, Sun YC, Fen JJ, Chen TJ, Chou LF, et al. Hospital-owned apps in Taiwan: nationwide survey. JMIR Mhealth Uhealth 2018 Jan 16;6(1):e22 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    ICT: information and communication technology
    ONTSI: Spanish National Observatory of Telecommunications and Information Society


    Edited by G Eysenbach; submitted 09.05.18; peer-reviewed by J Ringwald, S Davis; comments to author 18.07.18; revised version received 20.07.18; accepted 23.07.18; published 23.10.18

    ©Roberto Collado-Borrell, Vicente Escudero-Vilaplana, Antonio Calles, Estela Garcia-Martin, Belen Marzal-Alfaro, Eva Gonzalez-Haba, Ana Herranz-Alonso, Maria Sanjurjo-Saez. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 23.10.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.