Background: One-quarter of the world’s population will suffer from depression symptoms at some point in their lives. Mental health services in developed countries are overburdened. Therefore, cost-effective interventions that provide mental health care solutions such as Web-based psychotherapy programs have been proposed.
Objective: The intent of the study was to identify expectations regarding Web-based psychotherapy for the treatment of depression in primary care among patients and health professionals that might facilitate or hinder its effects.
Methods: The expectations of untreated patients and health professionals were examined by means of interviews and focus groups. There were 43 participants (20 patients with mild and moderate levels of depression, 11 primary care physicians, and 12 managers; 22 of them for interviews and 21 for groups). A thematic content analysis from the grounded theory for interviews, and an analysis of the discursive positions of participants based on the sociological model for groups were performed. Interpretations were achieved by agreement between three independent analysts.
Results: All participants showed a good general acceptance of Web-based psychotherapy, appreciating possible advantages and improvements. Patients, physicians, and managers shared the same conceptualization of their expectations, although highlighting different aspects. Patients focused on the need for individualized and personalized interaction, while professionals highlighted the need for the standardization of the program. Physicians were concerned with extra workload, while managers were worried about optimizing cost-effectiveness.
Conclusions: Expectations of the different participants can conflict with each other. Finding a balanced position among them is needed if we are to harmoniously implement effective Web-based interventions for depression in routine clinical practice.
Depression currently ranks fourth in disorders with the highest disease burden, and in the coming five years, it will cause the second-highest level of disability worldwide [- ]. It has been said that 25% of the population will experience depression symptoms at some point in their lives [ ]. Depression brings with it significant economic, personal, inter-personal, and societal costs, and is associated with important impairments in quality of life and increased mortality [ - ].
Antidepressant medication is the most common form of treatment for depressive patients in primary care , but adherence is low [ , ]. In fact, two-thirds of depressed primary care patients would prefer psychological treatments to pharmacotherapy [ - ]. Psychological treatments obtain better results than pharmacological ones in adherence, relapse, recovery rates, and chronicity, reducing the number of physician visits and hospital days [ , ]. Despite their effectiveness, face-to-face psychotherapy interventions face some serious limitations. These include difficulties in delivering interventions to the community due to strong barriers in providing psychotherapies in current models of service delivery; constraints in health care resources; limited availability of clinicians, especially in rural areas; and low participation rates, even if access to those interventions is at little or no cost [ - ]. Mental health services in developed countries are overburdened, and given the lack of intended resources, are in need of cost-effective alternatives [ ].
Attempts to overcome barriers to access have been addressed recently through the evolution of a new understanding in mental health care that recognizes low-intensity services, such as bibliotherapy, psychoeducation, and Web-based interventions . Low-intensity interventions signify treatments that limit specialist time or use this time in a cost-effective manner and are provided, when appropriate, as a first option before referral to high-intensity interventions in which the presence of the therapist is higher [ ]. For example, when offered by an integrated health care provider using a stepped-care model, it has been suggested that the first choice should be the least intensive intervention that is appropriate for a person, enabling people to step up or down the pathway according to changing needs and in response to treatment [ ]. The Internet offers a new way of providing psychological treatment for common mental health problems such as depression [ , ], and may attract people who do not make use of traditional mental health services [ ]. Web-based treatment has been described as an intervention that is operationalized and transformed for delivery via the Internet [ ]. It is usually highly structured and can be roughly divided into unguided and guided interventions, with an identified therapist [ , , ]. Guided Internet interventions are considered to be more effective in reducing depression symptoms than unguided ones [ , ], with average levels of adherence estimated at 26% in unguided interventions and 72% in guided interventions [ ]. Web-based interventions may also resemble traditional psychotherapy with scheduled sessions [ ], but a general characteristic is that patients are reached from a distance and that therapist time is reduced compared with face-to-face treatments [ ].
Several studies show that Web-based psychological treatments are effective for the treatment of depression, in both unguided and guided interventions, although the effects are more favorable in the latter case [, - ]. It has even been said that Web-based treatments with clinician assistance as brief as 1 hour per patient can work as well as face-to-face therapy [ ]. Web-based psychotherapy could be viable not only in the context of specialist services, but also at the primary care level [ , ], and could be particularly recommended as a first treatment step for self-help in treating depression before visiting a psychiatrist or psychologist [ ]. However, in spite of its efficiency, there are some limitations to its systematic use. One of the main ones is that attrition rates could be substantial [ , - ]. In most cases, patients withdraw for personal reasons, not because of problems with the technology or the social environment. Interestingly, these kinds of interventions are generally acceptable for both patients and professionals, although the attitudes of professionals toward this type of psychotherapy seem to be more negative than the attitudes of patients themselves [ , , ].
Therefore, if we are to develop and deploy this kind of program, maximizing acceptance and using it as a part of public health services, as in this case, we must be sensitive to the different views and attitudes of all participants in the therapeutic process. There may be different types of expectations or requirements according to the perspective of each type of participant. Given this background, the aim of the present study was to identify expectations among both patients and health professionals that may serve as barriers or facilitators to engagement with treatment when performing Web-based psychotherapy for depression in primary care, in order to increase adherence and effectiveness, improving the care offered to these types of patients.
A qualitative design was used to collect information from a wide range of purposefully and theoretically guided samples of depressed patients and health professionals. Both in-depth interviews and discussion groups were used to access the subjectivity and the processes involved in generating expectations . In-depth interviews were carried out by a single interviewer and focus groups were moderated by an interviewer and an observer, both of them female psychologists and researchers, with previous experience in the field and no previous contact with participants.
Patients were recruited from the Spanish autonomous region of Aragon during their visits to primary care, and diagnosis was established using the MINI Neuropsychiatric Interview in its Spanish version . Patients were selected when they reported mild or moderate depression symptoms according to cut-off points of the Beck Depression Inventory [ ]. Family physicians and managers were chosen from the catchment area, based on whether their workplace was rural or urban, and contacted by telephone. Participants were selected with consideration given to the variables of age, gender, residential setting (“urban”, “rural”), and affinity for technology (by means of the question: what is your level of affinity for new technologies?, with “high”, “intermediate”, “low” as possible responses), in order to gather plentiful and varied information. Participants had no previous knowledge of the researchers or the project. No patients refused to participate in the interviews, although some of them did not attend the discussion groups. No physicians or managers refused to participate; however, it was difficult to establish meeting dates because of their work schedule. outlines the main characteristics of the 43 participants (20 patients, 11 physicians, 12 managers).
A standardized protocol was designed to guide the interviews and groups, including the preparation of a topic list () to be addressed, with previously tested, open suggestions that could be of interest.
The objectives of the study were indirectly raised and questions asked about the topics in an open and progressive way. The interviewer and/or moderator were introduced to the participants as research psychologists and assumed a minimally orientative role, limiting their interventions to addressing the topics in the script. The setting for data collection was a neutral room in the hospital where the project was conducted, without the presence of non-participants. No individual or group interviews lasted more than 90 minutes. They were digitally audio-recorded and transcribed to obtain the final set of qualitative data for the analysis, which were revised by participants and added to the field notes made after interviews and groups. Participants provided written informed consent to participate in the study. There were no repeat interviews. This study forms part of a mixed-method research project that includes a randomized controlled trial with different participants . The project was approved by the Regional Ethics Committee of Aragon, Spain.
A thematic content analysis was performed from grounded theory in order to develop and to define until saturation the emergent categories of analysis derived from the interview data [- ]. Secondly, a sociological approach that analyzed discursive positions of participants in focal groups was used to complement the first approximation [ , ]. All the analyses were developed using Maxqda-2007 software, in an iterative way by agreement between the three researchers (JMM, JPA, JGC), and discussed with those in charge of the interviews and groups (PR, PHM) [ ]. Moreover, participants provided their agreement with the interpretations. This methodological triangulation was able to increase consistency and rigor by combining multiple techniques, maximizing the breadth and depth of perspectives. The complete details of the study protocol are reported elsewhere [ ].
|20-40 years||3 (7%)||2 (5%)||0 (0%)||2 (5%)||3 (7%)||1 (2%)|
|41-60 years||6 (14%)||2 (5%)||5 (12%)||5 (12%)||2 (5%)||5 (12%)|
|>60 years||3 (7%)||1 (2%)||0 (0%)||1 (2%)||1 (2%)||1 (2%)|
|Male||5 (12%)||1 (2%)||4 (9%)||1 (2%)||2 (5%)||2 (5%)|
|Female||7 (16%)||4 (9%)||1 (2%)||7 (16%)||4 (9%)||5 (12%)|
|Urban||9 (21%)||3 (7%)||4 (9%)||5 (12%)||4 (9%)||5 (12%)|
|Rural||3 (7%)||2 (5%)||1 (2%)||3 (7%)||2 (5%)||2 (5%)|
|Level of education|
|Primary||4 (9%)||0 (0%)||0 (0%)||3 (7%)||0 (0%)||0 (0%)|
|Secondary||5 (12%)||0 (0%)||0 (0%)||3 (7%)||0 (0%)||0 (0%)|
|University||3 (7%)||5 (12%)||5 (12%)||2 (5%)||6 (14%)||7 (16%)|
|Affinity for technology|
|High||6 (14%)||2 (5%)||2 (5%)||3 (7%)||4 (9%)||5 (12%)|
|Intermediate||3 (7%)||3 (7%)||3 (7%)||4 (9%)||2 (5%)||2 (5%)|
|Low||3 (7%)||0 (0%)||0 (0%)||1 (2%)||0 (0%)||0 (0%)|
aOut of the total of participating patients, 40% (17/43) had university studies and 60% (26/43) had high school education. Half of the patients (10/20) presented with mild symptoms of depression, and the other half (10/20) presented with moderate symptoms.
|Questions asked||Topic list|
|What is your relationship with technology? Have you received any training?|
|Like / dislike|
|Do you think new technologies can help to improve people’s lives?|
|Face-to-face vs Web-based|
|Support tool vs replacement tool|
|What do you think about the use of Web-based therapy to support the actions of health professionals? And as further therapies?|
|Possibilities of Web-based therapy|
|Virtual and anonymous relationship|
|Health professional vs program|
|What about the possibility of offering Web-based therapy for depressive disorders? Do you see it as feasible?|
|What would you ask/expect?|
|Aspects that could be helpful|
|Process from primary care|
The patients, primary care physicians, and managers showed a series of expectations regarding engagement with the use of Web-based psychotherapy for the treatment of depression, which can be divided into three main groups: aspects related to pre-treatment conditions, such as their initial acceptance, their general inclination to make use of the treatment, and its perceived usefulness; aspects related to the particular characteristics of this type of intervention, such as its standardization and the processes of interacting with the program; and the representations made of what could be seen as the expected therapeutic experience, such as experiences of trust, presence, and hope. These groupings can be arranged according to the moment in the therapeutic process to which they correspond ().
Conceptualization of the Discourse
The general acceptance of Web-based psychotherapy for depression depended on prior conditions, such as the inclination to use new technologies, which in turn consisted of subtopics such as “skill level”, “reasons for use”, “available technical means”, and “dedication”. Acceptance also depended on its usefulness as an instrument for psychotherapy, and usefulness consisted of subtopics such as “facilitating communication” and “access to information”, which in the case of physicians took on the meaning of consulting the records or background of patients:
We have limited access to sources of information during a consultation. The computer is the tool that provides access to the most updated, complete, and verified information, depending on the platforms you consult. It’s an important tool for both receiving and conveying information. It also allows us to have the patient’s records online and on hand.
[physician, female, 50 years old, high affinity]
Whereas, for patients, it meant having the possibility of consulting information related to their conditions and its treatment:
The machine [sic] should explain the diagnosis of the disease or anomaly a patient has and quickly help to find solutions for daily life.
[patient, male, 65 years old, high affinity]
Other subtopics under usefulness were “adding convenience”, which for managers meant providing patient access to health care resources:
Maybe it will make professionals more accessible to users; it could become more convenient to avoid having to travel, and interfere less with people’s work because they can do it at home.
[manager, female, 51 years old, high affinity]
Whereas, patients understood it to mean the possibility of improving reminders for control of and compliance with the instructions given by the professional:
The program should have some mechanism to do online activities and revision; for example, what the doctor told me, to refresh the information so as not to forget it.
[patient, female, 59 years old, low affinity]
Finally, usefulness also included “enabling reflectiveness”, understood by patients to mean the opportunity to reflect on their dysfunctional situation:
Does the program have a written format? If that’s the case, writing means thinking and rethinking; it’s like a kind of meditation or awareness of the day, of how things are going, how they develop. It gives you perspective, and that’s positive.
[patient, female, 52 years old, intermediate affinity]
Physicians particularly focused on their awareness of diagnostic impressions resulting from explorations:
The advantage it may have is that you can prepare beforehand the information you’re going to introduce: the questions; results of a particular test; the answers; and you can leave a record of your recommendations, so that there are no misinterpretations. This encourages patients to elaborate on what took place during the consultation once outside, in a more relaxed atmosphere like that of their own homes.
[physician, female, 42 years old, high affinity]
Acceptance depended on the processes required to standardize the program, which consisted of the subtopics “learning process”, “definition of goals”, “complementary tool”, “prior dissemination”, “service offered” (particularly for managers), “professionals involved” (especially highlighted by physicians), “patients served”, and “activities to carry out”. The last was understood by patients according to their own needs:
I do yoga on Wednesday and I feel great. Maybe it could include relaxation techniques and different strategies for different states of mind; some days are better than others.
[patient, male, 46 years old, intermediate affinity]
Whereas physicians underscored the importance of being able to use their own paradigmatic coordinates:
In our specialty, we refer to those of a cognitive behavioral model. Other more introspective or psychodynamic models revolve around the doctor-patient relationship, which cannot be applied using technology.
[physician, male, 51 years old, intermediate affinity]
In turn, the necessary processes for standardization were associated with the idea of specific forms of interaction between the participants and the program. This idea of interaction combined subtopics such as “feeling of security”, “program universality”, “possibilities for expression”, “supervision by a therapist”, and “individualized attention for patients”. The last of these had special relevance for patients, in the sense of personal and close contact:
Rapport. You have to be on the same wavelength and make a connection. You need warmth—they’re personal matters—personal contact, personal proximity.
[patient, male, 64 years old, intermediate affinity]
For professionals, it was simply focused on the need to adapt to the individual characteristics of each patient:
If it were also a little... if the doctor could tailor the treatment a little and if it were based on a shared model of decision-making, with a certain proximity between the professional and patient.
[physician, female, 54 years old, intermediate affinity]
Finally, if these forms of individualized interaction, associated with the processes for standardization of the program, created expectations of a therapeutic experience based on trust and on presence, the discourse would pave the way to hope, which could lead to positive attitudes once again linked to acceptance as a necessary condition for engagement with the therapeutic process.
shows the definitions of the topics and subtopics that comprise the conceptualization of the discourse presented above, and provides examples of participants’ responses to all of them.
|Acceptance||Favorable attitude to therapeutic use of new technologies (NTs), with responsibility to accept the program with the necessary effort, recognizing its possible benefits.|
|Skill level||Level of knowledge and skill when using NTs.|
|Reasons for use||Reasons for the use of NTs, for work, leisure, etc.|
|Available technical means||Available technical means and possibilities of updating them.|
|Dedication||Time devoted NTs and form of use, taking into account the risks of patterns of abusive use in some individuals.|
|Usefulness as an instrument for therapy|
|Facilitating communication||NTs as alternative means of communicating and forming relationships with others, of keeping in contact, alerting, and giving notification of results.|
|Access to information||Possibility of consulting background information and patient records (physicians) and important matters related to medical conditions and treatments (patients).|
|Adding convenience||Solutions to problems with daily clinical practice, such as facilitating access (managers) or reminders for, control of, and compliance with instructions (patients)|
|Enabling reflectiveness||Possibility of thinking/reconsidering through the use of writing, making possible a reflective attitude to their dysfunctional situation (patients), or of taking note of exploration and diagnostic impressions (physicians).|
|Learning process||Ease of learning the program and ease of use.|
|Definition of goals||Structured definition of the goals to meet with the program and their timeframe.|
|Complementary tool||Combined and complementary use of Web-based and traditional therapies, without the intention of replacing the presence of professionals.|
|Prior dissemination||Dissemination of information about the program in order to overcome possible resistance to change based on old habits.|
|Service offered||Implementation in health care delivery system, with a structure focused on a new model of health care, and with support from health care providers, IT experts, and administrative staff that allow referrals from primary care in coordination with mental health services.|
|Professionals involved||Recruitment of professionals with a positive attitude toward NTs who have specific skills depending on the characteristics of this type of intervention.|
|Patients served||Recruitment of patients according to their willingness to use NTs, low or mild severity of their disorder, and their demand for greater information or anonymity.|
|Activities to carry out||Incorporation of modules that appeal to patients, arouse their interest, and meet their needs (patients), with real possibilities of implementation within paradigmatic coordinates (physicians).|
|Feeling of security||Combination of safeguarding anonymity, data protection, and program quality.|
|Program universality||Sharing experiences of illness within a group by means of supervised forums, owing to the general nature of dysfunction shared by all the patients.|
|Possibilities for expression||Possibility of manifesting or expressing feelings and emotions through NTs.|
|Supervision by a therapist||Appraisal of the evolution of the disorder throughout the therapeutic process (physicians).|
|Individualized attention for patients||Personal, empathetic, sincere, and close contact (patients), with flexibility to be adapted to the individual characteristics of each patient (physicians).|
|Trust||Peace of mind when using the program in an intimate and participative way.|
|Presence||Support from and availability of a professional who listens and pays attention (patients).|
|Hope||An optimistic perspective for the outcome of the treatment.|
In general, the participants similarly conceptualized their expectations regarding Web-based psychotherapy for depression, although the focus of their discourse offered differing perspectives depending on their position (). For example, the health professionals—physicians and managers—placed emphasis on the intervention processes from the perspective of standardization of the program. More specifically, the physicians centered their interest on the professionals involved, with the concern of whether this type of intervention could improve the current delivery of health care, but at the cost of increasing their already excessive workload. However, the discourse given by the managers was focused on the idea of the service provided, with interest shown in the cost-effectiveness of this resource, by means of an organization of work that would create a new dynamic for distributing patients, and in a way that would solve practical problems, such as reducing waiting lists. Finally, patients highlighted the intervention processes from the perspective of interaction with the program, through which they expected to receive quality, personal, and individualized service, which would offer them the possibility of safely sharing experiences with people in the same situation as theirs, and with an accessible professional who would be in charge of supervising the treatment.
The different perspectives expressed by the participants—physicians, managers, and patients—reflected their different concerns based on their position. Could a patient be placed in the program without increasing my workload? Would this program solve the problem of waiting lists without added expense? Would this program sufficiently attend to my particular condition? Each position raised the need to satisfy different requirements, and any of these could cause resistance to the introduction of this type of instrument into the health service.
|Participant||Focus of discourse||Quotes|
|Physicians||Professionals||“Maybe we could use a little help so as not to overload our schedules even more.”|
(physician, male, 45 years old, high affinity)
|“The design is relatively simple to imagine, but it means a change to our routine practice. How long will it take to train us to use and implement this program? Would we be released from our clinical practice for that time?”|
(physician, female, 54 years old, intermediate affinity)
|“Not all of us have the same technological know-how or motivation. Should all doctors use the tool or only the most qualified? Those of us who volunteer to participate could be released from our routine workload to devote ourselves more specifically to this matter”.|
(physician, female, 35 years old, high affinity)
|“Telemedicine platforms are already showing great improvement in places with dispersed populations, assisting with the organization of care and better communication between primary and specialist care services, which not only improves final care, but saves money.”|
(manager, female, 51 years old, high affinity)
|Managers||Service||“The tool should speed up care processes, especially waiting lists and user access to resources, providing maximum efficacy with a small investment that is quickly justified.”|
(manager, male, 55 years old, intermediate affinity)
|“If we all save time with this tool, seeing more patients in distance mode and therefore freeing up our schedules, close, properly programmed, face-to-face monitoring could be carried out.”|
(manager, male, 50 years old, high affinity)
|“Of course, every patient is different, so if you decide to help them, first you have to know their whole story.”|
(patient, male, 46 years old, intermediate affinity)
|Patients||Individualization||“Depending on the patient, on the state they’re in, there can be interventions that are for everybody. But some patients, given their particular evolution, will need more personalized care.”|
(patient, female, 52 years old, intermediate affinity)
|“Therapy has to be something that is very personalized, with the possibility of asking and speaking about other subjects...”|
(patient, female, 59 years old, low affinity)
Our results show how important it is for primary care physicians that the implementation of Web-based psychotherapy programs does not mean an added workload for them; rather, this should be reduced. They also show that the main concern for health care management professionals is to offer greater accessibility to services, and to improve their cost-effectiveness. Patients expect to receive individualized care, which requires investment in a certain level of resources, workload for professionals, and infrastructure in order to meet their needs. These particular viewpoints reflect different expectations, which taken individually, seem to respond to conflicting needs and interests. In order to overcome any possible resistance simultaneously, we have to find common ground. One starting point in this regard could be the optimization of the processes for management and patient flow in an integrated model, which has proven to be very useful for balancing the burdens of care delivery .
Depressive disorder is currently one of the greatest challenges for public health systems. In its mild and moderate forms, it responds satisfactorily to different types of psychotherapeutic approaches , such as Web-based cognitive behavioral therapy, including those with little or no support [ , ]. This type of treatment could become an alternative for public health systems to facilitate patients’ acceptance and access to care [ ], adding efficacy to early interventions [ , , ]. Forecasts show that the dissemination and use of Web-based psychotherapy will grow exponentially in the coming decade [ ]. In this context, it is necessary to establish procedures for the implementation of these type of programs that meet the many varied expectations placed on them by all participants in the therapeutic process, whether patients or health professionals.
A fundamental aspect in this regard would be to determine the level of intensity of the required supervision. The Spanish health care system treats all individuals equally, which means that the referral process for patients is not a fast and smooth one. In an attempt to optimize the therapeutic process, patients should be and feel cared for, without overloading professionals, but while reducing costs and waiting times . In order to do this, it would be necessary to perform the specific task of disseminating the program, which would allow the patients most likely to benefit from this type of treatment to be identified and chosen, without losing sight of the factors that would enhance compliance. Those patients with symptoms of mild severity are seen as good candidates, as well as those who take responsibility for the treatment and who attribute success to themselves, focusing on action [ - ]. According to our results, all participants would show moderate severity at most, with an attitude of general acceptance toward Web-based therapy and a certain inclination for the use of new technologies, as has been seen in other works [ ], but most of all, they have to understand their possible usefulness in the specific field of psychotherapy.
Both patients and health professionals have to share a certain willingness to use new technologies , must have a certain level of skill in their use, and need to have the necessary infrastructure [ ], which is particularly important when we encounter difficult-to-access settings, or in cases with scarcity of training and resources [ , ]. All participants need to perceive the possibilities offered by Web-based psychotherapy as useful, with regard to convenience, time, and place of use, and value the reduction of transport costs, and the possibilities for communication, reflectiveness, memory, and information that it brings, while giving patients an active role and enabling its use whenever they want [ ]. Nevertheless, all participants also highlighted the importance of not falling into patterns of abuse. In other words, the use of Web-based psychotherapy for the treatment of depression should provide everybody involved with a certain sense of efficacy and comfort [ ]. This is how depression can become easier to handle, probably through patients’ actual perception of their own self-efficacy.
We have seen that the discourse of professionals basically revolves around the difficulties of attempts at standardization, which is necessary in order to provide institutional support for Web-based therapy. This is a reference to the general culture in which health services are immersed . This culture is present in questions such as learning processes, definition of goals to be met and activities to carry out, and in relation to the professionals involved and the services provided. That is to say, the group of health professionals—physicians and managers—are interested in the implementation of the program as a tool for clinical intervention, with the expectation that the needs of their users/patients have to be met, but also those of the professionals involved, implying possible strategies for promotion and improvement in quality and efficiency. We have thus seen how health care workers highlight the importance of standardization processes for Web-based treatments as part of an integrated service model, which is in agreement with the results of other studies [ - ].
In general, health professionals have positive attitudes to Web-based treatments [, ], and these positive attitudes tend to be associated with an open mind and availability to new treatments, the convenience that computers offer, and easy access to technology [ ], which is in line with our results. Nevertheless, therapists have also been said to express doubts as to whether new technologies produce substantial improvements, and although they are generally open to incorporating Web-based psychotherapy into their clinical practice, they show doubt depending on their skill, and out of the belief that this type of therapy may harm their relationship with patients [ ]. In this regard, our study has pointed out, through the discourse of both professionals and patients, that therapeutic interaction by computer should not completely replace human contact, which underscores the limits to the application of indiscriminate Web-based psychotherapy.
Web-based therapeutic interventions are rarely conducted without face-to-face contact at some point in the process [, , ]. The presence of a therapist is key to guiding patients, given that this benefits the treatment, and supervision of the therapeutic process is associated with achieving positive results, while withdrawals from treatment increase when there is not sufficient contact [ , , ]. On the contrary, adding contacts may improve efficacy, probably as a result of the trust created in the process [ ]. When we asked patients about the possibilities of Web-based psychotherapy, we immediately saw the emergence of thematic content that was linked to the need to construct a therapeutic alliance as a vector that produces the hope of a positive outcome [ - ]. In fact, it is the base on which all psychotherapy is constructed, as a relationship of help [ , ]. Another important aspect to take into account is the necessary confidentiality of the entire process, for the security and anonymity that both patients and professionals require [ ], and given that this could help to prevent stigmas [ ], if clinical symptoms are able to be resolved at the primary health care level, providing solutions without the need for involving mental health units [ ].
In general, the context for applying these results does not seem to be logically restricted to the particular characteristics of the place where the study was conducted. Instead, it points out the possible general characteristics and interests of the different participants. While all of the participants resided in only one region of Spain, it is true that Spanish primary care practices on the whole are currently a setting with a very high care delivery burden , and patient profiles also show a certain tendency toward personal contact in visits, as occurs in the majority of countries studied [ ]. For this reason, our results seem to be fairly reliable. Nonetheless, it would be logical to propose future studies that make use of our procedures in other countries, in order to verify the extent to which our conclusions can be generalized in different populations, or whether they are in fact the specific product of the studied population. The fact that the interviewer and analysis team were mental health specialists, psychologists, and psychiatrists should not be overlooked, and they may therefore have focused the framework of discourse generation and the creation of emerging categories toward topics of special interest in this field of knowledge. We would add that the randomized controlled study conducted parallel to this work, although with different participants, may have exerted a certain influence on the processes of analysis and interpretation of the data.
This study shows how patients, physicians, and managers see the possibility of carrying out Web-based psychotherapy for the treatment of depression revolve around two attractors: the need for individualized interaction, which enables the establishment of a therapeutic alliance, and the processes for standardizing the program, which would prevent professional overloading while optimizing cost-effectiveness. In order to find a balance between both expectations, Web-based psychotherapy should be understood as a complementary intervention, which allows the amount of human contact to be reduced, but without completely eliminating it. This type of intervention provides a way of treating depression, which would permit more patients to be supervised with fewer visits, offering a solution to the problem of waiting lists, and without being an additional burden for health professionals. Research shows that Web-based psychotherapy as an approach to treating depression is in its infancy as a therapeutic option. In order to facilitate its implementation in primary care, we should be aware of the expectations of all participants by designing effective programs that are able to offer patients individualized treatment by means of standard interventions in the different contexts. Incorporating Web-based therapy into health systems harmoniously will show its value in improving delivery of care , by facilitating access to resources and improving working conditions for professionals.
This study was funded by the Institute of Health Carlos III (FIS PI10/01982) of the Ministry of Economy and Competitiveness and the Ministry of Health and Consumption (Spain), through the Network for Prevention and Health Promotion in Primary Care (redIAPP, RD12/0005), the CIBER (PSI2010-17563), and with European Union ERDF funds.
JMM and JGC are the principal researchers and developed the original idea for the study and the study design. PRS and PHM were in charge of the interviews and groups. JMM, JPA, and JGC developed the data analysis and wrote the first manuscript. All the authors have read and corrected draft versions and approved the final version.
Conflicts of Interest
Multimedia Appendix 1
Participants’ responses to subtopics.PDF File (Adobe PDF File), 16KB
- World Health Organization. The Global Burden of Disease: 2004 Update. Switzerland: WHO; 2004. URL: http://www.who.int/healthinfo/global_burden_disease/GBD_report_2004update_full.pdf?ua=1 [accessed 2015-03-06] [WebCite Cache]
- Mathers CD, Loncar D. Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med 2006 Nov;3(11):e442 [FREE Full text] [CrossRef] [Medline]
- Richards D. Prevalence and clinical course of depression: a review. Clin Psychol Rev 2011 Nov;31(7):1117-1125. [CrossRef] [Medline]
- Sartorius N. Psychological disorders in general medical settings. Toronto: Published on behalf of the World Heath Organization by Hogrefe & Huber; 1990.
- Greenberg PE, Kessler RC, Birnbaum HG, Leong SA, Lowe SW, Berglund PA, et al. The economic burden of depression in the United States: how did it change between 1990 and 2000? J Clin Psychiatry 2003 Dec;64(12):1465-1475. [Medline]
- Sobocki P, Jönsson B, Angst J, Rehnberg C. Cost of depression in Europe. J Ment Health Policy Econ 2006 Jun;9(2):87-98. [Medline]
- Cuijpers P, Schoevers RA. Increased mortality in depressive disorders: a review. Curr Psychiatry Rep 2004 Dec;6(6):430-437. [Medline]
- Rapaport MH, Clary C, Fayyad R, Endicott J. Quality-of-life impairment in depressive and anxiety disorders. Am J Psychiatry 2005 Jun;162(6):1171-1178. [CrossRef] [Medline]
- Mohr DC, Ho J, Duffecy J, Baron KG, Lehman KA, Jin L, et al. Perceived barriers to psychological treatments and their relationship to depression. J Clin Psychol 2010 Apr;66(4):394-409 [FREE Full text] [CrossRef] [Medline]
- McHugh RK, Whitton SW, Peckham AD, Welge JA, Otto MW. Patient preference for psychological vs pharmacologic treatment of psychiatric disorders: a meta-analytic review. J Clin Psychiatry 2013 Jun;74(6):595-602 [FREE Full text] [CrossRef] [Medline]
- van Schaik DJ, Klijn AF, van Hout HP, van Marwijk HW, Beekman AT, de Haan M, et al. Patients' preferences in the treatment of depressive disorder in primary care. Gen Hosp Psychiatry 2004;26(3):184-189. [CrossRef] [Medline]
- Bedi N, Chilvers C, Churchill R, Dewey M, Duggan C, Fielding K, et al. Assessing effectiveness of treatment of depression in primary care. Partially randomised preference trial. Br J Psychiatry 2000 Oct;177:312-318 [FREE Full text] [Medline]
- Brody DS, Khaliq AA, Thompson TL. Patients' perspectives on the management of emotional distress in primary care settings. J Gen Intern Med 1997 Jul;12(7):403-406 [FREE Full text] [Medline]
- Churchill R, Khaira M, Gretton V, Chilvers C, Dewey M, Duggan C, Nottingham Counselling and Antidepressants in Primary Care (CAPC) Study Group. Treating depression in general practice: factors affecting patients' treatment preferences. Br J Gen Pract 2000 Nov;50(460):905-906 [FREE Full text] [Medline]
- Dwight-Johnson M, Sherbourne CD, Liao D, Wells KB. Treatment preferences among depressed primary care patients. J Gen Intern Med 2000 Aug;15(8):527-534 [FREE Full text] [Medline]
- O'Mahen HA, Flynn HA. Preferences and perceived barriers to treatment for depression during the perinatal period. J Womens Health (Larchmt) 2008 Oct;17(8):1301-1309. [CrossRef] [Medline]
- Priest RG, Vize C, Roberts A, Roberts M, Tylee A. Lay people's attitudes to treatment of depression: results of opinion poll for Defeat Depression Campaign just before its launch. BMJ 1996 Oct 5;313(7061):858-859 [FREE Full text] [Medline]
- Treating depression in adults.: National Institute for Health and Clinical Excellence (NICE); 2009. URL: https://www.nice.org.uk/guidance/cg90/resources/guidance-depression-in-adults-pdf [accessed 2014-10-27] [WebCite Cache]
- Huhn M, Tardy M, Spineli LM, Kissling W, Förstl H, Pitschel-Walz G, et al. Efficacy of pharmacotherapy and psychotherapy for adult psychiatric disorders: a systematic overview of meta-analyses. JAMA Psychiatry 2014 Jun;71(6):706-715. [CrossRef] [Medline]
- Morgan AJ, Jorm AF, Mackinnon AJ. Email-based promotion of self-help for subthreshold depression: Mood Memos randomised controlled trial. Br J Psychiatry 2012 May;200(5):412-418 [FREE Full text] [CrossRef] [Medline]
- Christensen H, Griffiths KM. The prevention of depression using the Internet. Med J Aust 2002 Oct 7;177 Suppl:S122-S125. [Medline]
- Buntrock C, Ebert DD, Lehr D, Cuijpers P, Riper H, Smit F, et al. Evaluating the efficacy and cost-effectiveness of web-based indicated prevention of major depression: design of a randomised controlled trial. BMC Psychiatry 2014;14:25 [FREE Full text] [CrossRef] [Medline]
- Cuijpers P, van Straten A, Warmerdam L, van Rooy MJ. Recruiting participants for interventions to prevent the onset of depressive disorders: possible ways to increase participation rates. BMC Health Serv Res 2010;10:181 [FREE Full text] [CrossRef] [Medline]
- Lehtinen V, Riikonen E, Latineen E. Promotion of mental health on the European agenda.: Finnish Ministry of Social Affairs and Health, Department for Prevention and Promotion; 2000. URL: https://www.julkari.fi/bitstream/handle/10024/75859/Promotion.pdf?sequence=1 [accessed 2015-03-03] [WebCite Cache]
- Richards D, Timulak L, Doherty G, Sharry J, Colla A, Joyce C, et al. Internet-delivered treatment: its potential as a low-intensity community intervention for adults with symptoms of depression: protocol for a randomized controlled trial. BMC Psychiatry 2014;14:147 [FREE Full text] [CrossRef] [Medline]
- Bennett-Levy J, Richards DA, Farrand P. Oxford guide to low intensity CBT interventions. Oxford: Oxford University Press; 2010:3-18.
- Andersson G. Using the Internet to provide cognitive behaviour therapy. Behav Res Ther 2009 Mar;47(3):175-180. [CrossRef] [Medline]
- van BW, Cuijpers P, van Straten A, Karyotaki E, Andersson G, Smit JH, et al. Adherence to Internet-based and face-to-face cognitive behavioural therapy for depression: a meta-analysis. PLoS One 2014;9(7):e100674 [FREE Full text] [CrossRef] [Medline]
- Ritterband LM, Andersson G, Christensen HM, Carlbring P, Cuijpers P. Directions for the International Society for Research on Internet Interventions (ISRII). J Med Internet Res 2006;8(3):e23 [FREE Full text] [CrossRef] [Medline]
- Patten SB. Prevention of depressive symptoms through the use of distance technologies. Psychiatr Serv 2003 Mar;54(3):396-398. [Medline]
- Johansson R, Andersson G. Internet-based psychological treatments for depression. Expert Rev Neurother 2012 Jul;12(7):861-9; quiz 870. [CrossRef] [Medline]
- Spek V, Cuijpers P, Nyklícek I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med 2007 Mar;37(3):319-328. [CrossRef] [Medline]
- Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev 2012 Jun;32(4):329-342. [CrossRef] [Medline]
- Kessler D, Lewis G, Kaur S, Wiles N, King M, Weich S, et al. Therapist-delivered Internet psychotherapy for depression in primary care: a randomised controlled trial. Lancet 2009 Aug 22;374(9690):628-634. [CrossRef] [Medline]
- Bergström J, Andersson G, Ljótsson B, Rück C, Andréewitch S, Karlsson A, et al. Internet-versus group-administered cognitive behaviour therapy for panic disorder in a psychiatric setting: a randomised trial. BMC Psychiatry 2010;10:54 [FREE Full text] [CrossRef] [Medline]
- So M, Yamaguchi S, Hashimoto S, Sado M, Furukawa TA, McCrone P. Is computerised CBT really helpful for adult depression?-A meta-analytic re-evaluation of CCBT for adult depression in terms of clinical implementation and methodological validity. BMC Psychiatry 2013;13:113 [FREE Full text] [CrossRef] [Medline]
- Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther 2009;38(4):196-205. [CrossRef] [Medline]
- Kaltenthaler E, Parry G, Beverley C, Ferriter M. Computerised cognitive-behavioural therapy for depression: systematic review. Br J Psychiatry 2008 Sep;193(3):181-184 [FREE Full text] [CrossRef] [Medline]
- Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One 2010;5(10):e13196 [FREE Full text] [CrossRef] [Medline]
- Clarke G, Reid E, Eubanks D, O'Connor E, DeBar LL, Kelleher C, et al. Overcoming depression on the Internet (ODIN): a randomized controlled trial of an Internet depression skills intervention program. J Med Internet Res 2002 Dec;4(3):E14 [FREE Full text] [CrossRef] [Medline]
- Clarke G, Eubanks D, Reid E, Kelleher C, O'Connor E, DeBar LL, et al. Overcoming Depression on the Internet (ODIN) (2): a randomized trial of a self-help depression skills program with reminders. J Med Internet Res 2005;7(2):e16 [FREE Full text] [CrossRef] [Medline]
- Learmonth D, Rai S. Taking computerized CBT beyond primary care. Br J Clin Psychol 2008 Mar;47(Pt 1):111-118. [CrossRef] [Medline]
- Kelders SM, Kok RN, Ossebaard HC, Van Gemert-Pijnen JEWC. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res 2012;14(6):e152 [FREE Full text] [CrossRef] [Medline]
- Gerhards SAH, de Graaf LE, Jacobs LE, Severens JL, Huibers MJH, Arntz A, et al. Economic evaluation of online computerised cognitive-behavioural therapy without support for depression in primary care: randomised trial. Br J Psychiatry 2010 Apr;196(4):310-318 [FREE Full text] [CrossRef] [Medline]
- Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res 2009;11(2):e13 [FREE Full text] [CrossRef] [Medline]
- Gun SY, Titov N, Andrews G. Acceptability of Internet treatment of anxiety and depression. Australas Psychiatry 2011 Jun;19(3):259-264. [CrossRef] [Medline]
- Waller R, Gilbody S. Barriers to the uptake of computerized cognitive behavioural therapy: a systematic review of the quantitative and qualitative evidence. Psychol Med 2009 May;39(5):705-712. [CrossRef] [Medline]
- Mays N, Pope C. Qualitative research in health care. London: BMJ Books; 2000:1-168.
- Ferrando L, Franco A, Soto M, Bobes J, Soto O, Franco L, et al. MINI International Neuropsychiatric Interview. Madrid:Instituto IAP 1998:1-25 Versión en español 5.0.0. DSM-IV [FREE Full text]
- Beck AT, Steer RA, Brown GK. Manual for the Beck Depression Inventory-II. San Antonio, Texas: Psychological Corp; 1996.
- López-del-Hoyo Y, Olivan B, Luciano JV, Mayoral F, Roca M, Gili M, et al. Low intensity vs. self-guided internet-delivered psychotherapy for major depression: a multicenter, controlled, randomized study. BMC Psychiatry 2013;13:21 [FREE Full text] [CrossRef] [Medline]
- Corbin JM, Strauss AL. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. London: Sage Publications, Inc; 1998.
- Strauss A. Qualitative analysis for social scientists. Cambridge: Cambridge University Press; 1987.
- Glaser BG, Strauss AL. The discovery of grounded theory; strategies for qualitative research. Chicago: Aldine Publishing Co; 1967.
- Alonso LE. La mirada cualitativa en sociología. Una aproximación interpretativa [A qualitative approach to sociology. An interpretative approach]. Madrid: Editorial Fundamentos; 1998.
- Phillips N, Hardy C. Discourse analysis: investigating processes of social construction. Thousand Oaks, Calif: Sage Publications; 2002.
- Montero-Marín J, Carrasco JM, Roca M, Serrano-Blanco A, Gili M, Mayoral F, et al. Expectations, experiences and attitudes of patients and primary care health professionals regarding online psychotherapeutic interventions for depression: protocol for a qualitative study. BMC Psychiatry 2013;13:64 [FREE Full text] [CrossRef] [Medline]
- Davison GC. Stepped care: doing more with less? J Consult Clin Psychol 2000 Aug;68(4):580-585. [Medline]
- Cuijpers P, van Straten A, Andersson G, van Oppen P. Psychotherapy for depression in adults: a meta-analysis of comparative outcome studies. J Consult Clin Psychol 2008 Dec;76(6):909-922. [CrossRef] [Medline]
- Andersson G. Internet-based cognitive-behavioral self help for depression. Expert Rev Neurother 2006 Nov;6(11):1637-1642. [CrossRef] [Medline]
- Spek V, Nyklícek I, Smits N, Cuijpers P, Riper H, Keyzer J, et al. Internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years old: a randomized controlled clinical trial. Psychol Med 2007 Dec;37(12):1797-1806. [CrossRef] [Medline]
- Wootton BM, Titov N, Dear BF, Spence J, Kemp A. The acceptability of Internet-based treatment and characteristics of an adult sample with obsessive compulsive disorder: an Internet survey. PLoS One 2011;6(6):e20548 [FREE Full text] [CrossRef] [Medline]
- Norcross JC, Pfund RA, Prochaska JO. Psychotherapy in 2022: A Delphi poll on its future. Professional Psychology: Research and Practice 2013;44(5):363-370. [CrossRef]
- Reins JA, Ebert DD, Lehr D, Riper H, Cuijpers P, Berking M. Internet-based treatment of major depression for patients on a waiting list for inpatient psychotherapy: protocol for a multi-centre randomised controlled trial. BMC Psychiatry 2013;13:318 [FREE Full text] [CrossRef] [Medline]
- Ellis LA, Collin P, Hurley PJ, Davenport TA, Burns JM, Hickie IB. Young men's attitudes and behaviour in relation to mental health and technology: implications for the development of online mental health services. BMC Psychiatry 2013;13:119 [FREE Full text] [CrossRef] [Medline]
- Bendelin N, Hesser H, Dahl J, Carlbring P, Nelson KZ, Andersson G. Experiences of guided Internet-based cognitive-behavioural treatment for depression: a qualitative study. BMC Psychiatry 2011;11:107 [FREE Full text] [CrossRef] [Medline]
- Titov N. Status of computerized cognitive behavioural therapy for adults. Aust N Z J Psychiatry 2007 Feb;41(2):95-114. [CrossRef] [Medline]
- Dünnebeil S, Sunyaev A, Blohm I, Leimeister JM, Krcmar H. Determinants of physicians' technology acceptance for e-health in ambulatory care. Int J Med Inform 2012 Nov;81(11):746-760. [CrossRef] [Medline]
- Becker EM, Jensen-Doss A. Computer-assisted therapies: examination of therapist-level barriers to their use. Behav Ther 2013 Dec;44(4):614-624. [CrossRef] [Medline]
- McCloskey MS. Training in empirically supported treatments using alternative learning modalities. Clinical Psychology:Science and Practice 2011;18(1):84-88. [CrossRef]
- Weingardt KR. The role of instructional design and technology in the dissemination of empirically supported manual-based therapies. Clinical Psychology: Science and Practice 2004;11(3):313-331. [CrossRef]
- Klaw E, Humphreys K. Facilitating client involvement in self-help groups. In: Koocher G, Norcross J, Hill S, editors. Psychologists’ Desk Reference, 2nd edition. New York: Oxford University Press; 2005:502-505.
- Parand A, Dopson S, Renz A, Vincent C. The role of hospital managers in quality and patient safety: a systematic review. BMJ Open 2014;4(9):e005055 [FREE Full text] [CrossRef] [Medline]
- Wangberg SC, Gammon D, Spitznogle K. In the eyes of the beholder: exploring psychologists' attitudes towards and use of e-therapy in Norway. Cyberpsychol Behav 2007 Jun;10(3):418-423. [CrossRef] [Medline]
- Gund A, Lindecrantz K, Schaufelberger M, Patel H, Sjöqvist BA. Attitudes among healthcare professionals towards ICT and home follow-up in chronic heart failure care. BMC Med Inform Decis Mak 2012;12:138 [FREE Full text] [CrossRef] [Medline]
- Perle JG, Langsam LC, Randel A, Lutchman S, Levine AB, Odland AP, et al. Attitudes toward psychological telehealth: current and future clinical psychologists' opinions of internet-based interventions. J Clin Psychol 2013 Jan;69(1):100-113. [CrossRef] [Medline]
- Palmqvist B, Carlbring P, Andersson G. Internet-delivered treatments with or without therapist input: does the therapist factor have implications for efficacy and cost? Expert Rev Pharmacoecon Outcomes Res 2007 Jun;7(3):291-297. [CrossRef] [Medline]
- Marks IM, Cuijpers P, Cavanagh K, van Straten A, Gega L, Andersson G. Meta-analysis of computer-aided psychotherapy: problems and partial solutions. Cogn Behav Ther 2009;38(2):83-90. [CrossRef] [Medline]
- Christensen H, Griffiths KM, Mackinnon AJ, Brittliffe K. Online randomized controlled trial of brief and full cognitive behaviour therapy for depression. Psychol Med 2006 Dec;36(12):1737-1746. [CrossRef] [Medline]
- Carlbring P, Bohman S, Brunt S, Buhrman M, Westling BE, Ekselius L, et al. Remote treatment of panic disorder: a randomized trial of internet-based cognitive behavior therapy supplemented with telephone calls. Am J Psychiatry 2006 Dec;163(12):2119-2125. [CrossRef] [Medline]
- Bordin ES. The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research & Practice 1979;16(3):252-260. [CrossRef]
- Hill CE, Knox S. Processing the therapeutic relationship. Psychother Res 2009 Jan;19(1):13-29. [CrossRef] [Medline]
- Prado-Abril J, García-Campayo J, Sánchez-Reales S. Funcionamiento de la terapia cognitivo-interpersonal en los trastornos de la personalidad: Estudio de dos casos [Efficacy of interpersonal-cognitive therapy in personality disorders: Two cases]. RPPC 2014 Jul 21;18(2):139. [CrossRef]
- Gelso CJ. The real relationship in a postmodern world: theoretical and empirical explorations. Psychother Res 2009 May;19(3):253-264. [CrossRef] [Medline]
- Addis ME, Wade WA, Hatgis C. Barriers to dissemination of evidence-based practice: Promises, obstacles and future directions. Clin Psychol-Sci Pr 1999;9(4):367-378. [CrossRef]
- Farrer L, Christensen H, Griffiths KM, Mackinnon A. Web-based cognitive behavior therapy for depression with and without telephone tracking in a national helpline: secondary outcomes from a randomized controlled trial. J Med Internet Res 2012;14(3):e68 [FREE Full text] [CrossRef] [Medline]
- Fernández A, Saameño JAB, Pinto-Meza A, Luciano JV, Autonell J, Palao D, et al. Burden of chronic physical conditions and mental disorders in primary care. Br J Psychiatry 2010 Apr;196(4):302-309 [FREE Full text] [CrossRef] [Medline]
- Waller R, Gilbody S. Barriers to the uptake of computerized cognitive behavioural therapy: a systematic review of the quantitative and qualitative evidence. Psychol Med 2009 May;39(5):705-712. [CrossRef] [Medline]
- Ebert DD, Lehr D, Baumeister H, Boß L, Riper H, Cuijpers P, et al. GET.ON Mood Enhancer: efficacy of Internet-based guided self-help compared to psychoeducation for depression: an investigator-blinded randomised controlled trial. Trials 2014;15:39 [FREE Full text] [CrossRef] [Medline]
Edited by G Eysenbach; submitted 28.10.14; peer-reviewed by J Boggs, G Culjak; comments to author 30.12.14; revised version received 26.01.15; accepted 12.02.15; published 10.03.15Copyright
©Jesús Montero-Marín, Javier Prado-Abril, Cristina Botella, Fermin Mayoral-Cleries, Rosa Baños, Paola Herrera-Mercadal, Pablo Romero-Sanchiz, Margalida Gili, Adoración Castro, Raquel Nogueira, Javier García-Campayo. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 10.03.2015.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.