This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.
The prevalence of depression is high and has been stable despite increased treatment, research, and dissemination. People encounter barriers to seeking traditional mental health services, which could be mitigated by using web-based prevention methods.
This study aims to understand what people at high risk for depression perceive as effective aspects of web-based mental health programs and what motivates people at high risk for depression to use web-based mental health programs.
We conducted an inductive content analysis using telephone interview data from 77 participants at high risk for depression who were recruited from 2 randomized controlled trials (RCTs). Participants from the first RCT were working men who had been randomly assigned to 1 of the following 3 groups: control group, who had access to general depression information from a website called BroMatters; intervention group 1, who had access to the BroMatters website along with the associated BroHealth web-based mental health program; and intervention group 2, who had access to the BroMatters website, the BroHealth web-based mental health program, and telephone sessions with a life coach. Participants from the second RCT were men and women who had been assigned to the intervention group, who received access to the HardHat web-based mental health program, or the control group, who only received access to the HardHat web-based mental health program following completion of the RCT. Participants for this inductive content analysis study were recruited from the intervention groups in both RCTs. Two groups of participants (n=41 and n=20) were recruited from the BroHealth RCT, and a third group comprised 16 participants that were recruited from the HardHat RCT.
We generated four categories regarding the perceived effectiveness of web-based programs and five categories related to what motivates the use of web-based programs. Participants identified awareness, program medium and functionality, program content, and coaches as categories related to the effectiveness of the programs. Categories of motivators to use web-based programs included providing reminders or incentives, promotion of the programs, providing appropriate medium and functionality, appropriate content, and perceived need. The final category related to motivators reflects perceptions of participants who were either unsure about what motivates them or believed that there is no way to motivate use.
Conflicting evidence was obtained regarding the perceived effectiveness of aspects of the content and functionality of web-based programs. In general, web-based mental health programs were perceived to help increase mental health awareness, especially when it includes live access to a coach. However, the results also revealed that it is difficult to motivate people to begin using web-based mental health programs. Strategies that may motivate the use of such programs include perceived personal need, effective promotion, providing incentives and reminders, and improving functionality.
Depression is a prevalent mental health disorder [
Barriers to seeking help related to treating and preventing depression are numerous and include stigma and availability of and access to services [
People are often concerned about privacy and confidentiality for fear of being stigmatized for accessing mental health services [
In view of user skepticism and the need for a fuller understanding of user perceptions of web-based mental health programs, our purpose is to identify factors that motivate use (initiation and adherence) of such programs and the perceived effectiveness of the programs. We achieve our purpose by analyzing data drawn from qualitative interviews conducted with a sample of web-based mental health program users who are at high risk of developing depression.
This qualitative study complements 2 randomized controlled trials (RCTs). The RCTs were aimed at understanding strategies for preventing depression and evaluating user perceptions of the effectiveness of web-based mental health programs. This qualitative component elaborates on the understanding derived through the RCT studies by illuminating what users perceive as effective about web-based mental health programs and what motivates the use of such programs. In using a qualitative approach, we align ourselves with researchers who highlight the power of qualitative research to support contextual understanding of complex mental health phenomena [
We studied the perceived effectiveness of web-based mental health programming and what motivates the use of web-based mental health programs, and we treated these topics as emerging and yet to be coherently understood. Accordingly, we employed an inductive content analysis approach [
Below, we outline the broader RCT studies from which participants for this inductive content analysis study were drawn. We follow this with a description of our qualitative sample, data collection, and data analysis, including trustworthiness measures.
The BroHealth RCT was about participants’ perceptions of the effectiveness of the BroHealth web-based program, which was designed to prevent depression in working men who are at high risk of having a major depressive episode (MDE) in the next 4 years. BroHealth includes modules that provide information about stress and depression, web-based self-checks that help monitor symptoms, and a variety of self-help components such as cognitive behavioral therapy (CBT) and goal setting and tracking. Qualified coaches were also available to participants for 40-min sessions to a maximum of once per week. Coaches help participants set goals and help them work through problems. The study protocol from which BroHealth was developed is available elsewhere [
BroHealth RCT participants were recruited across Canada using the random digit dialing method. Participants were men who were (1) older than 18 years, (2) working for pay, and (3) at high risk for an MDE determined by the depression risk calculator developed and validated by Wang et al [
Control group: participants received general information about depression through the BroMatters website
Intervention group 1: participants received general information about depression through the BroMatters website as well as access to the associated BroHealth web-based program
Intervention group 2: participants received general information about depression through the BroMatters website, access to the BroHealth program, and access to a qualified coach with whom they could schedule telephone sessions.
Every other week, participants received reminders via email to encourage their engagement with the BroHealth program. Participants received incentives (about Can $25 [US $19] gift cards) for completing each interview, but they did not receive any incentive for completing the web-based program.
The HardHat RCT was about participants’ perceptions of the effectiveness of the HardHat web-based program designed to prevent depression in both men and women who are at high risk of having an MDE in the next 4 years. The HardHat program is coach assisted and comprises 5 compulsory and 4 supplementary sessions, which include short homework and in-class assignments. The 5 compulsory sessions had to be completed sequentially, and finishing one would unlock the next session. The 4 supplementary sessions could be accessed at any point in time. The sessions entail problem-solving therapy and components of CBT. Coaches had a minimum of a Bachelor of Science degree and had attended an intensive 2-day training session provided by a psychiatrist with CBT expertise. Coaches answered questions, guided users through the program, and provided feedback on homework and assignments. Coaches met weekly to discuss the participants’ cases and any issues encountered during coaching. Coaches also met with the psychiatrist on a quarterly basis.
HardHat RCT participants were recruited through a partnership with Green Shield Canada, a not-for-profit Canadian health and dental insurance company. An advertisement and link were posted on the Green Shield Canada health portal. Prospective participants could click the link and complete the eligibility questionnaire, which included a depression risk assessment using the same risk calculator used with participants in the BroHealth RCT [
Wait-list control group: participants gained access to the HardHat program following their final (6 months) interview
Intervention group: participants were given immediate access to the HardHat program.
HardHat participants received incentives (about Can $25 [US $19] gift cards) for completing each of the baseline, 3-month, and 6-month interviews. Every other week, participants in the intervention group received email reminders to engage in the HardHat program. Unlike the BroHealth RCT participants, HardHat participants were also incentivized to complete program sessions. For each session completed, participants earned 100 Green Shield Canada points and were given a ballot for a monthly draw to win a US $100 gift card. The Green Shield Canada points could be used to buy additional ballots for the chance to win rewards such as gift cards.
The original qualitative study design entailed a plan to interview a random sample of the BroHealth RCT intervention group completers to ask them about their experience using the BroHealth program and what aspects of the program they found effective. However, after the initial month of both the BroHealth and HardHat RCTs, we noted that the use of the web-based programs was low among participants in both BroHealth intervention groups and the HardHat intervention group. The sampling plan was shifted to encompass a random sample of participants from these 3 intervention groups; we asked these participants about their perceptions of the effectiveness of their respective web-based programs as well as about what might motivate them to use web-based programs.
A total of 77 participants provided data for this study. Sixty-one participants were from the BroHealth intervention and were organized into 2 groups as follows: BroHealth qualitative group 1 comprised 41 participants who were randomly selected from either of the BroHealth intervention groups (BroHealth intervention group 1=370 participants and BroHealth intervention group 2=374 participants) because they had logged in to BroHealth a maximum of one time during the RCT and were interviewed 2 to 10 months after commencing the program; BroHealth qualitative group 2 comprised 20 participants who were also randomly selected from either of the BroHealth intervention groups, regardless of whether and to what extent they had used the BroHealth program. The BroHealth qualitative group 2 participants were interviewed following the completion of the RCT. Rounding out our sample, a third qualitative group comprising 16 HardHat participants was randomly selected from the HardHat intervention group (HardHat intervention group=103 participants) because they had logged in to HardHat a maximum of one time. HardHat participants were interviewed 1 month into the RCT.
Semistructured telephone interviews were conducted with participants, and interview duration ranged from 2 to 35 min and averaged approximately 9 min. Interviews were audio recorded and transcribed verbatim. All interviews included questions about aspects of the web-based programs that participants found effective, why they did not use the programs, and what did or would motivate program use. The interviews with the BroHealth group 2 participants tended to be lengthier, as these interviews included questions about experience with the RCT overall. The qualitative interview guides are included in the
We sought to capture a full range of both aspects of participants’ perceptions of the effectiveness of the web-based programs as well as factors that would motivate the use of such programs. As such, we were guided in our sample sizes by the principle of
For this inductive content analysis, we began data analysis concurrent with interview data collection. After each interview, the recording was transcribed and reviewed by the research team. We then followed Elo and Kyngas’ [
We enhanced the trustworthiness of our findings by using the triangulation of investigators in our analysis. Specifically, author 2 (MN) conducted a brief analysis by reading select transcripts and providing a summary of key issues evident in the transcripts. All transcripts were then reviewed and coded by author 1, looking for important pieces of data. Authors 1 (HE) and 2 (MN) reviewed both analyses for the similarity of issues identified in the transcripts. A third researcher who was external to this project was brought in to ensure that the broader categories were a fair representation of the codes that were identified. The 3 researchers then discussed and reached consensus about any inconsistencies in codes and categories.
This project was approved by the Research Ethics Board of the Royal Mental Health Centre in Ottawa, Canada.
Of the 77 participants, 70 were males and 7 were females. Response rates in the form of the number of prospective participants contacted versus the number who agreed to participate in the interviews are depicted in
The average age of the participants was 40.6 years (SD 1.34) and ranged from 20 to 65 years. The average risk of depression in the next 4 years was 23.1% and ranged from 7% to 87%. We generated 4 categories pertaining to the perceived effectiveness of the web-based mental health programs: awareness of health, functionality and medium, content, and coaches. We generated 5 categories pertaining to what motivates the use of web-based mental health programs: reminders and incentives, promotion of the programs, appropriate medium and functionality, perceived need, and questioning how or if motivating use is possible.
Response rates of each group of qualitative interviews.
Interview groups | Population (n) | Contacted, n (%) | Interviews, n (%) |
BroHealth low usage | 744 | 81 (10.9%) | 41 (5.5%) |
BroHealth after randomized controlled trial | 744 | 101 (13.6%) | 20 (2.7%) |
HardHat | 103 | 61 (59.2%) | 16 (15.5%) |
Summary of the categories that were found through content analysis divided into their respective topics.
Topics | Categories |
Effectiveness |
Web-based programs increase awareness of mental health Perceived program functionality and the internet as a medium Contrasting perceptions of content effectiveness Coaches increase perceived effectiveness of programs |
Motivators |
Providing reminders and incentives increases motivation Promotion of web-based health programs increases motivation Providing appropriate medium and functionality increases motivation Perceived need for use increases motivation Motivating the use of web-based programs may be impossible |
The most common benefit of web-based mental health programs identified by participants is that such programs improve mental health awareness. Some participants spoke positively about increased self-awareness resulting from the use of the programs. For instance, “...it forced me through some of the issues that I am having” and “I think it helped just be aware of some of the problems writing them down. You know, I just didn't really focus on them that much.”
Participants appreciated being aware of a resource that they could count on to support their needs currently and in the future. One participant explained:
I’d like to have it as a resource I can get to because there are times where like work, life and what not is more stressful than normal...and I want to make sure that I have help when I need it.
Participants believed that web-based programs are especially beneficial for individuals who are unwilling or financially unable to seek professional help.
Moreover, participants believe that web-based mental health programs can increase society’s awareness of mental health. Participants viewed the web-based programs as a “step in the right direction” in terms of reducing stigma and increasing access to help, especially for men:
...it also makes it a nice tool for people who don't want to talk about mental health among men. It's still a big stigma right now. Not a lot of people that want to admit to it, but it’s nice that it’s there.
Functionality and medium were important considerations with respect to the perceived effectiveness of web-based health programs. Participants expressed conflicting views about using the internet. On the one hand, participants endorsed the idea of having 24/7 access and an increased level of privacy. For instance, one participant mentioned:
I would say that that makes it effective to me because it's available to me at 1 o' clock in the morning if I wake up and I can't sleep...or feeling anxious about something, that's an advantage to uh, to be able to look at something and at that time.
Another participant said:
I assume a lot of people who are in my situation are in a crazy schedule so like you know the ability to do something on your own time and not always have appointments booked for you is good.
On the other hand, participants mentioned having procrastinated because there was nobody to ensure their participation. Furthermore, many participants had limitations to their computer use for reasons such as long hours on the computer for work, not being comfortable with computer use, and not having internet access. For instance:
I work on computers all day in my job so to then after sit on a computer um you know, when I walk away from my work I cannot just spend a lot of time on computers.
Although there was little reference to specific aspects of web-based program functionality, most participants were happy with the overall functionality and ease of use of both programs. However, some participants in both programs expressed finding it difficult to navigate the websites:
It was okay, for the first little bit it might have been a little bit confusing and not really sure where to go, what I’m looking for.
Some participants also noted technical issues such as broken links that may inhibit the effectiveness of the program.
Participants had varying opinions regarding the effectiveness of the content of the web-based mental health programs. Some found the content to be appropriate, detailed and engaging, and effective at decreasing stress. One participant remarked:
What was helpful is that, I do need to get back to listing what my challenges and goals are.
Conversely, some participants did not find the program content useful for the following reasons: the content was too similar to other resources, the content was not relevant to the user, the program had a poor flow, and the program lacked appropriate information on mental health. One participant stated:
after a half a dozen times I found that the content was redundant with what I had already gotten from my healthcare provider.
Some participants believed that the amount and type of content were comprehensive and covered a wide area related to mental health, whereas other participants felt there was too much information and that
Participants also recommended having personalized profiles to allow them to more quickly and easily narrow in on appropriate resources. Participants who believed the content to be appropriate and helpful cast their feedback in broad terms such as
Although 45 participants had access to a coach (intervention group 2 of BroHealth and HardHat intervention group participants), very few used their coach. Of the 29 participants in BroHealth intervention group 2 who had access to a coach, only 2 utilized the coach and they believed that it was a great feature of the program:
I think I called at least 6 to 8 times and each time I was really happy to talk to him...to bring me back and to give me good advice and to take me back to planet earth a little.
None of the 16 HardHat intervention group participants used their coach. Most were not aware that there was a coach included in the program or were unsure of the role of the coach. A few participants expressed not feeling comfortable talking with a coach because they were unsure about what to say. Participants who were either not given access to a coach (intervention group 1 in the BroHealth RCT) or who did not use their coach speculated that having a counselor to talk to would be an added benefit of the program. One participant compared the availability of BroHealth coaches with the availability of counselors in another program:
...they utilize an interesting way of connecting live counsellors with people who are actively looking to chat right now. And that's the only thing that wasn't there.
HardHat participants also believed that coaches would benefit them:
I think that getting that personal connection with the coach to be able to have that personal connection and possibly be able to relate to them.
Participants from both programs recommended having counselors that they could speak to via text, phone, or in person by appointment or on a 24/7 basis. Participants believed this would improve the web-based programs in 2 ways: (1) by keeping participants accountable by scheduling appointments and (2) by giving them someone to talk to if they need extra help with their mental health.
Most participants believed that the reminders were beneficial in increasing their program use:
…when I got an e-mail from you before that sort of was a trigger to take a look.
At the same time, many participants did not recall receiving these reminders, thus limiting the perceived effectiveness of reminders. Many participants believed that text message reminders, rather than email, would be a more effective way to motivate program use:
I don't always check my emails, it's not something that I necessarily sit down and do on a daily basis. Everybody always has their phone with them.
Participants also acknowledged that the follow-up interviews conducted as part of the RCTs served as reminders to use the programs:
A lot of it was after interviews that I've done previously. It was a good reminder that the website was there.
Participants in the HardHat RCT received incentives to engage in the program, whereas participants in the BroHealth RCT did not. Participants who received incentives and participants who did not receive incentives indicated that incentives were a good motivator for program use. For instance, one participant commented:
Something like points or rewards for progress as you work through it kind of thing might be a motivator to go back to it.
Overall promotion and marketing of web-based mental health programs are major motivators to use the program. Participants believed that better promotion, and thus awareness and knowledge of the program, is the first step in motivating program use. For instance, one participant said:
It really is just trying to motivate the person to click it once, I suppose, and go on there.
Moreover, participants believed that having a good understanding of the program and its benefits before starting the program would motivate use. Various ways to promote use to people not already using the web-based programs were described by participants, including emails, text messages, word of mouth, and social media. One participant suggested using employers and workplaces to distribute information about the program, ensuring that a support system in the workplace is in place, and even having the program integrated within the workplace. Another participant said:
...it would be nice if things were within the workplace. In the workplace there's more structure. A lot of my stress derived from being self-employed and not having uh the workplace environment there to support me.
The type of medium and functionality of the web-based programs were significant motivators. Many participants mentioned the importance of personal preference, noting that younger generations tend to be drawn to web-based media. Participants conveyed the importance of the medium fitting into their everyday life to motivate them to use the program. For instance, having notifications on their social media accounts and/or being able to access the program as an app on their mobile device were motivators. One participant explained:
whatever kind of sites that a person connects through...so you know if I get, if I get Facebook updates like that.
Many participants mentioned that being able to talk to a person (via text messaging, phone, or in person) in some capacity is beneficial for web-based mental health programs and would motivate use by increasing accountability. Ease of use (ie, “quick, easy, and convenient”) was also a motivator to use the programs, as these characteristics allow the programs to fit into the busy lives of the participants.
Participants perceiving that they need the program and perceiving the program as beneficial are major motivations for program use. Many nonusers anticipated that they would use web-based mental health programs in the future if they perceived a need for it. These nonusers did not believe that they were currently going through a hard time or having any symptoms; thus, they did not believe they had a personal need for the program.
Participants who did perceive themselves as having a need for the program were more motivated to continue using the program when program content was relevant to their lives. For instance, one participant said:
That one time I did go into it, I liked what I saw so I'm going to be going back.
Having content relevant to participants’ experiences makes participants more likely to achieve the benefits of the program, in turn, improving motivation to use the program on a continuous basis. Updating the content may also lead to continued use.
Although motivating the use of web-based mental health programs is an important endeavor to ensure the use of mental health programs, many participants were simply unsure of how to do so or felt that motivating use was not possible. For instance, one participant stated:
...that's a really good question and if it was an easy answer, I wish it was an easy answer.
Others felt that the barriers to using such programs, such as lack of prioritization and stigma, are unsurmountable. For example, one participant explained:
when it comes to stacking priorities, how would you get around that, I really don't know.
Another participant commented:
...in my opinion, probably can't...I just come from a different school of thought I guess. That's just not a man thing to do.
Web-based mental health programs are valuable in preventing and treating depression [
Past literature describes many benefits of using web-based mental health programs, including convenience, accessibility, and cost-effectiveness [
Despite the benefits described earlier, adherence to web-based programs for mental health is low. Thus, the question is, how can we motivate people to use web-based health programs for mental health? Furthermore, how can we motivate people to use web-based programs before developing depression?
The first and, arguably, the hardest step is to convince people to use such programs for the first time. To convince people to use these programs, people need to (1) have the knowledge that such programs exist and (2) believe that they have a need for the services provided by the web-based mental health programs. Useful marketing of the programs was a very strong motivator uncovered in this study. Primary care providers are the number one source of mental health information [
Mental health programs within the workplace have been reported in the literature as decreasing stigmatization of poor mental health [
Once a person has decided to initiate the use of a mental health program, they need to complete it to reap the full benefits [
Our study found that appropriate content was an important factor for increasing the perceived effectiveness and, consequently, the increased use of web-based mental health programs. However, as content needs often vary significantly from person to person, the participants in this study postulated that having individually tailored content may motivate the continued use of a web-based program. Moreover, meta-analyses and systematic reviews have shown that having tailored content can decrease symptoms of depression in study populations [
In addition, reminders not only increase adherence to [
The use of the internet as a medium was a polarizing topic, as web-based programs are not preferred by everyone. Although some participants believe using the internet as a medium is ideal because of privacy and convenience, others preferred alternate media as they had limited computer use. This discrepancy is consistent with other studies [
Although the methods to motivate use described above have been found to be effective, there are many individuals who are unsure of how to motivate their own use or who simply do not believe that it is possible to motivate people in general because depression and help-seeking remain highly stigmatized [
This study is limited in several ways. First, given the specific and detailed nature of this study, we make no claims that our findings can be extrapolated to larger populations or to other web-based mental health programs. Second, there is a chance that a different research team with different backgrounds would generate different categories from our data. To offset this limitation, multiple researchers collaborated and achieved a consensus on the analysis. We note further that some participants were interviewed a few months after they had used the program and thus may have had difficulty with recall. Our study did not examine how demographics, such as age, income level, and occupation, could influence participants’ perceptions about web-based mental health programs. Finally, very few participants engaged with their coaches. As a result, the views that they expressed about coaches were often not based on personal experience and should therefore be interpreted with caution.
In conclusion, awareness of one’s own mental health is a benefit of using web-based mental health programs. The content and functionality of the programs are important factors when assessing perceived effectiveness. However, perceived effectiveness varies from person to person, and what may be effective for one person may not be effective for another. Access via chat to a real person and being able to customize content to fit the users’ personal needs are improvements that could increase the perceived effectiveness and use of similar programs. Motivating people to use such programs is difficult; even current program users are unsure of the best ways to motivate use. Motivators include providing reminders or incentives, promoting the programs, providing appropriate medium and functionality, and perceived need, which, if adequately incorporated into web-based program design and implementation, may lead to increased use.
Qualitative interview guide.
cognitive behavioral theory
major depressive episode
randomized controlled trial
This study was supported by grants from the Movember Foundation and Green Shield Canada. The Movember Foundation and Green Shield Canada play no role in the study design, analysis, and interpretation.
All authors contributed to study design, interpretation, review, and final approval of the manuscript.
None declared.