Published on 04.09.19 in Vol 21, No 9 (2019): September
A Digital Intervention Addressing Alcohol Use Problems (the “Daybreak” Program): Quasi-Experimental Randomized Controlled Trial
Background: Alcohol use is prevalent in many societies and has major adverse impacts on health, but the availability of effective interventions limits treatment options for those who want assistance in changing their patterns of alcohol use.
Objective: This study evaluated the new Daybreak program, which is accessible via mobile app and desktop and was developed by Hello Sunday Morning to support high-risk drinking individuals looking to change their relationship with alcohol. In particular, we compared the effect of adding online coaching via real-time chat messages (intervention group) to an otherwise self-guided program (control group).
Methods: We designed the intervention as a randomized control trial, but as some people (n=48; 11.9%) in the control group were able to use the online coaching, the main analysis comprised all participants. We collected online surveys at one-month and three-months follow-up. The primary outcome was change in alcohol risk (measured with the alcohol use disorders identification test–consumption [AUDIT–C] score), but other outcomes included the number of standard drinks per week, alcohol-related days out of role, psychological distress (Kessler-10), and quality of life (EUROHIS-QOL). Markers of engagement with the program included posts to the site and comments on the posts of others. The primary analysis used Weighted Generalized Estimating Equations.
Results: We recruited 398 people to the intervention group (50.2%) and 395 people to the control group (49.8%). Most were female (71%) and the mean age was 40.1 years. Most participants were classified as probably dependent (550, 69%) on the AUDIT–10, with 243 (31%) classified with hazardous or harmful consumption. We followed up with 334 (42.1%) participants at one month and 293 (36.9%) at three months. By three months there were significant improvements in AUDIT–C scores (down from mean 9.1 [SD 1.9] to 5.8 [SD 3.1]), alcohol consumed per week (down from mean 37.1 [SD 28.3] to mean 17.5 [SD 18.9]), days out of role (down from mean 1.6 [SD 3.6] to 0.5 [SD 1.6]), quality of life (up from 3.2 [SD 0.7] to 3.6 [SD 0.7]) and reduced distress (down from 24.8 [SD 7.0] to 19.0 [SD 6.6]). Accessing online coaching was not associated with improved outcomes, but engagement with the program (eg, posts and comments on the posts of others) were significantly associated with improvements (eg, in AUDIT–C, alcohol use and EUROHIS-QOL). Reduced alcohol use was found for both probably dependent (estimated marginal mean of 40.8 to 20.1 drinks) and hazardous or harmful alcohol users (estimated marginal mean of 22.9 to 11.9 drinks).
Conclusions: Clinically significant reductions in alcohol use were found, as well as reduced alcohol risk (AUDIT–C) and days out of role. Importantly, improved alcohol-related outcomes were found for both hazardous or harmful and probably dependent drinkers. Since October 2016, Daybreak has reached more than 50,000 participants. Therefore, there is the potential for the program to have an impact on alcohol-related problems at a population health level, importantly including an effect on probably dependent drinkers.
Trial Registration: Australian New Zealand Clinical Trials Registry: ACTRN12618000010291; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=373110
International Registered Report Identifier (IRRID): RR2-10.2196/9982
J Med Internet Res 2019;21(9):e14967
The use of alcohol is one of the leading causes of disease burden and deaths globally, and among those aged 15-49 years it is the leading risk factor for deaths for both males and females . While there are increasing doubts that alcohol use confers any health benefits [ ], national guidelines tend to be framed in terms of reducing the risks to health from alcohol use [ , ]. Despite these guidelines, many people still consume alcohol in a manner that increases their risk of adverse consequences: in Australia, about 38% of those aged 12 years or older exceeded either the single occasion consumption guideline or the regular use guideline in 2016 [ ]. Further, the current availability of treatment resources is estimated to only fulfil 26%-48% of the needs for treatment required [ ]. In the United States, about 24.5% of those aged 12 years or older are classified as having binged in the last 12 months, about 6.1% have engaged in heavy alcohol use and about 5.1% have an alcohol use disorder [ ]. Yet, even among those with an alcohol use disorder, less than 10% are likely to have received treatment in the last year [ ].
In order to provide interventions, particularly for those with at-risk patterns of alcohol use (as opposed to those with alcohol use disorders, such as alcohol dependence), opportunistic screening and brief interventions have been developed [, ]. Subsequently, these face to face interventions have been adapted for Internet delivery, with the intensity varying from personalized feedback to multistage interventions [ , ]. An early meta-analysis found that compared with single session interventions (Hedges’ g=.27), extended self-help interventions (Hedges’ g=.61) offered significantly greater reductions in alcohol use [ ] but that the addition of guidance did not significantly improve outcomes compared with unguided interventions [ ]. In contrast, a recent individual patient meta-analysis based on 14,198 participants found that guided interventions resulted in greater reductions in alcohol use than fully automated interventions [ ]. Further, no difference in outcomes was found between those with different drinking profiles (described as regular at-risk drinking, heavy drinking or binge drinking.)
Even where interventions have been shown to be efficacious, there are few publicly available websites, with a recent review identifying 72 trials of alcohol interventions but only eight (11%) with functioning websites . Further, the importance of interventions reaching the whole of the target population has been emphasized if public health impacts are to be realized [ ]. To this end, Hello Sunday Morning took a different approach to conventional web-based interventions and provided both a social media–based, health promotion movement combined with an online environment that incorporated blogging, social networking, peer support and interventions (eg, behavioral experiments) [ ].
Hello Sunday Morning, established in 2010, asked participants to set a public alcohol consumption goal (eg, abstinence or reduction) for a set period of time (eg, three, six or twelve months [, ]). Previous reports have provided descriptive analysis of participants [ ], and an observational study reported a significant improvement in scores on the alcohol use disorders identification test (AUDIT) [ ], down from a mean of 20.3 (SD 6.7) at baseline to a mean of 8.9 (SD 8.9) at seven months [ ]. In August 2018, the original version of Hello Sunday Morning closed, having registered more than 100,000 people, and was superseded by the Daybreak program that was accessible via mobile app and desktop.
As with the legacy program, the Daybreak program aimed to support individuals in changing their relationship with alcohol via access to peer support, self-guided experiments, and individualized health coaching. Daybreak was developed in response to the growing number of probably dependent drinkers engaging with Hello Sunday Morning, to ensure that these members had the level of clinical support they required (eg, access to health coaches, psychologists and appropriate levels of peer moderation) that the previous version of the program could not provide.
The objectives of the current study were: (1) to assess the effectiveness of the new Daybreak program; and (2) to evaluate the effect of adding a professional, clinical component (termed online coaching) to the program, whereby members had access to counsellors or psychologists via smartphone chat. We hypothesized that those receiving coaching would show greater improvements in alcohol-related measures than those who did not receive coaching. As additional objectives, we evaluated whether engagement with the program improved outcome measures. Further, given the need to provide resources for both those with at-risk alcohol use and those with more severe problems (probable dependence), outcomes were compared for these two groups. Daybreak is designed as a standalone intervention.
The study was planned as a randomized control trial to compare the Daybreak program plus online coaching via real-time chat messages (Intervention group) and the Daybreak program without online coaching (Control group) at one, three and six months. However, due to a programming error, some (n=48; 11.9%) people in the Control group were able to access online coaching and we could not tell if other members of the Control group found they could access the online coaching but did not opt to use it. Therefore, with the approval of the human research ethics committee, the trial was ended after the last person to consent reached their three-month follow-up rather than the planned six-month period.
Participants and Randomization
We invited new registrants to Daybreak to join the study (see). To be eligible, participants had to be 18 years or older, a resident in Australia, had to provide a valid email address and had to have access to the Internet. However, we excluded those who reported a history of treatment for cardiovascular disease, as this was likely to confer additional health risks during alcohol withdrawal [ ]. Participants had to exceed the at-risk threshold (>7) on the 10-item AUDIT [ ]. Scores on the AUDIT between 8-19 indicate a pattern of drinking that is likely to fulfil the International Classification of Diseases criteria for hazardous or harmful drinking, while higher scores equate to alcohol dependence [ ], but the AUDIT is a screening tool and not a diagnostic indicator. Finally, as part of our duty of care, we assessed suicide risk with the P4 suicidality screening survey [ ]. Those participants classified as above minimal risk were still eligible for the study, but they were also provided with the contact details for Lifeline (a 24-hour support service). Those people classified in the highest AUDIT group (≥20: probable dependence) had it recommended to them to speak to their general practitioner or other health professional prior to reducing their use of alcohol in order to minimize potentially serious complications during alcohol withdrawal. The study planned to use a simple, fully randomized allocation (eg, no blocking). Participants were blind to their condition and follow-up data were collected online by an automated survey and hence blind to condition. Those not meeting the eligibility criteria could still access Daybreak but were not part of the study cohort. The processes of screening, enrolment and randomization were fully automated.
The Daybreak program is available from the Google and Apple App Stores or https://www.daybreakprogram.org/, but it can also be accessed from sites such as healthdirect.gov or other health directories. Alternatively, visitors to the Hello Sunday Morning website (www.hellosundaymorning.org) are directed to the program. Daybreak is a self-guided program that can be accessed as frequently as required by the participant, and access is controlled via username (email address) and password. Those in the Intervention group also had access to an online health coach between 7:00 and 19:00 on weekdays, but as noted above, some of the Control group also accessed coaching. We commenced recruitment in February 2018 and closed it in November 2018. The Daybreak version used throughout the study was version 1.5.8, build 90. Since late 2016, Daybreak has reached more than 50,000 participants.
We emailed and sent a text to participants with a link to the relevant follow-up survey after one month and after three months. If required, we sent a reminder text message one week later. If there was no response, a research assistant who was blind to study group allocation telephoned the participant to ask them to complete the follow-up, with a maximum of three telephone reminders calls allowed to be made. At each follow-up, participants were eligible to enter a draw to win an Ipad2. The study received the required institutional ethics approval (Curtin University 2017-0855), and the trial procedure was registered (ACTRN12618000010291). In compliance with Australian ethical guidelines, as all participant were screened with at risk alcohol use, we used an active rather than placebo control group .
The sample size estimation was calculated for the planned outcomes at six months. For online alcohol interventions, typical effect size values are in the range of Cohen d=0.3-0.4 at 6 months [, , ]. We were not aware of previous investigations involving social networks as a means of reducing alcohol use; however, investigations with other behaviors (eg, diet, physical activity) typically report small but not significant changes [ ]. Therefore, we based our sample calculation on a small effect (Cohen f=.10; equivalent to Cohen d=0.2) and assumed that the repeated measures would be correlated at r=0.5. To achieve a power of 0.80 with an alpha P<.05 would require 60 people per group, however, given the clinical interest in the effectiveness of brief alcohol interventions for those with more entrenched problems (probable dependence), and potential gender differences, we aimed to recruit 60 people to the smallest cell (sex by AUDIT risk level by study group). To achieve this, we projected recruitment of 300 participants in each group (600 in total), and assuming that 35% would be lost to follow-up, we targeted 467 per group (N=934).
Participants were screened with the 10-item AUDIT, which has been validated in Australia  and elsewhere. Scores range from 0-40 (0-7=low risk, 8-19=hazardous or harmful alcohol use, 20-40=probable dependence), and outcomes were assessed as change in the scores for the first three items (termed the AUDIT–C). Prior research has shown that the AUDIT–C can predict clinical outcomes at 12 months [ ]. We also assessed secondary outcomes and other measures, which are listed in .
Engagement with the Daybreak program was recorded as: (1) engagement with coaching (defined as at least one message sent by the participant to the coach); (2) The number of experiments completed; (3) number of blog shares (posts on their own blog); and (4) number of blog comments (posts on another person’s blog).
Content of the Interventions
The rationale behind the Daybreak program is to help people change their relationship with alcohol. This is facilitated by encouraging participants to establish a goal (eg, abstinence, reduced use), to reflect on their mood, and also to give and receive peer support. Four mechanisms were used to help achieve behavior change, which included weekly check-ins, peer support, behavioral experiments and health coaching.
The Daybreak program includes self-reported questionnaires to encourage participants to undertake self-reflection to explore their intrinsic motivators for change.
The Daybreak program enables participants to connect with other users of the program through a blog function. Internal data showed that 45% of shares on the blog received five or more comments in less than 60 minutes. In addition to supporting others going through the process of becoming a nonconsumer of alcohol, the narrative process enables individuals to construct new self-identities, with transitions in the narratives often noted .
Two components of the Daybreak program are self-guided experiments and associated learnings. The experiments draw on a range of theoretical perspectives (eg, cognitive behavioral therapy, acceptance and commitment therapy) and cover five areas (mindfulness, connectedness, resilience, situational strategies and health). For example, a mindfulness experiment might guide participants to be in the moment during a period of craving. There are also some experiments that take a broader perspective to help participants with their general health (eg, fitness routines, healthy eating, sleep hygiene).
The online health coaching was the critical difference between the Intervention Group and Control group. As previously described , all the health coaches fulfilled the relevant guidelines for low intensity mental health providers [ ], and some coaches were registered general and clinical psychologists. In-house training was provided to develop skills and knowledge on delivering online services (eg, ethical considerations, forming connections online, coaching procedures, risk management, and platform specific training). Novice coaches received supervision, with further periodic feedback from a senior health coach.
The role of the online coaches was to partner with participants in order to assist them with goal setting and assist them in reaching their goals. All coaching interactions occurred through real-time chat messages on a secure platform. The coaches tailored support to the individual’s requirements and drew on a range of techniques (eg, cognitive behavioral therapy, motivational interviewing and acceptance and commitment therapy techniques) as appropriate. Daybreak has a written Risk Management Protocol covering all members, not just the research cohort, to automatically detect trigger words and alert the clinical team . In addition, forum posts were monitored and the clinical team responded to alerts from other participants.
Descriptive data and analyses (eg, t tests, Mann-Whitney U tests, χ2 tests) were provided for each group. However, due to concerns over the randomization process, the main repeated measures analysis was for all participants rather than by randomized groups. In addition to the overall results,provides online descriptive data at 1-month and 3-months follow-up by randomized group for each outcome measure.
We used Weighted Generalized Estimating Equation (WGEE) analyses to investigate longitudinal changes in primary and secondary outcomes over the study period. WGEE is a repeated measures regression model that takes into account the correlation of repeated measures within each subject . In contrast to repeated measures analysis of variance (ANOVA), WGEE has minimal assumptions about time dependence and uses all available longitudinal data, irrespective of single missing values at follow-up. WGEE is also more robust than unweighted generalized estimating equation, when the assumption of missing completely at random (MCAR) is violated. To control for attrition at 1-month and 3-months follow-up, we estimated weights as suggested by Salazar et al (2016). Attrition analysis revealed that 1-month assessments were more likely to be completed by participants who were older (t721.92= 3.67; P<.001), not single (χ23=11.467; P=.009), who used less alcohol in the 7 days prior to baseline (t786.919=–2.676; P=.008), who had higher sleep quality values (t703.512=–1.953; P=.05), who had more blog shares (t482.08=3.744; P<.001), blog comments (t550.511=4.058; P<.001), experiments taken (χ21=15.65; P<.001), and finally, who stayed longer in the program (t692.773=5.252; P<.001). In addition, the 3-month assessments were also more likely completed by participants who were female (χ22=20.366; P<.001), who had minimal initial suicide risk (χ22=8.706; P=.01), and who had lower psychological distress (t657.61=–2.328; P=.02).
In the first round of analysis, WGEE models included only the time variable to examine significant changes in outcomes over the study course. In the second round, WGEE models included the following predictors: (1) time (baseline versus follow-up assessment); (2) study group; and (3) the interaction term for time by group. In the last round of analyses, WGEE models included: (1) time; (2) baseline variables; (3) program use variables; and (4) interaction terms for time by program use variables. We then used a hierarchical, backwards procedure where we removed predictors with the highest P-value one at a time until only significant predictors were retained within the model. In the WGEE parameters, the intercept shows the mean change in the outcome for all participants (and on a population level). Betas are added or subtracted to the intercept, which reveals the change in the outcome for the particular group.
Outcomes by AUDIT risk group (probably dependent versus hazardous or harmful) were assessed with a standard, repeated measures ANOVA, as we were interested in the subject level outcomes rather than the population interpretation from the WGEE. In addition, an alpha level of 0.05 (two tailed) was chosen for all statistical tests conducted in the study. All analyses were performed using the statistical tools SPSS version 22 and R version 3.3 via geepack .
Study Participation, Sample Characteristics, and Attrition
There were 2616 people who viewed the invitation page. Of these, 1278 (49%) accessed additional information and 978 (77%) provided consent. However, not all were eligible for the study. Of everyone who provided consent, 61 indicated a previous cardiovascular disease diagnosis, 28 scored below the AUDIT cut-off score, and 36 did not complete the AUDIT (12 cases failed more than 1 eligibility criteria). Further, there were 50 people who attempted to enroll multiple times after failing an eligibility criterion. We excluded these people, plus an additional 22 people who were not randomized because of a programming error. Thus, the study cohort consisted of 793 people (81.1% of those who consented; see).
There were 398 people randomized to the Intervention group (50.2%) and 395 to the Control group (49.8%). Of all the participants, 71% were female (one person selected other) with a mean age of 40.1 years (SD 10.0), and most participants (77%) had at least commenced tertiary education. The mean Kessler’s K-10 score was 24.8 (SD 7.0), with 19 participants (2.4%) reporting a serious suicide attempt, and nearly 30% of participants were in the highest risk category on the P4 suicide screen. A total of 69% (n=550) of participants were classified in the AUDIT highest risk category (probably dependent), with their mean alcohol consumption being 37.1 (SD 28.3) standard drinks per week. At baseline, the only significant difference between the groups was in terms of days completely out of role due to alcohol use (). Follow-up data were subsequently collected from 334 (42.1%) participants at 1 month, and from 293 (36.9%) at 3 months.
Overall, 106 participants engaged with coaching (eg, at least one message sent by the participant to the coach), including 68 from the Intervention and 38 from the Control groups (). A greater proportion of those in the Intervention group engaged with an online coach (17.1%; χ21=9.5; P=.002) than the Control group (9.6%). Blog posts were made by 526 people, with 258 in the Intervention group (65%) and 268 in the Control group (68%). In terms of shares, 230 people (58%) in the Intervention and 227 people (58%) in the Control group commented on the posts of others. There were no significant differences in the median number of experiments taken, shares, comments or days in the study.
Pre-post comparisons of primary and secondary outcomes are displayed in. The WGEE models revealed significant changes over the study period for all outcomes at P<.001, except for amount of exercise at baseline to 1 month (P=.15) and at baseline to 3 months (P=.65). Participants significantly reduced their alcohol use and their psychological distress, and also gained in sleep quality and quality of life. Further, WGEE revealed that neither study group, nor the interaction term between study group and time, were associated with changes in primary or secondary outcomes. WGEE accounted for missing patterns at T1 and T2, with weights for T1 accounting for age, marital status, alcohol use days (last 7 days), sleep quality, retention, blog shares, blog comments, and experiments seen or done, and weights for T2 accounting for age, gender, marital status, suicide risk, psychological distress (K-10), retention, blog shares, blog comments, and experiments seen or done. Effect size was calculated via Psychometrica [ ].
|Variable||Intervention (n=398)||Control (n=395)||P value|
|Sex (female)a, n (%)||285 (72)||276 (70)||.51|
|Age (years), mean (SD)||40.9 (10.0)||41.0 (10.1)||.89|
|Marital statusa, n (%)||.74|
|Single or divorced||139 (35)||129 (33)|
|Married||162 (41)||174 (44)|
|De facto||87 (22)||80 (20)|
|Remarried||10 (3)||12 (3)|
|Highest education levela, n (%)||.71|
|Primary or high school or trade||88 (22)||97 (25)|
|Some or complete university||191 (48)||185 (47)|
|Some or complete higher degree||119 (30)||113 (29)|
|Suicide risk (highest category)a, n (%)||119 (30)||109 (28)||.30|
|Kessler-10, mean (SD)||24.5 (7.0)||25.0 (7.1)||.32|
|Kessler-10 categorya, n (%)||.62|
|Low||35 (9)||36 (9)|
|Mild||106 (27)||91 (23)|
|Moderate||154 (39)||168 (43)|
|Severe||103 (26)||100 (25)|
|EUROHIS-QOL, mean (SD)||3.2 (0.7)||3.1 (0.7)||.70|
|Sleep Quality, mean (SD)||1.7 (0.7)||1.7 (0.8)||.70|
|Exercise (METSb)c, median (IQR)||36 (17-56)||35 (16-56)||.76|
|Health service usec, median (IQR)||2 (0-6)||2 (0-5)||.60|
|Core adverse events, mean (SD)||27.5 (11.3)||26.5 (12.1)||.24|
|Days out of rolec||.02|
|Median (IQR)||1 (0-2)||0 (0-1)|
|Mean (SD)||1.8 (4.1)||1.4 (2.8)|
|Part days out of rolec||.47|
|Median (IQR)||1 (0-5)||1 (0-4)|
|Mean (SD)||3.6 (5.5)||3.5 (5.6)|
|AUDITd (10 items; initial screen), mean (SD)||23.0 (6.0)||23.0 (6.5)||.61|
|AUDIT 10 categorya||.45|
|8-19 hazardous or harmful||117 (29)||126 (32)|
|20-40 dependent||281 (71)||269 (69)|
|AUDIT–C (3 items), mean (SD)||9.0 (1.9)||9.2 (1.9)||.29|
|7-day standard drinks, mean (SD)||37.5 (31.1)||36.8 (25.3)||.74|
aAssessed with chi-square test.
bMETS: metabolic equivalents.
cAssessed with non-parametric Mann-Whitney U.
dAUDIT: alcohol use disorders identification test.
|Variable||Intervention (n=398)||Control (n=395)||P value|
|Engaged with coaching (yes), n (%)||68 (17)||38 (10)||.002|
|Experiments taken (any)|
|n (%)||147 (37)||134 (34)||.40|
|Median (IQRa)||0 (0-1)||0 (0-1)||.50|
|Blog shares, median (IQR)||1 (0-4)||1 (0-10)||.13|
|Blog comment, median (IQR)||1 (0-10)||2 (0-10)||.74|
|Time in study (days), median (IQR)||32 (6-87)||30 (4-90)||.51|
aIQR: interquartile range.
|Variable||Baseline (T0) (n=792)||1 month (T1) (n=333)||3 months (T2) (n=293)||P value (T0-T1)||P value (T0-T2)||Pre-post effect size (T0-T2)|
|AUDIT–Ca, mean (SD)||9.11 (1.92)||6.03 (3.02)||5.78 (3.02)||<.001||<.001||–1.53|
|Alcohol days out of role, mean (SD)||1.59 (3.55)b||0.60 (2.46)b||0.48 (1.63)||<.001||<.001||–0.262|
|Alcohol use (last 7 days), mean (SD)||37.10 (28.34)c||17.06 (21.57)||17.49 (18.89)||<.001||<.001||–0.689|
|Kessler K-10, mean (SD)||24.80 (7.03)||19.84 (6.75)||18.97 (6.60)||<.001||<.001||–0.937|
|EUROHIS, mean (SD)||3.15 (0.70)||3.51 (0.73)||3.57 (0.70)||<.001||<.001||0.745|
|Sleep Quality, mean (SD)||1.70 (0.74)d||1.28 (0.74)||1.27 (0.75)||<.001||<.001||–0.54|
|Exercise (METSe), mean (SD)||55.41 (153.19)||76.20 (246.16)||52.05 (97.88)||.15||.65||–0.015|
aAUDIT–C: alcohol use disorders identification test-communication.
b11 missing values.
c1 missing value.
d4 missing values.
eMETS: metabolic equivalents.
Change in alcohol consumption was compared for those who were as classified on the AUDIT–10 at baseline as hazardous or harmful or as probably dependent. Retention was similar for the two groups at three months, with hazardous or harmful at 38.3% (χ21=0.3; P=.61) versus probably dependent at 36.4 % (χ21=0.3; P=.61). There were significant reductions in alcohol use for both groups (F1288= 24.7; P<.001), with estimated marginal means of 40.8 down to 20.1 drinks for probably dependent and 22.9 down to 11.9 drinks for hazardous or harmful, and there was also a significant time by group interaction (F1288= 8.3; P=.004) reduction for the probable dependence group. The time by sex and the time by group by sex interactions were not significant.
Factors that predicted significant changes in alcohol-related variables are displayed in. Online coaching was not significant in any of the models and was therefore not retained. Significant predictors for AUDIT–C were time (reduced at each follow-up), gender (males report higher scores than females), age (older participants report higher scores than younger participants), and the interaction between blog comments and time (more comments were associated with lower AUDIT–C scores at 1-month follow-up). Significant predictors for alcohol days out of role were time (reduced at each follow-up), gender (males report more days out of role than females), marital status (single participants report more days out of role than partnered participants), education (higher education was associated with lower scores), and the interaction between taking part in experiments and time (taking part in experiments was associated with fewer days out of role at 1-month and 3-months follow-up). Significant predictors for alcohol use in standard drinks were time (lower at each follow-up), age (increased with age), marital status (lower for partnered people), and the interaction term between blog shares and time (more shares were associated with lower alcohol use at 1-month and 3-months follow-up).
|Model, predictors, categories||Beta||SE||P value|
|Blog comments × time|
|Alcohol days out of role|
|Single or divorced (ref)||—||—||—|
|Married or remarried or de facto||–0.83||0.19||<.001|
|Experiments × time|
|Experiments (no) × baseline (ref)||—||—||—|
|Experiments (yes) × 1 month||–0.86||0.36||.01|
|Experiments (yes) × 3 months||–0.25||0.3||.40|
|Alcohol use last 7 days|
|Single or divorced (ref)||—||—||—|
|Married or remarried or de facto||–3.93||1.97||.04|
|Blog shares × time|
Factors that significantly predicted changes in psychological distress and quality of life are displayed in. Significant predictors for the K-10 were time (lower scores at both follow-ups), age (lower with increasing age), marital status (lower for partnered participants), and education level (lower for those with more education). None of the interaction terms for program use by time were retained in the model. Significant predictors for EUROHIS-QOL were time (higher scores at each follow-up), marital status (higher for partnered participants), education (higher for those with more education), and the interaction between blog comments and time (more comments were associated with higher quality of life scores at 1-month follow-up).
|Model, predictor, and categories||Beta||SE||P value|
|Interaction blog comments×time|
Use of the Daybreak program resulted in significantly improved outcomes in terms of alcohol measures, mental health and quality of life. An important finding was that the program was effective in those who were classified as probably dependent at baseline. Face to face brief interventions are recommended for those with at-risk alcohol use, but they are regarded as ineffective for those with alcohol use disorders [, ]. It is therefore important to determine the range of alcohol use for which electronic health (eHealth) interventions are effective. Overall, these findings need to be tempered with the fact that the trial was not implemented as designed, and the longest period of follow-up was only three months.
With its multiple components, the Daybreak program does not fit within the typical definitions of a brief intervention, certainly not as described for face to face brief interventions [, ]. In the context of eHealth interventions, the concept of a number of sessions of treatment or time to deliver treatment is ambiguous; however, Riper et al note a distinction is often drawn between “single session e-personalized normative feedback” and extended interventions that draw on a range of therapeutic techniques [ ]. The Daybreak program lies within the more extensive group. Previously, the extent of engagement with the Hello Sunday Morning program (eg, in terms of blog posts, blog shares, following other participants) has been shown to correlate with improved outcomes (ie, reduced AUDIT scores) [ ]. Despite the low overall level of engagement (see ), these measures still predicted a range of improved outcomes (eg, in AUDIT–C score, in EUROHIS-QOL score with blog comments about alcohol use, and in blog shares at one month). These findings suggest that the community aspect of Daybreak has an important therapeutic role in supporting behavior change.
The outcomes for the study also need to be considered in light of the cohort who participated. Those who access eHealth interventions often have less extensive alcohol use, with a range of 9.1-43.6 standard drinks (mean 18.3) , than those in face to face interventions (mean 24.4 standard (10g) drinks) [ ]. However, in the recent analysis by Riper et al, the mean consumption was 38.1 standard drinks per week [ ]. Most of our participants were classified as probably dependent on alcohol, with mean consumption being 37.1 standard drinks, but the prevalence of severe alcohol problems was higher than typically found in eHealth trials. Thus, many of our participants (69%) were classified as probably dependent on the AUDIT whereas the respective figure reported by Riper et al was 22%, but they also reported that 34% were heavy drinkers (defined as >35/50 standard drinks for females or males) [ ]. Also notable was the high prevalence of women in our trial, representing 71% of participants compared with typical values of about 50% [ , ] and even compared to the previous assessment of Hello Sunday Morning clients (64%) [ ]. There are concerns that eHealth alcohol interventions may not be as effective with women as men [ ]. Although men had higher AUDIT–C scores and more days out of role than women, gender was not significant as an interaction term in the current study.
Also notable was the high level of distress as measured with the K-10 and the suicide screening scores. Given the evident distress, it is important that eHealth interventions in this area provide appropriate support and referral pathways. In contrast, the days out of role were not as extensive as those reported for people with alcohol dependence , and the mean quality of life scores, while lower at baseline than the general population, were above those for a cohort with depression [ ]. Further, by three months the mean score was above that for a general population sample [ ].
One of the main aims of this trial was to evaluate if outcomes could be enhanced by giving participants access to online coaching. Few participants opted to use this facility, with 17.1% of the Intervention group accessing the service. Overall, online coaching was not associated with any significantly improved outcomes. The lack of an effect for online coaching is similar to previous studies where guidance has not improved alcohol-related outcomes , but remains in contrast to both eHealth interventions for other mental health problems where guidance appears to be beneficial (eg, standardized mean difference compared to unguided=–0.27) [ ] and the most recent analysis of alcohol interventions [ ]. The reason for the potential difference between those with alcohol use problems and other types of mental health issues is unclear but given that improved outcomes were obtained without the provision of this additional resource-intensive component, this means that Daybreak can be provided more widely.
Clearly the most significant limitation was that the trial was not implemented as designed, with some members of the Control group accessing the online coaching, so this necessitated a change in the planned analysis. In addition, we also stopped the trial at the completion of the three-month follow-up rather than at six months due to this error. Compared with other studies in the field, the level of attrition for this study was high (63%) compared to other alcohol studies of at least three months duration (range=8%-45%; mean 25.2% ) [ ], thus limiting the generalizations that can be made from these data.
The current Australian guidelines do not provide a formal recommendation for the number of drinks per week that constitute low risk drinking, but they do recommend that average daily consumption should not exceed two drinks per day , equating to 14 per week. On this basis, the average reported here (17.5 drinks) still exceeds that figure, albeit from a high starting point. We do note that those with hazardous or harmful alcohol use did reduce their consumption to below the guideline (mean 11.9 at three months). The Daybreak program, due to its extensive reach, member engagement and clinical safety, has the potential to realize a population level impact for both at risk drinkers and for probably dependent drinkers [ ].
Conflicts of Interest
The trial was funded by Hello Sunday Morning under support from the nib foundation and Ian Potter Foundation. RJT is supported by funding from the Australian Government under the Substance Misuse Prevention and Service Improvement Grants Fund through employment at The National Drug Research Institute at Curtin University. JJLK and JCM are employees of Hello Sunday Morning.
Participant information.PDF File (Adobe PDF File), 325KB
Outcomes by randomized groups.PDF File (Adobe PDF File), 74KB
CONSORT-eHealth checklist (V1.6).PDF File (Adobe PDF File), 2MB
- GBD 2016 Alcohol Collaborators. Alcohol use and burden for 195 countries and territories, 1990-2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet 2018 Dec 22;392(10152):1015-1035. [CrossRef] [Medline]
- Chikritzhs T, Stockwell T, Naimi T, Andreasson S, Dangardt F, Liang W. Has the leaning tower of presumed health benefits from 'moderate' alcohol use finally collapsed? Addiction 2015 May;110(5):726-727. [CrossRef] [Medline]
- National Health and Medical Research Council. Australian Guidelines to Reduce Health Risks from Drinking Alcohol. Canberra: NHMRC; 2009:ISBN: 1864963743.
- UK Chief Medical Officers. UK Department of Health. 2015. Alcohol Guidelines Review: Summary of the proposed new guidelines URL: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/489795/summary.pdf [accessed 2019-06-06] [WebCite Cache]
- Australian Institute of Health and Welfare. National Drug Strategy Household Survey. Canberra: Government of Australia; 2017:ISBN: 2205-507X.
- Ritter A, Berends L, Chalmers J, Hull P, Lancaster K, Gomez M. Drug Policy Modelling Program, National Drug and Alcohol Research Centre. 2014. New Horizons: The review of alcohol and other drug treatment services in Australia URL: https://ndarc.med.unsw.edu.au/sites/default/files/ndarc/resources/New%20Horizons%20Final%20Report%20July%202014.pdf [accessed 2019-06-06] [WebCite Cache]
- Substance Abuse and Mental Health Services Administration. Results from the 2017 National Survey on Drug Use and Health: Detailed Tables. Rockville: SAMHSA, Center for Behavioral Health Statistics and Quality; 2018.
- Substance Abuse and Mental Health Services Administration. National Survey on Drug Use and Health (NSDUH) 2017 Data Archive. Rockville: SAMHSA; 2019.
- Landy MSH, Davey CJ, Quintero D, Pecora A, McShane KE. A Systematic Review on the Effectiveness of Brief Interventions for Alcohol Misuse among Adults in Emergency Departments. J Subst Abuse Treat 2016 Feb;61:1-12. [CrossRef] [Medline]
- O'Donnell A, Anderson P, Newbury-Birch D, Schulte B, Schmidt C, Reimer J, et al. The impact of brief alcohol interventions in primary healthcare: a systematic review of reviews. Alcohol Alcohol 2014;49(1):66-78 [FREE Full text] [CrossRef] [Medline]
- Riper H, Spek V, Boon B, Conijn B, Kramer J, Martin-Abello K, et al. Effectiveness of E-self-help interventions for curbing adult problem drinking: a meta-analysis. J Med Internet Res 2011;13(2):e42 [FREE Full text] [CrossRef] [Medline]
- White A, Kavanagh D, Stallman H, Klein B, Kay-Lambkin F, Proudfoot J, et al. Online alcohol interventions: a systematic review. J Med Internet Res 2010;12(5):e62 [FREE Full text] [CrossRef] [Medline]
- Riper H, Hoogendoorn A, Cuijpers P, Karyotaki E, Boumparis N, Mira A, et al. Effectiveness and treatment moderators of internet interventions for adult problem drinking: An individual patient data meta-analysis of 19 randomised controlled trials. PLoS Med 2018 Dec;15(12):e1002714 [FREE Full text] [CrossRef] [Medline]
- Rogers MA, Lemmen K, Kramer R, Mann J, Chopra V. Internet-Delivered Health Interventions That Work: Systematic Review of Meta-Analyses and Evaluation of Website Availability. J Med Internet Res 2017 Mar 24;19(3):e90 [FREE Full text] [CrossRef] [Medline]
- Sundström C, Blankers M, Khadjesari Z. Computer-Based Interventions for Problematic Alcohol Use: a Review of Systematic Reviews. Int J Behav Med 2017 Dec;24(5):646-658 [FREE Full text] [CrossRef] [Medline]
- Carah N, Meurk C, Hall W. Profiling Hello Sunday Morning: who are the participants? Int J Drug Policy 2015 Feb;26(2):214-216. [CrossRef] [Medline]
- Hamley B, Carah N. Fare. 2012. One Sunday at a time: Evaluating Hello Sunday Morning URL: http://fare.org.au/one-sunday-at-a-time-evaluating-hello-sunday-morning/ [accessed 2017-12-01] [WebCite Cache]
- Babor T, Higgins-Biddle J, Saunders J, Monteriro M. AUDIT The Alcohol Use Disorders Identification Test: Guidelines for Use in Primary Health Care, 2nd Ed. Geneva: World Health Organization; 2001.
- Kirkman JJL, Leo B, Moore JC. Alcohol Consumption Reduction Among a Web-Based Supportive Community Using the Hello Sunday Morning Blog Platform: Observational Study. J Med Internet Res 2018 Dec 17;20(5):e196 [FREE Full text] [CrossRef] [Medline]
- Kähkönen S, Zvartau E, Lipsanen J, Bondarenko B. Effects of alcohol withdrawal on cardiovascular system. Prog Neuropsychopharmacol Biol Psychiatry 2011 Mar 30;35(2):550-553. [CrossRef] [Medline]
- The ICD-10 Classification Of Mental And Behavioural Disorders: Diagnostic Criteria For Research. Geneva: World Health Organization; 2019:ISBN: 1-280-11558-0.
- Cole S, Raju M, Barrett J, Gerrity M, Dietrich A. The MacArthur Foundation Depression Education Program for Primary Care Physicians: background and rationale. Gen Hosp Psychiatry 2000;22(5):299-358. [Medline]
- National Health and Medical Research Council. National Statement on Ethical Conduct in Human Research (updated May 2015). Canberra: NHMRC; 2007:ISBN: 1864962690.
- Riper H, Blankers M, Hadiwijaya H, Cunningham J, Clarke S, Wiers R, et al. Effectiveness of guided and unguided low-intensity internet interventions for adult alcohol misuse: a meta-analysis. PLoS One 2014;9(6):e99912 [FREE Full text] [CrossRef] [Medline]
- Maher CA, Lewis LK, Ferrar K, Marshall S, De Bourdeaudhuij I, Vandelanotte C. Are health behavior change interventions that use online social networks effective? A systematic review. J Med Internet Res 2014;16(2):e40 [FREE Full text] [CrossRef] [Medline]
- Bradley KA, Rubinsky AD, Lapham GT, Berger D, Bryson C, Achtmeyer C, et al. Predictive validity of clinical AUDIT-C alcohol screening scores and changes in scores for three objective alcohol-related outcomes in a Veterans Affairs population. Addiction 2016 Nov;111(11):1975-1984. [CrossRef] [Medline]
- Redman S, Sanson-Fisher RW, Wilkinson C, Fahey PP, Gibberd RW. Agreement between two measures of alcohol consumption. J Stud Alcohol 1987 Mar;48(2):104-108. [Medline]
- Sobell LC, Sobell MB, Leo GI, Cancilla A. Reliability of a timeline method: assessing normal drinkers' reports of recent drinking and a comparative evaluation across several populations. Br J Addict 1988 Apr;83(4):393-402. [Medline]
- Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SLT, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med 2002 Aug;32(6):959-976. [Medline]
- Australian Mental Health Outcomes and Classification Network. 2005. Kessler - 10 Training Manual URL: https://www.corc.uk.net/media/1275/kessler10_manual.pdf [accessed 2019-06-07] [WebCite Cache]
- Kessler RC, Frank RG. The impact of psychiatric disorders on work loss days. Psychol Med 1997 Jul;27(4):861-873. [Medline]
- Slade T, Johnston A, Teesson M, Whiteford H, Burgess P, Pirkis J. The Mental Health of Australians 2. Report on the 2007 National Survey of Mental Health and Wellbeing. Canberra: Department of Health and Ageing; 2009:ISBN: 1-74186-903-X.
- Network of Alcohol and Other Drugs Agencies. Using the Client Outcomes Management System (COMS). Strawberry Hills: NSW Health; 2012. URL: https://www.nada.org.au/wp-content/uploads/2018/06/nada_coms_instruction_manual_int_final_web.pdf [accessed 2018-01-30] [WebCite Cache]
- da Rocha NS, Power MJ, Bushnell DM, Fleck MP. The EUROHIS-QOL 8-item index: comparative psychometric properties to its parent WHOQOL-BREF. Value Health 2012 May;15(3):449-457 [FREE Full text] [CrossRef] [Medline]
- Wade AG, Fernández J, François C, Hansen K, Danchenko N, Despiegel N. Escitalopram and duloxetine in major depressive disorder: a pharmacoeconomic comparison using UK cost data. Pharmacoeconomics 2008;26(11):969-981. [Medline]
- Buysse DJ, Reynolds CF, Monk TH, Berman SR, Kupfer DJ. The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research. Psychiatry Res 1989 May;28(2):193-213. [Medline]
- Godin G, Shephard RJ. A simple method to assess exercise behavior in the community. Can J Appl Sport Sci 1985 Sep;10(3):141-146. [Medline]
- Jetté M, Sidney K, Blümchen G. Metabolic equivalents (METS) in exercise testing, exercise prescription, and evaluation of functional capacity. Clin Cardiol 1990 Aug;13(8):555-565 [FREE Full text] [CrossRef] [Medline]
- Presley CA, Meilman PW, Lyerla R. Development of the Core Alcohol and Drug Survey: initial findings and future directions. J Am Coll Health 1994 May;42(6):248-255. [CrossRef] [Medline]
- Pennay A, MacLean S, Rankin G. Hello Sunday Morning: Alcohol, (non)consumption and selfhood. Int J Drug Policy 2016 Feb;28:67-75. [CrossRef] [Medline]
- Tait RJ, Kirkman JJL, Schaub MP. A Participatory Health Promotion Mobile App Addressing Alcohol Use Problems (The Daybreak Program): Protocol for a Randomized Controlled Trial. JMIR Res Protoc 2018 May 31;7(5):e148 [FREE Full text] [CrossRef] [Medline]
- Primary Health Network Brisbane North. Low intensity mental health services. Brisbane: PHN Brisbane North; 2015.
- Salazar A, Ojeda B, Dueñas M, Fernández F, Failde I. Simple generalized estimating equations (GEEs) and weighted generalized estimating equations (WGEEs) in longitudinal studies with dropouts: guidelines and implementation in R. Stat Med 2016 Dec 30;35(19):3424-3448. [CrossRef] [Medline]
- Halekoh U, Højsgaard S, Yan J. The Package for Generalized Estimating Equations. J. Stat. Soft 2006 Dec 22;5(2):1-11. [CrossRef]
- Psychometrica. 2019. Computation of Effect Sizes URL: https://www.psychometrica.de/effect_size.html [accessed 2019-06-04] [WebCite Cache]
- Moyer A, Finney JW, Swearingen CE, Vergun P. Brief interventions for alcohol problems: a meta-analytic review of controlled investigations in treatment-seeking and non-treatment-seeking populations. Addiction 2002 Mar;97(3):279-292. [Medline]
- Saitz R. Alcohol screening and brief intervention in primary care: Absence of evidence for efficacy in people with dependence or very heavy drinking. Drug Alcohol Rev 2010 Nov;29(6):631-640 [FREE Full text] [CrossRef] [Medline]
- Riper H, Tait RJ. Using the Internet for alcohol and drug prevention. In: Miller P, editor. Interventions for Addictions. Amsterdam: Elsevier; 2012:855-863.
- Darke S. Self-report among injecting drug users: a review. Drug Alcohol Depend 1998 Aug 1;51(3):253-63; discussion 267. [Medline]
- Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on Internet-based mental health interventions — A systematic review. Internet Interventions 2014 Oct;1(4):205-215. [CrossRef]
|ANOVA: analysis of variance|
|AUDIT: alcohol use disorders identification test|
|eHealth: electronic health|
|MCAR: missing completely at random|
|WGEE: Weighted Generalized Estimating Equation|
Edited by G Eysenbach; submitted 11.06.19; peer-reviewed by M Duplaga; comments to author 09.07.19; revised version received 10.07.19; accepted 12.07.19; published 04.09.19
©Robert J Tait, Raquel Paz Castro, Jessica Jane Louise Kirkman, Jamie Christopher Moore, Michael P Schaub. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 04.09.2019.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.