Currently submitted to: Journal of Medical Internet Research
Date Submitted: Aug 10, 2020
Open Peer Review Period: Aug 10, 2020 - Oct 5, 2020
(closed for review but you can still tweet)
NOTE: This is an unreviewed Preprint
Warning: This is a unreviewed preprint (What is a preprint?). Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn (a note "no longer under consideration" will appear above).
Peer-review me: Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period (in this case, a "Peer-Review Me" button to sign up as reviewer is displayed above). All preprints currently open for review are listed here. Outside of the formal open peer-review period we encourage you to tweet about the preprint.
Citation: Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author).
Final version: If our system detects a final peer-reviewed "version of record" (VoR) published in any journal, a link to that VoR will appear below. Readers are then encourage to cite the VoR instead of this preprint.
Settings: If you are the author, you can login and change the preprint display settings, but the preprint URL/DOI is supposed to be stable and citable, so it should not be removed once posted.
Submit: To post your own preprint, simply submit to any JMIR journal, and choose the appropriate settings to expose your submitted version as preprint.
Visualising patterns of engagement with a behaviour change app for alcohol reduction.
The development of behaviour change apps often follows an iterative process, where the app evolves into a more complex, dynamic or personalised intervention through cycles of research, development and implementation. Understanding how existing users engage with an app (e.g. frequency, amount, depth and duration of use) can help guide further incremental improvements. Visualisations provide a good understanding of patterns of engagement, as usage data are often longitudinal and rich.
To visualise behavioural engagement with Drink Less, a behaviour change app which aims to reduce hazardous and harmful alcohol consumption in the general adult UK population.
We explored behavioural engagement among 19,233 existing users of Drink Less. Users were included in the analytic sample if they were: from the UK; aged 18 years or over; interested in drinking less alcohol; had a baseline Alcohol Use Disorders Identification Test (AUDIT) score of 8 or above indicative of excessive drinking; and downloaded the app between 17th May 2017 to 22nd January 2019 (615 days). Measures of when sessions begin, length of sessions, time to disengagement, and patterns of use were visualised with heat maps, time-line plots, k-modes clustering analyses and Kaplan-Meier plots.
The visualisations gave us five important insights: (i) the existing daily notification, delivered at 11am, appeared to have a very strong impact on engagement in the following hour; (ii) behavioural engagement decreased over time, with 50% of users disengaging (defined as no use for seven or more consecutive days) 22 days after download; (iii) three distinct trajectories of use were identified: Engagers (24% users), Slow Disengagers (19% users) and Fast Disengagers (57% users); (iv) the depth of engagement was limited, with 85% of sessions occurring within the ‘Self-monitoring and Feedback’ module; and (v) outside the hour after the daily notification is sent, a peak of both frequency and amount of time spent per session was observed in the evenings.
Visualisations of behavioural engagement with the Drink Less app suggest that the current daily notification substantially impacts engagement. Our next research aim is to further optimise the notification policy by tailoring to contextual circumstances of individuals over time. This will be achieved by a Micro-Randomised Trial (MRT), and these visualisations were helpful in both gaining a better understanding of engagement and informing the design of the MRT.
Request queued. Please wait while the file is being generated. It may take some time.
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.