Published on in Vol 22, No 9 (2020): September

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/15307, first published .
Identifying Mobile Health Engagement Stages: Interviews and Observations for Developing Brief Message Content

Identifying Mobile Health Engagement Stages: Interviews and Observations for Developing Brief Message Content

Identifying Mobile Health Engagement Stages: Interviews and Observations for Developing Brief Message Content

Original Paper

1School of Advertising, Marketing and Public Relations, QUT Business School, Queensland University of Technology, Brisbane, QLD, Australia

2QUT Design Lab, Creative Industries Faculty, Queensland University of Technology, Brisbane, QLD, Australia

Corresponding Author:

Kara Burns, BSc (Hons), BASc, PhD

School of Advertising, Marketing and Public Relations

QUT Business School

Queensland University of Technology

George St

Brisbane, QLD, 4000

Australia

Phone: 61 414294967

Email: drkaraburns@gmail.com


Background: Interest in mobile health (mHealth) has increased recently, and research suggests that mHealth devices can enhance end-user engagement, especially when used in conjunction with brief message content.

Objective: This research aims to explore the stages of engagement framework for mHealth devices and develop a method to generate brief message content to promote sustained user engagement. This study uses the framework by O’Brien and Toms as a point of departure, where engagement is defined as the uptake or the use of an mHealth device. The framework is a linear repeatable process, including point of engagement, period of engagement, disengagement, and re-engagement. Each stage is characterized by attributes related to a person’s technology experience. Although the literature has identified stages of engagement for health-related technology, few studies explore mHealth engagement. Furthermore, little research has determined a method for creating brief message content at each stage in this engagement journey.

Methods: Interviews and observations from 19 participants who used mHealth technologies (apps, devices, or wellness websites) in a solo capacity were recruited for sample group 1. In sample group 2, interviews, and observations from 25 participants using mHealth technologies in a group capacity through the Global Corporate Challenge were used. These samples were investigated at 3 time points in both research contexts. The results underwent deductive-inductive thematic analysis for the engagement stages’ framework and attributes.

Results: In addition to the 4 stages identified by O’Brien and Toms, 2 additional stages, self-management and limited engagement, were identified. Self-management captures where users had disengaged from their technology but were still engaged with their health activity. Limited engagement captures where group mHealth users had minimal interaction with their mHealth technology but continued to engage in a group fitness activity. The results revealed that mHealth engagement stages were nonlinear and embedded in a wider engagement context and that each stage was characterized by a combination of 49 attributes that could be organized into 8 themes. Themes documented the total user experience and included technology usability, technology features, technology aesthetics, use motivations, health awareness, goal setting, social support, and interruptions. Different themes were found to have more relevance at different engagement stages. Knowing themes and attributes at all engagement stages allows technology developers and health care professionals to generate relevant brief message content informed by a person-centered approach.

Conclusions: This research extends an existing engagement stages framework and identifies attributes and themes relevant to mHealth technology users’ total user experience and incorporates concepts derived from health, business studies, and information systems literature. In addition, we offer a practical 5-step process based on a person-centered approach to develop mHealth technology brief message content for sustained engagement.

J Med Internet Res 2020;22(9):e15307

doi:10.2196/15307

Keywords



Mobile Health

Since 2013, mobile health (mHealth) or the use of mobile computing and communication technologies in health care, public health, and personal wellness has gained significant interest, including the use of SMS through mobile devices. This is because of efforts to engage patients [1] and improve health outcomes at lower costs [2]. mHealth is considered to be a subset of the broader eHealth movement, which involves the digitization of health care processes [3]. Although eHealth and mHealth are potentially transformative for health care users, population health, and health care systems, the benefit of the significant economic investment in these modalities is undergoing scrutiny. For example, a 2011 review of the billions of dollars spent on eHealth systems globally has shown no evidence that implementing these technologies reduces health service costs [4].

When investigating clinical impact, early randomized control trials focused on mHealth feasibility. Current research has shown mHealth to be effective for improving health outcomes, especially when using brief messages such as those delivered by SMS through personal devices (eg, smartphones). Brief messages are cost-effective and can be delivered en masse in low-resource areas and can be personalized to target specific populations [5]. For example, women in low- and middle-income countries who received SMS support during pregnancy showed reduced chances of infant morbidity or mortality [6]. This is congruent with other SMS mHealth initiatives that have shown an increase in smoking cessation [7], improvements in the uptake of sexual health services using SMS reminders compared with controls [8], and reduced viral loads of patients with HIV when reminded to take antiretroviral medication [9].

For mHealth interventions that include a communication component, message content is critical to the effectiveness of the interventions. For example, in a 24-month randomized clinical trial for weight loss, targeted feedback from health care providers by SMS was shown to improve engagement behavior in self-reported energy and fat intake [10]. An important aspect of this study was that messages were personalized using the individual feedback provided by participants. Communication between health care providers and patients holds an immediate opportunity for improved clinical outcomes and patient engagement, emphasizing the importance of identifying suitable message content for this communication [5]. However, one of the key challenges faced by these health care services is how to understand patterns of engagement and keep users engaged [11].

mHealth Engagement

mHealth engagement is complex because of numerous definitions and the technology straddling the disciplines of health care, information systems, and business studies. In this research, engagement is defined as the uptake or use of an mHealth device [12]; however, limiting the exploration of mHealth to one discipline skews our understanding of the phenomena, resulting in a partial view of the impact of the technology and engagement.

Through information systems research, the usability and design of technology play a key role in the uptake of mHealth [13]. It is recommended that the usability and visual appeal of apps should be taken into consideration from the beginning of the design process [13]; however, there is also an opportunity for it to be critiqued based on user feedback throughout the life of the mHealth intervention to support sustained engagement.

The business literature suggests that a user-centered experience is a key factor that contributes to engagement in service contexts, and this can also be applied to mHealth technology [14]. It is evident that there are different views on user experience. This paper defines the user experience as the total experience that a person obtains from all interactions with a health care provider and an mHealth device. This includes the value they receive [15-17]. The total user experience can be evidenced by end-user thoughts, feelings, and behaviors related to their technology use [18,19]. Value is critical to engagement and can be defined as a total assessment of the perceived cost [20] versus benefits [21,22]. If the effort to engage is greater than the total perceived value of the engagement, users may not be interested in an mHealth device.

An interdisciplinary framework that incorporates health, information systems, and business does not exist in the present literature for mHealth engagement. However, O'Brien and Toms [12] developed a linear conceptual framework for defining technology user engagement that was applied in the context of web-based technology apps and incorporates attributes from both business and information systems. Through empirical inquiry, these authors demonstrated 4 stages of engagement, including point of engagement, period of engagement, disengagement, and re-engagement, that can be experienced in a linear sequence and repeated. Figure 1 provides the model of engagement stages, as proposed by O’Brien and Toms [12].

Figure 1. Proposed model of engagement by O'Brien and Toms (2008).
View this figure

As illustrated earlier, the point of engagement is when the user encounters the technology for the first time, the period of engagement is the periodic use of the technology, disengagement is characterized by a period without using the technology, and re-engagement is a reintroduction of the technology to a previous user. Each stage in the process is characterized by themes and attributes. Attributes are the phenomena experienced by end users when engaging with mHealth technology, and these can be analyzed into themes. Attributes also signify the total user experience and are used as a baseline for exploration in this research. Importantly, this conceptualization provides a standard framework that can be flexibly applied in different contexts to explore the determinants of engagement in an mHealth context [23].

The framework of O'Brien and Toms has been explored in other digital health investigations, often underpinning studies that seek to conceptualize context-specific engagement [24]. Others simply apply the existing stages of the engagement framework [25,26]. Only one known study has explored additional stages by examining the notion of unengagement [11]. In this 2019 study of 486 health services’ users who accessed web-based health services [11], it was recognized that the nonengagement or disengagement were examples of unengagement. Thus, to date, the stages and attributes in the model by O’Brien and Toms require critique and further investigation, specifically within the context of mHealth, where exploration is limited.

With that in mind and using the framework by O’Brien and Toms as a departure point, this study aimed to develop a person-centered approach to generate relevant brief message content relating to engagement stages to promote sustained user engagement. When combined with users’ thoughts and observations of actual use, the framework by O’Brien and Toms can provide a way to investigate the stages of engagement for mHealth devices [12]. This is commensurate with the business literature and other health technology interventions that “demand a user-centered and iterative approach to development, using mixed methods and in-depth qualitative research to progressively refine the intervention to meet user requirements” [27]. Hence, this study asks, “How can knowledge about users’ mHealth device engagement stages inform the development of brief message content intended to promote sustained user engagement?”


Study Design

To gain rich insight, a qualitative approach was used to investigate the framework by O’Brien and Toms [28]. Qualitative studies allowed the researcher to observe or record behavior in its natural setting [28]. Interviews were used to explore participants’ state of mind in-depth [29], and face-to-face observations provided an understanding of participants’ behaviors [30].

In total, 2 sample groups were used in this research to deepen the understanding of mHealth technology use, avoiding the use of a single case to support findings. Participants were considered eligible if they had used an mHealth technology for at least 2 weeks before the interviews and observations (excluding pregnancy apps), were aged >18 years, were able to communicate effectively in English, and provided informed consent. Interviews and observations across the 2 sample groups were conducted until data saturation occurred [31]. This occurred in a total of 34 participants.

Samples 1 and 2 were contextually different, comparing mHealth engagement with solo (single person) technology use and mHealth engagement in a social (group) context. In both samples, a screening questionnaire, interviews, and structured face-to-face observations were undertaken. Questions included perceptions of use, value, behaviors, and engagement. Participants were asked about their program usage (either an individual program such as a tracking app for sample 1 or the group program for sample 2). Example questions included How has the program impacted your behavior toward wellness?, Can you please show me what you value about the program and explain why you have selected this?, and Why do you think your usage has dropped and/or increased? The full interview protocol is outlined in Multimedia Appendix 1. Ethics approval was obtained from the researcher’s home university (University Human Research Ethics Committee), and the research was conducted in line with standard ethical guidelines and the National Statement on Ethical Conduct in Human Research [32]. No incentives were offered in this study.

Sample Group 1

Participants who used mHealth technologies (eg, mHealth apps or wellness websites) in an individual context for at least 2 weeks before the first interview were purposively recruited using a promotional flyer and snowball sampling in a large metropolitan city in Australia. Upon recruitment, participants attended in-depth confidential interviews and structured face-to-face observations using their mHealth technology in a private room or in a public location of their choice. Interviews and observations of the participant using the device were recorded by a researcher on a video camera. Participants were then invited to attend a second session 6 to 8 weeks after the first session and a final interview and observations at 8 to 10 months after the first session.

Sample Group 2

Participants who used mHealth technologies in a group context were purposively recruited from the Global Corporate Challenge (GCC), a 100-day workplace team pedometer competition. The program is designed to promote workplace health and engagement around the world by encouraging employees to work in teams completing a minimum of 10,000 steps per day. After 2 to 4 weeks of engagement, participants attended in-depth confidential interviews and structured face-to-face observations using their mHealth technology in a private room or in a public location of their choice. These were recorded using a video camera by a researcher. All participants were invited to attend a second session 8-10 weeks after the first session and a final interview and observation 3-5 weeks after the GCC was complete.

Data Analysis for Engagement Stages and mHealth Content

Interviews and structured participant observations from samples 1 and 2 produced verbal and visual data that were analyzed by the principal investigator. Interviews were the primary source of the research findings, whereas observations were used to confirm the data collected from the interviews and to show how participants engaged with their mHealth technology.

Transcribed interviews were read several times, and deductive-inductive thematic analysis was undertaken using Atlas.ti software [33,34]. The stages of engagement and attributes from the framework by O’Brien and Toms [12] were applied to the interviews and observations. Deductive analysis was used to evaluate the conceptual framework, and a general inductive analysis was used to discover new attributes and important themes based on attributes related to each stage of engagement [35]. When a priori attributes and stages of engagement were not present in the data, they were removed; when new ones emerged, they were added to the schema. To reduce researcher subjectivity bias, 2 experienced health engagement researchers completed inter-rater reliability checks on the data. The inter-rater reliability calculated using the Cohen kappa coefficient was 0.92 in SPSS Statistics 26 (IBM Corp). This result suggests a strong level of agreement between the coders. Finally, mHealth engagement data through face-to-face observations confirmed participant use, thus triangulating the engagement states through both interviews and observations.

To establish message content, the occurrence and salience of themes at each engagement stage were established. Increased repetition of a theme at an engagement stage suggested increased salience of the corresponding message content. Thus, the most common themes and codes at each stage of engagement were identified and arranged in a hierarchy of the most relevant to be used for personalized communication.


Participants

A total of 19 participants attended in-depth confidential interviews and structured participant observations using their mHealth technology with a researcher in sample group 1 (individual context) at the first period. Of the 19 participants, 12 (63%) were females and 7 (37%) were males, with age range of 18 to 49 years. The participants were invited to be interviewed and observed at 3 periods. At the second period, of the 19 participants, 15 (79%) participants completed the interviews and observations, with 11 (58%) participants agreeing to a third interview. In sample group 2, (group context) 25 participants were recruited from the GCC. Of the 25 participants, 18 (72%) were females and 7 (28%) were males, with an age range of 18 to ≥70 years. Again, each of the participants was invited to partake in the 3 periods. In total, 96% (24/25) participants completed both the second and third periods of data collection. Full participant details for sample 1 and sample 2 are provided in Table 1. Examples of technologies used across both samples included Fitocracy, Strava, Garmin Watch, Fitbit, or simple pedometers, and these were accessed via smart watches, mobile phones, and advanced trackers.

Table 1. Participant details for sample 1 and sample 2.
ParticipantsSamplesGenderAge groups (years)Length of time participants had been using their digital health technology at start of their interviews
1Sample 1Female40-493-6 months
2Sample 1Female30-396 months to 1 year
3Sample 1Female18-29<1 month
4Sample 1Male40-491-3 months
5Sample 1Male18-292 years
6Sample 1Female18-291-3 months
7Sample 1Male40-492 years
8Sample 1Female40-492 years
9Sample 1Female18-291-3 months
10Sample 1Female40-491-3 months
11Sample 1Male30-396 months to 1 year
12Sample 1Female18-296 months to 1 year
13Sample 1Female18-296 months to 1 year
14Sample 1Male30-396 months to 1 year
15Sample 1Male18-296 months to 1 year
16Sample 1Male30-392 years
17Sample 1Female40-491-3 months
18Sample 1Female40-496 months to 1 year
19Sample 1Female30-291 year
1Sample 2Female30-393 years
2Sample 2Female30-392 years
3Sample 2Female30-391 year
4Sample 2Male50-594 years
5Sample 2Female18-291 year
6Sample 2Female50-591 year
7Sample 2Female50-591 year
8Sample 2Female40-491 year
9Sample 2Female60-69>6 years
10Sample 2Female50-592 years
11Sample 2Female40-491 year
12Sample 2Male50-593 years
13Sample 2Male30-392 years
14Sample 2Female30-392 years
15Sample 2Male40-491 year
16Sample 2Female40-492 years
17Sample 2Female30-392 years
18Sample 2Male50-593 years
19Sample 2Female30-393 years
20Sample 2Female30-391 year
21Sample 2Male40-493 years
22Sample 2Female50-594 years
23Sample 2Male≥704 years
24Sample 2Female40-494 years
25Sample 2Female50-592 years

Engagement Stages

The framework by O’Brien and Toms [12] explored engagement in the context of web searching, web-based shopping, educational webcasting, and video games, finding 4 stages of engagement: point of engagement, period of engagement, disengagement, and re-engagement. Similarly, sample group 1 identified these 4 types of engagement plus a fifth engagement domain of self-management. Self-management refers to a stage where users had completely disengaged from their technology; however, they were still engaged with their health activity.

Furthermore, sample group 2 indicated an additional stage alongside self-management called limited engagement. This occurred when users had minimal interaction with their mHealth technology but engaged in the health activity to contribute to the group goals. Participants did not want to fully disengage as they felt the desire to stay in the program for others. Although limited engagement was discovered in the group context, it may also apply to solo engagement contexts. Thus, this research extends the framework by O’Brien and Toms [12] to include 6 stages of mHealth technology engagement, as seen in Figure 2. Importantly, these stages are not linear, with participants skipping stages based on motivation and accountability to engage, which are all features of a person’s wider engagement context.

Figure 2. Mobile health engagement stages in this study (based on O’Brien & Toms 2008).
View this figure

Themes at Each Engagement Stage

When developing message content for sustained engagement, this research determined 8 themes that represent the main discussions impacting the 6 engagement stages. Each engagement stage is characterized by a different combination of these themes and 49 attributes. Figure 3 indicates the themes relevant at each engagement stage. These themes are presented in a hierarchical order based on their level of importance for each engagement stage. For example, in the limited engagement stage, the 5 themes of interruptions, social support, specific goals, technology features, and use motivations contribute toward shaping the level of limited engagement for the participant. The most frequently discussed theme for limited engagement was interruptions, with the lowest being use motivations. This indicates that interruptions are the greatest consideration for users experiencing limited engagement with mHealth technology. Multimedia Appendix 2 provides a full summary of the themes as they are expressed at each engagement stage.

Figure 3. Themes relevant at each engagement stage.
View this figure

On the basis of Textbox 1 and Multimedia Appendix 3, the point of engagement is characterized by the user’s attraction to the technical features of an mHealth device that helps them to fulfill their motivations to be healthy. At this stage, it is important that the technology is easy to use and promotes the support of a provider or a peer network. There was recognition that the mHealth device could improve users’ health awareness and their ability to reach their goals; however, these are less important than the features of the technology. Technology aesthetics was not highly relevant at the point of engagement.

Mobile health engagement stages and themes characterizing each stage.
  • Point of engagement is characterized by technology feature, use motivations, social support, technology usability, health awareness, and goal setting
  • Sustained engagement is characterized by technology feature, use motivations, social support, health awareness, technology usability, and goal setting
  • Limited engagement is characterized by interruptions, social support, goal setting, technology feature, and use motivations
  • Disengagement is characterized by technology feature, use motivations, technology usability, interruptions, and social support
  • Self-management is characterized by goal setting, interruptions, use motivations, and technology feature
  • Re-engagement is characterized by use motivations, goal setting, technology feature, social support, technology usability, technology aesthetics, and health awareness
Textbox 1. Mobile health engagement stages and themes characterizing each stage.

Sustained engagement is characterized by the regular continued use of the mHealth device to support health and wellness activities. During this stage, technology features are important to achieve motivation, and this can be amplified through the support of a peer network or through provider messages. The continued use of an mHealth device encouraged users to have more health awareness. Usability and goal setting are still important in this stage but are less important than the features of the technology.

Limited engagement is characterized by users’ interrupted use of the mHealth device, with participants driven by social motivations to continue with the health activity. Social support through a peer network or provider messages was considered by users as influential during this period to achieve their health goals. Interruptions experienced by users were often caused by a feature of the technology; however, social interactions provided the motivation to continue.

Disengagement is characterized by discontinuing the use of an mHealth device and participants stopping the health activity. This was often caused by the mHealth technology not being suitable for the user’s needs and not providing motivation to continue. This mainly occurred because the mHealth device lacked features or was difficult to use. In addition, users did not receive the required social support from their device to develop sustained engagement. This was because of the inability of the mHealth technology to engage the user’s peer network or support provider messages. Finally, other interruptions also caused disengagement.

Self-management is characterized by users who are able to stay motivated and achieve their goals without their mHealth technology. Interruptions caused by the technology features meant that an mHealth device was not appealing and no longer used. In addition, as users were already active and aware of their health status, they did not need their mHealth technology for health awareness.

Re-engagement is characterized by users wanting to be motivated and wanting to achieve their goals. During this period, the technology features and technology aesthetics or the visual appeal of a device were important in the decision to re-engage. When re-engaging with existing or new technology, users were after specific technology features to help reach their health goals (eg, heart rate monitor and step counter). In addition, users were looking to re-engage with a mHealth technology that provides social support and helps them achieve health awareness.

Description of Each Theme

A total of 8 themes were established in interviews across the 2 samples: technology usability, features, technology aesthetics, use motivations, health awareness, goal setting, social support, and interruptions when engaging with mHealth technology. To develop message content, an understanding of the themes, their attributes, and the relevant stage of engagement is considered below.

Technology Usability

The usability of the mHealth wellness technology was discussed by most participants and was important at the points of engagement, sustained engagement, disengagement, and re-engagement stages. Fundamentally, this was related to functional congruence or the device performing in a way that was required by the wearer [36]. This finding is consistent with other studies that highlight the importance of usability [13,14]. Usability was specified as ease of use, wearability, portability, convenience, and connectivity. In addition, accuracy and customization were important features when participants engaged with mHealth technology at the point of engagement and to a lesser extent once they were engaged. Disengagement occurred when the device did not perform as expected; it could not be customized, resulting in a nonpersonalized experience or a feature of the technology failed. Many participants lamented that if they could not see their previous activity, this reduced motivation and increased effort to re-engage:

I like that it’s simple to use, you just literally put it on your arm, load up on to your phone and just go, you don’t have to do anything with it.
[Participant 9: female, aged 18-29 years, sample 1]
I like how the GCC and the Fitbit thing they sync with that device...I like that seamless syncing so that it already knows what’s happened.
[Participant 20: female, aged 30-39 years, sample 2]
Technology Feature

The most relevant topic across both samples was the features of the mHealth technology, which was discussed by all participants and was present in each stage of engagement. Participants found value in the collection, monitoring, and review of health data, with it providing motivation to engage and use mHealth technology. Indeed, user-generated health data have been recognized to engage and empower patients in health care [37], and this also occurred in the wellness context. Gamification, messages, sounds, and dashboard tracking were features of devices that promoted continued use and the statistics provided through the Fitbit. However, if interruptions occur, for example, by a device having a short battery life, it could lead to disengagement and subsequent self-management. Although motivation to achieve goals was the predominant reason for re-engaging with technology, technology features also impacted the decision to re-engage:

...data, that was what led me to get this one because I wanted my heart rate and it gave me that and it gives me whatever data I want really on my sleep or my heart rate or exercise patterns, it can give me as much or as little as I want.
[Participant 1: female, aged 40-49 years, sample 1]
Technology Aesthetics

Despite the emphasis on design elements in the extant literature [14,15], this was only a minor theme discussed in interviews by one-third of the participants. Defined as an attractive interface, ergonomic design, and unobtrusive when worn, these attributes were only relevant at the re-engagement stage. Disengagement because of failure of a product feature affected future mHealth technology choices, and new offerings with improved design were considered to supersede predecessors. This was most evident in sample 1, where participants used the devices alone, whereas in sample 2, they were much more likely to re-engage based on perceptions of usability:

The new one is a bit thinner I think, this isn’t too bad, I think it can still do the same as heart rate and all of that, but then I suppose after a while I might end up getting a thinner version.
[Participant 6: female, aged 18-29 years, sample 1]
Use Motivations

Although technology features were the most important aspect of mHealth adoption, motivation to use the technology was a heavily discussed theme at every stage of engagement. Motivation was considered key to sustained engagement, and although it is accepted that individual differences in motivational control exist [38], people generally have individual intrinsic motivators in sample 1, and in sample 2, extrinsic social motivators became more relevant. Being active, reducing stress, and having a balanced lifestyle were motivations to use an mHealth technology in the pursuit of achieving wellness and a long life. When using technology in sustained engagement, motivation was derived through technology features via encouragement to achieve challenges, competition through leader boards, and the sense of team obligations. In addition, achieving health goals left people feeling good about their technology experience and encouraged sustained use and re-engagement:

After the baby I wanted to get fit again and feel good about myself so either way I was going to be doing it. I just wanted something there, I could go back and have a look and see my fitness improving over time not just having to guess a particular thing.
[Participant 3: female, aged 18-29 years, sample 1]
...and on Facebook as well, we’ve got a chat group in messenger because all in our group are friends on Facebook, so sometimes we message each other on the weekend and say this morning I got 10,000 steps already or something like that. I think that when everyone else in the group sees that they feel like I’d better do something myself.
[Participant 15: male, aged 40-49 years, sample 2]
Health Awareness

Awareness was an attribute in the framework by O’Brien and Toms [26] and was prevalent in interviews, becoming the theme, health awareness, in this research. Engaging with an mHealth technology that results in greater awareness of health through the collection and analysis of health data is consistent with the quantified self-movement, defined as self-knowledge through numbers [39]. The theme was evident at the point of engagement and became more relevant in sustained engagement and was referenced again in re-engagement. Participants were motivated at the point of engagement by awareness of health and wellness goals and could objectively evaluate their performance when using the technology during sustained engagement, with re-engagement partly spurred by the awareness of previous health outcomes. This led to enhanced behavior recognition and increased personal accountability for health activities. This theme was not important at limited engagement, disengagement, or self-management, as these stages suggest low exposure to data collection and analysis:

So, I can actually see that I’m more active than what I originally thought because I thought I only do about 30 minutes of walking on the treadmill or whatever but now I’m realizing I’m doing an extra 6,500 steps.
[Participant 3: female, aged 18-29 years, sample 1]

Goal Setting

Although goal setting was noted at the point of engagement, sustained engagement, and limited engagement, it became the most relevant theme in self-management and important for re-engagement. Participants spoke of goals related to exercise, nutrition, sleep, weight, and heart rate before and during sustained use of the mHealth technology, although these were less important than technology features, use motivations, and technology usability. As technology was not present in self-management, goals became the focus of wellness activities. Finally, goals were an avenue to re-engage with their existing or new mHealth technology, with participants having more sensitivity to goals after their first experiences. This was because of an increased awareness of devices, the ability to self-quantify, and the previous experience of achieving goals:

It’s simple to use and there’s a lot of scope to how I can plan a run. I can get it to remind me every pretty much time, calories, the goal I reach.
[Participant 15: male, aged 18-29 years, sample 1]
...and I want to be fabulous at 50, so I thought this will encourage me to do a few extra steps and think about what I’m eating, so that’s my goal for November.
[Participant 5: female, aged 18-29 years, sample 2]
Social Support

Social support was expressed in sample 1 as customer support and sample 2 as peer support. This was most relevant at the point of engagement, sustained engagement, limited engagement, and re-engagement. At the point of engagement, participants contacted customer support to understand a device feature for better use. Social support was relevant during sustained and limited engagement, including discussion of team interactivity and building a sense of community. Peer competition was an extrinsic motivator to do better, and when group goals were achieved, it enhanced the profile of the teams in the wellness community. When self-management was present and devices were no longer used, social support became less relevant; however, when re-engaging with technology, previous experiences of a social support community were influential in the uptake of new devices:

Maybe it’s not so much to do with Strava but maybe it’s just that there’s a community of people that helps facilitate, maybe it’s something to do with just that people can see what others are up to and follow them and share in their experiences.
[Participant 16: male, aged 30-39 years, sample 1]
I like the team. I like that idea of people being in a team together contributing, motivating each other.
[Participant 16: female, aged 40-49 years, sample 2]
Interruptions

Interruptions were a critical element in limited engagement, disengagement, and self-management stages. Interruptions were caused by an individual’s engagement. Family factors, work time constraints, and illnesses impacted limited engagement. Technology failure included losing a device or being unable to access data, and this impacted disengagement and the decision to self-manage. Device features were also relevant, with low functionality resulting in a perception that devices were not holistic, leading to limited use and disengagement. Indeed, disengagement can occur in the limited engagement stage, even in the presence of social support, if an individual experiences significant interruptions:

Unfortunately, the battery goes very, very quickly and then these times where I can’t hold the phone because I’m doing stuff so it’s not monitoring my steps.
[Participant 12: female, aged 18-29 years, sample 1]
I think for me with kids I needed a program where I can go back three days and log what I’d done because I can get distracted or sidetracked.
[Participant 3: female, aged 18-29 years, sample 1]
Developing Message Content

Multimedia Appendix 3 illustrates the full list of 49 attributes that emerged from the research relevant to each of the mHealth themes. These attributes highlight the key factors that determine the expression of each theme. By identifying the themes important at each engagement stage and then the relevant attributes, health care providers and mHealth developers can determine the type of content in messages that aim to sustain engagement.

For example, at the point of engagement, the most important theme that emerged was the technology feature. The attributes related to this theme are health data collection, dashboard tracking, messages, sounds, and device battery life. If health care providers such as insurers or personal trainers want to attract clients, the content of messages could focus on technology features such as the ability to track the user’s data (dashboard tracking) or the use of health information (health data collection). When users demonstrate limited engagement, messages can focus on the challenges of interruptions to health programs, such as competing the demands of family and providing some tips for how they can manage these difficult times. If users show re-engagement behaviors, messages could focus on reminding users of personal motivations for health management, focusing on specific small goals they may want to achieve.

Therefore, with engagement stages defined in this research and identification of key themes and attributes shaping people’s engagement over time, this research recommends a 5-step process to help co-design appropriate content around these engagement stages for mHealth users. This co-designed 5-step process will help ensure that messages are meaningful with the aim of improving mHealth device engagement over time (Figure 4).

Figure 4. A five-step process to develop effective brief message content.
View this figure

The 5-step process highlights the importance of first understanding the components necessary to group users into relevant engagement stages. By interviewing and observing users (step 1), organizations can identify which of the 6 engagement stages the mHealth user is at (step 2). This allows targeted communication relevant to the individual and their engagement stage to be developed, encouraging sustained engagement (step 3). The relevance of the message content can be drawn from the attributes identified. Step 4 involves pretesting the messages for acceptability by the user and to ensure the development of a two-way communication between the health care provider and the user. Without ensuring the suitability and targeting of the message content, health care providers run the risk that the target user will not pay attention to the message [40]. The final stage (step 5) involves the delivery of suitable messaging representative of the engagement stage the user is at, including monitoring the message success. This monitoring could come in the form of interactive responses via text messages, rebooking with health care staff, user-generated content entered into an app, or other such responses indicating engagement. This process is applicable across a broad application of mHealth relevant contexts, including but not limited to wellness initiatives and clinical contexts; however, programs require targeting and tailoring to an individual’s context to ensure maximum communication success.


The use of mHealth technology for patient engagement is enhanced by communication between health care providers and the technology user. To date, an engagement framework that can be flexibly applied in different contexts to develop message content has been under-researched in the extant literature. This research presents a model of 6 engagement stages: point of engagement, sustained engagement, limited engagement, disengagement, self-management, and re-engagement. Stages are characterized by 8 themes and 49 attributes, which signify the total user experience.

Importantly, the 6 engagement stages are not linear and have been reconceptualized using a person-centered approach, taking into account a user’s wider engagement context. In a group context, mHealth devices can instigate limited engagement where the extrinsic motivation of the group performance is the only reason to engage. If limited engagement is recognized, however, message content can be tailored to increase the intrinsic motivation of goal setting to achieve sustained engagement. Similarly, after episodic wellness initiatives such as the GCC cessation, participants can still be engaged in health activities without the technology present. To pique interest and re-engagement in devices, technology aesthetics and features can be communicated to ex-users. Finally, people who disengage because of interruptions and find it difficult to re-engage may benefit from motivating message content that promotes limited engagement and social support as a goal before sustained engagement.

This research extends previous investigations into engagement stages, as initially proposed by O’Brien and Toms [12]. Although previous research has investigated the stages of engagement from a business and information systems perspective [12], this study is one of the first investigations to specifically explore and extend these stages for an mHealth context. Within a health context, where the stages of engagement proposed by O’Brien and Toms [12] have been applied, there have been no developments in the existing stages or attributes, acknowledging the unique context [29,30]. Keeling et al [11] are the only researchers to further develop the stages proposed by O’Brien and Toms for a web-based health context; however, these researchers focused on investigating into digital engagement to understand why users do not engage with web-based health services. Although these researchers have contributed to knowledge about disengaged users, they observed that further research is needed into mHealth apps, as health conditions alter with time and research into touchpoints over time would be advantageous to better understand engagement. This study, to an extent, fulfills these shortcomings identified by Keeling et al [11].

The development of brief message content for mHealth engagement is a nascent research area, with existing studies focusing on specific providers or medical conditions. Indeed, many studies approach message development by creating content that emphasizes the providers’ needs, rather than taking a person-centered approach, which involves understanding the wider context for the user [41], as undertaken in this research.

The standard approach to develop brief message content for mHealth is to align message content with an appropriate theory, develop content based on a desired behavior, and then pretest the messages on users, often rating acceptability using a validated survey [42]. Although message pretesting is considered a priority to “understand and learn about the specific audience’s preferences in technology use, language, and health needs” [40], co-designing message content with end users is critical for acceptability and workflow integration [43]. Methods to create targeted messages for mHealth engagement using a person-centered approach are limited, although there is recognition that researchers need to consider formative qualitative investigation with the target population before message development [44], as was conducted in this research.

This study extends the shortcomings of previous research by developing a 5-step process to develop co-designed message content [40]. The attributes, themes, and engagement stages identified in this study can be used to develop personalized two-way message content that can be verified by message pretesting. If a health care provider, such as a weight loss clinic, wants to focus on a user who is demonstrating behaviors associated with the disengagement stage, they can ask about interruptions in brief message content and encourage re-engagement with an existing or new device with different features to achieve health goals. Attributes that are important to goal setting may include exercise, nutrition, sleep, weight, or heart rate. The proposed process highlights the importance of co-designing messages to ensure the best response and acceptance by users.

Conclusions

On the basis of current evidence, brief messages are cost-effective and can be personalized and delivered at scale in multiple settings to improve sustained health engagement. This research demonstrates that end-user mHealth engagement is complex, nonlinear, can be social or solo, and is characterized by 6 stages. Each stage is defined by themes and attributes that signify the total user experience. Fundamentally, this research calls for the consideration of interdisciplinary frameworks that incorporate health, information systems, and business to avoid the partial view of this phenomenon and to enhance engagement over time.

The limitations of this research are the small sample size from a single first-world country. Future research could measure the existing, and explore for additional, engagement stages using a larger sample and in different cultures. This would allow for more detailed investigations between groups, such as those users at different stages in the engagement journey, those displaying different demographic characteristics, or those using different types of technologies.

Further research could also include larger quantitative investigations that could be used to overcome the more exploratory and perhaps limited representative sample in this study. Future quantitative research could investigate interventions at each engagement stage or use experimental design to test the suitability of message content across these stages. The development of a short identification survey could also be undertaken, focusing on the 6 engagement stages. This would enable quick categorization of users and the stage they are at in their engagement journey, thus limiting the reliance on more longer time-intensive interviews for organizations that could result in more easily obtained targeted communication.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Interview and observation protocol.

DOCX File , 16 KB

Multimedia Appendix 2

Expression of each theme at each engagement stage.

DOCX File , 21 KB

Multimedia Appendix 3

Brief communication content attributes.

DOCX File , 83 KB

  1. Patel MS, Asch DA, Volpp KG. Wearable devices as facilitators, not drivers, of health behavior change. J Am Med Assoc 2015 Feb 3;313(5):459-460. [CrossRef] [Medline]
  2. Fiordelli M, Diviani N, Schulz PJ. Mapping mHealth research: a decade of evolution. J Med Internet Res 2013 May 21;15(5):e95 [FREE Full text] [CrossRef] [Medline]
  3. Von Knoop C, Lovich D, Silverstein MB, Tutty M. Vital Signs: E-Health in the United States. The Boston Consulting Group. 2003.   URL: https://mkt-bcg-com-public-images.s3.amazonaws.com/public-pdfs/legacy-documents/file14063.pdf [accessed 2020-08-20]
  4. Black AD, Car J, Pagliari C, Anandan C, Cresswell K, Bokun T, et al. The impact of eHealth on the quality and safety of health care: a systematic overview. PLoS Med 2011 Jan 18;8(1):e1000387 [FREE Full text] [CrossRef] [Medline]
  5. Long H, Bartlett YK, Farmer AJ, French DP. Identifying brief message content for interventions delivered via mobile devices to improve medication adherence in people with type 2 diabetes mellitus: a rapid systematic review. J Med Internet Res 2019 Jan 9;21(1):e10421 [FREE Full text] [CrossRef] [Medline]
  6. Lund S, Rasch V, Hemed M, Boas IM, Said A, Said K, et al. Mobile phone intervention reduces perinatal mortality in zanzibar: secondary outcomes of a cluster randomized controlled trial. JMIR Mhealth Uhealth 2014 Mar 26;2(1):e15 [FREE Full text] [CrossRef] [Medline]
  7. Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, et al. The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS Med 2013;10(1):e1001362 [FREE Full text] [CrossRef] [Medline]
  8. Burns K, Keating P, Free C. A systematic review of randomised control trials of sexual health interventions delivered by mobile technologies. BMC Public Health 2016 Aug 12;16(1):778 [FREE Full text] [CrossRef] [Medline]
  9. Lester RT, Ritvo P, Mills EJ, Kariri A, Karanja S, Chung MH, et al. Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): a randomised trial. Lancet 2010 Nov 27;376(9755):1838-1845. [CrossRef] [Medline]
  10. Ambeba EJ, Ye L, Sereika SM, Styn MA, Acharya SD, Sevick MA, et al. The use of mHealth to deliver tailored messages reduces reported energy and fat intake. J Cardiovasc Nurs 2015;30(1):35-43 [FREE Full text] [CrossRef] [Medline]
  11. Keeling DI, de Ruyter K, Mousavi S, Laing A. Technology push without a patient pull: examining digital unengagement (DU) with online health services. Eur J Mark 2019 Sep 9;53(9):1701-1732. [CrossRef]
  12. O'Brien HL, Toms EG. What is user engagement? A conceptual framework for defining user engagement with technology. J Am Soc Inf Sci Technol 2008 Apr;59(6):938-955. [CrossRef]
  13. Alagoz F, Valdez AC, Wilkowska W, Ziefle M, Dorner S, Holzinger A. From cloud computing to mobile Internet, from user focus to culture and hedonism: the crucible of mobile health care and wellness applications. In: Proceedings of the 5th International Conference on Pervasive Computing and Applications. 2010 Presented at: ICPCA'10; Dec 1-3, 2010; Maribor, Slovenia. [CrossRef]
  14. Wirtz J, den Ambtman A, Bloemer J, Horváth C, Ramaseshan B, van de Klundert J, et al. Managing brands and customer engagement in online brand communities. J Serv Manag 2013 Jun 14;24(3):223-244. [CrossRef]
  15. Zainuddin N, Previte J, Russell-Bennett R. A social marketing approach to value creation in a well-women's health service. J Mark Manag 2011 Feb 23;27(3-4):361-385. [CrossRef]
  16. Maklan S, Klaus P. Customer experience: are we measuring the right things? Int J Mark Res 2011 Nov;53(6):771-772. [CrossRef]
  17. Verhoef PC, Lemon KN, Parasuraman A, Roggeveen A, Tsiros M, Schlesinger LA. Customer experience creation: determinants, dynamics and management strategies. J Retail 2009 Mar;85(1):31-41. [CrossRef]
  18. Voss C, Roth AV, Chase RB. Experience, service operations strategy, and services as destinations: foundations and exploratory investigation. Product Oper Manag 2008 May;17(3):247-266. [CrossRef]
  19. Lemke F, Clark M, Wilson H. Customer experience quality: an exploration in business and consumer contexts using repertory grid technique. J Acad Mark Sci 2011;39(6):846-869. [CrossRef]
  20. Zeithaml VA. Consumer perceptions of price, quality, and value: a means-end model and synthesis of evidence. J Mark 1988 Jul 1;52(3):2-22. [CrossRef]
  21. Woodall T. Conceptualising 'value for the customer': an attributional, structural and dispositional analysis. Acad Mark Sci Rev 2003;12(12):1-42 [FREE Full text]
  22. Payne A, Holt S. Diagnosing customer value: integrating the value process and relationship marketing. Br J Management 2001 Jun;12(2):159-182. [CrossRef]
  23. Vandelanotte C, Müller AM, Short CE, Hingle M, Nathan N, Williams SL, et al. Past, present, and future of eHealth and mHealth research to improve physical activity and dietary behaviors. J Nutr Educ Behav 2016 Mar;48(3):219-28.e1. [CrossRef] [Medline]
  24. Simblett S, Greer B, Matcham F, Curtis H, Polhemus A, Ferrão J, et al. Barriers to and facilitators of engagement with remote measurement technology for managing health: systematic review and content analysis of findings. J Med Internet Res 2018 Jul 12;20(7):e10480 [FREE Full text] [CrossRef] [Medline]
  25. Lohse K, Shirzad N, Verster A, Hodges N, van der Loos HF. Video games and rehabilitation: using design principles to enhance engagement in physical therapy. J Neurol Phys Ther 2013 Dec;37(4):166-175. [CrossRef] [Medline]
  26. Short CE, Vandelanotte C, Dixon MW, Rosenkranz R, Caperchione C, Hooker C, et al. Examining participant engagement in an information technology-based physical activity and nutrition intervention for men: the manup randomized controlled trial. JMIR Res Protoc 2014 Jan 3;3(1):e2 [FREE Full text] [CrossRef] [Medline]
  27. Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med 2016 Nov;51(5):833-842. [CrossRef] [Medline]
  28. O’Brien HL, Toms EG. Examining the generalizability of the User Engagement Scale (UES) in exploratory search. Inf Process Manag 2013 Sep;49(5):1092-1107. [CrossRef]
  29. Creswell JW, Creswell JD. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. Thousand Oaks, California: Sage Publications; 2017.
  30. Dahlke S, Hall W, Phinney A. Maximizing theoretical contributions of participant observation while managing challenges. Qual Health Res 2015 Aug;25(8):1117-1122. [CrossRef] [Medline]
  31. Boddy CR. Sample size for qualitative research. Qual Market Res Int J 2016 Sep 12;19(4):426-432. [CrossRef]
  32. National Statement on Ethical Conduct in Human Research 2007. The National Health and Medical Research Council. 2018.   URL: https:/​/www.​nhmrc.gov.au/​about-us/​publications/​national-statement-ethical-conduct-human-research-2007-updated-2018#block-views-block-file-attachments-content-block-1 [accessed 2019-06-10]
  33. Green J, Willis K, Hughes E, Small R, Welch N, Gibbs L, et al. Generating best evidence from qualitative research: the role of data analysis. Aust N Z J Public Health 2007 Dec;31(6):545-550. [CrossRef] [Medline]
  34. Neuman WL, Kreuger LW. Social Work Research Methods: Qualitative and Quantitative Applications. Boston, Massachusetts: Allyn and Bacon; 2003.
  35. Thomas DR. A general inductive approach for analyzing qualitative evaluation data. Am J Eval 2006 Jun 1;27(2):237-246. [CrossRef]
  36. Gao Y, Li H, Luo Y. An empirical study of wearable technology acceptance in healthcare. Indust Manag Data Syst 2015 Oct 19;115(9):1704-1723. [CrossRef]
  37. Burns K, McBride CA, Patel B, FitzGerald G, Mathews S, Drennan J. Creating consumer-generated health data: interviews and a pilot trial exploring how and why patients engage. J Med Internet Res 2019 Jun 13;21(6):e12367 [FREE Full text] [CrossRef] [Medline]
  38. Mitzner TL, McBride SE, Barg-Walkow LH, Rogers WA. Self-management of wellness and illness in an aging population. Rev Hum Factors Ergon 2013 Sep 26;8(1):277-333. [CrossRef]
  39. Ajana B. Digital health and the biopolitics of the quantified self. Digit Health 2017;3:2055207616689509 [FREE Full text] [CrossRef] [Medline]
  40. Gurman TA, Rubin SE, Roess AA. Effectiveness of mHealth behavior change communication interventions in developing countries: a systematic review of the literature. J Health Commun 2012;17(Suppl 1):82-104. [CrossRef] [Medline]
  41. Yardley L, Morrison L, Bradbury K, Muller I. The person-based approach to intervention development: application to digital health-related behavior change interventions. J Med Internet Res 2015 Jan 30;17(1):e30 [FREE Full text] [CrossRef] [Medline]
  42. Diez-Canseco F, Zavala-Loayza JA, Beratarrechea A, Kanter R, Ramirez-Zea M, Rubinstein A, et al. Design and multi-country validation of text messages for an mhealth intervention for primary prevention of progression to hypertension in Latin America. JMIR Mhealth Uhealth 2015 Feb 18;3(1):e19 [FREE Full text] [CrossRef] [Medline]
  43. Barnett ML, Mehrotra A, Jena AB. Adverse inpatient outcomes during the transition to a new electronic health record system: observational study. Br Med J 2016 Jul 28;354:i3835 [FREE Full text] [CrossRef] [Medline]
  44. Ybarra ML, Holtrop JS, Bağci Bosi AT, Emri S. Design considerations in developing a text messaging program aimed at smoking cessation. J Med Internet Res 2012 Jul 24;14(4):e103 [FREE Full text] [CrossRef] [Medline]


GCC: Global Corporate Challenge
mHealth: mobile health


Edited by G Eysenbach; submitted 07.07.19; peer-reviewed by N Brew Sam, S Atanasova, T Irizarry; comments to author 03.10.19; revised version received 23.12.19; accepted 26.07.20; published 22.09.20

Copyright

©Kara Burns, Rebekah Nicholas, Amanda Beatson, Marianella Chamorro-Koc, Alethea Blackler, Udo Gottlieb. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 22.09.2020.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.