Advertisement: Preregister now for the Medicine 2.0 Congress
Active Assistance Technology for Health-Related Behavior Change: An Interdisciplinary Review
Catriona M Kennedy1,2, PhD; John Powell3, PhD; Thomas H Payne4, MD, FACP; John Ainsworth1, MSc; Alan Boyd5, MSc; Iain Buchan1, MD, FFPH
1School of Community-Based Medicine, University of Manchester, Manchester, United Kingdom
2School of Computer Science, University of Birmingham, Birmingham, United Kingdom
3Division of Health Sciences, University of Warwick, Warwick, United Kingdom
4UW Medicine, University of Washington, Seattle, WA, United States
5Health Policy and Management Group, Manchester Business School, Manchester, United Kingdom
School of Community-Based Medicine
University of Manchester
1.311 Jean McFarlane Building
Manchester, M13 9PL
Phone: 44 161 275 5205
Fax: 44 161 275 5160
Background: Information technology can help individuals to change their health behaviors. This is due to its potential for dynamic and unbiased information processing enabling users to monitor their own progress and be informed about risks and opportunities specific to evolving contexts and motivations. However, in many behavior change interventions, information technology is underused by treating it as a passive medium focused on efficient transmission of information and a positive user experience.
Objective: To conduct an interdisciplinary literature review to determine the extent to which the active technological capabilities of dynamic and adaptive information processing are being applied in behavior change interventions and to identify their role in these interventions.
Methods: We defined key categories of active technology such as semantic information processing, pattern recognition, and adaptation. We conducted the literature search using keywords derived from the categories and included studies that indicated a significant role for an active technology in health-related behavior change. In the data extraction, we looked specifically for the following technology roles: (1) dynamic adaptive tailoring of messages depending on context, (2) interactive education, (3) support for client self-monitoring of behavior change progress, and (4) novel ways in which interventions are grounded in behavior change theories using active technology.
Results: The search returned 228 potentially relevant articles, of which 41 satisfied the inclusion criteria. We found that significant research was focused on dialog systems, embodied conversational agents, and activity recognition. The most covered health topic was physical activity. The majority of the studies were early-stage research. Only 6 were randomized controlled trials, of which 4 were positive for behavior change and 5 were positive for acceptability. Empathy and relational behavior were significant research themes in dialog systems for behavior change, with many pilot studies showing a preference for those features. We found few studies that focused on interactive education (3 studies) and self-monitoring (2 studies). Some recent research is emerging in dynamic tailoring (15 studies) and theoretically grounded ontologies for automated semantic processing (4 studies).
Conclusions: The potential capabilities and risks of active assistance technologies are not being fully explored in most current behavior change research. Designers of health behavior interventions need to consider the relevant informatics methods and algorithms more fully. There is also a need to analyze the possibilities that can result from interaction between different technology components. This requires deep interdisciplinary collaboration, for example, between health psychology, computer science, health informatics, cognitive science, and educational methodology.
(J Med Internet Res 2012;14(3):e80)
Behavior change; consumer health informatics; health communication; health promotion; personalization
Prevention, early intervention, and self-care are priorities for most health care systems around the world. Policy makers cannot, however, address these priorities solely through conventional clinical means. This is because citizens must make sustained health behavior changes, which are largely beyond the reach of the clinic .
Information technology has the potential to support behavior change . However, in many behavior change interventions, technology is used as only a passive medium, where the main purpose is efficiency, communication, or a positive user experience. For example, an interactive website might provide different types of multimedia or a discussion forum, but the health information may be static. Even if the health content is tailored to a particular audience, the tailoring is determined a priori. Users navigate the website in the same way as they would navigate tailored print material, albeit often with greater ease. Processing of health content is not automated.
Furthermore, many interventional studies do not identify which aspects of technology contributed to the observed outcomes; the technologies are simply named in a general way (eg, mobile phones ). Recent reviews on technology-supported interventions [4-7] also did not explore the semantic processing potential of the technology. For example, Enwald and Huotari  defined “second generation” as “interactive media” and “third generation” as the use of “mobile and remote devices.”
In this paper we aim to review research on the active aspects of technologies to assist health behavior change. Our objectives were (1) to define key technological capabilities involving active information processing, (2) to determine through a literature review where these technologies are used in behavior change interventions or where they are clearly recognized as important for interventions, (3) to identify emerging themes involving novel uses of active technology that are cross-disciplinary, and (4) to identify any gaps in the research and propose future directions.
Definition: Active Assistance
We define active assistance technology as any technology involving automated processing of health or behavior change information that is ongoing as the user interacts with the technology. In other words, the technology continues to process the health-related information during interactive use and may adapt its responses. This contrasts with passive information technology such as storage devices, videos, and website design. It also contrasts with interactive systems that do not process information related to health or behavior change. For example, an interactive system can process user choices on presentation format (eg, video or text) and adapt to these choices during a session. However, this is not active assistance because the responses are not related to the semantic content of the health messages, only to their formatting.
In this way, the concept of active assistance draws attention to the distinction between semantic and nonsemantic information processing during an interactive session. This is important, because semantic processing entails a degree of delegation of health decision making to an automated system, which can free up human specialists. It also has more serious consequences if incorrect.
Furthermore, active assistance takes place in an environment in which citizens and experts participate actively in the behavior change intervention (combining push and pull). In other words, the role of the technology is not merely to deliver a fully expert-led intervention where users follow instructions with minimal understanding. Instead, the technology helps users to reflect and learn about the obstacles to successful behavior change. A desirable feature is that users should feel they have ownership or control of the intervention .
A concept related to active assistance is persuasive technology, which is “designed to change attitudes or behaviors of users through persuasion and social influence” . Although many aspects of persuasion are relevant to active assistance, persuasive technology is not necessarily active in the way that we are defining it; passive techniques such as visualization and website design may suffice. However, some aspects of persuasion would benefit from active technology. In particular, the potential of the technology for unbiased information processing can help with self-monitoring and correction of inaccurate health beliefs, both of which are required in the persuasion model [10,11]. Similarly, many behavior change theories such as the transtheoretical model , social cognitive theory[13-15], and theory of planned behavior  imply the need for health education, accurate beliefs, and self-monitoring to effect behavior change and sustain it over the long term. Independently of persuasion and self-monitoring, automated information processing can also overcome some of the problems of self-report in measuring behavior change such as adherence .
In the context of these requirements, the following are key examples of active assistance technology that can support behavior change. The technologies may be used together or independently.
Automated Reasoning Using an Explicit Knowledge Representation
An example of this is that an interactive system might use knowledge-based reasoning about the user’s health and circumstances to determine how its responses should be tailored further to the particular individual. Since this process is dynamic, there is more potential for delivery of messages that are tailored to the user’s current environment and state of motivation than would be the case for static tailoring. Similarly, health education can involve answering specific health-related questions, on demand, using inference about what-if scenarios that the user wants to know about (nor necessarily personalized). Examples might include mobile or Web interfaces with dynamic personalization, intelligent reminding, natural-language dialog, or health-related games with an automated player.
Automated Data Collection With Pattern Recognition (Smart Sensing)
Automated sensing can overcome the limits of self-reported online diaries, which depend on memory. Recognition of patterns in online interactions, physical activities, or physiological states can provide useful self-monitoring information for users who are attempting to change their behavior, provided that it is displayed in a user-friendly way. This goes beyond the capability of automated reasoning because the system can acquire data and recognize events automatically without manual data input.
Automated Adaptation Over Time
Adaptation occurs in response to emerging patterns and contexts. This goes beyond automated reasoning and automated data collection because the system adapts its methods and decisions according to patterns that it has recognized. For example, an interactive system might learn to predict a user’s state of motivation based on his or her responses to prompts (without any additional sensing).
In each case, the algorithms need to be informed by health-related knowledge, either explicitly as a formal representation or implicitly in the form of assumptions built into their design.
Background: Related Reviews
Some previous literature reviews have addressed topics related to active assistance.
Webb et al  conducted a systematic review and meta-analysis of the effectiveness of Internet-based interventions. The review found that interventions grounded in behavior change theories are associated with increased effectiveness, with the theory of planned behavior having the largest positive effect. The review used a taxonomy of behavior change techniques and found that using a combination of these techniques tended to be more effective than using only one. Effectiveness was also increased by communication methods such as instant messaging. Although the review did not consider the role of active semantic processing, the findings that a combination of techniques is more effective suggest an increased necessity for such automated processing due to the added complexity of interventions that combine more than one technique.
Fry and Neff  reviewed the effectiveness of interventions using automated prompts and reminders, finding that more than half of those (11 out of 19 reviewed) showed positive results. The findings suggest that tailoring of prompts and making them more interactive can make them more effective. However, the review did not specify the role of the technology in determining the timing and content of prompts: whether these are manually designed in advance, or whether they can be adapted using automated methods.
Lustria et al  defined second-generation interventions as those that are tailored to individuals. The definition did not specify whether the tailoring is an ongoing automated adaptation process that happens during continued user interaction. However, the review has some interesting findings. Many tailored interventions have components for developing self-regulatory skills and self-monitoring. For example, the user can often keep online diaries and send them to an expert for analysis, who then provides feedback. Automation of some of the semantic analysis steps in this process would reduce the need for human expert involvement, thereby reducing costs. Similarly, Revere and Dunbar  conducted an earlier review (1996–1999), finding that tailored interventions tended to be effective but not enough evidence that tailoring was superior to generic interventions. The review mentioned the possibility of dynamic tailoring but did not focus on the distinction between dynamic and offline computer tailoring.
Bickmore and Giorgino  reviewed the technologies used in dialog systems and presented some examples that have been evaluated as effective. Similarly, Corkrey and Parkinson  reviewed interactive voice response systems from 1989 to 2000, finding a growing research area but few applications at that time.
For the purpose of building personalized health models, Fernandez-Luque et al  reviewed the research on extracting content from social networking sites (eg, blogs, forums, or search patterns). These techniques have relevance in behavior change interventions but are still at an early stage and present many ethical and technical challenges.
There have been no comprehensive reviews of active assistance technologies in health-related behavior change.
We conducted the literature review in accordance with the guidelines of the PRISMA statement  that are relevant to our objectives.
Keyword Search and Databases
We used the following strategy: <technology-related keywords> AND <health psychology-related keywords> AND health AND “behavior change”.
Technology- and psychology-related keywords were combinations of the following: [automated OR technology OR Internet OR “mobile phone” OR intelligent OR computer-based OR interactive OR agent-based OR adaptive OR “context-aware” OR “machine learning” OR “pattern recognition” OR robotic OR “virtual reality” OR semantic OR “knowledge-based” OR “decision support” OR ontology OR dialog OR “natural language”] AND [assistance OR intervention OR personalization OR persuasion OR adherence OR compliance OR motivation OR affective OR emotion OR reminder OR prompt].
We conducted some preliminary searches on a wide range of databases including CINAHL, EMBASE, Inspec, ISI Web of Science, PsycINFO, and ScienceDirect. However, we found that Google Scholar had a wide enough coverage to allow it be used instead of these databases. This is consistent with recent empirical studies such as those of Howland et al  and Walters . Therefore, we decided to use only Google Scholar and PubMed. The date range was January 2005 to January 2012. Only articles written in English were included.
Inclusion and Exclusion Criteria
We used the definition of active assistance above. The studies should have included at least one of the three active assistance technologies listed and have been intended for interactive use by clients or patients attempting to change their behavior. Studies may have described a new technology or design to be used in behavior change interventions, or they may have reported an evaluation of an actual intervention using the technology. Qualitative studies are necessary to evaluate usability and acceptability of active technology. Similarly, prototypes and works in progress help to provide an overview of the current research concepts and their maturity.
We excluded the following kinds of study: (1) interventions merely delivered using the Internet, CD-ROM, or other medium, where the technology only facilitates transmission of information from expert to user, (2) feedback, in which there is no automated processing of personal health-related information—for example, receiving emails from a human counselor would be excluded, (3) tailored-offline interventions, in which the computer processing is used by health professionals to tailor the intervention before or after the user interacts with the technology—this is the case where the semantic content processing is not part of the interactivity with the client (although a health professional may have interactive access), (4) simple data collection or preprogrammed reminding without any pattern recognition or inference (eg, pedometers); interventions where the semantic content of reminder messages were configured by the client were also excluded for this reason—for example, the planning tool of Soureti et al  is a passive technology and therefore excluded, (5) fixed games or simulations, in which there is no automated player with semantic processing capability, and (6) general guidelines or research roadmaps in which different options are discussed.
We divided studies into the following categories: (1) quantitative and qualitative evaluations of interventions using active technology, (2) pilot studies of new technology, and (3) prototypes or designs that are being developed or tested.
For each study, we asked the following questions. What kind of active technology was used? Was it effective? What was the role of the technology in the intervention? Was it theoretically grounded?
Active Technology Types
We looked for one or more of the following types of automated content processing, based on capabilities of the active assistance technologies outlined above: (1) automated data collection with pattern recognition, (2) context-sensitive alerts, reminders, and recommendations, (3) knowledge-based reasoning or inference (semantic representation, ontology, decision support, decision algorithm, and automated planning), (4) dialog systems with natural-language processing, (5) simulation or game with an intelligent agent, and (6) online adaptation to build user models and personalization (adaptive websites or interfaces, and user profiling).
In addition to our predefined categories, we identified new technology themes and author keywords describing the technology.
For those studies with evaluations of effectiveness, we asked the following questions. First, what was being evaluated? This could be acceptability or usability (self-reported positive or negative attitude); treatment adherence or technology engagement (observed); self-reported behavior change; or objectively measured behavior change (eg, step counts). Second, what method of evaluation was used (eg, randomized controlled trial [RCT] or qualitative study)? Third, were findings summarized, to give an indication of the maturity of the technology, and any advantages or new problems that it introduces?
Role of Active Technology in Interventions
It is important to understand the role of the active technology in the intervention.
We used the following three functions (defined above): (1) dynamic tailoring, (2) interactive education to support participations in their own care and disease prevention, and (3) support for self-monitoring in a way that overcomes biases of self-report.
In particular, we looked for an association of an active technology type with a purpose. For example, pattern recognition and context awareness may be used to support dynamic tailoring. Similarly, for unbiased self-monitoring, the technology needs to provide automated data collection, pattern recognition, and representation of the results in a visual format that can be easily understood.
We included here any behavior change theories mentioned by the authors as having a role in the technology design. In addition, we asked whether the study proposed any novel ways of connecting active technology with behavior change theories, and whether the active technology allows new possibilities that would not be available with static technology.
Following a review of title and abstracts, the search identified 228 potentially relevant articles. Of these, 41 satisfied the inclusion criteria after a full-text review. Table 1 lists the data extraction contents for intervention and active technology themes [27-67], along with any effectiveness evaluations. Table 2 [27-67] shows the extent to which our previously defined technology roles appeared in the studies (dynamic tailoring, interactive education, and self-monitoring support). Also included are any behavior change theories informing the technology design or usage.
In Table 1, we used the following notation to give an approximate summary of evidence for studies with effectiveness evaluations: <weight of study>: <effect>. Weight of study was scored as 5 (RCT with at least one objective measure, long-term), 4 (RCT with at least one objective measure, short-term), 3 (RCT with self-report only, long-term), 2 (RCT with self-report only, short-term), or 1 (qualitative or pilot study). Effect was scored as + (positive), (negative), or +/– (mixed or insignificant).
For example, a study with objective measures over the long term, but not showing a significant effect, would be summarized as 5: +/–. We used the same summarized notation if some measures were positive and others negative or insignificant. Details are in the findings column.
[view this table]
|Table 1. Technology themes, study types, and main findings.|
[view this table]
|Table 2. Active technology role and theoretical grounding.|
Emerging Technology Themes
From Table 1, it is clear that dialog systems were used widely in interventions using active technology (19 studies). Of these, embodied conversational agents (ECA) were components of 8 studies. ECAs are visual (embodied) characters that can conduct conversation with a user. They are agents in the sense that they can sense and respond to their environment . The agent’s environment might include a virtual game environment, the text inputs of a user, physical behavior data, or all three of these. Similarly, its responses might include conversational output, actions within the virtual environment, or effects on the real environment in the case of a robotic system [52,57,66]. Within the ECA context, motivation and empathy were central themes in 6 studies.
Ecological momentary assessment ) is a process of capturing the momentary experiences of participants—for example, using online diaries for the purposes of research. Not only are the participants’ environmental and behavioral circumstances recorded but so are their mental states. These can include, for example, their current goals, beliefs, mood, and emotions. Ecological momentary interventions ) are based on ecological momentary assessment. Levin and Levin  conducted a feasibility study on pain monitoring and recommended management using interactive voice response. Sorbi et al , in their pilot study, obtained a positive result for migraine attack prevention based on experience sampling using random mobile calls. Randomization overcomes memory bias. Another study that has relevance for the automation of ecological momentary assessment is the semantic analysis of blogs describing combat experience .
Most studies (18) were prototypes or design concepts. A total of 17 were feasibility or usability studies. Only 6 were RCTs measuring effectiveness for behavior change [29,30,36,39,45,67]. All of those also included a qualitative self-report of user experience. Bickmore and Picard  reported mixed results for an agent-based dialog system (FitTrack), with short-term improvement in physical activity during the intervention but reduced activity after follow-up. Interacting with an agent led initially to more physical activity than the control (nonagent) for sedentary participants (45 out of 101). Users enjoyed interacting with the relational agent more than with the nonrelational agent, but there was no significant difference in physical activity between the two agent conditions (both increased during the intervention). Additionally, users found the agent’s repetitiveness to be annoying. The authors suggested that long-term interaction with the agent might prevent the drop in physical activity. Bickmore et al  reported positive acceptance and increased physical activity for FitTrack with older adults (n = 21) over 2 months, but there was no significant decrease in loneliness.
The study of Bickmore et al  involved mechanisms for reducing the repetitiveness of a dialog system and enabling it to tell stories. The effect on long-term user engagement was positive, but the effect on actual behavior was negative. The authors proposed several explanations, such as increased enjoyment during interaction inhibiting activity. Their most recent research  reported a positive effect (n = 70) for sustained step count over 12 weeks, but there were mixed effects for satisfaction and motivation.
The study of Consolvo et al  involved a personalized display of the results of an activity recognition system and reported a positive effect on actual behavior and user experience (detailed below).
Jin  reported a positive effect of a virtual agent on stress management self-efficacy and enjoyment (n = 60).
In qualitative pilot studies (17 studies), agents with empathy and social behavior tended to be preferred over nonsocial agents. In particular, Farzanfar et al  found that depressed adults needed more empathy and that they found the system to be insensitive in a suicide-risk situation. There were some results that were not predicted in advance. Bickmore et al  studied a system to support medication adherence for mental health patients. Participants found communication with the agent to be simpler than human face-to-face communication because they could slow down the interaction and give a greater sense of control. Bickmore et al  reported similar effects for low health-literacy patients.
Role of Active Technology
Dynamic Tailoring and User Modeling
A total of 15 studies emphasized dynamic tailoring. Of these, 10 were prototypes, 1 was an RCT  (detailed above), and 4 were pilot studies. The studies of Buttussi and Chittaro , Hayes et al , and Turunen et al  were positive but had limited evaluations. Sorbi et al  studied migraine prevention using ecological momentary interventions with positive acceptance, although too many calls could be annoying. Dynamic tailoring is particularly associated with user models that are generated or refined automatically. Common themes are context-aware activity recognition and intelligent reminding. Although all active assistance technology (as defined above) potentially has the capability for dynamic tailoring, we did not find this to be a major topic in most studies.
Three studies [43,45,54] were directly concerned with health education. Hartmann et al  conducted a pilot study of a system to help people with asthma to participate in their own care by suggesting questions for them to ask their physicians using evidence-based decision rules. Jin’s  RCT tested the effect of an agent within an educational game environment on student stress management. The result was positive for self-reported stress management (n = 60).
Maier et al  developed a prototype for patient self-management for work-related disorders and alcohol reduction. One component was an information portal for training and health literacy, which was integrated with the Semantic Web.
Two studies on physical activity were concerned with accurate self-monitoring and visualization. Consolvo et al  conducted an RCT with positive results for a physical activity-awareness system for adults. The intervention (UbiFit) combined activity recognition with a visualization of the types of exercise that the system recognized. The visualization used a garden metaphor, where a particular type of flower represented a physical activity category (such as walking, cardiovascular, or strength). The user was awarded a flower when a physical activity was observed, eventually producing a varied garden (with a butterfly for completing the goal). Users had the opportunity to challenge and edit the system’s inferences about their activities. Using the system made a positive difference to actual exercise behavior, with the visual display having a larger positive effect. The RCT involved 28 participants, with 10 assigned to the full system, 9 assigned to activity recognition only, and 9 assigned to a manual diary with display only.
Behavior change models were used in 14 studies. Motivational interviewing  was the most widely used (8 studies). Of these, 5 were dialog systems, in which motivational interviewing was used as a general philosophy for dialog design [35,41,47,51,52]. Other behavior change theories that guided the designs were the transtheoretical model [31,35,40,47,65], self-efficacy [41,45], theory of planned behavior , and the health belief model .
Theoretically Grounded Ontologies
An important novel development in theoretically grounded active assistance is the incorporation of behavior change theories into the ontologies used in knowledge-based reasoning and dialog design (5 studies). The prototype in Bickmore and Sidner’s study  and their follow-up pilot study  used ontologies for automated reasoning about the behavior change process. One of these ontologies is theory-neutral, while another is based on the transtheoretical model, enabling reasoning about the different stages. Similarly, De Rosis et al , Klein et al , and Uribe et al  incorporated aspects of the transtheoretical model and other theories into an ontology for dynamic tailoring of messages, depending on the inferred mental state of the user.
The results show that significant research has been focused on dialog systems, ECAs, and activity recognition. There was also some work on ecological momentary intervention and intelligent context-aware prompting. The most covered health topic is physical activity. Most studies were still at an early stage, either prototype work in progress or pilot studies. Only 6 were RCTs, of which 4 were positive for behavior change and 5 were positive for acceptability.
The studies on dialog and ECA systems showed that empathy and relational behavior are significant research themes in behavior change, with many pilot studies showing preference for those features. The effect on actual behavior also tended to be positive. Too much interaction, however, might interrupt and inhibit positive health behaviors. So there is a need for careful consideration of the frequency and duration of interactive sessions in context.
Ecological momentary intervention is an opportunity for generating models from captured user experiences in the user’s own language (eg, from social networking sites) and for integrating these models with expert knowledge. Such models can include the mental states and emotions of the user, particularly if they are used in conjunction with theoretically grounded ontologies . Outside the behavior change domain, recent developments in mental health management have used models of this sort [72-74].
We found relatively few studies explicitly focusing on the functions of active technology that we selected above: dynamic tailoring, interactive education, and self-monitoring. Although some interventions may have included these functions implicitly, it seems that many studies did not recognize the role of a particular technology in enabling or improving these aspects.
Implications for Future Research
Links with Cognitive Science and Computer Science
Behavior change research needs to be informed by a deep understanding of algorithms and techniques that can support interventions. For this purpose, interdisciplinary collaboration with computer science and cognitive science is needed. In particular, behavior change technology has some parallels with educational technology. In educational systems, an intelligent tutor builds a model of the learner based on his or her performance and responses to questions (eg, what concepts does this person find difficult?) . This model is then opened up for inspection so that the user can see how the system has represented his or her progress and misconceptions [76-80]. The open model supports the user’s self-awareness, which is also an essential component of many behavior change theories. In behavior change research, we found only 1 study  that was aware of educational technology research.
Making users aware of the models can draw their attention to emotions and environmental circumstances (ecology) that are associated with negative behavior outcomes. Similarly, opening up models and giving users more control may enable users to spot any serious misunderstanding by an agent or dialog system, thus avoiding the problem of users blindly following incorrect instructions. In some educational systems , users can persuade the automated tutor to change the model, because users are experts in their own experience (although not in the factual topics they are learning). This general principle of patient (or nonexpert) participation in health information and management is a current research topic in heath informatics [82-86].
Alternatives to Dialog and ECA
Most studies on active assistance technologies in behavior change are based on natural-language dialog and ECA. We did not find many alternatives to these approaches that could be used if natural language or the ECA format is not suitable or preferable. For example, users might interact with adaptive interfaces where the users’ actions are interpreted semantically as if they were dialog responses. Many of the core principles, such as model-based reasoning, activity recognition, and context-aware reminders, can be effective with different forms of interface.
Need for Dependable Systems
Studies on ECA and dialog systems are mostly focused on relational behavior and enjoyment of usage. If ECA systems are to be deployed in areas such as mental health and low health literacy [33,34] they will need to be validated as safe, effective, efficient, and acceptable to patients or clients. Such validation, for example in the European Union, may have to meet criteria usually applied to medical devices. This parsimonious approach makes it difficult to reflect realistic complexity—for example, the detection of emerging health problems based on subtle content of a conversation that a human expert would be able to detect. Sometimes, important decisions might be supported by ECA systems that fall outside of their validated uses. For example, errors might happen due to unexpected behavior of an algorithm. There is a need for research on making the systems robust in unplanned scenarios.
Need for Integrated Semantic Systems
Most studies in behavior change were focused on one or two technologies (eg, dialog and activity recognition) without specifying how the components can interact to infer further information. For example, coordination between activity recognition and content analysis of online diary entries might determine the circumstances in which relapses tend to occur, and tailor messages accordingly. Similarly, reliable automated decision making requires an interactive system to be connected with diverse specialist knowledge sources that can be requested on demand. More research is needed on how the components of an active assistance system are coordinated together and how they may be connected with the Semantic Web and other health informatics resources (eg, risk modeling).
Limits of This Review
Articles not indexed in Google Scholar or PubMed would have been missed—most scholarly publications, however, are captured by Google Scholar. The review required the mention of “health” and “behavior change” in the articles. We did not include gray literature such as white papers and unpublished reports. We selected the date range (2005–2012) to focus on recent developments, but this may also have excluded innovative earlier work.
The review required specific mention of a key technology. There may be some interventions that use active technologies, but the studies did not mention this. Similarly, some studies mentioning only general intelligent technology were excluded from the full-text review because they could not be categorized. This may be a limitation because included studies need to involve significant interdisciplinary communication between technology specialists and health specialists. On the other hand, it may be a strength, as such communication is important for understanding a particular technology in context.
Since we limited the search to behavior change, it is also possible that many of the technologies are being applied in other areas of health informatics. For example, we found some prototypes early in the date range (2006–2007) but found no subsequent study relating to behavior change. In these cases, citation searching sometimes revealed further development of the techniques and algorithms, but no application in the health domain.
The potential of active technologies for dynamic and unbiased information processing is not being fully exploited in current health behavior change research. Most research has focused on specialist areas, such as dialog and ECA systems, and has been largely restricted to the study of persuasive dialog in respect of relational behavior and motivation of behavior change.
In addition to the potential benefits of active technologies, there is a need for a thorough understanding of the potential risks. Expected benefits such as that of dynamic tailoring of the content and presentation of information can be measured using established evaluation methods (eg, [87,88]). Risks such as misinformation due to the unexpected behavior of an algorithm may be more difficult to uncover. It is important to study realistically complex scenarios of the uses of active assistance systems. Such studies need to reveal how the system components interact to produce information, and how these components might in turn interact with wider systems such as the Semantic Web, clinical records, and personal health records. Wider still, we note that many health behaviors are socially mediated; therefore, active assistance research needs to bridge cognitive and sociotechnical aspects in order to deliver maximum public health benefit.
To exploit the full potential of active assistance technology, health behavior change researchers need a deep understanding of how the different components of information systems might change the intervention—its safety, effectiveness, efficiency, and acceptability. This requires more collaboration between disciplines such as health psychology, computer science, cognitive science, health informatics, medical sociology, and public health and health promotion.
This work was funded by the Northwest Institute for BioHealth Informatics (NIBHI), UK and by EPSRC grant "e-Health+: Citizen-driven Information for Healthcare and Wellbeing" EP/G002134/1.
Conflicts of Interest
- Walshe K, Smith J. Healthcare Management. 2nd edition. London: Open University Press; 2011.
- Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010;12(1):e4 [FREE Full text] [CrossRef] [Medline]
- Ryan D, Pinnock H, Tarassenko L, Lee A, Sheikh A, Price D. Can your mobile phone improve your asthma? Thorax 2010;65:A61. [CrossRef]
- Lustria ML, Cortese J, Noar SM, Glueckauf RL. Computer-tailored health interventions delivered over the Web: review and analysis of key components. Patient Educ Couns 2009 Feb;74(2):156-173. [CrossRef] [Medline]
- Enwald HP, Huotari ML. Preventing the obesity epidemic by second generation tailored health communication: an interdisciplinary review. J Med Internet Res 2010;12(2):e24 [FREE Full text] [CrossRef] [Medline]
- Brouwer W, Kroeze W, Crutzen R, de Nooijer J, de Vries NK, Brug J, et al. Which intervention characteristics are related to more exposure to internet-delivered healthy lifestyle promotion interventions? A systematic review. J Med Internet Res 2011;13(1):e2 [FREE Full text] [CrossRef] [Medline]
- Lau PW, Lau EY, Wong del P, Ransdell L. A systematic review of information and communication technology-based interventions for promoting physical activity behavior change in children and adolescents. J Med Internet Res 2011;13(3):e48 [FREE Full text] [CrossRef] [Medline]
- Gibbons MC, Wilson RF, Samal L, Lehmann CU, Dickersin K, Lehmann HP, et al. US Department of Health and Human Services, Agency for Healthcare Research and Quality. 2009 Oct. Impact of Consumer Health Informatics Applications. Evidence Report/Technology Assessment No 188 URL: http://www.ahrq.gov/downloads/pub/evidence/pdf/chiapp/impactchia.pdf [accessed 2012-03-28] [WebCite Cache]
- Fogg BJ. Persuasive Technology: Using Computers to Change What We Think and Do. Waltham, MA: Morgan Kaufmann; 2003.
- Lehto T, Oinas-Kukkonen H. Persuasive features in web-based alcohol and smoking interventions: a systematic review of the literature. J Med Internet Res 2011;13(3):e46 [FREE Full text] [CrossRef] [Medline]
- Oinas-Kukkonen H, Harjumaa M. Persuasive systems design: key issues, process model, and system features. Commun Assoc Inf Syst 2009;24:article 28.
- Prochaska JO, Velicer WF. The transtheoretical model of health behavior change. Am J Health Promot 1997;12(1):38-48. [Medline]
- Bandura A. Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs, NJ: Prentice-Hall; 1986.
- Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev 1977 Mar;84(2):191-215. [Medline]
- Bandura A. Social cognitive theory of self-regulation. Organ Behav Hum Decis Process 1991;50(2):248-287. [CrossRef]
- Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process 1991;50(2):179-211. [CrossRef]
- Linn AJ, Vervloet M, van Dijk L, Smit EG, Van Weert JC. Effects of eHealth interventions on medication adherence: a systematic review of the literature. J Med Internet Res 2011;13(4):e103 [FREE Full text] [CrossRef] [Medline]
- Fry JP, Neff RA. Periodic prompts and reminders in health promotion and health behavior interventions: systematic review. J Med Internet Res 2009;11(2):e16 [FREE Full text] [CrossRef] [Medline]
- Revere D, Dunbar PJ. Review of computer-generated outpatient health behavior interventions: clinical encounters "in absentia". J Am Med Inform Assoc 2001 Feb;8(1):62-79 [FREE Full text] [Medline]
- Bickmore T, Giorgino T. Health dialog systems for patients and consumers. J Biomed Inform 2006 Oct;39(5):556-571. [CrossRef] [Medline]
- Corkrey R, Parkinson L. Interactive voice response: review of studies 1989-2000. Behav Res Methods Instrum Comput 2002 Aug;34(3):342-353. [Medline]
- Fernandez-Luque L, Karlsen R, Bonander J. Review of extracting information from the Social Web for health personalization. J Med Internet Res 2011;13(1):e15 [FREE Full text] [CrossRef] [Medline]
- Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009 Jul 21;6(7):e1000097 [FREE Full text] [CrossRef] [Medline]
- Howland JL, Wright TC, Boughan RA, Roberts BC. How scholarly is Google Scholar? A comparison to library databases. Coll Res Libr 2009;70(3):227-234.
- Walters WH. Google Scholar coverage of a multidisciplinary field. Inf Process Manag 2007;43(4):1121-1132. [CrossRef]
- Soureti A, Murray P, Cobain M, Chinapaw M, van Mechelen W, Hurling R. Exploratory study of web-based planning and mobile text reminders in an overweight population. J Med Internet Res 2011;13(4):e118 [FREE Full text] [CrossRef] [Medline]
- Ananthanarayan S, Siek KA. Health sense: a gedanken experiment on persuasive wearable technology for health awareness. New York, NY: ACM Press; 2010 Presented at: First ACM International Health Informatics Symposium: IHI '10; Nov 11-12, 2010; Arlington, VA, USA. [CrossRef]
- Arteaga SM, Kudeki M, Woodworth A. Combating obesity trends in teenagers through persuasive mobile technology. ACM SIGACCESS Access Comput 2009;94:17-25. [CrossRef]
- Bickmore TW, Picard RW. Establishing and maintaining long-term human-computer relationships. ACM Trans Comput Hum Interact 2005;12(2):293-327.
- Bickmore TW, Caruso L, Clough-Gorr K, Heeren T. 'It's just like you talk to a friend' relational agents for older adults. Interact Comput 2005;17(6):711-735. [CrossRef]
- Bickmore TW, Sidner CL. Towards plan-based health behavior change counseling systems. 2006 Presented at: AAAI Spring Symposium on Argumentation for Consumers of Healthcare; Mar 27-29,2006; Stanford, CA, USA.
- Bickmore TW, Mauer D, Brown T. Context awareness in a handheld exercise agent. Pervasive Mob Comput 2009 Jun 1;5(3):226-235. [CrossRef] [Medline]
- Bickmore TW, Pfeifer LM, Jack BW. Taking the time to care: empowering low health literacy patients with virtual nurse agents. In: Proceedings. 2009 Presented at: 27th International Conference on Human Factors in Computing Systems: CHI '09; Apr 4-9, 2009; Boston, MA, USA. [CrossRef]
- Bickmore TW, Puskar K, Schlenk EA, Pfeifer LM, Sereika SM. Maintaining reality: relational agents for antipsychotic medication adherence. Interact Comput 2010;22(4):276-288. [CrossRef]
- Bickmore TW, Schulman D, Sidner CL. A reusable framework for health counseling dialogue systems based on a behavioral medicine ontology. J Biomed Inform 2011 Apr;44(2):183-197. [CrossRef] [Medline]
- Bickmore T, Schulman D, Yin L. Maintaining Engagement in Long-term Interventions with Relational Agents. Appl Artif Intell 2010 Jul 1;24(6):648-666. [CrossRef] [Medline]
- Bieber G, Voskamp J, Urban B. Activity recognition for everyday life on mobile phones. 2009 Presented at: International Conference on Universal Access in Human Computer Interaction; Jul 19-24, 2009; San Diego, CA, USA. [CrossRef]
- Buttussi F, Chittaro L. MOPET: a context-aware and user-adaptive wearable system for fitness training. Artif Intell Med 2008 Feb;42(2):153-163. [CrossRef] [Medline]
- Consolvo S, Klasnja P, McDonald DW, Avrahami D, Froehlich J, LeGrand L, et al. Flowers or a robot army? Encouraging awareness & activity with personal, mobile displays. 2008 Presented at: 10th International Conference on Ubiquitous Computing: UbiComp '08; Sep 21-24, 2008; Seoul, South Korea. [CrossRef]
- de Rosis F, Novielli N, Carofiglio V, Cavalluzzi A, De Carolis B. User modeling and adaptation in health promotion dialogs with an animated character. J Biomed Inform 2006 Oct;39(5):514-531. [CrossRef] [Medline]
- Farzanfar R, Frishkopf S, Friedman R, Ludena K. Evaluating an automated mental health care system: making meaning of human-computer interaction. Comput Hum Behav 2007;23(2):1167-1182. [CrossRef]
- Hakulinen J, Turunen M, Smith C, Cavazza M, Charlton, D. A Model for flexible interoperability between dialogue management and domain reasoning for conversational spoken dialogue systems. 2008 Presented at: Fourth International Workshop on Human-Computer Conversation; Oct 6-7, 2008; Bellagio, Italy.
- Hartmann CW, Sciamanna CN, Blanch DC, Mui S, Lawless H, Manocchia M, et al. A website to improve asthma care by suggesting patient questions for physicians: qualitative analysis of user experiences. J Med Internet Res 2007;9(1):e3 [FREE Full text] [CrossRef] [Medline]
- Hayes TL, Cobbinah K, Dishongh T, Kaye JA, Kimel J, Labhard M, et al. A study of medication-taking and unobtrusive, intelligent reminding. Telemed J E Health 2009 Oct;15(8):770-776. [CrossRef] [Medline]
- Jin SA. The effects of incorporating a virtual agent in a computer-aided test designed for stress management education: the mediating role of enjoyment. Comput Hum Behav 2010;26(3):443-451. [CrossRef]
- Kaipainen K, Honka A, Saranummi N. Personalized behavior change support for disease prevention. Conf Proc IEEE Eng Med Biol Soc 2011;2011:880-883. [CrossRef] [Medline]
- Klein M, Mogles N, van Wissen A. Why won't you do what's good for you? Using intelligent support for behavior change. 2011 Presented at: Human Behavior Unterstanding - Second International Workshop; Nov 16, 2011; Amsterdam, the Netherlands. [CrossRef]
- Konovalov S, Scotch M, Post L, Brandt C. Biomedical informatics techniques for processing and analyzing web blogs of military service members. J Med Internet Res 2010;12(4):e45 [FREE Full text] [CrossRef] [Medline]
- Lee D, Helal S, Johnson B. An action-based behavior model for persuasive telehealth. In: Lee Y, Bien ZZ, Mokhtari M, Kim JT, Park M, Lee H, et al, editors. Aging Friendly Technology for Health and Independence, Lecture Notes in Computer Science. Berlin: Springer; 2010:121-129.
- Levin E, Levin A. Evaluation of spoken dialogue technology for real-time health data collection. J Med Internet Res 2006;8(4):e30 [FREE Full text] [CrossRef] [Medline]
- Lisetti CL, Wagner E. Mental health promotion with animated characters: exploring issues and potential. 2008 Presented at: AAAI 2008 Spring Symposium on Emotion, Personality and Human Behavior; Mar 26-28, 2008; Palo Alto, CA, USA.
- Looije R, Neerinx MA, Cnossen F. Persuasive robotic assistant for health self-management of older adults: design and evaluation of social behaviors. Int J Hum Comput Stud 2010;68(6):386-397. [CrossRef]
- Maier E, Reimer U, Schar SG, Zimmermann PG. SEMPER: a Web-based support system for patient self-management. 2010 Presented at: 23rd Bled eConference: eTrust: Implications for the Individual, Enterprises and Society; Jun 20-23, 2010; Bled, Slovenia URL: http://ecenter.fov.uni-mb.si/proceedings.nsf/Proceedings/16DB5E433CFFAC33C1257757003AEB6E/$File/15_Maier.pdf [WebCite Cache]
- Mazzotta I, de Rosis F, Carofiglio V. PORTIA: a user-adapted persuasion system in the healthy eating domain. IEEE Intell Syst 2007;22(6):42-51. [CrossRef]
- Munguia Tapia E. Using Machine Learning for Real-Time Activity Recognition and Estimation of Energy Expenditure [PhD thesis]. Cambridge, MA: Massachusetts Institute of Technology; 2008. URL: http://dspace.mit.edu/handle/1721.1/44913 [accessed 2011-07-19] [WebCite Cache]
- Nguyen H, Masthoff J. Designing persuasive dialogue systems: using argumentation with care. 2008 Presented at: Third International Conference on Persuasive Technology; Jun 4-6, 2008; Oulu, Finland. [CrossRef]
- Oddsson LI, Radomski MV, White M, Nilsson D. A robotic home telehealth platform system for treatment adherence, social assistance and companionship - an overview. Conf Proc IEEE Eng Med Biol Soc 2009;2009:6437-6440. [CrossRef] [Medline]
- Op den Akker H, Moualed LS, Jones VM, Hermens HJ. A self-learning personalized feedback agent for motivating physical activity. 2011 Presented at: 4th International Symposium on Applied Sciences in Biomedical and Communication Technologies: ISABEL '11; Oct 26-29, 2011; Barcelona, Spain. [CrossRef]
- Rojas-Barahona LM, Giorgino T. Adaptable dialog architecture and runtime engine (AdaRTE): a framework for rapid prototyping of health dialog systems. Int J Med Inform 2009 Apr;78 Suppl 1:S56-S68. [CrossRef] [Medline]
- Smith C, Cavazza M, Charlton D, Zhang L, Turunen M, Hakulinen J. Integrating planning and dialogue in a lifestyle agent. In: Intelligent Virtual Agents. Berlin: Springer; 2008:146-153.
- Sorbi MJ, Mak SB, Houtveen JH, Kleiboer AM, van Doornen LJ. Mobile Web-based monitoring and coaching: feasibility in chronic migraine. J Med Internet Res 2007;9(5):e38 [FREE Full text] [CrossRef] [Medline]
- Spring B, Schneider K, McFadden HG, Vaughn J, Kozak AT, Smith M, et al. Make Better Choices (MBC): study design of a randomized controlled trial testing optimal technology-supported change in multiple diet and physical activity risk behaviors. BMC Public Health 2010;10:586 [FREE Full text] [CrossRef] [Medline]
- Tiwari P, Warren J, Day K. Empowering older patients to engage in self care: designing an interactive robotic device. AMIA Annu Symp Proc 2011;2011:1402-1411. [Medline]
- Turunen M, Hakulinen J, Stahl O, Gambäck B, Hansen P, Rodriguez Gancedo M, et al. Multimodal and mobile conversational health and fitness companions. Comput Speech Lang 2011;25(2):192-209. [CrossRef]
- Uribe JA, Duitama JF, Gomez NG. Personalized message emission in a mobile application for supporting therapeutic adherence. 2011 Presented at: 13th IEEE International Conference on e-Health Networking, Applications and Services (Healthcom); Jun 13-15, 2011; Columbia, MO, USA. [CrossRef]
- van der Putten A, Kramer NC, Eimler SC. Living with a robot companion: empirical study on the interaction with an artificial health advisor. 2011 Presented at: 13th International Conference on Multimodal Interfaces: ICMI '11; Nov 14-18, 2011; Alicante, Spain:. [CrossRef]
- Watson A, Bickmore T, Cange A, Kulshreshtha A, Kvedar J. An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial. J Med Internet Res 2012;14(1):e1 [FREE Full text] [CrossRef] [Medline]
- Russell S, Norvig P. Artificial Intelligence: A Modern Approach. 3rd edition. Upper Saddle River, NJ: Prentice Hall; 2010.
- Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008;4:1-32. [Medline]
- Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol 2010 Feb;15(Pt 1):1-39. [CrossRef] [Medline]
- Miller WR, Rollnick S. Motivational Interviewing: Preparing People to Change Addictive Behavior. New York, NY: Guilford Press; 1991.
- Morris ME, Kathawala Q, Leen TK, Gorenstein EE, Guilak F, Labhard M, et al. Mobile therapy: case study evaluations of a cell phone application for emotional self-awareness. J Med Internet Res 2010;12(2):e10 [FREE Full text] [CrossRef] [Medline]
- Burns MN, Begale M, Duffecy J, Gergle D, Karr CJ, Giangrande E, et al. Harnessing context sensing to develop a mobile intervention for depression. J Med Internet Res 2011;13(3):e55 [FREE Full text] [CrossRef] [Medline]
- van der Krieke L, Emerencia AC, Aiello M, Sytema S. Usability evaluation of a web-based support system for people with a schizophrenia diagnosis. J Med Internet Res 2012;14(1):e24 [FREE Full text] [CrossRef] [Medline]
- Desmarais MC, Baker R. A review of recent advances in learner and skill modeling in intelligent learning environments. User Model User-adapt Interact 2011;22(1-2):9-38. [CrossRef]
- Bull S, Kay J. Student models that invite the learner in: the SMILI open learner modelling framework. Int J Artif Intellig Educ 2007;17(2):89-120 [FREE Full text] [WebCite Cache]
- Dimitrova V. STyLE-OLM: Interactive open learner modelling. Int J Artif Intell Educ 2003;13(1):35-78.
- Mitrovic A, Martin B. Evaluating the effects of open student models on learning. In: Adaptive Hypermedia and Adaptive Web-Based Systems. Berlin: Springer; 2006:296-305.
- Duan D, Mitrovic A, Churcher N. Evaluating the effectiveness of multiple open student models in EER-Tutor. 2010 Presented at: 18th International Conference on Computers in Education: ICCE 2010; Nov 29-Dec 3, 2010; Putrajaya, Malaysia.
- Du Boulay B, Avramides K, Luckin R, Martinez-Miron E, Mendez GR, Carr A. Towards systems that care: a conceptual framework based on motivation, metacognition and affect. Int J Artif Intell Educ 2010;20(3):197-229 [FREE Full text] [WebCite Cache]
- Mabbot A, Bull S. Student preferences for editing, persuading, and negotiating the open learner model. 2006 Presented at: 8th International Conference on Intelligent Tutoring Systems; June 36-30, 2006; Jhongli, Taiwan. [CrossRef]
- Hughes S, Cohen D. Can online consumers contribute to drug knowledge? A mixed-methods comparison of consumer-generated and professionally controlled psychotropic medication information on the internet. J Med Internet Res 2011;13(3):e53 [FREE Full text] [CrossRef] [Medline]
- Wicks P, Massagli M, Kulkarni A, Dastani H. Use of an online community to develop patient-reported outcome instruments: the Multiple Sclerosis Treatment Adherence Questionnaire (MS-TAQ). J Med Internet Res 2011;13(1):e12 [FREE Full text] [CrossRef] [Medline]
- Gupta S, Wan FT, Newton D, Bhattacharyya OK, Chignell MH, Straus SE. WikiBuild: a new online collaboration process for multistakeholder tool development and consensus building. J Med Internet Res 2011;13(4):e108 [FREE Full text] [CrossRef] [Medline]
- Swan M. Crowdsourced health research studies: an important emerging complement to clinical trials in the public health research ecosystem. J Med Internet Res 2012;14(2):e46 [FREE Full text] [CrossRef] [Medline]
- Hartzler A, Pratt W. Managing the personal side of health: how patient expertise differs from the expertise of clinicians. J Med Internet Res 2011;13(3):e62 [FREE Full text] [CrossRef] [Medline]
- Hawkins RP, Kreuter M, Resnicow K, Fishbein M, Dijkstra A. Understanding tailoring in communicating about health. Health Educ Res 2008 Jun;23(3):454-466 [FREE Full text] [CrossRef] [Medline]
- Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull 2007 Jul;133(4):673-693. [CrossRef] [Medline]
|ECA: embodied conversational agent|
|RCT: randomized controlled trial|
|Edited by G Eysenbach; submitted 05.09.11; peer-reviewed by T Bickmore; comments to author 25.09.11; revised version received 31.03.12; accepted 15.05.12; published 14.06.12|
Please cite as:
Kennedy CM, Powell J, Payne TH, Ainsworth J, Boyd A, Buchan I
Active Assistance Technology for Health-Related Behavior Change: An Interdisciplinary Review
J Med Internet Res 2012;14(3):e80
END, compatible with Endnote
BibTeX, compatible with BibDesk, LaTeX
RIS, compatible with RefMan, Procite, Endnote, RefWorks
Add this article to your Mendeley library
Add this article to your CiteULike library
Copyright©Catriona M Kennedy, John Powell, Thomas H Payne, John Ainsworth, Alan Boyd, Iain Buchan. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 14.06.2012.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.