Published on 18.02.14 in Vol 16, No 2 (2014): February
Digital Asthma Self-Management Interventions: A Systematic Review
Background: Many people with asthma tolerate symptoms and lifestyle limitations unnecessarily by not utilizing proven therapies. Better support for self-management is known to improve asthma control, and increasingly the Internet and other digital media are being used to deliver that support.
Objective: Our goal was to summarize current knowledge, evidenced through existing systematic reviews, of the effectiveness and implementation of digital self-management support for adults and children with asthma and to examine what features help or hinder the use of these programs.
Methods: A comprehensive search strategy combined 3 facets of search terms: (1) online technology, (2) asthma, and (3) self-management/behavior change/patient experience. We undertook searches of 14 databases, and reference and citation searching. We included qualitative and quantitative systematic reviews about online or computerized interventions facilitating self-management. Title, abstract, full paper screening, and quality appraisal were performed by two researchers independently. Data extraction was undertaken using standardized forms.
Results: A total of 3810 unique papers were identified. Twenty-nine systematic reviews met inclusion criteria: the majority were from the United States (n=12), the rest from United Kingdom (n=6), Canada (n=3), Portugal (n=2), and Australia, France, Spain, Norway, Taiwan, and Greece (1 each). Only 10 systematic reviews fulfilled pre-determined quality standards, describing 19 clinical trials. Interventions were heterogeneous: duration of interventions ranging from single use, to 24-hour access for 12 months, and incorporating varying degrees of health professional involvement. Dropout rates ranged from 5-23%. Four RCTs were aimed at adults (overall range 3-65 years). Participants were inadequately described: socioeconomic status 0/19, ethnicity 6/19, and gender 15/19. No qualitative systematic reviews were included. Meta-analysis was not attempted due to heterogeneity and inadequate information provision within reviews. There was no evidence of harm from digital interventions. All RCTs that examined knowledge (n=2) and activity limitation (n=2) showed improvement in the intervention group. Digital interventions improved markers of self care (5/6), quality of life (4/7), and medication use (2/3). Effects on symptoms (6/12) and school absences (2/4) were equivocal, with no evidence of overall benefits on lung function (2/6), or health service use (2/15). No specific data on economic analyses were provided. Intervention descriptions were generally brief making it impossible to identify which specific “ingredients” of interventions contribute most to improving outcomes.
Conclusions: Digital self-management interventions show promise, with evidence of beneficial effects on some outcomes. There is no evidence about utility in those over 65 years and no information about socioeconomic status of participants, making understanding the “reach” of such interventions difficult. Digital interventions are poorly described within reviews, with insufficient information about barriers and facilitators to their uptake and utilization. To address these gaps, a detailed quantitative systematic review of digital asthma interventions and an examination of the primary qualitative literature are warranted, as well as greater emphasis on economic analysis within trials.
J Med Internet Res 2014;16(2):e51
Asthma is common, affecting an estimated 300 million people worldwide. The number of disability-adjusted life years lost is estimated at 15 million per year, similar to that for diabetes . The main goals of treatment for asthma include achieving and maintaining control of symptoms, normal activity levels, minimal exacerbations, normal lung function, and preventing deaths from asthma [ ]. However, these goals are not widely achieved; people with asthma often tolerate unnecessary symptoms, and management of the condition can often be suboptimal [ , , ]. Guided self-management for asthma as part of systematic, planned care can lead to improvements in patient outcomes such as increases in knowledge, confidence to manage asthma, and improved quality of life, as well as reductions in hospitalizations, emergency room visits, unscheduled visits to the doctor, and days off work or school [ - ].
Despite evidence of benefits, guided self-management, particularly through the use of asthma plans, remains underused [- ]. While interventions can often be successful in trial settings, evidence of their implementation into every day practice is limited [ , ]. Therefore, there is growing interest in the potential of the Internet and other digital media as a medium to deliver more tailored, relevant self-management support, while maintaining cost-effectiveness, with greater scope for integration into the everyday lives of those with asthma.
While many reviews have been published in the field of self-management in asthma, there is a lack of clarity about the role of digital interventions and which specific components of interventions or “ingredients” contribute most to promoting effective self-management practices and translate into improvement in patient outcomes. There is increasing interest in standardizing methods of determining the “active ingredients” of self-management interventions, potentially making it easier to measure and reproduce those features found to be most effective in future interventions .
The aim of this paper is to summarize current knowledge, evidenced through existing systematic reviews, of the effectiveness and implementation of digital self-management support for adults and children with asthma and to examine what features help or hinder the use of these programs. We describe our metareview, which examines the effects, if any, of asthma digital self-management interventions on a range of measures of lung function, symptoms, quality of life, and health care utilization.
We conducted a systematic review of systematic reviews—an approach that has proven helpful in synthesizing a broad base of literature in order to identify research gaps and inform future intervention programs . Our aims were to assess the evidence of effectiveness of asthma digital interventions for self-management as measured by an inclusive range of clinical and process outcomes.
We documented recruitment and retention rates, information about implementation processes, whether cost effectiveness was assessed, and whether theories of behavior change were used in intervention development to help us gain a better of understanding of features that helped or hindered the use of the programs. Our protocol is available in.
Inclusion and Exclusion Criteria
We included qualitative and quantitative reviews and used the PICOS (participants, interventions, comparison, outcomes, study design) framework  to define inclusion criteria (see for details). Our exclusion criteria can be found in .
Information Sources and Search Strategy
A professional systematic review company (York Health Economic Consortium) searched a wide range of databases covering health, mental health, education, social science (14 in total), with no start date before July 2011. The search strategy was devised using a combination of subject indexing terms (eg, MeSH [medical subject headings] in MEDLINE), and free-text search terms in the title and abstract. The search terms were identified through discussion between the research team, by scanning background literature, and by browsing a database’s thesaurus. To ensure sensitivity, the search strategy did not include a methodological search filter to identify reviews. The searches were not limited by date range or language. Hand-searching of Patient Education and Counseling, and the Primary Care Respiratory Journal, and reference searching and citation searching of included studies was undertaken (DM). We contacted experts to establish if any reviews had been missed. The search of electronic databases was updated to October 3, 2013.
The search strategy covered 3 broad areas: (1) asthma and related terms, (2) online/computerized and related terms, and (3) self-care/self-management, patient experience, qualitative, and related terms. The full list of databases searched and an example of the full search strategy for MEDLINE are available in.
Titles, abstracts, and full papers were screened by one researcher (DM) plus one other independent researcher (EC, SW, FM, NCT, KA, RD, AM, or VR). We independently undertook quality appraisal; disagreements were resolved by discussion with a third party if necessary. Only studies meeting predetermined quality criteria advanced to data extraction.
We used online data collection forms using Distiller SR software. For each included review, we collected (1) general information about the review (year, country of first author, language, number of studies, number of asthma studies, and number of digital asthma studies), (2) descriptions of each included RCT and intervention that fulfilled our criteria (inclusion criteria were applied to the systematic reviews initially and then subsequently to their featured RCTs, to determine those relevant to this review), and (3) results for each outcome of interest and the original article this result was derived from (including quotes from qualitative/narrative reviews).
Quality appraisal was undertaken in two ways. First, at the full paper screening stage, papers were required to meet criteria laid out in our definition of a review (eg, evidence of a systematic search or criteria for selection of papers must be included; seefor full definition). Then, the included papers underwent formal quality appraisal using A Measurement Tool to Assess Systematic Reviews (AMSTAR) [ - ]. This 11-point checklist covers the following domains: establishing the research question and inclusion criteria before the conduct of the review, data extraction by at least 2 independent data extractors, comprehensive literature review with searching of at least two databases, detailed list of included/excluded studies, quality assessment of included studies and consideration of quality assessments in analysis and conclusions, appropriate assessment of homogeneity, assessment of publication bias, and a statement of any conflict of interest. We made minor alterations to the wording in order to make the checklist applicable to non-quantitative reviews (available on request from the corresponding author). Papers needed to achieve at least 50% of quality indicators, plus a “yes” to question 7, which asks “Was the scientific quality of the included studies assessed and documented?” This was required to allow us to make a comment on the quality of the included data. Two researchers (DM + [KA, RD, AM, or VR]) scored each paper independently, with conflicts resolved by discussion with a third party if necessary (FM).
Any data provided describing risk of bias across reviews, and within individual RCTs, were extracted to inform the discussion.
Meta-analysis was not possible. Quantitative results for individual outcomes results were described as favoring the intervention group, favoring the control group, or demonstrating no difference. All results were included in a narrative summary.
Results of Article Screening and Selection
Our search identified 3810 unique citations, and title and abstract screening identified 116 full papers for review. Of these, 29 fulfilled our inclusion criteria ().
Description of Included Reviews
The 29 papers included systematic reviews from United States (12), United Kingdom (6), Canada (3), Portugal (2) Australia, France, Spain, Norway, Taiwan, and Greece (1 each). Only 9 reviews focused completely on asthma interventions (the others included self-management interventions for asthma alongside a range of other chronic conditions such as diabetes, heart failure, and hypertension), and 11 reviews looked exclusively at digital interventions (the rest examined digital interventions alongside other modes of self-management). These 29 reviews consisted of 4 Cochrane reviews [- ] and 3 meta-analyses [ - ], with the remaining 22 being narrative or descriptive studies (see ; [ , - ]).
Quality of the Included Reviews
Within the 29 included reviews, descriptions of the included RCTs and particularly the interventions themselves were generally suboptimal. AMSTAR scores ranged from 10% to 100% with a median of 40% (interquartile range 20–50), with 10 reviews scoring 50% or greater. All reviews with 50% or over also provided an individual assessment of quality, which was an essential criterion to progress to data extraction. Areas where reviews performed particularly poorly include providing information about conflict of interests of included RCTs (1/29), providing a priori design (6/29), independent screening and data extraction (6/29 clearly demonstrated this; a further 15/29 may have, but insufficient information was provided to be able to confirm this), and providing a list of excluded studies (7/29).
Of the 10 reviews meeting the predetermined AMSTAR requirements (), these included the 4 Cochrane reviews and 6 narrative/descriptive reviews. Four reviews focused only on asthma, with the remaining 6 featuring a range of conditions. Four of the reviews included nondigital/electronic modes of delivery of interventions. There was no one review that looked specifically at digital interactive interventions aimed only at those with asthma. These 10 systematic reviews presented results from a total of 19 RCTs meeting our inclusion criteria (see for descriptions [ , - , , , - , - ] and for interventions [ - ]).
All 10 systematic reviews provided sample sizes for their included RCTs, but only three provided numbers allocated to intervention group versus control [, , ]. All reviews presented some information about age, 8 out of 10 presented information about gender, and only 4 of the 10 reviews about the ethnicity of participants [ - , ]. No review provided information about socioeconomic status or levels of educational attainment.
Quality of Evidence in Included Reviews
Seven of the reviews provided risk of bias data based on the guidance provided by the Cochrane collaboration , whereby different elements such as adequate sequence generation, allocation concealment, and blinding are assessed as being of low risk of bias, high risk of bias, or unclear risk of bias. This does not provide an overall score. Two reviews provided quality scores, one based on the Oxford Quality scoring system [ ] and the other using the Consort Statement [ ]. The final review [ ] provided an overall quality grade based on guidance from within the Cochrane handbook, but did not provide any rationale for their grading. Grading of RCTs in this way is subjective, and there was conflict between reviews about the risk of bias present in a given RCT. For example, the presence of adequate sequence generation by Guendelman was assessed by 4 different reviews [ , , - ]. Two described this as “unclear risk of bias”, but the other two reported it as “adequate”, and “low risk of bias”. This, combined with the various different methods used and in some cases limited information provided, meant that we are unable to make any detailed statements about the quality of the included trials.
Descriptions of Included Randomized Controlled Trials
The 19 unique RCTs within the reviews are described in. Reporting of descriptive data about RCT participants was mixed; only 4/10 reviews [ - , ] provided information for all 7 descriptive headings (sample size, age of participants, gender, ethnicity, dropout rate, duration, country of study), with no data about socioeconomic status. The sample sizes for the 18 RCTs providing quantitative results ranged from 20 to 378. There were discrepancies in the sample sizes reported for some RCTs between reviews; for example, the RCT by Jan had 3 different sample sizes reported from 4 reviews (164, 179, and 196). Where there were discrepancies, taking the largest number provided the total number of participants of 2315. From the 19 RCTs featured, 4 were aimed at adults, 14 at children or adolescents, and the age range for one was not described (HussA). All 4 of the RCTs aimed at adults had upper age limits (of 25, 45, 50, and 65 years).
From the 8 RCTs with information about gender, 9 had a majority of female participants and 9 had a majority of males; combining the RCTs with sample size and gender numbers, the percentage of male participants was 54% (793/1478). Dropout rates were available for 11 of the 19 RCTs and ranged from 4.5% to 23%, but again, the reporting of these numbers for 3 of these RCTs was conflicting (Krishna, Jan, Guendelman). Reasons for dropout were rarely provided. Duration of studies ranged from a one-off use of the intervention, to access for 12 months. Eleven RCTs were from the United States, and one each from Taiwan, Portugal, Sweden, Denmark, and the Netherlands. The country was not described for the remaining 3 RCTs.
Descriptions of Contents of Included Interventions
A summary of the key components or ingredients reported as being present in the interventions is summarized in. Provision of information and self-management education was the most common feature present in 16/19 RCTs. This was followed by the presence of immediate feedback/interactivity from the device (13/19).
Ten of the interventions used games/quizzes/vignettes, and all of these were from RCTs from 2006 or earlier. Eight of the interventions involved some form of direct communication either to or from health professionals. Six of the interventions were available for daily use. The presence of an action plan was noted in 4 interventions, all 2005 or later. This was the same for interventions featuring automated reminders/alerts from devices. Description of the interventions was variable between reviews, and it is possible that many of these interventions feature components not described in.
The key ingredients or components of interventions were often poorly described rendering it impossible to draw conclusions about the effects of different components of interventions on outcomes.
Results Relating to Outcomes of Interest
There were quantitative results available for the following outcomes of interest: activity limitation, knowledge, markers of self-care, quality of life, medication use, symptoms, missing school, lung function, and health service utilization (eg, emergency department visits, hospitalizations, primary care visits).
There were descriptive results relating to adverse events, behavior change theory use, and patient satisfaction. No data were provided about cost-effectiveness or biomarkers of airway inflammation.
Results From Quantitative Reviews
Quantitative results were provided in a range of ways across the reviews. For example, McLean et al  provided original numbers of events and sample size, with results given as odds ratios with confidence intervals, whereas Stinson et al [ ] reported the outcome as either statistically significantly in favor of the intervention group (+), the control group (-), or no difference (0). Murray et al [ ] presented results as either standardized mean differences (SMD) and effect size (in the form of Lipsey Categories of small, medium, or large) or odds ratios. However, the significance for individual RCT results was not provided, limiting the conclusions we can draw from this individual review (therefore not included in the text below). Quantitative results are presented in and and summarized below. details all the data extracted from the reviews, along with a summary stating whether the results favored the intervention group (Y), showed no difference (0), or statistical significance of results was not provided (n/a). No results favored the control groups. summarizes only the results that provide a measure of statistical significance [ , - , , , - , ].
Stinson , Johansen et al [ , ], and Kirk [ ] reported findings from two RCTs (Joseph and Guendelman). Both reported that the use of a digital intervention reduced the number of days of restricted activity significantly.
Three reviews [, - ] provided results from 2 RCTs (Jan, Krishna) about the impact of online interventions on knowledge, both of which provided results in favor of the use of digital interventions.
Markers for Self-Management
Six of the reviews [, , , - , ] presented data for markers of self-management from 7 separate RCTs (Jan, Joseph, Rubin, Vilozni, Guendelman, HussA & Rasmussen) covering, for example, proportion using action plans, spirometry/inhaler technique, diary adherence, and impact on completion of self-management sessions. All except one (Guendelman) showed a positive effect.
Quality of Life
Six reviews [, , , - , ] presented data from 7 RCTs for quality of life. Four of the RCTs favored the intervention group (Jan, Van der Meer, Shames, Rasmussen), and 3 showed no difference (Joseph, Krishna, Kamps).
Two reviews [, ] provided results from 3 RCTs for this outcome. Two favored the interventions group (McPherson & Huss), while the other showed no difference (Shames).
Symptoms and Asthma Control
Seven systematic reviews [, , , , - , ] provided results for this outcome, from 12 RCTs. Six reported no difference (Guendelman, HussA, HussB, Shames, Kamps, Sundberg); the remaining 6 studies favored the use of the digital interventions (Jan, Joseph, Krishna, Rasmussen, Van der Meer, Bartholomew).
Three reviews reported for this outcome [, , ] from 4 RCTS: two favoring the intervention group (Joseph & McPherson), and two showing no difference (Guendelman & Rubin).
Six reviews [- , , - ] presented data for this outcome from 7 RCTs, with three favoring the use of digital interventions (Rasmussen, Guendelman, Sundberg), and 4 showing no difference (Jan, Shames, Kamps, HussA).
Emergency Department Visits
Five reviews [, , - , ] provided results from 6 RCTs on emergency department (ED) visits. Four trials showed no difference (Rasmussen, Bartholomew, Jan, Guendelman), and 2 studies favored the intervention (Joseph, Krishna).
Five reviews [, , - , ] provided information from 5 RCTs, all of which showed no significant differences between the intervention group and controls (Guendelman, Joseph, Rubin, McPherson, Rasmussen).
Primary Care Visits
Two reviews provided data for this outcome [, ] from 4 RCTs (Shames, Rubin, McPherson & Jan). All 4 RCTs demonstrated no difference in the number of visits.
Outcomes With Descriptive Results Only
Only two reviews [, ] provided results for this outcome. McLean et al [ ] results were specific to one study (Rasmussen) and found that the increased corticosteroid dose/use that went along with being in the intervention or specialist group, compared to the GP group, meant a higher proportion (no details provided) of those patients experienced dysphonia or oral candidiasis. McDermott made comments more generally stating that there appeared to be no adverse outcomes from moving towards computer-based patient self-management programs.
Use of Behavior Change Theory During Development
Two systematic reviews explicitly sought to establish the presence or absence of underlying theory in the development of their included interventions [- ]. Johansen et al [ , ] included as part of their quality appraisal whether or not there was “theoretical evidence that the intervention might have the desired effect”. Of the 5 digital asthma interventions included in their review, all 5 met this criterion (Chan, Guendelman, Jan, Rasmussen, Van der Meer). Kirk et al [ ] described the presence or absence of an “underlying theoretical basis” in their included RCTs. They reported that both the digital asthma RCTs in their review (Jan and Guendelman) demonstrated no theoretical basis, which contradicts the findings of Johansen et al [ , ].
Three other reviews described the contents of their included interventions using terminology relevant to behavior change theory. For example, within Murray et al , the Shegog trial was described as providing “intensive, tailored information on self-management for children with asthma. Text, graphics, animation, sound and video clips are utilised, and behavior support delivered via verbal reinforcement, guided practice, feedback goal setting and incentives”. However, it does not explicitly describe any role of behavior change theory during development of the intervention.
Stinson et al  reported that all three of their included interventions (Jan, Joseph, Krishna) featured training around symptom management, trigger avoidance, and medication use, but that Krishna was the only one described as including behavioral therapy (featuring modeling, reinforcement, and self-mastery), but again no explicit descriptions of theory used during development.
McDermott et al  did not describe the presence or absence of behavior change theories during the development of interventions included in their review but did attempt to characterize the “active ingredients” of each included intervention by coding their descriptions using a behavior change technique (BCT) taxonomy. One intervention (HussA) was found to include only one BCT (provide instruction) while the other (Sundberg) was found to have 3 BCTs (provide general information on the condition, advise on medication, and provide instruction).
Patient Satisfaction, Barriers, and Facilitators to Digital Asthma Interventions
Three reviews [, , , ] addressed these issues. One study (Cruz-Correia) featured within the McLean et al [ ] review found that patients preferred a Web-based system of monitoring asthma compared to a paper-based system. Johansen et al [ , ] reported in general that “an interactive-feedback learning mechanism can provide the stimulus for the patient to build the necessary confidence to handle symptoms and self-management, and in this way support patient centeredness”, and they reported specifically that the Guendelman study suggested the electronic devices might be considered as a “motivating and exciting tool for children with asthma”. Johansen et al [ , ] also reported the findings from the trial by Jan that children found their tool to be “fun” and concluded more research was required in this area. McDermott et al [ ] reported findings in general suggesting that computer-based programs may “even be preferred by many patients as they allow participants to proceed at their own pace”. McDermott et al [ ] also commented that the combination of standard and computer-based approaches might seem to be the ideal scenario, but state there was no evidence found in their review that is the case.
Only one review mentioned implementability of interventions. Kirk et al  felt that the integration of the intervention featured in the trial led by Jan was feasible in current practice but did not elaborate.
Cost Effectiveness Analysis
Three Cochrane reviews [, , ] and one narrative synthesis planned to include this outcome measure. McLean et al [ ] looked at “costs from the health care perspective”, but there were no results specific to interventions matching our inclusion criteria. Murray et al [ ] looked at “economic outcomes”, including health care use under this heading. Other than providing summaries of health care use for 3 trials (Bartholomew, Guendelman, Krishna), there was no additional specific cost data provided. Boyd et al [ ] planned to collect data on cost, but no studies provided such information. McDermott et al [ ] found only one of their included studies provided data on cost, and it was for an intervention aimed at those with diabetes.
Initial full paper screening resulted in 29 systematic reviews. However, following quality appraisal, only 10 met the predetermined AMSTAR cut-off values. This metareview summarizes the findings from these 10 systematic reviews featuring a total of 18 unique RCTs of digital asthma self-management interventions. Only 11 of the 19 RCTs were present in more than one review suggesting that at present there is no single good quality systematic review looking specifically at digital self-management interventions for asthma.
Within the systematic reviews we found that information about methods, intervention components, and results were often brief and did not allow for meaningful comparisons between interventions. The described studies themselves were extremely heterogeneous making comparison between interventions difficult. “Control” groups ranged from no active intervention or contact with health professionals to multiple face-to-face teaching sessions and intermittent use of the intervention itself, which may have masked potential positive outcomes of digital interventions. More recent reviews tended to have more information, particularly with online appendices.
In no studies did the control groups have better outcomes, although only two reviews addressed the issue of adverse events, and specific information was available from only one study, which is a concern. That study suggested digital interventions groups may be at higher risk of adverse events related to the fact that successful interventions usually increase inhaled corticosteroid use (a positive outcome) and therefore results in more cases of dysphonia or oral candidiasis. Surprisingly, the issue of patient satisfaction was also neglected, being specifically addressed in only one trial, which suggested participants preferred a Web-based system to a paper-based one, and discussed in general terms in one further review.
Descriptions of intervention development and particularly the use of theory (which has been shown to increase effectiveness) were either brief or not discussed at all, although our review suggests that more recent reviews are increasingly recognizing this, an issue highlighted by the recent publication of a CONSORT EHEALTH statement . This matters because trying to establish the key components of effective self-management interventions is a challenge faced by researchers in this area [ ]. For example, a recent Cochrane review of computer-based interventions in adults with type 2 diabetes concluded that there was a small beneficial effect on blood glucose control, particularly in the mobile phone subgroup [ ]. However, the authors also commented that the key “ingredient” of effective interventions was unclear; it could either have been that the mobile phone itself was important or that the interventions delivered using mobile phones had included BCTs that were likely to lead to success, and these could be the “ingredient” that made these interventions more effective. What is consistent across several systematic reviews on digital support for self-management of chronic illness is that interventions with multiple behavior change techniques appear, on the whole, to be more effective than those using fewer and that the use of theory to inform the choice and combination of BCTs appears to be associated with increasing effectiveness [ - ].
Only four RCTs featured adults, and there were no participants over the age of 65 years, with only one small trial with just 21 participants including individuals over the age of 50 years. No information was provided about the socioeconomic status or education level of participants. None of the trials were undertaken in low-income countries. Attrition rates of up to 23% were recorded. This is in keeping with other systematic reviews of digital interventions in other areas. For example, a recent Cochrane review examining computer-based weight loss interventions found attrition rates ranging from 2-25% (median 16%) , and attrition may be worse in interventions targeting older age groups, with one review including digital and nondigital interventions noting rates between 0 and 52% (median 15%) [ ]. Reassuringly, attrition rates are no worse than those found with nondigital self-management asthma interventions as described in Gibson’s Cochrane review examining asthma self-management education and regular health professional review, where attrition rates ranged from 0-54% (median 15%) [ ].
Our metareview suggests that digital interventions may be effective at improving knowledge, reducing activity limitation, improving markers of self-management, improving quality of life, and optimizing medication use in those less than 65 years of age. However, certain indicators, such as knowledge and activity limitation, were assessed in only two trials, and medication use improvements noted in two out of three trials that examined this. There was no evidence of improvements in symptoms, lung function, school absences, or health service utilization.
Importantly, we found no qualitative synthesis of asthma digital interventions that would have given insight into the patient experience of using digital self-management interventions, implementation processes, or barriers and facilitators to their use, which is an important gap in the evidence base.
Strengths and Limitations
Our metareview has a number of strengths and limitations. The search was undertaken by a team with good experience of systematic reviews, using multiple databases, and using a strategy designed iteratively with researchers to be as inclusive as possible, without being unwieldy. Despite this, we may have missed reviews of chronic illness interventions including asthma but not specifically indexed as such. We included non-English studies, which is a strength. Due to the heterogeneity of the data, a formal metasynthesis was not possible.
A further limitation here is the reliability and comprehensibility of the included information. When undertaking a review of reviews, the data are an extra step away from the original research increasing the possibility of reporting errors. We noted several discrepancies between reviews describing the same RCTs, in sample sizes and gender descriptions. Some trials presented data as sample size, while others used terms such as number of participants, and dropout calculations did not appear to correlate on several occasions. This could be due to reporting error, or differences in the interpretation of the terms sample size, follow-up, and participants. In addition, there was a lack of detail describing the populations included, and limited definitions of outcome measures provided by featured systematic reviews. This translates into a lack of specific detail about the population our results are relevant to, and limitations in comparing results that have potentially used different ways of defining outcomes. Finally, establishing a minimum standard of quality of included reviews ensures that there is a degree of reliability to the conclusions ; however, this undoubtedly narrowed the available data from which we could draw conclusions. Had we not used AMSTAR criteria, we could have had data from up to a further 12 RCTs and two qualitative studies. However many of these RCTs were included only in low AMSTAR scoring papers (ie, those that had not undertaken any quality appraisal of their included studies), and there were often no descriptions of control groups, or more than a few words describing the interventions, and therefore inclusion of any such data would have rendered our conclusions meaningless. The RCTs themselves often appeared poor quality (eg, poor randomization strategies), with small numbers (eg, sample sizes as low as 10), and had been excluded from the more robust reviews for these reasons. The lack of economic data is a weakness, although the results on health care resource use (hospitalizations and ED visits) suggests that evidence of cost-effectiveness may be lacking. However, without data including routine health care resource utilization and formal economic analysis, no firm conclusions can be drawn.
This metareview provides a snapshot of current knowledge about effectiveness of digital self-management support for those with asthma. Digital self-management interventions show promise, with evidence of beneficial effects on some outcomes. However, we know nothing about the socioeconomic status of participants, and few over the age of 50 years and no one over 65 years of age were included. Thus, the true “reach” of these studies is uncertain, and their likely uptake and use by the wider population of those with asthma remains uncertain. Few interventions were underpinned by robust theoretical frameworks. Digital interventions are poorly described, and there is insufficient information about barriers and facilitators to their uptake and utilization. Importantly, patient perspectives have been largely ignored in currently available reviews. There was little data about cost effectiveness within reviews, but this appears to relate to the lack of existence of such data from primary trials. Digital interventions for asthma appear promising but further robust investigation is needed, first, in the form of a detailed systematic review of currently available digital interventions aimed at those with asthma, detailing the presence or absence of BCTs. Second, examination of the primary qualitative literature to describe what is already known about the patient’s perspective would be invaluable to inform future interventions.
We would like to acknowledge the York Health Economic Consortium for their work on the search strategy. We would like to thank the Chief Scientist Office Scotland for funding this study (Ref: CAF/11/08). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Authors met the following criteria for author contributions: substantial contribution to conception and design, or acquisition of data, or analysis and interpretation of data (DM, SW, KA, EC, RD, AMcC, AMM, VR, NCT, FSM); drafting the article or revising it critically for important intellectual content (DM, SW, KA, EC, AMcC, NCT, FSM); final approval of the version to be published (DM, SW, KA, EC, RD, AMcC, AMM, VR, NCT, FSM).
Conflicts of Interest
DM, KA, EC, RD, AMcC, AMM, VR, NCT, and FSM have no conflict of interest. SW is co-author on one included review (Ring et al) but took no part in the screening, selection, or quality appraisal of this study.
Multimedia Appendix 1
Full systematic review protocol.PDF File (Adobe PDF File), 29KB
Multimedia Appendix 2
Details and results of databases searched, and sample search strategy for Medline Database.PDF File (Adobe PDF File), 41KB
Multimedia Appendix 3
Description of full quantitative results per outcome.PDF File (Adobe PDF File), 76KB
- Masoli M, Fabian D, Holt S, Beasley R, Global Initiative for Asthma (GINA) Program. The global burden of asthma: executive summary of the GINA Dissemination Committee report. Allergy 2004 May;59(5):469-478. [CrossRef] [Medline]
- Global Strategy for Asthma Management and Prevention. 2012. Global Initiative for Asthma (GINA) URL: http://www.ginasthma.org/local/uploads/files/GINA_Report_March13.pdf [accessed 2013-06-25] [WebCite Cache]
- Rabe KF, Vermeire PA, Soriano JB, Maier WC. Clinical management of asthma in 1999: the Asthma Insights and Reality in Europe (AIRE) study. Eur Respir J 2000 Nov;16(5):802-807 [FREE Full text] [Medline]
- Partridge MR, Dal Negro RW, Olivieri D. Understanding patients with asthma and COPD: insights from a European study. Prim Care Respir J 2011 Sep;20(3):315-23, 17 p following 323 [FREE Full text] [CrossRef] [Medline]
- British Thoracic Society Scottish Intercollegiate Guidelines Network. British Guideline on the Management of Asthma. Thorax 2008 May;63 Suppl 4:iv1-121. [CrossRef] [Medline]
- Powell H, Gibson PG. Options for self-management education for adults with asthma. Cochrane Database Syst Rev 2003(1):CD004107. [CrossRef] [Medline]
- Thoonen BP, Schermer TR, Van Den Boom G, Molema J, Folgering H, Akkermans RP, et al. Self-management of asthma in general practice, asthma control and quality of life: a randomised controlled trial. Thorax 2003 Jan;58(1):30-36 [FREE Full text] [Medline]
- Gibson PG, Powell H, Coughlan J, Wilson AJ, Abramson M, Haywood P, et al. Self-management education and regular practitioner review for adults with asthma. Cochrane Database Syst Rev 2003(1):CD001117. [CrossRef] [Medline]
- Hoskins G, McCowan C, Donnan PT, Friend JA, Osman LM, Asthma UK Scotland, Scottish Executive Health Department. Results of a national asthma campaign survey of primary care in Scotland. Int J Qual Health Care 2005 Jun;17(3):209-215 [FREE Full text] [CrossRef] [Medline]
- Ring N, Malcolm C, Wyke S, Macgillivray S, Dixon D, Hoskins G, et al. Promoting the use of Personal Asthma Action Plans: a systematic review. Prim Care Respir J 2007 Oct;16(5):271-283 [FREE Full text] [CrossRef] [Medline]
- Douglass J, Aroni R, Goeman D, Stewart K, Sawyer S, Thien F, et al. A qualitative study of action plans for asthma. BMJ 2002 Apr 27;324(7344):1003-1005 [FREE Full text] [Medline]
- Eccles MP, Armstrong D, Baker R, Cleary K, Davies H, Davies S, et al. An implementation research agenda. Implement Sci 2009;4:18 [FREE Full text] [CrossRef] [Medline]
- Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med 2013 Aug;46(1):81-95. [CrossRef] [Medline]
- Mair FS, May C, O'Donnell C, Finch T, Sullivan F, Murray E. Factors that promote or inhibit the implementation of e-health systems: an explanatory systematic review. Bull World Health Organ 2012 May 1;90(5):357-364 [FREE Full text] [CrossRef] [Medline]
- O'Connor D, Green S, Higgins JPT. Chapter 5: Defining the review question and developing criteria for including studies. In: Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions. Chichester, England: Wiley-Blackwell; 2008.
- Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, et al. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol 2009 Oct;62(10):1013-1020. [CrossRef] [Medline]
- Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 2007;7:10 [FREE Full text] [CrossRef] [Medline]
- Shea BJ, Bouter LM, Peterson J, Boers M, Andersson N, Ortiz Z, et al. External validation of a measurement tool to assess systematic reviews (AMSTAR). PLoS One 2007;2(12):e1350 [FREE Full text] [CrossRef] [Medline]
- Murray E, Burns J, See TS, Lai R, Nazareth I. Interactive Health Communication Applications for people with chronic disease. Cochrane Database Syst Rev 2005(4):CD004274. [CrossRef] [Medline]
- Boyd M, Lasserson TJ, McKean MC, Gibson PG, Ducharme FM, Haby M. Interventions for educating children who are at risk of asthma-related emergency department attendance. Cochrane Database Syst Rev 2009(2):CD001290. [CrossRef] [Medline]
- Welsh EJ, Hasan M, Li P. Home-based educational interventions for children with asthma. Cochrane Database Syst Rev 2011(10):CD008469. [CrossRef] [Medline]
- McLean S, Chandler D, Nurmatov U, Liu J, Pagliari C, Car J, et al. Telehealthcare for asthma. Cochrane Database Syst Rev 2010(10):CD007717. [CrossRef] [Medline]
- Wantland DJ, Portillo CJ, Holzemer WL, Slaughter R, McGhee EM. The effectiveness of Web-based vs. non-Web-based interventions: a meta-analysis of behavioral change outcomes. J Med Internet Res 2004 Nov 10;6(4):e40 [FREE Full text] [CrossRef] [Medline]
- Cushing CC, Steele RG. A meta-analytic review of eHealth interventions for pediatric health promoting and maintaining behaviors. J Pediatr Psychol 2010 Oct;35(9):937-949 [FREE Full text] [CrossRef] [Medline]
- Coffman JM, Cabana MD, Halpin HA, Yelin EH. Effects of asthma education on children's use of acute care services: a meta-analysis. Pediatrics 2008 Mar;121(3):575-586 [FREE Full text] [CrossRef] [Medline]
- Krishna S, Balas EA, Spencer DC, Griffin JZ, Boren SA. Clinical trials of interactive computerized patient education: implications for family practice. J Fam Pract 1997 Jul;45(1):25-33. [Medline]
- Lewis D. Computers in patient education. Comput Inform Nurs 2003;21(2):88-96. [Medline]
- Almeida P, Caetan F, Carvalho A, Fernandes S, Gaspar J, Loureiro M, et al. Introduction to Medicine. 2006. Interactive Applications for patient education and behaviour change in Asthma URL: http://medicina.med.up.pt/im/trabalhos06_07/sites/Turma16/sitee/articledownload.pdf [accessed 2013-07-02] [WebCite Cache]
- Bussey-Smith KL, Rossen RD. A systematic review of randomized control trials evaluating the effectiveness of interactive computerized asthma patient education programs. Ann Allergy Asthma Immunol 2007 Jun;98(6):507-16; quiz 516, 566. [CrossRef] [Medline]
- García-Lizana F, Sarría-Santamera A. New technologies for chronic disease management and control: a systematic review. J Telemed Telecare 2007;13(2):62-68. [CrossRef] [Medline]
- Fox MP. A systematic review of the literature reporting on studies that examined the impact of interactive, computer-based patient education programs. Patient Educ Couns 2009 Oct;77(1):6-13. [CrossRef] [Medline]
- Moeinedin F, Moineddin R, Jadad AR, Hamid JS, To T, Beyene J. Application of biomedical informatics to chronic pediatric diseases: a systematic review. BMC Med Inform Decis Mak 2009;9:22 [FREE Full text] [CrossRef] [Medline]
- Papastergiou M. Exploring the potential of computer and video games for health and physical education: A literature review. Computers & Education 2009 Nov;53(3):603-622. [CrossRef]
- Stinson J, Wilson R, Gill N, Yamada J, Holt J. A systematic review of internet-based self-management interventions for youth with health conditions. J Pediatr Psychol 2009 Jun;34(5):495-510 [FREE Full text] [CrossRef] [Medline]
- Coscrato G, Pina JC, Mello DFD. Utilização de atividades lúdicas na educação em saúde: uma revisão integrativa da literatura [Use of recreational activities in health education: integrative review of literature]. Acta paul. enferm 2010 Apr;23(2):257-263. [CrossRef]
- Gremeaux V, Coudeyre E. The Internet and the therapeutic education of patients: A systematic review of the literature. Ann Phys Rehabil Med 2010 Dec;53(10):669-692. [CrossRef] [Medline]
- McDermott MS, While AE. Maximizing the healthcare environment: a systematic review exploring the potential of computer technology to promote self-management of chronic illness in healthcare settings. Patient Educ Couns 2013 Jul;92(1):13-22. [CrossRef] [Medline]
- Paré G, Moqadem K, Pineau G, St-Hilaire C. Clinical effects of home telemonitoring in the context of diabetes, asthma, heart failure and hypertension: a systematic review. J Med Internet Res 2010;12(2):e21 [FREE Full text] [CrossRef] [Medline]
- Klasnja P, Pratt W. Healthcare in the pocket: mapping the space of mobile-phone health interventions. J Biomed Inform 2012 Feb;45(1):184-198 [FREE Full text] [CrossRef] [Medline]
- Kuo C, Wang H. Applying self-management intervention studies to patients with chronic illness: a systematic review [Chinese]. Journal of Nursing and Healthcare Research 2012(8):50-60 ISSN 2072-90235.
- Chrisler AJ. Asthma education: a review of randomized controlled youth asthma-education programs. J Public Health 2012 Oct 27;20(3):305-312. [CrossRef]
- Johansen MA, Berntsen GK, Schuster T, Henriksen E, Horsch A. Electronic symptom reporting between patient and provider for improved health care service quality: a systematic review of randomized controlled trials. Part 2: methodological quality and effects. J Med Internet Res 2012;14(5):e126 [FREE Full text] [CrossRef] [Medline]
- Johansen MA, Henriksen E, Horsch A, Schuster T, Berntsen GK. Electronic symptom reporting between patient and provider for improved health care service quality: a systematic review of randomized controlled trials. Part 1: state of the art. J Med Internet Res 2012;14(5):e118 [FREE Full text] [CrossRef] [Medline]
- Kirk S, Beatty S, Callery P, Gellatly J, Milnes L, Pryjmachuk S. The effectiveness of self-care support interventions for children and young people with long-term conditions: a systematic review. Child Care Health Dev 2013 May;39(3):305-324. [CrossRef] [Medline]
- Mosnaim GS, Powell LH, Rathkopf M. A review of published studies using interactive Internet tools or mobile devices to improve asthma knowledge or health outcomes. Pediatric Allergy, Immunology, and Pulmonology 2012 Jun;25(2):55-63. [CrossRef]
- Nickels A, Dimov V. Innovations in technology: social media and mobile technology in the care of adolescents with asthma. Curr Allergy Asthma Rep 2012 Dec;12(6):607-612. [CrossRef] [Medline]
- Hieftje K, Edelman EJ, Camenga DR, Fiellin LE. Electronic media-based health interventions promoting behavior change in youth: a systematic review. JAMA Pediatr 2013 Jun;167(6):574-580 [FREE Full text] [CrossRef] [Medline]
- Cruz-Correia R, Fonseca J, Lima L, Araújo L, Delgado L, Castel-Branco MG, et al. Web-based or paper-based self-management tools for asthma--patients' opinions and quality of data in a randomized crossover study. Stud Health Technol Inform 2007;127:178-189. [Medline]
- Guendelman S, Meade K, Benson M, Chen YQ, Samuels S. Improving asthma outcomes and self-management behaviors of inner-city children: a randomized trial of the Health Buddy interactive device and an asthma diary. Arch Pediatr Adolesc Med 2002 Feb;156(2):114-120. [Medline]
- Jan RL, Wang JY, Huang MC, Tseng SM, Su HJ, Liu LF. An internet-based interactive telemonitoring system for improving childhood asthma outcomes in Taiwan. Telemed J E Health 2007 Jun;13(3):257-268. [CrossRef] [Medline]
- Rasmussen LM, Phanareth K, Nolte H, Backer V. Internet-based monitoring of asthma: a long-term, randomized clinical study of 300 asthmatic subjects. J Allergy Clin Immunol 2005 Jun;115(6):1137-1142. [CrossRef] [Medline]
- van der Meer V, Bakker MJ, van den Hout WB, Rabe KF, Sterk PJ, Kievit J, SMASHING (Self-Management in Asthma Supported by Hospitals‚ ICT‚ Nurses and General Practitioners) Study Group. Internet-based self-management plus education compared with usual care in asthma: a randomized trial. Ann Intern Med 2009 Jul 21;151(2):110-120. [Medline]
- Joseph CL, Peterson E, Havstad S, Johnson CC, Hoerauf S, Stringer S, Asthma in Adolescents Research Team. A web-based, tailored asthma management program for urban African-American high school students. Am J Respir Crit Care Med 2007 May 1;175(9):888-895 [FREE Full text] [CrossRef] [Medline]
- Krishna S, Francisco BD, Balas EA, König P, Graff GR, Madsen RW, Randomized trial. Internet-enabled interactive multimedia asthma education program: a randomized trial. Pediatrics 2003 Mar;111(3):503-510. [Medline]
- Bartholomew LK, Gold RS, Parcel GS, Czyzewski DI, Sockrider MM, Fernandez M, et al. Watch, Discover, Think, and Act: evaluation of computer-assisted instruction to improve asthma self-management in inner-city children. Patient Educ Couns 2000 Feb;39(2-3):269-280. [Medline]
- Homer C, Susskind O, Alpert HR, Owusu M, Schneider L, Rappaport LA, et al. An evaluation of an innovative multimedia educational software program for asthma management: report of a randomized, controlled trial. Pediatrics 2000 Jul;106(1 Pt 2):210-215. [Medline]
- Shegog R, Bartholomew LK, Parcel GS, Sockrider MM, Mâsse L, Abramson SL. Impact of a computer-assisted education program on factors related to asthma self-management behavior. J Am Med Inform Assoc 2001;8(1):49-61 [FREE Full text] [Medline]
- Huss K, Winkelstein M, Nanda J, Naumann PL, Sloand ED, Huss RW. Computer game for inner-city children does not improve asthma outcomes. J Pediatr Health Care 2003;17(2):72-78. [CrossRef] [Medline]
- McPherson AC, Glazebrook C, Forster D, James C, Smyth A. A randomized, controlled trial of an interactive educational computer package for children with asthma. Pediatrics 2006 Apr;117(4):1046-1054 [FREE Full text] [CrossRef] [Medline]
- Rubin DH, Leventhal JM, Sadock RT, Letovsky E, Schottland P, Clemente I, et al. Educational intervention by computer in childhood asthma: a randomized clinical trial testing the use of a new teaching intervention in childhood asthma. Pediatrics 1986 Jan;77(1):1-10. [Medline]
- Shames RS, Sharek P, Mayer M, Robinson TN, Hoyte EG, Gonzalez-Hensley F, et al. Effectiveness of a multicomponent self-management program in at-risk, school-aged children with asthma. Ann Allergy Asthma Immunol 2004 Jun;92(6):611-618. [CrossRef] [Medline]
- Vilozni D, Barker M, Jellouschek H, Heimann G, Blau H. An interactive computer-animated system (SpiroGame) facilitates spirometry in preschool children. Am J Respir Crit Care Med 2001 Dec 15;164(12):2200-2205. [CrossRef] [Medline]
- Chan DS, Callahan CW, Hatch-Pigott VB, Lawless A, Proffitt HL, Manning NE, et al. Internet-based home monitoring and education of children with asthma is comparable to ideal office-based care: results of a 1-year asthma in-home monitoring trial. Pediatrics 2007 Mar;119(3):569-578 [FREE Full text] [CrossRef] [Medline]
- Kamps AW. Unscheduled care for people with asthma in a multi-ethnic area is reduced following educational outreach programme by specialist nurses. Evidence-based Healthcare 2004 Aug;8(4):190-191. [CrossRef]
- Sundberg R, Tunsäter A, Palmqvist M, Ellbjär S, Löwhagen O, Torén K. A randomized controlled study of a computerized limited education program among young adults with asthma. Respir Med 2005 Mar;99(3):321-328. [CrossRef] [Medline]
- Huss K, Huss RW, Squire EN, Carpenter GB, Smith LJ, Salata K, et al. Computer education for asthmatics: what effects? J Nurs Care Qual 1992 Apr;6(3):57-66. [Medline]
- Huss K, Salerno M, Huss RW. Computer-assisted reinforcement of instruction: Effects on adherence in adult atopic asthmatics. Res Nurs Health 1991;14(4):259-267. [CrossRef]
- Huss K, Squire E, Carpenter GB, Smith LJ, Huss RW, Salata K, et al. Effective education of adults with asthma who are allergic to dust mites. J Allergy Clin Immunol 1992 Apr;89(4):836-843. [Medline]
- Higgins J, Altman D. Chapter 8: Assessing risk of bias in included studies. In: Higgins J, Green S, editors. Cochrane handbook for systematic reviews of interventions. Chichester, UK: John Wiley & Sons; 2008.
- Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
- Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci 2009;4:40 [FREE Full text] [CrossRef] [Medline]
- Pal K, Eastwood SV, Michie S, Farmer AJ, Barnard ML, Peacock R, et al. Computer-based diabetes self-management interventions for adults with type 2 diabetes mellitus. Cochrane Database Syst Rev 2013;3:CD008776. [CrossRef] [Medline]
- Aalbers T, Baars MA, Rikkert MG. Characteristics of effective Internet-mediated interventions to change lifestyle in people aged 50 and older: a systematic review. Ageing Res Rev 2011 Sep;10(4):487-497. [CrossRef] [Medline]
- Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010;12(1):e4 [FREE Full text] [CrossRef] [Medline]
- Wieland LS, Falzon L, Sciamanna CN, Trudeau KJ, Brodney S, Schwartz JE, et al. Interactive computer-based interventions for weight loss or weight maintenance in overweight or obese people. Cochrane Database Syst Rev 2012;8:CD007675. [CrossRef] [Medline]
- Smith V, Devane D, Begley CM, Clarke M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions. BMC Med Res Methodol 2011;11(1):15 [FREE Full text] [CrossRef] [Medline]
|AMSTAR: A Measurement Tool to Assess Systematic Reviews|
|ACQ: Asthma Control Questionnaire|
|AQLQ: Asthma Quality of Life Questionnaire|
|BCT: behavior change techniques|
|ED: emergency department|
|FEV1: forced expiratory volume in 1 second|
|OR: odds ratio|
|PEF: peak expiratory flow rate|
|PICOS: participants, interventions, comparison, outcomes, study design|
|RCT: randomized controlled trial|
|SMD: standardized mean difference|
Edited by G Eysenbach; submitted 02.07.13; peer-reviewed by J Shepard, M Belisario; comments to author 18.09.13; revised version received 18.11.13; accepted 12.12.13; published 18.02.14
©Deborah Morrison, Sally Wyke, Karolina Agur, Euan J Cameron, Robert I Docking, Alison M MacKenzie, Alex McConnachie, Vandana Raghuvir, Neil C Thomson, Frances S Mair. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 18.02.2014.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.