Published on 26.07.12 in Vol 14, No 4 (2012): Jul-Aug
The Effects of Combining Web-Based eHealth With Telephone Nurse Case Management for Pediatric Asthma Control: A Randomized Controlled Trial
Background: Asthma is the most common pediatric illness in the United States, burdening low-income and minority families disproportionately and contributing to high health care costs. Clinic-based asthma education and telephone case management have had mixed results on asthma control, as have eHealth programs and online games.
Objectives: To test the effects of (1) CHESS+CM, a system for parents and children ages 4–12 years with poorly controlled asthma, on asthma control and medication adherence, and (2) competence, self-efficacy, and social support as mediators. CHESS+CM included a fully automated eHealth component (Comprehensive Health Enhancement Support System [CHESS]) plus monthly nurse case management (CM) via phone. CHESS, based on self-determination theory, was designed to improve competence, social support, and intrinsic motivation of parents and children.
Methods: We identified eligible parent–child dyads from files of managed care organizations in Madison and Milwaukee, Wisconsin, USA, sent them recruitment letters, and randomly assigned them (unblinded) to a control group of treatment as usual plus asthma information or to CHESS+CM. Asthma control was measured by the Asthma Control Questionnaire (ACQ) and self-reported symptom-free days. Medication adherence was a composite of pharmacy refill data and medication taking. Social support, information competence, and self-efficacy were self-assessed in questionnaires. All data were collected at 0, 3, 6, 9, and 12 months. Asthma diaries kept during a 3-week run-in period before randomization provided baseline data.
Results: Of 305 parent–child dyads enrolled, 301 were randomly assigned, 153 to the control group and 148 to CHESS+CM. Most parents were female (283/301, 94%), African American (150/301, 49.8%), and had a low income as indicated by child’s Medicaid status (154/301, 51.2%); 146 (48.5%) were single and 96 of 301 (31.9%) had a high school education or less. Completion rates were 127 of 153 control group dyads (83.0%) and 132 of 148 CHESS+CM group dyads (89.2%). CHESS+CM group children had significantly better asthma control on the ACQ (d = –0.31, 95% confidence limits [CL] –0.56, –0.06, P = .011), but not as measured by symptom-free days (d = 0.18, 95% CL –0.88, 1.60, P = 1.00). The composite adherence scores did not differ significantly between groups (d = 1.48%, 95% CL –8.15, 11.11, P = .76). Social support was a significant mediator for CHESS+CM’s effect on asthma control (alpha = .200, P = .01; beta = .210, P = .03). Self-efficacy was not significant (alpha = .080, P = .14; beta = .476, P = .01); neither was information competence (alpha = .079, P = .09; beta = .063, P = .64).
Conclusions: Integrating telephone case management with eHealth benefited pediatric asthma control, though not medication adherence. Improved methods of measuring medication adherence are needed. Social support appears to be more effective than information in improving pediatric asthma control.
Trial Registration: Clinicaltrials.gov NCT00214383; http://clinicaltrials.gov/ct2/show/NCT00214383 (Archived by WebCite at http://www.webcitation.org/68OVwqMPz)
J Med Internet Res 2012;14(4):e101)
- asthma information;
- childhood disease;
- case management;
- patient education;
- social support
Asthma and other chronic diseases pose a great risk as the United States attempts to decrease its health care costs. Research suggests that the active ingredients of chronic disease management include long duration [, ], assertive outreach [ ], monitoring [ - ], prompts [ - ], action planning [ - ], case management [ - ], and peer [ - ] and family [ - ] support. All of these can potentially be provided by information and computer-based technologies and sensors.
Poor control of pediatric asthma affects low-income and minority children disproportionately and contributes to more than 14 million lost school days and 3 million lost parental workdays per year . Daily controller medications can manage even severe asthma [ ], but adherence is low, especially for the underserved [ ]. Asthma education programs, with their low participation rates, have had mixed results [ ]. Nurse case management can reduce asthma-related emergency care and hospitalization costs, but it is expensive [ , ]. Child-focused, Web-based asthma education and games (eHealth) have improved knowledge, asthma control, and medication adherence in the short run [ - ]. However, parents tend to overestimate their child’s medication-taking skills and actual adherence [ ]. This suggests that parental involvement might be beneficial for managing pediatric asthma. Integrating phone-based clinician care into asthma eHealth programs for adults has shown significant promise in behavioral and asthma outcomes [ ]. Interventions such as CHESS+CM, based on self-determination theory [ ] and self-efficacy [ ], provide information, social support, and skill-building tools for self-managing the disease. These interventions, which aim to increase confidence, competence, relatedness, and autonomous motivation, have been used successfully in asthma education programs [ , , , ]. However, the factors associated with these theories have not been tested for their mediational effects on adherence to controller medications or asthma control. Understanding this is important for developing an asthma eHealth system that balances the various functions—information, social support, and skill building—to the best effect for children and their parents.
We, therefore, hypothesized that a parent-focused intervention that integrates monthly telephone nurse case management with a comprehensive, interactive asthma eHealth program could improve asthma control and medication adherence. We surmised that these effects would be mediated by social support, self-efficacy, and asthma information competence. This paper reports the results of a randomized controlled trial funded by the US National Institute of Nursing Research.
The year-long intervention called CHESS+CM consisted of an eHealth program, Comprehensive Health Enhancement Support System (CHESS), and a monthly telephone call to the parent from an asthma nurse case manager (CM). CHESS is an umbrella name for several eHealth systems developed and tested for the past 25 years at the University of Wisconsin-Madison. CHESS modules provide information, adherence strategies, decision-making tools, and support services in attractive, easy-to-use formats. The most important strength of CHESS modules may be the closed, guided universe of tailored information and support in an integrated package with efficient navigation, eliminating the need for complicated search and discovery. In randomized efficacy trials, CHESS modules significantly improved quality of life and self-efficacy for women with breast cancer versus control and Internet groups, and quality of life and costs of care in people infected with the human immunodeficiency virus [, ]. CHESS programs also have demonstrated the effectiveness of using self-determination and self-efficacy theories to improve information competence, health care participation, and social support among cancer patients [ , ]. The CHESS module used in this study was designed specifically for asthma.
The project was carried out with a University of Wisconsin-based team of educators, pharmacists, and nurse practitioners specializing in asthma rather than with staff from the five managed care organizations (MCOs) from which participants were recruited. University of Wisconsin-based nurse practitioners also monitored the progress of recruitment. The project director monitored the discussion group within CHESS to ensure that calls for help were rapidly addressed and that inaccurate information was not shared. The full trial protocol is available at http://www.webcitation.org/69E2cXZbo.
Asshows, CHESS for asthma had three audiences: parents, children, and case managers. Parents received comprehensive information based on the National Asthma Education and Prevention Program guidelines [ , , ], a peer discussion group, case manager email, and the Asthma Coach, which assesses the child’s asthma and the parent’s and child’s well-being. CHESS provided tailored feedback and links to salient CHESS content and other interactive tools. Children received simplified information in game and audiovisual formats, as well as social support via a peer discussion group and personal stories. No major bug fixes or downtimes occurred. Asthma-related content was updated annually over the course of the study. Otherwise, no major modifications were made to the system. No significant secular events took place during the study period.
The case manager received tools to schedule monthly phone calls with the parent, view parents’ Asthma Coach entries, enter phone call notes, and send and receive case management mail to and from the parent, as well as a “prescription pad” to place CHESS resources on the parent’s home page . Monthly case management calls to the parent assessed the child’s asthma, medication adherence, and psychosocial challenges, and provided relevant education and support. On completing a call, the case manager entered notes in the case management toolbox and then sent the parent a summary via case manager email with links to salient CHESS resources, which appeared on the parents’ CHESS home page, as shown in [ ]. These features were designed with user input for content and usability. For a more complete description of the CHESS asthma module and its development, see Wise et al [ ]. The module is available at https://chess.wisc.edu/asthmamobile/. The code name is uwmadison and the password is testing. Screenshots of the program are available on request.
Invitation and Recruitment
Eligible participants were parents or other adults functioning as parents, such as grandmothers, who were able to read at a sixth-grade level and had children ages 4–12 years with a diagnosis of asthma (International Classification of Diseases, 9th revision code 493) or wheezing (code 786.07); a prescribed asthma controller medication; and poor medication adherence, defined as having missed more than one medication refill or having an emergency department visit or hospitalization because of poor asthma control. Originally children were identified through the health care utilization and pharmacy claim databases at four MCOs (MCOs 1–4) and the Wisconsin Medicaid Program from one urban–rural county (Dane County, which is also the home of the University of Wisconsin-Madison) and seven surrounding rural counties (Columbia, Dodge, Green, Iowa, Jefferson, Rock, and Sauk). MCO 5 in Milwaukee was added after it became clear that MCOs 1–4 could not produce enough participants with poorly controlled asthma. MCO 5 served an entirely Medicaid population in Milwaukee County and had the state’s highest rates of asthma-related emergency department visits and overnight hospital stays .
All research materials and procedures were approved by the University of Wisconsin’s Health Sciences Review Board, as well as by the ethics and review boards for each of the five MCOs. Recruitment was initiated by a letter from the MCO or Wisconsin Medicaid Program to parents of study-eligible patients with an opt-in or an opt-out card regarding a phone call from the study nurse, depending on the organization’s institutional review board policies . Recruiters screened for eligibility, described the study (as a comparison of two approaches to asthma control) and its risks and benefits, and scheduled an intake interview for people who agreed to participate.
The study had four key risks. (1) The key risk for participants was the possibility of their replacing effective medical care with unproven treatments. To reduce this risk, each survey asked whether parts of the child’s medical treatment had been abandoned against medical advice. In addition, we scanned discussion group entries in CHESS. If we found indications of abandonment, we contacted parents to express our concern about potential risks. (2) Participants’ misinterpreting information in CHESS posed another risk. The information was presented at a sixth-grade reading level and screened by asthma experts to reduce this risk. Disclaimers also cautioned that the computer is not a substitute for seeking medical attention and that comments in the social media may not be factual. (3) To reduce the risk of anonymity being breached, participants were assigned a blind code number. All data had names removed and code numbers attached. (4) Participants’ divulging confidential information was another risk in the study. We frequently warned users about this, and we used digital signatures to warn users if CHESS was altered.
Parents and children participated in a prerandomization intake appointment with a study case manager at asthma clinics associated with MCOs 1–4 and, in MCO 5, at a community center. The study team traveled twice a month to the community center to conduct intakes after school and into the early evening . At all locations, childcare, snacks, and transportation were provided as needed. Parents were asked to bring the child’s medications to the intake interviews. Intakes lasted 45–90 minutes. Potential participants were informed of (1) the nature and purpose of the study, (2) the financial compensation offered (US $35 for completing each of four surveys and providing 2 spirometry readings), (3) the types of data to be collected from claims records, surveys, and computer-use tracking, (4) the intervention to be given to the experimental group, (5) the nature and reasons for random assignment, (6) the measures used to insure the confidentiality of data collected, (7) the timeline of the study, (8) the duration of the study (12 months, to capture the seasonality of asthma), and (9) the University of Wisconsin-Madison being the research organization for the project. Consent was documented by obtaining signed, institutional review board-approved consent forms containing all of the above information. The consent forms were kept in a locked file at CHESS. Intake appointments assessed parental ability to read at a sixth-grade level by asking parents to read aloud the consent letter. The appointments also included recording medications and doses, a spirometry test, and the child’s asthma history. A researcher administered a pretest survey with training on completing the asthma diary and provided individualized asthma education as needed. Regardless of study arm, case managers notified MCO staff about children with uncontrolled asthma for further evaluation.
Researchers at the University of Wisconsin generated the random allocation sequence. Nurses conducting consent, assent, and pretests were given sequentially numbered envelopes containing the random assignment for each participants. It was not possible to blind participants or outcome assessors. We did blind those analyzing the data.
Participants were equally randomized according to their MCO and then blocked by severity and by Medicaid status. Randomization occurred upon receipt of the run in diaries for MCO 1-4 subject and after just the intake for MCO 5 participants . The CHESS+CM group received a 45-minute training session. Laptop computers, land phone lines, and Internet service were provided, as needed. MCOs 1–4 and Wisconsin Medicaid Program participants received one-on-one training at home on an Internet-enabled computer with the live CHESS program. MCO 5 participants received group training at the community center where they had had their intake interview. Because that center lacked Internet access and most participants borrowed study laptops, training on using the laptop and CHESS was guided by an interactive compact disc. All users were instructed to use CHESS whenever they wished. No minimum expectations were placed on users.
All participants, regardless of study condition, received a call from the project manager 1 week after randomization to see how things were going. They also received with their mailed surveys at 3, 6, 9, and 12 months a packet of educational materials about asthma control, child development, parenting, and community resources. Parents and children returned to the clinic or community center for an exit interview that included taking the same measures used at the intake appointment. Exit interviews were conducted at home for 40 difficult-to-reach MCO 5 parents.
Asthma control was measured via two self-reports collected at baseline and at 3, 6, 9, and 12 months. Juniper and colleagues’ Asthma Control Questionnaire (ACQ) was administered orally at the intake and exit interviews and self-administered via mailed surveys at the intervening time points . This well-validated, 6-item, 7-point Likert scale measured daytime and nocturnal symptoms, missed school, and rescue medication use over the previous 7 days [ ]. Lower scores indicated better asthma control. Scales were created as a mean of all items. Surveys with missing ACQ items were not calculated and counted as missing data. Symptom-free days were calculated from 2-week diaries as the absence of asthma-related nighttime awakenings, daytime symptoms, bronchodilator use, unscheduled physician visits, or school absences [ ]. The study included a run-in period of 3 weeks before randomization during which participants kept asthma diaries that were used to collect baseline data on symptom-free days.
Adherence to asthma controller medications was measured as the mean composite score from self-reported 2-week asthma diaries at baseline and 3, 6, 9, and 12 months . The ratio of medication to possession was calculated from MCO and Wisconsin Medicaid Program pharmacy claims data as the actual versus expected prescription refill rate for each participant’s prescription.
Social support, self-efficacy, and information competence were adapted from 5-point Likert scales used successfully in prior CHESS studies . The 6-item social-support scale assessed the availability and reliability of social, emotional, and instrumental support. The 6-item self-efficacy scale assessed asthma problem-solving skills and strategies, along with perceived competence, goal attainment, and comparison with others’ skills. The 4-item information competence scale assessed parents’ understanding of asthma information needs, difficulty in obtaining such information, satisfaction with their strategies, and level of control using the information. Scales were created as a mean of all items. If more than 1 item was missing, the scale score was not computed.
Our study was powered based on an expected 320 dyads completing the trial; 259 completed the study. We anticipated a dropout rate of 20% but had a rate of 14% (42/301).
Descriptive statistics established baseline characteristics for the CHESS+CM and control groups and for participants with missing data. We used 1-way analysis of variance to compare differences between the CHESS+CM and control groups and between dropouts and those who completed the study. For missing 3-, 6-, 9-, and 12-month posttest data, we used a general linear model procedure to test for equality of mean scores meeting the baseline criteria followed by a 1-way analysis of variance to determine the P value for the general linear model. Scores for outcome variables with no significant mean differences between 3, 6, 9, and 12 months were averaged to create a score for the entire intervention time .
Main outcomes were an intent-to-treat analysis with a repeated-measures, mixed model to account for the correlation between the five time points within participants, and to analyze the differences between the time points and baseline within and between the control and CHESS+CM groups. A Bonferroni adjustment for multiple comparisons yielded adjusted P values and confidence limits for mean estimates within each set of comparisons at the four time periods. Finding no significant differences, we averaged participants’ 3-, 6-, 9-, and 12-month data to create a score for the whole intervention time following the procedure described above. Comparisons of the change from baseline were made over the average of all posttest time points within the CHESS+CM group and the control group and between the two groups.
A multiple regression model, as described by MacKinnon , was used to analyze mediators for outcome variables that showed significant difference between the CHESS+CM and control groups.
Step 1 determined significant covariates by loading candidate variables for their premediated effects of the intervention tau on the outcome variable. Covariates included the outcome variable’s pretest score, Medicaid status, age, time since diagnosis, and asthma severity, as well as the parent’s age and education level and whether help with parenting was available from another adult. Covariates in step 2 included the pretest scores for the outcome and mediator variables and any significant covariate.
Step 2 used a multiple regression model for each mediator, whereby alpha = CHESS+CM’s effect on the mediator, beta = mediator’s effect on the dependent variable, and tau1 = CHESS+CM’s effect on the dependent variable after the mediational test.
Recruitment and Enrollment
Asshows, a total of 1988 invitation letters were mailed, 702 recruitment or eligibility screening calls were completed, and 305 parent–child dyads enrolled in the study. The enrollees accounted for 15.34% of the 1988 letters sent and 43.5% of the 702 completed phone calls. Data were collected from August 2, 2004 through August 16, 2007.
Reasons for nonenrollment were unable to be reached by phone, not eligible, did not have moderate to severe asthma, and too busy. Up to 3 did not come for their scheduled intake appointments. A total of 4 dyads dropped out after the intake but before randomization; thus, 301 were randomly assigned: 153 to the control group and 148 to the CHESS+CM group. Finally, 259 dyads (86.1%) completed the study. After randomization, 42 dropped out: 26 (17%) from the control group and 16 (11%) from the CHESS+CM group. The between-group dropout rate was not significant (P = .12). However, participants who dropped out were significantly less likely to be white or married, and more likely to be significantly younger, have lower asthma quality of life, and have less education. Children of dropouts had no significant differences in baseline ACQ scores, but had significantly lower pharmacy refill rates and more asthma-related school absences.
Response Rates and Data Availability
Available data rates, shown in, were highest for self-reported data at baseline and 12 months, which involved direct interaction with a researcher. For example, the ACQ response rate was 98.7% at baseline and 82.7% at 12 months, but 58.1%, 52.8%, and 49.5% at the intervening time points. Missing pharmacy refill data, however, were highest at 12 months.
Baseline Characteristics of Control and Intervention Groups
shows no significant differences at baseline between the control and CHESS+CM groups for demographics, asthma status, Web use, or the mean outcome and mediator scores.
Intervention Effects on Main Outcomes
shows the mean difference in scores for the outcome variables between baseline and the mean scores measured at 3, 6, 9, and 12 months for the control group, the CHESS+CM group, and the difference between the CHESS+CM and the control group.
Symptom-free days as measured from asthma diaries improved significantly for the CHESS+CM group (odds ratio 1.38, P = .01) and less so for the control group (odds ratio 1.20, P = .29), but there were no significant between-group differences (odds ratio 0.18, P = 1.00). Asthma control as measured on the ACQ improved significantly for CHESS+CM (–0.42 on a 7-point Likert scale with lower scores indicating better control, P = .001) and not significantly for the control group (–0.11, P = .22). The between-group difference (–0.31) was significant (P = .01). The composite medication adherence score did not change significantly either within group or between the groups, with a 0.58% increase (P = .87) for the control group and 2.06% increase (P = .55) for the CHESS+CM group, and a 1.48% between-group difference (P = .76). Both groups reported declining adherence from diaries and had significant improvements in medication refills.
Mechanisms of CHESS+CM Effect on Asthma Control
shows the prespecified secondary mediational analyses. Part a, which shows the premediated effect of CHESS+CM on the ACQ with all covariates entered into the model, was significant at tau = –.22, P = .03. Only Medicaid was a significant covariate. Therefore, we entered three covariates into each mediator model: Medicaid, pretest score from the ACQ, and mediator.
part b shows that CHESS+CM had a significant effect on social support at alpha = .200, P = .01, and social support had a significant effect on ACQ at beta = .210, P = .03. After mediation, the CHESS+CM effect on ACQ was no longer significant at tau1 = –.174; P = .09, as hypothesized.
part c shows that CHESS+CM had a positive but nonsignificant effect on self-efficacy at alpha = .080, P = .14. Self-efficacy had a significant effect on ACQ at beta = .476, P = .01. After mediation, CHESS+CM no longer had a significant effect on ACQ at tau1 = –.182, P = .07.
part d shows that CHESS+CM had a marginally significant positive effect on information competence at alpha = .079, P = .09; information competence had a positive but nonsignificant effect on ACQ at beta = .063, P = .64. After the mediational analysis, CHESS+CM’s effect on ACQ remained significant at tau1 = –.235; P = .02. Information competence, therefore, was not a significant mediator.
In sum, only social support was the only significant mediator for CHESS+CM’s effect on asthma control.
and present the number of logins, pages viewed, and time spent on the site. is based on the total number of potential users (146); is based on the number of actual users during each month of access. shows the percentage of potential users that actually used CHESS each month. shows a sharp drop-off from the first to the second month and then small declines in most other months. The same can be said for the extent of use. In the last month, usage rates moved up again, possibly because participants knew that the study was coming to an end. This may have led people to employ their last opportunity to use CHESS or it may reflect users wanting to prepare for the exit interview.
Summary of Primary Outcomes
We report on a randomized controlled trial that integrated an asthma eHealth program called CHESS with case management from a monthly telephone call from an asthma nurse. The study enrolled 305 parent–child dyads and randomized 301 dyads. Half of our sample were African American and had a low income. Despite the digital divide, the intervention showed significant improvement on pediatric asthma control when measured by the ACQ, but not when measured as symptom-free days from asthma diaries. The intervention did not have a significant effect on adherence to asthma controller medications. Pharmacy refill rates improved for both groups, yet self-reported adherence declined in both groups. Social support mediated CHESS+CM’s effect on the ACQ. Despite positive trends, we found no significant effects for self-efficacy or information competence. Still, the study has important implications because of its focus on (1) low-income, high-risk populations (often African American), (2) an integrated system of nurse case management and eHealth, and (3) mediation analysis to identify the mechanisms of the effect of eHealth systems.
Mediational Effects of Social Support Versus Information
Of the three mediational analyses, social support was the only factor that significantly mediated the CHESS+CM effect on asthma control. CHESS+CM had a marginally significant impact on information competence (P = .09), but information competence had no impact on asthma control (P = .64). Conversely, CHESS+CM had a nonsignificant but promising trend (P = .14) toward improving self-efficacy. The trend was strongly associated with improvements in asthma control (P = .01).
These mediational analyses raise an intriguing question about the relative contribution of social support and information in pediatric asthma management and, as a result, the relative effort that should be spent in developing eHealth technologies, at least for asthma. CHESS+CM’s modest improvements in information competence but lack of mediational effect for the ACQ may result from an insensitive measure or inadequate presentation of information about or the nature of asthma care, or may indicate that knowledge may not be as important as motivation. On the other hand, an exploratory study of a Web portal for pediatric diabetes patients and their parents reported that users put great value on obtaining information from the site . It might be that, for this largely low-income and minority sample of parents, communicating specific asthma information by phone and case manager email with trusted, caring case managers is a more effective way to encourage asthma management than is reading information in the CHESS program. While these results may not hold for other chronic diseases, we encourage future researchers to consider the relative effects of social support and health information, and possible ways to deliver health information in a supportive manner. Interventions themselves may benefit from being simplified, leading to a more extensive adoption and use of eHealth systems.
Challenges of Measuring Medication Adherence
These results confirm other study results that show asthma diary data are unreliable because of lapses in daily record keeping and overreporting of adherence . The self-reported decline in adherence over time in both groups, however, is puzzling and raises questions about whether participation in the study encouraged more candid responses. This might be interpreted as increasing levels of realistic self-evaluation. Missing data about pharmacy refills were high and may stem from administrative errors and a highly mobile Medicaid population. This research might have benefited from the use of electronic medication measurement devices [ ], but these are costly, allow for dumping doses, and may augment adherence and thus reduce generalizability [ ].
Somewhat surprising was the control group’s significant and sustained improvements in refilling asthma controller medications. Control group placebo effects are widely recognized, but primarily for double-blind medication trials rather than health education interventions. Notably, our control group received a welcoming and thorough nurse-led, hour-long intake that was, for many parents and children, their first asthma-focused clinical appointment. This intake included an assessment of the child’s asthma and parent’s well-being, asthma education as needed, and a warm handoff rather than a referral to follow-up care. Control group participants also received four quarterly mailings with seasonally tailored asthma information, as well as parenting and community resources .
In a routine application setting, the case managers would have been employed by the MCO (possibly making our results more optimistic) and the control group would not have received the extensive attention provided in this study (possibly making our results more conservative).
Participants in this eHealth trial were not blinded. This research examined several outcomes of interest (asthma control, symptom-free days, and medication adherence), thus increasing the risk for a type I error. While we did use a Bonferroni correction, we did not use such a correction in the mediation analysis. We do not report analyses comparing users with nonusers of CHESS. Doing so would have increased the length of an already complex paper, shifted attention away from the primary analyses, and introduced substantial biases in research reporting. Finally, eligibility requirements and informed consent limited generalizability of the results. Specifically, we required a level of literacy beyond that possessed by many low-income people.
When this study was initiated, smartphones were just becoming powerful vehicles for change. If we were to do this study over today, we would make several changes. We would use global positioning system tracking to identify when the child entered a prespecified high-risk location, such as a smoker’s home. We would install more reminders to both parents and children. Our social media would have included a service in which parents could exchange tips on how best to promote adherence. We would have added a panic button and services to offer help if a child entered an asthma attack. We would have explored the addition of other sensors, such as a peak flowmeter attached to the smartphone. In a second study, we would compare CHESS alone versus CHESS+CM versus control.
Comparison with Prior Work
A 2011 Cochrane review of 21 randomized studies found that asthma telehealth care interventions did not show a clinically significant improvement in patients’ quality of life or in the number of emergency department visits, but did show a significant reduction in the number of asthma-related hospitalizations . Most interventions used telephones, and none combined telephone case management with self-guided Web-based education—and none measured the effects on asthma control. Like other pediatric asthma intervention studies with samples, the authors noted that an “active” control group may have reduced the effects on the primary outcomes [ ]. Other interventions have improved pediatric asthma outcomes and cognitive learning processes [ , ]. An interactive game that improved children’s asthma knowledge, self-management, and clinical outcomes did not significantly improve self-efficacy but found higher scores correlated with better self-management [ ]. A school-based intervention improved asthma self-efficacy, knowledge, and asthma management activities as outcomes, but not asthma control [ ]. An eHealth program improved asthma knowledge, which correlated with reduced use of rescue medicine and emergency department visits [ ]. However, this is the first study to our knowledge that tested the mediational effects of cognitive learning factors on asthma control.
Similarly to the present study, others have found significant effects from brief asthma educational interventions analogous to our active control condition. A single, brief pediatric asthma educational intervention improved asthma outcomes—at least in the short term . An evaluation of self-management support provided by in-home community health workers compared with an active control of three clinic-based pediatric asthma nurse education sessions found modest significant improvements in symptom-free days [ ].
This is one of very few eHealth studies that have shown an effect on pediatric asthma caregivers. This is significant because it confirms the family’s critical role in disease management .
Conclusion and Implications for Further Research
CHESS+CM provided information, social support, and interactive tools to help parents overcome barriers to managing their child’s asthma, and secondarily to help the child participate in his or her asthma management . The present study, however, could not identify whether the relative impact of the CHESS eHealth program or monthly phone conversations with the case manager affected these outcomes. Further analyses are needed to identify the specific effects for the separate components of CHESS and case management for different participant profiles and to provide important clues about how asthma education can be tailored better to meet the complex needs of managing pediatric asthma within the family context.
From an eHealth development perspective, more research is needed into the conditions under which it makes sense to invest heavily in various aspects of disease management , such as information versus social support. In the present study, the case manager provided asthma information in a supportive and encouraging manner during the monthly phone call—perhaps conflating the relative contribution of information and social support in improving asthma control. In sum, continuous condition-specific and population-specific research and refinement are needed to develop and implement effective eHealth programs.
Finally, information and communication technologies like the one used here might be cost beneficial in disease management . Efficacy studies of information and communication technologies in chronic disease self-management are promising [ , ]. People with addictions tend to view information and communication technologies favorably [ ]. They acknowledge more drug use and psychiatric symptoms online than in face-to-face interviews [ ]. Computerized screening and brief interventions have been shown to reduce problem drinking [ - ]. A recent review [ ] found positive outcomes in 29 of 32 randomized trials of personal computer interventions offering a single service, such as texting and giving reminders, for various chronic diseases. Randomized controlled trials of smartphone systems are just beginning to appear.
The authors wish to acknowledge the following: National Institute of Nursing Research (Grant 5R01 NR007889-03) for funding; The University of Wisconsin-Madison GCRC (Grant 3-1145-01) for clinical space to conduct intake interviews; Dean Health Plan, Physicians Plus Insurance Corporation, Group Health Cooperative, Unity Health Insurance, Managed Health Services, and the Wisconsin Medicaid Program for identifying and screening eligible participants. We thank Robert Lemanske, MD, Marcus Cohen, MD, and Donald Bukstein, MD, for reviewing the CHESS asthma program and enlisting the case managers, and Christine Sorkness, PhD, for reviewing the CHESS asthma module content. We thank Pam Richardson, RN, Sally Hollman, BS, RN, Rhonda Christenson, RN, Amy McCullough, DOM PC, and Elisha Terre, BA, for conducting the recruitment, intakes, and monthly telephone case management. Thanks to Eunkyung Kim, MS, for assistance with data analysis, and Andrea Gianopolis, BA, Maureen Fitzgerald, BA, Roberta Johnson, MA, MEd, and Amanda Dinauer, BA, for editorial and bibliographical assistance.
Study protocols were approved by the University of Wisconsin Health Sciences Institutional Review Board on March 9, 2004. The clinical trial registry number for Internet Telehealth for Pediatric Asthma Case Management (CHESS) is NCT00214383.
Funding: National Institute for Nursing Research 5R01 NR007889-03.
David H Gustafson, PhD, as the Principal Investigator, framed the study hypotheses and design and guided the overall development and implementation of the CHESS+CM intervention. For this paper, Dr Gustafson guided the preparation, framed the interpretation of the findings, played a significant role in writing, and approved the final version.
Meg Wise, MLS, PhD, as the project director in years 1 and 2, led the development of the intervention and study tools and as co-investigator in subsequent years coordinated the data analysis team and conducted the descriptive and 1-way analyses of variance. For this paper, Dr Wise played a significant role in writing, reviewing the literature, and coordinating the analysis.
Abhik Bhattacharya, PhD, as the biostatistician, developed the blocking procedures for randomization and managed and analyzed the data. For this paper, Dr Bhattacharya wrote sections on missing data and contributed to sections on the main outcomes. He carefully reviewed all the tables and text for this paper and approved the final version.
Alice D Pulvermacher, MS, as project director in years 3–5, managed the acquisition of data and the implementation of the project, and contributed to refining the implementation design. For this paper, Ms Pulvermacher reviewed drafts and approved the final version.
Kathleen K Shanovich, BSN, MS, as the lead asthma nurse case manager, contributed significantly to the CHESS content development and supervised the intake and exit interview processes and telephone case management during the study implementation. For this paper, Ms Shanovich reviewed drafts and approved the final version.
Brenda R Phillips, MS, conducted the analyses for symptom-free days from the asthma diary data. For this paper, Ms Phillips contributed to and reviewed the statistical methods and results sections, and reviewed and approved the final version.
Erik B Lehman, MS, conducted the statistical analyses for the Asthma Control Questionnaire and medication adherence. For this paper, Mr Lehman contributed to and reviewed the statistical methods and results sections, and reviewed and approved the final version.
Vernon M Chinchilli, PhD, developed, designed, and supervised the analyses for all primary outcome variables. For this paper, Dr Chinchilli contributed to and reviewed the statistical methods and results sections and reviewed and approved the final version.
RobertP Hawkins, PhD, as a co-investigator, contributed to the design of the research protocols and CHESS program content and to data analysis and interpretation. For this paper, Dr Hawkins provided substantive comments and approved the final version.
Jee-Seon Kim, PhD, designed and conducted the mediational analyses. For this paper, Dr Kim wrote the methods and results sections and developed the figures related to the mediational analyses.
Conflicts of Interest
The authors have no financial interests in the eHealth system evaluated here, although Gustafson, Wise, and Hawkins were lead members of the development team.
Multimedia Appendix 1
CONSORT eHealth checklist V1.6 [PDF File (Adobe PDF File), 467KB ].
- McKay JR, Van Horn DH, Oslin DW, Lynch KG, Ivey M, Ward K, et al. A randomized trial of extended telephone-based continuing care for alcohol dependence: within-treatment substance use outcomes. J Consult Clin Psychol 2010 Dec;78(6):912-923. [CrossRef] [Medline]
- Maisto SA, Zywiak WH, Connors GJ. Course of functioning 1 year following admission for treatment of alcohol use disorders. Addict Behav 2006 Jan;31(1):69-79. [CrossRef] [Medline]
- Godley MD, Godley SH, Dennis ML, Funk R, Passetti LL. Preliminary outcomes from the assertive continuing care experiment for adolescents discharged from residential treatment. J Subst Abuse Treat 2002 Jul;23(1):21-32. [Medline]
- Scherr D, Kastner P, Kollmann A, Hallas A, Auer J, Krappinger H, MOBITEL Investigators. Effect of home-based telemonitoring using mobile phone technology on the outcome of heart failure patients after an episode of acute decompensation: randomized controlled trial. J Med Internet Res 2009 Aug;11(3):e34 [FREE Full text] [CrossRef] [Medline]
- Noh JH, Cho YJ, Nam HW, Kim JH, Kim DJ, Yoo HS, et al. Web-based comprehensive information system for self-management of diabetes mellitus. Diabetes Technol Ther 2010 May;12(5):333-337. [CrossRef] [Medline]
- Helzer JE, Badger GJ, Rose GL, Mongeon JA, Searles JS. Decline in alcohol consumption during two years of daily reporting. J Stud Alcohol 2002 Sep;63(5):551-558. [Medline]
- Davis JR, Glaros AG. Relapse prevention and smoking cessation. Addict Behav 1986;11(2):105-114. [Medline]
- Larimer ME, Palmer RS, Marlatt GA. Relapse prevention. An overview of Marlatt's cognitive-behavioral model. Alcohol Res Health 1999;23(2):151-160. [Medline]
- Seale JP, Shellenberger S, Velasquez MM, Boltri JM, Okosun I, Guyinn M, et al. Impact of vital signs screening & clinician prompting on alcohol and tobacco screening and intervention rates: a pre-post intervention comparison. BMC Fam Pract 2010 Mar;11:18 [FREE Full text] [CrossRef] [Medline]
- Witkiewitz KA, Marlatt GA. High-risk situations: relapse as a dynamic process. In: Witkiewitz K, Marlatt G, editors. Therapist’s Guide to Evidence-Based Relapse Prevention. Amsterdam: Elsevier Academic Press; 2007:19-33.
- van Osch L, Lechner L, Reubsaet A, Wigger S, de Vries H. Relapse prevention in a national smoking cessation contest: effects of coping planning. Br J Health Psychol 2008 Sep;13(Pt 3):525-535. [CrossRef] [Medline]
- Washton AM. Cocaine Addiction: Treatment, Recovery, and Relapse Prevention. New York, NY: WW Norton & Company; 1991.
- Sullivan, WP, Wolk JL, Hartmann DJ. Case management in alcohol and drug treatment: improving client outcomes. Fam Soc 1992;73(4):195-204. [CrossRef]
- Dennis M, Scott CK, Funk R. An experimental evaluation of recovery management check-ups (RMC) for people with chronic substance use disorders. Eval Program Plann 2003 Aug;26(3):339-352.
- McLellan AT, Hagan TA, Levine M, Meyers K, Gould F, Bencivengo M, et al. Does clinical case management improve outpatient addiction treatment. Drug Alcohol Depend 1999 Jun 1;55(1-2):91-103. [Medline]
- Lorig KR, Ritter PL, Laurent DD, Fries JF. Long-term randomized controlled trials of tailored-print and small-group arthritis self-management interventions. Med Care 2004 Apr;42(4):346-354. [Medline]
- Rapp RC, Siegal HA, Fisher JH. A strengths-based model of case management/advocacy: adapting a mental health model to practice work with persons who have substance abuse problems. NIDA Res Monogr 1992;127:79-91. [Medline]
- Shaw BR, Jeong Yeob H, Hawkins RP, McTavish FM, Gustafson DH. Communicating about self and others within an online support group for women with breast cancer and subsequent outcomes. J Health Psychol 2008 Oct;13(7):930-939. [CrossRef] [Medline]
- Palermo TM, Wilson AC, Peters M, Lewandowski A, Somhegyi H. Randomized controlled trial of an Internet-delivered family cognitive-behavioral therapy intervention for children and adolescents with chronic pain. Pain 2009 Nov;146(1-2):205-213. [CrossRef] [Medline]
- DuBenske LL, Gustafson DH, Shaw BR, Cleary JF. Web-based cancer communication and decision making systems: connecting patients, caregivers, and clinicians for improved health outcomes. Med Decis Making 2010 Dec;30(6):732-744. [CrossRef] [Medline]
- Wise M, Gustafson DH, Sorkness CA, Molfenter T, Staresinic A, Meis T, et al. Internet telehealth for pediatric asthma case management: integrating computerized and case manager features for tailoring a Web-based asthma education program. Health Promot Pract 2007 Jul;8(3):282-291. [CrossRef] [Medline]
- Bloom B, Cohen RA, Freeman G. Summary health statistics for U.S. children: National Health Interview Survey, 2009. Vital Health Stat 10 2010 Dec(247):1-82. [Medline]
- Wolf FM, Guevara JP, Grum CM, Clark NM, Cates CJ. Educational interventions for asthma in children. Cochrane Database Syst Rev 2002(4):CD000326.
- Laster N, Holsey CN, Shendell DG, Mccarty FA, Celano M. Barriers to asthma management among urban families: caregiver and child perspectives. J Asthma 2009 Sep;46(7):731-739. [CrossRef] [Medline]
- Fox P, Porter PG, Lob SH, Boer JH, Rocha DA, Adelson JW. Improving asthma-related health outcomes among low-income, multiethnic, school-aged children: results of a demonstration project that combined continuous quality improvement and community health worker strategies. Pediatrics 2007 Oct;120(4):e902-e911 [FREE Full text] [CrossRef] [Medline]
- Karnick P, Margellos-Anast H, Seals G, Whitman S, Aljadeff G, Johnson D. The pediatric asthma intervention: a comprehensive cost-effective approach to asthma management in a disadvantaged inner-city community. J Asthma 2007 Feb;44(1):39-44. [CrossRef] [Medline]
- Coffman JM, Cabana MD, Halpin HA, Yelin EH. Effects of asthma education on children's use of acute care services: a meta-analysis. Pediatrics 2008 Mar;121(3):575-586 [FREE Full text] [CrossRef] [Medline]
- Lieberman DA. Management of chronic pediatric diseases with interactive health games: theory and research findings. J Ambul Care Manage 2001 Jan;24(1):26-38. [Medline]
- Shegog R, Bartholomew LK, Gold RS, Pierrel E, Parcel GS, Sockrider MM, et al. Asthma management simulation for children: translating theory, methods, and strategies to effect behavior change. Simul Healthc 2006;1(3):151-159. [CrossRef] [Medline]
- Burgess SW, Sly PD, Morawska A, Devadason SG. Assessing adherence and factors associated with adherence in young children with asthma. Respirology 2008 Jun;13(4):559-563. [CrossRef] [Medline]
- Finkelstein JA, Lozano P, Fuhlbrigge AL, Carey VJ, Inui TS, Soumerai SB, Pediatric Asthma Care Patient Outcomes Research Team. Practice-level effects of interventions to improve asthma care in primary care settings: the Pediatric Asthma Care Patient Outcomes Research Team. Health Serv Res 2005 Dec;40(6 Pt 1):1737-1757. [CrossRef] [Medline]
- Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol 2000 Jan;55(1):68-78. [Medline]
- Bandura A. Self-efficacy mechanism in human agency. Am Psychol 1982 Feb;37(2):122-147. [CrossRef]
- Smith S, Mitchell C, Bowler S. Patient-centered education: applying learner-centered concepts to asthma education. J Asthma 2007 Dec;44(10):799-804. [CrossRef] [Medline]
- Gustafson DH, Hawkins R, Pingree S, McTavish F, Arora NK, Mendenhall J, et al. Effect of computer support on younger women with breast cancer. J Gen Intern Med 2001 Jul;16(7):435-445. [Medline]
- Gustafson DH, Hawkins R, Boberg E, Pingree S, Serlin RE, Graziano F, et al. Impact of a patient-centered, computer-based health information/support system. Am J Prev Med 1999 Jan;16(1):1-9. [Medline]
- Wise M, Han JY, Shaw B, McTavish F, Gustafson DH. Effects of using online narrative and didactic information on healthcare participation for breast cancer patients. Patient Educ Couns 2008 Mar;70(3):348-356. [CrossRef] [Medline]
- National Heart, Lung, and Blood Institute, National Asthma Education and Prevention Program. US Department of Health and Human Services, National Institutes of Health. 2007. Expert Panel Report 3: Guidelines for the Diagnosis and Management of Asthma: Full Report URL: http://www.nhlbi.nih.gov/guidelines/asthma/asthgdln.pdf [accessed 2012-03-23] [WebCite Cache]
- Wisconsin Asthma Program. Wisconsin Department of Health Services, Division of Public Health, Bureau of Environmental and Occupational Health. 2010. Burden of Asthma in Wisconsin URL: http://www.dhs.wisconsin.gov/eh/asthma/pdf/BurdenofAsthma2010Web.pdf [accessed 2012-03-22] [WebCite Cache]
- Wise M, Pulvermacher A, Shanovich KK, Gustafson DH, Sorkness C, Bhattacharya A. Using action research to implement an integrated pediatric asthma case management and eHealth intervention for low-income families. Health Promot Pract 2010 Nov;11(6):798-806. [CrossRef] [Medline]
- Juniper EF, O'Byrne PM, Guyatt GH, Ferrie PJ, King DR. Development and validation of a questionnaire to measure asthma control. Eur Respir J 1999 Oct;14(4):902-907 [FREE Full text] [Medline]
- Santanello NC. Pediatric asthma assessment: validation of 2 symptom diaries. J Allergy Clin Immunol 2001 May;107(5 Suppl):S465-S472. [Medline]
- Moeinedin F, Moineddin R, Jadad AR, Hamid JS, To T, Beyene J. Application of biomedical informatics to chronic pediatric diseases: a systematic review. BMC Med Inform Decis Mak 2009;9:22 [FREE Full text] [CrossRef] [Medline]
- MacKinnon DP, Lockwood CM, Hoffman JM, West SG, Sheets V. A comparison of methods to test mediation and other intervening variable effects. Psychol Methods 2002 Mar;7(1):83-104. [Medline]
- Nordfeldt S, Hanberger L, Berterö C. Patient and parent views on a Web 2.0 Diabetes Portal--the management tool, the generator, and the gatekeeper: qualitative study. J Med Internet Res 2010;12(2):e17 [FREE Full text] [CrossRef] [Medline]
- Milgrom H, Bender B, Ackerson L, Bowry P, Smith B, Rand C. Noncompliance and treatment failure in children with asthma. J Allergy Clin Immunol 1996 Dec;98(6 Pt 1):1051-1057. [Medline]
- Bender B, Milgrom H, Apter A. Adherence intervention research: what have we learned and what do we do next? J Allergy Clin Immunol 2003 Sep;112(3):489-494. [Medline]
- Osterberg L, Blaschke T. Adherence to medication. N Engl J Med 2005 Aug 4;353(5):487-497. [CrossRef] [Medline]
- Tinkelman D, Schwartz A. School-based asthma disease management. J Asthma 2004 Jun;41(4):455-462. [Medline]
- McLean S, Chandler D, Nurmatov U, Liu J, Pagliari C, Car J, et al. Telehealthcare for asthma: a Cochrane review. CMAJ 2011 Aug 9;183(11):E733-E742. [CrossRef] [Medline]
- Schaffer SD, Tian L. Promoting adherence: effects of theory-based asthma education. Clin Nurs Res 2004 Feb;13(1):69-89. [CrossRef] [Medline]
- Wolf FM, Guevara JP, Grum CM, Clark NM, Cates CJ. Educational interventions for asthma in children. Cochrane Database Syst Rev 2003(1):CD000326. [CrossRef] [Medline]
- Bartholomew LK, Sockrider M, Abramson SL, Swank PR, Czyzewski DI, Tortolero SR, et al. Partners in school asthma management: evaluation of a self-management program for children with asthma. J Sch Health 2006 Aug;76(6):283-290. [CrossRef] [Medline]
- Krishna S, Francisco BD, Balas EA, König P, Graff GR, Madsen RW. Internet-enabled interactive multimedia asthma education program: a randomized trial. Pediatrics 2003 Mar;111(3):503-510. [Medline]
- Lukacs SL, France EK, Barón AE, Crane LA. Effectiveness of an asthma management program for pediatric members of a large health maintenance organization. Arch Pediatr Adolesc Med 2002 Sep;156(9):872-876. [Medline]
- Krieger J, Takaro TK, Song L, Beaudet N, Edwards K. A randomized controlled trial of asthma self-management support comparing clinic-based nurses and in-home community health workers: the Seattle-King County Healthy Homes II Project. Arch Pediatr Adolesc Med 2009 Feb;163(2):141-149. [CrossRef] [Medline]
- Brown N, Gallagher R, Fowler C, Wales S. The role of parents in managing asthma in middle childhood: an important consideration in chronic care. Collegian 2010;17(2):71-76. [Medline]
- Gentles SJ, Lokker C, McKibbon KA. Health information technology to facilitate communication involving health care providers, caregivers, and pediatric patients: a scoping review. J Med Internet Res 2010;12(2):e22 [FREE Full text] [CrossRef] [Medline]
- Popovici I, French MT, McKay JR. Economic evaluation of continuing care interventions in the treatment of substance abuse: recommendations for future research. Eval Rev 2008 Dec;32(6):547-568. [CrossRef] [Medline]
- Bewick BM, Trusler K, Barkham M, Hill AJ, Cahill J, Mulhern B. The effectiveness of web-based interventions designed to decrease alcohol consumption--a systematic review. Prev Med 2008 Jul;47(1):17-26. [CrossRef] [Medline]
- Solomon M, Wagner SL, Goes J. Effects of a Web-based intervention for adults with chronic conditions on patient activation: online randomized controlled trial. J Med Internet Res 2012;14(1):e32 [FREE Full text] [CrossRef] [Medline]
- Cunningham J, Wild TC, Walsh GW. Interest in self-help materials in a general population sample of drinkers. Drugs Educ Prev Policy 1999 Jul;6(2):209-213. [CrossRef]
- Rosen CS, Henson BR, Finney JW, Moos RH. Consistency of self-administered and interview-based Addiction Severity Index composite scores. Addiction 2000 Mar;95(3):419-425. [Medline]
- Hester RK, Squires DD, Delaney HD. The Drinker's Check-up: 12-month outcomes of a controlled clinical trial of a stand-alone software program for problem drinkers. J Subst Abuse Treat 2005 Mar;28(2):159-169. [CrossRef] [Medline]
- Murray E, McCambridge J, Khadjesari Z, White IR, Thompson SG, Godfrey C, et al. The DYD-RCT protocol: an on-line randomised controlled trial of an interactive computer-based intervention compared with a standard information website to reduce alcohol consumption among hazardous drinkers. BMC Public Health 2007;7:306 [FREE Full text] [CrossRef] [Medline]
- Saitz R, Palfai TP, Freedner N, Winter MR, Macdonald A, Lu J, et al. Screening and brief intervention online for college students: the ihealth study. Alcohol Alcohol 2007 Feb;42(1):28-36 [FREE Full text] [CrossRef] [Medline]
- Gustafson DH, Boyle MG, Shaw BR, Isham A, McTavish F, Richards S, et al. An e-health solution for people with alcohol problems. Alcohol Res Health 2011;33(4):327-337 [FREE Full text] [WebCite Cache]
- Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
|ACQ: Asthma Control Questionnaire|
|CHESS: Comprehensive Health Enhancement Support System|
|CHESS+CM: Comprehensive Health Enhancement Support System plus monthly nurse case management|
|CL: confidence limits|
|MCO: managed care organization|
Edited by G Eysenbach; submitted 12.10.11; peer-reviewed by W Slack, G Kreps, D Dalan, S Patolia; comments to author 11.01.12; revised version received 31.01.12; accepted 25.04.12; published 26.07.12
©David Gustafson, Meg Wise, Abhik Bhattacharya, Alice Pulvermacher, Kathleen Shanovich, Brenda Phillips, Erik Lehman, Vernon Chinchilli, Robert Hawkins, Jee-Seon Kim. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 26.07.2012.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.