Published on 21.02.12 in Vol 14, No 1 (2012): Jan-Feb
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/1924, first published Aug 29, 2011.
Effects of a Web-Based Intervention for Adults With Chronic Conditions on Patient Activation: Online Randomized Controlled Trial
Background: With almost one-half of Americans projected to have at least one chronic condition before 2020, a vital role of the health care system is to develop informed, engaged individuals who are effective self-managers of their health. Self-management interventions (SMIs) delivered face-to-face or by telephone (traditional SMIs) are associated with improved self-management knowledge, skills, and self-efficacy, which are expressed by the composite construct of patient activation, a predictor of health outcomes. Web-based interventions to support self-management across the spectrum of chronic diseases have the potential to reach a broader population of patients for extended periods than do traditional SMIs. However, evidence of the effectiveness of Web-based interventions on patient activation is sparse. High-quality studies featuring controlled comparisons of patients with different chronic conditions are needed to explore the interaction of Web-based interventions and patient activation.
Objective: To explore the effect of a Web-based intervention on the patient activation levels of patients with chronic health conditions, measured as attitudes toward knowledge, skills, and confidence in self-managing health.
Methods: For this 12-week study, prospective participants were selected from the patient panel of a regional health care system in the United States. The 201 eligible participants were randomly assigned to two groups. Intervention group participants had access to MyHealth Online, a patient portal featuring interactive health applications accessible via the Internet. Control participants had access to a health education website featuring various topics. Patient activation was assessed pre- and posttest using the 13-item patient activation measure. Parametric statistical models (t test, analysis of variance, analysis of covariance) were applied to draw inferences.
Results: The Web-based intervention demonstrated a positive and significant effect on the patient activation levels of participants in the intervention group. A significant difference in posttest patient activation scores was found between the two groups (F1,123 = 4.438, P = .04, r = .196). Patients starting at the most advanced development of patient activation (stage 4) in the intervention group did not demonstrate significant change compared with participants beginning at earlier stages.
Conclusions: To our knowledge, this is the first study to measure change in patient activation when a Web-based intervention is used by patients living with different chronic conditions. Results suggest that Web-based interventions increase patient activation and have the potential to enhance the self-management capabilities of the growing population of chronically ill people. Activated patients are more likely to adhere to recommended health care practices, which in turn leads to improved health outcomes. Designing Web-based interventions to target a specific stage of patient activation may optimize their effectiveness. For Web-based interventions to reach their potential as a key component of chronic disease management, evidence is needed that this technology produces benefits for a sustained period among a diverse population.
J Med Internet Res 2012;14(1):e32
- Chronic care;
- health information technology;
- patient activation;
- randomized controlled experiment;
- Web-based intervention
Care for patients with chronic diseases consumes 78% of the total cost of a US health care system that has been slow to adapt to the complex needs of this growing population [, ]. With almost one-half of Americans projected to have at least one chronic condition before the end of this decade [ , ], a vital role of the health care system is to provide the tools necessary for chronically ill patients to make informed decisions about their health care, and to solve the problems encountered daily from living with a chronic condition [ , ]. Self-management programs are designed to aid in this development by educating patients about their diseases, teaching skills to promote self-care behaviors, and fostering self-confidence in patients’ abilities to manage their disease [ - ]. As patients’ capabilities in these three areas improve, their level of patient activation, a measure of self-management capabilities, increases [ ]. This paper describes the results of a study of change in patient activation when a self-management program delivered via the Internet is used. The findings inform innovators of chronic care programs on strategies for leveraging information technology to address the challenges of delivering self-management support services to a large and growing population of patients.
Patients who believe they have a responsibility to take an active role in making decisions about their health are central to effective chronic care management [, ]. As the principal managers of their own care [ ], activated patients are more likely to adhere to activities for controlling symptoms and the progression of their disease [ , ]. A person’s activation level indicates the extent of his or her self-management capabilities, encompassing knowledge, skills, and self-efficacy [ , ]. Development of these self-management capabilities precedes change in health behavior or status [ , ]. Thus, the construct of patient activation is a predictor of health process and outcomes measures [ , ] and is therefore a key indicator of the quality of chronic care management [ ].
Activated patients strive to understand their conditions, viewing problems as challenges with the confidence that they can be solved [, ]. Acquiring these attributes of self-management is a learning process, involving the acquisition of knowledge and problem-solving skills that enable an individual to confidently engage in decision making and actions to effectively manage their chronic health condition [ ]. The developmental nature of patient activation is represented by four stages. At the earliest stage, individuals form beliefs that taking control of their health is important. As people progress through the second and third stages of patient activation, they develop the knowledge and skills to become increasingly active in self-managing their health. The most activated patients (stage 4) sustain self-management behaviors except when confronted with new or stressful situations [ ]. Considering that patients are confronting different types of challenges at each stage of patient activation, researchers hypothesize that the most effective self-management interventions (SMIs) will feature designs targeting patients at a particular stage [ ]. Despite the implications for designers of Web-based interventions for self-management, no research testing this theory appears in the literature.
Evidence suggests that SMIs delivered by face-to-face and telephonic modalities (ie, traditional SMIs) are associated with improvements in self-management knowledge and skills [, ] and self-efficacy [ ] among patients with various chronic conditions. Traditional SMI studies measuring change in the composite of these self-management capabilities—expressed as patient activation—show improvement in patient activation levels of chronically ill participants [ ]. Thus, traditional SMIs demonstrate effectiveness in helping patients develop their self-management capabilities and therefore serve a vital role in the broader goal of improving health outcomes.
Use of information technology to deliver SMIs via the Internet has the potential to reach a broader population of chronically ill patients for extended periods of time when compared with traditional SMIs [, , ]. Web-based interventions (also referred to as Internet-based interventions) are applications accessed via a website by patients and are designed to improve understanding of a health condition, change health behavior, and enhance problem-solving skills [ , ]. Certain Web-based interventions are aimed at helping patients develop self-management capabilities and modify self-care behaviors to better deal with their chronic conditions [ , , ]. The ensuing discussion of Web-based interventions refers to applications with self-management support as the central focus.
The health care community’s understanding of the value of Web-based interventions is inhibited by a dearth of high-quality studies , high variability in the effectiveness of different types of Web-based interventions [ ], and mixed results of their effect on self-efficacy [ , ], a key component of patient activation. Few studies of Web-based interventions have explored the broader construct of patient activation (encompassing knowledge, skills, and self-efficacy), an area of inquiry that holds promise because of the symbiotic relationship between knowledge, skills, and self-efficacy in self-management performance [ , ]. Furthermore, the literature on Web-based intervention research is dominated by disease-specific interventions and measures, with scant evidence of the effectiveness of applications designed for use by populations with a broad spectrum of chronic diseases. More experimental studies featuring controlled comparisons of samples comprising patients with different chronic conditions are needed to better understand the interaction between Web-based interventions and the attributes of self-management performance constituting patient activation [ , ].
The few high-quality studies in the literature of Web-based interventions and their effectiveness in developing self-management capabilities suggest that these applications help patients to understand their role in managing health and the fundamental aspects of their chronic conditions. For example, Web-based interventions increase patients’ awareness of the need to be actively engaged in their health care . A systematic review of randomized controlled trials revealed that Web-based interventions with self-management education modules had a significant and positive effect on patients’ knowledge of their chronic conditions [ ], a component of patient activation.
Research on the effects of Web-based interventions on the self-efficacy of people with chronic conditions is limited and results are mixed. Although the effect of Web-based interventions on self-efficacy showed promise in a meta-analysis , an insufficient number of studies precluded any conclusions. Web-based interventions designed specifically for patients with chronic conditions such as diabetes or arthritis showed significant enhancement in self-efficacy levels [ , , ] compared with a more generalized application targeting broader chronic disease populations, which did not demonstrate a significant effect [ ]. Although more research is needed before conclusions should be drawn, these results suggest that Web-based interventions designed to target specific chronic diseases may increase self-efficacy; no evidence exists that applications targeting a diverse population of chronically ill patients influence this important element of patient activation.
Only one study of a Web-based intervention’s effect on the composite construct of patient activation of patients with a chronic condition appears in the literature. This randomized controlled trial reported a significant improvement in patient activation among patients with diabetes . The study described in this paper builds on that research by evaluating the effect of a Web-based intervention on patient activation of patients living with different chronic conditions, including asthma, diabetes, and hypertension.
The aim of this randomized controlled trial was to evaluate change in self-management capabilities—expressed as patient activation—when a group of chronically ill patients were provided with online access to self-management materials. Specifically, we hypothesized that patients given access to a Web-based intervention designed to support self-management in the context of a person’s particular chronic disease would demonstrate positive change in patient activation levels compared with control group participants. A secondary hypothesis was tested within the intervention group. We hypothesized that patients beginning at a lower stage of patient activation development would demonstrate greater change in patient activation than would participants starting at higher stages.
Study Setting and Participants
Prospective participants were selected from the patient panel of Carolinas HealthCare System, a regional health care-delivery system in the southeastern United States. Adult patients who were seen by 300 physicians employed by Carolinas HealthCare System and with a diagnosis of asthma, hypertension, or diabetes constituted the sampling frame. We selected patients between ages 18 and 64 years, inclusive, with a diagnosis of one of the three conditions, and who had visited a participating physician in the past 2 years but not in at least 180 days. Patients with a chronic disease who have not visited their doctor in at least 6 months suggests nonadherence with recommended care guidelines and may indicate low patient activation. Employees of Carolinas HealthCare System were excluded. Selected patients were sent personalized invitations to participate. This study’s research protocol was approved by the Carolinas HealthCare System Research Review Committee, which did not require an external trial registration for this health behavior research. The institutional review boards of Walden University and Carolinas HealthCare System also approved the study.
All information used in this study for group assignments and data analysis was self-reported by participants and collected using a Web-based survey tool.shows the participants’ flow through the 12-week study.
Interested patients submitted online consents and enrollments. Patients meeting the eligibility criteria were placed in the pool of participants for the study. Participants were randomly assigned to the intervention or control group from pairs created by matching on adherence scores. We used a matching process because it helps to mitigate differences between the groups at baseline and strengthens the study’s statistical power . The adherence scores were calculated based on participants’ responses to four items in the enrollment questionnaire related to a person’s adherence to self-management behavior. The two participants with the lowest adherence scores constituted the first pair and those with the highest scores, the last. Starting at an arbitrary point in the stack of pairs, we assigned one member of the pair to the intervention and the other to the control group.
On completion of the random assignments, participants were notified via express mail of their inclusion in the study, were presented with descriptive information regarding the self-management material that would be made available to them, and received instructions for accessing the pretest and study material on the Internet. Included in these directions was a unique and confidential login that controlled the specific participant’s access privileges to the appropriate intervention or control group material. Participants were not informed of their intervention or control status.
We measured patient activation using the 13-item patient activation measure (PAM-13) . The PAM-13 is designed to elicit responses from a person about his or her attitudes toward knowledge, skills, and confidence in self-managing health. The scale is based on the Guttman technique with items ordered according to level of difficulty. A 4-point Likert-type scale of response options ranging from strongly disagree to strongly agree is used to elicit endorsement of a particular statement. The PAM-13 statements are published by the developers elsewhere [ ]. PAM-13 item responses result in total raw scores ranging from 13 to 52, which we converted to the linear interval scale of patient activation scores, ranging from 0 (lowest activation) to 100 (highest activation) [ ]. Within this converted scale are cut-off minimum-point levels for each of the four stages of patient activation described earlier [ , ].
Psychometric analysis of the PAM-13 reported in the literature shows a measure with strong reliability and validity properties . The unaltered PAM-13 was the pretest survey. The posttest survey included the PAM-13 plus an additional question about the participant’s visits to doctors during the study period.
The Web-based intervention used in this study was MyHealth Online, a personal health portal featuring a suite of interactive health applications. Effective Web-based interventions feature functions designed to change health behavior and improve patient–provider communications . The MyHealth Online self-service and health education applications enable patients to manage their health care directly. MyHealth Online users can book doctors’ office appointments online, request prescription renewals, and view and pay their bills.
MyHealth Online’s interactive, multimedia health education modules are based on information therapy principles, with each online session designed to advance the user’s knowledge by providing evidence-based information on the patient’s specific condition, self-management guidelines, and options for problem solving and treatment . Each week of the study, intervention participants received an email alerting them to the availability of the next in a progressive series of health education sessions specific to their chronic condition. Patients interact with the MyHealth Online health education modules at their own pace and decide the level of complexity of the material for a particular session. The self-directed design and 24-hour per day availability of MyHealth Online ensures that the information a patient needs to manage a particular problem is available when it is needed, facilitating decision making and behavior change [ ].
If patients need more information, they can communicate online with their providers using the secure message function of MyHealth Online. Secure provider–patient email communication helps patients engage in their care and improves their access to information . The software supporting MyHealth Online is supplied by GE Healthcare (Waukesha, WI, USA) and the health education applications are provided by Healthwise (Boise, ID, USA).
Control group participants were provided with access to a website hosting health education material on a variety of topics. In contrast to MyHealth Online, the materials available to control group participants were noninteractive and not prescriptive like the health education material provided to the intervention group. Participants were required to search topics to locate content of interest. Access to MyHealth Online or the control group’s website was granted to participants in the respective groups after they completed the pretest survey. All participants in the control and intervention groups were encouraged to continue their usual care during the study.
All participants in the study had access to the Carolinas HealthCare System website help desk for guidance on accessing and using the applications and to resolve technical problems. The intervention group participants were registered as end users of MyHealth Online and received no special services from the help desk. Support was limited to questions regarding the use and operation of the program. No self-management coaching was provided by any program resources. Intervention group participants received messages weekly via email reminding them to log in to MyHealth Online. Participants who fell below the desired threshold of participation (set at one log-in per week) received a message tailored to this condition, encouraging them to increase their participation and to contact the help desk if they required assistance to use the application. All control group participants received a message midway through the study reminding them to review the health education material and to contact the Carolinas HealthCare System help desk with any questions.
Except for the Rasch psychometric statistics , all statistical analysis was performed using PASW statistics release 18 programs (SPSS Statistics GradPack; IBM Corporation, Somers, NY, USA). We used Winsteps version 3.6 (Rasch Measurement Software, Chicago, IL, USA) to calculate the Rasch person reliability and infit statistics for assessing the PAM-13’s reliability and validity. Differences between the two groups were tested using the chi-square test of independence or Fisher exact test for categorical variables, and the t test for independent groups for pretest patient activation scores. These tests were also applied to assess between-group differences in the characteristics of patients who withdrew or dropped out of the study.
Interval-level data that were normally distributed resulted from this study, supporting the application of parametric models for the inferential tests. For testing the primary hypothesis, we evaluated the difference between groups in mean patient activation scores by applying analysis of covariance using the mean patient activation score at pretest as the covariate to reduce error variance. To test the second hypothesis and using a 2-step method, we analyzed change in patient activation scores between participants in the intervention group starting at different stages of patient activation. First, we divided intervention participants into three groups based on their stage of patient activation at the beginning of the study. We treated these groups as independent groups and applied 1-way analysis of variance to test for significance between groups. The 1-way analysis of variance is appropriate for comparing means between three groups but does not reveal the specific group differences underlying a significance difference . To determine the specific groups (ie, baseline stage) demonstrating significant change, we conducted a post hoc test, using the Tukey honestly significant difference (HSD) method.
presents demographic statistics for the control and intervention groups at the start of the study. The sample at baseline consisted of predominately non-Hispanic white persons between 45 and 64 years of age with a college degree. The sample consisted of slightly more women than men.
shows health characteristics of the control and intervention groups at baseline. Most participants self-reported hypertension or diabetes as their main chronic condition.
|Variable|| Total sample |
(N = 201)
| Control group |
(n = 100)
| Intervention group |
(n = 101)
|Test for difference|
|Age group (years)||χ22 = 0.5||.77|
|Gender||χ21 = 0.3||.62|
|Race||χ21 = 0.6||.43|
|Ethnicity||χ21 = 0.3a||.58|
|Hispanic, Latino, or Spanish origin||12||6%||5||5%||7||7%|
|Education||χ22 = 0.2a||.90|
|High school graduate or less||11||5%||5||5%||6||6%|
|Some college or trade school||66||33%||34||34%||32||32%|
|College graduate or more||123||62%||60||61%||63||62%|
a One participant assigned to the control group did not respond to this item.
|Variable|| Total sample |
(N = 201)
| Control group |
(n = 100)
| Intervention |
(n = 101)
|Test for difference|
|Main chronic condition||χ23 = 4.0a||.27|
|Doctor visit in the past 6 months||χ21 = 2.2b||.13|
|Have used health education classes, support groups, or materials from doctor||χ21 = 0.2||.68|
|Reflecting on the past 6 months...I did different tasks and activities needed to manage my health condition so as to reduce my need to see a doctor||χ21 = 0.0||.94|
a One participant assigned to the intervention group did not respond to this item.
b Two participants assigned to the intervention group did not respond to this item.
At baseline no significant differences were found between the groups on any background variables, and the groups were not statistically different at the end of the study. Based on participants completing the study, there was no significant difference between the groups’ mean pretest patient activation scores. Thus, the two groups at posttest were not significantly different from when the trial started. Furthermore, we found no significant difference between the groups in the average frequency of office visits during the study. This result suggests that any difference in patient activation scores between the groups at posttest was not influenced by patients seeing their doctors.
The control and intervention groups experienced attrition rates of 32% (32/100) and 41% (41/101) respectively, by the end of the study (). We found no significance difference between the dropouts of the two groups in mean pretest patient activation scores (t71 = .829, P = .41). Furthermore, the average pretest score of dropouts was not significantly different from that of participants who completed the study (t197 = –.951, P = .34). These results indicate that participants who completed the study did not differ from those who did not in terms of the dependent variable at pretest.
Psychometric Properties of the PAM-13
The PAM-13 is based on the Rasch item response model . Reliability of the PAM-13 is evaluated using the person reliability index; fit statistics are calculated to test construct validity of the measure [ ]. The person reliability coefficient was a relatively high .83, showing a good spread of responses across the ordered items and expected endorsement patterns. Item and person infit statistics of .99 and 1.01, respectively, were well within the acceptable range [ ]. In sum, the PAM-13 demonstrated strong psychometric properties in this study.
Effect of the Web-Based Intervention on Patient Activation
The Web-based intervention demonstrated a positive and significant effect on the patient activation levels, on average, of the participants in the intervention group. Controlling for the pretest patient activation scores, we found a significant difference in posttest patient activation scores between the two groups (F1,123 = 4.438, P = .04, effect size r = .196). Both groups experienced an average increase in patient activation scores during the study (), prompting an examination of change scores to determine whether the improvement in the control group may have attenuated the between-group difference at posttest. The difference in the mean patient activation score from pretest to posttest of the control group (mean 2.04, SD 10.01) was not significant (t67 = 1.677, P = .10), whereas the intervention group showed a highly significant change (mean 5.967, SD 9.70, t57 = 4.683, P < .001). The positive and significant change in the intervention group’s patient activation reinforces the analysis of covariance results.
|Group||na|| Patient activation |
| Patient activation |
|Analysis of covarianceb|
a Group size (n) at posttest.
b Analysis of covariance on 12-week posttest scores controlling for patient activation score at pretest.
Baseline Patient Activation Stage and Change in Activation Scores
Prior to testing for differences in patient activation score changes between participants starting at each stage of patient activation, we combined patients at the first two stages into a single group to make this group’s size comparable with the others (). The 1-way analysis of variance revealed that the mean change in patient activation scores across the three groups was significantly different (F2,55 = 6.472, P = .003, effect size r = .436. Post hoc comparisons using the Tukey HSD test showed a significantly lower mean change score in the stage 4 group than in the combined stage 1–2 group (mean difference –8.457, 95% confidence interval –15.47 to –1.45; P = .01, effect size d = 0.45) and than among participants starting at stage 3 (mean difference –8.354, 95% confidence interval –15.06 to –1.64; P = .01, effect size d = 0.45). The difference in change scores between the stage 1–2 and stage 3 groups was nonsignificant (P = .999).
Despite beginning the study at the most advanced stage of patient activation, stage 4 group participants had the potential to substantially improve their patient activation scores. A ceiling effect was not evident in the stage 4 group, as 79% (22/28) of the participants began with activation scores between 68 and 80, sufficiently below the maximum score of 100, to experience a mean change in patient activation comparable with groups beginning at the earlier stages.
|Patient activation stage||n|| Patient activation |
| Patient activation |
| Change in patient |
To our knowledge, this is the first study to examine the effect of a Web-based intervention designed to target various chronic conditions on patient activation, a construct encompassing a person’s knowledge, skills, and self-efficacy to self-manage his or her health. It is also the first study to explore change in patient activation development stages among patients using a Web-based intervention. Results from this controlled trial suggest that a Web-based intervention targeting various chronic diseases and featuring the versatility to support self-management in the context of a person’s particular chronic condition may improve the level of patient activation, a measure of self-management capabilities.
We found a small but significant difference in posttest patient activation scores between the control and intervention groups. The small effect size found between the groups’ patient activation scores is consistent with other Web-based interventions demonstrating a significant effect on health behavior outcomes . Within the intervention group, participants starting this 12-week study at the first three stages of patient activation improved their patient activation scores significantly compared with patients who started at the most advanced stage (4) of activation.
MyHealth Online is designed for use by patients with various health interests. Within this general-purpose architecture, applications are configurable to present content that targets a person’s specific chronic condition. For this study, parameters were set to provide messages and health education modules to an intervention group participant based on the main chronic disease self-reported during the enrollment process. SMIs that embed general self-management skills training within interactive disease-specific modules are more effective than didactic disease education alone in enhancing the self-efficacy component of the patient activation construct . Building on this evidence, health education modules in MyHealth Online contain interactive exercises that present a self-management problem in the context of a specific disease (eg, adhering to a hypertension medication regimen). This approach resembles the disease-specific education of Web-based interventions shown to enhance the self-efficacy of patients with arthritis [ ] and diabetes [ ], and is in contrast to a general-purpose Web-based intervention [ ], which did not show significant improvement in the self-efficacy component of patient activation. Thus, the present study suggests that, to improve patient activation, Web-based interventions designed for use by populations consisting of people with different chronic diseases should be designed to provide information therapy that is specific to a patient’s medical condition.
People in the first three stages of patient activation are forming beliefs about their role in personal health and starting to build confidence in their abilities to self-manage . From a chronic care management perspective, a desirable goal is to develop patients’ self-management capabilities to the level reflected by the most advanced stage of patient activation. Patients with chronic conditions who are the most activated (ie, stage 4) are more likely to engage in self-management behaviors that are associated with improved clinical outcomes, including adhering to prescribed medication regimens, regularly testing glucose levels, and monitoring blood pressure [ ]. The significant improvement in patient activation shown by intervention participants starting at the first three stages of patient activation suggests that MyHealth Online may have helped these patients become more capable of self-managing their health. Web-based interventions that aid the advancement of patients on the developmental continuum of patient activation contribute to an expanded population of patients who are able to actively manage their diseases—adhering to desirable health behaviors and knowing what steps to take when confronted with a condition-related incident (eg, diabetic hypoglycemia).
My Health Online appears to have aided primarily participants at the early stages of patient activation in gaining an understanding of their chronic conditions and developing the skills and self-confidence needed to better manage them. This apparent area of effectiveness of MyHealth Online is similar to findings from previous studies of the effects of Web-based interventions on the self-efficacy component of patient activation. Wangberg found that diabetic patients with the lowest baseline self-efficacy benefited the most from a Web-based intervention . The nonsignificant change in stage 4 patients’ activation scores in the current study is comparable with the observation by Berman et al that patients with high baseline levels of the more granular attribute of self-efficacy did not show significant change as a result of a Web-based intervention [ ].
Highly activated (ie, stage 4) patients lack confidence in their abilities to solve problems they have not previously encountered . Despite room for improvement among participants beginning at stage 4 of patient activation in this study, they did not appear to gain substantive benefit from the SMI that was used. This outcome suggests that the self-service and interactive health education modules of MyHealth Online did not improve the self-confidence of participants who possessed the knowledge and skills to self-manage their health in routine situations. They may require a more sophisticated SMI with scenarios for how to solve various complex problems not frequently encountered. More research is needed to understand the specific needs of patients at the most advanced stage of patient activation.
The contrast in change in patient activation of people at different starting points of self-management capabilities affirms the assertion by Hibbard and colleagues  that different SMIs are needed to help people on their journey along the continuum of patient activation. Although more research is needed, evidence suggests that a Web-based intervention should be designed to specifically target either people with low levels of patient activation or those in the advanced stage of patient activation. A Web-based SMI with features similar to those of MyHealth Online may yield the most optimal results when used by patients in the earlier stages of patient activation. By recognizing the different stages of patient activation and targeting Web-based interventions to patients in the earlier stages, chronic care program designers and practitioners may derive tangible value from this technology as measured by improvements in quality metrics for adherence and health status.
Strengths and Limitations
This study has several strengths and limitations. Important strengths were the rigorous randomized experimental design and posttest sample size (n = 128). The groups were statistically not different in terms of demographic characteristics and the dependent variable at baseline. Data met the assumptions for appropriate use of parametric tests. The dependent variable (patient activation score) was transformed to an interval-level scale, distributions of patient activation scores pre- and posttest were close to normal, variance of these scores shown by the two groups was sufficiently homogeneous, and the combined sample size exceeded the minimum needed to produce accurate results [, ]. In addition, the PAM-13 demonstrated good psychometric properties.
Four limitations should be considered when interpreting the results. First, results may not be applicable to other populations and settings. Compared with the US population , the sample underrepresented people belonging to minority groups. Furthermore, 95% (189/200) of the study participants had attended college. This study follows a persistent pattern of research involving Web-based SMIs, which attract mostly college-educated, non-Hispanic, white participants [ , , , , , ]. Thus, the applicability of results from most research on Web-based interventions is inherently limited to a population willing and able to access the Internet. Further study is warranted to validate the results from this study with larger samples that are more representative of the US chronic disease population.
The second limitation is the unexplained reasons for the 41% attrition rate in the intervention group, a level higher than the 12%–25% reported for controlled trials involving Web-based interventions [, , ]. The six withdrawals and 24 dropouts may have been participants who experienced difficulties using the applications or had expectations for the Web-based intervention that were not met. These are problems reported by users of Web-based interventions in prior research [ , ]. The significance of usability or user expectations to this study’s level of attrition is unknown, as measuring user satisfaction was not a study objective. Furthermore, although the two groups maintained statistical equivalency on all demographic and health descriptive variables at posttest despite the attrition, attributes of the dropouts not measured in this study may have influenced the study’s outcomes.
Third, the scope of this research was limited to measuring change in patient activation when a Web-based intervention was used. The relative importance of specific functions and participants’ perceived value of the Web-based intervention were not assessed. A fourth limitation is the possibility that participants were influenced by agents external to the study. Participants were encouraged to receive usual care; no restrictions were placed on use of other support resources.
Results from this study suggest that Web-based interventions have the potential to serve a vital role in health care providers’ efforts to enhance the self-management capabilities of the growing population of chronically ill people. The study’s outcomes reveal that the use of a Web-based intervention may result in more activated patients who are more proficient and self-confident in self-managing their chronic conditions. As a measure of self-management capabilities and a predictor of health outcomes, patient activation and its underlying components are mediators  in a causal chain of chronic care beginning with an SMI and ending with improved health outcomes. Activated patients are more likely to adhere to recommended health care practices, which in turn leads to improved health outcomes [ , ]. Thus, Web-based interventions that influence patient activation are an essential element of chronic disease management programs where success is measured in quality metrics such as patient adherence, functional status, or clinical effectiveness. Evaluating the effect of a Web-based intervention on patient activation provides program designers and practitioners with a more complete picture of the factors contributing to change in the health status of targeted patients.
As innovators work to transform health care to support the new “...era of chronic disease predominance” , they are encouraged to build on the discoveries from this and previous research to advance the industry’s understanding of the value of Web-based SMIs in activating patients to take control of their health. By providing self-management support services on demand, anytime, and from anywhere, Web-based interventions have the potential to be a transformative technology in the management of chronic diseases, delivering self-management services to large numbers of people with fewer human resources than traditional SMIs have. To turn this potential into reality, evidence is needed that Web-based interventions can produce benefits for a sustained period among a diverse population. More clarity of the value of Web-based self-management tools as scalable interventions will stimulate the investments necessary to accelerate adoption throughout all segments of the large and growing chronic disease population.
No funding or sponsors supported this research.
Conflicts of Interest
Multimedia Appendix 1
CONSORT-EHEALTH checklist V1.6 .PDF File (Adobe PDF File), 810KB
- Bodenheimer T, Chen E, Bennett HD. Confronting the growing burden of chronic disease: can the U.S. health care workforce do the job? Health Aff (Millwood) 2009;28(1):64-74. [CrossRef] [Medline]
- Pierson CA, Schumann L, Berner B. A perspective on chronic illness. J Am Acad Nurse Pract 2008 Mar;20(3):107-108. [CrossRef] [Medline]
- Anderson G. Partnership for Solutions. 2004 Sep. Chronic Conditions: Making the Case for Ongoing Care URL: http://www.partnershipforsolutions.org/DMS/files/chronicbook2004.pdf [accessed 2012-02-06] [WebCite Cache]
- US Census Bureau. 2008. National Population Projections: Projections of the Population and Components of Change for the United States: 2010-2050 URL: http://www.census.gov/population/www/projections/summarytables.html [accessed 2011-07-18] [WebCite Cache]
- Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness. JAMA 2002 Oct 9;288(14):1775-1779. [Medline]
- Coleman K, Austin BT, Brach C, Wagner EH. Evidence on the chronic care model in the new millennium. Health Aff (Millwood) 2009;28(1):75-85. [CrossRef] [Medline]
- Lorig KR, Holman H. Self-management education: history, definition, outcomes, and mechanisms. Ann Behav Med 2003 Aug;26(1):1-7. [Medline]
- Hill-Briggs F. Problem solving in diabetes self-management: a model of chronic illness self-management behavior. Ann Behav Med 2003;25(3):182-193. [Medline]
- Newman S, Steed L, Mulligan K. Self-management interventions for chronic illness. Lancet 2004;364(9444):1523-1537. [CrossRef] [Medline]
- Hibbard JH. Moving toward a more patient-centered health care delivery system. Health Aff (Millwood) 2004;Suppl Variation:VAR133-VAR135. [CrossRef] [Medline]
- Holman H, Lorig K. Patient self-management: a key to effectiveness and efficiency in care of chronic disease. Public Health Rep 2004;119(3):239-243. [CrossRef] [Medline]
- Hibbard JH, Cunningham PJ. Center for Studying Health System Change. 2008. How Engaged are Consumers in Their Health and Health Care, and Why Does it Matter? HSC Research Brief no 8 URL: http://hschange.org/CONTENT/1019/ [accessed 2011-06-23] [WebCite Cache]
- Hibbard JH, Mahoney ER, Stock R, Tusler M. Do increases in patient activation result in improved self-management behaviors? Health Serv Res 2007 Aug;42(4):1443-1463. [CrossRef] [Medline]
- Remmers C, Hibbard J, Mosen DM, Wagenfield M, Hoye RE, Jones C. Is patient activation associated with future health outcomes and healthcare utilization among patients with diabetes? J Ambul Care Manage 2009;32(4):320-327. [CrossRef] [Medline]
- Hibbard JH, Tusler M. Assessing activation stage and employing a "next steps" approach to supporting patient self-management. J Ambul Care Manage 2007;30(1):2-8. [Medline]
- Bandura A. Self-efficacy: The Exercise of Control. New York, NY: WH Freeman; 1997.
- Nolte S, Elsworth GR, Sinclair AJ, Osborne RH. The extent and breadth of benefits from participating in chronic disease self-management courses: a national patient-reported outcomes survey. Patient Educ Couns 2007 Mar;65(3):351-360. [CrossRef] [Medline]
- Mosen DM, Schmittdiel J, Hibbard J, Sobel D, Remmers C, Bellows J. Is patient activation associated with outcomes of care for adults with chronic conditions? J Ambul Care Manage 2007;30(1):21-29. [Medline]
- Hibbard JH, Stockard J, Mahoney ER, Tusler M. Development of the Patient Activation Measure (PAM): conceptualizing and measuring activation in patients and consumers. Health Serv Res 2004 Aug;39(4 Pt 1):1005-1026. [CrossRef] [Medline]
- Warsi A, Wang PS, LaValley MP, Avorn J, Solomon DH. Self-management education programs in chronic disease: a systematic review and methodological critique of the literature. Arch Intern Med 2004;164(15):1641-1649 [FREE Full text] [CrossRef] [Medline]
- Marks R, Allegrante JP, Lorig K. A review and synthesis of research evidence for self-efficacy-enhancing interventions for reducing chronic disability: implications for health education practice (part II). Health Promot Pract 2005 Apr;6(2):148-156. [CrossRef] [Medline]
- Griffiths F, Lindenmeyer A, Powell J, Lowe P, Thorogood M. Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res 2006;8(2):e10 [FREE Full text] [CrossRef] [Medline]
- Ritterband LM, Gonder-Frederick LA, Cox DJ, Clifton AD, West RW, Borowitz SM. Internet interventions: in review, in use, and into the future. Prof Psychol Res Pr 2003;34(5):527-534. [CrossRef]
- Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010;12(1):e4 [FREE Full text] [CrossRef] [Medline]
- Barak A, Klein B, Proudfoot JG. Defining internet-supported therapeutic interventions. Ann Behav Med 2009 Aug;38(1):4-17. [CrossRef] [Medline]
- Kaelber DC, Jha AK, Johnston D, Middleton B, Bates DW. A research agenda for personal health records (PHRs). J Am Med Inform Assoc 2008;15(6):729-736 [FREE Full text] [CrossRef] [Medline]
- Kerr C, Murray E, Stevenson F, Gore C, Nazareth I. Internet interventions for long-term conditions: patient and caregiver quality criteria. J Med Internet Res 2006;8(3):e13 [FREE Full text] [CrossRef] [Medline]
- Samoocha D, Bruinvels DJ, Elbers NA, Anema JR, van der Beek AJ. Effectiveness of web-based interventions on patient empowerment: a systematic review and meta-analysis. J Med Internet Res 2010;12(2):e23 [FREE Full text] [CrossRef] [Medline]
- Murray E, Burns J, See TS, Lai R, Nazareth I. Interactive Health Communication Applications for people with chronic disease. Cochrane Database Syst Rev 2005(4):CD004274. [CrossRef] [Medline]
- Solomon MR. Information technology to support self-management in chronic care: a systematic review. Dis Manag Health Outcomes 2008;16(6):391-401.
- Jackson CL, Bolen S, Brancati FL, Batts-Turner ML, Gary TL. A systematic review of interactive computer-assisted technology in diabetes care. Interactive information technology in diabetes care. J Gen Intern Med 2006 Feb;21(2):105-110. [CrossRef] [Medline]
- Cudney S, Sullivan T, Winters CA, Paul L, Oriet P. Chronically ill rural women: self-identified management problems and solutions. Chronic Illn 2005 Mar;1(1):49-60. [Medline]
- Lorig K, Ritter PL, Laurent DD, Plant K, Green M, Jernigan VB, et al. Online diabetes self-management program: a randomized study. Diabetes Care 2010 Jun;33(6):1275-1281. [CrossRef] [Medline]
- Lorig KR, Ritter PL, Dost A, Plant K, Laurent DD, McNeil I. The Expert Patients Programme online, a 1-year study of an Internet-based self-management programme for people with long-term conditions. Chronic Illn 2008 Dec;4(4):247-256. [CrossRef] [Medline]
- Lorig KR, Ritter PL, Laurent DD, Plant K. Internet-based chronic disease self-management: a randomized trial. Med Care 2006 Nov;44(11):964-971. [CrossRef] [Medline]
- Shadish WR, Cook TD, Campbell DT. Experimental and Quasi-experimental Designs for Generalized Causal Inference. Boston, MA: Houghton Mifflin; 2002.
- Hibbard JH, Mahoney ER, Stockard J, Tusler M. Development and testing of a short form of the patient activation measure. Health Serv Res 2005 Dec;40(6 Pt 1):1918-1930. [CrossRef] [Medline]
- Insignia Health. Patient Activation Measure (PAM) 13 License Materials. Portland, OR: Insignia Health LLC; 2008.
- Mettler M, Kemper DW. Information therapy: health education one person at a time. Health Promot Pract 2003 Jul;4(3):214-217. [Medline]
- Baker L, Wagner TH, Singer S, Bundorf MK. Use of the Internet and e-mail for health care information: results from a national survey. JAMA 2003 May 14;289(18):2400-2406 [FREE Full text] [CrossRef] [Medline]
- Rasch G. Probabilistic Models for Some Intelligence and Attainment Tests. Chicago, IL: University of Chicago Press; 1980.
- Polit DF. Data Analysis & Statistics for Nursing Research. Stamford, CT: Appleton & Lange; 1996.
- Francis CF, Feyer AM, Smith BJ. Implementing chronic disease self-management in community settings: lessons from Australian demonstration projects. Aust Health Rev 2007 Nov;31(4):499-509; discussion 498. [Medline]
- Lorig KR, Ritter PL, Laurent DD, Plant K. The internet-based arthritis self-management program: a one-year randomized trial for patients with arthritis or fibromyalgia. Arthritis Rheum 2008 Jul 15;59(7):1009-1017 [FREE Full text] [CrossRef] [Medline]
- Wangberg SC. An Internet-based diabetes self-care intervention tailored to self-efficacy. Health Educ Res 2008 Feb;23(1):170-179 [FREE Full text] [CrossRef] [Medline]
- Berman RL, Iris MA, Bode R, Drengenberg C. The effectiveness of an online mind-body intervention for older adults with chronic pain. J Pain 2009 Jan;10(1):68-79. [CrossRef] [Medline]
- Norusis MJ. SPSS 16.0 Advanced Statistical Procedures Companion. Upper Saddle River, NJ: Prentice Hall; 2008.
- McKay HG, King D, Eakin EG, Seeley JR, Glasgow RE. The diabetes network internet-based physical activity intervention: a randomized pilot study. Diabetes Care 2001 Aug;24(8):1328-1334. [Medline]
- Ross SE, Moore LA, Earnest MA, Wittevrongel L, Lin CT. Providing a web-based online medical record with electronic communication capabilities to patients with congestive heart failure: randomized trial. J Med Internet Res 2004 May 14;6(2):e12 [FREE Full text] [CrossRef] [Medline]
- Glasgow RE, Nutting PA, King DK, Nelson CC, Cutter G, Gaglio B, et al. Randomized effectiveness trial of a computer-assisted intervention to improve diabetes care. Diabetes Care 2005 Jan;28(1):33-39. [Medline]
- Ralston JD, Revere D, Robins LS, Goldberg HI. Patients' experience with a diabetes support programme based on an interactive electronic medical record: qualitative study. BMJ 2004 May 15;328(7449):1159 [FREE Full text] [CrossRef] [Medline]
- Baron RM, Kenny DA. The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J Pers Soc Psychol 1986 Dec;51(6):1173-1182. [Medline]
- Bodenheimer T. Helping patients improve their health-related behaviors: what system changes do we need? Dis Manag 2005 Oct;8(5):319-330. [CrossRef] [Medline]
- Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: Improving and Standardizing Evaluation Reports of Web-based and Mobile Health Interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
|HSD: honestly significant difference|
|PAM-13: 13-item patient activation measure|
|SMI: self-management intervention|
Edited by G Eysenbach; submitted 29.08.11; peer-reviewed by L Ritterband; comments to author 24.09.11; revised version received 24.01.12; accepted 27.01.12; published 21.02.12
©Michael Solomon, Stephen L Wagner, James Goes. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 21.02.2012.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.