Although Healthy People 2020 recommends diabetes education, less than 7% of people with diabetes report receiving formal diabetes education in the year following diagnosis [1]. Diabetes education may also help with achieving many of the Healthcare Effectiveness Data and Information Set (HEDIS) measures [2]. Diabetes self-management education aims to increase healthful behaviors while reducing HbA1c. In a recently published paper, we reported on the 6-month outcomes for a diabetes self-management intervention offered both face-to-face and Web-based [3]. Study participants improved healthful behaviors, medication adherence, hypoglycemia, and HbA1c. More than 70% of study participants made a positive improvement (effect size of 0.4 or greater) in 1 or more of 5 outcome variables (HbA1c, frequency of hypoglycemia, medication adherence, completing recommended screenings, and exercise). In this paper, we report on the 1-year outcomes for the same study.

The study aimed at testing the following hypotheses:

1. Improvements in HbA1c, health indicators (hypoglycemic symptoms and depression), and health behaviors (exercise, medication adherence, receiving recommended tests) between baseline (preintervention) and 1 year.

2. Changes would meet or exceed Healthy People diabetes recommendation for percentage of population with HbA1c above 9% and below 7% and percentage of population receiving microalbumin, foot, and eye examinations.

3. Effectiveness would be independent of the mode of delivery.

4. Both older (65 plus) and younger participants would benefit.

5. Participants with baseline HbA1c ≥9.0, Patient Health Questioinaire (PHQ-8) depression ≥10.0, 2 or more hypoglycemia symptoms, medication nonadherence, or no aerobic exercise would have clinically significant improvements in these variables.

6. Moderate effect size (0.4) improvements would be found for the majority of participants in reducing 1 of more of the aforementioned variables.

Better Choices, Better Health-Diabetes (BCBH-D) was developed for people with type 2 diabetes. Both versions of the program (face-to-face and Web-based) meet the American Association of Diabetes Educators (AADE) standards for diabetes self-management and support [4], have been shown to be effective in previous randomized trials [5,6], have the same content, and are designed to enhance self-efficacy [7]. Content includes healthy eating, exercise, understanding glucose monitoring, communicating with family, friends, and the health care system, hypoglycemia, depression, difficult emotions, sick days, medication management, problem solving, decision making, and action planning. Both are 6 weeks, have 2 peer facilitators, and have standardized facilitator training. Neither program had any reinforcement beyond the initial intervention. Both have been described in detail elsewhere [3]. The study was approved by the Stanford and New England institutional review boards and has 5 collaborators, Anthem Inc, the National Council on Aging, Stanford School of Medicine, the National Council of Young Men’s Christian Association of the United States of America, and OASIS Health.

Because this was a pragmatic trial designed to be offered in real-world settings, there were few inclusion (have type 2 diabetes and be covered by an Anthem-affiliated health plan) or exclusion (currently pregnant or in chemotherapy or radiation treatment for cancer) criteria. Unlike most efficacy trials, symptom severity was not an inclusion criterion.

Web-based participants were recruited in 2013 and 2014 by email from their employers or emails or phone calls from an Anthem plan. Both commercial and Medicare-Advantage participants were eligible. Potential study participants went to the recruitment website, completed screening, and completed an informed consent and baseline questionnaire.

Face-to-face participants were recruited through mailings, flyers in workplaces or physicians’ offices, case managers, and automated telephone calls. Face-to-face programs were available in Atlanta, Indianapolis, and St. Louis. A small percentage of the community participants were not covered by Anthem plans. All other screening criteria were the same for Web-based and face-to-face participants.

Data were collected using self-report, validated questionnaires at baseline and 12 months. We asked participants to furnish a sample of blood, although this was not required for program or study participation; nor were participants disqualified if they failed to return their samples. Consenting participants were sent HbA1c test kits. These were returned to investigators, bar-coded to avoid disclosing PHI, and then sent to CoreMedica, a Clinical Laboratory Improvement Amendments (CLIA) certified lab [8]. Participants and their physicians were sent results. Because CoreMedica recalibrated its measurements in June 2014 increasing all values by roughly 0.4, all measures prior to June were adjusted upward by 0.4.

Measures were chosen to be of interest to patients, providers, and the health care system. Demographic variables included age, gender, race, ethnicity, education, and marital status. Participant also reported other diseases. Previously validated outcome measures are described in detail elsewhere [3,9,10].

Health indicators included self-rated health, which is a single item from the National Health Examination Survey [11], the PHQ-8 depression scale [12], the Illness Intrusiveness Scale, which measures role function [13], and the hypoglycemic symptoms scale [14]. Fatigue and sleep are each single-item visual numeric scales [15]. Behavior indicators included communication with physicians, a scale asking how often patients ask questions and discuss problems with their health care provider [10], minutes of aerobic exercise per week [10], and the Morisky Medication Adherence scale [16]. We also asked participants if they had eye, foot, cholesterol, and kidney examinations in the last year or, on follow-up questionnaires, in the last 6 months.

Pragmatic studies, because of study-population heterogeneity, present unique methodological challenges. In many diabetes studies, subjects are chosen, for example, because of high HbA1c or depression. In this study, no such screening occurred, resulting in greater heterogeneity for the key outcome variables. Not all participants have the same problems, and some have no problems. Consequently, we conducted several types of analyses. The first was a descriptive analysis of the participants and their engagement with the program. The second, or classic, set of analyses determined the 12-month changes and significance for the population as a whole. The third, or subset, analyses examined only those who demonstrated problems in specific variables of interest, for example, high HbA1c or low adherence to taking medications. Having a problem was decided either by a standard criteria such as 10 or above on a PHQ-8 being highly suggestive of depression [12] or by specific scores on the adherence and hypoglycemia scales suggested by the authors and previous publications. For exercise, we chose those not exercising at baseline, and for HbA1c, we chose 9, as this is the level discussed in the Healthy People 2020 goals [17]. A fourth analysis sought to reconcile the second and third analyses by examining the percentage of the total population who achieved a moderate benefit (0.4 effect size) in at least 1 of the 5 variables of interest.

To help determine the likelihood of bias caused by attrition, we compared baseline scores of participants who failed to complete with those who completed 12-month questionnaires.

Univariate statistics describe demographic and engagement characteristics. Independent-sample t tests compare demographic and baseline outcome variables between those who failed to complete 12-month follow-up questionnaires and those who completed them. Paired t tests examined changes between baseline and 12 months and if these differed significantly from a null hypothesis of zero change (hypothesis 1).

For those who had had no examinations (eye, foot, cholesterol, or kidney) in the year prior to entry, we calculated the percentage that had examinations in the 12 months following baseline.

To compare effectiveness by mode of delivery, we used independent- sample t tests to compare change scores between Web-based and face-to-face participants (hypothesis 3). Similarly, we compared 1-year changes for older (65 plus) and younger participants (hypothesis 4).

Subgroup analyses were conducted for participants with specific conditions as described above: HbA1c above 9; clinical depression (PHQ-8 of 10 or above [12]); at least two symptoms of hypoglycemia; low medication adherence; and no exercise at baseline. For each measure, we report the mean change of the group and the percentage that no longer had the negative indication (hypothesis 5). In addition, to examine the possibility that results were due to regressions to the mean, we calculated the change scores for the subsets of the sample that did not meet each of the 5 negative criteria.

To determine the proportion of all participants who benefited on at least 1 of the 5 indicators, we calculated the percentage who improved by an effect size of at least 0.4 (hypothesis 6). We examined the relationship between the number of criterial indicators and the number of improvements using Pearson correlations.

A total of 4639 potential participants (509 face-to-face and 4130 Web-based) left contact information. All were invited to fill out a screener and, if eligible, complete consent and the baseline questionnaire. People only became study participants when they attended the first workshop or logged on to the first session. Of these, 1229 (229 face-to-face and 1000 Web-based) completed the process, were eligible, and became study participants. The majority of those not completing the process did not have Anthem-affiliated plans or failed to complete the screener, consent, or questionnaire (Figures 1 and 2). Of those starting the program, 687 and 170 (69.7%) completed 12-month questionnaires. About 80% (957/1229) of the participants successfully completed a baseline HbA1c. Of these, 55.0% (526/957) completed 12-month HbA1cs.

Table 1 shows demographic characteristics and baseline outcome scores. Relative to the face-to-face cohort, the Web-based participants were more likely to be male, more likely to be married, and less likely to be minority. They also were younger. All differences were statistically significant. There was 1 statistically significant difference between the 2 groups among baseline outcome measures. The face-to-face participants had better initial communication with their physicians (P=.03).

Participants took part in 1 of 50 face-to-face workshops or 49 Web-based workshops. Face-to-face workshops had 3-16 study participants attending a mean of 4.7 of 6 sessions (SD 1.5). Web-based workshops had 5-28 participants. Both modes also had nonstudy participants.

Web-based participants logged in a mean of 4.8 sessions (SD 1.5, range 1-6). They averaged 4.36 action plans (SD 3.9, range 0-6), 5.25 posts to discussion boards (3.9, 0-22), 10.4 replies to posts (20.1, 0-228), and 157.0 visits to workshop Web pages (62.4, 1-209).

Of 1229 participants, 69.7% (857/1229) completed the 12-month questionnaire. The face-to-face participants (74.2%, 170/229) were more likely to complete compared to Web-based participants (68.7%, 687/1000). Outside of optional HbA1c, no variable had more than 1.7% missing data among 12-month completers. Nine-hundred and fifty-three consented to HbA1c testing and successfully completed baseline tests. Twelve-month HbA1c tests were successfully completed by 526 participants (55.0% (526/957) of those consenting and furnishing baseline HbA1c samples).

We compared baseline values of those not completing 12-month questionnaire and completers. Among demographic variables, noncompleters tended to be younger (mean 55.1 vs 57.8 years old, P<.001) and slightly less educated (14.9 vs 15.5 years of education, P<.001). There were no significant differences by gender, marital status, or ethnicity.

Among 15 outcome variables, 4 had statistically significance differences at baseline comparing completers and noncompleters. Also, 12-month noncompleters reported higher baseline HbA1c (8.4% vs 8.1% , P=.007), lower general health (3.04 vs 2.87 on a 1-5 scale, P<.001), less aerobic exercise (65.3 vs 84.0 minutes/week, P=.002), and less likely to have had an eye exam in the last 12 months (79.7% vs 77.5%, P=.005).

Table 2 shows the mean changes from baseline to 12 months (hypotheses 1). Seven of 7 health indicators (including HbA1c) and 7 of 8 health behaviors had statistically significant improvements between baseline and 12 months.

If we apply a Bonferroni correction and use .003 as the level of significance, 12 of 15 outcomes remain statistically significant.

Between baseline (preintervention) and 1 year, there were modest, but statistically significant, improvements in 14 of 15 outcome measures, including HbA1c. There were no significant changes in the proportion having cholesterol exams within the preceding year. However, baseline percentages having those tests were high, leaving little room for improvement.

The Healthy People 2020 [17] goals were to (1) reduce by 10% the proportion of persons with diabetes with an HbA1c value greater than 9.0%; (2) increase the proportion of the diabetic population with an HbA1c value less than 7% HbA1c by 10%; (3) increase the proportion of adults with diabetes who have at least an annual foot examination by 10% from a current 68% to 74.8%; (4) increase the proportion having annual eye exams by 10%; (5) increase the proportion having urinary microalbumin (kidney) tests by 10%; and (6) increase the proportion of adults with diabetes who receive formal diabetes education. By design, the BCBH-D workshops add to the proportion receiving diabetes education. For 4 of 5 goals, the participants in the program exceeded the desired increase of 10%. For the fifth goal (eye exams), the participants in the study were very close to achieving the goal (a mean increase of 9.2%). A year after the intervention, the participants exceeded many of Healthy People 2020 goals, such as improvements in HbA1c and percentage having recommended examinations. In addition, if the findings of this study can be replicated in other settings, the interventions may lead to improvement in both HEDIS and Medicare Star Quality Measures.

The real-world nature of this pragmatic study necessitated the lack of a control group. Thus, we cannot be certain that the improvements observed are not due to other factors or might have occurred during the same time to nonparticipants. Alternative explanations for the improvements might include new medications and health plan initiatives that became available during the period of the study. It is also possible that there were interactions between workshop participation and members’ likelihood of taking advantage of Anthem initiatives and new medications. While these other factors may be important, the consistency of the statistically significant improvements across multiple domains suggests a positive impact of workshop participation.

Attrition may also have affected outcomes (people with negative results may be more likely to avoid 12-month follow-up questionnaires). However, considering the large initial sample (n=1229) and large number of outcomes, there were only a few baseline statistical differences between 12-month completers and noncompleters, suggesting only minimal possible attrition bias.

For the analyses of changes for those with the 4 criteria conditions, regression to the mean might have contributed to the outcomes. However, the large differences in positive change scores for the worse-off compared with the smaller changes for the complementary subset of those relatively better-off suggest that not all of the improvements could have resulted from regression to the mean.

Even with the real-world pragmatic nature of the study, the participants were largely a self-selected population, perhaps more motivated than people who would not enroll. In 2016, the CMS Center for Innovation published a report from a 3000 plus person sample of people receiving Medicare [19]. Among other questions, they asked the likelihood of attending a wellness program if offered in their community in the next 6 months. Nearly 57% said that they were very likely (12.3%), likely (13.9%), or somewhat likely (30.6%) to enroll, and about half of these (46.4%) said they were interested in chronic diseases self-management programs.

As a community-based intervention, BCBH-D offered in 2 modes was associated with small but significant nonreinforced benefits, which were sustained for at least 1 year. The 2 different modes were able to reach somewhat different populations. This illustrates that offering more than 1 delivery mode reaches a broader population. Overall, there was little difference in 12-month improvements—participants in both delivery modes benefited similarly.

The program also appeared to meet some Healthy People 2020 diabetes objectives and could contribute to improved HEDIS and Medicare Star ratings. Most importantly, it was associated with clinically significant benefits for those with high HbA1c, for those with depression and hypoglycemia, as well as medication nonadherers and nonexercisers. The benefits differed by individual, but a large majority of the population had meaningful improvements in at least one of the areas. This study demonstrates that the peer-facilitated BCBH-D program, offered outside of the traditional health care system, can assist a national sample of health-plan members in improving their diabetes management, with benefits persisting for at least 1 year. This, and similar multidelivery-mode programs have the potential for making an impact on our growing diabetes population.