Published on 23.08.16 in Vol 18, No 8 (2016): August
Use and Appreciation of a Tailored Self-Management eHealth Intervention for Early Cancer Survivors: Process Evaluation of a Randomized Controlled Trial
This is a corrected version. See correction statement: http://www.jmir.org/2016/9/e242/
Background: A fully automated computer-tailored Web-based self-management intervention, Kanker Nazorg Wijzer (KNW [Cancer Aftercare Guide]), was developed to support early cancer survivors to adequately cope with psychosocial complaints and to promote a healthy lifestyle. The KNW self-management training modules target the following topics: return to work, fatigue, anxiety and depression, relationships, physical activity, diet, and smoking cessation. Participants were guided to relevant modules by personalized module referral advice that was based on participants’ current complaints and identified needs.
Objective: The aim of this study was to evaluate the adherence to the module referral advice, examine the KNW module use and its predictors, and describe the appreciation of the KNW and its predictors. Additionally, we explored predictors of personal relevance.
Methods: This process evaluation was conducted as part of a randomized controlled trial. Early cancer survivors with various types of cancer were recruited from 21 Dutch hospitals. Data from online self-report questionnaires and logging data were analyzed from participants allocated to the intervention condition. Chi-square tests were applied to assess the adherence to the module referral advice, negative binominal regression analysis was used to identify predictors of module use, multiple linear regression analysis was applied to identify predictors of the appreciation, and ordered logistic regression analysis was conducted to explore possible predictors of perceived personal relevance.
Results: From the respondents (N=231; mean age 55.6, SD 11.5; 79.2% female [183/231]), 98.3% (227/231) were referred to one or more KNW modules (mean 2.9, SD 1.5), and 85.7% (198/231) of participants visited at least one module (mean 2.1, SD 1.6). Significant positive associations were found between the referral to specific modules (range 1-7) and the use of corresponding modules. The likelihoods of visiting modules were higher when respondents were referred to those modules by the module referral advice. Predictors of visiting a higher number of modules were a higher number of referrals by the module referral advice (β=.136, P=.009), and having a partner was significantly related with a lower number of modules used (β=-.256, P=.044). Overall appreciation was high (mean 7.5, SD 1.2; scale 1-10) and was significantly predicted by a higher perceived personal relevance (β=.623, P=.000). None of the demographic and cancer-related characteristics significantly predicted the perceived personal relevance.
Conclusions: The KNW in general and more specifically the KNW modules were well used and highly appreciated by early cancer survivors. Indications were found that the module referral advice might be a meaningful intervention component to guide the users in following a preferred selection of modules. These results indicate that the fully automated Web-based KNW provides personal relevant and valuable information and support for early cancer survivors. Therefore, this intervention can complement usual cancer aftercare and may serve as a first step in a stepped-care approach.
Trial Registration: Nederlands Trial Register: NTR3375; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=3375 (Archived by WebCite at http://www.webcitation.org/6jo4jO7kb)
J Med Internet Res 2016;18(8):e229
Recovery from cancer and its treatment can be challenging for cancer survivors. A variety of physical, psychosocial, and lifestyle difficulties might impede the resumption of previous daily life activities . Cancer aftercare guidelines for oncology professionals recommend paying attention to the early detection and recognition of psychological distress, fatigue, pain, problems with daily activities, lifestyle risks, and also to stimulating self-care within the first year after completing the primary curative cancer treatment [ , ]. Further, due to the aging population and improved cancer care, the population of cancer survivors is growing while complaints, needs, and preferences of cancer survivors can vary individually over the different subjects and time [ - ]. For these reasons, fully automated, computer-tailored Web-based cancer aftercare interventions may be suitable for providing a large number of cancer survivors with personalized advice at relatively low costs [ ]. Moreover, online solutions fit well with the increasing numbers of cancer survivors who search the Internet for health-related information, especially with those survivors who do not seek face-to-face guidance or treatment [ , ]. Web-based interventions might be appropriate to be integrated as a first step in a stepped-care approach as it offers a low-intensive intervention first before referring to interventions that are more intensive. Such first-step, low-intensive interventions might be sufficient to meet the personal needs of a large proportion of survivors with relatively mild complaints and are less costly [ ]. In addition, Web-based interventions can comprise relevant information as written text, videos, animations, interactive features, hyperlinks, while personalization of the content is possible by applying computer tailoring [ - ].
The Web-based intervention Kanker Nazorg Wijzer (Cancer Aftercare Guide, KNW) is a fully automated intervention that aims to increase survivors’ quality of life (QoL) by providing psychosocial support as well as promoting positive lifestyle changes, and it targets cancer survivors of any type of cancer . The KNW consists of seven self-management training modules covering the topics return to work, fatigue, anxiety and depression, social relationship and intimacy issues, physical activity, diet, and smoking cessation (see ), supplemented with one general information module on residual symptoms. Based on the responses to a screening questionnaire, cancer survivors receive personalized advice on which KNW modules are most relevant for them to use. This Module Referral Advice (MRA) is designed in a fashion analogous to traffic lights as displayed in . This MRA aims to guide participants through the wide-ranging KNW portal, based on experienced complaints and identified needs, as assessed by the screening questionnaire. The KNW has been shown to be effective in reducing fatigue and depressive symptoms and in improving quality of life domains (ie, emotional and social functioning) [ ]. In addition, strong indications were found that KNW users are engaged in more moderate physical activity and have a higher intake of vegetables, fruits, and fish 6 months after they started using the KNW [ ]. Besides assessing the effects of the KNW, it is important to understand how this complex intervention was used and appreciated by the participants, whether use and appreciation was predicted by certain user characteristics, and to evaluate relevant key intervention components [ , - ]. Moreover, it is essential to examine specifically whether the provided information was perceived as personally relevant in order to evaluate the computer tailoring.
Previously published Web-based interventions in the areas of lifestyle, mental health, and chronic conditions differ with regard to the number of (cancer-related) topics, the composition of the target group, the intervention components, and the delivery mode [, - ]. Generally, typical Web-based interventions are modular in set-up, are updated weekly, require weekly visits, last for about 10 weeks, and include interaction with the system, peers, or a counselor [ ]. The actual use of most interventions was low, or data on the use have been poorly reported [ , ]. The extent of use might be influenced by differences in participant and intervention characteristics [ ]. Prior studies among cancer survivors have shown that different user characteristics were related to different user patterns: for example, a higher usage was found among those with low levels of self-reported social support and a high illness burden, and among survivors who were working and who received radiotherapy [ , ]. Being female, middle aged or older, having mid to high levels of education, a healthy body mass index (BMI), a healthier lifestyle, and having a low quality of life were predictors for a higher use of (multiple behavior) eHealth interventions among the general population [ , ]. Reported intervention characteristics that might predict usage were peer or counselor support, in-person contact, updates of the intervention, and sending reminders [ , , ]. According to previously published studies, mixed results were found on the relationship between intervention usage and outcomes, such as symptom distress, depression, and lifestyle behaviors [ , , ]. With regard to appreciation, prior studies reported that Web-based interventions were positively evaluated by cancer survivors, and a higher use was associated with a higher appreciation in a generic Web-based intervention for breast cancer survivors [ , , ].
The design of the KNW portal differs from most of the existing Web-based interventions for cancer survivors by providing personalized self-management training on seven topics and by allowing users to choose which modules they want to use during an intervention period of 6 months. Previously identified effective intervention characteristics of Web-based lifestyle interventions were tailored feedback, the use of theory, interactivity, goal setting, and online or in-person contact [, ]. The KNW comprises all these elements, except for in-person contact. However, the MRA provides automated personalized guidance through the KNW modules. Given the large scope and the varied target group of the KNW portal, it is important to assess how the intervention was used, appreciated, whether the content was sufficiently tailored to be perceived as personal relevant, and what possible factors, including personal relevance, might predict the module use and its appreciation. In addition, the MRA might be a meaningful intervention component; therefore, the association between the MRA and the KNW module use also needs to be evaluated.
The main objective of this study is threefold: (1) to describe the use of the KNW modules and to identify predictors of a higher number of modules used, (2) to investigate the adherence to the provided MRA, and (3) to describe the appreciation of the KNW and its predictors. Additionally, to explore how well the tailoring worked and whether the perceived personal relevance might be different among subgroups, we explored possible predictors of personal relevance.
This process evaluation was conducted as part of a two-armed randomized controlled trial (RCT) that evaluates the effects of the KNW portal. For the purpose of this report, all respondents of the intervention condition were included in the analyses. The details of the trial design, sample size calculation, participant eligibility, recruitment procedures, and the intervention have been published elsewhere [- ]. Ethical approval for this trial (Dutch Trial Register NTR3375) was obtained from the Medical Research Ethics Committee, METC Z (NL41445.096.12, 12-T-115). All procedures performed in this study were in accordance with the ethical standards of the institutional and national research committee and with the 1964 Helsinki declaration and its later amendments of comparable ethical standards. Informed consent was obtained from all individual participants included in the study.
Specific Intervention Elements: Module Referral Advice and Module Principles
A comprehensive description of the intervention, including the eight KNW modules, the underlying theoretical frameworks, and technical features are published in detail elsewhere [, ]. This section describes the details of the MRA that was based on personal scores from the baseline questionnaire and that can refer to the seven self-management modules of the KNW (see ). The classification criteria for green, orange, and red MRA are summarized in [ - ]. A green MRA signifies that the respondent reported no complaints, or minor complaints or needs, concerning the specific topic. Therefore, following the correspondent module is not a high priority. An orange MRA was provided when the respondents reported elevated but not severe complaints, or when respondents partially adhered to the lifestyle recommendations of the World Cancer Research Fund/American Institute for Cancer Research and the American Cancer Society [ , ]. The orange advice praises respondents’ reasonably positive scores; however, it is recommended that they follow the corresponding module for further improvement. This orange category includes a wide coverage of score ranges, allowing for participants with higher, but not severe scores to still receive some positive and encouraging feedback and not lose their motivation to follow a module due to feedback that might be perceived as too stringent. A red MRA was provided only when severe psychosocial complaints, problematic functioning, or low/no adherence to lifestyle recommendations was reported, thus indicating that the respondent might be in high need of support concerning the specific topic. In that case, it was strongly recommended to follow the corresponding module. More detailed information on the underlying measures and cut-off points is included in .
|Measurements and classification criteriaa||MRA categories|
|Fatigue||CIS, subscale subjective fatigue (1-56) ||<27||27-35||>35|
|Return to work||Extended CaSUN [, ]: Needs to adjust/ find a job (0-5); Needs to receive financial support (0-5); Needs support up on returning to work (0-5); Needs legal information (0-5)||No needs||Score on needs 3-12||Score on needs ≥13|
|Mood||HADS-A (0-21); HADS-D (0-21) ; MAC: dimension negative adjustment to cancer (16-64) [ ]||HADS-A<8 and HADS-D<8 and MAC ≤36||HADS-A < 8 and HADS-D 8-15 and/ or MAC > 36; HADS-A 8-15 and HADS-D <8 or 8-15||HADS-A < 8 or 8-15 and HADS-D >15; HADS-D < 8 or 8-15 and HADS-A >15|
|Relationships||SSL-D (6-24) / CaSUN (2 itemsb)||SSL-D ≤7||SSL-D=8 or 9 & needs CaSUN||SSL-D ≥10 & needs CaSUN|
|Physical activity||SQUASH [, ]: Weekly ≥150 min moderate to vigorous PA; Daily ≥30 min of moderate PA on ≥5 days p/w||Meeting both conditions||Meeting 1 out of 2 conditions||Meeting no conditions|
|Diet||Dutch Standard Questionnaire on Food Consumption : Daily ≥200g vegetables; Daily ≥2 pieces of fruit; Weekly ≥2 servings of fish; Daily ≥15g whole grainsc; Daily ≥4 servings of potatoes/ whole-grain rice/ whole-grain pasta||Meeting at least 4 out of 5 conditions||Meeting 2 or 3 out of 5 conditions||Meeting 1 or 0 out of five conditions|
|Smoking||Smoking, not smoking, time point of quitting ||Never/formersmokers, quit prior to cancer diagnosis||Quit smoking after cancer diagnosis||Current smokers|
aCIS: Checklist Individual Strength; PA: physical activity; HADS: Hospital Anxiety and Depression Scale, HADS-A: subscale anxiety, HADS-D: subscale depression; MAC: Mental Adjustment to Cancer Scale; SSL-D: Social Support List‒discrepancy subscale; SQUASH: Short Questionnaire to Assess Health Enhancing Physical Activity
bNeeds related to sexuality and fertility.
cWhole-grain bread, oatmeal, cereals.
Throughout the different KNW intervention modules, principles of problem-solving therapy, cognitive behavioral therapy, social cognitive theories, and self-regulation theories were applied [- ]. According to the I-Change Model [ ], awareness factors such as knowledge, cues to action, and risk perception might be important determinants in the dynamic process of behavior change by influencing motivation and intention. By applying the MRA, participants were made aware of their current psychosocial status and lifestyle behaviors in relation to the norms and guidelines, with the aim of guiding the participants toward the appropriate self-management modules. When using the modules, self-management skills training was provided by encouraging respondents to observe their current behavior more in detail, choose themes to work on, set goals, and to prepare action and coping plans, followed by monitoring their experiences and possible progress in the changed strategies and behaviors. Within the modules, the information and support was tailored to the current emotional status, lifestyle behavior, and motivational determinants (attitude, self-efficacy, intention) by the application of computer tailoring. Furthermore, the feedback was tailored to personal characteristics (gender, age, marital status, children, education level), and cancer-related and medical issues (type of cancer, comorbidities). Four weeks after completing (parts of) one module, the participants were invited to reflect on their behavioral change plans and experiences in a brief personalized evaluation session. They were also encouraged to continue applying the previously recommended self-management skills. Furthermore, valuable generic information about lifestyle and psychosocial issues was accessible when visiting the user forum and the monthly news items.
All data were derived from online self-report questionnaires and logging details.
Module use was assessed by using logging data. Actual use was dichotomized (yes/no) for each module separately (in total eight modules). Module use was categorized into “yes” when at least the first three pages of a module were used. These three pages comprised important key information after which participants followed personalized pathways through the modules. The individual pathways were based on the responses to the baseline questionnaire, own preferences and goals, and take into consideration that the amount of needed information and/or support can vary to initiate behavior change . Additionally, by assessing login data (last day the separate modules were used), the number of weeks of module engagement was registered.
At 6-month follow-up, the overall rating of the KNW and separate ratings for each of the used module(s) were assessed on a scale ranging from 1 (very poor) to 10 (outstanding) (eg, “Overall, how do you rate the KNW? Select your rating (1-10)”; “How do you rate module mood on a scale from 1 to 10”). Further, four separate items were measured to evaluate whether the provided information and support was understandable, useful, personally relevant, and recommendable to fellow patients, on a 5-point Likert-scale, ranging from 1 (low) to 5 (high). The perceived personal relevance (“Was the information from the Kanker Nazorg Wijzer of personal relevance for you?”) was included in the analysis of this study to explore whether computer tailoring worked well within the KNW. These items correspond to items that were used in other studies to measure the appreciation of Web-based interventions [- ].
Demographic and Cancer-Related Variables
Information about demographic and cancer-related characteristics was collected at baseline. Standard questions were used to measure age, gender, and marital status. Marital status was dichotomized into “with partner” (married, cohabiting partners) and “without partner” (single, divorced, widowed). Education level was categorized into “low” (lower vocational education, medium general secondary education), “medium” (secondary vocational education, higher general secondary education), and “high” (higher vocational education, university education). Employment status was dichotomized into “working” (self-employed, in paid employment) and “not working” (unemployed, retired, unable to work). Type of cancer was categorized into breast, colorectal, and other types of cancer (ie, bladder, esophageal, gynecologic, hematologic, kidney, liver, lung, prostate, stomach, testicular, and thyroid cancer). Type of treatment was categorized into surgery and chemotherapy and radiotherapy, surgery and chemotherapy, surgery and radiotherapy, and other types of treatment. Further, aftercare (yes/no) and comorbidities (yes/no) were measured, and height and weight were assessed to determine BMI. The time since completion of primary treatment in weeks was based on registry data from the hospitals.
The analyses were performed using STATA version 13.1. Descriptive statistics were used to describe demographic and cancer-related characteristics of the module (non-) users and the number of weeks of module engagement among all participants of the intervention condition at baseline. To calculate the appreciation outcomes, participants who completed the relevant questions at the 6-month measurement and who used the corresponding modules were included. Chi-square tests were used to determine the relationships between the MRA and the subsequent module use with a two-sided alpha=.05 level of significance. Negative binominal regression analysis was used to identify the predictors of a higher number of modules used (0-8), due to overdispersed count data. Independent variables (hypothesized predictors) were demographic variables (gender, age, marital status, education, employment), cancer-related variables (cancer type, type of treatment, number of weeks after completing primary cancer treatment, aftercare, comorbidities, BMI), the number of red and orange MRA, ranging from 0-7, and the perceived personal relevance, ranging from 1-5. To examine the predictors of a higher overall appreciation of the KNW, multiple linear regression analysis was applied among participants who completed the follow-up questionnaire after 6 months. The dependent variable was the overall rating of the KNW, measured at 6-month follow-up, ranging from 1-10. The same independent variables as described above were counted as predictors. Furthermore, the number of used modules (sum score 0-8) was added to the multiple linear regression model. To explore possible predictors of perceived personal relevance, ordered logistic regression analysis was conducted, taking into consideration that the dependent variable, perceived personal relevance, was an ordinal variable, ranging from 1-5. Within this analysis, all demographic and cancer-related characteristics were added as independent variables. Dummy coding was used for categorical variables including more than two categories and the continuous and ordinal variables were standardized in all conducted regression analyses. Since filling out all computer-based questions was required, and respondents were reminded automatically if a question was not answered, there were no missing data at baseline. Missing data at 6-month follow-up due to dropout were not imputed when calculating appreciation outcomes.
Baseline characteristics of the intervention participants are displayed in. The majority of the participants was female (79.2%, 183/231), mean age was 55.6 (SD 11.5) years, and 70.1% (162/231) had been treated for breast cancer. A detailed overview of cancer diagnoses among the sample is shown in . Mean time since completing primary cancer treatment was 25.1 (SD 13.5) weeks.
The majority (80-100%) of the module users continued after reading the first three compulsory pages of the different modules. The numbers and percentages of participants who used the separate modules are displayed in. The diet module (134/231, 58.0%) was used most often, and the smoking module was used least often (23/231, 10.0%). However, from all the smokers at baseline (n=27), 13 (48%) individuals used the module Smoking. Overall, the participants used on average 2.1 (SD 1.6) KNW modules; 14.3% (33/231) used no modules, 30.3% (70/231) used one module, 18.2% (42/231) used two modules, 21.2% (49/231) used three modules, 8.7% (20/231) used four modules, 3.9% (9/231) used five modules, and 3.4% (8/231) individuals used six or more modules. Module engagement was highest during the first 16 weeks after getting KNW access: around 80% of the users used the modules within this period.
Provided Module Referral Advice
displays how the red, orange, and green MRA ranged among the participants and how the modules were used. For fatigue, diet, and smoking, more red compared to orange MRA was provided, and for return to work, mood, relationships, and PA, more orange compared to red MRA was given. Green MRA was most frequently given with regard to smoking, return to work, mood, and relationships. Module use after getting a red or orange MRA was 58.8% and 38.6% for module fatigue, 55.6% and 52.4% for module return to work, 25% and 30.3% for module mood, and 25.9% and 27.3% for module relationships. Concerning the lifestyle modules, module use after receiving a red or orange MRA for PA was 25% and 35%, for diet 50.4% and 68.7%, and for smoking 48.2% and 42.9%. From the 231 participants, 173 (74.9%) received at least one red MRA, and 192 (83.1%) received at least one orange MRA. On average, the participants were referred to 2.9 (SD 1.5) relevant modules (either red or orange MRA, not displayed).
Adherence to the Provided Module Referral Advice
The relations between the color of MRA (respectively red, orange, green) and module use are shown in. In general, the likelihood that participants actually used a relevant module was higher when the MRA was red or orange compared to green. When comparing module use after receiving a red MRA versus an orange MRA for the modules return to work, mood, relationships, PA, smoking, the differences were small, meaning that both colors led to comparable module participation. Participants used modules Fatigue (X2=4.599, P=.032, OR 2.262) more often when a red MRA was provided compared to an orange MRA. The diet module (X2=7.553, P=.006, OR .463) was used more often when an orange MRA was provided compared to a red MRA.
|Overall (N=231)||No module |
|Return to work |
|Physical activity |
|Residual symptoms |
|Female, n (%)||183 |
|Age, mean (SD)||55.6 |
|With partner, n (%)||193 |
|BMI, mean (SD)||26.0 |
|Education, n (%)|
|Working at baseline, n (%)||122 |
|Type of cancer, n (%)|
|Had cancer before, n (%)||24 |
|Treatment, n (%)|
|Surgery, chemo, radio||86 |
|Surgery, chemo||61 |
|Surgery, radio||46 |
|Weeks since completion treatment, mean (SD)||25.1 |
|Having comorbidities, n (%)||62 |
|Using aftercare, n (%)||145 |
|Followed module, %||Followed module, %||Followed module, %|
|Return to work||3.9||55.6||44.4||18.2||52.4||47.6||77.9||14.4||85.6|
|Module (yes/no)||Red compared to orange||Red compared to green||Orange compared to green|
|X2||P||Odds ratio |
|X2||P||Odds ratio |
|X2||P||Odds ratio |
|Return to work||0.030||.863||1.136 |
|Physical activity||0.696||.404||.186 |
aStatistically significant result.
From the 231 participants who had access to the KNW intervention, 182 responded to the questions concerning appreciation after 6 months. The overall appreciation of the KNW was high (mean 7.5, SD 1.2) (). In general, the overall KNW was rated more positively among module users compared to non-module users. Ratings of the separate modules ranged from 6.4 (satisfactory) for the residual symptoms module to 8 (good) for smoking module. Personal relevance ranged from 2.9 to 3.5 (a little bit relevant to relevant). The ratings for comprehensibility, usefulness, and recommendation to other cancer survivors were all positive and very uniform ( ).
|Overall||No module||Fatigue||Return to work||Mood||Relationships||PA||Diet||Smoking||Residual symptoms|
|Overall KNW (1-10), mean (SD)||7.5 |
|Modules (1-10)a, mean (SD)||7.3 |
|Subquestions on content (1-5) b, mean (SD)|
|Personal relevant?||3.2 |
|Recommendable to fellow survivors?||3.9 |
aNo module n=18, fatigue n=47, return to work n=27, mood n=13, relationships n=11, PA n=28, diet n=77, smoking n=6, residual symptoms n=14.
bNo module n=18, fatigue n=67, return to work n=46, mood n=45, relationships n=34, PA n=45, diet n=115, smoking n=18, residual symptoms n=39.
Predictors of a Higher Number of Modules Used
Using a higher number of modules was predicted by a higher number of red/orange MRA (β=.136, P=.009), and by a higher perceived personal relevance (β=.150, P=.014). Moreover, having a partner was significantly related with a lower number of modules used (β=-.256, P=.044) ().
Predictors of a Higher Appreciation of KNW Overall
A higher appreciation with the overall KNW was significantly predicted by a higher perceived personal relevance (β=.623, P=.000) (). None of the demographic and cancer-related variables, or the number of red/orange MRA, or number of modules used predicted a higher overall appreciation of the KNW intervention.
Predictors of a Higher Perceived Personal Relevance
None of the demographic and cancer-related characteristics significantly predicted the perceived personal relevance of the KNW content, indicating that the KNW content was rated comparably personal relevant among individuals with different demographic and cancer-related characteristics ().
This process evaluation of the Web-based KNW evaluated the automated guidance toward the KNW modules and subsequent module use, and the appreciation of this intervention. Despite the noncommittal nature of the KNW, more than 85% of the participants used one or more of the eight modules, and there was clear interest in all eight modules. This result confirms the need for wide-ranging support among early cancer survivors. Interestingly, automated referrals to specific modules were related to a higher number of modules used. Moreover, the complex KNW was highly appreciated and perceived as personal relevant by early cancer survivors.
The MRA aimed to guide the respondents toward the appropriate modules by giving feedback about current problem areas and needs. Cancer survivors might not have noticed some of these needs, and the MRA may have raised awareness about these topics. The importance of increasing awareness is theoretically grounded as described by Weinstein and Sandman  in their Precaution Adoption Process Model. That model includes a sequence of five stages within behavior change: “unaware of the issue,” “aware of the issue but not personally engaged,” “engaged and deciding what to do,” “planning to act but not yet having acted,” and “acting.” Prior research confirmed that a considerable number of colorectal cancer survivors were unaware of healthy diet recommendations, and older cancer survivors reported being less aware of the beneficial effects of a healthy lifestyle [ , ]. In addition, research revealed that cancer survivors might be less aware of available psychosocial support and solutions to psychosocial problems, while, for example, addressing maladaptive illness perceptions and adopting a more adaptive self-management may lead to better health outcomes [ , ]. Consequently, curiosity about available self-management support needs to be encouraged [ ]. In accordance with the I-Change Model, the MRA could increase knowledge about the current level of well-being, psychosocial conditions, and lifestyle behavior. Besides that, the MRA could elevate the risk perception and may serve as a cue to action with regard to the relevant topics, given that the solutions to the problems are provided (relevant self-management module) [ ]. These awareness/solution triggers might positively influence the motivation and intention to perform desired behavior, which is in line with the findings of Walthouwer et al [ ], who identified awareness as an important moderator in the relationship between psychosocial determinants and specific dietary behavior (eating in moderation) in the general population. Results in our study illustrate that these awareness/solution triggers are most likely to be followed when a red or orange MRA was provided. Thus, the MRA successfully referred those respondents with elevated as well as severe complaints and/or needs. However, this did not apply for fatigue because highly fatigued respondents (red MRA) were more likely to use the fatigue module compared to participants with less fatigue (orange MRA). Additionally, with regard to diet, results might indicate that especially those who were already engaged more in a healthy diet were more likely to use the diet module. Furthermore, the topic diet could be of general interest to the participants, while the topic fatigue might be most interesting for participants with specific complaints. Consequently, the MRA may be a meaningful intervention component to increase motivation, subsequent module use, and problem-solution, while MRA adherence might be related to the specific behavior. Using topic-specific KNW modules has shown to be effective in decreasing fatigue, depressive feelings, and was beneficial in increasing moderate physical activity and fruit and fish consumption [ , ].
Within the KNW, participants were referred on average to 2.9 modules, while on average 2.1 modules were used. The appreciation rates were high, and the results showed that a higher number of modules used did not contribute to a higher appreciation. However, a higher perceived personal relevance did contribute to a higher appreciation. This is in line with Wilson et al  reporting that a moderate number of recommendations in multiple behavior interventions might produce the highest level of change, while engagement with a higher number of recommendations might be too demanding. Within the KNW, respondents were allowed to make their own choices, despite the provided MRA. Prior research confirms that the possibility to choose within multiple behavior interventions may prevent high attrition rates and could improve intervention outcomes [ , , ]. Offering wide ranging support in combination with personalized referral to relevant topics and the possibility to choose might prevent overload. Donkin et al [ ] support this suggestion by reporting that a certain level of usage might be needed to obtain benefit from an online intervention for depression. However, after reaching a point of therapy saturation, little or no additional program gains might be expected. This is in line with a Web-based study among cancer survivors and with another Web-based obesity prevention study among the general population, which reported that more intervention use did not result in better intervention outcomes [ , ]. Using a higher number of modules may not be necessary for all users to benefit most from the KNW. Our results revealed that having no partner was related to the use of a higher number of modules, and participants who were in greater need of support (higher number of red/orange MRA) indeed used a higher number of modules. This is consistent with the findings of Borosund et al [ ], who reported that, in particular, cancer survivors with low levels of social support and a high illness burden used self-management components of a Web-based illness management support system. Furthermore, higher perceived personal relevance was related to using a higher number of modules, which might be explained by receiving a higher amount of computer-tailored content within the modules. The overall KNW was highly appreciated with an average grade of 7.5, indicating an appreciation from very satisfactory to good. The low variability (SD 1.2) indicates a considerably unanimous positive rating 6 months after getting access to the KNW. Results from our study indicate that perceived personal relevance might be a key component to explain a higher appreciation. Computer tailoring was applied within the KNW in order to create personal relevant feedback. Since perceived personal relevance could not be predicted by demographic and cancer-related characteristics, we can conclude that the tailoring of information worked well. In comparison, the overall satisfaction of a generic fully automated Web-based self-management intervention for breast cancer survivors was mean 7 (SD 1.2) [ ]. In addition, the overall appreciation of a Web-based weight management intervention for overweight adults was mean 6.6, and the overall appreciation of a Web-based text- and video-tailored intervention for smoking cessation in the general population was mean 6.45 (SD 1.62; scales ranged from 1-10) [ , ]. The overall appreciation ratings of KNW module users were more positive than the ratings of module non-users, although the module non-users were still quite positive in their ratings. In addition to the modules, the KNW has a user forum and participants received monthly emails inviting them to visit generic monthly news items. Filling out the screening questionnaire and follow-up questionnaires, combined with receiving personalized feedback on problem areas (by the MRA), as well as the additional KNW features, might already have raised awareness and provided other valuable information to achieve benefits among module non-users. Overall, the high appreciation rate indicates that the broad design and tailored information of the KNW seem to fit well with the needs of early cancer survivors (in which, breast cancer survivors were overrepresented).
Some limitations need to be addressed. First, providing data on completion of the separate themes and specific activities within the modules, and on completion of the evaluation sessions was not possible due to the module design. This information might be interesting for future studies; therefore, we recommend future interventions to study in more detail participation of intervention modules. Second, within our study, it was not possible to compare the relationships between the MRA and module use to a control group not receiving the MRA. Consequently, these associations need to be interpreted with caution, as it is conceivable that without the MRA, some of the same modules would have been used. Future experimental research might explore the specific effects of a similar automated referral system on subsequent choices. Third, this eHealth intervention requires respondents to have computer skills and health literacy, such as competence at accessing, understanding, appraising, and applying the health information provided . However, since eHealth literacy was not assessed in this study, it is not possible to estimate the extent to which this might have influenced initial recruitment and the use and appreciation of the KNW. Fourth, mainly middle-aged, female breast cancer survivors who scored fairly well on QoL and depression participated, which might be too selective a group to represent the general cancer survivor population. During recruitment, mainly breast cancer outpatient clinics participated. Five-year survival rates of breast cancer are relatively high [ ]. Unless mostly females with higher socioeconomic status are reached in Web-based interventions in general, interpretations of these findings should be viewed with caution [ ].
The general KNW and the KNW modules were substantially used and highly appreciated by early cancer survivors, thus confirming the need for wide-ranging support among this target group. Results indicate that the MRA may be seen as a meaningful key component of the fully automated KNW intervention by guiding users to follow a preferred selection of modules, given their current complaints and identified needs. Moreover, the overall intervention and separate modules were highly appreciated, which could be explained by a higher perceived personal relevance. We can conclude that computer tailoring worked well and that the range of topics, design, and personalized information suited the needs of early cancer survivors. This process evaluation adds meaningful information on the use and appreciation of Web-based cancer aftercare interventions and confirms that the KNW offers valuable and appropriate support for early cancer survivors to complement usual cancer aftercare and may serve as a first step in a stepped-care approach.
Our sincere thanks go to the medical staff of the Dutch hospitals, who were involved in recruitment of participants: Beatrix Hospital Gorinchem, Bernhoven Hospital Uden, Bronovo Hospital The Hague, Catharina Hospital Eindhoven, Diakonessenhuis Hospital Utrecht, Elkerliek Hospital Helmond, Flevo Hospital Almere, IJsselland Hospital Capelle aan den Ijssel, Ikazia Hospital Rotterdam, Laurentius Hospital Roermond, Lievensberg Hospital Bergen op Zoom, Maasstad Hospital Rotterdam, Sint Anna Hospital Geldrop, Sint Jans Gasthuis Hospital Weert, Slingeland Hospital Doetinchem, Spaarne Hospital Hoofddorp, University Medical Center Groningen, University Medical Center Maastricht, VieCuri Medical Center Venlo, Langeland Hospital Zoetermeer, Zuyderland Medical Center Heerlen, and Sittard-Geleen.
Special thanks to Audrey Beaulen who provided helpful assistance in the recruitment of the subjects, and Linda Küsters for her contribution in the development of the lifestyle modules.
This research project was funded by the Dutch Cancer Society (grant number NOU2011-5151).
Conflicts of Interest
Multimedia Appendix 1
Determination of the Module Referral Advice categories (red, orange, green).PDF File (Adobe PDF File), 23KB
Multimedia Appendix 2
Overview of cancer diagnoses among the KNW sample.PDF File (Adobe PDF File), 16KB
Multimedia Appendix 3
Predictors of a higher number of followed KNW modules (N=182).PDF File (Adobe PDF File), 31KB
Multimedia Appendix 4
Predictors of a higher appreciation of KNW (N=182).PDF File (Adobe PDF File), 31KB
Multimedia Appendix 5
Predictors of a higher perceived personal relevance of KNW content (N=182).PDF File (Adobe PDF File), 24KB
- Bluethmann SM, Basen-Engquist K, Vernon SW, Cox M, Gabriel KP, Stansberry SA, et al. Grasping the 'teachable moment': time since diagnosis, symptom burden and health behaviors in breast, colorectal and prostate cancer survivors. Psychooncology 2015 Jun 8:Epub ahead of print. [CrossRef] [Medline]
- Netherlands Comprehensive Cancer Organisation. Guideline cancer survivorship care URL: http://oncoline.nl/index.php?language=en [accessed 2016-05-15] [WebCite Cache]
- Runowicz CD, Leach CR, Henry NL, Henry KS, Mackey HT, Cowens-Alvarado RL, et al. American Cancer Society/American Society of Clinical Oncology Breast Cancer Survivorship Care Guideline. J Clin Oncol 2016 Feb 20;34(6):611-635. [CrossRef] [Medline]
- Willems RA, Bolman CAW, Mesters I, Kanera IM, Beaulen AJM, Lechner L. Cancer survivors in the first year after treatment: the prevalence and correlates of unmet needs in different domains. Psychooncology 2016 Jan;25(1):51-57. [CrossRef] [Medline]
- Kanera IM, Bolman CAW, Mesters I, Willems RA, Beaulen AJM, Lechner L. Prevalence and correlates of healthy lifestyle behaviors among early cancer survivors. BMC Cancer 2016;16:4 [FREE Full text] [CrossRef] [Medline]
- The Netherlands Cancer Registry. Cijfers over kanker (statistics on cancer). 2016. URL: http://www.cijfersoverkanker.nl [accessed 2016-05-13] [WebCite Cache]
- Given CW, Given BA. Symptom management and psychosocial outcomes following cancer. Semin Oncol 2013 Dec;40(6):774-783. [CrossRef] [Medline]
- Kohl LF, Crutzen R, de Vries NK. Online prevention aimed at lifestyle behaviors: a systematic review of reviews. J Med Internet Res 2013;15(7):e146 [FREE Full text] [CrossRef] [Medline]
- Chou WS, Liu B, Post S, Hesse B. Health-related Internet use among cancer survivors: data from the Health Information National Trends Survey, 2003-2008. J Cancer Surviv 2011 Sep;5(3):263-270. [CrossRef] [Medline]
- Ritterband LM, Tate DF. The science of internet interventions. Introduction. Ann Behav Med 2009 Aug;38(1):1-3. [CrossRef] [Medline]
- Krebber AM, Leemans CR, de Bree R, van Straten A, Smit F, Smit EF, et al. Stepped care targeting psychological distress in head and neck and lung cancer patients: a randomized clinical trial. BMC Cancer 2012;12:173 [FREE Full text] [CrossRef] [Medline]
- Broekhuizen K, Kroeze W, van Poppel MN, Oenema A, Brug J. A systematic review of randomized controlled trials on the effectiveness of computer-tailored physical activity and dietary behavior promotion programs: an update. Ann Behav Med 2012 Oct;44(2):259-286 [FREE Full text] [CrossRef] [Medline]
- Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull 2007 Jul;133(4):673-693. [CrossRef] [Medline]
- de Vries H, Brug J. Computer-tailored interventions motivating people to adopt health promoting behaviours: introduction to a new approach. Patient Educ Couns 1999 Feb;36(2):99-105. [Medline]
- Willems RA, Bolman CAW, Mesters I, Kanera IM, Beaulen AAJM, Lechner L. The Kanker Nazorg Wijzer (Cancer Aftercare Guide) protocol: the systematic development of a web-based computer tailored intervention providing psychosocial and lifestyle support for cancer survivors. BMC Cancer 2015;15:580 [FREE Full text] [CrossRef] [Medline]
- Willems RA, Bolman CAW, Mesters I, Kanera IM, Beaulen AAJM, Lechner L. Short-term effectiveness of a web-based tailored intervention for cancer survivors on quality of life, anxiety, depression, and fatigue: randomized controlled trial. Psychooncology 2016 Mar 14:-. [CrossRef] [Medline]
- Kanera IM, Bolman CAW, Willems RA, Mesters I, Lechner L. Lifestyle-related effects of the web-based Kanker Nazorg Wijzer (Cancer Aftercare Guide) intervention for cancer survivors: a randomized controlled trial. J Cancer Surviv 2016 Mar 17:-. [CrossRef] [Medline]
- Hulscher ME, Laurant MG, Grol RP. Process evaluation on quality improvement interventions. Qual Saf Health Care 2003 Feb;12(1):40-46 [FREE Full text] [Medline]
- Steckler A, Linnan L. Process evaluation for public health interventions and research. San Francisco, CA: Jossey-Bass; 2002.
- Brouwer W, Kroeze W, Crutzen R, de Nooijer J, de Vries NK, Brug J, et al. Which intervention characteristics are related to more exposure to internet-delivered healthy lifestyle promotion interventions? A systematic review. J Med Internet Res 2011;13(1):e2 [FREE Full text] [CrossRef] [Medline]
- Goode AD, Lawler SP, Brakenridge CL, Reeves MM, Eakin EG. Telephone, print, and Web-based interventions for physical activity, diet, and weight control among cancer survivors: a systematic review. J Cancer Surviv 2015 Dec;9(4):660-682. [CrossRef] [Medline]
- Kim AR, Park HA. Web-based Self-management Support Interventions for Cancer Survivors: A Systematic Review and Meta-analyses. Stud Health Technol Inform 2015;216:142-147. [Medline]
- Kuijpers W, Groen WG, Aaronson NK, van Harten WH. A systematic review of web-based interventions for patient empowerment and physical activity in chronic diseases: relevance for cancer survivors. J Med Internet Res 2013;15(2):e37 [FREE Full text] [CrossRef] [Medline]
- van den Berg SW, Peters EJ, Kraaijeveld JF, Gielissen MF, Prins JB. Usage of a generic web-based self-management intervention for breast cancer survivors: substudy analysis of the BREATH trial. J Med Internet Res 2013;15(8):e170 [FREE Full text] [CrossRef] [Medline]
- McAlpine H, Joubert L, Martin-Sanchez F, Merolli M, Drummond KJ. A systematic review of types and efficacy of online interventions for cancer patients. Patient Educ Couns 2015 Mar;98(3):283-295. [CrossRef] [Medline]
- Kelders SM, Kok RN, Ossebaard HC, Van Gemert-Pijnen JE. Persuasive System Design Does Matter: A Systematic Review of Adherence to Web-Based Interventions. J Med Internet Res 2012;14(6):e152 [FREE Full text] [CrossRef] [Medline]
- Ritterband LM, Thorndike FP, Cox DJ, Kovatchev BP, Gonder-Frederick LA. A behavior change model for internet interventions. Ann Behav Med 2009 Aug;38(1):18-27 [FREE Full text] [CrossRef] [Medline]
- Børøsund E, Cvancarova M, Ekstedt M, Moore SM, Ruland CM. How user characteristics affect use patterns in web-based illness management support for patients with breast and prostate cancer. J Med Internet Res 2013;15(3):e34 [FREE Full text] [CrossRef] [Medline]
- Berry DL, Blonquist TM, Patel RA, Halpenny B, McReynolds J. Exposure to a patient-centered, Web-based intervention for managing cancer symptom and quality of life issues: impact on symptom distress. J Med Internet Res 2015;17(6):e136 [FREE Full text] [CrossRef] [Medline]
- Reinwand DA, Schulz DN, Crutzen R, Kremers SP, de Vries H. Who Follows eHealth Interventions as Recommended? A Study of Participants' Personal Characteristics From the Experimental Arm of a Randomized Controlled Trial. J Med Internet Res 2015;17(5):e115 [FREE Full text] [CrossRef] [Medline]
- Brouwer W, Oenema A, Raat H, Crutzen R, de Nooijer J, de Vries NK, et al. Characteristics of visitors and revisitors to an Internet-delivered computer-tailored lifestyle intervention implemented for use by the general public. Health Educ Res 2010 Aug;25(4):585-595 [FREE Full text] [CrossRef] [Medline]
- Schulz DN, Schneider F, de VH, van Osch LA, van Nierop PW, Kremers SP. Program completion of a web-based tailored lifestyle intervention for adults: differences between a sequential and a simultaneous approach. J Med Internet Res 2012;14(2):e26 [FREE Full text] [CrossRef] [Medline]
- Donkin L, Hickie IB, Christensen H, Naismith SL, Neal B, Cockayne NL, et al. Rethinking the dose-response relationship between usage and outcome in an online intervention for depression: randomized controlled trial. J Med Internet Res 2013;15(10):e231 [FREE Full text] [CrossRef] [Medline]
- Ritterband LM, Bailey ET, Thorndike FP, Lord HR, Farrell-Carnahan L, Baum LD. Initial evaluation of an Internet intervention to improve the sleep of cancer survivors with insomnia. Psychooncology 2012 Jul;21(7):695-705 [FREE Full text] [CrossRef] [Medline]
- De CK, Charlier C, Van Hoof E, Pauwels E, Lechner L, Bourgois J, et al. Development and usability of a computer-tailored pedometer-based physical activity advice for breast cancer survivors. Eur J Cancer Care (Engl) 2015 Sep;24(5):673-682. [CrossRef] [Medline]
- Vercoulen JHHM, Swanink CMA, Fennis JFM, Galama JMD, van der Meer JWM, Bleijenberg G. Dimensional assessment of chronic fatigue syndrome. J Psychosom Res 1994 Jul;38(5):383-392. [Medline]
- Hodgkinson K, Butow P, Hunt GE, Pendlebury S, Hobbs KM, Lo SK, et al. The development and evaluation of a measure to assess cancer survivors' unmet supportive care needs: the CaSUN (Cancer Survivors' Unmet Needs measure). Psychooncology 2007 Sep;16(9):796-804. [CrossRef] [Medline]
- Mesters I, Willems RA, Kanera IM, Bolman CAW, Keeman M, Lechner L. Psychometric Quality of the Extended Cancer information Needs Questionnaire (CaSUN-NL). In: Archives of Physical Medicine and Rehabilitation;. 2015 Presented at: American Congress of Rehabilitation Medicine; 25-30 October 2015; Dallas, TX p. e65.
- Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand 1983 Jun;67(6):361-370. [Medline]
- Watson M, Homewood J. Mental Adjustment to Cancer Scale: psychometric properties in a large cancer cohort. Psychooncology 2008 Nov;17(11):1146-1151. [CrossRef] [Medline]
- van Sonderen E. Het meten van sociale steun met de Sociale Steun Lijst Interacties (SSL-I) en Sociale Steun Lijst Discrepanties (SSL-D). Een handleiding. Groningen, The Netherlands: Research Institute SHARE, Rijksuniversiteit Groningen URL: https://www.umcg.nl/SiteCollectionDocuments/research/institutes/SHARE/assessment%20tools/handleiding_ssl_2e_druk.pdf [accessed 2016-05-15] [WebCite Cache]
- Wendel-Vos GCW, Schuit AJ, Saris WHM, Kromhout D. Reproducibility and relative validity of the short questionnaire to assess health-enhancing physical activity. J Clin Epidemiol 2003 Dec;56(12):1163-1169. [Medline]
- de Hollander EL, Zwart L, de Vries SI, Wendel-Vos W. The SQUASH was a more valid tool than the OBiN for categorizing adults according to the Dutch physical activity and the combined guideline. J Clin Epidemiol 2012 Jan;65(1):73-81. [CrossRef] [Medline]
- van den Brink CL, Ocke M, Houben A, van NP, Droomers M. Rijksinstituut voor Volksgezondheid en Milieu. 2016. Validering van standaardvraagstelling voeding voor Lokale en Nationale Monitor Volksgezondheid URL: http://www.rivm.nl/Documenten_en_publicaties/Wetenschappelijk/Rapporten/2005/augustus/Validering_van_standaardvraagstelling_voeding_voor_Lokale_en_Nationale_Monitor_Volksgezondheid [accessed 2016-05-15] [WebCite Cache]
- Mudde A, Willemsen M, Kremers S, De Vries H. Meetinstrumenten voor onderzoek naar roken en stoppen met roken [Measurement Instruments used in Research with Regard to Smoking and Smoking Cessation]. Den Haag: Stivoro; 2006.
- Rock CL, Doyle C, Demark-Wahnefried W, Meyerhardt J, Courneya KS, Schwartz AL, et al. Nutrition and physical activity guidelines for cancer survivors. CA Cancer J Clin 2012;62(4):243-274 [FREE Full text] [CrossRef] [Medline]
- World Cancer Research Fund International. Food, Nutrition, and Physical Activity: a Global Perspective. Washington, DC; 2016. Policy and Action for Cancer Prevention URL: http://www.wcrf.org/int/research-we-fund/continuous-update-project-cup [accessed 2016-05-15] [WebCite Cache]
- D'Zurilla TJ, Nezu AM. Problem-solving therapy: a positive approach to clinical intervention. New York: Springer; 2007.
- Bleijenberg G, Berends T, Voskamp H, Bazelmans E, Verhagen S. Cognitive behaviour therapy for post-cancer fatigue: a treatment protocol. In: Gielissen MFM, editor. Fatigue in cancer survivors: from assessment to cognitive behaviour therapy (Doctoral dissertation). Nijmegen: Radboud University; 2007.
- de Vries H, Mudde A, Leijs I, Charlton A, Vartiainen E, Buijs G, et al. The European Smoking Prevention Framework Approach (EFSA): an example of integral prevention. Health Educ Res 2003 Oct;18(5):611-626 [FREE Full text] [Medline]
- Baumeister RF, Heatherton TF, Tice DM. Losing control: how and why people fail at self-regulation. San Diego, CA: Academic Press; 1994.
- Walthouwer MJ, Oenema A, Lechner L, de Vries H. Comparing a Video and Text Version of a Web-Based Computer-Tailored Intervention for Obesity Prevention: A Randomized Controlled Trial. J Med Internet Res 2015;17(10):e236 [FREE Full text] [CrossRef] [Medline]
- van Genugten L, van Empelen P, Boon B, Borsboom G, Visscher T, Oenema A. Results from an online computer-tailored weight management intervention for overweight adults: randomized controlled trial. J Med Internet Res 2012;14(2):e44 [FREE Full text] [CrossRef] [Medline]
- Stanczyk N, Bolman CAW, van Adrichem M, Candel M, Muris J, de Vries H. Comparison of text and video computer-tailored interventions for smoking cessation: randomized controlled trial. J Med Internet Res 2014;16(3):e69 [FREE Full text] [CrossRef] [Medline]
- Weinstein ND, Sandman PM. A model of the precaution adoption process: evidence from home radon testing. Health Psychol 1992;11(3):170-180. [Medline]
- Hawkins NA, Berkowitz Z, Rodriguez JL. Awareness of Dietary and Alcohol Guidelines Among Colorectal Cancer Survivors. Am J Prev Med 2015 Dec;49(6 Suppl 5):S509-S517 [FREE Full text] [CrossRef] [Medline]
- Niu C, Eng L, Qiu X, Shen X, Espin-Garcia O, Song Y, et al. Lifestyle Behaviors in Elderly Cancer Survivors: A Comparison With Middle-Age Cancer Survivors. J Oncol Pract 2015 Jul;11(4):e450-e459 [FREE Full text] [CrossRef] [Medline]
- Mehnert A, Koch U. Psychological comorbidity and health-related quality of life and its association with awareness, utilization, and need for psychosocial support in a cancer register-based sample of long-term breast cancer survivors. J Psychosom Res 2008 Apr;64(4):383-391. [CrossRef] [Medline]
- Thong MS, Kaptein AA, Vissers PA, Vreugdenhil G, van de Poll-Franse LV. Illness perceptions are associated with mortality among 1552 colorectal cancer survivors: a study from the population-based PROFILES registry. J Cancer Surviv 2016 Mar 19:Epub ahead of print. [CrossRef] [Medline]
- Walthouwer MJ, Oenema A, Candel M, Lechner L, de Vries H. Eating in moderation and the essential role of awareness. A Dutch longitudinal study identifying psychosocial predictors. Appetite 2015 Apr;87:152-159. [CrossRef] [Medline]
- Wilson K, Senay I, Durantini M, Sánchez F, Hennessy M, Spring B, et al. When it comes to lifestyle recommendations, more is sometimes less: a meta-analysis of theoretical assumptions underlying the effectiveness of interventions promoting multiple behavior domain change. Psychol Bull 2015 Mar;141(2):474-509 [FREE Full text] [CrossRef] [Medline]
- Kwak L, Kremers SP, Candel MJ, Visscher TL, Brug J, van Baak MA. Changes in skinfold thickness and waist circumference after 12 and 24 months resulting from the NHF-NRG In Balance-project. Int J Behav Nutr Phys Act 2010;7:26 [FREE Full text] [CrossRef] [Medline]
- Walthouwer MJ, Oenema A, Lechner L, de Vries H. Use and Effectiveness of a Video- and Text-Driven Web-Based Computer-Tailored Intervention: Randomized Controlled Trial. J Med Internet Res 2015;17(9):e222 [FREE Full text] [CrossRef] [Medline]
- Sørensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, (HLS-EU) Consortium Health Literacy Project European. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health 2012;12(1):80 [FREE Full text] [CrossRef] [Medline]
|BMI: Body Mass Index|
|CaSUN: Cancer Survivors’ Unmet Needs questionnaire|
|CIS: Checklist Individual Strength|
|HADS: Hospital Anxiety and Depression Scale|
|KNW: Kanker Nazorg Wijzer (Cancer Aftercare Guide)|
|MAC: Mental Adjustment to Cancer Scale|
|MRA: Module Referral Advice|
|PA: physical activity|
|QoL: quality of life|
|RCT: randomized controlled trial|
|SQUASH: Short Questionnaire to Assess Health Enhancing Physical Activity|
|SSL-D: Social Support List‒Discrepancy Subscale|
Edited by G Eysenbach; submitted 17.05.16; peer-reviewed by C Short, E Børøsund; comments to author 02.06.16; revised version received 11.07.16; accepted 20.07.16; published 23.08.16
©Iris Maria Kanera, Roy A Willems, Catherine A W Bolman, Ilse Mesters, Victor Zambon, Brigitte CM Gijsen, Lilian Lechner. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 23.08.2016.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.