Comparison of Use and Appreciation of a Print-Delivered Versus CD-ROM-Delivered, Computer-Tailored Intervention Targeting Saturated Fat Intake: Randomized Controlled Trial
Background: Computer-tailored health education, a promising health education technique, is increasingly being delivered interactively, for example, over the Internet. It has been suggested that there may be differences in use and appreciation between print and interactive delivery of computer-tailored interventions, which may influence information processing. This may especially be the case for women, older people, and people of lower socioeconomic status. Knowledge about differences in use and appreciation could help in choosing the appropriate delivery mode for a particular target audience.
Objective: The study investigates a content-identical, computer-tailored intervention addressing saturated fat intake delivered via print or CD-ROM. We analyzed consumer use and appreciation of the feedback information and explored whether possible differences exist among gender, age, and education subgroups.
Methods: Healthy Dutch adults (18-65 years), none of whom were under treatment for hypercholesterolemia, were randomly allocated to receive a computer-tailored program on CD-ROM (n = 151) or in print (n = 141). At baseline, data were collected on gender, age, and education level. One month post-intervention, data were collected on the use (feedback information read, saved, discussed) and appreciation (trustworthiness, perceived individualization, perceived personal relevance, and user-friendliness) of the feedback. Statistical analyses on the use and appreciation items were performed using chi-square tests and independent-samples t tests.
Results: After exclusion of individuals with missing values, a total of 257 and 240 respondents were included in the analyses of the use outcomes of feedback read and saved, respectively. The results indicate that among the total population, the print feedback was read more often than the CD-ROM feedback (95% vs 81%; P = .001) and saved more often than the CD-ROM feedback (97% vs 77%; P < .001). Similar results were found among the gender, age, and education subgroups. After exclusion of individuals who did not read the information and those with missing values, a total of 208-223 respondents were included in the analyses of the use outcome of feedback discussed and the appreciation items. The personal relevance of the print feedback was rated higher than for the CD-ROM-delivered feedback (0.97 vs 0.68; P = .04), but the effect size was small (0.28). These differences in personal relevance were also seen among women (1.06 vs 0.67; P = .04) and respondents aged 35-49 years (1.00 vs 0.58; P = .03), with moderate effect sizes (0.38 and 0.44, respectively).
Conclusions: Despite the possible advantages of interactive feedback, the present study indicates that interactive-delivered feedback was used less and perceived as less personally relevant compared to the print-delivered feedback. These differences in use and appreciation of delivery modes should be taken into consideration when selecting a delivery mode for a specific subgroup in order to optimize exposure.
Trial Registration: ISRCTN 01557410; http://www.webcitation.org/5XMylWleH
J Med Internet Res 2008;10(2):e12)
- process evaluation;
- demographic differences;
- nutrition education
Computer-Tailored Health Education
Computer-tailored health education delivers individualized information matched to an individual’s characteristics [, ] and is a promising health education technique, particularly for (print-delivered) nutrition education [ ]. The Internet is increasingly being used for the delivery of computer-tailored interventions. There are many features that make the Internet an attractive medium of delivery, such as the instant and continuous availability, the possibilities for interactivity, and the possibility to provide immediate feedback [ , ]. Another potential advantage is that larger numbers of people can be reached for lower cost, as compared with print-delivered interventions [ , , ].
There also may be disadvantages of providing computer-tailored interventions over the Internet: it may be more difficult to read or process information from a computer screen [, ], it may require more effort to receive the computer-tailored feedback (ie, starting the computer and the program), and people may be less likely to save and re-read interactive-delivered feedback [ ]. Furthermore, it has been suggested that specific groups, such as people of lower socioeconomic status, women, and older people, will not be reached with interventions over the Internet because they may have more difficulty with and less interest in using interactive media [ - ].
On the other hand, some previous studies have shown that persons from lower socioeconomic groups have more interest in computer-tailored feedback compared to generic information [- ]. In addition, the possibility of incorporating multiple mediums on the Internet to convey the information could reinforce comprehension for less-educated individuals [ ]. Even though it has been suggested that there may be differences in use between print- and interactive-delivered computer-tailored interventions, the evidence to demonstrate this is still limited. The aim of the present study is to examine differences in use and appreciation of an identical-content, print-delivered versus interactive-delivered, computer-tailored intervention.
Knowledge about differences in use and appreciation could help in choosing the appropriate delivery mode for a particular target audience.
Information Processing and Delivery Mode
Use and appreciation of an intervention are important factors to study since they are prerequisites for active information processing [, ]. Active information processing is necessary for finally achieving changes in determinants and behavior [ ]. Information processing starts with attention to the message [ ], which can be operationalized as reading the information. The channel through which the information is provided is one of the factors that may determine attention to the message [ ]. Attention to the message may be more easily achieved when the information is provided in a readily readable format or when it is provided via a medium that the receiver likes or knows how to use [ , ].
Active information processing not only involves attention to the message, but also thoughtful consideration of the information content. Reading, saving, and discussing the information with others may be indicators of active information processing. Furthermore, information is more likely to be attended to and actively processed when it is perceived as interesting, personally relevant, and individualized [- ]. In a study by Oenema and colleagues, perceived personal relevance and individualization were identified as mediators of the effect of a computer-tailored intervention [ ].
Even though, based on theory, indicators of use and perception of personal relevance are important for achieving intervention effects, these factors may be different for print and interactive deliveries: the medium may determine attention and access to the message , as well as the ability and willingness to actively process the information [ , ].
Only two previous studies have compared use of print- and Internet-delivered interventions with identical content [, ]. Both studies reported higher recall and use of the print materials compared to the materials delivered through the Internet. In the current study we will evaluate a broader set of indicators for use and appreciation and perceptions of personal relevance between a print-delivered and an interactive-delivered, computer-tailored, nutrition education intervention with identical content aimed at reducing saturated fat intake. These interventions were found to be equally effective in reducing saturated fat intake in the short term, but only the effects of the print-delivered tailored feedback were maintained in the longer term [ ].
The current study specifically examines whether there are differences in use (information read, saved, discussed with others) and appreciation (perceived personal relevance, perceived individualization, trustworthiness, user-friendliness) between print computer-tailored advice and interactive computer-tailored advice. These differences were examined for a mixed population and for gender, age, and education subgroups. A CD-ROM was used to deliver the interactive, Web-based intervention, enabling people who did not have Internet access to use the program.
Design and Recruitment
This study is part of a larger randomized controlled trial with five study arms. The current study uses data from two of the study arms for secondary data analysis: computer-tailored dietary saturated fat reduction feedback delivered on CD-ROM (n = 151) or delivered in print (n = 141). Approval for the research project was obtained from the Medical Ethics Committee of Erasmus University Medical Center, Rotterdam, The Netherlands. All participants gave written informed consent after receiving written information about the study. Volunteers for the larger intervention trial were recruited from among employees of nine large companies and inhabitants of two neighborhoods in the Rotterdam area (2003-2004). A total of 798 adults volunteered to participate, none of whom were on a prescribed diet or under treatment for hypercholesterolemia. Participants completed a baseline paper-and-pencil screening questionnaire and were subsequently randomized by computer to one of the two intervention conditions ().
The tailored feedback in the current study incorporated feedback on personal saturated fat intake, social-comparison information, motivational feedback, practical product feedback addressing the most important sources of fat in the person’s diet, information on low-fat alternatives, and self-efficacy-enhancing feedback for difficult situations as derived from an individual assessment. The content of the computer-tailored program (screening questionnaire and feedback) was identical for the two intervention conditions, only the delivery mode was different, as described below. Details of the computer-tailored feedback are described elsewhere .
In the CD-ROM condition, the computer-tailored feedback was programmed as a series of Web pages (questionnaire, feedback messages), then stored on a CD-ROM. The program started with a home page explaining the nature and goal of the program and how it should be used. Immediately after completion of the screening questionnaire, the individualized computer-tailored information appeared on screen (). Low-fat recipes for appetizers, main courses, and desserts could be searched from a recipe page. It was possible to print and save the feedback, but the program did not automatically do this. Respondents were asked to use the program on a computer with Internet Explorer 5.0 or higher and to use it in the same week they received the CD-ROM.
The tailored information in the print condition was generated from the results of a baseline paper-and-pencil questionnaire. The questionnaires were scanned and imported into a computer-tailoring program that generated individualized computer-tailored printed feedback letters of 1.5-4 pages (). Depending on their preferences, respondents received recipe suggestions for low-fat appetizers, main courses, or desserts. The feedback letters were sent to the home address of the respondent within 2 weeks of the time the study team received the completed questionnaire.
Gender, age, and education level were assessed in the baseline questionnaire. A categorical variable was created from age (≤ 34 years, 35-49 years, 50-65 years) . Highest level of completed formal education was measured using one question in which seven education categories were distinguished (from elementary school to university degree) [ ]. The categories were then collapsed into a three-level education variable (lower = lower secondary education or less; medium = upper secondary or post-secondary non-tertiary education; higher = college or university training).
At 1 month post-intervention, the outcome measures (use and appreciation items) were assessed. The questions were introduced by explaining that nutrition advice referred to either the advice delivered by a printed letter or by CD-ROM. Use was assessed with the following yes/no items: “I have read the complete nutrition advice”; “I saved the nutrition advice”; and “I discussed the nutrition advice with others.” Appreciation was assessed using a 5-point scale (from −2 = strongly disagree to +2 = strongly agree): “I perceived the nutrition advice as trustworthy”; “The nutrition advice addressed my personal dietary habits”; “The nutrition advice was of personal relevance for me”; and “The nutrition advice was user-friendly.” Appreciation questions were adapted from the process questionnaire as proposed by Brug and colleagues  and have been successfully used in previous studies [ , ].
Equality of the study groups at baseline was examined with chi-square tests (gender, education) and an independent-samples t test (age). Differences in use and appreciation outcomes between the intervention conditions were analyzed with chi-square tests (feedback read, saved, and discussed) and independent-samples t tests (trustworthy, perceived individualization, personal relevance, and user-friendliness). Respondents with missing values were excluded from the analyses. The “discussed” variable and the appreciation items were analyzed only for those respondents who confirmed they had read all the information. Finally, in order to compare the size of the difference in appreciation items between the print and the CD-ROM group, we calculated the effect sizes as the standardized differences in group means by dividing the difference between the conditions by the pooled standard deviation. Effect sizes were categorized as small (0-0.32), moderate (0.33-0.55), or large (> 0.55) as defined by Lipsey . The analyses were performed for the total group, and, based on the literature [ ], we decided a priori to conduct stratified analyses in specific subgroups based on gender, age, and education category. All analyses were conducted in SPSS version 11 (SPSS Inc, Chicago, IL, USA).
Among the respondents (n = 292), 46% were male, the mean age was 43.9 years (SD 10.3), 22% fell in the lower education level, 34.4% in the medium education level, and 43.6% in the higher education level. There were no significant differences in gender, age, or education level between the two conditions.
Use of the Computer-Tailored Information
As shown in, the print-delivered feedback was read more often than the CD-ROM-delivered feedback according to self-reports among the total population (P = .001) and among women (P = .003). This was also the case for participants in the 50-65 year age group (P = .01; ) and for participants in lower and higher education levels (P = .04 for both groups; ).
The print-delivered feedback was reported to be saved more often than the CD-ROM-delivered feedback among the total population (P < .001), men (P = .02), women (P < .001), the ≤ 34 year and 35-49 year age groups (P = .001 for both groups), and medium- and higher-educated respondents (P = .001 for both groups).
Less than 50% of those who reported to have read the tailored information discussed it with others.
Appreciation of the Computer-Tailored Information
Trustworthiness, perceived individualization, and user-friendliness were not significantly different between the print condition and the CD-ROM condition. However, the CD-ROM condition was rated as more user-friendly by men (P = .10) and respondents ≤ 34 years (P = .10), with a moderate, though not statistically significant, effect size.
Results showed a statistically significant higher perceived personal relevance for the print condition compared to the CD-ROM condition among the total population (P = .04), women (P = .04), and the 35-49 year age group (P = .03), with effect sizes that can be categorized as small (among total population) to moderate (among women and 35-49 year age group). In addition, the print condition was rated as more personally relevant by the ≤ 34 year age group (P = .18) and the less educated respondents (P = .19), with moderate, though not statistically significant, effect sizes.
The results of this study indicate that there are differences in the use and appreciation of a print-delivered versus CD-ROM-delivered, computer-tailored intervention. The differences were mainly in favor of the print-delivered intervention. The print feedback was read and saved more often than the CD-ROM feedback (some specific subgroups excepted), and the print feedback was perceived as more personally relevant in the total study group and in some of the subgroups, with small to moderate effect sizes.
Surprisingly, the print-delivered feedback was rated as more personally relevant. Personal relevance is considered to be a core characteristic and a potential working mechanism of computer-tailored interventions [, ], and, in the present study, both interventions had the same level of personalization and individualization. Apparently, it is not only the feedback itself that is related to the perception of personal relevance, but also the delivery mode through which the information is distributed. Perhaps the immediate feedback on screen after completion of the questionnaire (in the CD-ROM condition) versus the time lag between returning the questionnaire to the researchers and receiving feedback (in the print condition) influences this perception. The receipt of a personalized mailed letter might also enhance relevance. Another explanation may be that participants had expected more personal relevance from a computer program in which they had to complete questions first.
Comparison With Prior Work
Our study is unique in evaluating a broader set of indicators for use, appreciation, and perception of personal relevance between a print-delivered and an interactive-delivered, computer-tailored intervention with identical content.
The finding that the print-delivered feedback is read and saved more often than the CD-ROM-delivered feedback is in line with expectations and findings from previous studies [, , , ].
Information sent through print media may be more easily available and accessible and easier to read and save [, ]. Our results not only indicate that the subgroups suggested in the literature (women, less educated respondents, and older respondents) use the CD-ROM less than print, but also that this is the case for men and higher-educated and younger respondents. However, we do not know why participants in the CD-ROM group did not read the information. Having to use a computer and start a program may have been a barrier in terms of the time, effort, or planning that would be needed to use the program and generate the feedback. For another segment of the participants, lack of motivation or skills to use interactive media may have been a reason [ , ]. This could have been the case for women, older persons, and less-educated persons.
Vandelanotte et al found that people over 40 years compared to those younger than 40 years preferred an intervention delivered in print over an interactively delivered intervention . However, it has also been found that even though people had indicated they preferred to receive an intervention over the Internet, they nevertheless did not access this intervention [ ].
The findings of this study add to the evidence regarding differences in use of interactive and print-delivered interventions with identical content [, ] and provide important new insights in appreciation and perceived relevance of the information. Findings from this and previous studies suggest that interactively delivered interventions as used to date may be less successful in attracting attention and may be less suited to facilitate active information processing compared to print-delivered computer-tailored information. Efforts are needed to increase use, appreciation, and active information processing.
The present study provides descriptive data. Further studies should explore if personal relevance and reading level mediate differential effects between print-delivered and interactive-delivered tailored feedback. Additionally, less-educated people and those older than 65 years were underrepresented or not included in this study. Although the intervention could be provided over the Internet, in this study it was delivered on a CD-ROM.
In this study we conducted a lot of tests without correction for multiple testing, which may increase the risk of false positives in the outcomes of the analyses. However, due to subgroup analyses, the number of participants was rather small in some analyses, which may have caused lack of power to detect significant differences, even when there was a moderate effect size. Reducing the P value to correct for multiple testing would increase the risk of false negatives. Therefore, we reported the uncorrected P values and the effect sizes of our different outcome measures. We evaluated the significance of differences using a significance level of P < .05. Effects can also be evaluated using a more conservative significance level of P < .01 to approach correction for multiple testing. In addition, the moderate effect sizes may provide an indication of differences that might become statistically significant when analyzed in larger groups.
Further, this study compared two delivery modes on aspects of use and appreciation that are relevant for both modes (ie, in both cases, for information processing, the information should be read, saved, and perceived as personally relevant). However, using this approach, we may have missed important aspects for use and probably appreciation of the information or the program that are more sensitive to specific characteristics of interactive media. Future process evaluation studies could use more extensive and specific instruments.
Interactive computer-tailored feedback appears to be read and saved less than print-delivered feedback and perceived as less personally relevant, especially among certain subgroups. These differences in use and appreciation of the computer-tailored intervention delivered through print or interactive delivery modes can be taken into account when selecting a delivery mode for a specific subgroup in order to optimize exposure. Future studies should explore methods to improve exposure to and use of interactively delivered computer-tailored information.
This study was funded by ZonMw, The Netherlands Organization for Health Research and Development (project number 22000131). Date of approval from the institutional review board of Erasmus University Medical Center, Rotterdam, was November 11, 2002.
Conflicts of Interest
- Kreuter MW, Strecher VJ, Glassman B. One size does not fit all: the case for tailoring print materials. Ann Behav Med 1999;21(4):276-283. [Medline] [CrossRef]
- de Vries H, Brug J. Computer-tailored interventions motivating people to adopt health promoting behaviours: introduction to a new approach. Patient Educ Couns 1999 Feb;36(2):99-105. [Medline] [CrossRef]
- Kroeze W, Werkman A, Brug J. A systematic review of randomized trials on the effectiveness of computer-tailored education on physical activity and dietary behaviors. Ann Behav Med 2006 Jun;31(3):205-223. [Medline] [CrossRef]
- Griffiths F, Lindenmeyer A, Powell J, Lowe P, Thorogood M. Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res 2006;8(2):e10 [FREE Full text] [Medline] [CrossRef]
- Evers KE, Cummins CO, Prochaska JO, Prochaska JM. Online health behavior and disease management programs: are we ready for them? Are they ready for us? J Med Internet Res 2005 Jul 1;7(3):e27 [FREE Full text] [Medline] [CrossRef]
- Brug J, Oenema A, Kroeze W, Raat H. The internet and nutrition education: challenges and opportunities. Eur J Clin Nutr 2005 Aug;59 Suppl 1(Suppl 1):S130-7; discussion S138-9. [Medline] [CrossRef]
- Oenema A, Brug J, Lechner L. Web-based tailored nutrition education: results of a randomized controlled trial. Health Educ Res 2001 Dec;16(6):647-660 [FREE Full text] [Medline] [CrossRef]
- Brug J, Oenema A, Campbell M. Past, present, and future of computer-tailored nutrition education. Am J Clin Nutr 2003 Apr;77(4 Suppl):1028S-1034S [FREE Full text] [Medline]
- Murphy JM, Long JF, Holleran TA, Esterly E. Persuasion online or on paper: a new take on an old issue. Learn Instr 2003;13(5):511-532. [CrossRef]
- Eysenbach G. Poverty, human development, and the role of eHealth. J Med Internet Res 2007;9(4):e34 [FREE Full text] [Medline] [CrossRef]
- Birru M, Steinman RA. Online health information and low-literacy African Americans. J Med Internet Res 2004 Sep 3;6(3):e26 [FREE Full text] [Medline] [CrossRef]
- Van Dijk L, de Haan J, Rijken S. Digitalisering van de leefwereld, een onderzoek naar informatie- en communicatietechnologie en sociale ongelijkheid (Eindrapport). Den Haag: Sociaal Cultureel Planbureau; 2000.
- Van Dijk JAGM. De digitale kloof wordt dieper. Zaandam: SQM en Infodrome @ United Knowledge; 2003.
- Huysmans F, De Haan J, Van den Broek A. Achter de schermen. Een kwart eeuw lezen, kijken en Internetten. Den Haag: Sociaal Cultureel Planbureau; 2004.
- Brug J, van Assema P. Differences in use and impact of computer-tailored dietary fat-feedback according to stage of change and education. Appetite 2000 Jun;34(3):285-293. [Medline] [CrossRef]
- Campbell MK, Honess-Morreale L, Farrell D, Carbone E, Brasure M. A tailored multimedia nutrition education pilot program for low-income women receiving food assistance. Health Educ Res 1999 Apr;14(2):257-267 [FREE Full text] [Medline] [CrossRef]
- Campbell MK, Tessaro I, DeVellis B, Benedict S, Kelsey K, Belton L, et al. Effects of a tailored health promotion program for female blue-collar workers: health works for women. Prev Med 2002 Mar;34(3):313-323. [Medline] [CrossRef]
- Birru MS, Monaco VM, Charles L, Drew H, Njie V, Bierria T, et al. Internet usage by low-literacy adults seeking health information: an observational analysis. J Med Internet Res 2004 Sep 3;6(3):e25 [FREE Full text] [Medline] [CrossRef]
- McGuire WJ. Theoretical Foundations of Campaigns. Newbury Park, CA: Sage; 1989.
- Petty RE, Barden J, Wheeler SC. The elaboration likelihood model of persuasion. In: DiClemente RJ, Crosby R, Keyler MC, editors. Emerging Theories in Health Promotion Practice and Research - Strategies for Improving Public Health. San Francisco, CA: Jossey-Bass; 2002.
- Norman CD, Skinner HA. eHealth Literacy: Essential Skills for Consumer Health in a Networked World. J Med Internet Res 2006;8(2):e9 [FREE Full text] [Medline] [CrossRef]
- Parrott RL. Motivation to attend to health messages: presentation of content and linguistic considerations. In: Maibach EW, Parrott RL, editors. Designing Health Messages: Approaches from Communication Theory and Public Health Practice. Thousand Oaks, CA: Sage; 1995:7-23.
- Brug J, Steenhuis I, van Assema P, de Vries H. The impact of a computer-tailored nutrition intervention. Prev Med 1996;25(3):236-242. [Medline] [CrossRef]
- Kreuter MW, Bull FC, Clark EM, Oswald DL. Understanding how people process health information: a comparison of tailored and nontailored weight-loss materials. Health Psychology 1999;18(5):487-494. [Medline] [CrossRef]
- Vandelanotte C, De Bourdeaudhuij I, Brug J. Acceptability and feasibility of an interactive computer-tailored fat intake intervention in Belgium. Health Promot Int 2004 Dec;19(4):463-470 [FREE Full text] [Medline] [CrossRef]
- Oenema A, Tan F, Brug J. Short-term efficacy of a web-based computer-tailored nutrition intervention: main effects and mediators. Ann Behav Med 2005 Feb;29(1):54-63. [Medline] [CrossRef]
- Marks JT. A comparison of Web and print media for physical activity promotion among middle school girls [dissertation]. Chapel Hill, NC: University of North Carolina; 2004.
- Marks JT, Campbell MK, Ward DS, Ribisl KM, Wildemuth BM, Symons MJ. A comparison of Web and print media for physical activity promotion among adolescent girls. J Adolesc Health 2006 Jul;39(1):96-104. [Medline] [CrossRef]
- Marshall AL, Leslie ER, Bauman AE, Marcus BH, Owen N. Print versus website physical activity programs: a randomized trial. Am J Prev Med 2003 Aug;25(2):88-94. [Medline] [CrossRef]
- Kroeze W, Oenema A, Campbell M, Brug J. The efficacy of Web-based and print-delivered computer-tailored interventions to reduce fat intake: results of a randomized controlled trial. J Nutr Educ Behav (forthcoming).
- International Standard Classification of Education. 1997 Nov. UNESCO. URL: http://www.unesco.org/education/information/nfsunesco/doc/isced_1997.htm [accessed 2008 Apr 2] [WebCite Cache]
- Lipsey MW. Design Sensitivity: Statistical Power for Experimental Research. Newbury Park, CA: Sage Publications; 1990.
Edited by G Eysenbach; submitted 24.05.07; peer-reviewed by I DeBourdeaudhuij, M Verheijden; comments to author 24.10.07; revised version received 31.01.08; accepted 25.03.08; published 29.04.08
© Willemieke Kroeze, Anke Oenema, Marci Campbell, Johannes Brug. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 29.04.2008. Except where otherwise noted, articles published in the Journal of Medical Internet Research are distributed under the terms of the Creative Commons Attribution License (http://www.creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided 1) the original work is properly cited, including full bibliographic details and the original article URL on www.jmir.org, and 2) this statement is included.