The Law of Attrition Revisited – Author’s Reply
Comment on: Christensen H, Mackinnon A. The Law of Attrition Revisited. J Med Internet Res. 2006;8(3) p. e20 http://www.jmir.org/2006/3/e20/
Comment on: Eysenbach G. The Law of Attrition. J Med Internet Res. 2005;7(1) p. e11 http://www.jmir.org/2005/1/e11/
J Med Internet Res 2006;8(3):e21)
I agree with many of the points made by Christensen and Mackinnon in response to my “Law of Attrition” , which highlights the central role of adherence and exposure as important, but often underreported measures of eHealth interventions.
Recent articles in this journal, for example a paper by Danaher and colleagues on exposure measures in Web-based health behavior change programs , have picked up this discussion, and we are looking forward to receive more research explicating issues around sustained uptake of such interventions.
I do however not agree that focusing on attrition means focusing on the “negative” side of eHealth interventions. To formulate a “law of attrition” was partly motivated by the observation that many authors (the letter writer not included) are not very explicit about high dropout or nonusage rates in their study. Sometimes we have the impression that authors attempt to “hide” high attrition rates, perhaps fearing that reviewers and editors would deem a manuscript unpublishable if too many participants did not use an intervention or drop out from a trial. To explicate a “Law of Attrition” is an attempt to elucidate the fact that high dropout rates and nonusage seem common experiences for eHealth researchers and practitioners, and to encourage them to be forthcoming with such information, enabling them to cite a “law”. Attrition data should not be hidden or buried somewhere in the manuscript, but explicitly stated (already in the abstract) and - even better - analyzed using multivariate models. Participant characteristics, intervention attributes, as well as external variables need to be incorporated in such models, to analyze and predict events such as dropouts or nonusage. We will not be learning about what works and what does not by concealing such data.
Attrition measures are particularly important for the interpretation of “negative” studies (studies which do not show an effect on outcomes), as can be illustrated by a recently published study on electronic links between an emergency room and primary care physicians, which did not result in a significant reduction in resource utilization . That study is a perfect example for the current tendency to focus on reporting traditional outcome measures (in this case, resource utilization in the emergency department and family physician offices), while failing to report any detailed exposure, adoption, or usage data. Without proper reporting and analysis of such data we will – in an “intention-to-use” analysis - never know whether it is the intervention which is principally flawed, or whether it was simply not (or not to a sufficient degree) adopted by the user group [ ]. Adoption and sustained use are obvious prerequisites for any information and communication technology to change outcomes, and little is gained by just reporting “negative” outcomes without exploring why and for whom the technology worked (or failed to work) in terms of engagement, adherence, and continued use.
- Eysenbach G. The law of attrition. J Med Internet Res 2005;7(1):e11 [FREE Full text] [Medline] [CrossRef]
- Danaher BG, Boles SM, Akers L, Gordon JS, Severson HH. Defining participant exposure measures in Web-based health behavior change programs. J Med Internet Res 2006;8(3):e15 [FREE Full text] [Medline] [CrossRef]
- Lang E, Afilalo M, Vandal AC, Boivin JF, Xue X, Colacone A, et al. Impact of an electronic link between the emergency department and family physicians: a randomized controlled trial. CMAJ 2006 Jan 31;174(3):313-318 [FREE Full text] [Medline] [CrossRef]
- Greiver M, Eysenbach G. Virtual links to the emergency department. CMAJ 2006 Jul 18;175(2):172-174 author reply 174 [FREE Full text] [Medline] [CrossRef]
Edited by G. Eysenbach; This is a non-peer-reviewed article. submitted 15.09.06; published 29.09.06
© Gunther Eysenbach. Originally published in the Journal of Medical Internet Research (http://www.jmir.org). Except where otherwise noted, articles published in the Journal of Medical Internet Research are distributed under the terms of the Creative Commons Attribution License (http://www.creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited, including full bibliographic details and the URL (see "please cite as" above), and this statement is included.