Published on 24.06.13 in Vol 15, No 6 (2013): June
Letter to the Editor
The Systematic Removal of Participants Post-Randomization Can Lead to Alternate Explanations of the Results
J Med Internet Res 2013;15(6):e128
The strength of randomized controlled trials is that they allow causal statements to be made about the efficacy of an intervention. This is because the randomization of participants to experimental condition distributes participants with different characteristics to each experimental condition by chance, including variations in the outcome variables of interest. Such randomization allows the use of statistical tests incorporating probability statements regarding the chance that the difference observed between conditions is due to chance (eg, 1 in 20 chance; P<.05).
Any systematic removal of participants post-randomization interferes with the assumption of the randomness of participant allocation to experimental condition. This can introduce a potential confound or alternative explanation of the results. The recently published study by Rooke et al  removed participants from the analysis who reported other treatment use during the study (n=5). The removal of participants was done post-randomization and in a systematic fashion (ie, anyone who reported using other treatment was not included in the analysis). All participants who reported receiving other treatment were in the control condition and were allocated to receive the Web address of an education only website. Even if some participants in the intervention condition had also accessed other treatment, this would still be a systematic, post-randomization removal of participants. However, it is easier to develop alternate explanations of the findings of this trial because all participants using other treatment were from the control condition.
From one perspective, it is possible that the excluded participants were those who were experiencing the most serious problems with their Cannabis use. If this is the case, it could make it less likely that significant differences would be observed between experimental condition by reducing the variance between participants. Alternatively, perhaps these were the five participants in the control condition who were the most motivated to reduce their Cannabis use. This could mean that participants in the control condition were less motivated, on average, than those in the intervention condition, to do something about their Cannabis use. This could serve as an alternate explanation of the findings in this study.
Given that only five participants were removed out of 225 (or 230 if control and intervention group participant totals are added?) randomized at baseline, it is quite possible that this alternate explanation is untrue. However, the authors do expose themselves to alternate explanations of the findings by the removal of these participants. If the systematic removal of participants post-randomization is deemed necessary, one possible solution would be to run (and report on) the analysis with and without these participants included. Such sensitivity analyses would go a long way towards addressing any possible confounds that may have been introduced.
Conflicts of Interest
Edited by G Eysenbach; submitted 25.03.13; peer-reviewed by S Rooke; accepted 11.06.13; published 24.06.13
©John A Cunningham. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 24.06.2013.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.