Published on 18.09.15 in Vol 17, No 9 (2015): September
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/4786, first published May 31, 2015.
Letter to the Editor
Response to “Twitter-Based Journal Clubs: Some Additional Facts and Clarifications”
J Med Internet Res 2015;17(9):e217
We read with great interest the recent correspondence from Topf et al  regarding our recent publication “Globalization of Continuing Professional Development by Journal Clubs via Microblogging: A Systematic Review” [ ]. We thank the authors for their interest, opinions, and contribution to the ongoing work evaluating the utility of Twitter-based Journal Clubs in the context of continuing professional development.
Topf et al note the limitation associated with the dynamic nature of the "impressions" data as a reported outcome measure and provide a well-explained example of how this metric is dynamic. Further, they correctly note that "spam" accounts associated with the journal clubs (JC) artificially increase the total impressions for a Twitter journal club. Despite this, when used appropriately, we believe there is some value to impressions as a performance metric given the paucity of comparative outcome measures in the early Twitter-based journal club era. This education tool is unique and traditional analysis methods typically used in systematic reviews and meta-analytical studies are clearly not suitable. The "impression:tweet ratio" reported in the initial manuscript was a metric applied only to the Twitter user account to assess the following and “impression” of the journal club, thus reducing the influence of such "spam" accounts to a degree. We believe this modified calculation is a useful quantifiable measure of publicity and potential viewership of the discussion. However, for trend analysis, such as that performed for the top five performing journal clubs, the identification and exclusion of such accounts (eg, @brodalumab) was performed as they were not only statistical outliers but also known spam accounts. This helped us to provide highly accurate data in this analysis.
The dynamic nature of Twitter-based JC was pertinently raised by the authors, as evidenced by the commencement of recent JCs. We support the notion of a "living" systematic review, not currently possible given the publication using traditional peer-reviewed methods and associated delays. The suggested method of “Storifying” the chat is an appealing method for consolidation and formalization of the conversation for later review. The value of these conversations for scholarly activity is gaining momentum, with some institutions promoting Altmetric scores for affiliated publications. Furthermore, Symplur in this context as a real-time aggregate database is an invaluable tool in appreciating the changes in journal club discussions. We anticipate that with further time and refinement, more sophisticated methods for measuring journal club performance will be devised. The ongoing success of current and future journal clubs will be determined by appropriate identification and recommendation from experienced participants with advice for successes and pitfalls from established JCs.
Given the current opportunity to present updated data six-months following the previous review , 6 more Twitter journal clubs have been established and none have become inactive (see ). These new journal clubs represent diverse groups within the medical field including rheumatology (#rheumJC), radiology (#medradJClub) and neuro-crictical care (#NCSTJC). Additionally, several recent publications regarding the use of social media for medical education, specifically journal clubs, have become apparent. Of these, several represent publication of summaries of a recent Twitter-based journal club discussion [ - ] or narrative reviews on the evolution of Twitter-based journal clubs [ ]. Further recent publications have assessed the uptake of Twitter-based journal clubs by respective societies [ , ].
- Topf JM, Sparks MA, Iannuzzella F, Lerma E, Oates T, Phelan PJ, et al. Twitter-Based Journal Clubs: Additional Facts and Clarifications. J Med Internet Res 2015;17(9):e216 [FREE Full text] [CrossRef]
- Roberts MJ, Perera M, Lawrentschuk N, Romanic D, Papa N, Bolton D. Globalization of continuing professional development by journal clubs via microblogging: a systematic review. J Med Internet Res 2015;17(4):e103 [FREE Full text] [CrossRef] [Medline]
- Colman R, Anand A. Twitter discussions from a respirology journal club. Lancet Respir Med 2015 Apr;3(4):e10. [CrossRef] [Medline]
- Westafer L, Hensley J, Shaikh S, Lin M. Global Emergency Medicine Journal Club: A Social Media Discussion About the Lack of Association Between Press Ganey Scores and Emergency Department Analgesia. Ann Emerg Med 2015 May 20 (forthcoming). [CrossRef] [Medline]
- Topf JM, Hiremath S. Social media, medicine and the modern journal club. Int Rev Psychiatry 2015 Apr;27(2):147-154. [CrossRef] [Medline]
- Davies N, Murphy DG, van RS, Woo HH, Lawrentschuk N. Online and social media presence of Australian and New Zealand urologists. BJU Int 2015 Apr 24. [CrossRef] [Medline]
- Misrai V, Castagnola C, Descotes JL, Rouprêt M. [Use of social media by French urologists: Results from a study of the National French Urological Association]. Prog Urol 2015 Jun;25(7):428-434. [CrossRef] [Medline]
Edited by G Eysenbach; submitted 31.05.15; peer-reviewed by I Thangasamy, S Hiremath; comments to author 01.07.15; revised version received 04.07.15; accepted 08.07.15; published 18.09.15
©Marlon Perera, Matthew Roberts, Nathan Lawrentschuk, Damien Bolton. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 18.09.2015.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.