Enhancement of Medical Interns' Levels of Clinical Skills Competence and Self-Confidence Levels via Video iPods: Pilot Randomized Controlled Trial
Background: Designing and delivering evidence-based medical practice for students requires careful consideration from medical science educators. Social Web (Web 2.0) applications are a part of today’s educational technology milieu; however, empirical research is lacking to support the impact of interactive Web 2.0 mobile applications on medical educational outcomes.
Objectives: The aim of our study was to determine whether instructional videos provided by iPod regarding female and male urinary catheter insertion would increase students’ confidence levels and enhance skill competencies.
Methods: We conducted a prospective study with medical trainee intern (TI) participants: 10 control participants (no technological intervention) and 11 intervention participants (video iPods). Before taking part in a skills course, they completed a questionnaire regarding previous exposure to male and female urinary catheterization and their level of confidence in performing the skills. Directly following the questionnaire, medical faculty provided a 40-minute skills demonstration in the Advanced Clinical Skills Centre (ACSC) laboratory at the University of Auckland, New Zealand. All participants practiced the skills following the demonstrations and were immediately evaluated by the same faculty using an assessment rubric. Following the clinical skill evaluation, participants completed a postcourse questionnaire regarding skill confidence levels. At the end of the skills course, the intervention group were provided video iPods and viewed a male and a female urinary catheterization video during the next 3 consecutive months. The control group did not receive educational technology interventions during the 3-month period. At the end of 3 months, participants completed a follow-up questionnaire and a clinical assessment of urinary catheterization skills at the ACSC lab.
Results: The results indicate a decline in skill competency over time among the control group for both male and female catheterizations, whereas the competency level was stable among the experimental group for both procedures. Interaction results for competency scores indicate a significant level by group and time (P = .03) and procedure and group (P = .02). The experimental group’s confidence level for performing the female catheterization procedure differed significantly over time (P < .001). Furthermore, confidence scores in performing female catheterizations increased for both groups over time. However, the confidence levels for both groups in performing the male catheterization decreased over time.
Conclusions: Video iPods offer a novel pedagogical approach to enhance medical students’ medical skill competencies and self-confidence levels. The outcomes illustrate a need for further investigation in order to generalize to the medical school population.
J Med Internet Res 2011;13(1):e29)
Medical students obtain a rich learning experience in the Advanced Clinical Skills Centre (ACSC) at The University of Auckland, New Zealand. They take courses such as crisis management in anesthesia, open and laparoscopic surgical skills, advanced cardiac life support, general surgical skills, gynecologic principles, orthopedics, and general physician assessment skills. Faculty members at the ACSC provide students with modern human-patient simulations as a part of the medical education curriculum and are willing to try new medical pedagogy to enhance learning outcomes.
The traditional apprenticeship model for teaching clinical skills is no longer feasible due to the shortage of faculty ; however, this educational model may be augmented with simulation training, centralized skills training centers, and Web/Medicine 2.0 applications [ , ] that support a constructivist approach to learning [ ]. Enhanced medical trainee education, by using new and emerging technologies for teaching and learning, may increase team communication and collaboration, skill engagement and performance, and competency with consequent adverse events, or preventing medical errors. Furthermore, there is an ethical imperative to ensure optimal treatment without doing harm to patients and, therefore, technological advancements may provide a safe environment for medical students to practice [ ]. The aim of this experimental study was to determine whether female and male urinary catheter insertion videos provided via video iPods would increase medical students’ confidence levels and enhance skill competencies.
Medical video technology delivered via a mobile device has great potential for cultivating a positive learning landscape in medical schools. Educators know that millennial students, born between 1980 and 1994, are technologically adept, stressed, high-achieving, confident, and self-assured . These students demand convenience and require specific educational direction and guidance while attending college. Therefore, the introduction of mobile audiovisual technologies for this type of student is ideal because of the convenience they provide and the specific educational content they deliver. These students are accustomed to waking up and automatically having the current medical news, viewpoints, research, and education to listen to and perhaps view while commuting to the university, work, or the gym. This is made possible by podcasts and video mobile technologies.
From an educational theoretical perspective, Mayer’s cognitive theory of multimedia learning posits that people learn best when images are combined with words in an electronic learning environment . Mayer’s definition of multimedia includes animation and narration, not just corresponding text and static illustrations. Mayer’s studies involve the use of short multimedia tutorials and result in significant learning outcomes. Therefore, Mayer’s theory of multimedia learning served as the conceptual framework for this study.
The aim of this investigation was to determine whether female and male urinary catheter insertion videos provided via video iPods would increase medical students’ confidence levels and enhance skill competencies and retention. It is important to measure both confidence and competence because self-confidence is not always a reliable indicator of skill competence. This study was designed around a central hypothesis that medical students who receive medical skill videos delivered via a mobile technology would have increased self-confidence and skill competency.
Students in the health care professions have benefited from repeatedly listening to learning material at their convenience via mobile technology and have reported high satisfaction using audio and video formats in learning [, ]. Social Web (Web 2.0) applications, such as podcasts/vodcasts, are becoming common technology applications in health care professional education, and novel research is being conducted and published regarding learning outcomes [ - ]. While no one has clearly defined and agreed on what Medicine or Health 2.0 is, researchers have determined the term originated from the concepts of medicine and Web 2.0 [ ]. A podcast/vodcast may consist of an audio and/or video file distributed to a selected media player over the Internet, some smart phones, and iPad-style notebooks, or downloaded to an iPod-like device. Video podcasts may then be referred to as Medicine/Health 2.0 tools to affect health care and education, and perhaps even in underserved countries where mobile health technology is expanding [ ].
In regard to use of video iPods in higher education, audio and video formats prove effective in enhancing learning outcomes [- ]. Health care professional students report satisfaction in listening to lecture material and viewing clinical skills [ ]. This innovative pocket-sized mobile device is becoming part of physicians’ repertoire of diagnostics, educational tools, and research interventions. However, there is a paucity of evidence around how mobile technology, and using it as a platform for medical education, affects practitioner competence in clinical skills and procedures.
Urinary catheterization of male and female patients is an important technical skill requiring practice. Therefore, we formulated research questions and invited a cohort of medical trainee interns (TIs) attending a clinical skills rotation at ACSC to participate in the study. We set out to answer the following questions. What are TIs’ levels of confidence in performing male and female urinary catheterizations prior to a clinical skills course? What are TIs’ levels of competence and confidence in performing female and male urinary catheterization after a clinical skills course? What are TIs’ levels of competence and confidence in performing male and female urinary catheterization (comparing the control and intervention groups) at 3 months after a clinical skills course? These questions are critical given that urinary catheterization may be a contributing factor to nosocomial infections and other medical conditions [, ].
This was a prospective study using a random sample. Carrying out a prospective study with randomized participants in medical education is challenging for three reasons: (1) a randomized trial, particularly if a control group is involved, is perceived to put some students at a disadvantage, (2) variables are difficult to control, and (3) appropriate outcome measures are difficult to identify . We designed and carried out the study with these reasons in mind in order to control for confounding variables.
The study sample consisted of 21 final-year medical TIs attending the University of Auckland’s School of Medicine (see). Medical TI participants who completed 6 years of medical training were randomized into two groups. The control group (n = 10) and the intervention group (n = 11) were enrolled in a clinical skills course lasting 2 consecutive days. All TIs are required to complete the clinical skills course during the final year of medical school. Six clinical-skill course cycles are held throughout the year, and we randomly selected this study sample from the six cycles of TIs rotating through the scheduled courses in 2006.
Since the participants were enrolled in an established teaching course, Institutional Review Board of Protection of Human Subjects approval was not required. Furthermore, trials including health care providers as participants are exempt, and therefore this randomized control trial was not registered . We obtained consent to participate in the study from the medical TI participants.
A power analysis was not conducted for this experimental study. TIs were assured that participation in the study was voluntary and would not have an effect on any course grades or employment at the University of Auckland.
Precourse Evaluation: Skill Experience
The skills taught during the clinical skills course were advanced cardiac life support, lumbar puncture procedure, nasogastric tube insertion, urinary catheterization of a male and a female patient, and the care of an open contaminated wound. Participants were asked at the onset to state expected learning outcomes from the clinical skills course and at the end of the study to evaluate the course. Precourse questionnaires were newly developed and distributed by the medical school faculty to both groups of TIs before instruction on male and female urinary catheterization. The precourse evaluation questionnaire contained five questions concerning (1) prior exposure to the male and female urinary catheterization skill, (2) self-reported level of confidence in performing the skills, (3) importance of mastering the procedures for male and female urinary catheterizations, (4) to what extent TIs would make use of the clinical procedure in future medical practice, and (5) TIs’ level of fatigue before receiving training for the medical skills.
Another purpose of the precourse questionnaire was to determine levels of TIs’ preexisting knowledge that might confound the results of the study . Validity and reliability of the newly developed questionnaire were not assessed. All questionnaires were collected from the TIs by the clinical skills course director and kept in the director’s locked office cabinet. Participants were assured that their precourse questionnaire responses would be kept confidential and that the data would be kept for 5 years before being securely disposed of.
Competency and Confidence Levels
Directly after completing the precourse questionnaire, the TIs viewed a professionally filmed 15-minute male urinary catheter insertion video and a 15-minute female urinary catheter insertion video in the ACSC on a television monitor. Immediately following the videos, the TIs viewed a live 10-minute demonstration of the male and female urinary catheterization skill (5 minutes for each skill) performed on a mannequin by a physician in the ACSC. The total training time was approximately 40 minutes. The TIs were directly given the opportunity to practice each skill on the male and female mannequins in the ACSC under the supervision of clinical tutors. All TIs participated in the practice session. Each practice procedure lasted on average 10 minutes.
The TIs then completed both procedures while being formally assessed by a physician faculty member who used a 16- and 15-item paper-based competency skill evaluation tool for the male and female catheterization procedures, respectively. An ACSC faculty physician wrote the competency skill evaluation tools. The assessment tool consisted of a written skill checklist, comprising direct observation with criteria, for steps in the demonstrated/learned procedures. Kneebone  recognizes that there “is as yet no uniform approach to measuring performance”; however, we chose this method because we did not consider the clinical skills to be sufficiently complex to warrant a more arduous form of assessment. The reliability and validity for this form of assessment are high for surgical skills procedures, since subjectivity is removed from the evaluation process [ ]. Each participant had to satisfactorily demonstrate insertion of a urinary catheter into the male and female simulation mannequins while being assessed against a set of standardized procedure metrics.
The students’ competency scores were calculated by averaging the 16 clinical procedural steps for the male catheterization skill and the 15 clinical procedural steps for the female catheterization. The procedural steps were setting up a sterile field; maintaining sterility during urinary catheter tray setup; choosing the correct size and type of catheter; explaining the procedure to the patient; questioning the patient about allergies to iodine, latex, and adhesives; washing hands before donning sterile gloves; demonstrating correct technique for donning sterile gloves; cleansing the patient’s skin while maintaining aseptic technique; properly draping the patient with a sterile towel; inserting the catheter while adhering to sterile technique; ascertaining correct depth of catheter insertion before inflating the Foley catheter balloon; gently pulling back on the catheter to confirm balloon inflation and position; correctly connecting and anchoring the catheter; indicating that patient’s foreskin would be replaced at the end of the procedure; and properly documenting the patient’s chart (date of insertion, volume of balloon inflation, and any complications). The student either “correctly” or “incorrectly” performed each step of the procedure.
Following this evaluation process, TIs were randomly assigned to two groups: control and intervention. The randomization process involved consecutively numbering 21 envelopes, provided by a third party not involved in conducting the study, with allocation to either the intervention (video iPod) or control group (no technology) in each envelope. After consenting to participate in the study, TIs were irreversibly randomized by being provided the sealed envelope. The intervention group was given unlimited access to two ACSC faculty-prepared videos (see) presented via a video iPod: female ( ) and male urinary catheterization procedures ( ). Use of the video iPod was explained to the intervention group, and members of the intervention group were contacted by email 2 weeks after receiving the video iPods to inquire about technical difficulties using the hardware or software. To avoid a confounding variable, the control group was not given any technological intervention for 3 months. The intervention group was asked not to share the videos delivered via the video iPods with their peers or discuss the learning process.
After 3 consecutive months, all participants were reevaluated against the same set of standardized metrics used before the intervention and by the same evaluators who conducted the training course to ascertain students’ competency in the urinary catheterization skills. Evaluators were blinded to which group was being assessed. TIs filled out a 3-month follow-up course questionnaire that measured exposure to the male and female urinary catheter procedures since attending the initial clinical skills course at the ACSC and their confidence levels (secondary end point) for each catheterization procedure. The ACSC staff member researcher responsible for arranging the follow-up meeting used text messaging to remind participants of the upcoming 3-month follow-up evaluation at the ACSC.
Data were entered into SPSS version 18 (IBM Corporation, Somers, NY, USA) for statistical analyses. Demographic data (see) were entered and a male/female catheterization experience variable was calculated.
Precourse Evaluations: Skill Experience
Before learning the clinical skill procedure, students’ experience was measured as the number of times they had performed a urinary catheterization. For the 3-month follow-up experience measurement, the number of times students had “performed” or “assisted” with the clinical procedure was included in the data collection.shows results for skill experience with male and female catheterization procedures. For the control group, we did not obtain data for one participant at the 3-month follow-up on both procedures. For the intervention group, we obtained data for 10 participants at the precourse and 3-month follow-up times. For one question at the 3-month follow-up time, we obtained only eight responses.
Competency and Confidence Levels
A high procedural score suggests higher TI competency. The results indicate a decline in competency over time in the control group for both female and male catheterizations. However, the competency level was stable in the intervention (video iPod) group for both procedures. The postcourse male urinary catheter insertion competency scores were nearly equal for the control and intervention groups and close in value to the postcourse female urinary catheterization competency scores for the control group. The greatest difference was in the intervention group competency score for the female catheterization procedure at the 3-month follow-up course, which was higher than the other competency scores (see).
The TIs’ confidence levels were measured at the pre-, post-, and 3-month follow-up course for female and male catheterizations separately. The mean values for the participants are reported in. The change scores indicate a practical significance and perhaps, with a larger sample size, the results would have been different and deemed clinically significant.
As noted in the group-by-time interaction (control vs intervention by post- vs 3-month follow-up course), the intervention competency scores were stable for male and female catheterization procedures, while the control group competency scores for female and male catheterizations became smaller. Possible interactions between variables were investigated by using the Kenward-Roger autoregressive correlation matrix. The calculated interaction effect for the interaction between group (control vs intervention), procedure (female vs male catheterization), and time (pre-, post-, 3-month follow-up course) was not significant at the .05 level. However, the group-by-time interaction and the procedure-by-group interaction were significant at the .05 level. The results are highlighted in.
In regard to TI confidence levels, there was no statistically significant interaction between group (control vs intervention), procedure (female vs male catheterization), and time (post- vs 3-month follow-up course). Neither was there a statistically significant interaction between group (control vs intervention) and time (pre- vs 3-month follow-up course). However, there was a statistically significant interaction between procedure (female vs male catheterization) and time (pre- vs 3-month follow-up course). Over time the confidence scores in performing the female catheterization procedure increased for both groups, while the confidence scores in performing the male catheterization procedure decreased. The results are presented in.
Urinary catheterization skill competency declined over time in the control group for both male and female catheterizations, whereas the competency level was stable in the intervention group for both procedures. This finding is consistent with findings from other studies where a particular skill or procedure is not practiced: competency is likely to diminish over time. The study cohort of final-year medical TIs also would not have the opportunity to perform urinary catheterization on a regular basis for various clinical reasons [, ]. Interaction results for competency scores indicate a significant level by group and time, and by procedure and group. The intervention group’s confidence level for performing the female catheterization procedure differed significantly over time. Furthermore, TIs’ confidence scores in performing female catheterizations increased in both groups over time. However, the confidence scores for both groups in performing the male catheterization decreased over time.
From a clinical education point of view (patient anatomy and comfort level of the TI participant), the male procedure may have been more challenging for the female medical students, who constituted the majority of the study’s sample. If gender is a factor and has potential effects on performance and safety, then more research needs to be conducted. In regard to evaluating the student’s gender with respect to male and female patients in the clinical setting, anecdotal evidence from researchers’ experiences highlights this as a potential educational issue. Also, data suggest a trend for the intervention group to access the two videos via the video iPods just before the 3-month follow-up assessment period and not throughout the 12 weeks following the instruction and immediate postcourse assessment. In the future, researchers may want to measure time-on-viewing (also called time-on-learning) the videos and assess where the students viewed the videos. Time-on-viewing is a significant factor in learning a skill and may be logged in a personal journal by the learner . Learning space is also a factor affecting learning, and it may be beneficial to analyze the effects of time-on-viewing and location-of-learning on medical students’ competency, confidence, and knowledge-retention levels.
The significance of implementing mobile devices as learning tools needs to be further evaluated for future educational purposes. Developers of computer-based instruction and other learning technologies benefit from gathering information from formative evaluation strategies when developing instructional media in order to assess clinical judgment and practice . Hence, it may be helpful to conduct a pilot study with the goal of determining which media format is most beneficial for medical students’ learning and demonstrating clinical skills before making a final decision about adopting these and other popular mobile social learning technologies. Furthermore, it is recommended that the educator provide the listener/viewer with some sort of interactivity option with the podcast/vodcast producer(s) to answer questions or provide user feedback regarding the podcast/vodcast [ ].
Even though the statistically significant improvement in student confidence levels for performing the female urinary catheterization clinical skill over time was positive, the primary limitation of this study is the small sample size. Other concerns that need to be taken into consideration in medical education research include: technical requirements and potential problems that students might encounter with video iPods; pressure to perform the skills in a specific way because medical faculty are conducting a study of clinical skill proficiency; and the effect of time-on-viewing and location-of-learning these clinical skills via the video iPod on medical students’ competency and confidence levels.
The use of mobile devices, such as a video iPod, smart phone, or iPad-like notebook, for health care professional education is interesting and promising. A convenient and ubiquitous mobile technical device providing scenario-based video presentations enhances a constructivist approach to medical education. There are many potential educational uses of the video iPod for patients, families, and their health care providers all over the world. Furthermore, it is beneficial to offer the audience viewing the videos on mobile devices some interaction with the devices and/or to provide feedback from the podcast/vodcast presenter . The results of this small experimental study suggest that video iPods enhance medical students’ confidence in performing the female urinary catheterization procedure over time in a learning resource center, and medical students’ skill competency levels remained the same over time when they accessed the video demonstrations, via a video iPod, of the medical procedure. Social learning technologies, such as the video iPod, engage learners and provide an environment where students may connect, cultivate ideas, and collaborate while learning important clinical skills, in keeping with the concept of Medicine 2.0 [ ]. Learning outcomes are influenced by mobile technology and offer a convenient adjunct to traditionally designed medical school courses.
We wish to thank Elizabeth Robinson PhD and Shannon Halkyard EdD(c) for their assistance with the statistical analyses.
Conflicts of Interest
Multimedia Appendix 1
Female catheterizationMP4 file (MP4 Video File), 55,767 KB
Multimedia Appendix 2
Male catheterizationMP3 file (MP4 Video File), 71,948 KB
- Kohn LT, Corrigan JM, Donaldson MS. To Err is Human: Building a Safer Health System. Washington, DC: National Academy Press; 2000.
- Blum CA, Borglund S, Parcells D. High-fidelity nursing simulation: impact on student self-confidence and clinical competence. Int J Nurs Educ Scholarsh 2010;7(1):Article 18 [FREE Full text] [CrossRef] [Medline]
- Boulos MN, Maramba I, Wheeler S. Wikis, blogs and podcasts: a new generation of Web-based tools for virtual collaborative clinical practice and education. BMC Med Educ 2006;6:41 [FREE Full text] [CrossRef] [Medline]
- Jonassen DH, Peck KL, Wilson BG. Learning With Technology: A Constructivist Perspective. Upper Saddle River, NJ: Prentice Hall; 1999.
- Ziv A, Wolpe PR, Small SD, Glick S. Simulation-based medical education: an ethical imperative. Simul Healthc 2006 Aug;1(4):252-256. [CrossRef] [Medline]
- Oblinger DG, Oblinger JL. Educause. 2005. Educating the net generation URL: http://www.educause.edu/educatingthenetgen [accessed 2010-06-09] [WebCite Cache]
- Mayer RE. Multimedia Learning. Cambridge, UK: Cambridge University Press; 2001.
- Osterweil N. Medpage Today. 2007. Medical students take iPod sounds to heart URL: http://www.medpagetoday.com/PublicHealthPolicy/PublicHealth/5369 [accessed 2010-06-09] [WebCite Cache]
- Jelesiewicz E. Temple Time Online Edition. 2007. iPods help docs improve stethoscope skills URL: https://develop.temple.edu/temple_times/march07/DociPod.html [accessed 2010-06-09] [WebCite Cache]
- Wiecha J, Heyden R, Sternthal E, Merialdi M. Learning in a virtual world: experience with using second life for medical education. J Med Internet Res 2010;12(1):e1 [FREE Full text] [CrossRef] [Medline]
- Sandars J, Schroter S. Web 2.0 technologies for undergraduate and postgraduate medical education: an online survey. Postgrad Med J 2007 Dec;83(986):759-762. [CrossRef] [Medline]
- Cain J, Fox BI. Web 2.0 and pharmacy education. Am J Pharm Educ 2009 Nov 12;73(7):120. [Medline]
- Van De Belt TH, Engelen LJ, Berben SA, Schoonhoven L. Definition of Health 2.0 and Medicine 2.0: a systematic review. J Med Internet Res 2010;12(2):e18 [FREE Full text] [CrossRef] [Medline]
- Anon. Apple Inc. 2010. iPods in bedside medical education: improving care in developing countries URL: http://images.apple.com/science/profiles/ipod_ultrasound/ [accessed 2010-06-14] [WebCite Cache]
- Tempelhof MW, Garman KS, Langman MK, Adams MB. Leveraging time and learning style, iPod vs. realtime attendance at a series of medicine residents conferences: a randomised controlled trial. Inform Prim Care 2009;17(2):87-94. [Medline]
- Maag M. iPod? uPod? An emerging mobile learning tool in nursing education and students' satisfaction. In: Proceedings of the 23rd Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education. 2006 Presented at: Who's Learning? Whose Technology?; Dec 3-6, 2006; Sydney, Australia.
- Maag M. Podcasting and MP3 players: emerging education technologies. Comput Inform Nurs 2006 Feb;24(1):9-13. [Medline]
- Graves N, Tong E, Morton AP, Halton K, Curtis M, Lairson D, et al. Factors associated with health care-acquired urinary tract infection. Am J Infect Control 2007 Aug;35(6):387-392. [CrossRef] [Medline]
- Richards MJ, Edwards JR, Culver DH, Gaynes RP. Nosocomial infections in medical intensive care units in the United States. National Nosocomial Infections Surveillance System. Crit Care Med 1999 May;27(5):887-892. [Medline]
- Prideaux D. Researching the outcomes of educational interventions: a matter of design. RTCs have important limitations in evaluating educational interventions. BMJ 2002 Jan 19;324(7330):126-127 [FREE Full text] [Medline]
- International Committee of Medical Journal Editors. ICMJE. 2009. Frequently asked questions: questions about clinical trials registration URL: http://www.icmje.org/faq_clinical.html [accessed 2010-12-08] [WebCite Cache]
- Kneebone R. Simulation in surgical training: educational issues and practical implications. Med Educ 2003 Mar;37(3):267-277. [Medline]
- Moorthy K, Munz Y, Sarker SK, Darzi A. Objective assessment of technical skills in surgery. BMJ 2003 Nov 1;327(7422):1032-1037 [FREE Full text] [CrossRef] [Medline]
- Fincher RM. Procedural competence of internal medicine residents: time to address the gap. J Gen Intern Med 2000 Jun;15(6):432-433. [Medline]
- Hayden SR, Panacek EA. Procedural competency in emergency medicine: the current range of resident experience. Acad Emerg Med 1999 Jul;6(7):728-735. [Medline]
- McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. Effect of practice on standardised learning outcomes in simulation-based medical education. Med Educ 2006 Aug;40(8):792-797. [CrossRef] [Medline]
- Lasater K. Clinical judgment development: using simulation to create an assessment rubric. J Nurs Educ 2007 Nov;46(11):496-503. [Medline]
- Boulous M. Slideshare. 2010. Networked social media in learning, teaching and research slide #98. -10-24 URL: http://www.slideshare.net/sl.medic/networked-social-media-in-learning-teaching-and-research [accessed 2010-10-24] [WebCite Cache]
- Eysenbach G. Medicine 2.0: social networking, collaboration, participation, apomediation, and openness. J Med Internet Res 2008;10(3):e22 [FREE Full text] [CrossRef] [Medline]
|ACSC: Advanced Clinical Skills Centre|
|TI: trainee intern|
Edited by G Eysenbach; submitted 28.06.10; peer-reviewed by M Kamel Boulos, J Brixey; comments to author 01.09.10; revised version received 25.10.10; accepted 24.01.11; published 01.03.11
©Margaret Hansen, George Oosthuizen, John Windsor, Iain Doherty, Samuel Greig, Karina McHardy, Lloyd McCann. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 01.03.2011.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.