Published on 12.05.20 in Vol 22, No 5 (2020): May
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/14910, first published Jun 05, 2019.
Augmented Reality Learning Environment for Basic Life Support and Defibrillation Training: Usability Study
Background: Basic life support (BLS) is crucial in the emergency response system, as sudden cardiac arrest is still a major cause of death worldwide. Unfortunately, only a minority of victims receive cardiopulmonary resuscitation (CPR) from bystanders. In this context, training could be helpful to save more lives, and technology-enhanced BLS simulation is one possible solution.
Objective: The aim of this study is to assess the feasibility and acceptability of our augmented reality (AR) prototype as a tool for BLS training.
Methods: Holo-BLSD is an AR self-instruction training system, in which a standard CPR manikin is “augmented” with an interactive virtual environment that reproduces realistic scenarios. Learners can use natural gestures, body movements, and spoken commands to perform their tasks, with virtual 3D objects anchored to the manikin and the environment. During the experience, users were trained to use the device while being guided through an emergency simulation and, at the end, were asked to complete a survey to assess the feasibility and acceptability of the proposed tool (5-point Likert scale; 1=Strongly Disagree, 5=Strongly Agree).
Results: The system was rated easy to use (mean 4.00, SD 0.94), and the trainees stated that most people would learn to use it very quickly (mean 4.00, SD 0.89). Voice (mean 4.48, SD 0.87), gaze (mean 4.12, SD 0.97), and gesture interaction (mean 3.84, SD 1.14) were judged positively, although some hand gesture recognition errors reduced the feeling of having the right level of control over the system (mean 3.40, SD 1.04).
Conclusions: We found the Holo-BLSD system to be a feasible and acceptable tool for AR BLS training.
J Med Internet Res 2020;22(5):e14910
Sudden cardiac arrest is a major cause of death in adults in developed countries . As such, basic life support (BLS) is a fundamental aspect of the emergency response system. Survival rates are higher when bystanders are able to deliver early cardiopulmonary resuscitation (CPR) and defibrillation [ ]. Unfortunately, although laypeople and health care providers are increasingly trained, only a minority of cardiac arrest survivors receive bystander CPR. Therefore, despite major gaps that still exist in the delivery of optimal care [ ], training plays a pivotal role in saving lives [ ].
The standard approach to BLS training of laypeople involves classroom-based courses consisting of skill demonstrations, hands-on practice, and lectures given by a certified trainer . Simulation with manikins allows trainees to acquire and practice skills without the risk of harming the patient [ ]. Debriefing provides an important learning moment in simulation sessions, as it gives participants the opportunity to critically reflect on decisions and actions performed and to learn from mistakes [ ]. Although it is still a matter of debate how simulation realism influences learning outcomes [ ], the importance of elements of stress and cognitive load in education has been proven, and they should be factored into the instructional design [ ]. Self-directed learning systems are an effective alternative to the standard approach, which, according to multiple studies reported by the American Heart Association guidelines, show no statistical difference in learning outcomes compared with instructor-led courses [ ].
In the context of self-instruction approaches, emerging technologies allow people to build new cognitive structures , and technology-enhanced simulation offers new models for training, which are associated with better knowledge, improved skills acquisition, and a moderate effect on patient outcomes [ ]. One such emerging technology is augmented reality (AR), which enhances the user’s perception by overlaying virtual objects (or “holograms”) on the real-world environment [ ]. AR is being applied across various disciplines in health care education including anatomy classes and surgical training [ - ]. In their integrative review, Zhu et al [ ] reported that AR could improve health care education by reducing failure rates and improving accuracy.
In this study, we investigated the use of AR as an innovative technology for BLS training. The aim of this study is to assess feasibility and acceptability of Holo-BLSD, our AR prototype tool for CPR training.
Holo-BLSD was developed jointly by the SIMNOVA simulation center (Novara, Italy) and the Department of Computer Engineering of Politecnico di Torino, in collaboration with Logosnet’s e-REAL Immersive Simulation Labs in Lugano, Switzerland. The app uses Microsoft’s HoloLens device, a wearable headset for AR experiences, and meets the recent American Heart Association guidelines . Holo-BLSD can be used in different real environments, and its contents can be adapted to where the system is being used: virtual elements can be placed and anchored in the desired position.
Since the majority of potential users are likely to have little or no experience with AR apps or the HoloLens, Holo-BLSD provides a specific training session to help users get acquainted with the system. During interaction training, all interaction types are introduced individually with detailed instructions that include vocal and visual clues.
After the interaction training, users can begin the BLS training. Holo-BLSD guides users step-by-step through the resuscitation procedure of an adult experiencing cardiac arrest. The simulated activities include the following: scene safety, in which any potential hazard should be removed; responsiveness check, performed by shaking and calling the victim; activation of local emergency medical services by using a public phone booth and interacting with a simulated operator; automated external defibrillator (AED) retrieval by asking a witness to find an AED; CPR, using a real manikin torso and superimposing a person’s full body using AR (); use of AED, once available, by directing pad placement and delivery of shock, if recommended. All generated data are logged, and a feedback sheet can be generated, allowing trainees and instructors to intuitively identify errors and strengths of the performance, thus supporting debriefing sessions and enabling the creation of a library of training events.
Participants were recruited on a voluntary basis during a national simulation-based training event for medical residents . The selection of subjects represents a convenience sample, and medical background was not a required inclusion criterion. Experiments took place at the SIMNOVA Simulation Center in Novara, Italy.
The experience was divided into three phases, in which volunteers (1) learned how to use the device through the interaction training session, (2) performed a BLS simulation using the Holo-BLSD app and a standard torso manikin, and (3) filled out the evaluation questionnaire.
Participants completed a survey of 61 questions divided across six categories (user input, system output, system usability, fidelity of simulation, immersivity, likeability), and graded on a scale from 1 (strongly disagree) to 5 (strongly agree). The complete questionnaire can be found in.
The results are presented with relative percentages for each of the five possible grades and summarized as mean and standard deviation. Given the explorative nature of the study, we did not plan any statistical inference tests.
Feasibility was assessed using the user input scale (interaction with gaze and gestures); the system output scale (quality of the display and sound); and the system usability scale , which is a standardized tool to evaluate interfaces based on the ISO 9241-400 guidance on ergonomic factors.
The remaining scales of the survey (fidelity, immersion, and likeability) were designed to assess acceptability.
Ethics and Statistical Analysis
Written informed consent was obtained from all participants, and the study results were presented in aggregate with no identifiers. The study was conducted in accordance with the principles of the Declaration of Helsinki. Descriptive statistics were calculated using Microsoft Excel (Version 2003, Microsoft Corporation).
This study involved 26 participants whose characteristics are summarized in.
Responses to the feasibility scale are shown inand and aggregated data for the system usability scale are presented in . The cognitive load required to operate the HoloLens was minimal (mean 1.77, SD 0.86) and no high physical effort was required (mean 1.19, SD 0.40). Users felt confident using the software (mean 3.62, SD 1.06). Voice (mean 4.48, SD 0.87), gaze (mean 4.12, SD 0.97), and gesture interaction (mean 3.84, SD 1.14) were evaluated positively. Words and symbols (mean 4.70, SD 0.56) and audio instructions (mean 4.43, SD 0.79) were easy to understand. Users were most critical of the quality of the display (mean 2.45, SD 1.47), although they rated it as appropriate for the function (mean 3.62, SD 1.17). Finally, users rated the system as easy to use (mean 4.00, SD 0.94).
Responses to the acceptability scale are summarized in- . The sensorial information provided by the AR gave participants the impression of physically being in the scenario (mean 3.52, SD 0.95). Users reported that the experience was pleasant (mean 4.13, SD 0.81) and enjoyable (mean 4.65, SD 0.57) and that the virtual contents were realistic (mean 3.74, SD 1.05). Users judged the system as capable of providing real benefit as a training tool (mean 4.22, SD 0.67).
|Characteristic||Participants, n (%)|
|Age group (years)|
|Space system engineer||1 (4)|
|Emergency medicine||7 (32)|
|General surgery||2 (9)|
|Internal medicine||1 (5)|
|Not specified||4 (18)|
aPercentages may not add up to 100 due to rounding.
bOnly applicable to residents and physicians.
|Question||Strongly Disagree (%)||Disagree (%)||Neither (%)||Agree (%)||Strongly Agree (%)||Mean (SD)|
|System Usability Scale (SUS)|
|I think that I would like to use this system frequently||0.0||11.5||23.1||38.5||26.9||3.81 (0.98)|
|I found the system unnecessarily complex||48.0||36.0||12.0||4.0||0.0||1.72 (0.84)|
|I thought the system was easy to use||0.0||7.7||19.2||38.5||34.6||4.00 (0.94)|
|I think that I would need the support of a technical person to be able to use this system||15.4||19.2||30.8||23.1||11.5||2.96 (1.25)|
|I found the various functions in this system were well integrated||0.0||3.8||30.8||42.3||23.1||3.85 (0.83)|
|I thought there was too much inconsistency in this system||26.9||34.6||23.1||11.5||3.8||2.31 (1.12)|
|I would imagine that most people would learn to use this system very quickly||0.0||3.8||26.9||34.6||34.6||4.00 (0.89)|
|I found the system very cumbersome to use||32.0||24.0||28.0||8.0||8.0||2.36 (1.25)|
|I felt very confident using the system||0.0||23.1||11.5||46.2||19.2||3.62 (1.06)|
|I needed to learn a lot of things before I could get going with this system||57.7||26.9||11.5||0.0||3.8||1.65 (0.98)|
|The HoloLens device is too bulky or too heavy||19.2||42.3||3.8||26.9||7.7||2.62 (1.30)|
|The mental effort (concentration) required to operate the device was very high||46.2||34.6||15.4||3.8||0.0||1.77 (0.86)|
|The physical effort required to operate the device was very high||80.8||19.2||0.0||0.0||0.0||1.19 (0.40)|
|Arm and hands/fingers fatigue was very high||76.9||19.2||3.8||0.0||0.0||1.27 (0.53)|
|Eye fatigue was very high||42.3||23.1||19.2||7.7||7.7||2.15 (1.29)|
|Head fatigue was very high||38.5||38.5||15.4||0.0||7.7||2.00 (1.13)|
|I would be comfortable using the device for long time||15.4||15.4||30.8||34.6||3.8||2.96 (1.15)|
Experts are paying increased attention to the realism and scenario design of CPR training. The physical features of manikins and simulators by themselves are insufficient in suspending learners’ disbelief and positively influencing learning outcomes . Despite ongoing advances in resuscitation science, cardiac arrest survival rates remain suboptimal and the educational efficiency of caregivers is still critical, as highlighted in 2003 [ ] and 2018 [ ]. Education facilitated through technology has been identified as a strategy to improve the effectiveness of BLS training. We developed the Holo-BLSD app using Microsoft’s HoloLens technology as an AR self-instruction learning environment for training and assessment of CPR and AED use, by using high definition holograms to immerge trainees in realistic scenarios, and a standard low-cost torso manikin to deliver tactile feedback. In this pilot study, we measured the feasibility and acceptability of our first prototype of the training app.
An excessive cognitive load may impair participants’ perceptions and performance, decreasing attention and problem-solving skills , and physical effort and fatigue may reduce user enjoyment of the experience. Despite these conditions, users rated the system as easy to use and they judged the learning experience as pleasant and enjoyable. Volunteers reported that the mental effort required to operate the device was minimal. Similarly, users indicated that the head-mounted display was comfortable. Unlike other head-mounted displays, such as the Google Glass used in Chaballout’s study [ ], no delay between the real and virtual environment was experienced.
Some users noted that ambient light affected the quality of the holograms and made visual instructions difficult to interpret. Users judged the lack of peripheral view, which is known to increase cognitive load , as a major limitation. The assembled environment was considered complex enough to be of use, allowing users to focus on the tasks without leaving them disoriented. It is worth noting that trainees found the virtual contents realistic, stating that the system could provide a real benefit as a training tool and help practitioners be more effective.
In this study, we presented preliminary evidence that validated the Holo-BLSD app as a BLS training tool. Additional studies comparing traditional instructor-led training with low and high-fidelity simulation or other models will be useful.
The limitations of the study are the small number of participants, which makes it difficult to draw clear conclusions about the benefit of the proposed technology on learning outcomes. Nevertheless, this study was intended to provide a proof of concept and to measure the feasibility and acceptability of AR technology in a life support simulation. To this end, positive user responses indicate that future studies are warranted.
AR is in the early stages of application within health care education, but it has enormous potential. In this study, we presented Holo-BLSD, an AR system for BLS training that offers realistic haptic feedback through a manikin and a virtual scenario that can be easily reconfigured to generate different situations, including extreme and dangerous ones. We found the proposed application to be feasible and acceptable as a tool for self-instruction training. The positive outcomes of this preliminary study make this prototype worthy of future testing.
Conflicts of Interest
Complete user questionnaire.PDF File (Adobe PDF File), 154 KB
User input.PNG File , 228 KB
System of output.PNG File , 135 KB
Fidelity of simulation.PNG File , 149 KB
Immersion.PNG File , 104 KB
Likeability.PNG File , 142 KB
- Yeung J, Okamoto D, Soar J, Perkins GD. AED training and its impact on skill acquisition, retention and performance--a systematic review of alternative training methods. Resuscitation 2011 Jun;82(6):657-664. [CrossRef] [Medline]
- Kleinman ME, Brennan EE, Goldberger ZD, Swor RA, Terry M, Bobrow BJ, et al. Part 5: Adult Basic Life Support and Cardiopulmonary Resuscitation Quality: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation 2015 Nov 03;132(18 Suppl 2):S414-S435 [FREE Full text] [CrossRef] [Medline]
- Cheng A, Nadkarni VM, Mancini MB, Hunt EA, Sinz EH, Merchant RM, American Heart Association Education Science Investigators;on behalf of the American Heart Association Education SciencePrograms Committee‚ Council on Cardiopulmonary‚ Critical Care‚ PerioperativeResuscitation; Council on CardiovascularStroke Nursing;Council on Quality of CareOutcomes Research. Resuscitation Education Science: Educational Strategies to Improve Outcomes From Cardiac Arrest: A Scientific Statement From the American Heart Association. Circulation 2018 Aug 07;138(6):e82-e122. [CrossRef] [Medline]
- Hazinski MF, Nolan JP, Aickin R, Bhanji F, Billi JE, Callaway CW, et al. Part 1: Executive Summary: 2015 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations. Circulation 2015 Oct 20;132(16 Suppl 1):S2-39 [FREE Full text] [CrossRef] [Medline]
- Bhanji F, Donoghue AJ, Wolff MS, Flores GE, Halamek LP, Berman JM, et al. Part 14: Education: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation 2015 Nov 03;132(18 Suppl 2):S561-S573. [CrossRef] [Medline]
- Chaballout B, Molloy M, Vaughn J, Brisson IR, Shaw R. Feasibility of Augmented Reality in Clinical Simulations: Using Google Glass With Manikins. JMIR Med Educ 2016 Mar 07;2(1):e2 [FREE Full text] [CrossRef] [Medline]
- Bigi E, Bressan F, Cabrini L, Gasperini C. La simulazione in medicina. Milano: Raffaello Cortina Editore; 2013:978-988.
- Beckers SK, Biermann H, Sopka S, Skorning M, Brokmann JC, Heussen N, et al. Influence of pre-course assessment using an emotionally activating stimulus with feedback: a pilot study in teaching Basic Life Support. Resuscitation 2012 Mar;83(2):219-226. [CrossRef] [Medline]
- Cook DA, Hatala R, Brydges R, Zendejas B, Szostek JH, Wang AT, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA 2011 Sep 07;306(9):978-988. [CrossRef] [Medline]
- Hugues O, Fuchs P, Nannipieri O. New Augmented Reality Taxonomy: Technologies and Features of Augmented Environme. In: Furht B, editor. Handbook of augmented reality. New York: Springer; 2011:850.
- Thomas RG, John NW, Delieu JM. Augmented reality for anatomical education. J Vis Commun Med 2010 Mar;33(1):6-15. [CrossRef] [Medline]
- Botden SMBI, Jakimowicz JJ. What is going on in augmented reality simulation in laparoscopic surgery? Surg Endosc 2009 Aug;23(8):1693-1700 [FREE Full text] [CrossRef] [Medline]
- Ogawa H, Hasegawa S, Tsukada S, Matsubara M. A Pilot Study of Augmented Reality Technology Applied to the Acetabular Cup Placement During Total Hip Arthroplasty. J Arthroplasty 2018 Dec;33(6):1833-1837. [CrossRef] [Medline]
- Zhu E, Hadadgar A, Masiello I, Zary N. Augmented reality in healthcare education: an integrative review. PeerJ 2014;2:e469 [FREE Full text] [CrossRef] [Medline]
- Ingrassia PL, Franc JM, Carenzo L. A novel simulation competition format as an effective instructional tool in post-graduate medical education. Adv Simul (Lond) 2018;3:17 [FREE Full text] [CrossRef] [Medline]
- Bangor A, Kortum PT, Miller JT. An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction 2008 Jul 30;24(6):574-594. [CrossRef]
- Chamberlain DA, Hazinski MF, European Resuscitation Council, American Heart Association, HeartStroke Foundation of Canada, Australia New Zealand Resuscitation Council, Resuscitation Council of Southern Africa, Consejo Latino-Americano de Resuscitación. Education in resuscitation. Resuscitation 2003 Oct;59(1):11-43. [Medline]
- Baumeister J, Ssin SY, ElSayed NAM, Dorrian J, Webb DP, Walsh JA, et al. Cognitive Cost of Using Augmented Reality Displays. IEEE Trans Vis Comput Graph 2017 Dec;23(11):2378-2388. [CrossRef] [Medline]
|AED: automated external defibrillator|
|AR: augmented reality|
|BLS: basic life support|
|CPR: cardiopulmonary resuscitation|
Edited by G Eysenbach; submitted 05.06.19; peer-reviewed by J Vaughn, M Padilha; comments to author 11.07.19; revised version received 30.11.19; accepted 15.12.19; published 12.05.20
©Pier Luigi Ingrassia, Giulia Mormando, Eleonora Giudici, Francesco Strada, Fabio Carfagna, Fabrizio Lamberti, Andrea Bottino. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 12.05.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.