Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 12.05.20 in Vol 22, No 5 (2020): May

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/14910, first published Jun 05, 2019.

This paper is in the following e-collection/theme issue:

    Short Paper

    Augmented Reality Learning Environment for Basic Life Support and Defibrillation Training: Usability Study

    1SIMNOVA - Centro di Simulazione in Medicina e Professioni Sanitarie, Università del Piemonte Orientale, Novara, Italy

    2Department of Medicine, Università di Padova, Padova, Italy

    3School of Medicine, Università Piemonte Orientale, Novara, Italy

    4Department of Control and Computer Engineering, Politecnico di Torino, Torino, Italy

    Corresponding Author:

    Pier Luigi Ingrassia, MD, PhD

    SIMNOVA - Centro di Simulazione in Medicina e Professioni Sanitarie

    Università del Piemonte Orientale

    Via Lanino 1

    Novara, 28100

    Italy

    Phone: 39 3294212083

    Email: pierluigi.ingrassia@med.uniupo.it


    ABSTRACT

    Background: Basic life support (BLS) is crucial in the emergency response system, as sudden cardiac arrest is still a major cause of death worldwide. Unfortunately, only a minority of victims receive cardiopulmonary resuscitation (CPR) from bystanders. In this context, training could be helpful to save more lives, and technology-enhanced BLS simulation is one possible solution.

    Objective: The aim of this study is to assess the feasibility and acceptability of our augmented reality (AR) prototype as a tool for BLS training.

    Methods: Holo-BLSD is an AR self-instruction training system, in which a standard CPR manikin is “augmented” with an interactive virtual environment that reproduces realistic scenarios. Learners can use natural gestures, body movements, and spoken commands to perform their tasks, with virtual 3D objects anchored to the manikin and the environment. During the experience, users were trained to use the device while being guided through an emergency simulation and, at the end, were asked to complete a survey to assess the feasibility and acceptability of the proposed tool (5-point Likert scale; 1=Strongly Disagree, 5=Strongly Agree).

    Results: The system was rated easy to use (mean 4.00, SD 0.94), and the trainees stated that most people would learn to use it very quickly (mean 4.00, SD 0.89). Voice (mean 4.48, SD 0.87), gaze (mean 4.12, SD 0.97), and gesture interaction (mean 3.84, SD 1.14) were judged positively, although some hand gesture recognition errors reduced the feeling of having the right level of control over the system (mean 3.40, SD 1.04).

    Conclusions: We found the Holo-BLSD system to be a feasible and acceptable tool for AR BLS training.

    J Med Internet Res 2020;22(5):e14910

    doi:10.2196/14910

    KEYWORDS



    Introduction

    Sudden cardiac arrest is a major cause of death in adults in developed countries [1]. As such, basic life support (BLS) is a fundamental aspect of the emergency response system. Survival rates are higher when bystanders are able to deliver early cardiopulmonary resuscitation (CPR) and defibrillation [2]. Unfortunately, although laypeople and health care providers are increasingly trained, only a minority of cardiac arrest survivors receive bystander CPR. Therefore, despite major gaps that still exist in the delivery of optimal care [3], training plays a pivotal role in saving lives [4].

    The standard approach to BLS training of laypeople involves classroom-based courses consisting of skill demonstrations, hands-on practice, and lectures given by a certified trainer [5]. Simulation with manikins allows trainees to acquire and practice skills without the risk of harming the patient [6]. Debriefing provides an important learning moment in simulation sessions, as it gives participants the opportunity to critically reflect on decisions and actions performed and to learn from mistakes [7]. Although it is still a matter of debate how simulation realism influences learning outcomes [4], the importance of elements of stress and cognitive load in education has been proven, and they should be factored into the instructional design [8]. Self-directed learning systems are an effective alternative to the standard approach, which, according to multiple studies reported by the American Heart Association guidelines, show no statistical difference in learning outcomes compared with instructor-led courses [5].

    In the context of self-instruction approaches, emerging technologies allow people to build new cognitive structures [7], and technology-enhanced simulation offers new models for training, which are associated with better knowledge, improved skills acquisition, and a moderate effect on patient outcomes [9]. One such emerging technology is augmented reality (AR), which enhances the user’s perception by overlaying virtual objects (or “holograms”) on the real-world environment [10]. AR is being applied across various disciplines in health care education including anatomy classes and surgical training [11-13]. In their integrative review, Zhu et al [14] reported that AR could improve health care education by reducing failure rates and improving accuracy.

    In this study, we investigated the use of AR as an innovative technology for BLS training. The aim of this study is to assess feasibility and acceptability of Holo-BLSD, our AR prototype tool for CPR training.


    Methods

    Development

    Holo-BLSD was developed jointly by the SIMNOVA simulation center (Novara, Italy) and the Department of Computer Engineering of Politecnico di Torino, in collaboration with Logosnet’s e-REAL Immersive Simulation Labs in Lugano, Switzerland. The app uses Microsoft’s HoloLens device, a wearable headset for AR experiences, and meets the recent American Heart Association guidelines [2]. Holo-BLSD can be used in different real environments, and its contents can be adapted to where the system is being used: virtual elements can be placed and anchored in the desired position.

    Since the majority of potential users are likely to have little or no experience with AR apps or the HoloLens, Holo-BLSD provides a specific training session to help users get acquainted with the system. During interaction training, all interaction types are introduced individually with detailed instructions that include vocal and visual clues.

    After the interaction training, users can begin the BLS training. Holo-BLSD guides users step-by-step through the resuscitation procedure of an adult experiencing cardiac arrest. The simulated activities include the following: scene safety, in which any potential hazard should be removed; responsiveness check, performed by shaking and calling the victim; activation of local emergency medical services by using a public phone booth and interacting with a simulated operator; automated external defibrillator (AED) retrieval by asking a witness to find an AED; CPR, using a real manikin torso and superimposing a person’s full body using AR (Figure 1); use of AED, once available, by directing pad placement and delivery of shock, if recommended. All generated data are logged, and a feedback sheet can be generated, allowing trainees and instructors to intuitively identify errors and strengths of the performance, thus supporting debriefing sessions and enabling the creation of a library of training events.

    Figure 1. A trainee using the HoloLens device (above) and AR displayed in the trainee’s field of view (below).
    View this figure

    Participants were recruited on a voluntary basis during a national simulation-based training event for medical residents [15]. The selection of subjects represents a convenience sample, and medical background was not a required inclusion criterion. Experiments took place at the SIMNOVA Simulation Center in Novara, Italy.

    The experience was divided into three phases, in which volunteers (1) learned how to use the device through the interaction training session, (2) performed a BLS simulation using the Holo-BLSD app and a standard torso manikin, and (3) filled out the evaluation questionnaire.

    Software Evaluation

    Participants completed a survey of 61 questions divided across six categories (user input, system output, system usability, fidelity of simulation, immersivity, likeability), and graded on a scale from 1 (strongly disagree) to 5 (strongly agree). The complete questionnaire can be found in Multimedia Appendix 1.

    The results are presented with relative percentages for each of the five possible grades and summarized as mean and standard deviation. Given the explorative nature of the study, we did not plan any statistical inference tests.

    Feasibility

    Feasibility was assessed using the user input scale (interaction with gaze and gestures); the system output scale (quality of the display and sound); and the system usability scale [16], which is a standardized tool to evaluate interfaces based on the ISO 9241-400 guidance on ergonomic factors.

    Acceptability

    The remaining scales of the survey (fidelity, immersion, and likeability) were designed to assess acceptability.

    Ethics and Statistical Analysis

    Written informed consent was obtained from all participants, and the study results were presented in aggregate with no identifiers. The study was conducted in accordance with the principles of the Declaration of Helsinki. Descriptive statistics were calculated using Microsoft Excel (Version 2003, Microsoft Corporation).


    Results

    This study involved 26 participants whose characteristics are summarized in Table 1.

    Feasibility

    Responses to the feasibility scale are shown in Multimedia Appendices 2 and 3 and aggregated data for the system usability scale are presented in Table 2. The cognitive load required to operate the HoloLens was minimal (mean 1.77, SD 0.86) and no high physical effort was required (mean 1.19, SD 0.40). Users felt confident using the software (mean 3.62, SD 1.06). Voice (mean 4.48, SD 0.87), gaze (mean 4.12, SD 0.97), and gesture interaction (mean 3.84, SD 1.14) were evaluated positively. Words and symbols (mean 4.70, SD 0.56) and audio instructions (mean 4.43, SD 0.79) were easy to understand. Users were most critical of the quality of the display (mean 2.45, SD 1.47), although they rated it as appropriate for the function (mean 3.62, SD 1.17). Finally, users rated the system as easy to use (mean 4.00, SD 0.94).

    Acceptability

    Responses to the acceptability scale are summarized in Multimedia Appendices 4-6. The sensorial information provided by the AR gave participants the impression of physically being in the scenario (mean 3.52, SD 0.95). Users reported that the experience was pleasant (mean 4.13, SD 0.81) and enjoyable (mean 4.65, SD 0.57) and that the virtual contents were realistic (mean 3.74, SD 1.05). Users judged the system as capable of providing real benefit as a training tool (mean 4.22, SD 0.67).

    Table 1. Respondents’ demographics and characteristicsa.
    View this table
    Table 2. Aggregated data for the system usability scale.
    View this table

    Discussion

    Principal Findings

    Experts are paying increased attention to the realism and scenario design of CPR training. The physical features of manikins and simulators by themselves are insufficient in suspending learners’ disbelief and positively influencing learning outcomes [4]. Despite ongoing advances in resuscitation science, cardiac arrest survival rates remain suboptimal and the educational efficiency of caregivers is still critical, as highlighted in 2003 [17] and 2018 [3]. Education facilitated through technology has been identified as a strategy to improve the effectiveness of BLS training. We developed the Holo-BLSD app using Microsoft’s HoloLens technology as an AR self-instruction learning environment for training and assessment of CPR and AED use, by using high definition holograms to immerge trainees in realistic scenarios, and a standard low-cost torso manikin to deliver tactile feedback. In this pilot study, we measured the feasibility and acceptability of our first prototype of the training app.

    An excessive cognitive load may impair participants’ perceptions and performance, decreasing attention and problem-solving skills [6], and physical effort and fatigue may reduce user enjoyment of the experience. Despite these conditions, users rated the system as easy to use and they judged the learning experience as pleasant and enjoyable. Volunteers reported that the mental effort required to operate the device was minimal. Similarly, users indicated that the head-mounted display was comfortable. Unlike other head-mounted displays, such as the Google Glass used in Chaballout’s study [6], no delay between the real and virtual environment was experienced.

    Some users noted that ambient light affected the quality of the holograms and made visual instructions difficult to interpret. Users judged the lack of peripheral view, which is known to increase cognitive load [18], as a major limitation. The assembled environment was considered complex enough to be of use, allowing users to focus on the tasks without leaving them disoriented. It is worth noting that trainees found the virtual contents realistic, stating that the system could provide a real benefit as a training tool and help practitioners be more effective.

    In this study, we presented preliminary evidence that validated the Holo-BLSD app as a BLS training tool. Additional studies comparing traditional instructor-led training with low and high-fidelity simulation or other models will be useful.

    Limitations

    The limitations of the study are the small number of participants, which makes it difficult to draw clear conclusions about the benefit of the proposed technology on learning outcomes. Nevertheless, this study was intended to provide a proof of concept and to measure the feasibility and acceptability of AR technology in a life support simulation. To this end, positive user responses indicate that future studies are warranted.

    Conclusions

    AR is in the early stages of application within health care education, but it has enormous potential. In this study, we presented Holo-BLSD, an AR system for BLS training that offers realistic haptic feedback through a manikin and a virtual scenario that can be easily reconfigured to generate different situations, including extreme and dangerous ones. We found the proposed application to be feasible and acceptable as a tool for self-instruction training. The positive outcomes of this preliminary study make this prototype worthy of future testing.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Complete user questionnaire.

    PDF File (Adobe PDF File), 154 KB

    Multimedia Appendix 2

    User input.

    PNG File , 228 KB

    Multimedia Appendix 3

    System of output.

    PNG File , 135 KB

    Multimedia Appendix 4

    Fidelity of simulation.

    PNG File , 149 KB

    Multimedia Appendix 5

    Immersion.

    PNG File , 104 KB

    Multimedia Appendix 6

    Likeability.

    PNG File , 142 KB

    References

    1. Yeung J, Okamoto D, Soar J, Perkins GD. AED training and its impact on skill acquisition, retention and performance--a systematic review of alternative training methods. Resuscitation 2011 Jun;82(6):657-664. [CrossRef] [Medline]
    2. Kleinman ME, Brennan EE, Goldberger ZD, Swor RA, Terry M, Bobrow BJ, et al. Part 5: Adult Basic Life Support and Cardiopulmonary Resuscitation Quality: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation 2015 Nov 03;132(18 Suppl 2):S414-S435 [FREE Full text] [CrossRef] [Medline]
    3. Cheng A, Nadkarni VM, Mancini MB, Hunt EA, Sinz EH, Merchant RM, American Heart Association Education Science Investigators;on behalf of the American Heart Association Education SciencePrograms Committee‚ Council on Cardiopulmonary‚ Critical Care‚ PerioperativeResuscitation; Council on CardiovascularStroke Nursing;Council on Quality of CareOutcomes Research. Resuscitation Education Science: Educational Strategies to Improve Outcomes From Cardiac Arrest: A Scientific Statement From the American Heart Association. Circulation 2018 Aug 07;138(6):e82-e122. [CrossRef] [Medline]
    4. Hazinski MF, Nolan JP, Aickin R, Bhanji F, Billi JE, Callaway CW, et al. Part 1: Executive Summary: 2015 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations. Circulation 2015 Oct 20;132(16 Suppl 1):S2-39 [FREE Full text] [CrossRef] [Medline]
    5. Bhanji F, Donoghue AJ, Wolff MS, Flores GE, Halamek LP, Berman JM, et al. Part 14: Education: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation 2015 Nov 03;132(18 Suppl 2):S561-S573. [CrossRef] [Medline]
    6. Chaballout B, Molloy M, Vaughn J, Brisson IR, Shaw R. Feasibility of Augmented Reality in Clinical Simulations: Using Google Glass With Manikins. JMIR Med Educ 2016 Mar 07;2(1):e2 [FREE Full text] [CrossRef] [Medline]
    7. Bigi E, Bressan F, Cabrini L, Gasperini C. La simulazione in medicina. Milano: Raffaello Cortina Editore; 2013:978-988.
    8. Beckers SK, Biermann H, Sopka S, Skorning M, Brokmann JC, Heussen N, et al. Influence of pre-course assessment using an emotionally activating stimulus with feedback: a pilot study in teaching Basic Life Support. Resuscitation 2012 Mar;83(2):219-226. [CrossRef] [Medline]
    9. Cook DA, Hatala R, Brydges R, Zendejas B, Szostek JH, Wang AT, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA 2011 Sep 07;306(9):978-988. [CrossRef] [Medline]
    10. Hugues O, Fuchs P, Nannipieri O. New Augmented Reality Taxonomy: Technologies and Features of Augmented Environme. In: Furht B, editor. Handbook of augmented reality. New York: Springer; 2011:850.
    11. Thomas RG, John NW, Delieu JM. Augmented reality for anatomical education. J Vis Commun Med 2010 Mar;33(1):6-15. [CrossRef] [Medline]
    12. Botden SMBI, Jakimowicz JJ. What is going on in augmented reality simulation in laparoscopic surgery? Surg Endosc 2009 Aug;23(8):1693-1700 [FREE Full text] [CrossRef] [Medline]
    13. Ogawa H, Hasegawa S, Tsukada S, Matsubara M. A Pilot Study of Augmented Reality Technology Applied to the Acetabular Cup Placement During Total Hip Arthroplasty. J Arthroplasty 2018 Dec;33(6):1833-1837. [CrossRef] [Medline]
    14. Zhu E, Hadadgar A, Masiello I, Zary N. Augmented reality in healthcare education: an integrative review. PeerJ 2014;2:e469 [FREE Full text] [CrossRef] [Medline]
    15. Ingrassia PL, Franc JM, Carenzo L. A novel simulation competition format as an effective instructional tool in post-graduate medical education. Adv Simul (Lond) 2018;3:17 [FREE Full text] [CrossRef] [Medline]
    16. Bangor A, Kortum PT, Miller JT. An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction 2008 Jul 30;24(6):574-594. [CrossRef]
    17. Chamberlain DA, Hazinski MF, European Resuscitation Council, American Heart Association, HeartStroke Foundation of Canada, Australia New Zealand Resuscitation Council, Resuscitation Council of Southern Africa, Consejo Latino-Americano de Resuscitación. Education in resuscitation. Resuscitation 2003 Oct;59(1):11-43. [Medline]
    18. Baumeister J, Ssin SY, ElSayed NAM, Dorrian J, Webb DP, Walsh JA, et al. Cognitive Cost of Using Augmented Reality Displays. IEEE Trans Vis Comput Graph 2017 Dec;23(11):2378-2388. [CrossRef] [Medline]


    Abbreviations

    AED: automated external defibrillator
    AR: augmented reality
    BLS: basic life support
    CPR: cardiopulmonary resuscitation


    Edited by G Eysenbach; submitted 05.06.19; peer-reviewed by J Vaughn, M Padilha; comments to author 11.07.19; revised version received 30.11.19; accepted 15.12.19; published 12.05.20

    ©Pier Luigi Ingrassia, Giulia Mormando, Eleonora Giudici, Francesco Strada, Fabio Carfagna, Fabrizio Lamberti, Andrea Bottino. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 12.05.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.