Background: Virtual reality (VR) is increasingly being used for the assessment and treatment of impairments arising from acquired brain injuries (ABIs) due to perceived benefits over traditional methods. However, no tailored options exist for the design and implementation of VR for ABI rehabilitation and, more specifically, traumatic brain injury (TBI) rehabilitation. In addition, the evidence base lacks systematic reviews of immersive VR use for TBI rehabilitation. Recommendations for this population are important because of the many complex and diverse impairments that individuals can experience.
Objective: This study aims to conduct a two-part systematic review to identify and synthesize existing recommendations for designing and implementing therapeutic VR for ABI rehabilitation, including TBI, and to identify current evidence for using immersive VR for TBI assessment and treatment and to map the degree to which this literature includes recommendations for VR design and implementation.
Methods: This review was guided by PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). A comprehensive search of 11 databases and gray literature was conducted in August 2019 and repeated in June 2020. Studies were included if they met relevant search terms, were peer-reviewed, were written in English, and were published between 2009 and 2020. Studies were reviewed to determine the level of evidence and methodological quality. For the first part, qualitative data were synthesized and categorized via meta-synthesis. For the second part, findings were analyzed and synthesized descriptively owing to the heterogeneity of data extracted from the included studies.
Results: In the first part, a total of 14 papers met the inclusion criteria. Recommendations for VR design and implementation were not specific to TBI but rather to stroke or ABI rehabilitation more broadly. The synthesis and analysis of data resulted in three key phases and nine categories of recommendations for designing and implementing VR for ABI rehabilitation. In the second part, 5 studies met the inclusion criteria. A total of 2 studies reported on VR for assessment and three for treatment. Studies were varied in terms of therapeutic targets, VR tasks, and outcome measures. VR was used to assess or treat impairments in cognition, balance, and anxiety, with positive outcomes. However, the levels of evidence, methodological quality, and inclusion of recommendations for VR design and implementation were poor.
Conclusions: There is limited research on the use of immersive VR for TBI rehabilitation. Few studies have been conducted, and there is limited inclusion of recommendations for therapeutic VR design and implementation. Future research in ABI rehabilitation should consider a stepwise approach to VR development, from early co-design studies with end users to larger controlled trials. A list of recommendations is offered to provide guidance and a more consistent model to advance clinical research in this area.
The use of virtual reality (VR) in health care has expanded in recent years and continues to be investigated due to the increasing availability and advancement of technology [, ]. VR is being used in clinical research for the assessment and therapeutic intervention of impairments associated with acquired brain injuries (ABIs), which is an umbrella term for brain injuries that are sustained after birth [ , ]. A considerable evidence base exists for using VR for ABI rehabilitation, with a particular focus on stroke [ - ]. Traumatic brain injury (TBI) is another ABI that is increasingly being investigated with VR technologies; however, the evidence base is smaller and not as rigorous as that for other ABIs. TBI leads to alterations in brain function and pathology caused by a blow or other external force on the head [ ]. As a major cause of disability and mortality, ABIs are increasingly being considered as a public health burden and place significant economic strain on society [ ]. People who sustain an ABI can experience physical, cognitive, and communication impairments that are often long lasting and significantly impact their everyday functioning [ , - ].
VR refers to “a computer-generated digital environment that can be experienced and interacted with as if that environment were real” . VR systems are typically classified as immersive, semi-immersive, or nonimmersive [ , ], with immersion referring to the level of user perception with regard to being in a virtual environment (VE) rather than the real world [ ]. Immersive VR systems supply VEs with a changing field of view via head-mounted displays (HMDs) [ , , ]. Movement within immersive VEs is achieved via hardware such as head trackers, hand controllers, and body motion sensors [ , ]. Semi-immersive VR refers to systems that use projection-based systems (eg, driving simulators and use of shutter glasses), whereas nonimmersive VR systems include basic desktop displays and videogames [ , , ]. To improve the delivery of assessment, treatment, and clinical outcomes for people with ABI, the use of VR should be further explored because of its potential to address limitations and produce benefits over conventional assessment and treatment methods [ - ].
Recommendations for VR Design and Implementation in ABI Rehabilitation
The existing literature provides guidance for safety and ethical considerations in clinical VR research [- ], although there is a general lack of focus on design and development processes for using VR in ABI rehabilitation [ , ]. Some prior studies have proposed useful recommendations for implementing VR in health care and rehabilitation research; however, they are often specific to a particular VR system or do not focus on ABI [ - ]. Given the potentially limited applicability of these recommendations for designing and implementing VR in ABI rehabilitation, developing a set of recommendations would be beneficial for guiding research in this field.
Part 1 of this review had originally planned to include recommendations for using VR in TBI rehabilitation exclusively; however, no studies were identified. Examining the use of VR with other ABIs may provide guidance for this population. Recommendations specific to ABI are necessary, as individuals may experience motor, visual, or vestibular impairments that could impact their ability to use VR [, ]. There are studies that propose recommendations for using VR in ABI rehabilitation [ , ]; however, there are no known systematic reviews on this topic. Developing recommendations based on existing studies and frameworks would be valuable for determining critical technological factors to guide the design and implementation of immersive VR in ABI rehabilitation.
VR for ABI Rehabilitation
ABI rehabilitation aims to improve function or provide compensatory strategies to reduce impairments and increase participation in activities and quality of life [- ]. Goals and opportunities to practice real-life, meaningful tasks should be provided to maximize function and enable participation outside of clinical settings [ , ]. Examples include practicing cognitive, physical, or communication therapy goals in everyday activities [ , ] or relevant community settings (eg, home, cafes, and work) [ , ]. Early and intensive therapy is also recommended [ - ]. This focus on generalization and intensity can support neuroplastic changes, which in turn can assist with functional recovery following ABIs [ , ]. Furthermore, treatment programs should be goal oriented [ ] and tailored to individual needs [ ]; however, this can be challenging due to the complexity and diversity of ABIs [ , ]. Other limitations of the current assessment and treatment approaches in ABI rehabilitation include difficulties providing sufficient intensive therapy to allow for neuroplastic change or provision of services to patients residing in rural areas [ , ]. Advances in technology have provided opportunities for researchers to investigate the use of VR as a novel rehabilitation tool to overcome some of these barriers [ , ].
The benefits of VR for ABI rehabilitation include enhanced ecological validity, the ability to maintain experimental control over assessment and treatment standardization [, - ], and the option to cater to individual skills and goals by controlling task complexity [ , ]. VR can also provide relatively naturalistic VEs [ , ] for repeated practice of functional tasks such as activities of daily living [ , , ], which may assist with generalizing targeted skills [ ]. VR can also enhance patient motivation [ , ], which is necessary for neurorehabilitation, as repeated practice is required to achieve adequate treatment outcomes. Furthermore, VR may reduce barriers to accessing rehabilitation services, such as affordability and geographical isolation [ ].
The development of VR for ABI rehabilitation should incorporate co-design design principles , which is lacking in the current literature, especially for TBI. Co-design engages intended users (eg, patients and therapists) in the design and development of products, including VR [ ]. People with ABI can experience complex and debilitating impairments. By determining their specific needs and capabilities, VR systems can be developed to meet patient and therapist needs, improve success in clinical practice, and maximize therapeutic outcomes [ , , , ].
With regard to using VR in TBI rehabilitation specifically, there are no known systematic reviews that examine the evidence base for using immersive VR to assess and treat any impairment sustained from TBIs. Experimental and review studies have mainly investigated VR for assessing or treating cognitive or motor impairments [, , , - ]. This current evidence base provides some support for using VR for TBI rehabilitation; however, the quality of the evidence is relatively low [ ], and many studies include nonimmersive and semi-immersive systems [ , - ] rather than focusing on immersive VR technology with HMDs. Issues identified in experimental studies include heterogeneity (eg, severity of TBI, VR system used, and outcome measures) with small sample sizes and a lack of randomized controlled trials (RCTs), resulting in the inability to perform meta-analysis [ , ]. Existing reviews provide important information; however, many reviews are not systematic in design or lack quality appraisal of included studies [ , , , , ], focus on VR for only cognitive or motor impairments [ - ], do not consider immersive VR only [ , , , - , ], or do not review both assessment and treatment studies [ , , , , , ]. As literature to date has not focused on using immersive VR across the clinical spectrum of TBI rehabilitation, this review aims to identify and evaluate the use of immersive VR for the assessment and treatment of any impairment sustained within this group.
This systematic review contains two parts and aims to:
- Identify and synthesize existing recommendations and frameworks for designing and implementing therapeutic VR for ABI rehabilitation. By doing so, we aim to identify key technological and co-design factors to propose recommendations for the systematic development of VR apps in this field.
- Determine the current published evidence base for using immersive VR for TBI assessment and treatment. The identified studies will be compared against the synthesized recommendations from part 1 to determine strengths and potential gaps in the literature with reference to recommendations for VR design and implementation to propose ways to improve future research and practice.
Protocol and Registration
This review has been registered with the International Prospective Register of Systematic Reviews (CRD42020152884) and was guided by the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Statement .
A systematic search was conducted in August 2019. A total of 11 databases were accessed: CINAHL, Cochrane Central, Embase, Institute of Electrical and Electronics Engineers Xplore, MEDLINE, ProQuest Central, PsycBITE, PsychINFO, Scopus, speechBITE, and Web of Science. Search strategies were adapted for individual database requirements. Gray literature was also searched to ensure that all relevant studies were identified (ie, peer-reviewed conference proceedings and clinical guidelines). Additional studies were sourced by hand searching the reference lists of the included papers and repeating database searches in June 2020.
Two systematic searches were conducted to address the research aims in this review. For part 1, the general search strategy was virtual reality AND assessment OR intervention OR research AND recommendations AND neurorehabilitation OR brain injury. For part 2, the general search terms were virtual reality AND traumatic brain injury AND assessment OR intervention. The following limits were placed on the searches and studies for inclusion: (1) peer-reviewed, (2) full-text availability, (3) written in English, and (4) published between 2009 and 2020. Literature from the past 10 years was included to reflect current research, as the use of VR in health care and rehabilitation is changing rapidly. A detailed search strategy is provided in, and the inclusion and exclusion criteria are provided in .
Inclusion and exclusion criteria for included studies.
Inclusion and Exclusion Criteria
- Provided clear guidelines, consensus statements, recommendations, considerations, or pathways for using virtual reality with adults aged ≥18 years with an acquired brain injury, or the study referred to acquired brain injury populations.
- All study designs were considered.
- Included data or review of existing scientific evidence as a basis for recommendations.
- All virtual reality types were considered (recommendations for development and implementation are likely to be applicable for all therapeutic virtual reality designs despite potential variability in virtual reality systems and levels of immersion [ ]).
- Papers that provided recommendations for a specific virtual reality system were excluded (ie, recommendations could not be applied to using virtual reality for acquired brain injury rehabilitation more broadly).
- Included adults aged ≥18 years with a diagnosis of traumatic brain injury (studies were required to have ≥50% participants with a traumatic brain injury).
- Evaluated use of immersive virtual reality for assessing or treating any impairment sustained from a traumatic brain injury (immersive virtual reality was considered due to rapid advancements in technology [ ]).
- Intervention studies included pre-post outcomes.
- Original research design (eg, randomized controlled trial, case series, and case study).
- Review papers and studies with semi-immersive or nonimmersive virtual reality systems were excluded.
The following process was conducted separately for each systematic search. Search results were exported to a reference manager (EndNote X9, Clarivate), where any duplicate references were excluded. Nonduplicate references were exported to a systematic review management program (Covidence)  to review titles and abstracts against search terms and eligibility criteria. An independent reviewer completed the reliability screening for 25.04% (426/1701) of randomly selected nonduplicate references from both searches. All disagreements were resolved via discussion. For part 1, the interrater point-by-point agreement was 97.6% (243/249), Cohen κ was 0.733, and 95% CI was 0.598-0.948, indicating substantial agreement [ ]. For part 2, the interrater point-by-point agreement was 91.5% (162/177), Cohen κ was 0.605, and 95% CI was 0.426-0.785, indicating substantial agreement [ ]. Full texts of eligible papers were retrieved and assessed for inclusion following this process.
The following data were extracted and entered into a Microsoft Excel  spreadsheet by the first author. Part 1 included bibliographic data, study design and level of evidence, population, focus of the paper, and VR recommendations. Part 2 included bibliographic data, study design and level of evidence, participant characteristics, VR system and equipment, VR task, dosage and time in VR, outcome measures, results, adverse effects, inclusion and exclusion criteria, and evaluation against recommendations synthesized from studies in part 1.
Data Synthesis and Analysis
For part 1, data were synthesized via a qualitative meta-synthesis: (1) extracting recommendations from the included studies, (2) coding individual recommendations, (3) grouping recommendations based on similarities, and (4) synthesis of grouped recommendations to produce a single comprehensive list . For part 2, meta-analysis was not performed due to the heterogeneity of the included studies. Therefore, the results are presented descriptively and in summary tables.
Where possible, studies were classified according to the Oxford Centre of Evidence-Based Medicine Levels of Evidence . This hierarchy classifies evidence according to research methodology from the highest (level 1, systematic reviews) to the lowest (level 5, mechanism-based reasoning) levels of evidence. Methodological quality was assessed using appraisal tools relevant to study design [ ]: A Measurement Tool to Assess Systematic Reviews for systematic reviews [ ]; Joanna Briggs Institute (JBI) checklists for case series [ ], case studies [ ], qualitative studies [ ], and papers of text and opinion (eg, consensus, expert opinion, and perspectives) [ ]; and the Mixed Methods Appraisal Tool for mixed methods studies [ ]. The PRISMA extension reporting guideline was used for scoping reviews [ ], as no suitable appraisal tools were found. The first author and an independent rater conducted the quality assessment. Any disagreements were resolved through consensus with the fourth author. Studies were not excluded based on appraisal tool scores. The scores were used to guide the interpretation of the results.
Part 1 of this review aimed to develop recommendations for the design and implementation of therapeutic VR for ABI rehabilitation based on a synthesis of the existing literature.
Database, gray literature, and hand searches returned 1320 potential studies. Following the removal of duplicates, 995 studies were reviewed for keywords and eligibility criteria. After reading the full texts, 14 studies met the criteria for this review ().
Study Design and Level of Evidence
A variety of study designs were included: 1 systematic review , 4 literature reviews [ - ], 5 text and opinion papers [ - , , ], 2 mixed methods studies [ , ], 1 scoping review [ ], and 1 qualitative study [ ]. A total of 5 of these studies were published as conference proceedings [ , , , , ]. Further information regarding the details of the included studies is presented in .
|Author||Country||Study design||Population or participant details||VRa definition (VR equipment and environment)||Aims of the study|
|Birckhead et al ||United States||Expert opinion consensus||Clinical health care and rehabilitation (makes references to stroke)||Immersive VR, defined VR as using an “HMDb with a close proximity screen”||To develop a methodological, best practice framework to guide development and implementation of high-quality therapeutic VR in health care|
|Bryant et al ||Australia||Qualitativec||Rehabilitation, including ABId (communication disability)||Immersive VR||To explore views of health care and VR professionals on VR-based rehabilitation|
|Deutsch and Westcott McCoy ||United States||Literature reviewc||Neurological rehabilitation||Mentions nonimmersive, semi-immersive, and immersive VR systems||To review literature on VR in neurorehabilitation and offer suggestions for bridging gaps between research and practice when adopting VR|
|Glegg and Levac ||Canada||Perspective or discussionc||Rehabilitation (based on neurorehabilitation)||Mentions nonimmersive, semi-immersive, and immersive VR systems||To provide recommendations for the development, research, and clinical implementation of VR based on known barriers and facilitators|
|Glegg and Levac ||Canada||Scoping review||Rehabilitation (including ABI)||Included studies used a range of nonimmersive, semi-immersive, and immersive VR systems||To determine factors that contribute to facilitators and barriers to implementing VR in rehabilitation and to develop recommendations to address barriers|
|Kellmeyer ||Germany||Perspective or discussion||Neurology and psychiatry||Immersive VR||To discuss implications of using highly immersive VR systems within neurology and psychiatry, including ethical issues and adverse effects|
|Laver et al ||Australia||Systematic review (1e)||Stroke||Included studies used a range of nonimmersive, semi-immersive, and immersive VR systems||To determine efficacy of VR for stroke rehabilitation|
|Lee et al ||Korea||Mixed methods||Acute stroke; 8 participants (4 male and 4 female; mean age 63 years)||Semi-immersive VR system (Microsoft Kinect; whack-a-mole game for upper limb movement)||To explore patients’ perceived difficulty and enjoyment during VR rehabilitation and the factors affecting experiences and to suggest implementation strategies for VR-based rehabilitation for acute stroke|
|Levin et al ||Canada||Literature review||ABI (upper limb impairments)||Defines VR with examples of nonimmersive, semi-immersive, and immersive systems||To review motor control and learning principles and to discuss how they can be included in the design of VR training environments|
|Lewis and Rosie ||New Zealand||Literature review||Chronic neurological conditions (associated movement disorders)||Included studies used a range of nonimmersive, semi-immersive, and immersive VR systems||To review studies that examine users’ responses to VR interventions and develop suggestions for how future VR systems can address user needs and expectations|
|Proffitt and Lange ||United States||Perspective or discussion||Stroke||VR systems that allow for immersion without assistance (ie, robotic devices)||To outline steps for developing VR interventions for stroke rehabilitation|
|Proffitt et al ||United States||Review of case studies||Rehabilitation (including stroke and TBIf)||Included studies used a range of nonimmersive and semi-immersive VR systems||To review examples of end user involvement in VR research to provide recommendations for user-engaged design and implementation for VR in clinical practice|
|Ramírez-Fernández et al ||Mexico||Literature reviewc||Stroke (upper limb impairments)||Not specified; all VR environments||To develop a taxonomy of VR design factors for upper limb rehabilitation of stroke patients|
|Vaezipour et al ||Australia||Mixed methodsc||Speech pathologists trialed a VR system designed for neurological conditions including ABI (communication impairments)||Immersive VR system (HTC VIVE Pro; simulated kitchen activity)||To explore speech pathologists’ perspectives about immersive VR for rehabilitation of neurogenic communication disorders and to determine advantages and barriers to VR use|
aVR: virtual reality.
bHMD: head-mounted display.
dABI: acquired brain injury.
eOxford levels of evidence (not applied to mixed methods or qualitative papers).
fTBI: traumatic brain injury.
Populations and Participants
Studies included a range of participants or populations: ABIs (8/14, 57%) [, , , - , , ], stroke only (4/14, 29%) [ , , , ], or a variety of medical conditions with reference to ABIs (2/14, 14%) [ , ].
Various VR systems and levels of immersion were considered or described in the included studies: a combination of nonimmersive, semi-immersive, and immersive systems (7/14, 50%) [, , , , - ]; immersive systems (4/14, 29%) [ , , , ]; semi-immersive systems (1/14, 7%) [ ]; any VR environment (1/14, 7%) [ ]; and VR systems that provided immersion without robotic devices (1/14, 7%) [ ].
Qualitative Data Synthesis and Analysis
Three key phases of therapeutic VR development in health care were recommended according to the methodological framework developed by Birckhead et al : (1) content development via end user involvement and iterative testing processes; (2) testing for feasibility, acceptability, tolerability, and efficacy; and (3) conducting RCTs for VR versus control interventions. Similar processes were described by Proffitt and Lange [ ] and Laver et al [ ], who recommended that initial VR studies for stroke rehabilitation should determine safety, validity, and usability with intended users before conducting larger trials and comparative studies [ , ].
Further synthesis and analysis of recommendations from the 14 included studies identified nine categories of recommendations related to participant, design, and technology factors for VR development and implementation in ABI rehabilitation: (1) end user involvement; (2) participant factors; (3) adverse effects and safety; (4) researcher involvement; (5) barriers and facilitators; (6) rehabilitation principles; (7) technological design and development; (8) supporting implementation; and (9) research study design, reporting, and analysis. Many of these categories are interlinked and can be considered across the suggested phases of design and implementation for therapeutic VR (). A summary of the nine categories of recommendations is presented in , and a complete downloadable version is provided in [ , , - , , , - ].
Summarized recommendations for design and implementation of virtual reality for acquired brain injury rehabilitation.
Category and Recommendations
End User Involvement
- Involve end users when designing virtual reality apps [ , , , , , ].
- Consider participant factors when designing prototypes (eg, age, gender, ethnicity, health conditions, social position, cognition, and physical limitations) [ , , - ].
- Determine the impact of virtual reality on motivation and how to sustain engagement [ , , ].
- Observe users to learn about their behavior [ ].
Adverse Effects and Safety
- Measure and report physical and emotional adverse effects [ , ].
- Examine safety of virtual reality devices and tasks to determine suitability and contraindications [ , , ].
- Develop ideas and evaluate virtual reality prototypes as a team [ ].
Determining Barriers and Facilitators to Virtual Reality
- Identify potential barriers and facilitators to designing and implementing virtual reality with key stakeholders [ , , , ] and offer solutions or implementation strategies [ ].
- Maintain therapeutic principles in virtual reality tasks (eg, principles of motor learning) [ , ].
- Tasks should be progressively challenging and customizable [ - ].
- When providing feedback, consider real-time knowledge of performance [ - ] and multimodal feedback (eg, visual, auditory, and haptic) [ , , ].
Technological Design and Development
- Use hardware and software that is unrestrictive and allows for movement and possible postural constraints [ ].
- Work in collaboration with virtual reality experts, game developers, and engineers [ , , ].
- Support therapists with virtual reality [ , , , , ] and provide continued training [ , , ].
- Provide information, training, and support for patients using virtual reality [ , , , ].
Research Study Design, Reporting, and Analysis
- Conduct larger, adequately powered trials [ ].
- For randomized controlled trials, use appropriate randomization, conceal allocation, use CONSORT (Consolidated Standards of Reporting Trials) guidelines [ ], and justify and describe control conditions [ , , ].
- When reporting virtual reality research, consider using reporting guidelines (eg, Template for Intervention Description and Replication) [ ], describe intervention details [ , ] and efforts to conceal allocation clearly [ ], register trials on a publicly accessible registry, and publish all research regardless of outcomes [ ].
- When selecting outcome measures, consider clinical relevance and validity [ , ], patient-reported outcomes [ , ], and pre- and postintervention measures [ , ]; measure long-term effects of virtual reality interventions [ , ]; compare against nonrandomized control groups [ ]; and evaluate virtual reality in natural environments [ ].
End User Involvement
Involving end users in co-design for therapeutic VR was recommended in 6 studies [, , , , , ]. Suggested end users include therapists and patients who ultimately benefit from the VR systems. Co-design encourages those involved in the design process to gather user feedback to improve the iterations of VR tasks under development. It was recommended that this feedback includes, for example, patient willingness to try VR, what worked or did not work, or which VR systems therapists wish to acquire. Gathering user feedback, both positive and negative, is an important part of co-design because VR prototypes should be iteratively tested by end users and continually refined to better meet patient and therapist needs [ , ].
A range of participant factors should be considered when developing therapeutic VR for ABI rehabilitation [, , , , , ]. This is because individuals with neurological impairments may experience physical and cognitive conditions that could impact their understanding and use of VR. In addition, more meaningful and effective VR programs can be developed when specific user needs are considered [ , , , ]. Observing patient behavior in a clinical context or conducting surveys and interviews may provide insights into these factors to be considered [ ]. Ways to enhance and sustain patient motivation should also be addressed [ , , ].
Adverse Effects and Safety
Participants may experience a range of potential adverse physical and emotional effects when using VR. Some of the potential adverse effects of using VR include headaches, vertigo, nausea, dizziness, fear, and anxiety . A total of 5 of the included studies [ - , , ] recommended that these adverse effects should be measured and reported during the development of VR tasks for neurological populations. Measuring adverse effects is necessary to establish a research base for the safety of VR devices and programs and to determine any contraindications for use with people who have an ABI [ - , ].
Determining Barriers and Facilitators
Potential barriers and facilitators of VR use and implementation should be identified via site-specific assessments or interviews during VR development [, , , ]. These barriers and facilitators should be from the perspective of patients and health care providers. Solutions to address the identified barriers should be provided to support successful VR design and implementation [ ]. This is particularly important during the design and feasibility testing of therapeutic VR [ ].
Researcher Involvement in Design
Birckhead et al  provided recommendations for researcher involvement and collaboration in the initial design processes. Research teams should develop several ideas for VR tasks and then determine the most feasible and suitable ideas for prototype testing. It is argued that team collaboration is essential for developing therapeutic VR and can often lead to more innovative and improved designs [ ].
A total of 5 studies [- ] provided recommendations for incorporating rehabilitation principles (eg, principles of motor learning and control [ , ]) when designing VR tasks for ABI rehabilitation. Motor patterns used during VR tasks should provide patients with rehabilitation benefits [ ], and tasks should be able to be modified to accommodate impairment severities and stages of recovery [ - ]. Recommendations were also made to provide feedback. Some studies suggested that feedback on performance should be given in real time to engage and motivate patients [ - ]. Levin et al [ ] recommended that knowledge of both performance and results should be provided in a way that does not interrupt task progression. Multimodal feedback (eg, visual, auditory, and haptic) should also be considered to potentially improve engagement [ , ]. Additional recommendations included designing tasks that have purposeful goals and providing the opportunity for multiple repetitions of rehabilitation targets [ ].
Technological Design and Development
A total of 4 of the included studies [, , , ] discussed technological factors to be considered when designing therapeutic VR. Researchers and therapists are recommended to work with game developers and engineers, as they have technological and design expertise to build tasks that meet patients’ and therapists’ needs [ , , ]. Hardware (eg, HMDs and hand-held devices) and software for VR tasks should also be carefully considered to prevent potential limitations or failures of the VR technology [ ]. Examples include designing or selecting systems that allow for adequate movement, providing a sufficient field of view, and reducing the complexity of hardware.
Recommendations for supporting the implementation of VR in practice for therapists and patients were provided in 8 of the included studies [, , , , , , , ]. Recommendations for therapists included providing tailored clinical training packages, providing education about using VR to achieve rehabilitation outcomes, and identifying ways to assist with troubleshooting and implementation [ , , , , ]. Education and training could also be provided to students in relevant professions [ , ]. In terms of supporting patients, therapists should provide adequate information about the purpose of VR and clear instructions for use [ , ] and monitor patient performance regardless of practice settings (eg, rehabilitation units, home-based therapy), as it is necessary for rehabilitation tasks to be performed correctly to achieve sufficient treatment outcomes [ , ].
Study Design, Reporting, and Analysis
Among the included studies, 4 [, , , ] proposed recommendations for the design, analysis, and reporting of clinical VR research. Recommendations were related, but not limited, to ensuring rigorous randomization processes in clinical trials, use of reporting guidelines, and detailing specific components of the VR tasks (eg, equipment, therapy dose, and intensity). Recommendations were provided for selecting and using outcome measures to determine the effectiveness of VR interventions [ , , , ]. Researchers are encouraged to use outcome measures that are clinically relevant, validated, and standardized, and researchers should also consider using patient-reported measures [ ] or target participation outcomes [ ]. With regard to the timing of outcome measures, Birckhead et al [ ] recommended that measures should be taken at least pre- and postintervention, whereas Laver et al [ ] suggested that outcome measures should be taken at least 3 months postintervention to determine long-term effects.
The methodological quality of the included studies varied ([ , , - , , , - , - , - ]). Cross-comparison of study quality could not be made, as quality assessment could not be conducted with a single appraisal tool and no suitable appraisal tools were found for all study types. Studies with relatively high methodological quality included one systematic review [ ], papers of text and opinion [ - , , ], one qualitative focus group study [ ], one scoping review [ ], and one mixed methods study [ ]. The second mixed methods study [ ] met four out of five criteria for quantitative methodology but had limitations in reporting qualitative and mixed methods components. However, this study was presented as a conference proceeding, so all details may not have been included.
Published guidelines for the management of TBI were included as gray literature in the search for this review. None of the reviewed guidelines [, , , , - ] provided clear recommendations for the development or implementation of VR for TBI rehabilitation. Despite this, three guidelines suggested that VR is a priority area for research for the assessment and management of TBI [ , , ], highlighting the potential of VR for TBI rehabilitation and the importance of conducting research in this area.
Part 2 of this review aimed to identify current evidence for using immersive VR for assessment and treatment in TBI rehabilitation. These studies were also examined to determine the extent to which they incorporate recommendations for developing and implementing therapeutic VR based on the findings from part 1 of this review.
Database, gray literature, and hand searches returned 1536 potential studies. A total of 830 duplicate studies were removed. Following the screening of titles and abstracts, 77 nonduplicates were identified for full-text screening. Of these studies, 5 met the inclusion criteria. This process is illustrated in.
Study Design and Level of Evidence
Included studies investigated the use of VR for assessment (2/5, 40%) [, ] or treatment (3/5, 60%) [ - ] of impairments following TBI ( ). The overall rating of the level of evidence [ ] was low. Assessment studies provided level 4 evidence [ , ]. Treatment study designs included 1 case series (level 4) [ ] and 2 single case studies [ , ].
|Author||Country||Study design||Participant numbers (TBIa severity)||Age (years)||Gender||Time post TBI||Setting|
|Banville and Nolin ||Canada||Quasi-experimental assessment (4b)||TBI=31 (7 moderate and 24 severe) and matched healthy controls=31||TBI: mean 27 (SD 11) and controls: mean 27 (SD 11)||TBI: 23 males and 8 females; controls: 23 males and 8 females||Mean 3.78 (SD 2.5) years||Outpatient|
|Cikajlo et al ||Slovenia||Case series (4b)||TBI=3, brain tumor=1, and nonbrain injury=4||TBI or brain tumor: range 24-48 and nonbrain injury: range 27-40||Not reported||Not reported||Outpatient|
|Gamito et al ||Portugal||Case study||TBI=1 (severe)||20||Male||3 months||Inpatient rehabilitation ward|
|Ma et al ||United States||Case studyc||TBI=1 (moderate-severe)||26||Male||9 months||Physical therapy clinic|
|Robitaille et al ||Canada||Proof of concept (4b)||TBI=6 (mild) and healthy controls=6||TBI: mean 30.3 (SD 8.6; range 18-61) and controls: mean 30.3 (SD 5.3)||Not reported||Median 0.46 years; range 2 weeks to 7 years||Not reported|
aTBI: traumatic brain injury.
bOxford levels of evidence.
A total of 42 participants with TBI were included in this study (). The number of participants ranged from 1 to 31 (mean 8, SD 13). Time post injury ranged from 2 weeks to 7 years. Although not always reported, the majority of participants were males (25/42, 60%) aged between 18 and 61 years. Most of the included participants sustained a severe TBI (25/42, 60%) [ , ], followed by moderate TBI (7/42, 17%) [ ], mild TBI (6/42, 14%) [ ], and moderate-severe TBI (1/42, 2%) [ ]. TBI severity was not reported for 3 participants [ ]. Where reported, VR was used in inpatient [ ] and outpatient settings [ , , ].
Target of VR Assessment or Treatment
Impairments targeted in VR assessment included executive functions  and prospective memory [ ]. VR treatments targeted attention and working memory [ ], balance and functional mobility [ ], and stress and anxiety [ ].
Keeping with the definition of immersive VR systems, all studies used HMDs to create immersive VEs [- , , ], and one study included body motion tracking [ ]. Virtual cities were used as the basis for memory and attention tasks [ , ]. Other VR tasks included a mindfulness-based stress reduction program [ ], a military patrol task to assess executive functions [ ], and standing balance practice in VR as an adjunct to traditional physical therapy [ ].
Assessment studies did not report the time spent in VR. Where reported, therapy session duration ranged from 5 to 25 minutes; total dosage ranged from 50 minutes to 3 hours; and participants received 5, 8, or 10 therapy sessions. One study provided breaks during VR sessions . Further information related to the VR details of the included studies is presented in .
|Study||Target||Dosage or time in VRa and VR hardware||Task details||Outcome measures||Results||Adverse effects and potential issues||Eligibility criteria|
|Banville and Nolin ||Prospective memory and executive functions||Time in VR not reported; HMDb (eMagin Z800) with head tracker||Non-VR task: prospective memory assessment based on Rivermead Behavioral Memory Test; VR task: virtual prospective memory tasks completed in a virtual city (included visiting apartments and selecting an apartment to live in)||Non-VR: correct actions, time to complete, and whether prompting was required; VR: prospective memory score, precision score, time to complete, success in task, and IPQc||Participants could be classified as having a TBId by performance on each task. TBI participants were significantly less precise with prospective memory VR tasks (P=.02) and took more time to perform VR tasks (P=.008) than controls||SSQe completed; no reported cybersickness; SSQ scores did not differ between groups||Inclusion criteria: confirmed TBI|
|Cikajlo et al ||Stress and anxiety||8 sessions (25 minutes per session, once weekly); Samsung Galaxy X7 mobile phone mounted to HMD (Samsung Gear VR)||Mindfulness stress reduction program conducted by an instructor (eg, self-meditation and group discussions in various VEsf such as a mountain view or a room with a fireplace)||MAAS,g SWLS,h MMSEi (TBI only), session and task ratings, and head motion||Slight improvement in MAAS and SWLS scores (TBI group>non-TBI group); one participant increased MMSE (not reported for others); task ratings: simple to use and interesting; varying head motions||Potential for overheating of mobile phones (sessions were, therefore, limited to 30 minutes)||Inclusion criteria: mild or no cognitive impairment and able to understand instructions; exclusion criteria: high diopters, astigmatism, and wore glasses|
|Gamito et al ||Working memory and attention||10 sessions (5 minutes each session); HMD (eMagin Z800)||Activities included performing ADLsj in the VE (eg, breakfast, navigating to and from a supermarket, and buying items)||PASATk and completion time of each task||Significant increase in correct responses between initial and final PASAT scores (P<.05)||Not reported||Inclusion criteria: diagnosed with a TBI 3-12 months prior, clinical deficit in memory and attention, and aged 18-60 years; exclusion criteria: a previous psychiatric disorder that may impact memory and attention and neurological diseases|
|Ma et al ||Balance and functional mobility||5 sessions (12 trials, with a 1- to 2-minute break in between); breaks were decided by the participant. Samsung Galaxy X7 mobile phone mounted to HMD (Samsung Gear VR)||Standing balance exercises in a VE with traffic lights, street crossing and traffic island, night and day versions, moving cars, and static buildings||DGI,l mini-BEST,m DHI,n ABC,o GROC,p and patient-specific functional scale (self-scoring street crossing and multitasking abilities)||Improvements in DGI, mini-BEST, DHI, GROC, and patient-specific functional scale||Not reported||Not reported|
|Robitaille et al ||Executive functions||Time in VR not reported; HMD (piSight 166-43) with head tracking and body tracking (MoCap)||Exploration of a simulated military patrol scene in a village with different conditions and obstacles to navigate (eg, fences, wires, beams, and avatars)||PQ,q SUS,r errors, walking speed and fluidity, and obstacle clearance||TBI group walked faster and had slightly greater obstacle clearances. Significant difference in walking fluidity between groups for two hostile blocks (P=.046). Moderate to high presence scores on SUS and PQ||SSQ completed: 1 participant with TBI and 1 control participant reported slight headaches||Inclusion criteria (TBI): mild TBI; inclusion criteria (controls): no known TBI or other neurological or musculoskeletal issues|
aVR: virtual reality.
bHMD: head-mounted display.
cIPQ: Igroup Presence Questionnaire.
dTBI: traumatic brain injury.
eSSQ: Simulator Sickness Questionnaire.
fVE: virtual environment.
gMAAS: Mindfulness Attention Awareness Scale.
hSWLS: Satisfaction With Life Scale.
iMMSE: Mini-Mental State Examination.
jADL: activities of daily living.
kPASAT: Paced Auditory Serial Addition Task.
lDGI: Dynamic Gait Index.
mmini-BEST: Mini-Balance Evaluation System Test.
nDHI: Dizziness Handicap Index.
oABC: Activities Balance Confidence Scale.
pGROC: Global Rating of Change.
qPQ: Presence Questionnaire.
rSUS: Slater-Usoh-Steed Questionnaire.
One assessment study investigated participant performance on a VR and non-VR assessment of prospective memory , with participants performing similarly on both tasks. Both assessment studies [ , ] included healthy control groups, with findings able to distinguish between participants with and without TBI. One intervention study [ ] included unmatched participants without TBI and did not report major differences in outcomes between the groups.
Eligibility Criteria and Adverse Effects
One intervention study  excluded participants due to visual impairments that may have impacted their tolerance of the HMD. The Simulator Sickness Questionnaire [ ] was used in 2 studies [ , ] to monitor potential adverse effects of VR, with only 1 participant with TBI reporting a slight headache [ ]. A total of 2 studies did not consider or report adverse effects [ , ].
Outcome Measures and Results
Various outcome measures were used, and all studies included more than one measure. VR task-specific outcome measures were used in 4 studies [, , , ]. A total of 4 studies used outcome measures traditionally used for non-VR tasks [ - , ]. Depending on the outcome, intervention studies took measures pre-, mid-, and postintervention [ , ] or pre-post intervention with a 1-month follow-up [ ].
The results from the assessment studies suggested that VR assessment tasks have the potential for use as novel diagnostic tools [, ]. These studies included healthy controls and could classify participants as having a TBI or not by their performance on VR assessment tasks. The findings demonstrated a significant difference between groups for walking fluidity during a navigation task [ ] and for time and precision to complete a procedural memory task in VR [ ].
Statistically significant outcomes were reported in one case study , where VR intervention for attention and memory deficits led to a significant increase in pre-post assessment scores on the Paced Auditory Serial Addition Task. The remaining treatment studies presented descriptive data on the outcomes of participants with TBI [ , ]. Ma et al [ ] demonstrated that VR treatment combined with standard physical therapy led to improvements in gait and balance. Cikajlo et al [ ] reported slight improvements in pre-post psychometric outcomes for stress and anxiety following the implementation of a group-based VR mindfulness intervention that participants rated as interesting and simple to use.
The quality assessments of the included treatment studies are presented in. We assessed 2 case studies using the JBI checklist for case reports [ ] and these studies were found to have low [ ] to moderate [ ] methodological quality. The studies included adequate information about interventions but did not provide comprehensive participant or assessment details or refer to measuring the potential adverse effects of VR. One study [ ] was appraised using the JBI checklist for case series [ ] and had a low methodological quality. Information about condition measurement and treatment outcomes was provided, but important details about the participants and recruitment methods were absent.
Recommendations for VR: Evidence in TBI Studies
VR assessment and treatment studies for TBI rehabilitation were examined regarding the three suggested phases of VR development  and the nine categories of recommendations for VR design and implementation proposed in part 1 of this review ( ). With regard to phases of VR design, there was one feasibility study [ ] and one proof-of-concept study [ ] but no controlled trials or co-design studies with detailed descriptions of end user involvement in VR development. A total of 3 studies [ , , ] have considered the potential adverse effects of VR. Rehabilitation principles were included in studies that provided varied or progressively challenging tasks [ , ]. All treatment studies collected at least one outcome measure pre- and postintervention and included clinically relevant outcome measures. At least one patient-reported outcome measure was included in 4 studies [ , , , ], and one study included a user survey for task feedback [ ]. Details were generally provided about the active ingredients of the VR equipment and tasks (eg, dose, repetitions, and time in VR).
Recommendations that were not included in the assessment and treatment studies were as follows: involving researchers when developing VR tasks, considering barriers and facilitators to VR use, technological design and development, and supporting VR in practice. However, many of these recommendations are applicable to specific phases of VR development and implementation, so they may not have been relevant for all studies. Furthermore, recommendations may have been addressed but not specifically reported on.
|Recommendations for VRa development||Banville and Nolin ||Cikajlo et al ||Gamito et al ||Ma et al ||Robitaille et al |
|Phase of VR development|
|Phase 1: co-design|
|Phase 2: feasibility||✓b||✓|
|Phase 3: controlled trials|
|End user involvement||✓|
|Adverse effects and safety||✓||✓||✓|
|Determining barriers and facilitators to VR|
|Technological design and development|
|Research study design, reporting, and analysis||✓||✓||✓||✓||✓|
aVR: virtual reality.
The findings of this systematic review highlight that research in the field of VR and ABI rehabilitation, particularly for TBI, is still emerging. To our knowledge, this is the first study to synthesize existing recommendations for developing VR for ABI rehabilitation and to systematically review the current evidence base for using immersive VR for TBI rehabilitation. Recommendations for future research have been provided based on the results of this review.
Part 1 of this review aimed to identify and synthesize the recommendations for designing and implementing therapeutic VR for ABI rehabilitation, with a focus on using existing frameworks to determine key technological and co-design factors. The findings appear to be consistent across VR technologies and health care settings and contain important considerations for using VR with people who have an ABI.
Three phases for VR development and implementation of therapeutic VR in health care were developed by Birckhead et al  and formed a framework against which this review was completed. A total of nine categories of recommendations were subsequently developed from all 14 studies included in part 1 of this review. Most recommendations that were addressed in the limited literature reported in this study were related to the design of VR tasks, including consideration of participant factors, involving key end users and researchers, determining barriers and facilitators of VR use, technological considerations, and including rehabilitation principles in VR tasks. The recommendations can be applied throughout VR development and implementation ( ).
A phased approach to VR design should be considered [, , ], with early focus on engaging key end users [ , , , , , , , ] in co-design and feasibility studies before conducting larger controlled trials [ , , , ]. This approach is not widely used in research investigating VR for health care purposes [ - ] or for adults with TBI, yet user involvement in VR development is emerging in pediatric TBI [ ] and ABI rehabilitation [ , ]. Involving end users in designing digital health interventions is recommended [ , ] and is essential for producing successful VR apps [ , , ], particularly for people with TBI [ ]. Additional recommendations for research design, reporting and analysis, and supporting implementation for VR were synthesized to further guide and strengthen research in this area. Such recommendations include the use of reporting guidelines such as the Template for Intervention Description and Replication [ ] and the CONSORT (Consolidated Standards of Reporting Trials) [ ] and supporting end users with VR adoption via education and training.
The included studies drew on research examining various VR systems and levels of immersion. This reflects the literature from the past decade and highlights the limited use of fully immersive VR for neurological rehabilitation. However, recommendations for VR research are similar across VR platforms, particularly for design and feasibility studies , and may be adapted for various clinical settings and disciplines [ ]. No specific recommendations were made regarding preferred VR hardware or software. Future research and clinical VR apps should focus on more immersive systems [ ] because of the rapid advancement and availability of VR technology as well as tasks that can be used across different devices to facilitate transition and use from rehabilitation facilities to home environments (eg, wireless systems and mobile phone compatibility) [ , , ]. The tolerance and safety of new VR systems will need to be established for people with ABI [ - , , ].
The second part of this review aimed to determine the current evidence base for using immersive VR for TBI rehabilitation and to review the extent to which these studies addressed the recommendations developed in part 1 of this review. A total of 5 studies that investigated the use of immersive VR for TBI assessment and treatment were identified and included.
The findings demonstrate a small body of evidence for using immersive VR in TBI rehabilitation. Studies have used immersive VR to assess cognitive impairment following mild, moderate, and severe TBI [, ]. VR treatments targeted memory and attention [ ] and balance [ ] in single cases of participants with moderate-severe TBI and anxiety in a case series of 3 people with TBI (severity not disclosed) [ ]. The range of time post injury, age of participants, clinical settings, dosage and frequency, and VR tasks suggest that immersive VR has potential for use with people with TBI across the continuum of care [ ]; however, further studies are required to support this evidence because of the limited number of included studies and small sample sizes.
Three different HMDs were used in the 5 studies, including the smartphone-compatible Samsung Gear, which highlights the accessibility and affordability of immersive VR technology [, , ]. There were no commonalities in terms of VR software and tasks, with each study implementing VR tasks specific to the targeted impairments and outcomes. There would be potential challenges in developing a VR platform to suit the various impairments and severities of brain injury [ ], so the proposed recommendations developed in part 1 of this review may improve the consistency of VR development for TBI rehabilitation where heterogeneity may not be accounted for.
There were limited adverse effects of VR use reported in 3 of the 5 included studies [, , ]. The potential adverse effects of VR use must be monitored and reported due to the limited research in this area and to determine the safety and feasibility of immersive VR for people with TBI [ - , ]. Involving VR experts and interdisciplinary teams should be considered when designing new VR tasks to mitigate potential safety issues [ ].
The included studies reported positive findings, but few specific conclusions can be drawn regarding assessment and treatment effectiveness due to a limited number of studies with small sample sizes, a lack of control conditions, assessment reference standards, face-to-face comparisons, and heterogeneity of data that prevented pooling of data and meta-analysis. Some studies had relatively low methodological quality and provided minimal details about participants and recruitment methods, making it challenging to generalize findings and determine the suitability of VR platforms and tasks for people with TBI.
The current evidence base for using immersive VR for TBI rehabilitation incorporates some of the recommendations proposed in part 1 of this review (), yet there is a need for future studies to increase end user engagement in co-design and feasibility testing before conducting controlled trials [ , , ]. Specifically, future research should engage end users [ , , , , ] and clinical experts alongside the design and technology industries to inform VR development [ , , ], identify potential barriers and facilitators to using VR [ , , , ], and focus on stepwise progression of VR research [ , , , ]. By doing so, VR tasks for TBI, and ABI rehabilitation more broadly, can better meet patients’ and therapists’ needs [ , , , , ].
Although a systematic literature search was undertaken, some existing studies may have been excluded, as inclusion criteria limited papers to English only, and gray literature did not include conference abstracts or theses. In addition, inconsistencies with VR definitions and classifications [- ] may have led to exclusion based on the definitions of VR immersion levels. Caution should be taken when interpreting results, as the overall levels of evidence presented were relatively low. Furthermore, the inclusion of various study designs led to the inability to use a single critical appraisal tool, and some of the included studies presented poor methodological quality.
There were limited high-level evidence studies that provided recommendations for developing and implementing VR in ABI rehabilitation (ie, part 1). Although this may decrease the perceived value of findings, it likely reflects the fact that VR technology and practice in this field are still emerging  and may be moving faster than the evidence base [ , ]. Despite this, most recommendations were synthesized from a VR expert consensus paper [ ], which provided a framework for therapeutic VR methodology. Furthermore, findings across the included studies were similar and provide a basis for ongoing research for developing and implementing VR for ABI rehabilitation, including for people with TBI.
The current evidence base for using immersive VR for TBI assessment and treatment (ie, part 2) consisted mainly of lower-quality methods of case studies and case series. These study designs may be suitable for early co-design and feasibility studies for VR development, yet this was not always reflected in the included studies. On the basis of the methodological quality and levels of evidence, future studies should provide important details about participants, recruitment methods, and interventions; consider and report on adverse effects; and include reference standards and control conditions. These findings reflect the general lack of high-quality evidence, as highlighted in previous reviews of nonimmersive, semi-immersive, and immersive VR for TBI rehabilitation [, , , , ], and the findings may be difficult to generalize due to heterogeneity. The use of the proposed recommendations may improve the consistency of design and implementation of VR in TBI rehabilitation and provide a model to advance clinical research in this area.
Recommendations for Future Research
Future research should consider the proposed recommendations when designing and implementing VR tasks for ABI rehabilitation, especially for people with TBIs. As identified in this review, stepwise VR development () [ , , ] is lacking in current TBI literature. There needs to be an increased focus on co-design processes to investigate the opinions and needs of key end users, including people with ABI and their therapists [ , , , , , , ]. Iterative testing and feasibility studies will also be necessary to establish the safety and viability of new immersive VR tasks before implementing larger-scale studies and RCTs [ , , ], particularly given that people with ABIs may face challenges when using and interacting with VR systems [ , ] and there are limited studies that use immersive VR for TBI rehabilitation [ - , , ].
Although this review offers a starting point for guiding future research in VR for TBI rehabilitation, the recommendations provided were formed from papers that included a wider range of ABIs. Work should be undertaken to develop guidelines specific to TBI to ensure more rigorous development and evaluation of therapeutic VR for this population. Expanding the evidence base for using VR with people with TBI has been encouraged and highlighted as a priority area in published guidelines for TBI management [, , ]. Furthermore, immersive VR to date has been used to treat people with TBI who have cognitive disorders, balance issues, or anxiety. Future research should develop and investigate the use of VR for other significant impairments that people with TBI may experience, such as cognitive-communication disorders.
This systematic review highlights that the use of immersive VR in ABI rehabilitation, especially TBI, is still in its infancy. There are no existing guidelines for designing and implementing VR tasks specific to TBI, reflecting the need for more rigorous research in this area. Existing evidence demonstrates the potential to use immersive VR for TBI assessment and treatment. However, this comprises a small number of lower-quality studies with a large degree of heterogeneity, small sample sizes, and limited generalizability of the findings.
This review produced recommendations for developing and implementing VR for ABI rehabilitation (and ): engaging end users; considering participant, researcher, and technological factors; addressing facilitators and barriers; incorporating rehabilitation principles; and supporting implementation in clinical practice. These recommendations can be incorporated into the three phases of therapeutic VR development ( ). Researchers in ABI rehabilitation are presented with an opportunity to capitalize on the current digital health movement, particularly when the required technology and resources for immersive VR are becoming increasingly available and affordable. VR has the potential to provide innovative assessment and treatment methods, and future work in this field should use these recommendations to improve consistency, quality, and outcomes for the effective design of therapeutic VR.
This research was supported by a Research Training Program Scholarship and a Merit Award Scholarship awarded to the first author (SB). The authors would like to thank Petra Avramovic for assistance with the reliability screening and critical appraisal of the included papers.
Conflicts of Interest
Example database searches.PDF File (Adobe PDF File), 185 KB
List of recommendations for the design and implementation of virtual reality for acquired brain injury rehabilitation.PDF File (Adobe PDF File), 142 KB
Quality appraisal of the included studies.XLSX File (Microsoft Excel File), 23 KB
- Adamovich SV, Fluet GG, Tunik E, Merians AS. Sensorimotor training in virtual reality: a review. NeuroRehabilitation 2009;25(1):29-44 [FREE Full text] [CrossRef] [Medline]
- Bohil CJ, Alicea B, Biocca F. Virtual reality in neuroscience research and therapy. Nat Rev Neurosci 2011 Nov 3;12(12):752-762. [CrossRef] [Medline]
- Teasell R, Bayona N, Marshall S, Cullen N, Bayley M, Chundamala J, et al. A systematic review of the rehabilitation of moderate to severe acquired brain injuries. Brain Inj 2007 Feb;21(2):107-112. [CrossRef] [Medline]
- What Is the Difference Between Acquired Brain Injury and Traumatic Brain Injury? Brain Injury Association of America. 2020. URL: https://www.biausa.org/brain-injury/about-brain-injury/nbiic/what-is-the-difference-between-an-acquired-brain-injury-and-a-traumatic-brain-injury [accessed 2020-11-10]
- Connelly L, Jia Y, Toro M, Stoykov ME, Kenyon RV, Kamper DG. A pneumatic glove and immersive virtual reality environment for hand rehabilitative training after stroke. IEEE Trans. Neural Syst. Rehabil. Eng 2010 Oct;18(5):551-559 [FREE Full text] [CrossRef]
- Kizony R, Katz N, (Tamar) Weiss PL. Adapting an immersive virtual reality system for rehabilitation. J Visual Comput Animat 2003 Dec;14(5):261-268 [FREE Full text] [CrossRef]
- Lee SH, Jung H, Yun SJ, Oh B, Seo HG. Upper extremity rehabilitation using fully immersive virtual reality games with a head mount display: a feasibility study. PM R 2020 Mar;12(3):257-262. [CrossRef] [Medline]
- Levin MF, Magdalon EC, Michaelsen SM, Quevedo AA. Quality of grasping and the role of haptics in a 3-d immersive virtual reality environment in individuals with stroke. IEEE Trans Neural Syst Rehabil Eng 2015 Nov;23(6):1047-1055. [CrossRef]
- McNeill M, Pokluda L, McDonough S, Crosbie C. Immersive Virtual Reality for Upper Limb Rehabilitation Following Stroke. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. 2004 Oct Presented at: IEEE'04; October 10-13, 2004; The Hague, Netherlands URL: https://doi.org/10.1109/ICSMC.2004.1400754 [CrossRef]
- Laver KE, Lange B, George S, Deutsch JE, Saposnik G, Crotty M. Virtual reality for stroke rehabilitation. Cochrane Database Syst Rev 2017 Nov 20;11:CD008349 [FREE Full text] [CrossRef] [Medline]
- Jaffe DL, Brown DA, Pierson-Carey CD, Buckley EL, Lew HL. Stepping over obstacles to improve walking in individuals with poststroke hemiplegia. J Rehabil Res Dev 2004 May;41(3A):283-292 [FREE Full text] [CrossRef] [Medline]
- Crosbie JH, Lennon S, McGoldrick MC, McNeill MD, McDonough SM. Virtual reality in the rehabilitation of the arm after hemiplegic stroke: a randomized controlled pilot study. Clin Rehabil 2012 Sep;26(9):798-806. [CrossRef] [Medline]
- Jannink MJ, Erren-Wolters CV, de Kort AC, van der Kooij H. An electric scooter simulation program for training the driving skills of stroke patients with mobility problems: a pilot study. Cyberpsychol Behav 2008 Dec;11(6):751-754. [CrossRef] [Medline]
- Cortés-Pérez I, Nieto-Escamez FA, Obrero-Gaitán E. Immersive virtual reality in stroke patients as a new approach for reducing postural disabilities and falls risk: a case series. Brain Sci 2020 May 15;10(5):296 [FREE Full text] [CrossRef] [Medline]
- Menon DK, Schwab K, Wright DW, Maas AI, Demographics and Clinical Assessment Working Group of the InternationalInteragency Initiative toward Common Data Elements for Research on Traumatic Brain InjuryPsychological Health. Position statement: definition of traumatic brain injury. Arch Phys Med Rehabil 2010 Nov;91(11):1637-1640. [CrossRef] [Medline]
- Humphreys I, Wood RL, Phillips CJ, Macey S. The costs of traumatic brain injury: a literature review. Clinicoecon Outcomes Res 2013;5:281-287 [FREE Full text] [CrossRef] [Medline]
- Boyle GJ, Haines S. Severe traumatic brain injury: some effects on family caregivers. Psychol Rep 2002 Apr;90(2):415-425. [CrossRef] [Medline]
- Cullen N. Canadian healthcare perspective in traumatic brain injury rehabilitation. J Head Trauma Rehabil 2007;22(4):214-220. [CrossRef] [Medline]
- Turner-Stokes L, Pick A, Nair A, Disler PB, Wade DT. Multi-disciplinary rehabilitation for acquired brain injury in adults of working age. Cochrane Database Syst Rev 2015 Dec 22(12):CD004170. [CrossRef] [Medline]
- Menon DK, Bryant C. Time for change in acquired brain injury. Lancet Neurol 2019 Jan;18(1):28. [CrossRef] [Medline]
- Jerald J. The VR Book: Human-Centred Design for Virtual Reality. New York, NY: Association for Computing Machinery and Morgan & Claypool; 2016.
- Ma M, Zheng H. Virtual reality and serious games in healthcare. In: Brahnam S, Jain LC, editors. Advanced Computational Intelligence Paradigms in Healthcare 6. Virtual Reality in Psychotherapy, Rehabilitation, and Assessment. Heidelberg, Germany: Springer, Berlin, Heidelberg; 2011:169-192.
- Kalawsky R. Developments in VR Technology. The Advisory Group on Computer Graphics. 1996. URL: http://www.agocg.ac.uk/reports/virtual/vrtech/title.htm [accessed 2019-06-09]
- Slater M. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos Trans R Soc Lond B Biol Sci 2009 Dec 12;364(1535):3549-3557 [FREE Full text] [CrossRef] [Medline]
- Miller HL, Bugnariu NL. Level of immersion in virtual environments impacts the ability to assess and teach social skills in autism spectrum disorder. Cyberpsychol Behav Soc Netw 2016 Apr;19(4):246-256 [FREE Full text] [CrossRef] [Medline]
- Burdea GC. Virtual rehabilitation--benefits and challenges. Methods Inf Med 2003;42(5):519-523. [Medline]
- Rizzo A. Virtual reality and disability: emergence and challenge. Disab Rehab 2009 Jul 7;24(11-12):567-569. [CrossRef]
- Rizzo A, Kim GJ. A swot analysis of the field of virtual reality rehabilitation and therapy. Presence: Teleoperators Virtual Environ 2005;14(2):119-146. [CrossRef]
- Massetti T, da Silva TD, Crocetta TB, Guarnieri R, de Freitas BL, Bianchi Lopes P, et al. The clinical utility of virtual reality in neurorehabilitation: a systematic review. J Cent Nerv Syst Dis 2018;10:1179573518813541 [FREE Full text] [CrossRef] [Medline]
- Madary M, Metzinger TK. Recommendations for good scientific practice and the consumers of VR-technology. Front Robot AI 2016 Feb 19;3:3 [FREE Full text] [CrossRef]
- Ramirez E. Ecological and ethical issues in virtual reality research: a call for increased scrutiny. Philosophical Psychology 2018 Oct 13;32(2):211-233 [FREE Full text] [CrossRef]
- Bryant L, Brunner M, Hemsley B. A review of virtual reality technologies in the field of communication disability: implications for practice and research. Disabil Rehabil Assist Technol 2020 May;15(4):365-372. [CrossRef] [Medline]
- Spiegel JS. The ethics of virtual reality technology: social hazards and public policy recommendations. Sci Eng Ethics 2018 Oct;24(5):1537-1550. [CrossRef] [Medline]
- Aida J, Chau B, Dunn J. Immersive virtual reality in traumatic brain injury rehabilitation: a literature review. NeuroRehabilitation 2018;42(4):441-448. [CrossRef] [Medline]
- Glegg SM, Levac DE. Barriers, facilitators and interventions to support virtual reality implementation in rehabilitation: a scoping review. PM R 2018 Nov;10(11):1237-51.e1 [FREE Full text] [CrossRef] [Medline]
- Campelo A, Hashim J, Weisberg A, Katz L. Virtual Rehabilitation in the elderly: Benefits, issues, and considerations. In: 2017 International Conference on Virtual Rehabilitation. 2017 Presented at: VR'17; June 19-22, 2017; Montreal, Canada p. 19-22. [CrossRef]
- Kitson A, Prpa M, Riecke BE. Immersive interactive technologies for positive change: a scoping review and design considerations. Front Psychol 2018;9:1354 [FREE Full text] [CrossRef] [Medline]
- Lindner P, Miloff A, Hamilton W, Reuterskiöld L, Andersson G, Powers MB, et al. Creating state of the art, next-generation Virtual Reality exposure therapies for anxiety disorders using consumer hardware platforms: design considerations and future directions. Cogn Behav Ther 2017 Sep;46(5):404-420. [CrossRef] [Medline]
- Glegg SM, Levac DE. Enhancing Clinical Implementation of Virtual Reality: an Evidence-based Perspective and Call to Action. In: 2017 International Conference on Virtual Rehabilitation. 2017 Presented at: VR'17; June 19-22, 2017; Montreal, Canada. [CrossRef]
- Kellmeyer P. Neurophilosophical and ethical aspects of virtual reality therapy in neurology and psychiatry. Camb Q Healthc Ethics 2018 Oct;27(4):610-627. [CrossRef] [Medline]
- Proffitt R, Lange B. Considerations in the efficacy and effectiveness of virtual reality interventions for stroke rehabilitation: moving the field forward. Phys Ther 2015 Mar;95(3):441-448 [FREE Full text] [CrossRef] [Medline]
- Report to Congress on Traumatic Brain Injury in the United States: Epidemiology and Rehabilitation. Centers for Disease Control and Prevention. 2015. URL: https://www.cdc.gov/traumaticbraininjury/pdf/TBI_Report_to_Congress_Epi_and_Rehab-a.pdf [accessed 2020-02-03]
- Carlson PM, Boudreau ML, Davis J, Johnston J, Lemsky C, McColl MA, et al. 'Participate to learn': a promising practice for community ABI rehabilitation. Brain Inj 2006 Oct;20(11):1111-1117. [CrossRef] [Medline]
- Maas AI, Menon DK, Adelson PD, Andelic N, Bell MJ, Belli A, InTBIR ParticipantsInvestigators. Traumatic brain injury: integrated approaches to improve prevention, clinical care, and research. Lancet Neurol 2017 Dec;16(12):987-1048. [CrossRef] [Medline]
- Zanier ER, Zoerle T, Di Lernia D, Riva G. Virtual reality for traumatic brain injury. Front Neurol 2018;9:345 [FREE Full text] [CrossRef] [Medline]
- International Classification of Functioning, Disability and Health. World Health Organisation. 2001. URL: https://apps.who.int/iris/handle/10665/42407 [accessed 2019-08-09]
- Tate R, Kennedy M, Ponsford J, Douglas J, Velikonja D, Bayley M, et al. INCOG recommendations for management of cognition following traumatic brain injury, part III: executive function and self-awareness. J Head Trauma Rehabil 2014;29(4):338-352. [CrossRef] [Medline]
- Togher L, Wiseman-Hakes C, Douglas J, Stergiou-Kita M, Ponsford J, Teasell R, INCOG Expert Panel. INCOG recommendations for management of cognition following traumatic brain injury, part IV: cognitive communication. J Head Trauma Rehabil 2014;29(4):353-368. [CrossRef] [Medline]
- Mattingly EO. Functional evaluation and treatment in acquired brain injury acute rehabilitation. Perspect ASHA SIGs 2018 Jan;3(2):13-20 [FREE Full text] [CrossRef]
- Bayley MT, Tate R, Douglas JM, Turkstra LS, Ponsford J, Stergiou-Kita M, INCOG Expert Panel. INCOG guidelines for cognitive rehabilitation following traumatic brain injury: methods and overview. J Head Trauma Rehabil 2014;29(4):290-306. [CrossRef] [Medline]
- Turner-Stokes L. Evidence for the effectiveness of multi-disciplinary rehabilitation following acquired brain injury: a synthesis of two systematic approaches. J Rehabil Med 2008 Oct;40(9):691-701 [FREE Full text] [CrossRef] [Medline]
- Hylin MJ, Kerr AL, Holden R. Understanding the mechanisms of recovery and/or compensation following injury. Neural Plast 2017;2017:7125057 [FREE Full text] [CrossRef] [Medline]
- Section II: Assessment and Rehabilitation of Brain Injury Sequelae. Ontario Neurotrauma Foundation. 2016. URL: https://braininjuryguidelines.org/modtosevere/fileadmin/Guidelines_components/Rec/Section_2_REC_complete_ENG_final.pdf [accessed 2019-07-08]
- Königs M, Beurskens EA, Snoep L, Scherder EJ, Oosterlaan J. Effects of timing and intensity of neurorehabilitation on functional outcome after traumatic brain injury: a systematic review and meta-analysis. Arch Phys Med Rehabil 2018 Jun;99(6):1149-59.e1. [CrossRef] [Medline]
- Khan F, Baguley IJ, Cameron ID. 4: rehabilitation after traumatic brain injury. Med J Aust 2003 Mar 17;178(6):290-295. [CrossRef] [Medline]
- Pietrzak E, Pullman S, McGuire A. Using virtual reality and videogames for traumatic brain injury rehabilitation: a structured literature review. Games Health J 2014 Aug;3(4):202-214. [CrossRef] [Medline]
- Edwards J, Vess J, Reger G, Cernich A. The use of virtual reality in the military's assessment of service members with traumatic brain injury: recent developments and emerging opportunities. Appl Neuropsychol Adult 2014;21(3):220-230. [CrossRef] [Medline]
- Martínez-Moreno JM, Sánchez-González P, Luna M, Roig T, Tormos JM, Gómez EJ. Modelling ecological cognitive rehabilitation therapies for building virtual environments in brain injury. Methods Inf Med 2016;55(1):50-59. [CrossRef] [Medline]
- Schultheis M, Himelstein J, Rizzo A. Virtual reality and neuropsychology: upgrading the current tools. J Head Trauma Rehabil 2002 Oct;17(5):378-394. [CrossRef] [Medline]
- Weiss P, Katz N. The potential of virtual reality for rehabilitation. J Rehabil Res Dev 2004 Sep;41(5):vii-vix [FREE Full text] [Medline]
- Holden MK. Virtual environments for motor rehabilitation: review. Cyberpsychol Behav 2005 Jun;8(3):187-211; discussion 212. [CrossRef] [Medline]
- Besnard J, Richard P, Banville F, Nolin P, Aubin G, le Gall D, et al. Virtual reality and neuropsychological assessment: the reliability of a virtual kitchen to assess daily-life activities in victims of traumatic brain injury. Appl Neuropsychol Adult 2016;23(3):223-235. [CrossRef] [Medline]
- Brundage SB, Graap K, Gibbons KF, Ferrer M, Brooks J. Frequency of stuttering during challenging and supportive virtual reality job interviews. J Fluency Disord 2006;31(4):325-339. [CrossRef] [Medline]
- Thornton M, Marshall S, McComas J, Finestone H, McCormick A, Sveistrup H. Benefits of activity and virtual reality based balance exercise programmes for adults with traumatic brain injury: perceptions of participants and their caregivers. Brain Inj 2005 Nov;19(12):989-1000. [CrossRef] [Medline]
- Norman D, Draper S. User-centred System Design: New Perspective on Human-computer Interaction. Hillsdale, NJ: Lawrence Earlbaum Associate; 1986.
- Birckhead B, Khalil C, Liu X, Conovitz S, Rizzo A, Danovitch I, et al. Recommendations for methodology of virtual reality clinical trials in health care by an international working group: iterative study. JMIR Ment Health 2019 Jan 31;6(1):e11973 [FREE Full text] [CrossRef] [Medline]
- Proffitt R, Glegg S, Levac D, Lange B. End-user involvement in rehabilitation virtual reality implementation research. J Enabling Technol 2019;13(2):92-100 [FREE Full text] [CrossRef] [Medline]
- Manivannan S, Al-Amri M, Postans M, Westacott LJ, Gray W, Zaben M. The effectiveness of virtual reality interventions for improvement of neurocognitive performance after traumatic brain injury: a systematic review. J Head Trauma Rehabil 2019;34(2):E52-E65. [CrossRef] [Medline]
- Alashram AR, Annino G, Padua E, Romagnoli C, Mercuri NB. Cognitive rehabilitation post traumatic brain injury: a systematic review for emerging use of virtual reality technology. J Clin Neurosci 2019 Aug;66:209-219. [CrossRef] [Medline]
- Maggio MG, De Luca R, Molonia F, Porcari B, Destro M, Casella C, et al. Cognitive rehabilitation in patients with traumatic brain injury: a narrative review on the emerging use of virtual reality. J Clin Neurosci 2019 Mar;61:1-4. [CrossRef] [Medline]
- Shin H, Kim K. Virtual reality for cognitive rehabilitation after brain injury: a systematic review. J Phys Ther Sci 2015 Sep;27(9):2999-3002 [FREE Full text] [CrossRef] [Medline]
- Larson EB, Feigon M, Gagliardo P, Dvorkin AY. Virtual reality and cognitive rehabilitation: a review of current outcome research. NeuroRehabilitation 2014;34(4):759-772. [CrossRef] [Medline]
- Mumford N, Duckworth J, Thomas PR, Shum D, Williams G, Wilson PH. Upper-limb virtual rehabilitation for traumatic brain injury: a preliminary within-group evaluation of the elements system. Brain Inj 2012;26(2):166-176. [CrossRef] [Medline]
- Grealy MA, Johnson DA, Rushton SK. Improving cognitive function after brain injury: the use of exercise and virtual reality. Arch Phys Med Rehabil 1999 Jun;80(6):661-667. [CrossRef] [Medline]
- Dvorkin AY, Ramaiya M, Larson EB, Zollman FS, Hsu N, Pacini S, et al. A "virtually minimal" visuo-haptic training of attention in severe traumatic brain injury. J Neuroeng Rehabil 2013 Aug 9;10:92 [FREE Full text] [CrossRef] [Medline]
- Rábago CA, Wilken JM. Application of a mild traumatic brain injury rehabilitation program in a virtual realty environment: a case study. J Neurol Phys Ther 2011 Dec;35(4):185-193. [CrossRef] [Medline]
- Jacoby M, Averbuch S, Sacher Y, Katz N, Weiss PL, Kizony R. Effectiveness of executive functions training within a virtual supermarket for adults with traumatic brain injury: a pilot study. IEEE Trans Neural Syst Rehabil Eng 2013 Mar;21(2):182-190. [CrossRef] [Medline]
- Aulisio MC, Han DY, Glueck AC. Virtual reality gaming as a neurorehabilitation tool for brain injuries in adults: a systematic review. Brain Inj 2020 Aug 23;34(10):1322-1330. [CrossRef] [Medline]
- Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009 Jul 21;6(7):e1000097 [FREE Full text] [CrossRef] [Medline]
- Snoswell AJ, Snoswell CL. Immersive virtual reality in health care: systematic review of technology and disease states. JMIR Biomed Eng 2019 Sep 26;4(1):e15025. [CrossRef]
- Veritas Health Innovation: Melbourne, Australia. Covidence Systematic Review Software. URL: http://www.covidence.org/ [accessed 2019-02-07]
- Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977 Mar;33(1):159-174. [Medline]
- Microsoft Excel. Microsoft Corporation. 2020. URL: https://office.microsoft.com/excel [accessed 2020-02-02]
- McArthur A, Klugárová J, Yan H, Florescu S. Innovations in the systematic review of text and opinion. Int J Evid Based Healthc 2015 Sep;13(3):188-195. [CrossRef] [Medline]
- The Oxford 2011 Levels of Evidence. OCEBM Levels of Evidence Working Group. URL: http://www.cebm.net/index.aspx?o=5653 [accessed 2019-09-10]
- Buccheri RK, Sharifi C. Critical appraisal tools and reporting guidelines for evidence-based practice. Worldviews Evid Based Nurs 2017 Dec 12;14(6):463-472. [CrossRef] [Medline]
- Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. Br Med J 2017 Sep 21;358:j4008 [FREE Full text] [CrossRef] [Medline]
- Moola S, Munn Z, Tufanaru C, Aromataris E, Sears K, Sfetcu R, et al. Systematic reviews of etiology and risk. In: Aromataris E, Munn Z, editors. JBI Manual for Evidence Synthesis. New York, USA: JBI; 2020.
- Lockwood C, Munn Z, Porritt K. Qualitative research synthesis: methodological guidance for systematic reviewers utilizing meta-aggregation. Int J Evid Based Healthc 2015 Sep;13(3):179-187. [CrossRef] [Medline]
- McArthur A, Klugárová J, Yan H, Florescu S. Innovations in the systematic review of text and opinion. Int J Evid Based Healthc 2015 Sep;13(3):188-195. [CrossRef] [Medline]
- Hong QN, Pluye P, Fàbregues S, Bartlett G, Boardman F, Cargo M, et al. Improving the content validity of the mixed methods appraisal tool: a modified e-Delphi study. J Clin Epidemiol 2019 Jul;111:49-59.e1 [FREE Full text] [CrossRef] [Medline]
- Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med 2018 Oct 2;169(7):467-473 [FREE Full text] [CrossRef] [Medline]
- Deutsch JE, Westcott McCoy S. Prisma extension for scoping reviews (virtual reality and serious games in neurorehabilitation of children and adults: prevention, plasticity, and participation): checklist and explanation. Pediatr Phys Ther 2017 Jul;29(Suppl 3):S23-S36 [FREE Full text] [CrossRef] [Medline]
- Levin MF, Weiss PL, Keshner EA. Emergence of virtual reality as a tool for upper limb rehabilitation: incorporation of motor control and motor learning principles. Phys Ther 2015 Mar;95(3):415-425 [FREE Full text] [CrossRef] [Medline]
- Lewis GN, Rosie JA. Virtual reality games for movement rehabilitation in neurological conditions: how do we meet the needs and expectations of the users? Disabil Rehabil 2012;34(22):1880-1886. [CrossRef] [Medline]
- Ramírez-Fernández C, Morán AL, García-Canseco E, Orihuela-Espina F. Design Factors of Virtual Environments for Upper Limb Motor Rehabilitation of Stroke Patients. In: Proceedings of the 5th Mexican Conference on Human-Computer Interaction. 2014 Presented at: HCI'14; November 3-5, 2014; Oaxaca, Mexico. [CrossRef]
- Lee M, Pyun S, Chung J, Kim J, Eun S, Yoon B. A further step to develop patient-friendly implementation strategies for virtual reality-based rehabilitation in patients with acute stroke. Phys Ther 2016 Oct;96(10):1554-1564. [CrossRef] [Medline]
- Vaezipour A, Aldridge D, Wall K, Koenig S, Theodoros T. Design and Development of a Virtual Reality System for the Management of Adult Neurogenic Communication Disorders. In: IEEE International Symposium on Mixed and Augmented Reality Adjunct. 2019 Presented at: IEEE'19; October 10-19, 2019; Beijing, China. [CrossRef]
- Bryant L, Hemsley B, Bailey B, Bluff A, Nguyen V, Stubbs P, et al. Opportunities for Immersive Virtual Reality in Rehabilitation: Focus on Communication Disability. In: 53rd Hawaii International Conference on System Sciences. 2020 Presented at: CSS'20; January 7-10, 2020; Maui, HI. [CrossRef]
- Kleim JA, Jones TA. Principles of experience-dependent neural plasticity: implications for rehabilitation after brain damage. J Speech Lang Hear Res 2008 Feb;51(1):S225-S239. [CrossRef] [Medline]
- Cikajlo I, Cizman Staba U, Vrhovac S, Larkin F, Roddy M. A cloud-based virtual reality app for a novel telemindfulness service: rationale, design and feasibility evaluation. JMIR Res Protoc 2017 Jun 5;6(6):e108 [FREE Full text] [CrossRef] [Medline]
- Gamito P, Pacheo J, Morais D, Saraiva T, Lacerda R, Baptista A, et al. Traumatic brain injury memory training: a virtual reality online solution. Int J Disabil Hum Dev 2011;10(4):309-312 [FREE Full text] [CrossRef]
- Ma L, Tornetta Jr F, Egan W, Wright WG. Virtual Reality Therapy as Adjunct to Traditional Physical Therapy for a TBI Patient Who Suffered a Gunshot Wound to the Head: Case Report. In: 13th International Conference on Virtual Rehabilitation. 2019 Presented at: VR'19; July 21-24, 2019; Tel Aviv, Israel. [CrossRef]
- Brain Injury Rehabilitation in Adults. Scottish Intercollegiate Guidelines Network (SIGN). 2013 Mar. URL: https://www.sign.ac.uk/media/1068/sign130.pdf [accessed 2019-08-07]
- Marshall S, Janzen S, Duffy T, Faltynek P, Mirkowski M, Janssen S, et al. Motor and Sensory Impairment Rehabilitation Post Acquired Brain Injury. Evidence-Based Review of Moderate to Severe Acquired Brain Injury. 2018. URL: https://erabi.ca/wp-content/uploads/2018/12/Module4_V12_motorsensory.pdf [accessed 2019-08-08]
- Occupational Therapy Practice Guidelines for Adults with Traumatic Brain Injury. National Guideline Clearinghouse (NGC). 2016. URL: http://www.guideline.gov/content.aspx?id=15287 [accessed 2019-08-08]
- The Diagnosis, Acute Management and Rehabilitation of People with Traumatic Brain Injury. New Zealand Guidelines Group. 2016. URL: https://www.moh.govt.nz/NoteBook/nbbooks.nsf/0/B8738C3605889A6ACC257A6D00809243/$file/060831_TBI_Evidence_Tables_Final.pdf [accessed 2019-09-08]
- Ponsford J, Bayley M, Wiseman-Hakes C, Togher L, Velikonja D, McIntyre A, INCOG Expert Panel. INCOG recommendations for management of cognition following traumatic brain injury, part II: attention and information processing speed. J Head Trauma Rehabil 2014;29(4):321-337. [CrossRef] [Medline]
- Velikonja D, Tate R, Ponsford J, McIntyre A, Janzen S, Bayley M, INCOG Expert Panel. INCOG recommendations for management of cognition following traumatic brain injury, part V: memory. J Head Trauma Rehabil 2014;29(4):369-386. [CrossRef] [Medline]
- Turkstra L, Ylvisaker M, Coelho C, Kennedy M, Sohlberg MM, Avery J, et al. Practice guidelines for standardized assessment for persons with traumatic brain injury. J Med Speech-Lang Path 2005;13(2):ix-xxxviii [FREE Full text]
- Banville F, Nolin P. Using virtual reality to assess prospective memory and executive functions after traumatic brain injury. J Cyber Rehab 2012;5(1):45-55 [FREE Full text]
- Robitaille N, Jackson PL, Hébert LJ, Mercier C, Bouyer LJ, Fecteau S, et al. A Virtual Reality avatar interaction (VRai) platform to assess residual executive dysfunction in active military personnel with previous mild traumatic brain injury: proof of concept. Disabil Rehabil Assist Technol 2017 Oct;12(7):758-764. [CrossRef] [Medline]
- Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG. Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int J Aviat Psychol 1993 Jul;3(3):203-220. [CrossRef]
- Mummah SA, Robinson TN, King AC, Gardner CD, Sutton S. Ideas (integrate, design, assess, and share): a framework and toolkit of strategies for the development of more effective digital interventions to change health behavior. J Med Internet Res 2016 Dec 16;18(12):e317 [FREE Full text] [CrossRef] [Medline]
- Garrett B, Taverner T, Gromala D, Tao G, Cordingley E, Sun C. Virtual reality clinical research: promises and challenges. JMIR Serious Games 2018 Oct 17;6(4):e10839 [FREE Full text] [CrossRef] [Medline]
- Huygelier H, Schraepen B, van Ee R, Vanden Abeele V, Gillebert CR. Acceptance of immersive head-mounted virtual reality in older adults. Sci Rep 2019 Mar 14;9(1):4519 [FREE Full text] [CrossRef] [Medline]
- Miller KJ, Adair BS, Pearce AJ, Said CM, Ozanne E, Morris MM. Effectiveness and feasibility of virtual reality and gaming system use at home by older adults for enabling physical activity to improve health-related domains: a systematic review. Age Ageing 2014 Mar;43(2):188-195. [CrossRef] [Medline]
- Shen J, Xiang H, Luna J, Grishchenko A, Patterson J, Strouse RV, et al. Virtual reality-based executive function rehabilitation system for children with traumatic brain injury: design and usability study. JMIR Serious Games 2020 Aug 25;8(3):e16947 [FREE Full text] [CrossRef] [Medline]
- Vaezipour A, Whelan B, Wall K, Theodoros D. Acceptance of rehabilitation technology in adults with moderate to severe traumatic brain injury, their caregivers, and healthcare professionals: a systematic review. J Head Trauma Rehabil 2019;34(4):E67-E82. [CrossRef] [Medline]
- Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. Br Med J 2014 Mar 7;348:g1687. [CrossRef] [Medline]
- Schulz K, Altman D, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Br Med J 2010 Mar 23;340:c332 [FREE Full text] [CrossRef] [Medline]
- Bohil CJ, Alicea B, Biocca FA. Virtual reality in neuroscience research and therapy. Nat Rev Neurosci 2011 Nov 3;12(12):752-762. [CrossRef] [Medline]
- Jerdan SW, Grindle M, van Woerden HC, Kamel Boulos MN. Head-mounted virtual reality and mental health: critical review of current research. JMIR Serious Games 2018 Jul 6;6(3):e14 [FREE Full text] [CrossRef] [Medline]
- Cant R, Cooper S, Sussex R, Bogossian F. What's in a name? Clarifying the nomenclature of virtual simulation. Clinical Simulation in Nursing 2019 Feb;27:26-30. [CrossRef]
- Kardong-Edgren S, Farra SL, Alinier G, Young HM. A call to unify definitions of virtual reality. Clin Simulat Nurs 2019 Jun;31:28-34. [CrossRef]
- Slater M, Wilbur S. A framework for immersive virtual environments (FIVE): speculations on the role of presence in virtual environments. Presence-Teleop Virt 1997 Dec;6(6):603-616. [CrossRef]
- Tieri G, Morone G, Paolucci S, Iosa M. Virtual reality in cognitive and motor rehabilitation: facts, fiction and fallacies. Expert Rev Med Devices 2018 Feb;15(2):107-117. [CrossRef] [Medline]
|ABI: acquired brain injury|
|CONSORT: Consolidated Standards of Reporting Trials|
|HMD: head-mounted display|
|JBI: Joanna Briggs Institute|
|PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses|
|RCT: randomized controlled trial|
|TBI: traumatic brain injury|
|VE: virtual environment|
|VR: virtual reality|
Edited by R Kukafka; submitted 09.12.20; peer-reviewed by A Vaezipour, J Salisbury, B Smith; comments to author 03.03.21; revised version received 25.04.21; accepted 24.05.21; published 30.07.21Copyright
©Sophie Brassel, Emma Power, Andrew Campbell, Melissa Brunner, Leanne Togher. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 30.07.2021.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.