Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 26.06.20 in Vol 22, No 6 (2020): June

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/17632, first published May 29, 2020.

This paper is in the following e-collection/theme issue:

    Original Paper

    Using Virtual Reality to Improve Apathy in Residential Aged Care: Mixed Methods Study

    1University of South Australia, Adelaide, Australia

    2Helping Hand Aged Care, Adelaide, Australia

    Corresponding Author:

    Dimitrios Saredakis, BPsych

    University of South Australia

    St Bernards Road, Magill

    South Australia

    Adelaide, 5072

    Australia

    Phone: 61 08 8302 4083

    Email: dimitrios.saredakis@mymail.unisa.edu.au


    ABSTRACT

    Background: Apathy is a common symptom in neurological disorders, including dementia, and is associated with a faster rate of cognitive decline, reduced quality of life, and high caregiver burden. There is a lack of effective pharmacological treatments for apathy, and nonpharmacological interventions are a preferred first-line approach to treatment. Virtual reality (VR) using head-mounted displays (HMDs) is being successfully used in exposure- and distraction-based therapies; however, there is limited research on using HMDs for symptoms of neurological disorders.

    Objective: This feasibility study aimed to assess whether VR using HMDs could be used to deliver tailored reminiscence therapy and examine the willingness to participate, response rates to measures, time taken to create tailored content, and technical problems. In addition, this study aimed to explore the immediate effects between verbal fluency and apathy after exposure to VR.

    Methods: A mixed methods study was conducted in a sample of older adults residing in aged care, and 17 participants were recruited. Apathy was measured using the Apathy Evaluation Scale (AES), and verbal fluency was used as a proxy measure of improvements in apathy and debriefing interviews to assess feedback from participants. Side effects that can occur from using HMDs were also measured.

    Results: We recruited participants from a high socioeconomic status setting with a high education level, and the participation rate was 85% (17/20); most responses to measures were positive. Access to a wide range of freely available content and the absence of technical difficulties made the delivery of a VR reminiscence intervention highly feasible. Participants had improved semantic scores (t14=−3.27; P=.006) but not phonemic fluency scores (t14=0.55; P=.59) immediately after the intervention. Those with higher levels of apathy demonstrated the greatest cognitive improvements after a VR reminiscence experience, which was indicated by a strong positive relationship between the AES and semantic verbal fluency change scores postminus pre-VR (r=0.719; 95% CI 0.327 to 0.900; P=.003). All participants enjoyed the experience despite 35% (6/17) of participants experiencing temporary side effects.

    Conclusions: This study provides initial evidence that it is feasible to use VR with HMDs for therapy to treat symptoms of apathy in older adults in residential aged care. However, there is a need to closely monitor the side effects of HMD use in older adults. Further research is needed using an active control group to compare the use of VR with traditional forms of reminiscence therapy.

    J Med Internet Res 2020;22(6):e17632

    doi:10.2196/17632

    KEYWORDS



    Introduction

    Background

    Apathy is one of the most common symptoms of neurological and psychiatric disorders such as dementia [1-3]. A lack of motivation is the defining feature of apathy, resulting in a reduction of goal-directed behavior [4]. Apathy contributes to a poorer quality of life and a faster rate of cognitive decline [5,6]. In addition, the risk of mortality in those with apathy increases 3-fold compared with those without apathy [7]. Those caring for people with apathy are also affected by reported higher caregiver burden compared with other neuropsychiatric symptoms [8,9].

    A high prevalence of apathy of up to 84% has been reported in older adults in residential aged care with cognitive decline [10]. Healthy older adults can also experience symptoms of apathy in varying degrees [11,12]. Significant changes in life circumstances, for example, surviving natural disasters or being institutionalized, may reduce motivation, and increase symptoms of apathy [13]. Changes in specific brain regions have been associated with apathy, including frontal-subcortical structures [14,15]. However, the mechanisms of apathy are not fully understood.

    Although symptoms of apathy may overlap with those of depression [16], apathy can also present as a separate clinical symptom [17], and there is increasing evidence supporting this distinction [18,19]. Symptoms of apathy can also differ depending on the type of dementia, with more severe symptoms found in the behavioral variant of frontotemporal dementia [20]. With little evidence supporting pharmacological treatment for apathy [21] and the side effects of current medications [22], alternative interventions are required.

    Nonpharmacological approaches have demonstrated evidence in improving the levels of apathy, including music, art, cognitive stimulation, and reminiscence therapy [23]. Reminiscence therapy is commonly used in residential aged care and involves the discussion of a person’s past experiences involving the use of items including photographs, magazines, or music [24]. It can help maintain a person’s sense of identity and improve feelings of self-worth [25,26], an important aspect of improving apathy.

    A recent Cochrane review found reminiscence therapy to be effective in some cases [27]. However, the effect sizes found were small and inconsistent. Little or no differences in cognitive outcomes were commonly found when comparing reminiscence therapy–treated groups with nontreatment groups (eg, standardized mean difference 0.11, 95% CI 0.00 to 0.23) [27]. Improving the delivery of tailored reminiscence therapy by increasing how realistic it is may increase the effectiveness of the therapy and the likelihood of attending sessions [28].

    The use of technology in reminiscence therapy can provide access to a wide range of content via the internet and make it easy to tailor an intervention specifically for a person [29,30]. In a within-group study comparing the creation of a digital life storybook with a conventional life storybook for people with dementia, additional improvements were seen in the quality of life and autobiographical memory performance when the digital life storybook was used [30]. The traditional version in this study consisted of tangible prompts, including photos and other memorabilia, and the digital version consisted of a movie created and burned onto a DVD for playing on television. iPads have also been used in the delivery of individualized reminiscence therapy with positive results, including improvements in well-being [31,32]. Significantly higher levels of initiating speech and engagement were found using a touchscreen monitor compared with traditional reminiscence therapy using artifacts, including newspapers, books, and photos [33]. Virtual reality (VR) in the form of large-screen displays has also been used and provides an immersive experience [34]. The level of immersion can vary among technologies. iPads or computer screens are classified as nonimmersive, whereas large-screen displays are considered semi-immersive [35]. An increase in the level of immersion can increase the level of presence (the degree to which a person feels they are in the virtual environment) [36]. During a navigation task, an increased sense of presence using highly immersive 3D screens while wearing stereo glasses has been found to recruit additional brain areas compared with less immersive 2D screens [37].

    VR using head-mounted displays (HMDs) provides a fully immersive, highly engaging, and realistic experience with the user closed off from external distractions. The use of HMDs is not limited to gaming and has infiltrated many areas, including medical training, rehabilitation, and therapy [38-41]. Advances in technology, production, and reduced costs have made HMDs widely accessible, with little training required to implement and use them. In patients who had previously not reported clinical benefits from other forms of psychotherapy, the use of VR using HMDs has been successful in treating post-traumatic stress disorder (PTSD), with a significant decrease in PTSD symptoms being found while comparing pretreatment symptoms with posttreatment symptoms (d=1.17) [42]. Other successful interventions using HMDs include reducing anxiety [43] and pain management of burn victims during wound care [44,45].

    Recent research has found that older adults, including those with cognitive decline, can tolerate using HMDs and has reported positive experiences [46-49]. There has also been success in using HMDs for memory training in older adults with significant improvements in memory tests (d=.7) compared with a control group receiving music therapy [50]. Other uses of HMDs, including in older adults, have shown an increase in the performance of daily living activities in stroke victims [51] and success with vestibular rehabilitation in older adults with mild cognitive impairment [52]. These findings of HMD use in older adults suggest that expansion into other areas is possible. Research into the use of VR using HMDs in therapy for symptoms of neurological disorders is limited.

    In addition to the lack of motivation in apathy [53], executive dysfunction has also been found to be associated with apathy [54,55]. Impairment in executive function is a key cognitive mechanism of apathy. Apathy is negatively associated with the performance of verbal fluency tasks [56]. Similarly, those with dementia and apathy have shown reduced performance on verbal fluency tasks, compared with those without apathy [57]. Specifically, associations have been reported between apathy and semantic fluency but not phonemic fluency [56,58]. Performance in verbal fluency tasks indicates executive control [59] and initiation [60]. These executive functions of control and initiation are reduced in those with apathy [61,62]. Apathetic participants demonstrated a preference for a VR task over a pen and paper task, as it provided a more engaging experience [63]. In addition, VR (using a projector screen with stereo glasses) has demonstrated the ability to stimulate autobiographical memories [34]. Therefore, VR may improve the performance of executive functions, both directly and indirectly.

    Although there is evidence supporting the acceptability of using HMDs in older adults as previously mentioned, some people do experience side effects from using HMDs, including the occurrence of motion sickness such as that induced by air, sea, or land travel. Research on sickness symptoms while using HMDs in older adults has reported conflicting outcomes [64-66]. Many companies are starting to offer VR services for older adults in residential aged care [67-69]. However, the occurrence and prevalence of side effects of using VR HMDs with this age group are uncertain [70]. With the increased use of VR using HMDs in many areas, including older adults, awareness of any side effects from using this technology has become essential.

    Objectives

    This study aimed to evaluate the feasibility of using tailored content created for viewing in a VR HMD to deliver reminiscence therapy to older adults in residential aged care. Along with establishing the feasibility of this study, the following parameters were also examined: availability and willingness to participate, response rates to measures used, the time needed to create tailored content, and technical problems. Verbal fluency was used as a measure of immediate effects on executive function after exposure to tailored content in VR, and associations with verbal fluency and apathy were also examined. A debriefing interview was used to assess enjoyment and obtain feedback from participants. Side effects of using HMDs were also examined using the Simulator Sickness Questionnaire (SSQ) combined with feedback from the debriefing interview.


    Methods

    Participants

    Participants were recruited from a residential aged care facility in Adelaide, Australia. Potentially suitable participants were identified by senior staff at the residential aged care facility following the inclusion and exclusion criteria. A list of identified participants was then given to the researcher, and the researcher approached participants to request their participation in the study. The current health status of each participant was obtained from the nursing staff on duty before the participants were contacted. Out of 20 participants who were requested to participate in this study, 3 declined; 10 women and 7 men, between the ages of 72 and 95 years with a mean age of 87.3 years (SD 6.3), agreed to participate. All the participants were Australian, of whom 11 were born in Australia, 2 in the United Kingdom, 2 in Africa, and 2 in Europe. The participants born in the United Kingdom, Africa, and Europe had spent most of their lives in Australia. The participants came from a high socioeconomic background and most were well educated; the mean years of education was 13 (SD 3). According to the Psychogeriatric Assessment Scale (PAS), 10 participants had no or minimal cognitive impairment, 3 presented with mild impairments, and 4 had moderate impairments [71]. The mean score for the Apathy Evaluation Scale (AES) was 31.5 (SD 6.3). Using a cutoff score of 36.5 [72], 3 participants met the criteria for a diagnosis of apathy with the highest score being 46; 5 participants scored between 34 and 36. Medication history was available for 14 participants. The most common medication used was for depressive symptoms in 6 out of 14 participants (43%). Participants were excluded if their score on the PAS was 16 or higher indicating severe impairment; had significant neurological disorders; had other conditions, including agitation and aggression at a level that would make assessment difficult; or if their vision could not be corrected by glasses or glass frames that could not fit into the HMD. Informed consent was obtained from all the participants, and no honorarium was offered for participation. Ethics approval was obtained from the University of South Australian Human Research Ethics Committee in accordance with the Australian National Statement on Ethical Conduct in Human Research (2007).

    Materials

    Virtual Reality Apparatus

    The Oculus Go HMD was used [73] to deliver the VR experience to participants. This is a standalone HMD that does not require tethering to a computer or the use of a mobile phone.

    Virtual Reality Content

    YouTube VR (Google LLC) was used for the playback of 360-degree videos. This is an app that is specifically used for viewing YouTube videos in VR HMDs. All 360-degree videos were downloaded to the HMD to reduce reliance on the internet and improve the reliability of playback. Wander (Parkline Interactive) was used to navigate to places of interest tailored to the participant. This app uses data from Google Street View and has the feature of saving places visited for future access.

    Questionnaire for Establishing Virtual Reality Content

    An interview was conducted to develop tailored content for each participant and was based on reminiscence therapy guidelines [24]. Questions included the following: “What significant memories do you have from your childhood?” “What significant life events do you have positive memories of?” and “What memories do you have from working, including details about your first job, and work in the home?”

    Psychogeriatric Assessment Scale

    Cognitive status was obtained from the current records of the residential aged care facility using the PAS [74]. The PAS includes both a subject and informant interview and provides a summary of functioning related to cerebrovascular disease, cognitive status, and behavioral disturbance that can occur in dementia [74]. Scores range from 0 to 21 with a score of ≥4 indicating likely cognitive impairment [75] and the risk of further cognitive decline [76].

    Apathy Evaluation Scale Self-Rated Version

    Apathy was measured using the AES [4]. This was included to measure the participants’ current level of apathy. The AES contains 18 items measured on a scale ranging from not at all, slightly, somewhat, and a lot. The AES scores range from 18 to 72, with higher scores indicating a higher level of apathy. Rating is based on the previous 4 weeks. The self-rated version of the AES has been found to have satisfactory test-retest reliability of .76 and good internal consistency (α=.86) [4]. The internal consistency for this study was α=.77. Questions included, “Are you interested in having new experiences?” and “Do you spend time doing things that interest you?”

    Simulator Sickness Questionnaire

    Side effects were measured using the SSQ [77]. This questionnaire is widely used in VR-related research [78]. It consists of 16 items that assess the symptoms in the VR environment using a 4-point rating scale from 0 (indicating no symptoms) to 3 (indicating severe symptoms). The SSQ has 3 subscales, including nausea, oculomotor, and disorientation, and has demonstrated good internal consistency (α=.87) [79]. Internal consistency for this study was α=.69. Both the total and subscale SSQ scores require weighting. The subscale scores were weighted as follows: nausea 9.54, oculomotor 7.58, and disorientation 13.92. Total scores were calculated by adding the 3 unweighted subscale scores and multiplying by 3.74. The 3 subscales include overlapping symptoms, for example, the symptom of blurred vision overlaps both the oculomotor and disorientation subscales. Symptoms measured included headache, nausea, sweating, and eye strain.

    Slater-Usoh-Steed Presence Questionnaire

    The Slater-Usoh-Steed Presence Questionnaire (SUS) was used to assess how realistic participants thought the VR environment was [80]. The SUS consists of 6 items scored from 1 to 7. Questions include “To what extent were there times during the experience when the virtual environment was reality for you?” and “During the time of your experience, did you often think to yourself that you were actually in the virtual environment?” This scale has demonstrated acceptable internal consistency (α=.75) [81]. Internal consistency for this study was α=.74.

    Verbal Fluency

    Both phonemic and semantic verbal fluency tasks were administered to the participants [82]. In the phonemic verbal fluency task, participants had to name as many words as possible starting with the letter F or P. In the semantic verbal fluency task, participants had to list as many words as possible in the category of either animals or fruit/vegetables. The tasks were timed for 1 min each.

    Expectations/Enjoyment Measure

    Participants were asked about their expectations before the VR experience “What are your expectations about the VR experience, in reference to overall enjoyment?” After the VR experience, they were asked, “How much did you enjoy the experience?” Each question was given a rating ranging from 1 to 10.

    Debriefing Questionnaire

    A debriefing interview consisting of 8 questions at the end of the VR session (session 2) assessed the feedback from the participants. Interview questions included “Did you find the experience enjoyable?” and “What did you like about the experience?”

    Procedure

    The study consisted of 2 sessions, with each session lasting for approximately 60 min. Before consent, to ensure that the participants were able to see images satisfactorily in the headset, a short demonstration was performed where participants viewed images in the HMD using the Wander app. Once it was established that the participants could satisfactorily see the images in the headset, and they consented to participate in the study, an appointment was made for the first session. In the first session, basic demographic data were collected. Participants were then asked a series of questions (questionnaire for establishing VR content) to establish topics for sourcing content to be viewed in the HMD. Finally, the participants completed the AES.

    Once the researcher had sourced content based on data gathered from the interview in the first session for viewing in the HMD (approximately 3 days apart), an appointment was made for the second session. Before and after the VR session, 2 verbal fluency tests (phonemic and semantic), expectations/enjoyment rating, and the SSQ were administered. Alternate forms of verbal fluency tests were counterbalanced for each participant. Although the SSQ was designed to be used postexposure to VR, it was decided to follow the precondition of screening participants who may have health-related conditions [77]. The sourcing of content was completed between the first and second sessions and took approximately 90 min for each participant. Participants viewed the VR content that was timed for 20 min. The researcher determined the order of the content being viewed, and during the VR session, a conversation occurred between the participant and the researcher about the participant’s past experiences with regard to the content. Participants were not given access to the controllers, and all navigation was performed by the researcher. This was done to minimize frustration and provide a seamless experience for each participant. The HMD image was mirrored to a laptop to enable the researcher to see what the participant was viewing and to allow the researcher to navigate within the apps. Participants remained seated during the VR content exposure, as standing has been found to increase the risk of motion sickness when using HMDs [83]. Remaining seated also reduced the risk of falls while wearing an HMD. A swivel chair was used to enable participants to turn freely when viewing the VR content, thereby limiting neck movement. One participant was restricted to a mobile chair, and the VR content was delivered while they were lying down at a 45-degree angle in the chair. The researcher turned the mobile chair during VR exposure to enable the participant to view the 360-degree videos. Another participant with mobility issues was seated in a lounge-type chair in their room. After VR exposure, the SUS was administered as a measure of presence, followed by the debriefing questionnaire.


    Results

    Separate Bonferroni corrections for multiple comparisons were applied for each family of tests. For the 2 fluency tasks, alpha was set at <.025 (.05/2). For the 4 SSQ scores, alpha was set at <.013 (.05/4). For the pre-expectations and enjoyment scale, alpha was set at <.05 (.05/1). Assumptions of normality using the Shapiro-Wilk test found both oculomotor and disorientation subscale SSQ scores to significantly deviate from a normal distribution; therefore, the Wilcoxon signed-rank test was performed for all SSQ comparisons. Two-tailed paired samples t tests were used for the remaining comparisons. Means and standard deviations for all pre- and postmeasures are shown in Table 1. Two-tailed paired sample t tests revealed that semantic verbal fluency scores were significantly higher post-VR, which was the only significant difference (Table 1).

    Neither pre- nor post-VR comparison between phonemic and semantic fluency reached statistical significance in a two-tailed paired samples t test (pre-VR: mean 0.40 (SD 5.10); 95% CI −2.42 to 3.22; t14=0.30; P=.77. post-VR: mean −2.47 (SD 5.21); 95% CI −5.35 to 0.42; t14=−1.83; P=.09).

    Bivariate (Pearson) correlations between the AES scores with either phonemic or semantic verbal fluency taken at baseline were not significant (AES and phonemic: r=0.309; 95% CI −0.241 to 0.709; P=.26; AES and semantic: r=−0.104; 95% CI −0.585 to 0.432; P=.71).

    Bivariate (Pearson) correlations between the AES scores taken at baseline and phonemic verbal fluency change scores postminus pre-VR were not significant (r=−0.195; 95% CI −0.643 to 0.352; P=.49. There was a strong positive relationship between the AES and semantic verbal fluency change scores postminus pre-VR (r=0.719; 95% CI 0.327 to 0.900; P=.003; Figure 1).

    Correlations between the AES scores and either phonemic or semantic change scores were significant (P=.03). Statistical differences between correlations were calculated using the Steiger method [84]. Figure 2 shows a breakdown of the SSQ scores for each participant pre- and post-VR using SSQ score cutoffs [85]. Figure 3 shows a summary of the total and subscale SSQ scores. Figure 4 shows a breakdown of the pre-expectation/postenjoyment scores for each participant.

    Table 1. Means and standard deviations for all pre- and post-VR measures with statistics and effect size.
    View this table
    Figure 1. Correlation between scores on the Apathy Evaluation Scale at baseline and postminus pre–virtual reality session semantic and phonemic verbal fluency. Two participants scored the same in the semantic verbal fluency correlation.
    View this figure
    Figure 2. Pre– and post–Simulator Sickness Questionnaire scores with each line representing 1 participant. Shaded areas indicate Simulator Sickness Questionnaire score cutoffs of <5, 5 to 10, 10 to 15, 15 to 20, and >20. VR: virtual reality.
    View this figure
    Figure 3. Distribution of Simulator Sickness Questionnaire total and subscale scores at pre- and post–virtual reality intervention, indicated by boxplots within violin plots, white dots represent medians.
    View this figure
    Figure 4. Pre–virtual reality expectations versus post–virtual reality enjoyment scores with each line representing one participant.
    View this figure

    Most participants had some difficulty with the SUS questionnaire; question number 5 had to be repeated or further explained. Four participants did not attempt answering question number 5, and 2 participants could not complete any of the questions. Therefore, data from the SUS were not analyzed.

    After the VR session, the participants were asked a set of 8 questions to gain feedback about their experiences. Although some of the questions could be answered with a yes or no response, participants were given the opportunity to elaborate on their answers, if required.

    All the study participants found the experience enjoyable. When asked what they liked about the experience, 11 participants said they enjoyed reminiscing, 4 participants reported it was nice to do something different, 1 participant reported how realistic the experience was, and finally, 1 participant liked the colors and clarity of the images shown. Comments included “liked the accuracy, feeling of being there and sites that I wanted to see again,” “taken back to somewhere that I know I will never see again,” “better than looking at a computer,” and “I had a feeling of being there.”

    In reference to acceptability, 1 participant reported that the HMD was heavy; however, this was rectified by adjusting the head strap. All remaining participants found everything acceptable. When asked if they would do it again, all responded yes, with 1 participant stating, “only for research purposes.”

    There were instances where participants reported negative symptoms or side effects. This included 1 participant with discomfort around the cheekbone and forehead areas. Another participant reported dizziness and the feeling that they were “going to fall off the edge;” a further 2 participants reported the feeling that they were going to fall off the edge. One participant reported eyestrain, and another participant reported nausea 10 min after the VR session, which subsided within 10 min. Therefore, 6 out of 17 participants reported some type of negative symptoms or side effects.

    Participants were asked to offer suggestions to improve their experience. One participant stated that they would have liked to use the controller to navigate in the virtual environment on their own; another participant suggested having some type of interaction; a third participant said it would have been good to “show the difference between then and now,” referring to the Wander app; and finally, one participant would have preferred to see the places that they had not been to before. All participants said they would recommend the VR experience to a friend.

    Finally, the participants were asked what they thought about the questionnaires. A total of 12 participants reported that they were all acceptable; 1 participant did not like them without giving a reason; 1 participant could not remember enough to comment; 1 participant said there were too many questions; 1 participant thought there was not a lot of relevance; and 1 participant said that the pre-VR measures did “cause some tension.”


    Discussion

    This study found that VR using HMDs to deliver reminiscence therapy is feasible and may be beneficial for aged care residents with apathy. Of the 20 participants who were requested to participate, 17 agreed, indicating a willingness of residents in aged care to participate in research using VR technology. Therefore, the number of available participants for this study was easily achieved. The 3 participants who declined to participate were not interested. It is not known how often exclusion criteria had to be applied, as participants were selected by senior staff at the residential aged care facility following the exclusion criteria. A challenge for future research in apathy is a possible reluctance of those with high levels of apathy to participate because of a lack of interest and motivation, similar to reduced involvement in therapeutic activities found in those with higher levels of apathy [86]. The response rates to measures used in this study were positive. The SUS was the only measure that caused difficulties in understanding the questions, with 2 participants not completing any of the questions. The SUS was chosen because of the small number of items (6) and quick completion time compared with other measures of presence [81] to reduce participant burden. It was validated in a younger sample of university-based students with a technical background, who had no difficulties in completing the questionnaire [81]. As per the qualitative feedback received by this study, older adults may have difficulties in understanding some questions of the SUS. All other measures were fully completed, and all participants adhered to the procedure of the research. It should be noted that the reliability values for measures reported in the literature may not generalize to this study because of sample differences, that is, older adults with neurological and other chronic diseases.

    The time taken to create content varied depending on the participant’s previous experiences. In this study, the researcher prepared the content before the VR session. It was found that by using readily available apps, the content could easily be sourced for all participants for a VR exposure time of 20 min. This finding is of importance for this study, as individualized reminiscence therapy can be resource intensive [87]. The accessibility of content utilizing the apps in this study reduces the resources required for creating content and places fewer demands on staff if applied in aged care lifestyle activities.

    In this study, the preparation of VR content took approximately 90 min for each participant. This time can be substantially reduced once a library of 360-degree travel or music videos has been created. In addition, in this study, the content was compiled before the VR session to maximize the amount of time the participant would reminisce. Sourcing of VR content could also be done during a reminiscence session, working together with the participant while they are viewing images in the HMD, and an area for future research. Working together with the participant not only reduces the preparation time but also allows sessions to be tailored and flexible depending on participants’ responses [88]. Traditional methods, including making up a life history book, can require substantial resources and are also limited [88]. Using the Wander and YouTube apps reduces the preparation time and provides a wide range of content that can be easily changed. The use of a group reminiscence therapy format that is more generic can be a preferred approach because of the ability to improve social interaction [89] and can also be less resource intensive [90]. However, each person has a unique history, and using individualized content has been demonstrated to be more effective than using generic content [91]. In addition, an individualized approach is person-centered, focusing on a person’s strengths, thereby helping maintain a sense of self and identity [92].

    No technical problems with conducting the sessions were encountered. To enable successful delivery of the content, it is recommended that the VR headset be mirrored to an external screen and controlled by the person delivering the content. Thus, the focus is on viewing the content rather than trying to learn to navigate or use the controllers. Although 2 participants would have liked to interact in some form with the virtual environment, this study was designed to provide a seamless experience. As the VR exposure consisted of one session, the intention was to reduce any frustration that could occur because of pressing the wrong buttons on the controller. We cannot draw any conclusions about the extent to which aged care residents could navigate within the app and use the controllers themselves, as this was not attempted. However, the feasibility of controller usage and navigation in VR in this population is an avenue for future research for studies conducted over a longer period. Providing the ability to interact allows the user to act independently and may improve the sense of presence. Recent research has found that the use of VR in providing interaction may be an alternative way of delivering stimulation to people with dementia who do not participate in other lifestyle activities [93].

    Verbal fluency was used as a proxy measure to assess improvements in apathy. Both semantic and phonemic verbal fluency results were similar at baseline, despite phonemic fluency being known to be more difficult [94]. This could be because of the level of education in this group of participants (mean 13 years, SD 3), as higher education has been correlated with increased performance in phonemic fluency [95]. In pre-VR sessions, both phonemic and semantic fluency scores were not associated with the participants’ level of apathy. In post-VR sessions, not only did semantic fluency increase but the results were positively correlated with participants’ level of apathy at baseline. This suggests that the greatest cognitive improvements were seen in participants with higher levels of apathy. What is unclear is why these differences were seen only in semantic fluency. Similar improvements in verbal fluency have been reported in a study using traditional reminiscence therapy in a sample of dementia patients [96] in a short number of sessions. However, in this study, increases were seen in both phonemic and semantic fluency, and apathy was not measured. The executive function of initiation required for verbal fluency may be low in persons with apathy [97], and the reliving of autobiographical memories in an immersive environment may have stimulated the process of initiation.

    The results from the debriefing questionnaire were positive and in agreement with previous research, finding acceptance of using HMDs in older adults [46-48]. This study further expands the knowledge of acceptability by demonstrating that VR using HMDs can be used to deliver reminiscence therapy with participants of varying levels of cognitive impairment, including minimal, mild, and moderate impairment, as assessed by the PAS. All participants reported enjoying the VR experience, despite 6 participants reporting a side effect. Another indicator of positive response was that all participants stated they would do it again (although 1 said “for research purposes only”). The most common response about what the participants liked about the experience was related to reminiscence and the enjoyment of seeing places from their past, indicating that this is something this age group wants to experience in a VR environment. An important aspect of reminiscence is maintaining a person’s sense of identity [87]. As loss of identity can be a key feature of Alzheimer disease that can increase apathy [98], participating in tailored reminiscence therapy may help in maintaining a person’s sense of self and identity and therefore improve levels of apathy. The expectations questions asked pre-VR compared with the enjoyment level post-VR, although in a positive direction, failed to reach a significant level. There were 2 participants in pain because of pre-existing conditions during the VR session, which may have contributed to this result.

    Although quantitative findings of short-term side effects from VR were not significant, the debriefing questionnaire raised some concerns. Six participants reported side effects, 4 of which were symptoms related to items measured by the SSQ, including nausea, eyestrain, and dizziness. These symptoms dissipated quickly. In one instance where a participant experienced nausea, it occurred 10 min after the VR experience with symptoms subsiding within 10 min. This after-effect highlights the importance of monitoring participants both during and after VR to avoid health and safety implications.

    Moreover, 3 participants had the feeling of “falling off the edge” in VR. This symptom was not captured by the SSQ and did create some discomfort, with 2 of the participants requesting to be moved back to their original position, when they had not actually moved. This could not be associated with the type of content. One explanation could be that sometimes the camera shooting the VR content is elevated, and a high sense of presence may have given a realistic feeling of their position in the virtual environment. Another factor that may have contributed to this symptom is the common occurrence of balance problems in older adults with neurological diseases [99]. This symptom will need to be monitored in future studies when working with this population.

    The importance of taking pre- and post-SSQ measures was demonstrated in this study, with some participants reporting symptoms before the commencement of VR. This was usually because of pain from existing conditions. It is also interesting to note that in 4 participants, the SSQ scores decreased post-VR; this included a participant with the highest pre-VR SSQ score. This reduction in the SSQ scores could be a similar effect seen in the successful use of VR for distraction-based therapies [44,45]. Despite all participants finding the experience enjoyable, it is important to consider that 6 out of 17 participants (35%) had some type of negative response when viewing the VR content and the importance of monitoring symptoms. When using cutoff scores for the SSQ (negligible symptoms: <5, minimal symptoms: 5-10, significant symptoms: 10-15, concerning symptoms: 15-20, and problematic symptoms: >20 [85]), it can be seen in Figure 2 that the majority of participants scored >5, with 4 participants experiencing problematic symptoms (>20). However, these cutoffs were created with military personnel using flight simulators, and how these cutoff scores relate to the general population and, in the case of this study, older adults is unknown.

    This study aimed to assess feasibility; therefore, a control group was not included, and we could not compare results using a traditional reminiscence therapy approach. However, the aim was first to establish if HMDs could be used in this population for reminiscence therapy. Although alternate forms of both phonemic and semantic verbal fluency were used to reduce practice effects, the lack of a control group receiving no VR intervention warrants a caveat when interpreting the results. It must remain open to what degree the pre-post comparisons are the result of the VR exposure versus a pure retest effect. It is also not known how long the verbal fluency improvements would last and if other aspects of apathy were reduced. Anecdotally, staff members providing services to participants involved in the research reported positive mood changes during the research process, and there were also instances where positive changes in behavior were reported by family members of participants involved in the research.

    As the self-rated version of the AES was used, it needs to be considered that people with apathy will normally underestimate their condition [4]. Therefore, true scores may be higher than reported. This study did not specifically recruit participants with apathy, and a challenge with future research is the difficulty of recruiting participants who do have apathy because of their lack of interest and motivation.

    This study demonstrated that VR using HMDs can be used to deliver tailored content about a person’s past and that residents in aged care enjoyed this experience. The aged care site in this study was in an area of high socioeconomic status, and study participants had a relatively high education level. Higher levels of education have been associated with an increased willingness to participate in research [100]. The sample was also selected by the staff and therefore was not a random sample, possibly introducing a selection bias [101]. How these factors would generalize to a random sample with an average or lower education level is unknown and needs to be considered when determining generalizability as participation rates, adherence to sessions, and therefore feasibility may differ. Immediate effects on cognition for those with higher levels of apathy after 1 session is an interesting finding and highlights the importance of continuing this research. The VR experience can be implemented and incorporated into current lifestyle activities in aged care with the correct protocols in place. VR is being increasingly used in older adults in areas including assessment, cognitive training, and rehabilitation; therefore, it is critical to monitor side effects, particularly after the VR experience, to avoid any health and safety implications and assess whether the benefits of using HMDs outweigh the risk of side effects. This study provides initial evidence that it is feasible to use VR with HMDs for therapy to treat symptoms of apathy in older adults in residential aged care. Further research over multiple sessions using an active control group to compare with traditional reminiscence therapy will help establish the advantages of using VR with HMDs.

    Acknowledgments

    DS was supported by the Australian Government Research Training Program Scholarship. TL and HK were funded by the National Health and Medical Research Council Boosting and Dementia Research Leadership Fellowships Scheme (GNT1136269 and GNT1135676, respectively).

    Conflicts of Interest

    None declared.

    References

    1. Zhao Q, Tan L, Wang H, Jiang T, Tan M, Tan L, et al. The prevalence of neuropsychiatric symptoms in Alzheimer's disease: systematic review and meta-analysis. J Affect Disord 2016 Jan 15;190:264-271. [CrossRef] [Medline]
    2. Skorvanek M, Rosenberger J, Gdovinova Z, Nagyova I, Saeedian RG, Groothoff JW, et al. Apathy in elderly nondemented patients with Parkinson's disease: clinical determinants and relationship to quality of life. J Geriatr Psychiatry Neurol 2013 Dec;26(4):237-243. [CrossRef] [Medline]
    3. Lanctôt KL, Agüera-Ortiz L, Brodaty H, Francis P, Geda Y, Ismail Z, et al. Apathy associated with neurocognitive disorders: recent progress and future directions. Alzheimers Dement 2017 Jan;13(1):84-100. [CrossRef] [Medline]
    4. Marin R, Biedrzycki R, Firinciogullari S. Reliability and validity of the apathy evaluation scale. Psychiatry Res 1991 Aug;38(2):143-162. [CrossRef] [Medline]
    5. Geda YE, Roberts RO, Mielke MM, Knopman DS, Christianson TJ, Pankratz VS, et al. Baseline neuropsychiatric symptoms and the risk of incident mild cognitive impairment: a population-based study. Am J Psychiatry 2014 May;171(5):572-581 [FREE Full text] [CrossRef] [Medline]
    6. Tierney SM, Woods SP, Weinborn M, Bucks RS. Real-world implications of apathy among older adults: independent associations with activities of daily living and quality of life. J Clin Exp Neuropsychol 2018 Nov;40(9):895-903. [CrossRef] [Medline]
    7. van der Linde RM, Matthews FE, Dening T, Brayne C. Patterns and persistence of behavioural and psychological symptoms in those with cognitive impairment: the importance of apathy. Int J Geriatr Psychiatry 2017 Mar;32(3):306-315. [CrossRef] [Medline]
    8. Dauphinot V, Delphin-Combe F, Mouchoux C, Dorey A, Bathsavanis A, Makaroff Z, et al. Risk factors of caregiver burden among patients with Alzheimer's disease or related disorders: a cross-sectional study. J Alzheimers Dis 2015;44(3):907-916. [CrossRef] [Medline]
    9. Lou Q, Liu S, Huo YR, Liu M, Liu S, Ji Y. Comprehensive analysis of patient and caregiver predictors for caregiver burden, anxiety and depression in Alzheimer's disease. J Clin Nurs 2015 Sep;24(17-18):2668-2678. [CrossRef] [Medline]
    10. Zuidema S, Koopmans R, Verhey F. Prevalence and predictors of neuropsychiatric symptoms in cognitively impaired nursing home patients. J Geriatr Psychiatry Neurol 2007 Mar;20(1):41-49. [CrossRef] [Medline]
    11. Bonnelle V, Manohar S, Behrens T, Husain M. Individual differences in premotor brain systems underlie behavioral apathy. Cereb Cortex 2016 Feb;26(2):807-819 [FREE Full text] [CrossRef] [Medline]
    12. Brodaty H, Altendorf A, Withall A, Sachdev P. Do people become more apathetic as they grow older? A longitudinal study in healthy individuals. Int Psychogeriatr 2010 May;22(3):426-436. [CrossRef] [Medline]
    13. Marin RS. Differential diagnosis and classification of apathy. Am J Psychiatry 1990 Jan;147(1):22-30. [CrossRef] [Medline]
    14. le Heron C, Holroyd CB, Salamone J, Husain M. Brain mechanisms underlying apathy. J Neurol Neurosurg Psychiatry 2019 Mar;90(3):302-312 [FREE Full text] [CrossRef] [Medline]
    15. Starkstein S, Brockman S. The neuroimaging basis of apathy: empirical findings and conceptual challenges. Neuropsychologia 2018 Sep;118(Pt B):48-53. [CrossRef] [Medline]
    16. Starkstein SE, Ingram L, Garau ML, Mizrahi R. On the overlap between apathy and depression in dementia. J Neurol Neurosurg Psychiatry 2005 Aug;76(8):1070-1074 [FREE Full text] [CrossRef] [Medline]
    17. Levy ML, Cummings JL, Fairbanks LA, Masterman D, Miller BL, Craig AH, et al. Apathy is not depression. J Neuropsychiatry Clin Neurosci 1998;10(3):314-319. [CrossRef] [Medline]
    18. Lohner V, Brookes RL, Hollocks MJ, Morris RG, Markus HS. Apathy, but not depression, is associated with executive dysfunction in cerebral small vessel disease. PLoS One 2017;12(5):e0176943 [FREE Full text] [CrossRef] [Medline]
    19. Zhu C, Grossman H, Sano M. Why do they just sit? Apathy as a core symptom of Alzheimer disease. Am J Geriatr Psychiatry 2019 Apr;27(4):395-405 [FREE Full text] [CrossRef] [Medline]
    20. Kumfor F, Zhen A, Hodges J, Piguet O, Irish M. Apathy in Alzheimer's disease and frontotemporal dementia: distinct clinical profiles and neural correlates. Cortex 2018 Jun;103:350-359. [CrossRef] [Medline]
    21. Ruthirakuhan M, Herrmann N, Abraham E, Chan S, Lanctôt KL. Pharmacological interventions for apathy in Alzheimer's disease. Cochrane Database Syst Rev 2018 May 4;5:CD012197 [FREE Full text] [CrossRef] [Medline]
    22. Bogdan A, Manera V, Koenig A, David R. Pharmacologic approaches for the management of apathy in neurodegenerative disorders. Front Pharmacol 2019;10:1581 [FREE Full text] [CrossRef] [Medline]
    23. Goris ED, Ansel KN, Schutte DL. Quantitative systematic review of the effects of non-pharmacological interventions on reducing apathy in persons with dementia. J Adv Nurs 2016 Nov;72(11):2612-2628. [CrossRef] [Medline]
    24. Westphal A, Callega D, LoGiudice D, Lautenschlager N. University of Melbourne. 2017. Using Reminiscence With People With Dementia in Sub-Acute & Acute Care   URL: http:/​/medicine.​unimelb.edu.au/​__data/​assets/​pdf_file/​0020/​2471312/​Using-reminiscence-with-people-with-dementia-in-acute-and-subacute-care-manual.​pdf [accessed 2019-10-15]
    25. Pishvaei M, Moghanloo RA, Moghanloo VA. The efficacy of treatment reminders of life with emphasis on integrative reminiscence on self-esteem and anxiety in widowed old men. Iran J Psychiatry 2015;10(1):19-24 [FREE Full text] [Medline]
    26. Moral JC, Terrero FB, Galán AS, Rodríguez TM. Effect of integrative reminiscence therapy on depression, well-being, integrity, self-esteem, and life satisfaction in older adults. J Posit Psychol 2014 Jul 18;10(3):240-247. [CrossRef]
    27. Woods B, O'Philbin L, Farrell EM, Spector AE, Orrell M. Reminiscence therapy for dementia. Cochrane Database Syst Rev 2018 Mar 1;3:CD001120 [FREE Full text] [CrossRef] [Medline]
    28. Chapoulie E, Guerchouche R, Petit P, Chaurasia G, Robert P, Drettakis G. Reminiscence Therapy using Image-Based Rendering in VR. In: Proceedings of the Conference on IEEE Virtual Reality. 2014 Presented at: VR'14; March 29-April 2, 2014; Minneapolis, MN, USA. [CrossRef]
    29. Lazar A, Thompson H, Demiris G. A systematic review of the use of technology for reminiscence therapy. Health Educ Behav 2014 Oct;41(1 Suppl):51S-61S [FREE Full text] [CrossRef] [Medline]
    30. Subramaniam P, Woods B. Digital life storybooks for people with dementia living in care homes: an evaluation. Clin Interv Aging 2016;11:1263-1276 [FREE Full text] [CrossRef] [Medline]
    31. Ryan AA, McCauley CO, Laird EA, Gibson A, Mulvenna MD, Bond R, et al. 'There is still so much inside': the impact of personalised reminiscence, facilitated by a tablet device, on people living with mild to moderate dementia and their family carers. Dementia (London) 2020 May;19(4):1131-1150. [CrossRef] [Medline]
    32. Laird EA, Ryan A, McCauley C, Bond RB, Mulvenna MD, Curran KJ, et al. Using mobile technology to provide personalized reminiscence for people living with dementia and their carers: appraisal of outcomes from a quasi-experimental study. JMIR Ment Health 2018 Sep 11;5(3):e57 [FREE Full text] [CrossRef] [Medline]
    33. Astell AJ, Ellis MP, Bernardi L, Alm N, Dye R, Gowans G, et al. Using a touch screen computer to support relationships between people with dementia and caregivers. Interact Comput 2010 Jul;22(4):267-275. [CrossRef]
    34. Benoit M, Guerchouche R, Petit P, Chapoulie E, Manera V, Chaurasia G, et al. Is it possible to use highly realistic virtual reality in the elderly? A feasibility study with image-based rendering. Neuropsychiatr Dis Treat 2015;11:557-563 [FREE Full text] [CrossRef] [Medline]
    35. Ma M, Zheng H. Virtual reality and serious games in healthcare. In: Brahnam S, Jain LC, editors. Advanced Computational Intelligence Paradigms in Healthcare 6: Virtual Reality in Psychotherapy, Rehabilitation, and Assessment. Berlin, Heidelberg: Springer; 2011:169-192.
    36. Witmer BG, Jerome CJ, Singer MJ. The factor structure of the presence questionnaire. Presence 2005 Jun;14(3):298-312. [CrossRef]
    37. Slobounov S, Ray W, Johnson B, Slobounov E, Newell K. Modulation of cortical activity in 2D versus 3D virtual reality environments: an EEG study. Int J Psychophysiol 2015 Mar;95(3):254-260. [CrossRef] [Medline]
    38. Dascal J, Reid M, IsHak WW, Spiegel B, Recacho J, Rosen B, et al. Virtual reality and medical inpatients: a systematic review of randomized, controlled trials. Innov Clin Neurosci 2017;14(1-2):14-21 [FREE Full text] [Medline]
    39. Krijn M, Emmelkamp P, Olafsson R, Biemond R. Virtual reality exposure therapy of anxiety disorders: a review. Clin Psychol Rev 2004 Jul;24(3):259-281. [CrossRef] [Medline]
    40. Rose T, Nam C, Chen K. Immersion of virtual reality for rehabilitation - review. Appl Ergon 2018 May;69:153-161. [CrossRef] [Medline]
    41. Sankaranarayanan G, Li B, Manser K, Jones SB, Jones DB, Schwaitzberg S, et al. Face and construct validation of a next generation virtual reality (Gen2-VR) surgical simulator. Surg Endosc 2016 Mar;30(3):979-985 [FREE Full text] [CrossRef] [Medline]
    42. Reger GM, Holloway KM, Candy C, Rothbaum BO, Difede J, Rizzo AA, et al. Effectiveness of virtual reality exposure therapy for active duty soldiers in a military mental health clinic. J Trauma Stress 2011 Feb;24(1):93-96. [CrossRef] [Medline]
    43. Parsons T, Rizzo A. Affective outcomes of virtual reality exposure therapy for anxiety and specific phobias: a meta-analysis. J Behav Ther Exp Psychiatry 2008 Sep;39(3):250-261. [CrossRef] [Medline]
    44. Hoffman HG, Patterson DR, Seibel E, Soltani M, Jewett-Leahy L, Sharar SR. Virtual reality pain control during burn wound debridement in the hydrotank. Clin J Pain 2008 May;24(4):299-304. [CrossRef] [Medline]
    45. Das DA, Grimmer KA, Sparnon AL, McRae SE, Thomas BH. The efficacy of playing a virtual reality game in modulating pain for children with acute burn injuries: a randomized controlled trial [ISRCTN87413556]. BMC Pediatr 2005 Mar 3;5(1):1 [FREE Full text] [CrossRef] [Medline]
    46. Huygelier H, Schraepen B, van Ee R, Abeele VV, Gillebert CR. Acceptance of immersive head-mounted virtual reality in older adults. Sci Rep 2019 Mar 14;9(1):4519 [FREE Full text] [CrossRef] [Medline]
    47. Rose V, Stewart I, Jenkins KG, Tabbaa L, Ang CS, Matsangidou M. Bringing the outside in: the feasibility of virtual reality with people with dementia in an inpatient psychiatric care setting. Dementia (London) 2019 Sep 11:- epub ahead of print. [CrossRef] [Medline]
    48. Roberts AR, de Schutter B, Franks K, Radina ME. Older adults' experiences with audiovisual virtual reality: perceived usefulness and other factors influencing technology acceptance. Clin Gerontol 2019;42(1):27-33. [CrossRef] [Medline]
    49. Brimelow R, Dawe B, Dissanayaka N. Preliminary research: virtual reality in residential aged care to reduce apathy and improve mood. Cyberpsychol Behav Soc Netw 2020 Mar;23(3):165-170. [CrossRef] [Medline]
    50. Optale G, Urgesi C, Busato V, Marin S, Piron L, Priftis K, et al. Controlling memory impairment in elderly adults using virtual reality memory training: a randomized controlled pilot study. Neurorehabil Neural Repair 2010 May;24(4):348-357. [CrossRef] [Medline]
    51. Cho D, Lee S. Effects of virtual reality immersive training with computerized cognitive training on cognitive function and activities of daily living performance in patients with acute stage stroke: a preliminary randomized controlled trial. Medicine (Baltimore) 2019 Mar;98(11):e14752 [FREE Full text] [CrossRef] [Medline]
    52. Micarelli A, Viziano A, Micarelli B, Augimeri I, Alessandrini M. Vestibular rehabilitation in older adults with and without mild cognitive impairment: effects of virtual reality using a head-mounted display. Arch Gerontol Geriatr 2019;83:246-256. [CrossRef] [Medline]
    53. Marin RS. Differential diagnosis of apathy and related disorders of diminished motivation. Psychiatric Annals 1997;27(1):30-33. [CrossRef]
    54. McPherson S, Fairbanks L, Tiken S, Cummings JF, Back-Madruga C. Apathy and executive function in Alzheimer's disease. J Int Neuropsychol Soc 2002 Mar;8(3):373-381. [CrossRef] [Medline]
    55. Tsoi T, Baillon S, Lindesay J. Early frontal executive impairment as a predictor of subsequent behavior disturbance in dementia. Am J Geriatr Psychiatry 2008 Feb;16(2):102-108. [CrossRef] [Medline]
    56. Fishman KN, Ashbaugh AR, Lanctôt KL, Cayley ML, Herrmann N, Murray BJ, et al. Apathy, not depressive symptoms, as a predictor of semantic and phonemic fluency task performance in stroke and transient ischemic attack. J Clin Exp Neuropsychol 2018 Jun;40(5):449-461. [CrossRef] [Medline]
    57. Grossi D, Santangelo G, Barbarulo AM, Vitale C, Castaldo G, Proto MG, et al. Apathy and related executive syndromes in dementia associated with Parkinson's disease and in Alzheimer's disease. Behav Neurol 2013 Jan 1;27(4):515-522 [FREE Full text] [CrossRef] [Medline]
    58. Meyer A, Zimmermann R, Gschwandtner U, Hatz F, Bousleiman H, Schwarz N, et al. Apathy in Parkinson's disease is related to executive function, gender and age but not to depression. Front Aging Neurosci 2014;6:350 [FREE Full text] [CrossRef] [Medline]
    59. Shao Z, Janse E, Visser K, Meyer AS. What do verbal fluency tasks measure? Predictors of verbal fluency performance in older adults. Front Psychol 2014;5:772 [FREE Full text] [CrossRef] [Medline]
    60. Rosser A, Hodges JR. Initial letter and semantic category fluency in Alzheimer's disease, Huntington's disease, and progressive supranuclear palsy. J Neurol Neurosurg Psychiatry 1994 Nov;57(11):1389-1394 [FREE Full text] [CrossRef] [Medline]
    61. Robert P, Lanctôt KL, Agüera-Ortiz L, Aalten P, Bremond F, Defrancesco M, et al. Is it time to revise the diagnostic criteria for apathy in brain disorders? The 2018 international consensus group. Eur Psychiatry 2018 Oct;54:71-76 [FREE Full text] [CrossRef] [Medline]
    62. Radakovic R, Abrahams S. Developing a new apathy measurement scale: dimensional apathy scale. Psychiatry Res 2014 Nov 30;219(3):658-663. [CrossRef] [Medline]
    63. Manera V, Chapoulie E, Bourgeois J, Guerchouche R, David R, Ondrej J, et al. A feasibility study with image-based rendered virtual reality in patients with mild cognitive impairment and dementia. PLoS One 2016;11(3):e0151487 [FREE Full text] [CrossRef] [Medline]
    64. Kim A, Darakjian N, Finley JM. Walking in fully immersive virtual environments: an evaluation of potential adverse effects in older adults and individuals with Parkinson's disease. J Neuroeng Rehabil 2017 Feb 21;14(1):16 [FREE Full text] [CrossRef] [Medline]
    65. Parijat P, Lockhart TE. Can virtual reality be used as a gait training tool for older adults? Proc Hum Factors Ergon Soc 2011 Sep 1;55(1):157-161. [CrossRef]
    66. Kang YJ, Ku J, Han K, Kim SI, Yu TW, Lee JH, et al. Development and clinical trial of virtual reality-based cognitive assessment in people with stroke: preliminary study. Cyberpsychol Behav 2008 Jun;11(3):329-339. [CrossRef] [Medline]
    67. Aged Care Virtual Reality. 2018. VR Programs for Health Benefits   URL: http://www.agedcarevirtualreality.com/ [accessed 2019-08-20]
    68. Reminiscence. 2018. About Us   URL: https://www.reminiscience.co.uk/about-us [accessed 2019-08-20]
    69. Rendever. 2018. Virtual Reality for Seniors   URL: http://rendever.com/ [accessed 2019-08-20]
    70. Saredakis D, Szpak A, Birckhead B, Keage HAD, Rizzo A, Loetscher T. Factors associated with virtual reality sickness in head-mounted displays: a systematic review and meta-analysis. Front Hum Neurosci 2020;14:96 [FREE Full text] [CrossRef] [Medline]
    71. Jorm AF, Mackinnon AJ, Henderson AS, Scott R, Christensen H, Korten AE, et al. The psychogeriatric assessment scales: a multi-dimensional alternative to categorical diagnoses of dementia and depression in the elderly. Psychol Med 1995 May;25(3):447-460. [CrossRef] [Medline]
    72. Clarke DE, Reekum RV, Simard M, Streiner DL, Freedman M, Conn D. Apathy in dementia: an examination of the psychometric properties of the apathy evaluation scale. J Neuropsychiatry Clin Neurosci 2007;19(1):57-64. [CrossRef] [Medline]
    73. Oculus. 2019. Oculus Go   URL: https://www.oculus.com/go/ [accessed 2019-07-10]
    74. Jorm A, Mackinnon A. Australian Government Department of Health. 1995. The Psychogeriatric Assessment Scales   URL: https:/​/www.​health.gov.au/​sites/​default/​files/​documents/​2019/​12/​psychogeriatric-assessment-scales-pas-user-guide.​pdf [accessed 2019-08-20]
    75. Dyer SM, Gnanamanickam ES, Liu E, Whitehead C, Crotty M. Diagnosis of dementia in residential aged care settings in Australia: an opportunity for improvements in quality of care? Australas J Ageing 2018 Dec;37(4):E155-E158 [FREE Full text] [CrossRef] [Medline]
    76. Jorm A, Christensen H, Jacomb PA, Korten AE, Mackinnon AJ. The cognitive decline scale of the psychogeriatric assessment scales (PAS): longitudinal data on its validity. Int J Geriatr Psychiatry 2001 Mar;16(3):261-265. [CrossRef] [Medline]
    77. Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG. Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int J Aviat Psychol 1993 Jul;3(3):203-220. [CrossRef]
    78. Rebenitsch L, Owen C. Review on cybersickness in applications and visual displays. Virtual Reality 2016 Apr 26;20(2):101-125. [CrossRef]
    79. Bouchard S, Robillard G, Renaud P. Revising the factor structure of the simulator sickness questionnaire. Annu Rev CyberTherapy Telemed 2007;5:128-137 [FREE Full text]
    80. Usoh M, Catena E, Arman S, Slater M. Using presence questionnaires in reality. Presence 2000 Oct;9(5):497-503. [CrossRef]
    81. Schwind V, Knierim P, Haas N, Henze N. Using Presence Questionnaires in Virtual Reality. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 2019 Presented at: CHI'19; May 4-9, 2019; Glasgow, Scotland, UK. [CrossRef]
    82. Spreen O, Strauss E. A Compendium of Neuropsychological Tests: Administration, Norms, and Commentary. Second Edition. New York, NY: Oxford University Press; 1998.
    83. Merhi O, Faugloire E, Flanagan M, Stoffregen TA. Motion sickness, console video games, and head-mounted displays. Hum Factors 2007 Oct;49(5):920-934. [CrossRef] [Medline]
    84. Steiger JH. Tests for comparing elements of a correlation matrix. Psychol Bull 1980;87(2):245-251. [CrossRef]
    85. Kennedy R, Drexler J, Compton D, Stanney K, Lanham D, Harm D. Congural scoring of simulator sickness, cybersickness and space adaptation syndrome: similarities and differences. In: Hettinger LJ, Haas MW, editors. Virtual and Adaptive Environments: Applications, Implications, and Human Performance Issues. Mahwah, NJ: Lawrence Erlbaum Associates; 2003:247-278.
    86. Ellis JM, Doyle CJ, Selvarajah S. The relationship between apathy and participation in therapeutic activities in nursing home residents with dementia: evidence for an association and directions for further research. Dementia (London) 2016 Jul;15(4):494-509. [CrossRef] [Medline]
    87. Subramaniam P, Woods B. Towards the therapeutic use of information and communication technology in reminiscence work for people with dementia: a systematic review. Int J Comput Healthcare 2010;1(2):106. [CrossRef]
    88. Bermingham A, O'Rourke J, Gurrin C, Collins R, Irving K, Smeaton A. Automatically Recommending Multimedia Content for Use in Group Reminiscence Therapy. In: Proceedings of the 1st ACM International Workshop on Multimedia Indexing and Information Retrieval for Healthcare. 2013 Presented at: MIIRH'13; October 22, 2013; Barcelona, Spain. [CrossRef]
    89. Pinquart M, Forstmeier S. Effects of reminiscence interventions on psychosocial outcomes: a meta-analysis. Aging Ment Health 2012;16(5):541-558. [CrossRef] [Medline]
    90. Elias SS, Neville C, Scott T. The effectiveness of group reminiscence therapy for loneliness, anxiety and depression in older adults in long-term care: a systematic review. Geriatr Nurs 2015;36(5):372-380. [CrossRef] [Medline]
    91. Yasuda K, Kuwabara K, Kuwahara N, Abe S, Tetsutani N. Effectiveness of personalised reminiscence photo videos for individuals with dementia. Neuropsychol Rehabil 2009 Aug;19(4):603-619. [CrossRef] [Medline]
    92. Subramaniam P, Woods B. The impact of individual reminiscence therapy for people with dementia: systematic review. Expert Rev Neurother 2012 May;12(5):545-555. [CrossRef] [Medline]
    93. Baker S, Waycott J, Robertson E, Carrasco R, Neves B, Hampson R, et al. Evaluating the use of interactive virtual reality technology with older adults living in residential aged care. Inf Process Manag 2020 May;57(3):102105 [FREE Full text] [CrossRef]
    94. Vaughan RM, Coen RF, Kenny R, Lawlor BA. Preservation of the semantic verbal fluency advantage in a large population-based sample: normative data from the TILDA study. J Int Neuropsychol Soc 2016 May;22(5):570-576. [CrossRef] [Medline]
    95. Tombaugh T, Kozak J, Rees L. Normative data stratified by age and education for two measures of verbal fluency: FAS and animal naming. Arch Clin Neuropsychol 1999 Feb;14(2):167-177. [Medline]
    96. Okumura Y, Tanimukai S, Asada T. Effects of short-term reminiscence therapy on elderly with dementia: a comparison with everyday conversation approaches. Psychogeriatrics 2008;8(3):124-133. [CrossRef]
    97. Drijgers RL, Verhey FR, Leentjens AF, Köhler S, Aalten P. Neuropsychological correlates of apathy in mild cognitive impairment and Alzheimer's disease: the role of executive functioning. Int Psychogeriatr 2011 Oct;23(8):1327-1333. [CrossRef] [Medline]
    98. Massimi M, Berry E, Browne G, Smyth G, Watson P, Baecker RM. An exploratory case study of the impact of ambient biographical displays on identity in a patient with Alzheimer's disease. Neuropsychol Rehabil 2008;18(5-6):742-765. [CrossRef] [Medline]
    99. Allan L, Ballard C, Burn D, Kenny R. Prevalence and severity of gait disorders in Alzheimer's and non-Alzheimer's dementias. J Am Geriatr Soc 2005 Oct;53(10):1681-1687. [CrossRef] [Medline]
    100. DeLuca SA, Korcuska LA, Oberstar BH, Rosenthal ML, Welsh PA, Topol EJ. Are we promoting true informed consent in cardiovascular clinical trials? J Cardiovasc Nurs 1995 Apr;9(3):54-61. [CrossRef] [Medline]
    101. McMurdo M, Roberts H, Parker S, Wyatt N, May H, Goodman C, AgeAgeing Specialty Group‚ NIHR‚ Comprehensive Clinical Research Network. Improving recruitment of older people to research through good practice. Age Ageing 2011 Nov;40(6):659-665. [CrossRef] [Medline]


    Abbreviations

    AES: Apathy Evaluation Scale
    HMD: head-mounted display
    PAS: Psychogeriatric Assessment Scale
    PTSD: post-traumatic stress disorder
    SSQ: Simulator Sickness Questionnaire
    SUS: Slater-Usoh-Steed Presence Questionnaire
    VR: virtual reality


    Edited by G Eysenbach; submitted 29.12.19; peer-reviewed by H Huygelier, L Campbell; comments to author 10.02.20; revised version received 26.03.20; accepted 08.04.20; published 26.06.20

    ©Dimitrios Saredakis, Hannah AD Keage, Megan Corlis, Tobias Loetscher. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 26.06.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.