Published on in Vol 21, No 6 (2019): June

Preprints (earlier versions) of this paper are available at, first published .
The Symptoms Targeted for Monitoring in a Web-Based Tracking Tool by Caregivers of People With Dementia and Agitation: Cross-Sectional Study

The Symptoms Targeted for Monitoring in a Web-Based Tracking Tool by Caregivers of People With Dementia and Agitation: Cross-Sectional Study

The Symptoms Targeted for Monitoring in a Web-Based Tracking Tool by Caregivers of People With Dementia and Agitation: Cross-Sectional Study

Original Paper

1Geriatric Medicine Research Unit, Halifax, NS, Canada

2DGI Clinical Inc, Halifax, NS, Canada

3Division of Geriatric Medicine, Dalhousie University, Halifax, NS, Canada

4Otsuka Pharmaceutical Development & Commercialization Inc, Princeton, NJ, United States

5Department of Pharmacology, Dalhousie University, Halifax, NS, Canada

6Otsuka Canada Pharmaceutical Inc, Saint-Laurent, QC, Canada

Corresponding Author:

Kenneth Rockwood, MD

Geriatric Medicine Research Unit

Nova Scotia Health Authority

5955 Veterans' Memorial Lane

Halifax, NS, B3H 2E9


Phone: 1 902 473 8687

Fax:1 902 473 1050


Background: In people with dementia, neuropsychiatric symptoms (NPSs), especially agitation, are associated with worse quality of life and caregiver burden. As NPSs may vary with illness severity, knowledge of how people with dementia and their caregivers describe and rate the importance of agitation symptoms can improve the understanding of the clinical meaningfulness of the manifestations of agitation. The internet provides new opportunities to better understand patient experiences, as patients and caregivers increasingly look to Web-based platforms as a means of managing symptoms.

Objective: The aim of this study was to examine Web-based reports from a dementia symptom website to better understand the symptoms of agitation and explore how they are being targeted for monitoring by caregivers of people with dementia.

Methods: The Dementia Guide website hosts a Web-based database used by caregivers (97%) and people with dementia (3%).
From its 61 dementia symptoms, users can select relevant symptoms that they deem important to monitor or track the effects of treatment. We employed a staging algorithm to determine if individuals had mild cognitive impairment (MCI) or mild, moderate, or severe dementia. Agitation was defined using terms consistent with the International Psychogeriatrics Association’s provisional consensus definition. We compared the proportion of people with NPSs and agitation across stages of dementia severity and studied how many agitation-defining descriptors were selected, and how often they occurred, by stage.

Results: As of March 2017, 4121 people had used the tracking tool, of whom 2577 provided sufficient data to allow disease severity staging. NPSs were tracked by 2127/2577 (82.54%) and agitation by 1898/2577 (73.65%). The proportion in whom agitation was tracked increased with increasing cognitive impairment: 68.5% (491/717) in people with MCI, and 72.50% (754/1040), 73.3% (378/516), and 90.5% (275/304) in mild, moderate, and severe dementia, respectively (χ23=54.9; P<.001). The number of NPS and agitation descriptors selected also increased with severity (median number of NPSs=1, 2, 2, and 3 for MCI, mild, moderate, and severe dementia, respectively, Kruskal-Wallis H Test H3=250.47; P<.001; median number of agitation descriptors=1, 2, 3, and 4, H3=146.11; P<.001).

Conclusions: NPSs and agitation are common targets for tracking over the course of dementia and appear more frequently with increasing disease severity. These common and distressing symptoms represent clinically meaningful targets in treating people with dementia.

J Med Internet Res 2019;21(6):e13360




Cognitive decline is the hallmark of dementia, but more often the accompanying neuropsychiatric symptoms (NPSs) trouble people with dementia and their caregivers the most. NPSs appear across all types and stages of dementia [1-3] in as many as 80% to 90% of people with Alzheimer disease (AD) [4,5]. Apathy, irritability, agitation, depression, and anxiety typically are noted most often [6]. When specific NPSs arise, they vary with the type of dementia and its severity. In AD, apathy and depression are most often seen early, whereas delusions, hallucinations, and aggression become more prevalent with disease progression [2]. In its various guises, agitation is common across all stages of dementia [2]. This likely reflects agitation’s multiple causes, including biological subsyndromes [7], reaction to declining cognitive function, and comorbid illnesses [8].

Defining Agitation

The understanding of agitation continues to evolve. Recent work to evaluate NPSs in dementia has focused on the symptom of agitation. Without a commonly accepted consensus description of agitation, it has been difficult to compare studies or even to know which behaviors are included in studies of agitation [9]. For these reasons, the International Psychogeriatric Association proposed a provisional consensus clinical and research definition, so as to help define populations for clinical care and research [9]. The proposed definition has resulted in a liberally construed notion of agitation, extending even beyond commonly used broad-spectrum NPS measures, such as the Neuropsychiatric Inventory (NPI) [10] and NPI-Clinician Rating Scale (NPI-C) [11]. In consequence of the newer approach, it is important to know how bothersome agitation-defining symptoms might be to people living with dementia and to their caregivers. As more bothersome symptoms vary with illness severity, knowledge of how caregivers describe and rate the importance of agitation symptoms can improve the understanding of the clinical meaningfulness of the myriad manifestations of agitation. One useful method for eliciting this information is by patient-centered, individualized measures, which allow patients (crucially in dementia) and their caregivers to specify which symptoms they find most troubling [12,13].

Web-Based Symptom Monitoring

The internet provides unprecedented access to the views of people living with chronic diseases. It is not yet clear as to how best their views can be elicited. Our group has pioneered one method of doing so. Since September 2006, the Dementia Guide website [14] offers a resource for persons with dementia (3% of users) and their caregivers (97% of users). Independently verified as credible using the DISCERN evaluation methodology [15], the site provides a mechanism for tracking symptoms important to caregivers and persons with dementia, thereby defining them as meaningful. This methodology is supported by previous work [16,17] and has allowed us to evaluate common but often understudied symptoms such as verbal repetition [18]. Although this approach cannot be used to estimate prevalence and incidence rates, which require representative population data, it can be used to compare frequencies in other nonrandom samples, and associations more generally, especially in relation to dementia severity.

Study Objectives

Here we used the dementia SymptomGuide to better understand the symptom of agitation and how it is being targeted for monitoring by caregivers. Specifically, our objectives were to (1) define agitation using the dementia SymptomGuide and evaluate how often it was being monitored across the stages of dementia severity, (2) estimate the degree of agitation experienced by people with dementia and how it varied with stage, and (3) compare the reported frequency (episodes per day) of agitation to other NPSs.


The Research Ethics Committee at Nova Scotia Health Authority provided approval for this study. Approval was sought from Nova Scotia Health Authority as one of the authors on this study (KR) is affiliated with the institution. SymptomGuide users consented to terms of use, which included allowing their data to be aggregated and used for research purposes. Users were assured that research findings would be presented in a manner that would not disclose personal or individual identifying information.

Design, Participants, and Instrument

For this cross-sectional study, participants were recruited from the Dementia Guide website [14]. In addition to offering information, the website makes available the dementia SymptomGuide: a Web-based symptom tracker [19]. With the dementia SymptomGuide, individuals create a Current Symptom Profile to monitor the symptoms that are important to them. Users can choose from a standardized inventory of 61 symptoms and 609 symptom descriptions or enter symptoms and descriptions of their own. The predefined symptom descriptions overlap such that one symptom description can fall under more than one symptom. For example, the description does not recognize current dwelling as home from the disorientation to place symptom overlaps with believes they live somewhere else from delusions and paranoia. This redundancy is a built-in feature to allow users multiple ways to address common phenomena. Users note the occurrence of each selected symptom and record its frequency at baseline and whenever they choose to follow up. SymptomGuide users are also asked to rank their chosen symptoms from most to least important (from most to least bothersome). Symptom rankings were normalized as the rank divided by total number of symptoms reported resulting in a 0 to 1 scale, such that a weighted rank of 1 is most important. At baseline, SymptomGuide users are also asked to provide information on demographics, dementia diagnosis, and medication use. For those who select 3 or more symptoms, the dementia stage can be determined using a staging algorithm [17]. In this way, users have an individualized selection of symptoms that they track with standardized descriptions to allow comparisons across users. In this study, we used data from the users’ first visit (baseline) only.

We attempted to determine the level of cognitive impairment for all users with our staging algorithm [17]. Users who selected fewer than 3 symptoms were excluded from the analysis because the staging algorithm requires at least 3. Users for whom stage could be determined were categorized into 4 levels of cognitive impairment (mild cognitive impairment [MCI], mild dementia, moderate dementia, or severe dementia) as previously described by our group [17]. To control for outliers, if the number of symptoms selected by a user was greater than the 95th percentile (more than 23 symptoms), they were excluded from the analyses. Symptom frequencies were truncated at 10 episodes per hour (99th percentile) plus 1, such that symptom frequencies greater than 10 episodes per hour were imputed as 11 episodes per hour.

Mapping Agitation to Symptom Descriptions

Agitation itself does not appear as one of the 61 symptoms in the dementia SymptomGuide Library. Instead, descriptions of many symptoms refer to agitation and its key components. To operationalize agitation, we took terms consistent with the International Psychogeriatric Association and NPI-C agitation definition [9,11] and mapped each term to SymptomGuide symptom descriptions. For example, the term screaming from the International Psychogeriatric Association’s consensus definition was mapped to the SymptomGuide descriptions: yells, shouts, or screams, verbally attacks others (eg, shouts insults), resists and refuses assistance with verbal outbursts, and yells at, or becomes easily angry with grandchildren. In this way, 90 dementia SymptomGuide descriptions from 33 separate symptoms were combined to define agitation (Multimedia Appendix 1).

Statistical Analysis

Participant characteristics were reported as frequencies and percentages, means and SD, or medians and ranges as appropriate. Percentages were based on the number of individuals with available data for each specific characteristic.

Objectives were evaluated using Pearson chi-squared test to compare the reported proportion of agitation and NPSs between stages of dementia severity (objective 1), Kruskal-Wallis one-way analysis of variance by ranks to compare the number and proportion of NPSs and agitation descriptors across groups, and a post hoc analysis with the Mann-Whitney-Wilcoxon test to determine pairwise associations (objective 2), and anticipating a non-normal distribution, we analyzed differences in reported episodes per day between symptoms using the nonparametric Mann-Whitney-Wilcoxon test (objective 3). All analyses were performed using R statistical software (R Core Team, Austria). All post hoc multiple comparisons were performed using Bonferroni corrections, by multiplying P values by the number of comparisons. Differences were considered statistically significant for values less than .05.

Design and Participants

As of March 2017, the dementia SymptomGuide database consisted of 4121 participants who created a symptom profile to monitor symptoms as targets for treatment. Of those, 2577 had 3 or more symptoms needed for the staging algorithm and so were included in the study (Figure 1). Most participants were elderly North American women (Table 1).

Figure 1. Participant inclusion chart. Participants were included in the analysis population if they met staging criteria excluding users who selected more than 23 symptoms (95th percentile). MCI: Mild Cognitive Impairment.
View this figure
Table 1. Participant characteristics.
CharacteristicTotalMild cognitive impairmentMildModerateSevere
Participants, n25777171040516304
Age (years), mean (SDa)76 (12)74 (15)75 (12)77 (11)77 (11)
Percentagea of women6363656162
Percentagea of participants with Alzheimer disease61100b765742
Percentagea living in care facilityc131172019
Percentagea with education ≥high school7782787871
Percentagea of North Americans8784878986

aStatistic/percentage of participants who reported information.

bTwo participants reported disease type in the mild cognitive impairment group.

cCare facility included retirement homes and nursing homes.

Reported Symptoms of Agitation

Of the 61 symptoms, 33 contained descriptions of agitation, of which 15 were NPSs (Multimedia Appendix 2). For example, one description of agitation from a non-NPS (looking after grandchildren) is yells at or becomes easily angry with grandchildren. Two-thirds of the most common symptoms (10/15) were an NPS, included a description of agitation, or were both (Figure 2). On average, 7.7 (SD 4.7) symptoms were targeted (median=4, range 3-23) per participant. In most participants (82.54%, 2127/2577), at least 1 symptom was an NPS. Agitation was selected across all stages with 73.65% (1898/2577) of participants reporting at least one description of the symptom. Agitation was reported least often in the MCI group (68.5%, 491/717) and most often in the severe dementia group (90.5%, 275/304).

Agitation was most often described by verbalizations such as Argumentative or difficult with others (reported by 20.49%, 312/1523 of participants with ranked symptoms; Figure 3), Makes comments that are mean or hurtful (15.17%, 231/1523), Yells, screams, or shouts (8.93%, 136/1523), or verbally attacks others (8.54%, 130/1523). The 15 most commonly reported descriptions of agitation are shown in Figure 3. The frequency of the description did not correlate with the participants’ ranking of importance of the symptom (r=.03; P=.1). For example, the symptom descriptions verbally attacks others and says the same word or phrase over and over again were ranked similarly (mean 0.42 for both) but had significantly different reported median episodes per day (1.6 versus 5.0; P=.01). The reported occurrence of any description of agitation was, on average, 7 times per day (median 2, interquartile range: 1.0-5.0) which was significantly more frequent than other NPSs at 4 times per day (median 1, interquartile range: 0.7-4.0; P<.001). The rankings of NPSs were rated more important than those for descriptions of agitation (median weighted rank 0.62 vs 0.51; P<.001).

Figure 2. Prevalence of symptoms most frequently being monitored on the dementia SymptomGuide by type of symptom. The proportion (% of participants) ±SEp monitoring the 15 most frequently monitored symptoms. "Agitation"=non-NPS including a description of agitation, "Other NPS"=NPS which does not include a description of agitation, "Agitation & NPS"=NPS that includes a description of agitation, "Neither"=symptom is not an NPS and does not include a description of agitation. NPS: Neuropsychiatric Symptoms, SEp: Standard Error of Proportion.
View this figure
Figure 3. Ranking and daily frequency of the most common descriptions of agitation. Relationship between rank of importance (A) and number of episodes per day (B) of the 15 most commonly reported descriptions of agitation. “More Important” rank=1.00-0.67, “Important” rank=0.66-0.34, “Less Important” rank=0.33-0.00.
View this figure

Variations by Severity

The proportion of participants with at least 1 NPS showed an increasing trend in relation to dementia severity—75.7% (543/717), 83.27% (866/1040), 82.2% (424/516), and 96.7% (294/304) for MCI, mild, moderate, and severe, respectively (χ23=65.8; P<.001). Similarly, the proportion of participants with at least 1 agitation description increased with severity: 68.5% (491/717), 72.50% (754/1040), 73.3% (378/516), and 90.5% (275/304) for MCI, mild, moderate, and severe, respectively (χ23=54.9; P<.001). A post hoc pairwise analysis showed that for people with severe dementia, there were high instances of both NPSs and agitation (Figure 4). We next compared the number of NPSs and agitation descriptions reported per participant by stage (Figure 5). There was a significant association between dementia severity and number of NPSs, with higher numbers of NPSs being reported in people with severe dementia (median 1, 2, 2, and 3 for MCI, mild, moderate, and severe, respectively; H3=250.47; P<.001). Similarly, there was a significant association between severity and agitation, with higher numbers of agitation descriptors being reported in those with severe dementia (median 1, 2, 3, and 4; H3=146.11; P<.001). For both measures, there were significant pairwise differences (P<.001) between every stage of dementia except mild and moderate. We also examined the prevalence of NPSs and agitation by stage and user-reported dementia diagnosis (Multimedia Appendix 3). The prevalence of both NPSs and agitation generally increased with dementia severity, in particular, in participants who reported a diagnosis of AD.

Finally, the proportion of total symptoms that were neuropsychiatric (number of NPSs divided by total number of symptoms) and the proportion of total descriptions related to agitation (number of agitation descriptions divided by total number of descriptions) were calculated for each participant (Figure 5). The proportion of NPSs varied significantly with stage, with the highest proportion occurring in those with severe dementia: median 27.3%, 25.0%, 25.0%, and 28.6% for MCI, mild, moderate, and severe, respectively (H3=17.39; P<.001). Similarly, the proportion of agitation description was highest in those with severe dementia: median proportion 8.3%, 6.7%, 7.2%, and 9.2% (H3=24.75; P<.001). Post hoc comparisons between stages revealed significant differences between the severe group and mild and moderate groups (P<.001 and P=.03, respectively) for NPSs and between the severe group and the MCI, mild, and moderate groups (P=.02, P<.001, and P=.002, respectively) for agitation. In participants who reported a specific dementia diagnosis, the number of NPSs and agitation descriptors selected increased with disease severity, significantly so in AD, vascular dementia, and frontotemporal dementia (Multimedia Appendix 4).

Figure 4. Proportion of participants who selected at least one NPS or description of agitation increased with stage. (A) % of participants who selected at least one NPS. (B) % of participants who selected at least one description of agitation. Bonferroni adjusted P values. MCI: Mild Cognitive Impairment, NPS: Neuropsychiatric Symptoms, p: P value.
View this figure
Figure 5. Number and proportion of symptoms that were NPS or descriptions of agitation were higher in the severe stage. Number of NPS (A) and descriptors of agitation (B) reported per subject in each stage. Proportion of symptoms targeted that are NPS (C) and symptom descriptions targeted that are descriptions of agitation (D) by stage. Outliers are shown here as observations above Q3 + 1.5 IQR (the 75th percentile + 1.5 times the interquartile range). Bonferroni adjusted P values. IQR: Interquartile Range, MCI: Mild Cognitive Impairment, NPS: Neuropsychiatric Symptoms, p: P value.
View this figure

Principal Findings

Using the SymptomGuide Web-based tracking tool, we determined how dementia caregivers selected symptoms of agitation as targets for monitoring. Across all stages, symptoms that define agitation, including NPSs, were tracked by most users. The proportion in whom agitation was tracked increased with severity of cognitive impairment. Although most of the symptoms that were chosen for monitoring tended to occur frequently, a few were tracked even when they occurred uncommonly. This suggests that the impact of a given symptom to caregiver distress might reflect either its content or its frequency or both. The range of specific symptoms that were identified for tracking also suggests the merit of a broad-spectrum approach to agitation, and perhaps the need for individualization to make tracking feasible. As it is important to validate our methodological approach, we compared our estimates of frequency of individual NPSs and agitation symptoms (from Web-based patient/caregiver reports) to data collected more traditionally in memory clinics. A large, nonrandom study by Siafarikas et al [20] used data from the Norwegian national registry of memory clinics (n=4571) to examine the frequency of NPSs and NPS subgroups in MCI and the different stages of AD. The study thereby notably provides a recent and contemporary database of symptoms and associations, collected to the high standard inherent in a national registry. We were interested to know whether trends similar to those found there could be detected using our Web-based data of predominantly North American caregiver reports. Recognizing that the differences in care and treatment practices between Norway and North America may be in play, nevertheless, our approach appears to be valid. For example, our estimate of the proportion of people with at least 1 NPS (82.54%, 2127/2577) corresponds closely to Norwegian estimates that NPSs were present in 87.2% of people with MCI or AD examined with validated neuropsychiatric cognitive assessments. Our data were consistent with that paper’s report of at least 1 NPS in 79.5% of MCI subjects and in 91.2% of those with AD and showed a similar trend of increasing NPSs with increasing dementia severity (Figure 4) [20]. In further support of our findings, Peters et al [21] characterized NPSs using data from A Canadian Cohort Study of Cognitive Impairment and Related Dementias [22] and found similar trends, with 74% of those that were cognitively impaired-not demented and 89% of those with dementia reporting at least 1 NPS. In keeping with our findings, they also found that a greater proportion of subjects experienced agitation with increasing levels of cognitive impairment (23% in the CIND group vs 36% in the dementia group). Similar comparability was seen when we mapped the dementia SymptomGuide symptom descriptions to the Neuropsychiatric Inventory-Questionnaire (NPI-Q) agitation/aggression domain used in the Siafarikas et al [20] study. Note that in contrast to the 90 SymptomGuide descriptions that aligned with what was described in the International Psychogeriatric Association’s provisional consensus report, only 50 such descriptions could be mapped to the NPI-Q agitation/aggression domain. However, the proportion of people with NPI-Q aggression/agitation increased with the severity of cognitive impairment—from 23% in people with MCI to 35% in people with moderate-severe dementia, close to our estimates using just those 50 descriptions: 19.0% (136/717) and 40.2% (330/820), respectively.

The similarity of our data with estimates from clinically adjudicated reports adds to our understanding of the validity and fidelity of Web-based data, at least where the Web-based reporting tool has been optimized for motivated users [19]. Resources such as the SymptomGuide increase the opportunity to capture the lived experience of people with dementia. In being able to demonstrate which of the symptoms with agitation are sufficiently salient to be monitored by caregivers, our data join those from the Norwegian registry report to offer empirical insights into the International Psychogeriatric Association’s provisional consensus clinical and research definition.

We were also able to assess the degree to which individuals experienced NPSs and agitation. We found that the number of NPSs and agitation descriptions reported per participant increased with dementia severity and were significantly different between all stages except mild and moderate. This finding should be interpreted carefully, however, as the total number of reported symptoms (and by extension, the total number of descriptions) also generally increases with severity. More telling measures were the proportion of a participant’s symptoms that were NPSs and the proportion of descriptions that related to agitation. We found similar estimates to those reported in other studies [20,21] showing that those with severe dementia experienced the highest degree of NPSs and agitation (median 28.6% of symptoms were NPSs; median 9.2% of descriptions were related to agitation). Of all the NPSs, agitation is often singled out as particularly troublesome and has become the focus of many investigations exploring the well-being of people with dementia and/or their caregivers [23,24]. To varying degrees of success, a range of pharmacological, psychological, and physical approaches are used to treat NPSs [1]. Despite their many advantages, instruments such as the NPI, NPI-Q, or NPI-C are highly structured and leave little room for customization or individualization by respondents. In other words, most self-report scales used for measuring NPSs contain predefined items or domains that have been deemed significant by the researcher, rather than the people with dementia and/or their caregivers. As a result, much less is known about the NPSs that are important to people with dementia or their caregivers, especially ones not included in NPS scales or measurements [9]. In this study, we did not have a comprehensive symptom inventory for each individual, however, we did have a list of symptoms selected for treatment, predominantly by caregivers. In this case, and as previously observed [25], agitation appears to be a potent symptom that is rarely ignored. The items selected by our caregiver/patient users were comparable in frequency and severity with those described by caregivers in the Norwegian national dementia registry, which also offers a comprehensive but nonrandom sample.


Our data must be interpreted with caution. As the dementia SymptomGuide does not include a symptom for agitation, we used 90 of 609 specific symptom descriptions to define agitation. This wide range of symptoms is in keeping with what has been proposed in the provisional consensus definition of the International Psychogeriatric Association [9]. Arguably, focusing on descriptors of behavior versus interpretation of behaviors is a strength, particularly given that the participants are nonprofessionals. However, such a broad definition of agitation may over represent the number of cases in this sample. For example, in keeping with that proposal, we included verbal repetition in our definition of agitation. This also reflects observations laid out elsewhere that verbal repetition might reflect anxiety as much as impaired memory [18]. In this sense, verbal repetition could be considered a form of psychomotor agitation, a prospect that requires additional inquiry. Furthermore, we note that the data in this study consist in self-reported questionnaire responses, with nontechnical accounts completed by care providers and a few people with dementia. Even so, this approach is in line with the goal of developing clinically meaningful data [12]. In this study, only data from the first (baseline) Web visit were used. It would indeed be interesting to track the patterns of symptoms over time in future studies, as numbers accumulate to allow sufficient disaggregation of data. The introduction of mobile health apps for smartphones and tablets should accelerate data acquisition.


The importance of agitation symptoms as a target for treatment in our study supports the need for more well-controlled studies of both nonpharmacologic and pharmacologic treatments of agitation across all stages of AD, as well as the need for a universally accepted operational definition of agitation in this context. In any era in which importance is being placed on the lived experience of people with dementia, how do we incorporate their point of view? How can we extricate their views from those of the people involved in their care? How can we balance the accessibility of Web-based resources with the interpretability of the data which might be generated on the Web? Can Web-based data be used to detect patterns in treatment response that might inform our understanding of mechanisms in dementia? These questions are motivating additional inquiries so that we can develop a more well-rounded understanding of how dementia affects the lives of the people to whom it is a challenge.


This study was conducted by DGI Clinical Inc, with funding provided by Otsuka Pharmaceuticals Development and Commercialization Inc.

Authors' Contributions

RAB, KR, CATC, SEH, MM, and MSA were involved in conceptualizing the study; RAB, KR, CATC, and MSA were responsible for the design of the study; KR was responsible for data acquisition; RAB, KR, TD, and JS participated in data analysis; RAB, KR, SEH, CATC, MM, MSA, TD, JS, HW, and LM were all involved in data interpretation, drafting, and critically reviewing the manuscript and also approved the manuscript for submission.

Conflicts of Interest

In addition to academic and hospital appointments, KR is President and Chief Science Officer of DGI Clinical, which in the last 5 years had contracts with pharma and device manufacturers (Baxter, Baxalta, Biogen, Shire, Hollister, Nutricia, Roche, and Otsuka) on individualized outcome measurement. In 2017, he attended an advisory board meeting with Lundbeck. Otherwise, any personal fees are for invited guest lectures, rounds and academic symposia, received directly from event organizers, for presentations on frailty. He is the Associate Director of the Canadian Consortium on Neurodegeneration in Aging, which is funded by the Canadian Institutes of Health Research (CNA-137794), with additional funding from the Alzheimer Society of Canada and several other charities, as well as from Pfizer Canada and Sanofi Canada (in phase 1, 2014-2019). He receives career support from the Dalhousie Medical Research Foundation as the Kathryn Allen Weldon Professor of Alzheimer Research and research support through grants from the Canadian Institutes of Health Research, the Canadian Frailty Network, the Nova Scotia Health Research Foundation, the Nova Scotia Health Authority Research Fund, and the Fountain Family Innovation Fund of the QEII Health Science Centre Foundation. RAB and MSA are employees of Otsuka Pharmaceutical Development and Commercialization Inc. MM is an employee of Otsuka Canada Pharmaceutical Inc. CATC is Chief Executive Officer of DGI Clinical. At the time of the study, HW, SEH, TD, and JS were employees of DGI Clinical Inc. LM received a postdoctoral fellowship from the Mitacs Elevate program, and her industrial cosponsor as part of this program is DGI Clinical Inc. Dementia Guide is a registered trademark owned by DementiaGuide Inc which operates as DGI Clinical.

Multimedia Appendix 1

Agitation descriptors.

DOCX File, 20KB

Multimedia Appendix 2

Dementia SymptomGuide symptom listing.

DOCX File, 20KB

Multimedia Appendix 3

Prevalence of neuropsychiatric symptom (NPS) and agitation increases with dementia stage, especially in Alzheimer disease. Proportion of participants who selected at least one NPS (A) or description of agitation (B), stratified by user-reported dementia type. Differences in proportions were tested in each dementia type by Pearson’s chi-squared test. Note that patients with MCI were not included in this analysis because they did not provide dementia diagnoses. Bonferroni adjusted P values.

PNG File, 25KB

Multimedia Appendix 4

Number of neuropsychiatric symptom (NPS) and agitation descriptors increases with dementia stage in Alzheimer disease, vascular and frontotemporal dementia. The number of NPS (A) and descriptors of agitation (B) tracked per participant in each stage, stratified by reported dementia type. Outliers were omitted for improved clarity. For each type of dementia, differences in number were tested by Kruskal-Wallis one-way ANOVA by ranks. Note that patients with mild cognitive impairment were not included in this analysis because they did not provide dementia diagnoses. Bonferroni adjusted P values.

PNG File, 21KB


  1. Livingston G, Sommerlad A, Orgeta V, Costafreda SG, Huntley J, Ames D, et al. Dementia prevention, intervention, and care. Lancet 2017 Dec 16;390(10113):2673-2674. [CrossRef] [Medline]
  2. Lyketsos CG, Carrillo MC, Ryan JM, Khachaturian AS, Trzepacz P, Amatniek J, et al. Neuropsychiatric symptoms in Alzheimer's disease. Alzheimers Dement 2011 Sep;7(5):532-539 [FREE Full text] [CrossRef] [Medline]
  3. Steinberg M, Shao H, Zandi P, Lyketsos CG, Welsh-Bohmer KA, Norton MC, Cache County Investigators. Point and 5-year period prevalence of neuropsychiatric symptoms in dementia: the Cache County Study. Int J Geriatr Psychiatry 2008 Feb;23(2):170-177 [FREE Full text] [CrossRef] [Medline]
  4. de Vugt ME, Riedijk SR, Aalten P, Tibben A, van Swieten JC, Verhey FRJ. Impact of behavioural problems on spousal caregivers: a comparison between Alzheimer's disease and frontotemporal dementia. Dement Geriatr Cogn Disord 2006;22(1):35-41. [CrossRef] [Medline]
  5. Steinberg M, Tschanz JT, Corcoran C, Steffens DC, Norton MC, Lyketsos CG, et al. The persistence of neuropsychiatric symptoms in dementia: the Cache County Study. Int J Geriatr Psychiatry 2004 Jan;19(1):19-26. [CrossRef] [Medline]
  6. Bergh S, Selbæk G. The prevalence and the course of neuropsychiatric symptoms in patients with dementia. Nor J Epidemiol 2012 Nov 29;22(2):-. [CrossRef]
  7. Petrovic M, Hurt C, Collins D, Burns A, Camus V, Liperoti R, et al. Clustering of behavioural and psychological symptoms in dementia (BPSD): a European Alzheimer's disease consortium (EADC) study. Acta Clin Belg 2007;62(6):426-432. [CrossRef] [Medline]
  8. Kales HC, Gitlin LN, Lyketsos CG, Detroit Expert Panel on Assessment Management of Neuropsychiatric Symptoms of Dementia. Management of neuropsychiatric symptoms of dementia in clinical settings: recommendations from a multidisciplinary expert panel. J Am Geriatr Soc 2014 Apr;62(4):762-769 [FREE Full text] [CrossRef] [Medline]
  9. Cummings J, Mintzer J, Brodaty H, Sano M, Banerjee S, Devanand DP, International Psychogeriatric Association. Agitation in cognitive disorders: International Psychogeriatric Association provisional consensus clinical and research definition. Int Psychogeriatr 2015 Jan;27(1):7-17 [FREE Full text] [CrossRef] [Medline]
  10. Cummings JL. The Neuropsychiatric Inventory: assessing psychopathology in dementia patients. Neurology 1997 May;48(5 Suppl 6):S10-S16. [CrossRef] [Medline]
  11. de Medeiros K, Robert P, Gauthier S, Stella F, Politis A, Leoutsakos J, et al. The Neuropsychiatric Inventory-Clinician rating scale (NPI-C): reliability and validity of a revised assessment of neuropsychiatric symptoms in dementia. Int Psychogeriatr 2010 Sep;22(6):984-994 [FREE Full text] [CrossRef] [Medline]
  12. Reuben DB, Tinetti ME. Goal-oriented patient care--an alternative health outcomes paradigm. N Engl J Med 2012 Mar 1;366(9):777-779. [CrossRef] [Medline]
  13. Gordon MF, Lenderking WR, Duhig A, Chandler J, Lundy JJ, Miller DS, Patient-Reported Outcome Consortium's Cognition Working Group. Development of a patient-reported outcome instrument to assess complex activities of daily living and interpersonal functioning in persons with mild cognitive impairment: The qualitative research phase. Alzheimers Dement 2016 Jan;12(1):75-84. [CrossRef] [Medline]
  14. Dementia Guide.   URL: [accessed 2019-05-13]
  15. Dillon WA, Prorok JC, Seitz DP. Content and quality of information provided on canadian dementia websites. Can Geriatr J 2013;16(1):6-15 [FREE Full text] [CrossRef] [Medline]
  16. Rockwood K, Zeng A, Leibman C, Mucha L, Mitnitski A. Validation of an informant-reported web-based data collection to assess dementia symptoms. J Med Internet Res 2012 Mar 12;14(2):e42 [FREE Full text] [CrossRef] [Medline]
  17. Rockwood K, Richard M, Leibman C, Mucha L, Mitnitski A. Staging dementia from symptom profiles on a care partner website. J Med Internet Res 2013 Aug 07;15(8):e145 [FREE Full text] [CrossRef] [Medline]
  18. Reeve E, Molin P, Hui A, Rockwood K. Exploration of verbal repetition in people with dementia using an online symptom-tracking tool. Int Psychogeriatr 2017 Dec;29(6):959-966 [FREE Full text] [CrossRef] [Medline]
  19. Rockwood K. An individualized approach to tracking and treating Alzheimer's disease. Clin Pharmacol Ther 2010 Oct;88(4):446-449. [CrossRef] [Medline]
  20. Siafarikas N, Selbaek G, Fladby T, Šaltytė Benth J, Auning E, Aarsland D. Frequency and subgroups of neuropsychiatric symptoms in mild cognitive impairment and different stages of dementia in Alzheimer's disease. Int Psychogeriatr 2018 Dec;30(1):103-113. [CrossRef] [Medline]
  21. Peters KR, Rockwood K, Black SE, Bouchard R, Gauthier S, Hogan D, et al. Characterizing neuropsychiatric symptoms in subjects referred to dementia clinics. Neurology 2006 Feb 28;66(4):523-528. [CrossRef] [Medline]
  22. Feldman H, Levy AR, Hsiung G, Peters KR, Donald A, Black SE, ACCORD Study Group. A Canadian cohort study of cognitive impairment and related dementias (ACCORD): study methods and baseline results. Neuroepidemiology 2003;22(5):265-274. [CrossRef] [Medline]
  23. Hongisto K, Hallikainen I, Selander T, Törmälehto S, Väätäinen S, Martikainen J, et al. Quality of Life in relation to neuropsychiatric symptoms in Alzheimer's disease: 5-year prospective ALSOVA cohort study. Int J Geriatr Psychiatry 2018 Jan;33(1):47-57. [CrossRef] [Medline]
  24. Torrisi M, De Cola MC, Marra A, De Luca R, Bramanti P, Calabrò RS. Neuropsychiatric symptoms in dementia may predict caregiver burden: a Sicilian exploratory study. Psychogeriatrics 2017 Mar;17(2):103-107 [FREE Full text] [CrossRef] [Medline]
  25. Rockwood K, Fay S, Hamilton L, Ross E, Moorhouse P. Good days and bad days in dementia: a qualitative chart review of variable symptom expression. Int Psychogeriatr 2014 Aug;26(8):1239-1246. [CrossRef] [Medline]

AD: Alzheimer disease
MCI: mild cognitive impairment
NPI: Neuropsychiatric Inventory
NPI-C: Neuropsychiatric Inventory-Clinician Rating Scale
NPI-Q: Neuropsychiatric Inventory-Questionnaire
NPS: neuropsychiatric symptom

Edited by G Eysenbach; submitted 15.01.19; peer-reviewed by Q Yuan, H McCarron, M O'Connell; comments to author 28.02.19; revised version received 09.04.19; accepted 26.04.19; published 28.06.19


©Kenneth Rockwood, Myrlene Sanon Aigbogun, Justin Stanley, Helen Wong, Taylor Dunn, Chère A T Chapman, Susan E Howlett, Maia Miguelez, Lisa McGarrigle, Ross A Baker. Originally published in the Journal of Medical Internet Research (, 28.06.2019.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.