Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/24730, first published .
Predicting Public Uptake of Digital Contact Tracing During the COVID-19 Pandemic: Results From a Nationwide Survey in Singapore

Predicting Public Uptake of Digital Contact Tracing During the COVID-19 Pandemic: Results From a Nationwide Survey in Singapore

Predicting Public Uptake of Digital Contact Tracing During the COVID-19 Pandemic: Results From a Nationwide Survey in Singapore

Original Paper

1Division of Social Sciences, Yale-NUS College, Singapore, Singapore

2Neuroscience and Behavioral Disorders Programme, Duke-NUS Medical School, Singapore, Singapore

Corresponding Author:

Jean CJ Liu, PhD

Division of Social Sciences

Yale-NUS College

28 College Avenue West #01-501

Singapore, 138533

Singapore

Phone: 65 6601 3694

Email: jeanliu@yale-nus.edu.sg


Background: During the COVID-19 pandemic, new digital solutions have been developed for infection control. In particular, contact tracing mobile apps provide a means for governments to manage both health and economic concerns. However, public reception of these apps is paramount to their success, and global uptake rates have been low.

Objective: In this study, we sought to identify the characteristics of individuals or factors potentially associated with voluntary downloads of a contact tracing mobile app in Singapore.

Methods: A cohort of 505 adults from the general community completed an online survey. As the primary outcome measure, participants were asked to indicate whether they had downloaded the contact tracing app TraceTogether introduced at the national level. The following were assessed as predictor variables: (1) participant demographics, (2) behavioral modifications on account of the pandemic, and (3) pandemic severity (the number of cases and lockdown status).

Results: Within our data set, the strongest predictor of the uptake of TraceTogether was the extent to which individuals had already adjusted their lifestyles because of the pandemic (z=13.56; P<.001). Network analyses revealed that uptake was most related to the following: using hand sanitizers, avoiding public transport, and preferring outdoor over indoor venues during the pandemic. However, demographic and situational characteristics were not significantly associated with app downloads.

Conclusions: Efforts to introduce contact tracing apps could capitalize on pandemic-related behavioral adjustments among individuals. Given that a large number of individuals is required to download contact tracing apps for contact tracing to be effective, further studies are required to understand how citizens respond to contact tracing apps.

Trial Registration: ClinicalTrials.gov NCT04468581, https://clinicaltrials.gov/ct2/show/NCT04468581

J Med Internet Res 2021;23(2):e24730

doi:10.2196/24730

Keywords



Background

In May 2020, Google and Apple released the Exposure Notification System, which is an application programming interface that logs the following: who a phone user has been in contact with, for how long, and at what distance [1]. This release came 2 months after COVID-19 was declared a pandemic [2], allowing governments to identify and isolate contacts of confirmed cases through a process known as “contact tracing” [3,4].

Less than a year after the first reported cases, over 33 million individuals have tested positive for COVID-19 worldwide and more than 1 million have died [5]. To limit disease spread, over half of the global population has been subjected to lockdowns involving school closures, workplace shutdowns, and movement restrictions [6]. Although these lockdowns are effective in tapering the epidemic curve [7], they are costly to the global economy and are unsustainable [8]. However, allowing the virus to spread unhindered could overwhelm the health care system and result in large-scale mortality [9,10].

To address both infection control and economic concerns, several countries have turned to contact tracing to keep the economy running [11,12]. Epidemiological modeling suggests that if (1) cases are effectively identified (through rigorous testing protocols), (2) contact tracing is comprehensive (identifying all possible exposure), and (3) contacts are quarantined in a timely manner, this strategy can curb the spread of the virus [4,11]. In an optimal scenario, 80% of contacts should be traced on the same day an individual tests positive [3,11].

Conventional Versus Digital Contact Tracing

Early during the pandemic (and in previous infectious disease outbreaks), contact tracing was manually performed [13]. Using a range of interview and surveillance techniques, a human contact tracer would typically identify an average of 36 contacts for each positive case [14]. Although this strategy allows for high levels of case detection when there are few cases [15], its labor-intensive format—requiring ~12 h of tracing for each positive case [16]—is difficult to scale up. Additionally, individuals who test positive may forget whom they have been in contact with, thus undermining the effectiveness of the process [11].

Considering these limitations of manual contact tracing, several mobile apps have been developed to facilitate automated contact tracing [17], for example, COVID Watch in the United States [18], COVIDSafe in Australia [19], and Corona-Warn-App in Germany [20]. These apps primarily track Bluetooth signals from phones in the vicinity [3], capturing contacts without the restraints of staffing or recall biases [4,11]. Further, phone apps can notify individuals swiftly after a contact tests positive, allowing them to be quickly isolated [3].

Understanding the Predictors of Uptake

Despite the potential of digital contact tracing, a recent meta-analysis concluded that owing to implementation barriers, manual contact tracing should remain the order of the day [12]. One major barrier pertains to the uptake of mobile apps. Several modelling studies have assessed parameters needed for the COVID-19 reproduction number (R0) to fall below 1 [3,11,21]. R0 refers to the number of infections spread from 1 positive case, and a value less than 1 indicates that the virus has been contained. For this to be achieved, contact tracing apps need to be downloaded by at least 56% of the population [21], which is much higher than the average rate of downloads globally (9%) [22].

To increase uptake, Qatar made it mandatory for residents to use the official contact tracing app [23]. Although this legislation led to high download rates (>90% [24]), the potential backlash from the public (eg, because of privacy concerns [25,26]) implies that few countries are likely to follow suit. Correspondingly, public health agencies would benefit from an understanding of the predictors of voluntary downloads [27], providing an empirical basis to nudge citizens and residents to voluntarily download contact tracing apps [28].

The Current Study

Given the urgent need to boost contact tracing apps, this study is the first to identify sociodemographic factors predicting voluntary uptake. Our study was conducted in Singapore, where the world’s first nationwide contact tracing app TraceTogether was launched in March 2020 [29]. TraceTogether uses a centralized approach adopted by several governments [19]; namely, randomly generated user IDs are generated and shared via Bluetooth with phones in close proximity [30]. When individuals test positive for COVID-19, they consent to add both their own user IDs and those of their contacts to a centralized database. This is used to identify matches, and exposure notifications are then sent from the server to close contacts [31,32]. (As an alternative model, a decentralized approach could be used where both matches and notifications are made through the user’s phone [33].)

As Singapore was the forerunner of this technology, the app has accrued 2.3 million users within 6 months, including approximately 40% of Singapore’s resident population or 50% of all smartphone users (considering a smartphone penetration rate of 82%) [34,35]. Correspondingly, our study represents a “best case scenario” for app uptake after several months have elapsed. In terms of the epidemic curve, our study was conducted between April and July 2020, as the country was in a lockdown (April to May 2020). This period witnessed a peak in daily COVID-19 cases (April: >1000/day or 175 per million population), which gradually tapered over time (July: >100/day or 17.5 per million population).


Study Design and Population

Between April 3 and July 17, 2020, we recruited 505 adults who met the following eligibility criteria: (1) at least 21 years of age and (2) had lived in Singapore for a minimum of 2 years. All participants responded to online advertisements. Within the constraints of online sampling owing to the pandemic, we strove to obtain a representative sample by placing advertisements in a wide range of online community groups (eg, Facebook or WhatsApp groups among individuals in residential estates, universities, and workplaces) and by using paid online advertisements targeting the broad spectrum of Singapore residents.

Prior to study enrolment, participants provided informed consent in accordance with a protocol approved by the Yale-NUS College Ethics Review Committee (#2020-CERC-001; ClinicalTrials.gov ID NCT04468581). They then completed a 10-min online survey hosted on the platform Qualtrics [36]. Data were collected in accordance with the second phase of a larger study tracking COVID-19 responses, and findings from the first phase have been described previously [37,38].

Outcome Variable: Use of TraceTogether

As the primary outcome variable, participants were asked to indicate whether they had downloaded the government’s contact tracing app TraceTogether (binary variables: 1=they had, 0=they had not).

Predictors

Demographics and Situational Variables

As predictors of TraceTogether usage, participants then reported the following demographic data: age, gender, citizenship, ethnicity, marital status, education level, house type (a proxy of socioeconomic status in Singapore), and household size. Based on the survey timestamp, we also included the following as predictors: (1) the total number of cases in Singapore to date, (2) whether the nation was in a lockdown at the time of participation (0=no, 1=yes), and (3) a self-reported measure of confidence the government could control COVID-19 spread (4-point scale: 1=“not confident at all,” 4=“very confident”).

Other Behavioral Modifications

As a basis of comparison, participants were also asked to identify which of 18 other behavioral modifications they had made as a result of the pandemic (apart from downloading TraceTogether). Specifically, participants were asked whether they had (1) washed their hands more frequently, (2) used hand sanitizers, (3) worn a mask in public voluntarily (before a law was passed), (4) avoided taking public transport, (5) stayed home more than usual, (6) avoided crowded places, (7) chosen outdoor over indoor venues, (8) missed or postponed social events, (9) changed their travel plans voluntarily, (10) reduced physical contact with others (eg, by not shaking hands), (11) avoided visiting hospitals or other health care settings, (12) avoided visiting places where COVID-19 cases had been reported, (13) maintained distance from people suspected of recent contact with a COVID-19–positive individual, (14) maintained distance from people who might have recently traveled to countries with an outbreak, (15) maintained distance from people with flu-like symptoms, (16) relied more on online shopping (eg, for groceries), (17) stocked up on more household supplies and groceries than usual, or (18) taken their children out of school (for each item, 0=the measure was not taken, 1=the measure was taken). These values were then summed to compute an aggregated measure of behavioral change (out of 18), and were included as a predictor to assess whether contact tracing usage was associated with conventional behavioral modifications one undertakes during an epidemic [39,40].

As part of the survey, participants were also asked to specify any other behavioral modifications (n=9, 1.8%) or no other behavioral modification (n=2, 0.4%). However, these data were excluded from the statistical analyses owing to the low base rate of affirmative responses.

Data Analysis Plan

For primary analysis, binary logistic regression was used to identify predictors TraceTogether uptake. In the first model (model 1), participants' demographics were included as predictors (age, citizenship, gender, marital status, education level, ethnicity, household type, and household size). Citizenship (base=others), gender (base=female), marital status (base=single), and ethnicity (base=Chinese) were coded as dummy variables. In the second model (model 2), we repeated the first model with the inclusion of situational variables (log-transformed total number of COVID-19 cases to date and lockdown status). Finally, in the third model (model 3), we repeated the second model with the inclusion of the total number of behavioral modifications as a predictor. All data were analyzed using SPSS (version 23, IBM Corp) and R (version 3.6.0, The R Foundation), with the type 1 familywise error rate controlled at α=.05 via Bonferroni correction (Bonferroni-adjusted α=.003 [.05/17 predictors]).


Demographics of the Sample

Table 1 shows the wide range of demographic characteristics of our study cohort (N=505). Compared to the resident population, the sample was matched in the following characteristics: ethnic composition, household size, and housing type (a proxy of socioeconomic status in Singapore) (≤10% difference). However, compared to the resident population, the present participants were more likely to be female (n=313, 62.0% vs 51.1%), single or dating (n=234, 46.4% vs 31.6%), to have a higher level of education or no tertiary education (n=65, 12.9% vs 51.7%), and to be citizens of Singapore or of other countries (n=456, 90.3% vs 61.4%).

Table 1. Baseline characteristics of survey respondents (N=505).
VariableValue
Age (years), mean (SD)37.82 (11.31)
Number of behavioral modifications, mean (SD)9.81 (3.82)
Gender, n (%)

Female313 (62.0)

Male192 (38.0)
Citizenship, n (%)

Singaporean456 (90.3)

Others49 (9.7)
Highest education, n (%)

No formal education2 (0.4)

Primary school2 (0.4)

Secondary school23 (4.6)

Junior college26 (5.1)

Institution of Technical Education12 (2.4)

Polytechnic (diploma)88 (17.4)

University (degree)265 (52.5)

Postgraduate (masters/PhD)87 (17.2)
Ethnicity, n (%)

Chinese412 (81.6)

Malay38 (7.5)

Indian32 (6.3)

Eurasian15 (3.0)

Others8 (1.6)
Marital status, n (%)

Single170 (33.7)

Dating64 (12.7)

Married241 (47.7)

Widowed/separated/divorced30 (5.9)
Household type, n (%)

HDBa flat: 1-2 rooms14 (2.8)

HDB flat: 3 rooms50 (9.9)

HDB flat: 4 rooms132 (26.1)

HDB flat: 5 rooms or executive flats149 (29.5)

Condominium or private apartments122 (24.2)

Landed property38 (7.5)
Household size, n (%)

126 (5.1)

288 (17.4)

3119 (23.6)

4133 (26.3)

5+139 (27.5)

aHDB: Housing & Development Board.

Binary Logistic Regression

Of the 505 participants, 274 (54.3%; 95% CI 49.8%-58.7%) reported having downloaded TraceTogether. The download rate in this sample matches that of smartphone users in the resident population [34], and Table 2 describes the characteristics of users and nonusers.

Table 3 shows parameter estimates from logistic regression analyses of the predictors of TraceTogether uptake. No demographic or situational variable significantly predicted downloads (models 1 and 2). After controlling for these variables, the number of behavioral modifications emerged as a significant predictor (model 3); that is, with each unit increase in the number of behavioral modifications adopted, participants were 1.10 times more likely to download TraceTogether (z=13.56; P<.001).

Table 2. Characteristics of the users of TraceTogether (N=505).
VariableTraceTogether usage

Users (n=274)Nonusers (n=231)
Age (years), mean (SD)38.57 (11.57)36.95 (10.96)
Household type, mean (SD)3.92 (1.18)3.76 (1.21)
Household size, mean (SD)3.54 (1.26)3.53 (1.15)
Number of behavioral modifications, mean (SD)10.33 (3.83)8.96 (3.65)
Gender, n (%)


Female177 (64.6)136 (58.9)

Male97 (35.4)95 (41.1)
Citizenship, n (%)


Singaporean240 (87.6)216 (93.5)

Others34 (12.4)15 (6.5)
Highest education, n (%)


No formal education1 (0.4)1 (0.4)

Primary school1 (0.4)1 (0.4)

Secondary school15 (5.5)8 (3.5)

Junior college14 (5.1)12 (5.2)

Institution of Technical Education8 (2.9)4 (1.7)

Polytechnic (diploma)41 (15.0)47 (20.3)

University (degree)136 (49.6)129 (55.8)

Postgraduate (masters/PhD)58 (21.2)29 (12.6)
Ethnicity, n (%)


Chinese218 (79.6)194 (84.0)

Malay20 (7.3)18 (7.8)

Indian19 (6.9)13 (5.6)

Eurasian13 (4.7)2 (0.9)

Others4 (1.5)4 (1.7)
Marital status, n (%)


Single85 (31.0)85 (36.8)

Dating38 (13.9)26 (11.3)

Married133 (48.5)108 (46.8)

Widowed/separated/divorced18 (6.6)12 (5.2)
Table 3. Logistic regression models of predictors of the uptake of TraceTogether (dependent variable=downloaded TraceTogether).
VariableModel 1: demographicsaModel 2: demographics and situational variablesModel 3: demographics, situational variables, and behavioral modifications

Odds ratio (95% CI)P valueOdds ratio (95% CI)P valueOdds ratio (95% CI)P value
Age (years)1.018 (1.00-1.04).091.020 (1.00-1.04).061.021 (1.00-1.04).05
Gender (base=female)0.771 (0.53-1.12).170.799 (0.55-1.17).250.904 (0.61-1.34).61
Citizenship (base=others)0.546 (0.26-1.14).110.597 (0.28-1.13).170.651 (0.30-1.39).27
Household type1.082 (0.92-1.27).761.056 (0.90-1.25).521.011 (0.85-1.20).90
Household size1.042 (0.89-1.23).621.028 (0.87-1.21).741.036 (0.88-1.22).67
Highest education1.032 (0.89-1.19).671.029 (0.89-1.25).700.993 (0.85-1.16).92
Ethnicity (base=Chinese)

Malay1.057 (0.53-2.11).881.050 (0.52-2.14).890.980 (0.48-2.02).96

Indian1.112 (0.52-2.37).780.984 (0.45-2.13).970.928 (0.43-2.03).85

Eurasian3.454 (0.70-17.02).133.475 (0.70-17.37).133.402 (0.66-17.42).14

Others0.720 (0.16-3.17).660.724 (0.16-3.29).680.851 (0.18-4.037).84
Marital status (base=single)

Dating1.505 (0.82-2.76).191.555 (0.84-2.90).161.392 (0.74-2.63).31

Married0.968 (0.62-1.52).890.974 (0.61-1.55).910.900 (0.56-1.44).66

Widowed/separated/divorced1.146 (0.47-2.79).761.155 (0.47-2.84).751.034 (0.41-2.59).94
Local COVID-19 cases to date (log)N/AbN/A0.774 (0.50-1.21).260.752 (0.48-1.18).22
Lockdown (base=no lockdown)N/AN/A0.561 (0.30-1.04).070.599 (0.32-1.12).11
Confidence in the governmentN/AN/A1.372 (1.05-1.79).021.363 (1.04-1.79).03
Number of behavioral modificationsN/AN/AN/AN/A1.102 (1.05-1.16)<.001c

aModel 1: Overall percentage of users correctly classified-56.6%, Nagelkerke R2-0.048; Model 2: Overall percentage of users correctly classified-58.2%, Nagelkerke R2-0.068; Model 3: Overall percentage of users correctly classified-60.2%, Nagelkerke R2-0.103.

bN/A: not applicable.

cP<.003 (following Bonferroni corrections).

Post Hoc Network Analysis

In the logistic regression analyses, TraceTogether downloads were predicted from the number of behavioral modifications because of the pandemic. To understand this association better, we conducted further exploratory analyses.

As shown in Figure 1, the majority of participants had modified their behaviors to curb the spread of COVID-19. The use of TraceTogether ranked 10th in the frequency of adoption (274/505, 54.3%), similar to the frequency of voluntary mask wearing (n=276, 54.7%).

Figure 1. Self-reported behavioral modifications , other than downloading TraceTogether, among the study participants undertaken in response to the COVID-19 outbreak in Singapore. Error bars=95% CI. Numbers in brackets represent the total number of respondents who reported the behavioral change.
View this figure

A corollary question is how TraceTogether usage is associated with other health protective behaviors; that is, how likely were people to download TraceTogether if they had modified their behavior in other ways? To address this question, we conducted network analyses by estimating a mixed graphical model (MGM) with the R package mgm [41]. MGM constructs weighted and undirected networks where the pathways among behaviors represent conditionally dependent associations, having controlled for the other associations in the network. Similar to partial correlations, each association (or “edge”) is the average regression coefficient of two nodes. To avoid false-positive findings, we set small associations to 0 for the main models.

As shown in Figure 2, TraceTogether usage was associated with hand sanitizer use, avoidance of public transport, and a preference for outdoor vs indoor venues. The adjacency matrix (ie, numerical values for the average regression coefficient between two nodes) for Figure 2 is presented in Multimedia Appendix 1.

For sensitivity analysis, we performed logistic regression analysis using TraceTogether downloads as the dependent variable, and 18 other behavioral modifications (see Methods) as the predictors. Our conclusions did not change, as indicated in Multimedia Appendix 2.

Figure 2. A model depicting how TraceTogether usage relates to other pandemic-related behavioral changes. Line thickness represents the strength of an association.
View this figure

As lockdowns owing to COVID-19 ease globally, digital contact tracing will play an increasingly critical role in managing the epidemic curve. However, this requires the public to actively download a contact tracing app—a step that has proven elusive among public health agencies worldwide [12]. This study is the first to examine the demographic, behavioral, and situational factors potentially predicting the voluntary use of TraceTogether.

Behavioral Modifications

As our primary outcome, we observed that the number of behavioral modifications significantly predicted the use of TraceTogether. In other words, a person who had already changed his/her lifestyle on account of the pandemic was also likely to download a contact tracing app. Network analyses revealed that downloads clustered with (1) using hand sanitizers, (2) avoiding public transport, and (3) preferring outdoor to indoor venues. This finding may suggest that public health campaigns could capitalize on other behavioral modifications when seeking to promote app downloads, for example, by printing information regarding a contact tracing app on the packaging of hand sanitizers or by framing the use of digital contact tracing as a preventive behavior. Policy makers might also expect app download rates to track behavioral modifications, anticipating, for example, higher download rates when the public fears an increase in COVID-19 cases (leading to more behavioral modifications) [42].

Theoretically, our findings further corroborate those of previous studies on how individuals change their behaviors during a pandemic. Based on prior outbreaks, a taxonomy of modifications had been identified whereby (1) “avoidant behaviors” are measures taken to avoid contact with potential carriers (eg, avoiding crowded places), while (2) “prevention behaviors” are those associated with maintaining hygiene (eg, regular hand washing) [42]. Extrapolating to the technological realm, our findings suggest that the use of a contact tracing app cuts across this taxonomy, since downloads were associated with both avoidant (avoiding public transport and preferring outdoor venues) and prevention behaviors (using hand sanitizers). Moving forward, we urge further studies to revise these classification systems in light of new technological developments.

Demographic and Situational Factors

Apart from behavioral modifications, it is notable that no demographic (eg, age, gender, etc) or situational variable (eg, number of COVID-19 cases and lockdown status) significantly predicted TraceTogether uptake. Prior to our study, it would have been conceivable that only a subset of the population would download a contact tracing app (eg, demographic groups based on gender, educational level, or age) [27,38,43]. By contrast, our findings highlight how uptake of digital contact tracing apps cuts across demographic groups.

While the lack of significant associations may be counterintuitive, a recent study reported similar results when predicting COVID-19–related behavioral modifications [42]. In a multinational survey, Harper et al [42] similarly observed that demographic and situational variables were unrelated to behavioral modifications owing to the pandemic. Since behavioral modifications predicted the use of a digital contact tracing app in our study, it seems reasonable to observe an analogous pattern here; that is, our results are unlikely to be based on false-negative outcomes.

As public health agencies develop strategies to promote downloads for contact tracing apps, the pattern of our findings may in turn suggest that demographic-specific messages are not needed. This is encouraging because the behavioral sciences offer widespread measures to “nudge” the general population [44]. In this case, the general public simply needs a one-off nudge to download the contact tracing app, after which the app functions independently in the background. Thus, if governments can nudge users in this first step (eg, by introducing incentives to download or by introducing contact tracing as an opt-out feature of existing government apps), it may be possible to attain the download rates necessary for contact tracing to be effective. Simultaneously, we urge further studies on the acceptance of such strategies; considering public concerns regarding privacy [25,26], any widespread intervention would need to be introduced cautiously.

Limitations

Our study has several limitations of note. As the first study of its kind, we made several choices at the exclusion of others. First, we opted for a cross-sectional design that precludes strong conclusions regarding causality. Second, we included an online sample to minimize person-to-person contact during the pandemic. Although we sampled individuals from a wide array of demographic groups, respondents were not representative of the general nationwide population; this may have deterred the establishment of potential associations among variables (eg, by including a high proportion of educated participants). Third, our survey relied on participants’ self-reported use of a contact tracing app. Although our download rate is similar to that of the general population, further studies may seek to verify actual usage (eg, by incorporating survey questions in a contact tracing app). Fourth, our survey was not intended to measure every aspect of TraceTogether usage, and there were several notable omissions (eg, reasons why individuals chose to use or not use the app, phone ownership, and usage-related questions). Indeed, our model metrics (eg, small Nagelkerke R2) indicate small effect sizes, highlighting the need for further studies to include a more comprehensive set of variables that may account for app downloads. Finally, we examined TraceTogether—an app with a centralized contact tracing protocol. Future studies are required to assess whether our findings extend to apps with decentralized protocols or to other forms of digital contact tracing that do not rely on mobile apps (eg, public acceptance of cloud-based contact in South Korea).

Conclusion

In conclusion, the potential contribution of digital technology to pandemic management is receiving increasing attention. What remains unclear, however, is how this technology is received and how best to promote its uptake. Focusing on contact tracing, this study shows that downloads of a mobile app was best predicted from the adoption of other infection control measures such as increased hand hygiene. In other words, the introduction of digital contact tracing is not merely a call to “trace together” but rather to “modify together,” to use contact tracing apps as part of the broader spectrum of behavioral modifications during a pandemic.

Acknowledgments

This research was funded by a grant awarded to JCJL from the JY Pillay Global Asia Programme (grant number: IG20-SG002).

Conflicts of Interest

None declared.

Multimedia Appendix 1

Adjacency matrix.

PDF File (Adobe PDF File), 35 KB

Multimedia Appendix 2

Sensitivity analysis.

PDF File (Adobe PDF File), 32 KB

References

  1. Etherington D. Apple and Google launch exposure notification API, enabling public health authorities to release apps. TechCrunch. 2020 May 20.   URL: http:/​/techcrunch.​com/​2020/​05/​20/​apple-and-google-launch-exposure-notification-api-enabling-public-health-authorities-to-release-apps/​ [accessed 2020-09-30]
  2. WHO Coronavirus Disease (COVID-19) Dashboard. World Health Organization.   URL: https://covid19.who.int/ [accessed 2020-09-30]
  3. Ferretti L, Wymant C, Kendall M, Zhao L, Nurtay A, Abeler-Dörner L, et al. Quantifying SARS-CoV-2 transmission suggests epidemic control with digital contact tracing. Science 2020 Mar 31:eabb6936. [CrossRef] [Medline]
  4. Hellewell J, Abbott S, Gimma A, Bosse NI, Jarvis CI, Russell TW, Centre for the Mathematical Modelling of Infectious Diseases COVID-19 Working Group, et al. Feasibility of controlling COVID-19 outbreaks by isolation of cases and contacts. Lancet Glob Health 2020 Apr;8(4):e488-e496 [FREE Full text] [CrossRef] [Medline]
  5. WHO Director-General's opening remarks at the media briefing on COVID-19 - 11 March 2020. World Health Organization. 2020 Mar 11.   URL: https:/​/www.​who.int/​dg/​speeches/​detail/​who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---11-march-2020 [accessed 2020-08-06]
  6. Blanchard O, Philippon T, Pisani-Ferry J. A new policy toolkit is needed as countries exit COVID-19 lockdowns. Bruegel. 2020 Jun.   URL: https://www.bruegel.org/wp-content/uploads/2020/06/PC-12-2020-230620.pdf [accessed 2020-08-06]
  7. Lau H, Khosrawipour V, Kocbach P, Mikolajczyk A, Schubert J, Bania J, et al. The positive impact of lockdown in Wuhan on containing the COVID-19 outbreak in China. J Travel Med 2020 May 18;27(3):taaa037 [FREE Full text] [CrossRef] [Medline]
  8. Fernandes N. Economic Effects of Coronavirus Outbreak (COVID-19) on the World Economy. SSRN Journal 2020 Mar 23. [CrossRef]
  9. Betsch C, Wieler LH, Habersaat K, COSMO group. Monitoring behavioural insights related to COVID-19. Lancet 2020 Apr 18;395(10232):1255-1256 [FREE Full text] [CrossRef] [Medline]
  10. Legido-Quigley H, Asgari N, Teo YY, Leung GM, Oshitani H, Fukuda K, et al. Are high-performing health systems resilient against the COVID-19 epidemic? Lancet 2020 Mar 14;395(10227):848-850 [FREE Full text] [CrossRef] [Medline]
  11. Kretzschmar ME, Rozhnova G, Bootsma MCJ, van Boven M, van de Wijgert JHHM, Bonten MJM. Impact of delays on effectiveness of contact tracing strategies for COVID-19: a modelling study. Lancet Public Health 2020 Aug;5(8):e452-e459 [FREE Full text] [CrossRef] [Medline]
  12. Braithwaite I, Callender T, Bullock M, Aldridge RW. Automated and partly automated contact tracing: a systematic review to inform the control of COVID-19. Lancet Digit Health 2020 Nov;2(11):e607-e621 [FREE Full text] [CrossRef] [Medline]
  13. Chen K, Li C, Lin J, Chen W, Lin H, Wu H. A feasible method to enhance and maintain the health of elderly living in long-term care facilities through long-term, simplified tai chi exercises. J Nurs Res 2007 Jun;15(2):156-164. [CrossRef] [Medline]
  14. Keeling MJ, Hollingsworth TD, Read JM. Efficacy of contact tracing for the containment of the 2019 novel coronavirus (COVID-19). J Epidemiol Community Health 2020 Oct;74(10):861-866 [FREE Full text] [CrossRef] [Medline]
  15. Niehus R, De Salazar PM, Taylor AR, Lipsitch M. Quantifying bias of COVID-19 prevalence and severity estimates in Wuhan, China that depend on reported cases in international travelers. medRxiv. Preprint posted online February 18, 2020 [FREE Full text] [CrossRef] [Medline]
  16. Rubin R. Building an “Army of Disease Detectives” to Trace COVID-19 Contacts. JAMA 2020 May 21:2357-2360. [CrossRef] [Medline]
  17. LI J, Guo X. Global Deployment Mappings and Challenges of Contact-tracing Apps for COVID-19. SSRN Journal 2020 May 26. [CrossRef]
  18. Morgan AU, Balachandran M, Do D, Lam D, Parambath A, Chaiyachati KH, et al. Remote Monitoring of Patients with Covid-19: Design, implementation, and outcomes of the first 3,000 patients in COVID Watch. NEJM Catalyst 2020 Jul 21;1(4). [CrossRef]
  19. COVIDSafe app. Australian Government: Department of Health.   URL: https://www.health.gov.au/resources/apps-and-tools/covidsafe-app [accessed 2020-09-30]
  20. Reelfs J, Hohlfeld O, Poese I. Corona-Warn-App: Tracing the start of the official COVID-19 exposure notification app for Germany. arXiv csCY Preprint posted online July 25, 2020 [FREE Full text]
  21. Hinch R, Probert W, Nurtay A, Kendall M, Wymant C, Hall M, et al. Effective configurations of a digital contact tracing app: A report to NHSX. 2020 May.   URL: https:/​/cdn.​theconversation.com/​static_files/​files/​1009/​Report_-_Effective_App_Configurations.​pdf?1587531217 [accessed 2020-08-06]
  22. Chan S. COVID-19 Contact tracing apps reach 9% adoption In most populous countries. SensorTower. 2020 Jul 14.   URL: https://sensortower.com/blog/contact-tracing-app-adoption [accessed 2020-09-30]
  23. Qatar makes COVID-19 app mandatory, experts question efficiency. Al Jazeera. 2020 May 26.   URL: https:/​/www.​aljazeera.com/​news/​2020/​05/​qatar-covid-19-app-mandatory-experts-question-efficiency-200524201502130.​html [accessed 2020-09-30]
  24. Rivero N. Global contact tracing app downloads lag behind effective levels. Quartz. 2020 Jul 15.   URL: https://qz.com/1880457/global-contact-tracing-app-downloads-lag-behind-effective-levels/ [accessed 2020-10-01]
  25. Ienca M, Vayena E. On the responsible use of digital data to tackle the COVID-19 pandemic. Nat Med 2020 Apr;26(4):463-464 [FREE Full text] [CrossRef] [Medline]
  26. Anderson M, Auxier B. Most Americans don’t think cellphone tracking will help limit COVID-19, are divided on whether it’s acceptable. Pew Research Center. 2020 Apr 16.   URL: https:/​/www.​pewresearch.org/​fact-tank/​2020/​04/​16/​most-americans-dont-think-cellphone-tracking-will-help-limit-covid-19-are-divided-on-whether-its-acceptable/​ [accessed 2020-09-30]
  27. Thorneloe R, Epton T, Fynn W, Daly M, Stanulewicz N, Kassianos A, et al. Scoping review of mobile phone app uptake and engagement to inform digital contact tracing tools for COVID-19. PsyArXiv Preprint posted online May 07, 2020. [CrossRef]
  28. Altmann S, Milsom L, Zillessen H, Blasone R, Gerdon F, Bach R, et al. Acceptability of app-based contact tracing for COVID-19: Cross-country survey evidence. JMIR Mhealth Uhealth 2020 Jul 24:e19857 [FREE Full text] [CrossRef] [Medline]
  29. How Singapore’s Covid-19 contact tracing app drew inspiration from a US high school project. Reuters. 2020 Jun 10.   URL: https:/​/www.​scmp.com/​news/​asia/​southeast-asia/​article/​3088389/​how-singapores-covid-19-contact-tracing-app-drew [accessed 2020-09-30]
  30. Bluetooth tracking and COVID-19: A tech primer. Privacy International. 2020 Mar 31.   URL: https://www.privacyinternational.org/explainer/3536/bluetooth-tracking-and-covid-19-tech-primer [accessed 2020-10-02]
  31. Bay J, Kek J, Tan A, Hau C, Yongquan L, Tan J, et al. BlueTrace: A privacy-preserving protocol for community-driven contact tracing across borders. Government Technology Agency-Singapore Tech Rep. 2020.   URL: https://pdfs.semanticscholar.org/b460/fbaf2041cec41ee1266fcf1b60d3683d137b.pdf [accessed 2020-08-06]
  32. Ferretti L, Wymant C, Kendall M, Zhao L, Nurtay A, Abeler-Dörner L, et al. Digital contact tracing: comparing the capabilities of centralised and decentralised data architectures to effectively suppress the COVID-19 epidemic whilst maximising freedom of movement and maintaining privacy. University of Oxford. 2020 May 07.   URL: https://tinyurl.com/y4bjggke [accessed 2020-08-06]
  33. Cho H, Ippolito D, Yu YW. Contact tracing mobile apps for COVID-19: Privacy considerations and related trade-offs. arXiv csCR. e-Print posted online on March 25, 2020 2020 Mar 25 [FREE Full text]
  34. TraceTogether. Government of Singapore. 2020 Jul 20.   URL: https://www.tracetogether.gov.sg [accessed 2020-08-06]
  35. Smartphone penetration rate as share of the population in Singapore from 2015 to 2025. Statista. 2020 Jul 30.   URL: https://www.statista.com/statistics/625441/smartphone-user-penetration-in-singapore/ [accessed 2020-12-01]
  36. Liu J. COVID-19 in Singapore: A nation-wide survey. OFSH. 2020 Jun 24.   URL: https://osf.io/pv3bj/ [accessed 2020-10-01]
  37. Liu JCJ, Tong EMW. The Relation Between Official WhatsApp-Distributed COVID-19 News Exposure and Psychological Symptoms: Cross-Sectional Survey Study. J Med Internet Res 2020;22(9):e22142 [FREE Full text] [CrossRef] [Medline]
  38. Long V, Liu J. Behavioral changes during the COVID-19 pandemic: Results of a national survey in Singapore. medXriv Preprint posted online on August 07, 2020. [CrossRef]
  39. Bali S, Stewart KA, Pate MA. Long shadow of fear in an epidemic: fearonomic effects of Ebola on the private sector in Nigeria. BMJ Glob Health 2016;1(3):e000111 [FREE Full text] [CrossRef] [Medline]
  40. Vinck P, Pham PN, Bindu KK, Bedford J, Nilles EJ. Institutional trust and misinformation in the response to the 2018-19 Ebola outbreak in North Kivu, DR Congo: a population-based survey. Lancet Infect Dis 2019 May;19(5):529-536. [CrossRef] [Medline]
  41. Haslbeck JMB, Waldorp LJ. mgm: Estimating Time-Varying Mixed Graphical Models in High-Dimensional Data. arXiv Preprint posted online October 23, 2015. [CrossRef]
  42. Harper CA, Satchell LP, Fido D, Latzman RD. Functional Fear Predicts Public Health Compliance in the COVID-19 Pandemic. Int J Ment Health Addict 2020 Apr 27:1-14 [FREE Full text] [CrossRef] [Medline]
  43. Karekla M, Kasinopoulos O, Neto DD, Ebert DD, Van Daele T, Nordgreen T, et al. Best Practices and Recommendations for Digital Interventions to Improve Engagement and Adherence in Chronic Illness Sufferers. European Psychologist 2019 Jan;24(1):49-67. [CrossRef]
  44. Reisch LA, Sunstein CR. Do Europeans Like Nudges? SSRN Journal 2020 Jan 26;11(4):310-325. [CrossRef]


MGM: mixed graphical model
R0: reproduction number


Edited by G Eysenbach; submitted 02.10.20; peer-reviewed by T McCall, J Li, N Guo; comments to author 03.11.20; revised version received 01.12.20; accepted 15.01.21; published 03.02.21

Copyright

©Young Ern Saw, Edina Yi-Qin Tan, Jessica Shijia Liu, Jean CJ Liu. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 03.02.2021.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.