Background: Although the use of patient-generated data (PGD) in the optimization of patient care shows great promise, little is known about whether patients who track their PGD necessarily share the data with their clinicians. Meanwhile, health literacy—an important construct that captures an individual’s ability to manage their health and to engage with their health care providers—has often been neglected in prior studies focused on PGD tracking and sharing. To leverage the full potential of PGD, it is necessary to bridge the gap between patients’ data tracking and data sharing practices by first understanding the interrelationships between these practices and the factors contributing to these practices.
Objective: This study aims to systematically examine the interrelationships between PGD tracking practices, data sharing practices, and health literacy among individual patients.
Methods: We surveyed 109 patients at the time they met with a clinician at a university health center, unlike prior research that often examined patients’ retrospective experience after some time had passed since their clinic visit. The survey consisted of 39 questions asking patients about their PGD tracking and sharing practices based on their current clinical encounter. The survey also contained questions related to the participants’ health literacy. All the participants completed the survey on a tablet device. The onsite survey study enabled us to collect ecologically valid data based on patients’ immediate experiences situated within their clinic visit.
Results: We found no evidence that tracking PGD was related to self-reports of having sufficient information to manage one’s health; however, the number of data types participants tracked positively related to their self-assessed ability to actively engage with health care providers. Participants’ data tracking practices and their health literacy did not relate to their data sharing practices; however, their ability to engage with health care providers positively related to their willingness to share their data with clinicians in the future. Participants reported several benefits of, and barriers to, sharing their PGD with clinicians.
Conclusions: Although tracking PGD could help patients better engage with health care providers, it may not provide patients with sufficient information to manage their health. The gaps between tracking and sharing PGD with health care providers call for efforts to inform patients of how their data relate to their health and to facilitate efficient clinician-patient communication. To realize the full potential of PGD and to promote individuals’ health literacy, empowering patients to effectively track and share their PGD is important—both technologies and health care providers can play important roles.
The prevalence of mobile health apps and wearable devices has enabled patients to track a variety of patient-generated data (PGD) outside the clinic, ranging from biometrics (eg, blood pressure, heart rate) to their everyday activities (eg, exercise, sleep) . Researchers have found that PGD are a valuable source of information for clinicians because they can use the data for diagnosis and treatment [ - ]. Data-driven consultation has the potential to optimize patient care by leveraging effective PGD sharing [ , ]. However, little is known about whether and to what extent patients who track their PGD actually share their data with clinicians in the clinic, which is critical to fully leveraging the potential of PGD to improve health outcomes.
In prior studies that have examined how patients leverage PGD, a key related concept that has often been neglected is health literacy—the cognitive and social skills to gain access to, understand, and use health information in ways that maintain good health . As a multidimensional concept, health literacy characterizes not only an individual’s ability to read and understand health information but also the ability to manage one’s health and engage with health care providers [ - ]. Although health literacy has been studied in public health for decades, this concept has rarely been examined within the context of studies focusing on PGD tracking and sharing.
Previous studies have found that through self-tracking of their PGD, patients can develop the skills necessary to interpret health information  and to communicate with clinicians [ ]. In this light, we aim to understand whether patients’ self-tracking practices, as a way to help them gain knowledge about their health [ - ], relate to their health literacy and whether patients’ health literacy, as an important skill to fully engage with health care providers [ , , ], relates to patients’ practice of sharing their PGD with clinicians.
According to previous research, PGD is defined as “health-related data created, recorded, or gathered by patients (or by family members or other caregivers) to help address their health concerns” [, ]. These data can be collected through automated tracking devices (eg, mobile phones, wearable devices), manual journaling, questionnaires, clinic tests (eg, laboratory results), and tests ordered by patients (eg, 23andMe [ ]). Researchers have found that tracking PGD is an effective means for personal health management [ , , ]. For example, people with diabetes who monitor their glucose levels go through several learning phases to develop an understanding of how their daily activities affect their health [ ]. Similarly, people with irritable bowel syndrome (IBS), who track their food and symptom data, conduct self-experiments to identify the types of food that trigger their IBS symptoms [ ].
Despite its benefits, PGD tracking can be detrimental under some circumstances. For example, tracking calorie intake can exacerbate negative thoughts and behaviors of patients with eating disorders . In this case, clinicians often recommend to such patients that they manage their eating practices by tracking their feelings and reflections about food and by focusing on the positive sides [ , ]. Therefore, when encouraging patients to track and share their PGD, it is important to tailor the tracking plans of individuals to their tracking needs and their specific health conditions.
This study was conducted in the clinic where patients were likely to share their PGD with clinicians in person . From the perspective of clinicians, PGD can support in the diagnosis and delivery of personalized treatment [ , , ]. For example, sleep data are used by clinicians conducting cognitive behavioral therapy for insomnia to inform sleep prescriptions [ ]. Similarly, food intake data are an important source for diagnosing and treating dietary problems [ ]. Although many clinicians acknowledge that having patients share their PGD can improve the quality of care that they can provide [ , , , - ], their views on sharing PGD are not always positive because of their increased liability, lack of time, doubts regarding data accuracy, integration difficulties, and security concerns [ , - ].
Patients’ preferences for sharing PGD also vary: some patients consistently share their data to keep their clinicians informed , some resist sharing their data because of privacy concerns or fear of being judged [ ], and others share their PGD, but only to the extent to which they trust their clinicians [ , ]. Although researchers have examined patients’ data tracking and sharing practices, we lack empirical data on whether and to what extent patients actually share their self-tracking data during clinical visits and the factors influencing their data sharing practices.
Health literacy has been declared a national priority in the United States . Previous studies have found that patients with higher health literacy are more likely to be informed about their health [ ], to engage in healthy behaviors [ , ], and to feel comfortable while communicating with health care professionals [ , ]. Therefore, health literacy has been used as a critical measure for evaluating the effectiveness of health care technologies [ , ].
To assess patient health literacy, researchers have developed various instruments. The most widely used measures include the Test of Functional Health Literacy in Adults (TOFHLA) , the eHealth Literacy Scale (eHEALS) [ ], and the Health Literacy Questionnaire (HLQ) [ ]. The TOFHLA captures the reading comprehension and numeracy of patients within health care contexts [ ], whereas the eHEALS measures the skills of patients related to finding, evaluating, and applying electronic health information to health problems [ ]. We chose the HLQ because it captures multiple independent constructs regarding different aspects of health literacy that can yield actionable insights [ , ]. According to the grounded psychometric development and validation of the HLQ [ ], each of the 9 metrics in HLQ provides unique insights into 9 areas of health literacy and therefore can be used separately when all the questions in 1 metric are asked (each metric has 4-5 questions). To keep the survey to a reasonable length, we included 2 of the 9 constructs included in the HLQ—having sufficient information to manage one’s health (HSI) and the ability to actively engage with health care providers (AE)—that are particularly relevant to PGD tracking and sharing [ ]. Individuals with higher levels of HSI feel confident that they have information they need to live with and manage their health; those with lower levels of HSI feel they lack knowledge in managing their health. Individuals with higher levels of AE are proactive about their health and feel in control in relationships with health care providers; those with lower levels of AE are passive in their approach to health care and do not have a sense of agency in interactions with clinicians [ ].
Although health literacy has not yet been explicitly considered in studies related to PGD, researchers have found that tracking PGD can increase people’s awareness of their health  and enable them to better answer their clinicians’ questions [ , , ]. Therefore, we speculate that tracking PGD may relate to one’s perception regarding HSI and AE. In addition, we assume that patients who shared their PGD in the clinic had tracked their PGD before and were equipped with sufficient HSI and AE. For example, a high level of HSI could enable patients to share their health data with clinicians by equipping patients with sufficient knowledge about their health and a high level of AE could facilitate patients’ data sharing as a way of engaging with clinicians. Thus, we investigate the following research questions (RQs):
- RQ1: Do patients’ self-tracking practices relate to their HSI and AE?
- RQ2: Do patients’ self-tracking practices, along with their HSI and AE, relate to their practices of sharing their PGD with their clinicians?
- RQ3: What benefits and barriers do patients encounter with regard to sharing their PGD with their clinicians?
Although most PGD-related studies have examined patients’ experiences retrospectively after some time had passed since their clinic visit [, ], we sought to gather the immediate perceptions of patients regarding their experiences of meeting with a clinician. We surveyed 109 patients who had just met with a clinician at a university health center (UHC), asking them about their practices of tracking and sharing PGD and assessing their health literacy (ie, HSI and AE). Conducting the survey onsite at the UHC enabled us to collect the experiences of participants from their current clinic visit, which helped reduce recall bias and enabled us to gather ecologically valid data.
Survey Design and Measures
Throughout the survey, we used the term personal health data instead of PGD to aid participants’ understanding. At the beginning of the survey, we defined personal health data as health-related data that people keep track of about themselves, such as exercise (eg, step count, miles run), sleep, diet, heart rate, and blood pressure.and describe our survey measures, including how we defined and assessed each construct.
|Quantitative measures and descriptions||Scale or categories|
|Self-reported health status of participants||1: very poor to 5: excellent|
|Number of data types: the total number of different types of health data participants reported being tracked||0: track nothing to 9: track 9 types of PGDa|
|Tracking group: how participants kept track of their PGD|
|Data sharing: whether participants had shared their health data with clinicians during their clinic visit||Yes or no|
|Willingness to share: how likely participants said they would be willing to share their data with clinicians in the future||1: very unlikely to 5: very likely|
|Having sufficient information to manage one’s health||Averaged score from 4 measures on a scale of 1: strongly disagree to 4: strongly agree (: questions 16-19) [ ]|
|The ability to actively engage with health care providers||Averaged score from 5 measures on a scale of 1: cannot do to 5: very easy (: questions 20-24) [ ]|
aPGD: patient-generated data.
Qualitative survey measures.
- Data tracked:The types of patient-generated data (PGD) that participants reported tracking (multiple-choice question with an option to write in additional data types)
- Data shared:The types of PGD that participants reported sharing during the particular appointment with the clinician (multiple-choice question with an option to write in additional data types)
- Data wished to track and be shared:The types of PGD that participants thought would have been helpful if they had tracked and shared them (open-ended question: “List up to 3 types of personal health data that you think it would have been helpful if you had tracked them and shared them with your doctor today”)
- Sharing benefits:Benefits that patients perceived they would have had by sharing their PGD during the particular encounter (an open-ended question asking participants to explain how sharing particular types of PGD would have been helpful)
- Sharing barriers:Barriers that patients encountered in sharing their PGD during their visit to the clinic (multiple-choice question: “what barriers (if any) did you have when sharing your PGD with your doctor?” and a follow-up question asking for further explanation)
In addition, we collected participants’ (1) demographic information (eg, age, gender, occupation, educational attainment, household income, first language), (2) access to technology (eg, internet, mobile phone), and (3) details of their meeting with the clinician (eg, reasons for visit, satisfaction). The survey consisted of 39 questions () and was administered using Qualtrics [ ] on a tablet device we provided.
Data collection for this study was part of a larger project that involved onsite surveys and follow-up interviews at a UHC. This paper focuses on the survey results. Following the UHC’s guidance, 3 researchers set up a study space next to several clinics, including primary care, women’ s health, behavioral health, immunization or allergy, and alternative medicine. We approached patients as they exited clinic offices and asked whether they had just met with a clinician. If the patient answered yes, we invited them to participate in the survey. If they expressed an interest, we then led them to the study space, secured their informed consent, and instructed them to take the survey using a tablet paired with a keyboard. As we had 2 tablets set up in the study space, we were able to host 2 participants at the same time. During the study, 2 to 3 researchers were sitting behind the tablets, and each participant was sitting in front of each tablet to complete the survey. Participants would inform the researchers when they completed the survey. We did not recruit any patients who had visited the UHC for mental health reasons, as per the UHC’s request.
The survey took participants about 4 to 16 minutes to complete (mean 7.60, SD 2.62). Each participant received a US $5 campus dining gift card after completing the survey. The study was approved by the Institutional Review Board at the researchers’ university.
To answer RQ1 (“Do patients’ self-tracking practices relate to their HSI and AE?”), we used multivariate multiple regression to examine whether the number of data types participants tracked and their tracking group (ie, nontracker, memory tracker, or tool tracker) were related to their HSI and AE levels. As patients’ health status has been found to highly correlate with their health literacy , we controlled their health status as a covariate. In addition, we dummy coded the tracking group using nontrackers as the reference group.
To answer RQ2 (“Do patients’ self-tracking practices, along with their HSI and AE, relate to their practices of sharing data with doctors?”), we used multiple logistic regression to predict whether participants had shared their PGD during a particular visit based on their HSI, AE, the number of data types they tracked, and their tracking group. Using this same set of predictors in addition to whether participants had shared their data, we used multiple linear regression to predict participants’ willingness to share their data with clinicians in the future.
To answer RQ3 (“What benefits and barriers do patients encounter with regard to sharing PGD with doctors?”), we first analyzed participants’ responses to the questions regarding their perceived benefits and barriers of sharing PGD with clinicians, and then categorized these responses using a bottom-up (inductive) approach. In this manner, we developed a coding dictionary that reflected different sharing-related benefits and barriers. We later reorganized the initial codes into potential themes, which complemented our findings for RQ2 by explaining why participants had or had not shared their health data with their clinician during the particular clinic visit.
In total, 112 patients participated in our study; however, 3 patients were subsequently excluded from our analysis as they had visited the UHC simply to receive a flu shot, fill out a form, or get a massage. Among the remaining 109 patients, 86 (78.9%) were female and 73 (67.0%) were native English speakers, and their ages ranged from 18 to 37 years (mean 21.0, SD 3.82). Most of the participants were college students (77/109, 70.6%), some (18/109, 16.5%) were full-time employees, and the rest (14/109, 12.8%) were unemployed. Except for 2, all participants (107/109, 98.2%) had access to the internet and a mobile phone. Participants reported visiting the clinic for an inquiry or examination for a specific injury, illness, or condition (65/109, 59.6%), a follow-up visit (22/109, 20.2%), a regular checkup (18/109, 16.5%), or something else (4/109, 3.7%).
Of the total, 87.2% (95/109) of participants reported tracking at least one type of PGD. Of these 95 participants, 38 (35%) were memory trackers who tracked their health data relying on their memory only and 57 (52%) were tool trackers who tracked their data using at least one tool (eg, paper journal, mobile app, website). The remaining 12.8% (14/109) of participants were nontrackers, who did not track any PGD.provides descriptive statistics for each of the 3 tracking groups.
|Participants’ information||Total or overall mean values||Nontrackers (n=14; 12.8%)||Memory trackers (n=38; 34.9%)||Tool trackers (n=57; 52.3%)|
|Age, years; mean (SD)||21.0 (3.82)||20.0 (2.70)||20.5 (3.92)||21.0 (4.70)|
|Gender, n (%)|
|Female||86 (78.9)||11 (78.6)||27 (71.1)||48 (84.2)|
|Male||23 (21.1)||3 (21.4)||11 (28.95)||9 (15.8)|
|Health status, n (%)|
|Excellent||13 (11.9)||2 (14.3)||7 (18.4)||4 (7.0)|
|Very good||27 (24.8)||2 (14.3)||7 (18.4)||18 (31.6)|
|Good||50 (45.9)||7 (50.0)||17 (44.7)||26 (45.6)|
|Fair||18 (16.5)||3 (21.4)||6 (15.8)||9 (15.8)|
|Poor||1 (0.9)||0 (0.0)||1 (2.6)||0 (0.0)|
|Reason for visit, n (%)|
|Inquiry or examination||65 (59.6)||8 (57.1)||25 (65.8)||32 (56.1)|
|Follow-up visit||22 (20.2)||2 (14.3)||7 (18.4)||13 (22.8)|
|Regular checkup||18 (16.5)||3 (21.4)||5 (13.2)||10 (17.5)|
|Other||4 (3.7)||1 (7.1)||1 (2.6)||2 (3.5)|
|Number of data types tracked, mean (SD)||3.46 (2.3)||0 (0)||3.53 (2.0)||4.26 (2.1)|
|Was data shared during the appointment? n (%)|
|No||16 (14.7)||3 (21.4)||5 (13.2)||8 (14.0)|
|Yes||93 (85.3)||11 (78.6)||33 (86.8)||49 (85.96)|
|Number of data types shared, mean (SD)||2.50 (2.01)||2.64 (2.47)||2.21 (1.38)||2.67 (1.95)|
|Likely to share data with clinician in the future? n (%)|
|Very likely||61 (56.0)||11 (78.6)||22 (57.9)||28 (49.1)|
|Somewhat likely||31 (28.4)||0 (0.0)||13 (34.2)||18 (31.6)|
|Neutral||11 (10.1)||2 (14.3)||1 (2.6)||8 (14.0)|
|Somewhat unlikely||3 (2.8)||0 (0.0)||1 (2.6)||2 (3.5)|
|Very unlikely||3 (2.8)||1 (7.1)||1 (2.6)||1 (1.8)|
|Health literacy scores, mean (SD)|
|HSIa (Cronbach α=.86)||3.08 (0.53)||3.11 (0.43)||2.97 (0.57)||2.97 (0.58)|
|AEb (Cronbach α=.88)||4.16 (0.55)||4.20 (0.54)||4.16 (0.53)||4.15 (0.61)|
aHSI: having sufficient information to manage one’s health.
bAE: the ability to actively engage with health care providers.
RQ1: Relationship Between Self-Tracking Practices and Health Literacy of Participants (HSI and AE Scores)
The regression model that predicted HSI based on the participants’ health status, the number of data types they tracked, and their tracking group was significant. However, there were no significant effects of the number of data types tracked or the participant tracking group (). Using the same independent variables, the regression model that predicted AE was found to be significant, and there was a significant main effect of the number of data types participants tracked. This result indicates that when controlling for participants’ health status and their tracking group, those who tracked more data types tended to have higher AE.
|Number of data types||−0.004||0.056e|
aHSI: having sufficient information to manage one’s health.
bAE: the ability to actively engage with health care providers.
RQ2: Relationships Between PGD Tracking, Health Literacy (HSI and AE Scores), and PGD Sharing in the Clinic
Tracking Does Not Always Lead to Sharing
A total of 85.3% (93/109) of our participants, including 11 nontrackers, reported that they had shared their PGD with their clinicians during the particular visit. The logistic regression predicting whether participants had shared their data during the particular visit was not significant (). This result indicates that whether participants shared their PGD during the visit was unrelated to the number of data types they tracked, their tracking group, and their HSI and AE levels.
|Outcome variable||Data sharing|
|Number of data types||0.264|
aHSI: having sufficient information to manage one’s health.
bAE: the ability to actively engage with health care providers.
Health Literacy and Willingness to Share One’s PGD With Clinicians in the Future
The regression model predicting participants’ willingness to share their PGD with clinicians in the future was significant, and there were significant effects of whether participants had shared their PGD during the particular visit and their AE level (). This indicates that, when controlling for other variables, participants who shared their data during the visit and those with a higher level of AE were more likely to be willing to share their PGD with clinicians in the future.
|Outcome variable||Sharing willingness|
|Number of data types||0.046|
cHSI: having sufficient information to manage one’s health.
dAE: the ability to actively engage with health care providers.
RQ3: Benefits of, and Barriers to, Sharing One’s PGD With Clinicians
When asked to list up to 3 types of PGD that the participants felt would have been helpful if they had tracked and shared with their clinicians, 72.5% (79/109) of our participants provided valid responses. These responses included body measures (eg, blood pressure, glucose level, heart rate, body temperature; 47/79, 60%), food (36/79, 46%), sleep (27/79, 34%), water (25/79, 32%), exercise (19/79, 24%), stress (7/79, 9%), menstrual cycle (6/79, 8%), symptoms (6/79, 8%), mood (3/79, 4%), and others (5/79, 6%). In the subsequent open-ended question, participants explained why these data would have been helpful if they had tracked and shared them: (1) to better inform clinicians in detail about their health condition; (2) to receive more personalized care; and (3) to better articulate their illness and health concerns (and ).
Benefits of sharing one’s patient-generated data with clinicians.
- Better inform clinicians of their health condition: Participants felt that sharing their patient-generated data (PGD) is generally helpful for clinicians to understand their health condition and identify any abnormality
- “More info, better diagnosis” (P29)
- “Sharing my body temperature might have helped doctors identify abnormality.” (P48)
- “Mood, sleep, and stress could have been helpful because [the doctor] would understand my illness severity.” (P103)
- Enable clinicians to deliver more personalized care: Participants stated that clinicians could provide better advice or treatments that are more relevant to them
- “If I had tracked and shared my skincare routine, the doctor can offer more personalized advices for me.” (P15)
- “The doctor could have told me if my current numbers [food, water, sleep] were healthy so [I] could adjust [them] accordingly.” (P23)
- Help patients to better articulate their illness and health concerns: Participants who experienced difficulties communicating with their clinicians believed that sharing concrete health data could help them better articulate their symptoms and concerns with evidence
- “I could have proved that I’ve been having fevers for the past couple of days, in addition to not eating, drinking, and sleeping as much as usual.” (P46)
- “Instead of saying ‘I have trouble sleeping until 4am and barely sleep,’ I could have said ‘in the past month I have gotten an average of X hours of sleep per night.’” (P66)
Barriers to sharing one’s patient-generated data with clinicians.
- Uncertainty regarding the relevance and usefulness of their data: Participants were not sure if the data they had tracked was relevant, important, and useful in relation to their current health issues
- “I am not sure if some symptoms are relevant to my headache and I don’t want to waste time.” (P82)
- “Sometimes I don't know what aspects of my health are important to share with my doctor in regards to the health issue I'm having at the moment.” (P102)
- Perceived irrelevance of one’s data: Participants considered that their patient-generated data (PGD) was not relevant to their current health concerns
- “My problem is women health problem; therefore, the data is not very relevant and she did not ask either.” (P22)
- “Some data, such as my exercise and sleep schedule, is not relevant.” (P64)
- Not having enough data: Participants were unable to share their PGD because they had not sufficiently tracked their data
- “My blood pressure and heart rate vary quite a bit. I would love to be able to track this but I don’t have a good device to do so.” (P65)
- “I am somewhat not precise with what I tell them, so that could mess with the data they need to help me.” (P106)
- Limited time to spend with their clinician: Participants expressed concerns regarding the limited time they got to spend with their clinicians
- “The time I spend with the doctor is so limited and it doesn’t seem like the doctor found it necessary to ask any more additional information.” (P46)
- “I feel like doctors never have enough time. They’re always in a rush.” (P65)
- Privacy concerns: Participants were concerned about talking to clinicians they were not familiar with and about the privacy of their health data
- “I feel uncomfortable sharing personal info with people I just met.” (P95)
- “Hacking of computer systems makes me very concerned about my privacy.” (P34)
- Fear of being judged: Participants worried about doctors judging them because of unhealthy behaviors
- “I say less than what I have been doing so that I am not get frowned upon.” (P45)
- “I am afraid of sharing my smoking habits with doctors.” (P52)
When asked about the barriers they had encountered with regard to sharing their PGD with the clinician, 42.2% (46/109) of our participants reported that they did not experience any barriers, whereas the other 57.8% (63/109) of our participants described specific barriers. Their barriers included uncertainty about the relevance and usefulness of their data (18/63, 29%), feeling their data were irrelevant (14/63, 22%), lack of adequate data (12/63, 19%), having limited time to spend with the clinician (11/63, 18%), privacy concerns (7/63, 11%), fear of being judged (4/63, 6%), and others (5/63, 8%). Inand , we list and provide descriptions and sample quotes for each of these barriers.
Reflecting on the Relationships Between PGD Tracking and Health Literacy
Our results show that neither the number of data types that participants tracked nor how they tracked their data relates to their HSI; however, when more types of PGD participants were tracked, their AE tended to be higher. We suspect that as participants tracked more types of PGD, they had more information about their health in mind. Armed with this information, participants could more actively engage with their clinicians, articulate their health concerns, and ask and answer questions regarding their health. However, tracking more types of data did not necessarily transfer to useful knowledge that participants felt helped them to manage their health. Many participants mentioned that they were not sure about the relevance and usefulness of their data.
Although relatively rare, some researchers have examined the role of health literacy in the ability of individuals to track and monitor their health behaviors [, ]. For example, Porter et al [ ] conducted a diary study focused on people’s recording of their daily physical activities and found that highly health literate individuals were able to achieve a higher accuracy in their diaries. Zoellner et al [ ] significantly reduced the sugar-sweetened beverage intake of the participants using a health literacy–centric intervention. Therefore, health literacy is seen as an essential human tool to support individuals in taking advantage of self-tracking technologies [ ]. Although these studies did not examine how to improve the health literacy of individuals, we see opportunities to improve health literacy in people through their engagement in the very act of self-tracking itself and through feedback generated based on one’s personal health data. One opportunity is to deliver health knowledge relevant to individuals’ PGD. For example, food tracking apps, such as MyFitnessPal [ ], suggest whether one’s food intake meets their nutritional needs when they record an entry and provide recommended dietary guidelines with feedback on one’s food consumption. Unlike traditional health literacy programs that focus on delivering general health knowledge [ , ], specific information related to an individual’s own health data can be easier to understand because it is tied to their own health concerns. However, we must keep in mind that interpretation of automatically tracked data is sometimes unreliable or may even cause misunderstandings [ , ]. For example, sleep tracking apps using pressure sensors to estimate sleep hours can cause false-positive detections when people are performing other activities in bed [ ]. Therefore, in delivering health information based on an individual’s data to promote health literacy, it is important to ensure the accuracy of the data and to provide relevant and actionable advice.
The Gaps Between Tracking and Sharing PGD
Our results show that patients who track their data do not always share those data with clinicians. Patients who shared their data during their clinic visits and those with a higher level of AE reported greater willingness to share their PGD with clinicians in the future. Although participants acknowledged several benefits of sharing their data with clinicians, over half of the participants reported one or more barriers to data sharing. First, participants were uncertain about the relevance of the data to their health or felt that their data were not relevant. Although not all types of PGD are necessarily related to patients’ immediate health concerns, these data can be important health indicators for preventative care [- ]. For example, an individual’s activity level and caffeine consumption can affect their sleep quality [ ]; similarly, changes in one’s heart rate may indicate a risk of cardiovascular disease [ ]. To optimize the value of PGD, it is important to empower patients to share their data with clinicians when necessary. We believe that both people and technology play important roles in this process: clinicians can point out specific types of PGD that may be helpful for diagnosis and decision making; tracking tools can be designed to inform patients of how their PGD may or may not be relevant to their present health concerns. For example, by supporting self-experimentation, tracking tools can draw potential correlations between patients’ health indicators (eg, symptoms) and their daily behaviors [ ]. These tools can also provide feedback based on the data and other contextual information of individuals to help them reflect on their behaviors and better assess the relevance of their data to their health [ ].
Second, participants reported that sharing their PGD with clinicians was sometimes difficult because they did not have enough data. Some participants worried that their data were imprecise, whereas others lacked access to professional devices to measure important body metrics, such as heart rate and blood pressure. To encourage patients to share their PGD with clinicians, we argue that there is a need to better support people’s ability to capture sufficient and accurate PGD over time. Due to the high data capture burden  and lack of flexibility in existing tracking tools [ , ], many people cannot adhere to the tracking plans, and may even abandon tracking. To address these challenges, we call for flexible and low-burden tracking tools to better support the ability of patients to collect their health data over a long period, which can help both patients and clinicians. For example, semiautomated tracking tools can be used to lower data capturing burden by leveraging automatic tracking (eg, sleep data from Fitbit [ ]) and enable flexible data capture through manual tracking (eg, mood) [ , ]. In addition, efforts need to be made to lower the barriers to tracking devices and to make them more accessible to the public (eg, setting up blood pressure kiosks).
Third, participants were reluctant to share their data because of the limited time they had to meet with their clinician. Participants explained that to make the best use of the time, they did not want to waste the time on sharing their PGD, especially when they considered that their data would not help clinicians. However, because patients are not medical experts, they could not always tell which data are relevant to their health, especially if they kept track of various types of data. Although our work did not examine clinicians’ perspectives on PGD sharing, previous work has found that clinicians are also concerned about the time they need to review PGD in the clinic [, ] and may even consider these data to be distracting [ ]. To resolve the dilemma of clinicians having limited time and patients feeling uncertain about whether their personal health data can be helpful, an approach should be developed to help patients share their data efficiently. For example, Fitbit recently rolled out a health and wellness report [ ] that includes a visual or textual summary of a user’s data, which the individual can print out and take to the clinician’s office [ ]. Although the relevance of these data to one’s health may be unclear to the patient, we believe that this is a promising step to support patients in sharing their data with their clinicians, leveraging consumer health technologies.
Finally, some participants reported that they were reluctant to share their PGD because of privacy concerns and fear of being judged, especially when asked to share data relating to unhealthy behaviors, such as smoking. This fear may stem from how tracking tools often pass judgment on people’s data, as researchers have noticed many self-tracking tools (eg, MyFitnessPal , Lose It! [ ]) posit weight gain and extra calorie intake as negative outcomes (eg, using red to highlight these data points). Although such designs serve as an alert for individuals to maintain a healthy lifestyle, they can increase the anxiety of those who have weight concerns or dietary problems [ ]. To help patients overcome their fear of being judged, tracking tools should avoid creating an environment that perpetuates stigma and that passes explicit or implicit judgments on users.
Limitations and Future Work
This study has limitations that should be considered when interpreting the results and implications. First, although significant, the adjusted R-square statistics in our regression models were relatively low, with a medium effect size (), indicating that the models explained only a small proportion of the variances in our outcome variables (ie, HSI, AE, willingness to share one’s data with clinicians in the future). This could be partly because of either (1) omitting other confounding factors that could influence the health literacy of participants (eg, socioeconomic status, health insurance) [ , ] and data sharing practices (eg, the questions clinicians asked) or (2) sampling bias resulting from recruiting mostly young, healthy, and tech-savvy college students with adequate technology access and higher HSI and AE than patients in general [ , ]. Second, we characterized the tracking practices of participants based on the number of data types they tracked and how they tracked their data, which did not capture all dimensions related to self-tracking. Third, some participants reported sharing PGD they had not tracked (eg, blood pressure taken in the clinic), possibly because (1) they interpreted PGD as encompassing health-related data captured in the clinic, despite our best efforts to define and communicate its meaning or (2) they were able to retrospectively recall or estimate some forms of PGD, even if they had not explicitly tracked the data (eg, weight). Fourth, to make the survey easy and quick to respond to, we omitted questions inquiring about how the PGD sharing happened during the clinic visit. For example, we did not specifically ask participants what triggered their data sharing (eg, whether participants were asked by the clinician, had proactively shared their data themselves, or had their body metrics assessed in the clinic). In addition, we did not ask participants how they shared their data (eg, verbal communication, screen sharing). Finally, we conducted the survey at a UHC, where the clinicians might not be the primary physicians of the participants, which may limit the generalizability of our findings.
Despite these limitations, we believe that, in optimizing health care for the next generation, investigating the interrelationships between PGD tracking and sharing practices, health literacy, and clinic experiences of tech-savvy college students is an important starting point. Going forward, we aim to further examine whether and how health literacy relates to different PGD tracking and sharing contexts—for example, replicating the study with different patient populations, such as those with more severe health conditions and those with low health literacy. Other dimensions of patients’ self-tracking practices, such as the frequency with which they track their data (eg, routine vs casual trackers), and triggers and methods of data sharing in the clinic warrant future research . In addition, our study focused only on 2 health literacy constructs (HSI and AE). It is worth investigating how patients’ data tracking and sharing practices may relate to other health literacy constructs, such as one’s ability to navigate the health care system [ ]. Finally, by surveying patients immediately after they met with a clinician, our study demonstrates the value of gathering immediate perspectives of patients on their experiences with PGD sharing, which allowed us to quantitatively explore the interrelationships between patients’ data tracking practices, data sharing practices, and their health literacy ( ). In the future, similar approaches can be used to examine the immediate perspectives of clinicians on their experiences in responding to and using PGD shared by their patients.
We presented an onsite survey study of 109 patients who had just met with a clinician at a UHC. Our aim was to investigate the potential relationships between patients’ PGD tracking practice, sharing practices, and their health literacy. We found that neither the number of data types the participants tracked nor how they tracked their data related to participants’ perceptions that they had sufficient information to manage their health (HSI). However, participants who reported tracking more types of PGD provided higher ratings when asked about their ability to actively engage with their health care providers. Our results also highlighted that tracking PGD does not always lead to sharing these data with clinicians, as exemplified by the many barriers participants reported regarding data sharing. Reflecting on our findings, we discussed ways to close the gaps between patient tracking and sharing of their PGD. We also suggested design opportunities to improve patient health literacy by leveraging the value of PGD to support patients in assessing the relevance of their PGD to their health and to facilitate patient data sharing with their clinicians.
The authors would like to thank all the study participants for their time to share personal experiences. This research was in part funded by the National Science Foundation Awards (#1753452 and #1753453) and by the Research Improvement Grant from the College of Information Studies at the University of Maryland, College Park.
Conflicts of Interest
Survey questionnaire.DOCX File , 19 KB
- Zhu H, Colgan J, Reddy M, Choe EK. Sharing patient-generated data in clinical practices: an interview study. AMIA Annu Symp Proc 2016;2016:1303-1312 [FREE Full text] [Medline]
- Wood W, Bennett AV, Basch E. Emerging uses of patient generated health data in clinical research. Mol Oncol 2015 May;9(5):1018-1024 [FREE Full text] [CrossRef] [Medline]
- Luo Y, Liu P, Choe EK. Co-designing Food Trackers With Dietitians: Identifying Design Opportunities for Food Tracker Customization. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 2019 Presented at: CHI'19; May 9-10, 2019; Glasgow, UK. [CrossRef]
- Zhu H, Luo Y, Choe EK. Making Space for the Quality Care: Opportunities for Technology in Cognitive Behavioral Therapy for Insomnia. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2017 Presented at: CHI'17; April 3-7, 2017; Denver, CO, USA. [CrossRef]
- Schroeder J, Hoffswell J, Chung C, Fogarty J, Munson S, Zia J. Supporting patient-provider collaboration to identify individual triggers using food and symptom journals. CSCW Conf Comput Support Coop Work 2017 Feb 25;2017:1726-1739 [FREE Full text] [CrossRef] [Medline]
- Chung C, Cook J, Bales E, Zia J, Munson SA. More than telemonitoring: health provider use and nonuse of life-log data in irritable bowel syndrome and weight management. J Med Internet Res 2015 Aug 21;17(8):e203 [FREE Full text] [CrossRef] [Medline]
- Kim Y, Heo E, Lee H, Ji S, Choi J, Kim J, et al. Prescribing 10,000 Steps Like Aspirin: Designing a Novel Interface for Data-driven Medical Consultation. In: Conference on Human Factors in Computing Systems - Proceedings Internet. New York, NY. 2017 Presented at: CHI'17; April 7-10, 2017; Denver, CO, USA URL: https://dl.acm.org/doi/10.1145/3025453.3025570 [CrossRef]
- West P, Giordano R, Van KM, Shadbolt N. Conference on Human Factors in Computing Systems. 2016 Presented at: CHI'16; May 5-7, 2016; San Jose, CA, USA URL: https://dl.acm.org/doi/10.1145/2858036.2858445 [CrossRef]
- Nutbeam D. Health promotion glossary. Health Promot 1986 May;1(1):113-127. [CrossRef] [Medline]
- Nutbeam D. The evolving concept of health literacy. Soc Sci Med 2008 Dec;67(12):2072-2078. [CrossRef] [Medline]
- Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the health literacy questionnaire (HLQ). BMC Public Health 2013 Jul 16;13:658 [FREE Full text] [CrossRef] [Medline]
- Klasnja P, Kendall L, Pratt W, Blondon K. Long-term engagement with health-management technology: a dynamic process in diabetes. AMIA Annu Symp Proc 2015;2015:756-765 [FREE Full text] [Medline]
- Chung C, Dew K, Cole A, Zia J, Fogarty J, Kientz J, et al. Boundary Negotiating Artifacts in Personal Informatics: Patient-provider Collaboration With Patient-generated Data. In: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. 2016 Presented at: ACM'16; June 2-5, 2016; San Francisco, CA, USA. [CrossRef]
- Choe E, Lee N, Lee B, Pratt W, Kientz J. Understanding Quantified-selfers? Practices in Collecting and Exploring Personal Data. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2014 Presented at: SIGCHI'14; June 3-6, 2014; Toronto, Canada. [CrossRef]
- Choe EK, Lee B, Andersen TO, Wilcox L, Fitzpatrick G. Harnessing the power of patient-generated data. IEEE Pervasive Comput 2018 Apr;17(2):50-56. [CrossRef]
- Choe EK, Lee B, Zhu H, Riche N. Understanding Self-reflection: How People Reflect on Personal Data Through Visual Data Exploration. In: Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare. 2017 Presented at: EAI'17; June 1-5, 2017; Barcelona, Spain. [CrossRef]
- Choe EK, Lee B, Kay M, Pratt W, Kientz J. SleepTight: Low-burden, Self-monitoring Technology for Capturing and Reflecting on Sleep Behaviors. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 2015 Presented at: ACM'15; July 16-18, 2015; Osaka, Japan. [CrossRef]
- Chiauzzi E, Rodarte C, DasMahapatra P. Patient-centered activity monitoring in the self-management of chronic health conditions. BMC Med 2015 Apr 9;13:77 [FREE Full text] [CrossRef] [Medline]
- Ishikawa H, Yano E. Patient health literacy and participation in the health-care process. Health Expect 2008 Jun;11(2):113-122 [FREE Full text] [CrossRef] [Medline]
- 23 and Me. URL: https://www.23andme.com/ [accessed 2020-11-23]
- Ayobi A, Marshall P, Cox A, Chen Y. Quantifying the Body and Caring for the Mind: Self-tracking in Multiple Sclerosis. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2017 Presented at: CHI'17; August 3-6, 2017; Denver, CO, USA. [CrossRef]
- Karkar R, Schroeder J, Epstein D, Pina L, Scofield J, Fogarty J, et al. TummyTrials: a Feasibility Study of Using Self-experimentation to Detect Individualized Food Triggers. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2017 Presented at: CHI'17; May 1-7, 2017; Denver, CO, USA. [CrossRef]
- Eikey EV. It's Definitely Been a Journey?: a Qualitative Study on How Women With Eating Disorders Use Weight Loss Apps. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2017 Presented at: CHI'17; May 1-7, 2017; Denver, CO, USA. [CrossRef]
- Eikey EV. Providers'perceptions of the Impact of Weight Loss Apps on Users With Eating Disorders. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 2016 Presented at: CHI'16; June 23-26, 2016; San Jose, CA, USA. [CrossRef]
- Garrity TF. Medical compliance and the clinician-patient relationship: a review. Soc Sci Med Part E: Med Psychol 1981 Aug;15(3):215-222. [CrossRef]
- Woods SS, Schwartz E, Tuepker A, Press NA, Nazi KM, Turvey CL, et al. Patient experiences with full electronic access to health records and clinical notes through the My HealtheVet Personal Health Record Pilot: qualitative study. J Med Internet Res 2013 Mar 27;15(3):e65 [FREE Full text] [CrossRef] [Medline]
- Sands DZ, Wald JS. Transforming health care delivery through consumer engagement, health data transparency, and patient-generated health information. Yearb Med Inform 2018 Mar 5;23(1):170-176. [CrossRef]
- West P, Van Kleek M, Giordano R, Weal M, Shadbolt N. Information quality challenges of patient-generated data in clinical practice. Front Public Health 2017;5:284 [FREE Full text] [CrossRef] [Medline]
- Jo DM. Issue Brief: Patient-Generated Health DataHealth IT. Office of the National Coordinator for Health Information Technology. 2013. URL: https://www.healthit.gov/sites/default/files/pghd_brief_final122013.pdf [accessed 2020-11-23]
- Patient-Generated Health Information Technical Expert Panel. Department Services, of Health and Human. 2013. URL: https://www.healthit.gov/sites/default/files/pghi_tep_finalreport121713.pdf [accessed 2020-11-23]
- Ostherr K, Borodina S, Bracken RC, Lotterman C, Storer E, Williams B. Trust and privacy in the context of user-generated health data. Big Data Soc 2017 Apr 17;4(1):205395171770467. [CrossRef]
- Halamka JD, Mandl KD, Tang PC. Early experiences with personal health records. J Am Med Informatics Assoc 2008 Jan 1;15(1):1-7. [CrossRef]
- Carmona RH. Health literacy: a national priority. J Gen Intern Med 2006 Aug;21(8):803. [CrossRef]
- Cho YI, Lee SD, Arozullah AM, Crittenden KS. Effects of health literacy on health status and health service utilization amongst the elderly. Soc Sci Med 2008 Apr;66(8):1809-1816. [CrossRef] [Medline]
- Noblin A, Wan T, Fottler M. The impact of health literacy on a patient's decision to adopt a personal health record. Perspect Health Inf Manag 2012;9:1-13 [FREE Full text] [Medline]
- St Leger L. Schools, health literacy and public health: possibilities and challenges. Health Promot Int 2001 Jun;16(2):197-205. [CrossRef] [Medline]
- Williams MV, Davis T, Parker R, Weiss B. The role of health literacy in patient-physician communication. Fam Med 2002 May;34(5):383-389. [Medline]
- Ishikawa H, Yano E, Fujimori S, Kinoshita M, Yamanouchi T, Yoshikawa M, et al. Patient health literacy and patient-physician information exchange during a visit. Fam Pract 2009 Dec;26(6):517-523. [CrossRef] [Medline]
- Jacobs RJ, Lou JQ, Ownby RL, Caballero J. A systematic review of eHealth interventions to improve health literacy. Health Informatics J 2016 Jun;22(2):81-98 [FREE Full text] [CrossRef] [Medline]
- Parker RM, Baker DW, Williams MV, Nurss JR. The test of functional health literacy in adults. J Gen Intern Med 1995 Oct;10(10):537-541. [CrossRef]
- Norman CD, Skinner HA. eHEALS: the eHealth literacy scale. J Med Internet Res 2006 Nov 14;8(4):e27 [FREE Full text] [CrossRef] [Medline]
- Friis K, Lasgaard M, Osborne R, Maindal H. Gaps in understanding health and engagement with healthcare providers across common long-term conditions: a population survey of health literacy in 29,473 Danish citizens. BMJ Open 2016 Jan 14;6(1):e009627 [FREE Full text] [CrossRef] [Medline]
- Hawkins M, Gill SD, Batterham R, Elsworth GR, Osborne RH. The Health Literacy Questionnaire (HLQ) at the patient-clinician interface: a qualitative study of what patients and clinicians mean by their HLQ scores. BMC Health Serv Res 2017 Apr 27;17(1):309 [FREE Full text] [CrossRef] [Medline]
- Cohen DJ, Keller SR, Hayes GR, Dorr DA, Ash JS, Sittig DF. Integrating patient-generated health data into clinical care settings or clinical decision-making: lessons learned from project healthdesign. JMIR Hum Factors 2016 Oct 19;3(2):e26 [FREE Full text] [CrossRef] [Medline]
- Nittas V, Lun P, Ehrler F, Puhan MA, Mütsch MA. Electronic Patient-Generated Health Data to Facilitate Disease Prevention and Health Promotion: Scoping Review. J Med Internet Res 2019 Oct 14;21(10):e13320 [FREE Full text] [CrossRef] [Medline]
- Qualtrics. 2019. URL: https://www.qualtrics.com/ [accessed 2020-11-23]
- Porter K, Chen Y, Estabrooks P, Noel L, Bailey A, Zoellner J. Using teach-back to understand participant behavioral self-monitoring skills across health literacy level and behavioral condition. J Nutr Educ Behav 2016 Jan;48(1):20-6.e1 [FREE Full text] [CrossRef] [Medline]
- Zoellner JM, Hedrick VE, You W, Chen Y, Davy BM, Porter KJ, et al. Effects of a behavioral and health literacy intervention to reduce sugar-sweetened beverages: a randomized-controlled trial. Int J Behav Nutr Phys Act 2016;13():38. [CrossRef] [Medline]
- Vamos S, Klein K. Our self-tracking movement and health literacy: are we really making every moment count? Glob Health Promot 2018 Jun;25(2):85-89. [CrossRef] [Medline]
- MyFitnessPal. URL: https://www.myfitnesspal.com/ [accessed 2020-11-23]
- Ferguson LA. Implementing a video education program to improve health literacy. J Nurse Pract 2012 Sep;8(8):e17-e22. [CrossRef]
- Yli-Kauhaluoma S, Pantzar M. Seeking connectivity to everyday health and wellness experiences: specificities and consequences of connective gaps in self-tracking data. Digit Health 2018;4:2055207618779714 [FREE Full text] [CrossRef] [Medline]
- Choe EK. Design of Persuasive Technologies for Healthy Sleep Behavior. In: Proceedings of the 13th international conference on Ubiquitous computing. 2011 Presented at: UbiComp'11; April 7-9, 2011; Beijing, China. [CrossRef]
- Liang Z, Alberto M, Martell C. Framing Self-quantification for Individual-level Preventive Health Care. In: Proceedings of the International Conference on Health Informatics. 2015 Presented at: CHI'15; May 7-9, 2015; Lisbon, Portugal. [CrossRef]
- Verdezoto N, Grönvall E. On preventive blood pressure self-monitoring at home. Cogn Tech Work 2015 Nov 23;18(2):267-285. [CrossRef]
- den Hoed M, Eijgelsheim M, Esko T, Brundel BJJM, Peal DS, Evans DM. Identification of heart rate-associated loci and their effects on cardiac conduction and rhythm disorders. Nat Genet 2013 Jun;45(6):621-631 [FREE Full text] [CrossRef] [Medline]
- Fitbit. URL: https://www.fitbit.com/ [accessed 2020-11-23]
- Choe EK, Abdullah S, Rabbi M, Thomaz E, Epstein DA, Cordeiro F, et al. Semi-automated tracking: a balanced approach for self-monitoring applications. IEEE Pervasive Comput 2017 Jan;16(1):74-84. [CrossRef]
- Kim Y, Jeon JH, Lee B, Choe EK, Seo J. OmniTrack. Proc ACM Interact Mob Wearable Ubiquitous Technol 2017 Sep 11;1(3):1-28. [CrossRef]
- West P, Van KM, Giordano R, Weal M, Shadbolt N. Common Barriers to the Use of Patient-generated Data Across Clinical Settings. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 2018 Presented at: CHI'18; July 17-19, 2018; Montreal, Canada. [CrossRef]
- Use Fitbit's New Wellness Report To Have A More Informed Conversation With Your Doctor. URL: https://blog.fitbit.com/fitbit-premium-wellness-report/ [accessed 2020-11-23]
- Lose It!. URL: https://www.loseit.com/ [accessed 2020-11-23]
- Lupton D. ‘I just want it to be done, done, done!’ food tracking apps, affects, and agential capacities. MTI 2018 May 23;2(2):29. [CrossRef]
- Morris RL, Soh S, Hill KD, Buchbinder R, Lowthian JA, Redfern J, et al. Measurement properties of the Health Literacy Questionnaire (HLQ) among older adults who present to the emergency department after a fall: a Rasch analysis. BMC Health Serv Res 2017 Aug 29;17(1):605 [FREE Full text] [CrossRef] [Medline]
- Cutilli CC, Bennett IM. Understanding the health literacy of America. Orthopaedic Nursing 2009;28(1):27-32. [CrossRef]
- Debussche X, Lenclume V, Balcou-Debussche M, Alakian D, Sokolowsky C, Ballet D, et al. Characterisation of health literacy strengths and weaknesses among people at metabolic and cardiovascular risk: Validity testing of the Health Literacy Questionnaire. SAGE Open Med 2018;6:2050312118801250 [FREE Full text] [CrossRef] [Medline]
- Brabers AE, Rademakers JJ, Groenewegen PP, van Dijk L, de Jong JD. What role does health literacy play in patients' involvement in medical decision-making? PLoS One 2017;12(3):e0173316 [FREE Full text] [CrossRef] [Medline]
- Figueiredo M, Caldeira C, Chen Y, Zheng K. Routine self-tracking of health: reasons, facilitating factors, and the potential impact on health management practices. AMIA Annu Symp Proc 2017;2017:706-714. [Medline]
|AE: the ability to actively engage with health care providers|
|eHEALS: eHealth literacy scale|
|HLQ: health literacy questionnaire|
|HSI: having sufficient information to manage one’s health|
|IBS: irritable bowel syndrome|
|PGD: patient-generated data|
|RQ: research question|
|TOFHLA: Test of Functional Health Literacy in Adults|
|UHC: University Health Center|
Edited by G Eysenbach; submitted 27.03.20; peer-reviewed by G Fitzpatrick, L Emmerton; comments to author 12.06.20; revised version received 07.08.20; accepted 26.10.20; published 22.12.20Copyright
©Yuhan Luo, Chi Young Oh, Beth St Jean, Eun Kyoung Choe. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 22.12.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.