Background: Gestational diabetes mellitus (GDM) is one of the most common medical complications during pregnancy. eHealth technologies are proving to be successful in supporting the self-management of medical conditions. Digital technologies have the potential to improve GDM self-management.
Objective: The primary objective of this systematic literature review was to identify the views of health professionals (HPs) and women with GDM regarding the use of eHealth for GDM self-management. The secondary objective was to investigate the usability and user satisfaction levels when using these technologies.
Methods: Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) approach, the search included primary papers in English on the evaluation of technology to support self-management of GDM from January 2008 to September 2021 using MEDLINE, CINAHL, Embase, ACM, and IEEE databases. The lists of references from previous systematic literature reviews, which were related to technology and GDM, were also examined for primary studies. Papers with qualitative, quantitative, and mixed methodologies were included and evaluated. The selected papers were assessed for quality using the Cochrane Collaboration tool, National Institute for Health and Care Excellence clinical guidelines, Critical Appraisal Skills Programme Qualitative Checklist, and McGill University Mixed Methods Appraisal Tool. NVivo (QSR International) was used to extract qualitative data, which were subjected to thematic analysis. Narrative synthesis was used to analyze the quantitative data.
Results: A total of 26 papers were included in the review. Of these, 19% (5/26) of studies used quantitative research methodologies, 19% (5/26) used qualitative methods, and 62% (16/26) used mixed methods. In all, 4 themes were identified from the qualitative data: the benefits of using technology, engagement with people via technology, the usability of technology, and discouragement factors for the use of technology. The thematic analysis revealed a vast scope of challenges and facilitators in the use of GDM self-management systems. The challenges included usability aspects of the system, technical problems, data privacy, lack of emotional support, the accuracy of reported data, and adoption of the system by HPs. Convenience, improved GDM self-management, peer support, increased motivation, increased independence, and consistent monitoring were facilitators to use these technologies. Quantitative data showed that there is potential for improving the usability of the GDM self-management systems. It also showed that convenience, usefulness, increasing motivation for GDM self-management, helping with GDM self-management, and being monitored by HPs were facilitators to use the GDM self-management systems.
Conclusions: This novel systematic literature review shows that HPs and women with GDM encountered some challenges in using GDM self-management systems. The usability of GDM systems was the primary challenge derived from qualitative and quantitative results, with convenience, consistent monitoring, and optimization of GDM self-management emerging as important facilitators.
Gestational diabetes mellitus (GDM) is defined as any degree of carbohydrate intolerance with onset or first recognition during pregnancy . GDM is one of the most common medical complications of pregnancy [ ], with a significant increase in its prevalence in different ethnic groups and countries over the last several years [ , ]. GDM is most prevalent in the Middle East and North Africa, with an estimated median of 12.9%, and least prevalent in Europe, with an estimated median of 5.8% of all pregnancies [ ]. In the United Kingdom, the prevalence of GDM is approximately 4% of all pregnancies [ ]. The rate of GDM is likely to rise owing to a growth in GDM risk factors, such as greater prevalence of maternal obesity and advancing age of childbearing [ ], leading to an increasing demand for GDM clinical services [ ].
GDM is associated with serious maternal [- ] and fetal complications [ - ]. Mothers who have been affected by GDM are also at risk of developing type 2 diabetes [ ] and cardiometabolic disorders later in life [ ], and their infants are more at risk of developing adulthood obesity and type 2 diabetes [ , ]. These complications represent significant health problems and cost [ ] for health services. The risk of adverse effects of GDM can be minimized by good control over maternal blood glucose (BG), diet, and physical activities [ ]. However, there is limited time between diagnosis and delivery to optimize care for women with GDM [ ]. Therefore, regular clinic visits [ ] to a multidisciplinary team are advised to provide care during pregnancy. Nonetheless, traveling to specialist clinics in central locations [ ] is expensive [ ], time consuming, and inconvenient for women [ ]. Recently, there has been an increase in the use of technology to enable self-management of GDM by women and to shift GDM management away from hospital-based care [ ].
In light of increased adoption of technology to access information and communication, a digital GDM self-management system might offer advantages such as reducing patient travel and waiting time , saving medical practitioner time [ ], reducing costs [ , ] to both the health care system and patients, greater convenience [ ], attainment of better pregnancy outcomes [ ], and an increased feeling of self-efficacy [ ]. This can further lead to better BG control [ , ] and a decrease in GDM complications owing to greater accuracy and more frequent monitoring [ ]. Such outcomes are evident in the results of several studies, which have found that health care technology can be beneficial for women with GDM in the improvement of hemoglobin A1c [ - ], mean BG [ , - ], maternal weight [ ], and maternal and fetal outcomes [ , , ]. Technology could also offer high-quality remote health care in a critical situation such as the COVID-19 pandemic to women with GDM, where travel and in-person contact have been severely restricted [ , ]. Therefore, there is an urgent need to consider computer-based communication technologies for the management of diabetes. This could contribute to better diabetes management by improving patient knowledge, attitudes, skills, lifestyle behavior [ ], quality of care, and access to care [ ].
Digital GDM self-management systems developed in recent years are available mostly as mobile apps or websites [, , ] and offer a wide range of features such as monitoring BG [ ], diet, physical activity, blood pressure, and ketonuria [ ] for women with GDM. However, a recent study by Kalhori et al [ ] suggests that the few GDM apps available in popular app stores are poor in quality, using the Mobile App Rating Scale as a basis for this result [ ].
Furthermore, most GDM self-management systems are not widely used [, ], and some are no longer supported [ , ], one reason for which is obsolete hardware (ML Bartholomew, MD, email communication, 2018). Previous systematic reviews in the scope of technology and GDM management were carried out on available technology for GDM self-management [ , - ], the impact of technology on clinical and pregnancy outcomes or GDM management [ - ], comparing women’s clinical outcomes using technology with standard care [ ], and the psychological aspect of using technology [ ]. However, to the best of our knowledge, there is no systematic literature review of the opinions of health care professionals and women with GDM about using technology for GDM self-management.
The primary aim of this systematic literature review was to identify the views of health professionals (HPs) and women with GDM regarding barriers and facilitators of using technology for GDM self-management. The secondary aim was to investigate the usability and user satisfaction of these technologies.
The search strategy was developed by following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) approach  with the help of a professional librarian. The PRISMA guidelines lead to standardized reports and enhance the clarity of systematic literature reviews [ ].
Criteria of Inclusion and Exclusion
To achieve the aims of this review, the criteria for inclusion and exclusion were developed as presented in.
Inclusion and exclusion criteria.
- Views of health care professionals, pregnant women diagnosed with gestational diabetes mellitus (GDM) or postpartum women with a history of GDM about their pregnancy period
- Technology (eHealth or telemedicine being used, evaluated, reviewed, or discussed by participants) or usability evaluation or reports of user satisfaction levels
- Any primary research studies
- Aspects of GDM management (eg, blood glucose control, diet, weight, physical activity, medication adherence, or information)
- Published papers written in any language other than English
- Women with preexisting type 1 and type 2 diabetes (except papers that provide information about GDM distinct from type 1 and 2 diabetes)
- Any nondigital technology
- Papers published before 2008
- Posters, abstracts, and news items
- Systematic literature reviews
- Usability results for task performance
Search Strategy and Screening Process
A search was carried out using 3 search terms—“self-management,” “gestational diabetes,” and “technology” (). The search terms were identified from papers in eHealth for GDM in the PubMed database.
The search included publications written in English from January 2008 to September 2021 in the MEDLINE, CINAHL, Embase, ACM, and IEEE databases. This date limitation was chosen to represent contemporary technology for GDM self-management.
The screening process was conducted by the first author in line with previous studies [, ] and with the help of the research team and a professional librarian using the following steps:
- Identification: the results of the search from different databases were exported to the EndNote X7 software. Furthermore, the reference lists of previous systematic literature reviews related to technology and GDM were examined in the primary studies. All citations were collated into one group and duplicate records were removed.
- Screening: the titles and abstracts of the remaining citations were screened based on the inclusion and exclusion criteria to select potential papers by the first author. At this stage, 2 other members of the research team independently conducted a double screening of the first 10% of the results. Following a discussion phase, this screening process was repeated to ensure reliability based on inclusion and exclusion criteria.
- Eligibility: Mendeley software was used to keep electronic copies of the full text of potential papers. The full text of the papers was assessed based on the inclusion and exclusion criteria.
- Included: the final papers were selected from the full text based on the inclusion and exclusion criteria by the first author. The papers were discussed with the research team if there was any lack of clarity in their inclusion.
The study characteristics were extracted from the final 26 included papers. A predefined data extraction table was populated with information, such as study design, sample size, location, analysis method, participants’ ages, inclusion and exclusion criteria, analysis methods, study goals, quantitative and qualitative data collection tools, and key findings ([ , , , , , , , , , , - ]).
NVivo 12 was used to extract relevant qualitative data to achieve the primary aim of the review. A predefined table, including the author, measures, scale items, and results, was used to extract relevant quantitative data.
Appropriate appraisal tools were chosen based on the methodology and study design. Each of the studies included in this review was critically assessed using an appropriate tool: the Cochrane Collaboration tool for randomized controlled trials (RCTs) , National Institute for Health and Care Excellence clinical guidelines for questionnaire studies or surveys [ ], the Critical Appraisal Skills Programme Qualitative Checklist for qualitative studies [ ], and the McGill University Appraisal Tool for Mixed Methods [ ].
To meet the aims of this systematic literature review and not to exclude data relevant to this review, the quality of papers was not assessed with the purpose of excluding them. Instead, limitations of the included studies were considered during the analysis and synthesis of data.
The analysis was completed in 2 phases for qualitative and quantitative data. Thematic analysis with an inductive approach  was used to develop themes from 73% (19/26) studies that included qualitative data following the 6 steps outlined by Braun and Clarke [ ].
Level 1 (reviewing codes of each theme for existence of coherent patterns) and level 2 analyses (reviewing the themes to assess whether they reflect the entire data set) were conducted by the first author and the second coauthor. Interrater reliability was not carried out, in line with the recommended process by Braun and Clarke .
Narrative review was used to analyze the quantitative data owing to the heterogeneity of research methods used. A narrative review is flexible and allows different types of evidence to be combined into a coherent summary. The narrative review process  included summarizing and explaining the quantitative data presented in 69% (18/26) included papers.
Study Selection and Study Characteristics
The search and screening strategies are shown in.
A total of 26 papers were included from the full text based on the inclusion and exclusion criteria. Of the included papers, 19% (5/26) were quantitative, 19% (5/26) were qualitative, and 62% (16/26) used mixed methods (). The sample sizes varied among the studies, ranging from 9 [ ] to 340 [ ] participants. Most of the included studies were from Europe (15/26, 58%), and the rest were from North America (3/26, 11%), Australia (4/26, 15%), Singapore (1/26, 4%), New Zealand (1/26, 4%), and South Korea (1/26, 4%), with 4% (1/26) study of unspecified location. Studies varied in exploring the views of women and HPs. Of these, 96% (25/26) studies included the views of women, with 23% (6/26) including the views of HPs, and only 4% (1/26) including HPs’ views without those of women.
Methodological Quality Assessment
In general, the 26 included studies showed some degree of bias in their research.
[ , , , , , ] and show the risk of bias summary and graph (specific to an RCT study design), respectively, for the included studies using Review Manager 5.3 (Cochrane Collaboration desktop software).
On the basis of the nature of the included studies that used technology as a core of their research, it was impossible to blind participants and researchers from the knowledge of the intervention participants received . Therefore, performance bias was not included in the risk of bias assessment ( and ) [ ]. Of the 23% (6/26) RCT studies, quality assessment showed that 15% (4/26) had a low risk of bias [ , , , ]. The other 8% (2/26) studies presented a risk of bias in incomplete outcome data owing to the withdrawal of a large number of participants during the study [ ] and an unequal number of participants in the intervention and control groups [ ]. Furthermore, the allocation concealment method has been adequately reported in only 8% (2/26) studies [ , ].
Quality appraisal of the remaining studies ([ , , , , , , , , , , - ]) revealed that 11% (3/26) qualitative studies were of good quality in design, data collection procedure, and data analysis [ , , ]. The common limitations for the rest of the studies (including quantitative, qualitative, or mixed methods) were bias in sampling [ , , ], small sample sizes relative to the type of study conducted [ , , ], lack of information about the validity and reliability of the data collection tools [ , - ], lack of information about inclusion and exclusion criteria [ ], poor qualitative results [ ], and unclear recruitment strategy [ ]. In addition, there was a lack of information regarding the method of gathering qualitative data [ ] and the analysis process [ , ]. In 8% (2/26) mixed methods studies, it was stated that the quantitative data would be collected in the following phase, but there was no clear explanation about how the triangulation of the quantitative and qualitative data would answer the research question [ , ].
Thematic Analysis of Qualitative Data
Of the included studies, 73% (19/26) contributed qualitative data to the thematic analysis. The views of women and HPs were integrated and reported together throughout the analysis. A total of 4 themes were identified: benefits of using technology, engagement with people via technology, usability of technology, and discouragement factors for the use of technology (definitions of the themes and subthemes are available in). Furthermore, 2 subthemes were identified, as outlined in .
Theme 1: Benefits of Using Technology
Both women and HPs reported their confidence in [, ] and willingness to use GDM self-management systems because of the benefits of these systems for women with GDM [ , ] and for their babies’ health [ , , ]. Furthermore, some HPs considered technology to be beneficial for complementing the limited number of health care professionals, while the rate of GDM is increasing [ ]. The benefits of using technology themes included 2 subthemes: “convenience of technology use” and “improving self-management by using technology.”
Convenience of Technology Use
Convenience was the predominant benefit of using technology for GDM management. A total of 50% (13/26) papers reported that women with GDM and HPs found the convenience of reduced travel and clinical appointments, as well as the pervasive use of technology, the most beneficial reasons for its use. Women in the studies of Khalil  and Edward et al [ ] expressed that traveling is “exhausting” [ ] particularly toward the end of their pregnancy [ ], and especially for women living at a distance [ , , ]. Women and HPs also indicated that it would lead to a reduction in the need for women to make potentially stressful arrangements for finding childcare and managing absence from work [ , ]. Therefore, technology could be highly advantageous for women with busy lives, especially those who already have children [ ]:
I am amazed with the technology and it suited me much better than having to travel in a lot and wait, especially with little ones
Generally, women and HPs lauded the ease and convenience of using technology rather than traditional paper logbooks. This was mainly because of the ability to access technology anytime  or anywhere, driven by the growing pervasiveness of mobile devices [ , ]—“you’ve always got your phone haven’t you, so it’s the easiest way to do stuff” (Patient 3).
Women and HPs also recognized constant access to information related to GDM [, , ] and being familiar with using similar technology [ , , - ] as further elements of ease and convenience.
Saving time is another convenient aspect of technology use for both women [, , ] and HPs [ ]. In a study by Bromuri et al [ ], a telemedicine system helped HPs review BG values quicker than to review them on a paper logbook, owing to alerts that highlighted out-of-range BG values resulting in hyperglycemia and hypoglycemia being recognized quickly. Women and HPs agreed that it takes considerable time to attend clinical appointments [ ] just to “be told you’re doing everything right” [ , ]:
They don’t want to spend all of their time trying to get to the hospital and look for parking and spend long periods waiting at hospital.
Improving GDM Self-management by Using Technology
Improving the ability of women to self-manage GDM is another prominent benefit of using such technology. Increasing awareness of one’s own data has been perceived as an important element of using technology for GDM self-management [, , ]. Women in some studies indicated that real-time feedback [ , , ], visualization of data (eg, graphic nutrient summaries or recommendations) [ , , ] and the ability to review and track their data [ , , ] empowered them with “self-awareness” about their own data [ , , ]. The clarity of the relationship between different attributes, particularly diet and BG levels, was seen as beneficial [ , , ]. Data relationships also helped women to identify “where it [self-management] was working or where it was going wrong’’ [ ] and supported them to change their lifestyle [ , , ]. However, women and HPs had different opinions about the accuracy of women’s self-reported data. Although some women favored recording data with technology because they were more accurate and precise [ ], other women admitted misreporting their data values to get more positive feedback [ ]. Some HPs did not want to rely on women’s self-reported data [ ] because they did not trust the accuracy of the data; they preferred to enter data into the system themselves [ ].
Women also found information related to diet [, , , , ] and peer support [ , ] useful in improving their lifestyle. Moreover, women felt “automatic messages” [ ], rewards, and goal tracking on the system motivated them to change their lifestyle and optimize their GDM self-management.
Both women and HPs perceived increased independence through technology [, ]. Women and HPs also expressed that using a digital GDM system improved both their self-management skills [ , , ] and exercise of control on their GDM condition [ , , , , , , , ]:
myDiabby helped patients self-manage their health. 
Technologies help us being more autonomous. We feel more responsible. 
Theme 2: Engagement With People via Technology
This theme included 2 main components including engagement with peers and engagement with health care professionals.
Women with GDM indicated that accessing “peer support” by a digital GDM self-management system would be useful  as “somebody may know something more” [ ]. Although some women had little or no experience with web-based group communication, they were still interested in communicating with other women with GDM via technology [ ]. Peer support provided an opportunity for women to access “other people’s experiences” [ ] for sharing and exchanging information [ ]. As a woman with GDM indicated, peer support provided “a better overview of risks associated with GDM, what could go wrong potentially, and the good stories as well” [ ]. Overall, women perceived that peer support empowered them with a broader scope of GDM knowledge than other women who were experiencing the same condition [ ]. In addition, peer support reassured women that they were “not alone” [ ] and offered them a “constant feeling of support” [ ]. Furthermore, it enabled women to talk about their condition and experience in a “safe space” without being judged by other people [ ]. Women indicated a lack of peer support in the current care system that might be addressed using technology [ ].
Regarding engagement with health care professionals, women appreciated the possibility of receiving additional support using technology. They valued sharing their data and having regular GDM monitoring by HPs via technology [, , , , , ], specifically for benefiting both their own health and that of their baby [ ]. Women expressed how sharing data with HPs was “reassuring” and gave them a “safety net” [ ] owing to a feeling of being monitored more closely by the HPs [ ]. Similarly, some HPs believed that sharing data would provide an opportunity to review and monitor the data frequently [ , ], detect any changes or problems at an early stage [ , ] and thereby allow the early application of treatment or interventions for women with GDM [ , , ].
Although some women and HPs felt comfortable communicating via technology [, , , , ], others were concerned about a lack of physical and emotional support [ , , , ] and a poorer quality of conversation [ , , ]:
I like the one to one contact so you can ask questions. 
Nevertheless, women still felt there was a need to provide more interaction and communication between HPs and women via mobile app technology .
Theme 3: Usability of Technology
Women and HPs provided various perspectives on the usability of digital GDM systems in this theme. The content of the systems, including the quality of information and format and presentation of patients’ data, was the main usability aspect discussed by women and HPs in the included papers.
When women and HPs found the GDM systems “easy to use” [, , , , ], “simple” [ , ], “intuitive” [ ] and “straightforward” [ , ], these impressions were influenced by the presence of simple language and images [ ] and the simplicity of information presentation, such as displaying all data on one screen [ , , ].
When usability concerns arose, they were also related to the data format and layout. Women and HPs suggested improving the layout and format of the information by changing the size of images or the amount of text , using videos [ ], improving the data summary presentation [ , ], changing the data format to be similar to that of a paper logbook [ , , , ], and distinguishing different degrees of BG severity [ ]:
To look back and see is there a blood sugar previous to try and identified yourself which was the pre and which was the post [meal test]. 
In the study by Pustozerov and Popova , HPs also indicated that improving the data format would help them review the data more easily.
Discussions on usability were also directed at the effectiveness of GDM apps in fulfilling the needs of women. Participants in different studies provided opinions about the lack of functionality in their GDM self-management systems. Some of their diverse suggestions included an option to scan barcodes of food , a time-alerting function for entering data [ ], an educational or coaching feature [ ], the ability to add a note to BG readings, and the ability to record the type of physical activity they have performed [ ].
Women were also interested in having pop-up messages , informing them about any changes in their data [ ], their condition [ ], or any new activities in the forum [ ] on the system:
To be able to review previous (entered) results and comments, to get an alert notice if results are out of the ideal range... 
A final aspect of usability concerned the effectiveness of information content. Women and HPs found the GDM information in both older technology  as well as that introduced by the studies [ , , ] to be insufficient and simplistic [ , , , ]. Personalized information was considered vital [ ] for diet [ , ] and in-depth information about GDM [ , ]. In addition, some women had issues with the clarity of the content and wanted simple, clear [ , ] and commonly used language [ , ] such as using “tablespoon” or “bowl” as familiar measurement units used by their dietitian rather than imperial measurements that were used to display food quantities on the app [ ].
Despite the clear views of some women and HPs that using GDM self-management technology was more efficient in monitoring  and recording [ ], other women were concerned about the inefficiency of their GDM systems [ , ]. Women with GDM found it was time consuming to use the system, particularly to retrieve information from food databases [ ]. Postpartum women who had GDM perceived that the apps they used for GDM were overcomplicated and required too much commitment to complete a task [ ]:
For something that was quite simple, it would take actually a long time to find it. 
I’ve never managed to do it for a long period, because of the amount of commitment. 
Theme 4: Discouragement Factors for the Use of Technology
The apparent disinterest of HPs was a cause of discouragement for women with GDM. Some said HPs lacked interest [, , ] and knowledge [ ] in using technology. Indeed, their HPs’ preference for a paper logbook discouraged women from using digital GDM self-management tools [ ], particularly those who were already unfamiliar with such technology [ ]:
I had no interest in writing it two places, and I understood that no one was going to read or use my app…They always asked for my book, so I used that. 
Similarly, HPs were concerned about women’s abilities to use technology:
they’re all on their screens but at the end of the day, some of them don’t actually have credit to even look at a website or download a piece of information. 
Confirming this, some women reported little or no experience of using “message boards and things of that nature” . Therefore, women themselves believed that some training might be needed to increase their confidence to use such technologies [ , ]. Some women with GDM were also concerned about the privacy of personal health information recorded on the systems [ , ].
In addition, HPs were concerned about the time required to use the systems and thought it would increase their workload [, , , ]. They were also concerned that some women might not be able to afford the technology [ ]:
We have some women who have got quite a low socioeconomic status, most of them still have phones...but not all have [mobile] data. 
Women with GDM and HPs also experienced technical problems as barriers to the use of GDM self-management technology. Both women and HPs reported some difficulties with data transmission [, , ], problems with accessing technology [ ], and poor access to the local internet [ , ].
Narrative Review of Quantitative Data
A narrative review was used to analyze the quantitative data, including the usability and user satisfaction results from 50% (13/26) of the included studies. Quantitative data from the remaining 27% (7/26) studies were not included in the analysis, as the results were not related to usability or user satisfaction [, , , , , ] or were the result of objective task performance [ ].
Quantitative studies used various measurements to gather data. Of these, only 12% (3/26) included a usability questionnaire to evaluate their systems, as summarized in.
Of the included studies, 8% (2/26) applied the system usability scale (SUS) developed by Brook in 1996 , with defined acceptability ranges for SUS scores (0-50 not acceptable, 50-70 marginal and 70-100 acceptable range) [ ]. Jo and Park [ ] reported a marginal score for their app, just below the acceptable threshold, (69.5 of 100). A similar, but acceptable, score was reported in the study by Gianfrancesco et al [ ] for their web-based dietary system (70.9 out of 100) [ ]. Pustozerov and Popova [ ] included a custom questionnaire wherein women with GDM rated the “usefulness” and “convenience” of their GDM system on a 10-point scale. Usefulness was rated highly (8.7 out of 10), with convenience scoring somewhat lower (7.2 of 10).
In short, although these results suggest that previous GDM systems have usability challenges, it is impossible to draw any reliable conclusions with only 12% (3/26) studies providing results from a usability questionnaire.
|Gianfrancesco et al ||SUSa questionnaire|
|Jo and Park ||SUS (Korean version)|
|Pustozerov and Popova ||Custom usability questionnaire (10-point scale questions on convenience and usefulness + open-ended questions)|
aSUS: system usability scale.
The included studies used different measurements to evaluate user satisfaction. Given et al  used an adapted version of the Telemedicine Satisfaction and Usefulness Questionnaire by Bakken et al [ ]. Of the studies that included user satisfaction questionnaires, 4% (1/26) did not make their satisfaction questionnaire available [ ], 12% (3/26) used specially developed satisfaction questionnaires [ , , ], and the rest (4/26, 15%) used satisfaction questionnaires without any information on how they were developed [ , , - ]. Studies by Hirst et al [ ] and Mackillop et al [ ] were the only ones to provide evidence of the validity and reliability of their developed questionnaires.
The included studies reported generally high user satisfaction in their evaluations of GDM systems [, , , , , , - ]. However, their user satisfaction questionnaires evaluated many different aspects of GDM systems regarding the type of technology and its features, making it difficult to clearly summarize areas for improvement. shows the key measures of the user satisfaction questionnaires in the included studies (the complete measures are available in ). Most questionnaires used a Likert scale rating to assess the degree of participants’ agreement with their statements about the GDM systems. Women in these studies interacted with the technology within the period from GDM diagnosis until childbirth (usually between 8 and 10 weeks). They all used and evaluated the real working prototypes. Miremberg et al [ ] were not included in because the questions or satisfaction items were not available in their study.
Assessment of the aspects of convenience was common. Caballero-Ruiz et al  highlighted the convenience of minimizing travel to centralized clinics as the strongest indicator of satisfaction (approximately, on average, 9.5 out of 10). In other studies, women rated GDM apps highly for factors such as not complicating their lives [ , , ] and the ability of these apps to fit into their lifestyles [ ].
Improvement of GDM self-management was a highly rated aspect of the studied systems, including helping women to record BG levels , reminding them to take medication and record BG levels, helping them eat healthier, encouraging them to be more active [ ], and helping to improve their GDM knowledge [ ]. Moreover, most women found SMS text messages helpful and motivated them to optimize their GDM self-management [ , ]. A total of 2 studies also reported a general increase in women’s confidence in the management of their GDM [ , ].
Confidence or trust in GDM systems was rated well. Women with GDM reported confidence that the health care team checked their BG levels on the GDM system . Many studies reported high ratings of confidence in the GDM systems, with women recommending them to others [ , , , , ] or planning to use them in their next pregnancy [ , , , ]. Similarly, a study reported a high degree of trust (average 9 out of 10) in the GDM system [ ], while another study reported that the GDM system was reliable [ ].
Slightly lower satisfaction scores were reported for other aspects of ease of use: clarity of visualization of changes to treatment was rated approximately 7 out of 10 , and Peleg et al [ ] reported satisfaction with system response time as approximately 3.5 out of 5, and ability to assist with interpreting self-monitored data approximately 3.8 out of 5.
Overall, based on the usability results (scores just under or above the acceptable threshold), there is much room for improvement in the usability of GDM self-management systems. However, with the limited number of papers providing a quantitative usability evaluation and the heterogeneity of questions assessing satisfaction, more studies are needed to identify where the improvement of usability and user satisfaction should be focused.
|Summary of key measures of user satisfaction questionnaires||Study|
|Varnfield et al ||Johnson and Berry ||Mackillop et al ||Peleg et al ||Caballero-Ruiz et al ||Peleg et al ||Bartholomew et al ||Hirst et al ||Given et al |
|Fit in with life or did not complicate it||✓||✓||✓||✓||✓|
|Adapt to daily life and context changes||✓||✓|
|Number of hospital consultations is enough||✓||✓|
|Help to record BGLsb||✓|
|Help to remember to take medication and take BGc||✓|
|Help to eat healthier or become more active||✓|
|Helps to improve GDMd knowledge||✓|
|Increased motivation for self-management||✓|
|Improved diabetes control||✓|
|Help to feel confident in managing GDM||✓||✓||✓|
|Feel confident that health care team checked BGLs||✓|
|Recommending to others||✓||✓||✓||✓||✓||✓|
|Using it again||✓||✓||✓||✓||✓|
|Easy to use||✓||✓||✓|
|Ease to learn how to use||✓||✓|
|Helps data interpretation||✓||✓|
|Clarity or effectiveness of visualization||✓||✓|
|Clarity of activities’ sequence in app||✓|
|System response time||✓||✓|
|Experiencing error with the system||✓|
|Trust is being well controlled||✓|
|Trust it to work||✓|
|Reliable to use||✓||✓|
|Satisfaction regarding diabetes follow-up||✓|
|Satisfied with the system||✓||✓|
|Enjoyable or interesting||✓||✓|
|Paying for the system||✓||✓|
a✓: illustrates where a study included a measure of user satisfaction in its participant questionnaire.
bBGL: blood glucose level.
cBG: blood glucose.
dGDM: gestational diabetes mellitus.
The primary objective of this systematic literature review was to identify the views of HPs, women with GDM, and postpartum women who have had GDM regarding GDM self-management technology. The secondary objective was to investigate the usability and user satisfaction levels of existing technologies and quantitatively evaluate these factors.
Regarding the first objective, thematic analysis of the qualitative data in the selected papers identified four themes: (1) the benefits of using technology, (2) engagement with people via technology, (3) usability of technology, and (4) discouragement factors for the use of technology.
The thematic analysis of qualitative data revealed barriers to usability, including technical problems, data privacy, lack of emotional support, the accuracy of reported data, and adoption of the system by HPs. Convenience, improving GDM self-management, peer support, increasing motivation, increasing independency, and providing consistent monitoring were common facilitators of using this technology.
For the second objective, the narrative review of the quantitative data (usability and user satisfaction) showed that there is room for improvement in the usability of GDM self-management systems.
Benefits of Using Technology
Convenience of Technology Use
The influence of convenience in our analysis, in both the qualitative and quantitative findings, is echoed in other literature on telemedicine. Pérez-Ferre et al  reported a 65% reduction in the number of clinical visits for women with GDM who were using telemedicine. The main benefits of doing so are the improvement of HPs' work efficiency and a better quality of life for women with GDM [ ].
Although our findings indicated a strong positive desire to reduce in-person clinics through technology, not everyone wanted clinical visits replaced altogether. This was affirmed in a recent systematic review that highlighted the negative impact of losing in-person contact between women with GDM and HPs , particularly for women who experience social isolation and anxiety during pregnancy [ ]. However, these studies were carried out before the COVID-19 pandemic. Today, patients may be more familiar with remote consultations, and the impact of this would benefit from further investigation.
Improving GDM Self-management by Using Technology
Our results revealed that women appreciated the use of technology to manage various aspects of their condition. These findings are consistent with those of relevant studies outside the scope of this review. Leziak et al  explored the experiences of women with GDM and pregnant women with type 2 diabetes using mobile health (mHealth) during pregnancy. Their results showed enhanced self-management through the use of mHealth technology [ ]. Similarly, Yee et al [ ] explored how pregnant women with GDM or preexisting diabetes perceived an SMS-based intervention during their pregnancy, showing an optimization of GDM self-management and increased motivation for diabetes self-care. In 2007, Homok et al [ ] evaluated the feasibility of a web-based telemedicine system that monitored the BG levels of underserved (poor socioeconomic status) women with GDM using the Diabetes Empowerment Scale [ ]. Participants experienced increased diabetes management self-efficacy, such as readiness to change their lifestyle behaviors to achieve diabetes goals.
In summary, evidence suggests that technology could help women optimize their GDM self-management abilities, leading to benefits for both themselves and their baby’s health. As a result of good practices initiated through GDM self-management technology, women could also improve control over their health, which could be maintained habitually after giving birth to prevent the development of type 2 diabetes.
Engagement With People via Technology
As mentioned earlier, this theme consists of 2 main components: “engagement with peers” and “engagement with health care professionals.”
The results of the thematic analysis demonstrated the benefits of peer support in digital GDM self-management systems [, , ] a finding supported by similar studies outside the scope of this review. Leziak et al [ ] explored the experiences of low-income women with GDM and pregnant women with type 2 diabetes, using mHealth technology to support and improve diabetes self-management during pregnancy. Their results highlighted how women valued social interactions with other women and accessed their knowledge and experiences. McMillan et al [ ] evaluated mHealth technology to support postpartum women with a history of GDM in maintaining postnatal activity and good dietary habits, finding that a discussion forum was a valuable feature in doing so [ ]. As other previous studies have emphasized, such favorable opinions of women toward peer support stem from their ability to share or read stories about other women [ ] and receive emotional support [ ], which is an important factor in health communication [ , ]. Indeed, some HPs believed that pregnant women valued other women’s experiences more than HPs’ advice during their pregnancy [ ]. However, Sherman and Greenfield [ ] found that, when examining message boards for pregnant teenagers, some of the medical information posted by pregnant women was misleading because it was suitable for their specific condition and therefore inappropriate for others [ ]. Furthermore, validation of posted information is also a major challenge [ ], and further work is needed in this area to provide a reliable and validated communication path between women with GDM.
Our thematic analysis described women’s interest in sharing data with their clinicians by remote means, to obtain reassurance and to be monitored more consistently. This is also evident in some previous studies. Dalfra et al  found that women with GDM and pregnant women with type 1 diabetes appreciated their telemedicine system for sharing their data with HPs and their ability to communicate with them whenever needed. Similarly, Leziak et al [ ] showed that women were also in favor of sharing data with HPs and receiving real-time feedback. However, in the included studies, some HPs found it difficult to trust women’s reported data [ , ]. In contrast, Kruger et al [ ] found that HPs were satisfied with the accuracy of the data reported by women with GDM via a telemedicine system. Other studies have found that it is unlikely that women would misreport their records, as they are highly motivated to maintain BG control [ ] for the sake of their baby’s health [ ]. Further work is needed to examine the means of decreasing the possibility of reporting incorrect data.
Usability of Technology
Although the evidence available regarding the usability of digital GDM self-management systems is limited , the findings of our review are in line with those of previous studies on mHealth self-management systems for type 1 and type 2 diabetes. Katz et al [ ] assessed 8 current diabetes self-management apps for adults with type 1 diabetes, discovering issues in the interpretability of data and high cognitive load. These results were corroborated by Fu et al [ ] in an evaluation of 4 apps for type 2 diabetes management. Further studies have also found usability challenges with data format on mHealth self-management systems [ - ], such as difficulty interpreting or understanding data in its current format [ ]. A useful digital self-management system should display data trends and patterns, specifically showing which data are normal or abnormal. Usability issues with data formats thus prevent patients from understanding their data [ , ], thereby limiting their self-management capabilities.
Our review also identified limitations in the functionality of the systems as another usability concern across the included studies. Previous reviews of general diabetes self-management apps have highlighted important missing functionality, including automatic transfer of BG data from a glucometer to a mobile app, personalized diabetes management advice , prevention of errors [ ], freedom to edit or remove data entries and appointments, and the ability to automate common tasks [ ].
The limited functionality of diabetes self-management systems can be considered a usability problem  and is likely to result in these systems failing to meet users’ needs [ ]. Addressing these functionality limitations would mitigate some of the usability challenges and help users optimize their engagement and interaction with these systems.
Quantitative evaluation of GDM self-management apps in the studies by Jo and Park  and Gianfrancesco et al [ ] yielded SUS scores just below and above the acceptable threshold, respectively. Unsurprisingly, previous studies that used the SUS questionnaire to evaluate diabetes self-management apps in different domains have received similarly poor ratings [ , , ]. Similar to this systematic review, these previous studies used guidance from Bangor et al [ ] to interpret the SUS scores, with most apps falling below the acceptable range.
Our quantitative analysis identified the need to improve the usability of GDM self-management systems. However, with the limited number of papers providing a quantitative usability evaluation, the heterogeneity of questions assessing satisfaction and the variation in systems being assessed, it is difficult for quantitative studies to identify where the improvement of usability and user satisfaction should be focused. Therefore, it is an aspect that needs further investigation.
Discouragement Factors for the Use of Technology
Despite the perceived benefits of GDM technology, our analysis revealed technical problems as a prevalent barrier across the included studies. Previous studies have reported similar technical problems when using eHealth and self-management systems [, - ]. Moreover, a previous systematic literature review by Simblett et al [ ] identified technical problems as one of the most significant barriers to using mHealth technologies. The most common technical problems in their review were app disappearance, loss of power, restarting without warning, not receiving notifications, receiving them at the wrong time, and having a difficult connection. Indeed, 2 participants withdrew from one of the included studies because of difficulties with internet connectivity. Parallel to the findings of this review, technical problems were the cause of reducing participants’ motivations [ , ] and even the cause of leaving the study by participants with other health conditions [ , ].
In addition to technical problems, the privacy of personal health information was a concern for some women. Simblett et al  also reported privacy concerns in one of the included studies. Although the use of advanced encryption algorithms and pseudoanonymization of personal data should address security and privacy challenges at the system level, it is important for future GDM systems to effectively communicate good security practices to reassure new users [ ].
Although most women across all studies were interested in using self-management technology, some suggested that their HPs were disinterested. Similarly, Wake et al  recognized the lack of awareness and adoption of technology by HPs as an important barrier to using eHealth for diabetes self-management [ ]. HPs’ difficulty to accept technology was experienced in previous studies [ - ], influenced by difficulty integrating it with their workflow [ , ], lack of integration with the medical record system [ ], or a lack of technical knowledge [ ]. Further work is required to involve HPs in the design and development of GDM technology more effectively to reduce this barrier.
Limitations and Further Work
The strengths of this review were its application of a rigorous process in paper selection and summarizing results that include both qualitative and quantitative data to cover a wide scope of understanding. Although this systematic literature review was conducted by the first author, we mitigated the potential for bias through a double screening of a proportion of papers’ citations (title and abstract) by the entire research team, in line with previous systematic literature reviews published in JMIR. Two of the authors were also involved in theme development and the methods and results were reviewed by all authors.
Thematic analysis was restricted to the qualitative data contained in the papers (19/26, 73%). It is possible that the authors of the included studies did not report significant results. However, it is unlikely that the key findings were not reported in the original papers.
The details of the methods and methodologies applied were limited in some studies. The available evidence is also limited by several factors. First, some studies used small sample sizes. Methodologically robust trials of greater sizes are needed to confirm the findings of our review. Second, the number of quantitative studies that measured usability was limited. Third, most of the evaluations of satisfaction did not address the validity and reliability of the satisfaction questionnaires. Furthermore, some questions in the satisfaction questionnaires were generic. Using standard evaluation tools and valid questionnaires would offer consistent and robust results across different studies.
Overall, further work is required to improve the usability of GDM self-management systems. There is a need to evaluate the systems using various usability approaches [, , ] and larger samples to obtain broader usability perceptions and identify problems with the systems. Furthermore, more engaging elements in a GDM self-management system are needed to develop better emotional support for women. Work is needed to improve peer communication to develop more support for women with GDM.
Further work is also needed to assess the design and development process of these GDM self-management technologies that might help identify the source of these usability challenges.
This is the first systematic literature review to carry out a comprehensive review of the perspectives of HPs, women with GDM, and postpartum women who have had GDM about using technology for GDM self-management during pregnancy. Despite the existence of several studies on technology and GDM, information about the perceptions of women with GDM and HPs regarding GDM self-management technology is limited. More rigorous studies are needed to reveal evidence-based barriers to and facilitators of using existing GDM self-management systems.
The authors would like to take this opportunity to thank the Engineering and Physical Sciences Research Council (EPSRC) for the funding support and opportunity to conduct this research project. They also thank Professor Annalu Waller, Dr Rachel Menzies, and Mr Scott McGregor for providing their help and advice during this review.
Conflicts of Interest
Keywords and search strategy.DOCX File , 13 KB
Study characteristics.DOCX File , 59 KB
Quality assessment.DOCX File , 45 KB
Definition of the themes and subthemes.DOCX File , 15 KB
Satisfaction measurements.DOCX File , 20 KB
- World Health Organization. Definition, diagnosis and classification of diabetes mellitus and its complications : report of a WHO consultation. Part 1, Diagnosis and classification of diabetes mellitus. World Health Organization. 1999. URL: https://apps.who.int/iris/handle/10665/66040 [accessed 2022-10-21]
- Mastrogiannis DS, Igwe E, Homko CJ. The role of telemedicine in the management of the pregnancy complicated by diabetes. Curr Diab Rep 2013 Feb;13(1):1-5. [CrossRef] [Medline]
- Ferrara A. Increasing prevalence of gestational diabetes mellitus: a public health perspective. Diabetes Care 2007 Jul;30 Suppl 2:S141-S146. [CrossRef] [Medline]
- Anna V, van der Ploeg HP, Cheung NW, Huxley RR, Bauman AE. Sociodemographic correlates of the increasing trend in prevalence of gestational diabetes mellitus in a large population of women between 1995 and 2005. Diabetes Care 2008 Dec;31(12):2288-2293 [FREE Full text] [CrossRef] [Medline]
- Zhu Y, Zhang C. Prevalence of gestational diabetes and risk of progression to type 2 diabetes: a global perspective. Curr Diab Rep 2016 Jan;16(1):7 [FREE Full text] [CrossRef] [Medline]
- National Collaborating Centre for Women's and Children's Health. Diabetes in pregnancy: management of diabetes and its complications from preconception to the postnatal period. In: The National Institute for Health and Clinical Excellence. London, UK: RCOG Press; 2008.
- Births in Scottish Hospitals. Information Services Division Publication Report. 2017 Nov 28. URL: https://www.isdscotland.org/Health-Topics/Maternity-and-Births/Publications/2017-11-28/2017-11-28-Births-Report.pdf [accessed 2019-06-06]
- Rigla M, Martínez-Sarriegui I, García-Sáez G, Pons B, Hernando ME. Gestational diabetes management using smart mobile telemedicine. J Diabetes Sci Technol 2018 Mar;12(2):260-264 [FREE Full text] [CrossRef] [Medline]
- Ovesen PG, Jensen DM, Damm P, Rasmussen S, Kesmodel US. Maternal and neonatal outcomes in pregnancies complicated by gestational diabetes. A nation-wide study. J Matern Fetal Neonatal Med 2015;28(14):1720-1724. [CrossRef] [Medline]
- Pettitt DJ, Knowler WC, Baird HR, Bennett PH. Gestational diabetes: infant and maternal complications of pregnancy in relation to third-trimester glucose tolerance in the Pima Indians. Diabetes Care 1980;3(3):458-464. [CrossRef] [Medline]
- Xiong X, Saunders LD, Wang FL, Demianczuk NN. Gestational diabetes mellitus: prevalence, risk factors, maternal and infant outcomes. Int J Gynaecol Obstet 2001 Dec;75(3):221-228. [CrossRef] [Medline]
- Carolan M. Women's experiences of gestational diabetes self-management: a qualitative study. Midwifery 2013 Jun;29(6):637-645. [CrossRef] [Medline]
- Jo S, Park H. Development and evaluation of a smartphone application for managing gestational diabetes mellitus. Healthc Inform Res 2016 Jan;22(1):11-21 [FREE Full text] [CrossRef] [Medline]
- Metzger BE, Buchanan TA, Coustan DR, de Leiva A, Dunger DB, Hadden DR, et al. Summary and recommendations of the Fifth International Workshop-Conference on Gestational Diabetes Mellitus. Diabetes Care 2007 Jul;30 Suppl 2:S251-S260. [CrossRef] [Medline]
- Schneider S, Hoeft B, Freerksen N, Fischer B, Roehrig S, Yamamoto S, et al. Neonatal complications and risk factors among women with gestational diabetes mellitus. Acta Obstet Gynecol Scand 2011 Mar;90(3):231-237 [FREE Full text] [CrossRef] [Medline]
- Bellamy L, Casas J, Hingorani AD, Williams D. Type 2 diabetes mellitus after gestational diabetes: a systematic review and meta-analysis. Lancet 2009 May 23;373(9677):1773-1779. [CrossRef] [Medline]
- Krishnaveni GV, Hill JC, Veena SR, Geetha S, Jayakumar MN, Karat CL, et al. Gestational diabetes and the incidence of diabetes in the 5 years following the index pregnancy in South Indian women. Diabetes Res Clin Pract 2007 Dec;78(3):398-404 [FREE Full text] [CrossRef] [Medline]
- American Diabetes Association. Diagnosis and classification of diabetes mellitus. Diabetes Care 2010 Jan;33 Suppl 1:S62-S69 [FREE Full text] [CrossRef] [Medline]
- Ohno MS, Sparks TN, Cheng YW, Caughey AB. Treating mild gestational diabetes mellitus: a cost-effectiveness analysis. Am J Obstet Gynecol 2011 Sep;205(3):282.e1-282.e7 [FREE Full text] [CrossRef] [Medline]
- Crowther CA, Hiller JE, Moss JR, McPhee AJ, Jeffries WS, Robinson JS, Australian Carbohydrate Intolerance Study in Pregnant Women (ACHOIS) Trial Group. Effect of treatment of gestational diabetes mellitus on pregnancy outcomes. N Engl J Med 2005 Jun 16;352(24):2477-2486. [CrossRef] [Medline]
- Miremberg H, Ben-Ari T, Betzer T, Raphaeli H, Gasnier R, Barda G, et al. The impact of a daily smartphone-based feedback system among women with gestational diabetes on compliance, glycemic control, satisfaction, and pregnancy outcome: a randomized controlled trial. Am J Obstet Gynecol 2018 Apr;218(4):453.e1-453.e7. [CrossRef] [Medline]
- Sheikhi H, Saadatifar B, Dashtban R, Anvari N, Mastaelizadeh H. Self-care in patients with gestational diabetes. J Biochem Technol 2018;9(2):177-180.
- Mackillop L, Loerup L, Bartlett K, Farmer A, Gibson OJ, Hirst JE, et al. Development of a real-time smartphone solution for the management of women with or at high risk of gestational diabetes. J Diabetes Sci Technol 2014 Nov;8(6):1105-1114 [FREE Full text] [CrossRef] [Medline]
- Nam S, Chesla C, Stotts NA, Kroon L, Janson SL. Barriers to diabetes management: patient and provider factors. Diabetes Res Clin Pract 2011 Jul;93(1):1-9. [CrossRef] [Medline]
- Given JE, Bunting BP, O'Kane MJ, Dunne F, Coates VE. Tele-Mum: a feasibility study for a randomized controlled trial exploring the potential for telemedicine in the diabetes care of those with gestational diabetes. Diabetes Technol Ther 2015 Dec;17(12):880-888. [CrossRef] [Medline]
- van den Heuvel JF, Groenhof K, Veerbeek JH, van Solinge WW, Lely AT, Franx A, et al. eHealth as the next-generation perinatal care: an overview of the literature. J Med Internet Res 2018 Jun 05;20(6):e202 [FREE Full text] [CrossRef] [Medline]
- Harrison TN, Sacks DA, Parry C, Macias M, Ling Grant DS, Lawrence JM. Acceptability of virtual prenatal visits for women with gestational diabetes. Womens Health Issues 2017;27(3):351-355. [CrossRef] [Medline]
- Edwards L, Connors C, Whitbread C, Brown A, Oats J, Maple-Brown L, NT Diabetes in Pregnancy Partnership. Improving health service delivery for women with diabetes in pregnancy in remote Australia: survey of care in the Northern Territory Diabetes in Pregnancy Partnership. Aust N Z J Obstet Gynaecol 2014 Dec;54(6):534-540. [CrossRef] [Medline]
- Franc S, Daoudi A, Mounier S, Boucherie B, Dardari D, Laroye H, et al. Telemedicine and diabetes: achievements and prospects. Diabetes Metab 2011 Dec;37(6):463-476. [CrossRef] [Medline]
- Hirst JE, Mackillop L, Loerup L, Kevat DA, Bartlett K, Gibson O, et al. Acceptability and user satisfaction of a smartphone-based, interactive blood glucose management system in women with gestational diabetes mellitus. J Diabetes Sci Technol 2015 Jan;9(1):111-115 [FREE Full text] [CrossRef] [Medline]
- Dalfrà MG, Nicolucci A, Lapolla A, TISG. The effect of telemedicine on outcome and quality of life in pregnant women with diabetes. J Telemed Telecare 2009;15(5):238-242. [CrossRef] [Medline]
- Homko CJ, Santamore WP, Whiteman V, Bower M, Berger P, Geifman-Holtzman O, et al. Use of an internet-based telemedicine system to manage underserved women with gestational diabetes mellitus. Diabetes Technol Ther 2007 Jun;9(3):297-306. [CrossRef] [Medline]
- Wojcicki JM, Ladyzynski P, Krzymien J, Jozwicka E, Blachowicz J, Janczewska E, et al. What we can really expect from telemedicine in intensive diabetes treatment: results from 3-year study on type 1 pregnant diabetic women. Diabetes Technol Ther 2001;3(4):581-589. [CrossRef] [Medline]
- Caballero-Ruiz E, García-Sáez G, Rigla M, Villaplana M, Pons B, Hernando ME. A web-based clinical decision support system for gestational diabetes: automatic diet prescription and detection of insulin needs. Int J Med Inform 2017 Jun;102:35-49. [CrossRef] [Medline]
- Ming W, Mackillop LH, Farmer AJ, Loerup L, Bartlett K, Levy JC, et al. Telemedicine technologies for diabetes in pregnancy: a systematic review and meta-analysis. J Med Internet Res 2016 Nov 09;18(11):e290 [FREE Full text] [CrossRef] [Medline]
- Kim Y, Kim H, Kim Y. Effects of a web-based self-management program on the behavior and blood glucose levels of women with gestational diabetes mellitus. Telemed J E Health 2019 May;25(5):407-414. [CrossRef] [Medline]
- Guo H, Zhang Y, Li P, Zhou P, Chen L, Li S. Evaluating the effects of mobile health intervention on weight management, glycemic control and pregnancy outcomes in patients with gestational diabetes mellitus. J Endocrinol Invest 2019 Jun;42(6):709-714. [CrossRef] [Medline]
- Yew TW, Chi C, Chan S, van Dam RM, Whitton C, Lim CS, et al. A randomized controlled trial to evaluate the effects of a smartphone application-based lifestyle coaching program on gestational weight gain, glycemic control, and maternal and neonatal outcomes in women with gestational diabetes mellitus: the SMART-GDM study. Diabetes Care 2021 Feb;44(2):456-463 [FREE Full text] [CrossRef] [Medline]
- Li S, Ouyang Y, Qiao J, Shen Q. Technology-supported lifestyle interventions to improve maternal-fetal outcomes in women with gestational diabetes mellitus: a meta-analysis. Midwifery 2020 Jun;85:102689. [CrossRef] [Medline]
- Seo Y, Kim EM, Choi JS, Park C. Using a mobile-based nutritional intervention application improves glycemic control but reduces the intake of some nutrients in patients with gestational diabetes mellitus: a case series study. Clin Nutr Res 2020 Jan;9(1):73-79 [FREE Full text] [CrossRef] [Medline]
- Carolan-Olah M, Sayakhot P. A randomized controlled trial of a web-based education intervention for women with gestational diabetes mellitus. Midwifery 2019 Jan;68:39-47. [CrossRef] [Medline]
- Xie W, Dai P, Qin Y, Wu M, Yang B, Yu X. Effectiveness of telemedicine for pregnant women with gestational diabetes mellitus: an updated meta-analysis of 32 randomized controlled trials with trial sequential analysis. BMC Pregnancy Childbirth 2020 Apr 06;20(1):198 [FREE Full text] [CrossRef] [Medline]
- Mackillop L, Hirst JE, Bartlett KJ, Birks JS, Clifton L, Farmer AJ, et al. Comparing the efficacy of a mobile phone-based blood glucose management system with standard clinic care in women with gestational diabetes: randomized controlled trial. JMIR Mhealth Uhealth 2018 Mar 20;6(3):e71 [FREE Full text] [CrossRef] [Medline]
- Albert L, Capel I, García-Sáez G, Martín-Redondo P, Hernando ME, Rigla M. Managing gestational diabetes mellitus using a smartphone application with artificial intelligence (SineDie) during the COVID-19 pandemic: much more than just telemedicine. Diabetes Res Clin Pract 2020 Nov;169:108396 [FREE Full text] [CrossRef] [Medline]
- Aziz A, Zork N, Aubey JJ, Baptiste CD, D'Alton ME, Emeruwa UN, et al. Telehealth for high-risk pregnancies in the setting of the COVID-19 pandemic. Am J Perinatol 2020 Jun;37(8):800-808 [FREE Full text] [CrossRef] [Medline]
- Jackson CL, Bolen S, Brancati FL, Batts-Turner ML, Gary TL. A systematic review of interactive computer-assisted technology in diabetes care. Interactive information technology in diabetes care. J Gen Intern Med 2006 Feb;21(2):105-110 [FREE Full text] [CrossRef] [Medline]
- Kalhori SR, Hemmat M, Noori T, Heydarian S, Katigari MR. Quality evaluation of english mobile applications for gestational diabetes: app review using mobile application rating scale (MARS). Curr Diabetes Rev 2021;17(2):161-168. [CrossRef] [Medline]
- Wickramasinghe N, Gururajan R. Innovation practice using pervasive mobile technology solutions to improve population health management: a pilot study of gestational diabetes patient care in Australia. J Healthc Qual 2016;38(2):93-105. [CrossRef] [Medline]
- Carolan-Olah M, Steele C, Krenzin G. Development and initial testing of a GDM information website for multi-ethnic women with GDM. BMC Pregnancy Childbirth 2015 Jul 05;15:145 [FREE Full text] [CrossRef] [Medline]
- Bartholomew ML, Soules K, Church K, Shaha S, Burlingame J, Graham G, et al. Managing diabetes in pregnancy using cell phone/internet technology. Clin Diabetes 2015 Oct;33(4):169-174 [FREE Full text] [CrossRef] [Medline]
- Balaji B, Halperin I, Mukerji G, Lipscombe L. 1350-P: eHealth technologies for gestational diabetes mellitus: summary of features and effectiveness: scoping review. Diabetes 2020 Jun 1;69(Supplement_1):1350-P. [CrossRef]
- Garg N, Arunan SK, Arora S, Kaur K. Application of mobile technology for disease and treatment monitoring of gestational diabetes mellitus among pregnant women: a systematic review. J Diabetes Sci Technol 2022 Mar;16(2):491-497 [FREE Full text] [CrossRef] [Medline]
- Nguyen M, Hossain N, Tangri R, Shah J, Agarwal P, Thompson-Hutchison F, et al. Systematic evaluation of Canadian diabetes smartphone applications for people with type 1, type 2 and gestational diabetes. Can J Diabetes 2021 Mar;45(2):174-8.e1. [CrossRef] [Medline]
- Eberle C, Loehnert M, Stichling S. Effectivness of specific mobile health applications (mHealth-apps) in gestational diabtetes mellitus: a systematic review. BMC Pregnancy Childbirth 2021 Dec 05;21(1):808 [FREE Full text] [CrossRef] [Medline]
- Leblalta B, Kebaili H, Lee S. PDB1 telemedicine use for gestational diabetes: a systematic review and meta-analysis of randomised controlled trials. Value in Health Regional Issues 2020 Sep;22:S32. [CrossRef]
- Rasekaba TM, Furler J, Blackberry I, Tacey M, Gray K, Lim K. Telemedicine interventions for gestational diabetes mellitus: a systematic review and meta-analysis. Diabetes Res Clin Pract 2015 Oct;110(1):1-9. [CrossRef] [Medline]
- Fantinelli S, Marchetti D, Verrocchio MC, Franzago M, Fulcheri M, Vitacolonna E. Assessment of psychological dimensions in telemedicine care for gestational diabetes mellitus: a systematic review of qualitative and quantitative studies. Front Psychol 2019;10:153 [FREE Full text] [CrossRef] [Medline]
- Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 2009 Jul 21;339:b2700 [FREE Full text] [CrossRef] [Medline]
- Fleming PS, Koletsi D, Pandis N. Blinded by PRISMA: are systematic reviewers focusing on PRISMA and ignoring other guidelines? PLoS One 2014;9(5):e96407 [FREE Full text] [CrossRef] [Medline]
- Lumsden J, Edwards EA, Lawrence NS, Coyle D, Munafò MR. Gamification of cognitive assessment and cognitive training: a systematic review of applications and efficacy. JMIR Serious Games 2016 Jul 15;4(2):e11 [FREE Full text] [CrossRef] [Medline]
- Gaffney H, Mansell W, Tai S. Conversational agents in the treatment of mental health problems: mixed-method systematic review. JMIR Ment Health 2019 Oct 18;6(10):e14166 [FREE Full text] [CrossRef] [Medline]
- Garnweidner-Holme L, Hoel Andersen T, Sando MW, Noll J, Lukasse M. Health care professionals' attitudes toward, and experiences of using, a culture-sensitive smartphone app for women with gestational diabetes mellitus: qualitative study. JMIR Mhealth Uhealth 2018 May 14;6(5):e123 [FREE Full text] [CrossRef] [Medline]
- Surendran S, Lim CS, Koh GC, Yew TW, Tai ES, Foong PS. Women's usage behavior and perceived usefulness with using a mobile health application for gestational diabetes mellitus: mixed-methods study. Int J Environ Res Public Health 2021 Jun 21;18(12):6670 [FREE Full text] [CrossRef] [Medline]
- Bromuri S, Puricel S, Schumann R, Krampf J, Ruiz J, Schumacher M. An expert personal health system to monitor patients affected by gestational diabetes mellitus: a feasibility study. J Ambient Intelligence Smart Environ 2016 Mar 15;8(2):219-237. [CrossRef]
- Skar JB, Garnweidner-Holme LM, Lukasse M, Terragni L. Women's experiences with using a smartphone app (the Pregnant+ app) to manage gestational diabetes mellitus in a randomised controlled trial. Midwifery 2018 Mar;58:102-108. [CrossRef] [Medline]
- Khalil C. Understanding the adoption and diffusion of a telemonitoring solution in gestational diabetes mellitus: qualitative study. JMIR Diabetes 2019 Nov 28;4(4):e13661 [FREE Full text] [CrossRef] [Medline]
- Johnson QB, Berry DC. Impacting diabetes self-management in women with gestational diabetes mellitus using short messaging reminders. J Am Assoc Nurse Pract 2018 Jun;30(6):320-326. [CrossRef] [Medline]
- Nicholson WK, Beckham AJ, Hatley K, Diamond M, Johnson L, Green SL, et al. The Gestational Diabetes Management System (GooDMomS): development, feasibility and lessons learned from a patient-informed, web-based pregnancy and postpartum lifestyle intervention. BMC Pregnancy Childbirth 2016 Sep 21;16(1):277 [FREE Full text] [CrossRef] [Medline]
- Peleg M, Shahar Y, Quaglini S, Broens T, Budasu R, Fung N, et al. Assessment of a personalized and distributed patient guidance system. Int J Med Inform 2017 May;101:108-130. [CrossRef] [Medline]
- Peleg M, Shahar Y, Quaglini S, Fux A, García-Sáez G, Goldstein A, et al. MobiGuide: a personalized and patient-centric decision-support system and its evaluation in the atrial fibrillation and gestational diabetes domains. User Model User-Adap Inter 2017 Mar 11;27(2):159-213. [CrossRef]
- Varnfield M, Redd C, Stoney RM, Higgins L, Scolari N, Warwick R, et al. M♡THer, an mHealth system to support women with gestational diabetes mellitus: feasibility and acceptability study. Diabetes Technol Ther 2021 May;23(5):358-366 [FREE Full text] [CrossRef] [Medline]
- Pais S, Parry D, Petrova K, Rowan J. Acceptance of using an ecosystem of mobile apps for use in diabetes clinic for self-management of gestational diabetes mellitus. Stud Health Technol Inform 2017;245:188-192. [Medline]
- Edwards KJ, Bradwell HL, Jones RB, Andrade J, Shawe JA. How do women with a history of gestational diabetes mellitus use mHealth during and after pregnancy? Qualitative exploration of women's views and experiences. Midwifery 2021 Jul;98:102995. [CrossRef] [Medline]
- Gianfrancesco C, Darwin Z, McGowan L, Smith DM, Haddrill R, Carter M, et al. Exploring the feasibility of use of an online dietary assessment tool (myfood24) in women with gestational d.iabetes. Nutrients 2018 Aug 23;10(9):1147 [FREE Full text] [CrossRef] [Medline]
- Rasekaba T, Nightingale H, Furler J, Lim WK, Triay J, Blackberry I. Women, clinician and IT staff perspectives on telehealth for enhanced gestational diabetes mellitus management in an Australian rural/regional setting. Rural Remote Health 2021 Jan;21(1):5983 [FREE Full text] [CrossRef] [Medline]
- Pustozerov E, Popova P. Mobile-based decision support system for gestational diabetes mellitus. In: Proceedings of the 2018 Ural Symposium on Biomedical Engineering, Radioelectronics and Information Technology (USBEREIT). 2018 Presented at: 2018 Ural Symposium on Biomedical Engineering, Radioelectronics and Information Technology (USBEREIT); May 07-08, 2018; Yekaterinburg, Russia. [CrossRef]
- Garnweidner-Holme LM, Borgen I, Garitano I, Noll J, Lukasse M. Designing and developing a mobile smartphone application for women with gestational diabetes mellitus followed-up at diabetes outpatient clinics in Norway. Healthcare (Basel) 2015 May 21;3(2):310-323 [FREE Full text] [CrossRef] [Medline]
- Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Cochrane Bias Methods Group, Cochrane Statistical Methods Group. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ 2011 Oct 18;343:d5928 [FREE Full text] [CrossRef] [Medline]
- Appendix E Evidence tables. National Institute for Health and Care Excellence. URL: https://www.nice.org.uk/guidance/cg143/evidence/appendix-e-evidence-tables-pdf-186634335 [accessed 2021-08-12]
- CASP checklists. CASP. URL: https://casp-uk.net/casp-tools-checklists/ [accessed 2021-08-15]
- Mixed Methods Appraisal Tool (MMAT) – Version 2011. McGill University. 2011. URL: https://tinyurl.com/mr3wjpd9 [accessed 2021-08-20]
- Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006 Jan;3(2):77-101. [CrossRef]
- Tigwell G, Menzies R, Flatla D. Designing for situational visual impairments: supporting early-career designers of mobile content. In: Proceedings of the 2018 Designing Interactive Systems Conference. 2018 Presented at: DIS '18: Designing Interactive Systems Conference 2018; Jun 9 - 13, 2018; Hong Kong China. [CrossRef]
- Mays N, Pope C, Popay J. Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J Health Serv Res Policy 2005 Jul;10 Suppl 1:6-20. [CrossRef] [Medline]
- Brooke J. SUS: a quick and dirty usability scale. In: Usability Evaluation In Industry. Boca Raton, Florida, United States: CRC Press; 1996.
- Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Int J Human Comput Interact 2008 Jul 30;24(6):574-594. [CrossRef]
- Bakken S, Grullon-Figueroa L, Izquierdo R, Lee N, Morin P, Palmas W, IDEATel Consortium. Development, validation, and use of English and Spanish versions of the telemedicine satisfaction and usefulness questionnaire. J Am Med Inform Assoc 2006;13(6):660-667 [FREE Full text] [CrossRef] [Medline]
- Pérez-Ferre N, Galindo M, Fernández MD, Velasco V, Runkle I, de la Cruz MJ, et al. The outcomes of gestational diabetes mellitus after a telecare approach are not inferior to traditional outpatient clinic visits. Int J Endocrinol 2010;2010:386941 [FREE Full text] [CrossRef] [Medline]
- Yee LM, McGuire JM, Taylor SM, Niznik CM, Simon MA. "I was tired of all the sticking and poking": identifying barriers to diabetes self-care among low-income pregnant women. J Health Care Poor Underserved 2015 Aug;26(3):926-940. [CrossRef] [Medline]
- Leziak K, Birch E, Jackson J, Strohbach A, Niznik C, Yee LM. Identifying mobile health technology experiences and preferences of low-income pregnant women with diabetes. J Diabetes Sci Technol 2021 Sep;15(5):1018-1026 [FREE Full text] [CrossRef] [Medline]
- Yee L, Taylor S, Young M, Williams M, Niznik C, Simon M. Evaluation of a text messaging intervention to support self-management of diabetes during pregnancy among low-income, minority women: qualitative study. JMIR Diabetes 2020 Aug 10;5(3):e17794 [FREE Full text] [CrossRef] [Medline]
- Anderson RM, Funnell MM, Fitzgerald JT, Marrero DG. The Diabetes Empowerment Scale: a measure of psychosocial self-efficacy. Diabetes Care 2000 Jun;23(6):739-743. [CrossRef] [Medline]
- Mcmillan B, Easton K, Delaney B, Mitchell C. Reducing the risk of progression from gestational diabetes to type 2 diabetes mellitus: women’s perspectives on the content, research development and evaluation of a mobile health technology lifestyle intervention to support postnatal dietary and activity lifestyle change. Reducing the risk of type 2 diabetes mellitus in primary care after gestational diabetes. 2017 Jan. URL: https://tinyurl.com/23rw8yke [accessed 2022-10-21]
- Sherman LE, Greenfield PM. Forging friendship, soliciting support: a mixed-method examination of message boards for pregnant teens and teen mothers. Comput Human Behav 2013 Jan;29(1):75-85. [CrossRef]
- Moorhead SA, Hazlett DE, Harrison L, Carroll JK, Irwin A, Hoving C. A new dimension of health care: systematic review of the uses, benefits, and limitations of social media for health communication. J Med Internet Res 2013 Apr 23;15(4):e85 [FREE Full text] [CrossRef] [Medline]
- Dasgupta K, Da Costa D, Pillay S, De Civita M, Gougeon R, Leong A, et al. Strategies to optimize participation in diabetes prevention programs following gestational diabetes: a focus group study. PLoS One 2013;8(7):e67878 [FREE Full text] [CrossRef] [Medline]
- Vickery M, van Teijlingen E, Hundley V, Smith G, Way S, Westwood G. Midwives' views towards women using mHealth and eHealth to self-monitor their pregnancy: a systematic review of the literature. Eur J Midwifery 2020;4:36 [FREE Full text] [CrossRef] [Medline]
- Kruger DF, White K, Galpern A, Mann K, Massirio A, McLellan M, et al. Effect of modem transmission of blood glucose data on telephone consultation time, clinic work flow, and patient satisfaction for patients with gestational diabetes mellitus. J Am Acad Nurse Pract 2003 Aug;15(8):371-375. [CrossRef] [Medline]
- Overdijkink SB, Velu AV, Rosman AN, van Beukering MD, Kok M, Steegers-Theunissen RP. The usability and effectiveness of mobile health technology-based lifestyle and medical intervention apps supporting health care during pregnancy: systematic review. JMIR Mhealth Uhealth 2018 Apr 24;6(4):e109 [FREE Full text] [CrossRef] [Medline]
- Katz D, Price B, Holland S, Dalton N. Data, data everywhere,still too hard to link: ionsights from user interactions with diabetes apps. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 2018 Presented at: CHI '18: CHI Conference on Human Factors in Computing Systems; Apr 21 - 26, 2018; Montreal QC Canada. [CrossRef]
- Fu HN, Rizvi RF, Wyman JF, Adam TJ. Usability evaluation of four top-rated commercially available diabetes apps for adults with type 2 diabetes. Comput Inform Nurs 2020 Jun;38(6):274-280 [FREE Full text] [CrossRef] [Medline]
- Zhu H, Colgan J, Reddy M, Choe EK. Sharing patient-generated data in clinical practices: an interview study. AMIA Annu Symp Proc 2016;2016:1303-1312 [FREE Full text] [Medline]
- Georgsson M, Staggers N. An evaluation of patients' experienced usability of a diabetes mHealth system using a multi-method approach. J Biomed Inform 2016 Feb;59:115-129 [FREE Full text] [CrossRef] [Medline]
- Hallberg I, Ranerup A, Kjellgren K. Supporting the self-management of hypertension: patients' experiences of using a mobile phone-based system. J Hum Hypertens 2016 Feb;30(2):141-146 [FREE Full text] [CrossRef] [Medline]
- Jalil S, Myers T, Atkinson I. Design implications from the preliminary results of a telemedicine patient-technology interaction study. In: Proceedings of the 7th International Symposium on Visual Information Communication and Interaction. 2014 Presented at: VINCI '14: The 7th International Symposium on Visual Information Communication and Interaction; Aug 5 - 8, 2014; Sydney NSW Australia. [CrossRef]
- Freitas CM, Luzzardi PR, Cava RA, Winckler MA, Pimenta MS, Nedel LP. Evaluating usability of information visualization techniques. CNPq, FAPERGS, and CAPES. URL: https://dl.acm.org/doi/abs/10.1145/1556262.1556326 [accessed 2022-10-06]
- Arnhold M, Quade M, Kirch W. Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. J Med Internet Res 2014 Apr 09;16(4):e104 [FREE Full text] [CrossRef] [Medline]
- Fu H, McMahon SK, Gross CR, Adam TJ, Wyman JF. Usability and clinical efficacy of diabetes mobile applications for adults with type 2 diabetes: a systematic review. Diabetes Res Clin Pract 2017 Sep;131:70-81. [CrossRef] [Medline]
- Fontecha J, González I, Bravo J. A usability study of a mHealth system for diabetes self-management based on framework analysis and usability problem taxonomy methods. J Ambient Intell Human Comput 2019 Jun 24:1. [CrossRef]
- Kontio E, Hyrkkänen U, Saarenpää T. Experiences on telemedicine solutions for diabetes care – Case eMedic project. In: Safe and Secure Cities. Cham: Springer; 2014.
- Veazie S, Winchell K, Gilbert J, Paynter R, Ivlev I, Eden KB, et al. Rapid evidence review of mobile applications for self-management of diabetes. J Gen Intern Med 2018 Jul;33(7):1167-1176 [FREE Full text] [CrossRef] [Medline]
- Verwey R, van der Weegen S, Spreeuwenberg M, Tange H, van der Weijden T, de Witte L. A pilot study of a tool to stimulate physical activity in patients with COPD or type 2 diabetes in primary care. J Telemed Telecare 2014 Jan;20(1):29-34. [CrossRef] [Medline]
- Nes AA, van Dulmen S, Eide E, Finset A, Kristjánsdóttir OB, Steen IS, et al. The development and feasibility of a web-based intervention with diaries and situational feedback via smartphone to support self-management in patients with diabetes type 2. Diabetes Res Clin Pract 2012 Sep;97(3):385-393. [CrossRef] [Medline]
- Burns MN, Begale M, Duffecy J, Gergle D, Karr CJ, Giangrande E, et al. Harnessing context sensing to develop a mobile intervention for depression. J Med Internet Res 2011 Aug 12;13(3):e55 [FREE Full text] [CrossRef] [Medline]
- McCloud RF, Okechukwu CA, Sorensen G, Viswanath K. Beyond access: barriers to internet health information seeking among the urban poor. J Am Med Inform Assoc 2016 Nov;23(6):1053-1059 [FREE Full text] [CrossRef] [Medline]
- Simblett S, Greer B, Matcham F, Curtis H, Polhemus A, Ferrão J, et al. Barriers to and facilitators of engagement with remote measurement technology for managing health: systematic review and content analysis of findings. J Med Internet Res 2018 Jul 12;20(7):e10480 [FREE Full text] [CrossRef] [Medline]
- Ristevski B, Chen M. Big data analytics in medicine and healthcare. J Integr Bioinform 2018 May 10;15(3):42-46 [FREE Full text] [CrossRef] [Medline]
- Wake DJ, He J, Czesak AM, Mughal F, Cunningham SG. MyDiabetesMyWay: an evolving national data driven diabetes self-management platform. J Diabetes Sci Technol 2016 Sep;10(5):1050-1058 [FREE Full text] [CrossRef] [Medline]
- Lapointe L, Rivard S. Getting physicians to accept new information technology: insights from case studies. CMAJ 2006 May 23;174(11):1573-1578 [FREE Full text] [CrossRef] [Medline]
- Goodrich DE, Buis LR, Janney AW, Ditty MD, Krause CW, Zheng K, et al. Integrating an internet-mediated walking program into family medicine clinical practice: a pilot feasibility study. BMC Med Inform Decis Mak 2011 Jun 24;11:47 [FREE Full text] [CrossRef] [Medline]
- Kujala S, Ammenwerth E, Kolanen H, Ervast M. Applying and extending the FITT framework to identify the challenges and opportunities of successful eHealth services for patient self-management: qualitative interview study. J Med Internet Res 2020 Aug 12;22(8):e17696 [FREE Full text] [CrossRef] [Medline]
- Klaassen B, van Beijnum BJ, Hermens HJ. Usability in telemedicine systems-A literature survey. Int J Med Inform 2016 Sep;93:57-69. [CrossRef] [Medline]
- Zapata BC, Fernández-Alemán JL, Idri A, Toval A. Empirical studies on usability of mHealth apps: a systematic literature review. J Med Syst 2015 Feb;39(2):1. [CrossRef] [Medline]
|BG: blood glucose|
|GDM: gestational diabetes mellitus|
|HP: health professional|
|mHealth: mobile health|
|PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses|
|RCT: randomized controlled trial|
|SUS: system usability scale|
Edited by R Kukafka; submitted 18.05.22; peer-reviewed by T Rasekaba, Y Shahar; comments to author 04.07.22; revised version received 16.07.22; accepted 28.09.22; published 27.10.22Copyright
©Ladan Safiee, Daniel John Rough, Heather Whitford. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 27.10.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.