Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Journal Description

The Journal of Medical Internet Research (JMIR) is the pioneer open access eHealth journal and is the flagship journal of JMIR Publications. It is a leading health services and digital health journal globally in terms of quality/visibility (Journal Impact Factor™ 7.4 (Clarivate, 2023)) and is also the largest journal in the field. The journal is ranked #1 on Google Scholar in the 'Medical Informatics' discipline. The journal focuses on emerging technologies, medical devices, apps, engineering, telehealth and informatics applications for patient education, prevention, population health and clinical care.

JMIR is indexed in all major literature indices including National Library of Medicine(NLM)/MEDLINE, Sherpa/Romeo, PubMed, PMCScopus, Psycinfo, Clarivate (which includes Web of Science (WoS)/ESCI/SCIE), EBSCO/EBSCO Essentials, DOAJ, GoOA and others. As a leading high-impact journal in its disciplines, ranking Q1 in both the 'Medical Informatics' and 'Health Care Sciences and Services' categories, it is a selective journal complemented by almost 30 specialty JMIR sister journals, which have a broader scope, and which together receive over 6.000 submissions a year. 

As an open access journal, we are read by clinicians, allied health professionals, informal caregivers, and patients alike, and have (as with all JMIR journals) a focus on readable and applied science reporting the design and evaluation of health innovations and emerging technologies. We publish original research, viewpoints, and reviews (both literature reviews and medical device/technology/app reviews). Peer-review reports are portable across JMIR journals and papers can be transferred, so authors save time by not having to resubmit a paper to a different journal but can simply transfer it between journals. 

We are also a leader in participatory and open science approaches, and offer the option to publish new submissions immediately as preprints, which receive DOIs for immediate citation (eg, in grant proposals), and for open peer-review purposes. We also invite patients to participate (eg, as peer-reviewers) and have patient representatives on editorial boards.

As all JMIR journals, the journal encourages Open Science principles and strongly encourages publication of a protocol before data collection. Authors who have published a protocol in JMIR Research Protocols get a discount of 20% on the Article Processing Fee when publishing a subsequent results paper in any JMIR journal.

Be a widely cited leader in the digital health revolution and submit your paper today!

 

Recent Articles:

  • AI-generated image, in response to the request "A healthcare professional or technician using telemonitoring equipment to remotely monitor a patient's cardiac device", (Generator: DALL-E3/OpenAI, April 17, 2024, Requestor: Sarah Raes). Source: Created with DALL-E3, an AI system by OpenAI; Copyright: N/A (AI-generated image); URL: https://www.jmir.org/2024/1/e47616; License: Public Domain (CC0).

    Investigating the Cost-Effectiveness of Telemonitoring Patients With Cardiac Implantable Electronic Devices: Systematic Review

    Abstract:

    Background: Telemonitoring patients with cardiac implantable electronic devices (CIEDs) can improve their care management. However, the results of cost-effectiveness studies are heterogeneous. Therefore, it is still a matter of debate whether telemonitoring is worth the investment. Objective: This systematic review aims to investigate the cost-effectiveness of telemonitoring patients with CIEDs, focusing on its key drivers, and the impact of the varying perspectives. Methods: A systematic review was performed in PubMed, Web of Science, Embase, and EconLit. The search was completed on July 7, 2022. Studies were included if they fulfilled the following criteria: patients had a CIED, comparison with standard care, and inclusion of health economic evaluations (eg, cost-effectiveness analyses and cost-utility analyses). Only complete and peer-reviewed studies were included, and no year limits were applied. The exclusion criteria included studies with partial economic evaluations, systematic reviews or reports, and studies without standard care as a control group. Besides general study characteristics, the following outcome measures were extracted: impact on total cost or income, cost or income drivers, cost or income drivers per patient, cost or income drivers as a percentage of the total cost impact, incremental cost-effectiveness ratios, or cost-utility ratios. Quality was assessed using the Consensus Health Economic Criteria checklist. Results: Overall, 15 cost-effectiveness analyses were included. All studies were performed in Western countries, mainly Europe, and had primarily a male participant population. Of the 15 studies, 3 (20%) calculated the incremental cost-effectiveness ratio, 1 (7%) the cost-utility ratio, and 11 (73%) the health and cost impact of telemonitoring. In total, 73% (11/15) of the studies indicated that telemonitoring of patients with implantable cardioverter-defibrillators (ICDs) and cardiac resynchronization therapy ICDs was cost-effective and cost-saving, both from a health care and patient perspective. Cost-effectiveness results for telemonitoring of patients with pacemakers were inconclusive. The key drivers for cost reduction from a health care perspective were hospitalizations and scheduled in-office visits. Hospitalization costs were reduced by up to US $912 per patient per year. Scheduled in-office visits included up to 61% of the total cost reduction. Key drivers for cost reduction from a patient perspective were loss of income, cost for scheduled in-office visits and transport. Finally, of the 15 studies, 8 (52%) reported improved quality of life, with statistically significance in only 1 (13%) study (P=.03). Conclusions: From a health care and patient perspective, telemonitoring of patients with an ICD or a cardiac resynchronization therapy ICD is a cost-effective and cost-saving alternative to standard care. Inconclusive results were found for patients with pacemakers. However, telemonitoring can lead to a decrease in providers’ income, mainly due to a lack of reimbursement. Introducing appropriate reimbursement could make telemonitoring sustainable for providers while still being cost-effective from a health care payer perspective. Trial Registration: PROSPERO CRD42022322334; https://tinyurl.com/puunapdr

  • Source: Pexels; Copyright: Anna Shvets; URL: https://www.pexels.com/photo/elderly-happy-woman-making-video-call-online-on-modern-tablet-5231330/; License: Licensed by JMIR.

    Psychometric Evaluation of a Tablet-Based Tool to Detect Mild Cognitive Impairment in Older Adults: Mixed Methods Study

    Abstract:

    Background: With the rapid aging of the global population, the prevalence of mild cognitive impairment (MCI) and dementia is anticipated to surge worldwide. MCI serves as an intermediary stage between normal aging and dementia, necessitating more sensitive and effective screening tools for early identification and intervention. The BrainFx SCREEN is a novel digital tool designed to assess cognitive impairment. This study evaluated its efficacy as a screening tool for MCI in primary care settings, particularly in the context of an aging population and the growing integration of digital health solutions. Objective: The primary objective was to assess the validity, reliability, and applicability of the BrainFx SCREEN (hereafter, the SCREEN) for MCI screening in a primary care context. We conducted an exploratory study comparing the SCREEN with an established screening tool, the Quick Mild Cognitive Impairment (Qmci) screen. Methods: A concurrent mixed methods, prospective study using a quasi-experimental design was conducted with 147 participants from 5 primary care Family Health Teams (FHTs; characterized by multidisciplinary practice and capitated funding) across southwestern Ontario, Canada. Participants included health care practitioners, patients, and FHT administrative executives. Individuals aged ≥55 years with no history of MCI or diagnosis of dementia rostered in a participating FHT were eligible to participate. Participants were screened using both the SCREEN and Qmci. The study also incorporated the Geriatric Anxiety Scale–10 to assess general anxiety levels at each cognitive screening. The SCREEN’s scoring was compared against that of the Qmci and the clinical judgment of health care professionals. Statistical analyses included sensitivity, specificity, internal consistency, and test-retest reliability assessments. Results: The study found that the SCREEN’s longer administration time and complex scoring algorithm, which is proprietary and unavailable for independent analysis, presented challenges. Its internal consistency, indicated by a Cronbach α of 0.63, was below the acceptable threshold. The test-retest reliability also showed limitations, with moderate intraclass correlation coefficient (0.54) and inadequate κ (0.15) values. Sensitivity and specificity were consistent (63.25% and 74.07%, respectively) between cross-tabulation and discrepant analysis. In addition, the study faced limitations due to its demographic skew (96/147, 65.3% female, well-educated participants), the absence of a comprehensive gold standard for MCI diagnosis, and financial constraints limiting the inclusion of confirmatory neuropsychological testing. Conclusions: The SCREEN, in its current form, does not meet the necessary criteria for an optimal MCI screening tool in primary care settings, primarily due to its longer administration time and lower reliability. As the number of digital health technologies increases and evolves, further testing and refinement of tools such as the SCREEN are essential to ensure their efficacy and reliability in real-world clinical settings. This study advocates for continued research in this rapidly advancing field to better serve the aging population. Trial Registration:

  • AI-generated image, in response to the request "A graph consisting of genes as DNA helices, drugs as chemical structures, and diseases as human icons" (Generator: Midjourney November 20, 2023; Requestor: Jason H Moore). Source: Created with Midjourney, an AI system by OpenAI; Copyright: N/A (AI-Generated image); URL: https://cdn.midjourney.com/277784fd-c6f3-489c-9f0d-d14174aa8792/0_1.webp; License: Public Domain (CC0).

    The Alzheimer’s Knowledge Base: A Knowledge Graph for Alzheimer Disease Research

    Abstract:

    Background: As global populations age and become susceptible to neurodegenerative illnesses, new therapies for Alzheimer disease (AD) are urgently needed. Existing data resources for drug discovery and repurposing fail to capture relationships central to the disease’s etiology and response to drugs. Objective: We designed the Alzheimer’s Knowledge Base (AlzKB) to alleviate this need by providing a comprehensive knowledge representation of AD etiology and candidate therapeutics. Methods: We designed the AlzKB as a large, heterogeneous graph knowledge base assembled using 22 diverse external data sources describing biological and pharmaceutical entities at different levels of organization (eg, chemicals, genes, anatomy, and diseases). AlzKB uses a Web Ontology Language 2 ontology to enforce semantic consistency and allow for ontological inference. We provide a public version of AlzKB and allow users to run and modify local versions of the knowledge base. Results: AlzKB is freely available on the web and currently contains 118,902 entities with 1,309,527 relationships between those entities. To demonstrate its value, we used graph data science and machine learning to (1) propose new therapeutic targets based on similarities of AD to Parkinson disease and (2) repurpose existing drugs that may treat AD. For each use case, AlzKB recovers known therapeutic associations while proposing biologically plausible new ones. Conclusions: AlzKB is a new, publicly available knowledge resource that enables researchers to discover complex translational associations for AD drug discovery. Through 2 use cases, we show that it is a valuable tool for proposing novel therapeutic hypotheses based on public biomedical knowledge.

  • Source: National Cancer Institute (NCI) Visuals Online; Copyright: Daniel Sone; URL: https://visualsonline.cancer.gov/details.cfm?imageid=9709; License: Public Domain (CC0).

    Evaluating Algorithmic Bias in 30-Day Hospital Readmission Models: Retrospective Analysis

    Abstract:

    Background: The adoption of predictive algorithms in health care comes with the potential for algorithmic bias, which could exacerbate existing disparities. Fairness metrics have been proposed to measure algorithmic bias, but their application to real-world tasks is limited. Objective: This study aims to evaluate the algorithmic bias associated with the application of common 30-day hospital readmission models and assess the usefulness and interpretability of selected fairness metrics. Methods: We used 10.6 million adult inpatient discharges from Maryland and Florida from 2016 to 2019 in this retrospective study. Models predicting 30-day hospital readmissions were evaluated: LACE Index, modified HOSPITAL score, and modified Centers for Medicare & Medicaid Services (CMS) readmission measure, which were applied as-is (using existing coefficients) and retrained (recalibrated with 50% of the data). Predictive performances and bias measures were evaluated for all, between Black and White populations, and between low- and other-income groups. Bias measures included the parity of false negative rate (FNR), false positive rate (FPR), 0-1 loss, and generalized entropy index. Racial bias represented by FNR and FPR differences was stratified to explore shifts in algorithmic bias in different populations. Results: The retrained CMS model demonstrated the best predictive performance (area under the curve: 0.74 in Maryland and 0.68-0.70 in Florida), and the modified HOSPITAL score demonstrated the best calibration (Brier score: 0.16-0.19 in Maryland and 0.19-0.21 in Florida). Calibration was better in White (compared to Black) populations and other-income (compared to low-income) groups, and the area under the curve was higher or similar in the Black (compared to White) populations. The retrained CMS and modified HOSPITAL score had the lowest racial and income bias in Maryland. In Florida, both of these models overall had the lowest income bias and the modified HOSPITAL score showed the lowest racial bias. In both states, the White and higher-income populations showed a higher FNR, while the Black and low-income populations resulted in a higher FPR and a higher 0-1 loss. When stratified by hospital and population composition, these models demonstrated heterogeneous algorithmic bias in different contexts and populations. Conclusions: Caution must be taken when interpreting fairness measures’ face value. A higher FNR or FPR could potentially reflect missed opportunities or wasted resources, but these measures could also reflect health care use patterns and gaps in care. Simply relying on the statistical notions of bias could obscure or underplay the causes of health disparity. The imperfect health data, analytic frameworks, and the underlying health systems must be carefully considered. Fairness measures can serve as a useful routine assessment to detect disparate model performances but are insufficient to inform mechanisms or policy changes. However, such an assessment is an important first step toward data-driven improvement to address existing health disparities.

  • While one participant undergoes a virtual kiosk test, the doctor examines their MRI scan results. Source: Image created by the authors; Copyright: The Authors; URL: https://www.jmir.org/2024/1/e54538/; License: Creative Commons Attribution (CC-BY).

    Integrating Biomarkers From Virtual Reality and Magnetic Resonance Imaging for the Early Detection of Mild Cognitive Impairment Using a Multimodal Learning...

    Abstract:

    Background: Early detection of mild cognitive impairment (MCI), a transitional stage between normal aging and Alzheimer disease, is crucial for preventing the progression of dementia. Virtual reality (VR) biomarkers have proven to be effective in capturing behaviors associated with subtle deficits in instrumental activities of daily living, such as challenges in using a food-ordering kiosk, for early detection of MCI. On the other hand, magnetic resonance imaging (MRI) biomarkers have demonstrated their efficacy in quantifying observable structural brain changes that can aid in early MCI detection. Nevertheless, the relationship between VR-derived and MRI biomarkers remains an open question. In this context, we explored the integration of VR-derived and MRI biomarkers to enhance early MCI detection through a multimodal learning approach. Objective: We aimed to evaluate and compare the efficacy of VR-derived and MRI biomarkers in the classification of MCI while also examining the strengths and weaknesses of each approach. Furthermore, we focused on improving early MCI detection by leveraging multimodal learning to integrate VR-derived and MRI biomarkers. Methods: The study encompassed a total of 54 participants, comprising 22 (41%) healthy controls and 32 (59%) patients with MCI. Participants completed a virtual kiosk test to collect 4 VR-derived biomarkers (hand movement speed, scanpath length, time to completion, and the number of errors), and T1-weighted MRI scans were performed to collect 22 MRI biomarkers from both hemispheres. Analyses of covariance were used to compare these biomarkers between healthy controls and patients with MCI, with age considered as a covariate. Subsequently, the biomarkers that exhibited significant differences between the 2 groups were used to train and validate a multimodal learning model aimed at early screening for patients with MCI among healthy controls. Results: The support vector machine (SVM) using only VR-derived biomarkers achieved a sensitivity of 87.5% and specificity of 90%, whereas the MRI biomarkers showed a sensitivity of 90.9% and specificity of 71.4%. Moreover, a correlation analysis revealed a significant association between MRI-observed brain atrophy and impaired performance in instrumental activities of daily living in the VR environment. Notably, the integration of both VR-derived and MRI biomarkers into a multimodal SVM model yielded superior results compared to unimodal SVM models, achieving higher accuracy (94.4%), sensitivity (100%), specificity (90.9%), precision (87.5%), and F1-score (93.3%). Conclusions: The results indicate that VR-derived biomarkers, characterized by their high specificity, can be valuable as a robust, early screening tool for MCI in a broader older adult population. On the other hand, MRI biomarkers, known for their high sensitivity, excel at confirming the presence of MCI. Moreover, the multimodal learning approach introduced in our study provides valuable insights into the improvement of early MCI detection by integrating a diverse set of biomarkers.

  • AI-generated image, in response to the request "Rescue workers using smartphones during wildfire." Generator: NightCafe, March 23, 2024. Requestor: Ejemai Eboreime. Source: Created using NightCafe; Copyright: N/A (AI-generated image); URL: https://www.jmir.org/2024/1/e49929; License: Public Domain (CC0).

    Mobile Apps to Support Mental Health Response in Natural Disasters: Scoping Review

    Abstract:

    Background: Disasters are becoming more frequent due to the impact of extreme weather events attributed to climate change, causing loss of lives, property, and psychological trauma. Mental health response to disasters emphasizes prevention and mitigation, and mobile health (mHealth) apps have been used for mental health promotion and treatment. However, little is known about their use in the mental health components of disaster management. Objective: This scoping review was conducted to explore the use of mobile phone apps for mental health responses to natural disasters and to identify gaps in the literature. Methods: We identified relevant keywords and subject headings and conducted comprehensive searches in 6 electronic databases. Studies in which participants were exposed to a man-made disaster were included if the sample also included some participants exposed to a natural hazard. Only full-text studies published in English were included. The initial titles and abstracts of the unique papers were screened by 2 independent review authors. Full texts of the selected papers that met the inclusion criteria were reviewed by the 2 independent reviewers. Data were extracted from each selected full-text paper and synthesized using a narrative approach based on the outcome measures, duration, frequency of use of the mobile phone apps, and the outcomes. This scoping review was reported according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews). Results: Of the 1398 papers retrieved, 5 were included in this review. A total of 3 studies were conducted on participants exposed to psychological stress following a disaster while 2 were for disaster relief workers. The mobile phone apps for the interventions included Training for Life Skills, Sonoma Rises, Headspace, Psychological First Aid, and Substance Abuse and Mental Health Services Administration (SAMHSA) Behavioural Health Disaster Response Apps. The different studies assessed the effectiveness or efficacy of the mobile app, feasibility, acceptability, and characteristics of app use or predictors of use. Different measures were used to assess the effectiveness of the apps’ use as either the primary or secondary outcome. Conclusions: A limited number of studies are exploring the use of mobile phone apps for mental health responses to disasters. The 5 studies included in this review showed promising results. Mobile apps have the potential to provide effective mental health support before, during, and after disasters. However, further research is needed to explore the potential of mobile phone apps in mental health responses to all hazards.

  • Source: Freepik; Copyright: fabrikasimf; URL: https://www.freepik.com/free-photo/computer-tablet-hands-doctor_21018841.htm; License: Licensed by JMIR.

    Comparing Contact Tracing Through Bluetooth and GPS Surveillance Data: Simulation-Driven Approach

    Abstract:

    Background: Accurate and responsive epidemiological simulations of epidemic outbreaks inform decision-making to mitigate the impact of pandemics. These simulations must be grounded in quantities derived from measurements, among which the parameters associated with contacts between individuals are notoriously difficult to estimate. Digital contact tracing data, such as those provided by Bluetooth beaconing or GPS colocating, can provide more precise measures of contact than traditional methods based on direct observation or self-reporting. Both measurement modalities have shortcomings and are prone to false positives or negatives, as unmeasured environmental influences bias the data. Objective: We aim to compare GPS colocated versus Bluetooth beacon–derived proximity contact data for their impacts on transmission models’ results under community and types of diseases. Methods: We examined the contact patterns derived from 3 data sets collected in 2016, with participants comprising students and staff from the University of Saskatchewan in Canada. Each of these 3 data sets used both Bluetooth beaconing and GPS localization on smartphones running the Ethica Data (Avicenna Research) app to collect sensor data about every 5 minutes over a month. We compared the structure of contact networks inferred from proximity contact data collected with the modalities of GPS colocating and Bluetooth beaconing. We assessed the impact of sensing modalities on the simulation results of transmission models informed by proximate contacts derived from sensing data. Specifically, we compared the incidence number, attack rate, and individual infection risks across simulation results of agent-based susceptible-exposed-infectious-removed transmission models of 4 different contagious diseases. We have demonstrated their differences with violin plots, 2-tailed t tests, and Kullback-Leibler divergence. Results: Both network structure analyses show visually salient differences in proximity contact data collected between GPS colocating and Bluetooth beaconing, regardless of the underlying population. Significant differences were found for the estimated attack rate based on distance threshold, measurement modality, and simulated disease. This finding demonstrates that the sensor modality used to trace contact can have a significant impact on the expected propagation of a disease through a population. The violin plots of attack rate and Kullback-Leibler divergence of individual infection risks demonstrated discernible differences for different sensing modalities, regardless of the underlying population and diseases. The results of the t tests on attack rate between different sensing modalities were mostly significant (P<.001). Conclusions: We show that the contact networks generated from these 2 measurement modalities are different and generate significantly different attack rates across multiple data sets and pathogens. While both modalities offer higher-resolution portraits of contact behavior than is possible with most traditional contact measures, the differential impact of measurement modality on the simulation outcome cannot be ignored and must be addressed in studies only using a single measure of contact in the future.

  • Source: Freepik; Copyright: Racool_studio; URL: https://www.freepik.com/free-photo/portrait-doctor_9833255.htm; License: Licensed by JMIR.

    Comparing Open-Access Database and Traditional Intensive Care Studies Using Machine Learning: Bibliometric Analysis Study

    Abstract:

    Background: Intensive care research has predominantly relied on conventional methods like randomized controlled trials. However, the increasing popularity of open-access, free databases in the past decade has opened new avenues for research, offering fresh insights. Leveraging machine learning (ML) techniques enables the analysis of trends in a vast number of studies. Objective: This study aims to conduct a comprehensive bibliometric analysis using ML to compare trends and research topics in traditional intensive care unit (ICU) studies and those done with open-access databases (OADs). Methods: We used ML for the analysis of publications in the Web of Science database in this study. Articles were categorized into “OAD” and “traditional intensive care” (TIC) studies. OAD studies were included in the Medical Information Mart for Intensive Care (MIMIC), eICU Collaborative Research Database (eICU-CRD), Amsterdam University Medical Centers Database (AmsterdamUMCdb), High Time Resolution ICU Dataset (HiRID), and Pediatric Intensive Care database. TIC studies included all other intensive care studies. Uniform manifold approximation and projection was used to visualize the corpus distribution. The BERTopic technique was used to generate 30 topic-unique identification numbers and to categorize topics into 22 topic families. Results: A total of 227,893 records were extracted. After exclusions, 145,426 articles were identified as TIC and 1301 articles as OAD studies. TIC studies experienced exponential growth over the last 2 decades, culminating in a peak of 16,378 articles in 2021, while OAD studies demonstrated a consistent upsurge since 2018. Sepsis, ventilation-related research, and pediatric intensive care were the most frequently discussed topics. TIC studies exhibited broader coverage than OAD studies, suggesting a more extensive research scope. Conclusions: This study analyzed ICU research, providing valuable insights from a large number of publications. OAD studies complement TIC studies, focusing on predictive modeling, while TIC studies capture essential qualitative information. Integrating both approaches in a complementary manner is the future direction for ICU research. Additionally, natural language processing techniques offer a transformative alternative for literature review and bibliometric analysis.

  • Source: Unsplash; Copyright: Surface; URL: https://unsplash.com/photos/a-woman-with-dreadlocks-sitting-in-front-of-a-laptop-computer--ZFvSWK4L28; License: Licensed by JMIR.

    Digital Interventions for Recreational Cannabis Use Among Young Adults: Systematic Review, Meta-Analysis, and Behavior Change Technique Analysis of...

    Abstract:

    Background: The high prevalence of cannabis use among young adults poses substantial global health concerns due to the associated acute and long-term health and psychosocial risks. Digital modalities, including websites, digital platforms, and mobile apps, have emerged as promising tools to enhance the accessibility and availability of evidence-based interventions for young adults for cannabis use. However, existing reviews do not consider young adults specifically, combine cannabis-related outcomes with those of many other substances in their meta-analytical results, and do not solely target interventions for cannabis use. Objective: We aimed to evaluate the effectiveness and active ingredients of digital interventions designed specifically for cannabis use among young adults living in the community. Methods: We conducted a systematic search of 7 databases for empirical studies published between database inception and February 13, 2023, assessing the following outcomes: cannabis use (frequency, quantity, or both) and cannabis-related negative consequences. The reference lists of included studies were consulted, and forward citation searching was also conducted. We included randomized studies assessing web- or mobile-based interventions that included a comparator or control group. Studies were excluded if they targeted other substance use (eg, alcohol), did not report cannabis use separately as an outcome, did not include young adults (aged 16-35 y), had unpublished data, were delivered via teleconference through mobile phones and computers or in a hospital-based setting, or involved people with mental health disorders or substance use disorders or dependence. Data were independently extracted by 2 reviewers using a pilot-tested extraction form. Authors were contacted to clarify study details and obtain additional data. The characteristics of the included studies, study participants, digital interventions, and their comparators were summarized. Meta-analysis results were combined using a random-effects model and pooled as standardized mean differences. Results: Of 6606 unique records, 19 (0.29%) were included (n=6710 participants). Half (9/19, 47%) of these articles reported an intervention effect on cannabis use frequency. The digital interventions included in the review were mostly web-based. A total of 184 behavior change techniques were identified across the interventions (range 5-19), and feedback on behavior was the most frequently used (17/19, 89%). Digital interventions for young adults reduced cannabis use frequency at the 3-month follow-up compared to control conditions (including passive and active controls) by −6.79 days of use in the previous month (95% CI −9.59 to −4.00; P<.001). Conclusions: Our results indicate the potential of digital interventions to reduce cannabis use in young adults but raise important questions about what optimal exposure dose could be more effective, both in terms of intervention duration and frequency. Further high-quality research is still needed to investigate the effects of digital interventions on cannabis use among young adults. Trial Registration: PROSPERO CRD42020196959; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=196959

  • Source: freepik.com; Copyright: Freepik; URL: https://www.freepik.com/free-photo/young-doctor-making-sure-little-girl-is-fine-after-vaccination_12892208.htm; License: Licensed by JMIR.

    Twitter Analysis of Health Care Workers’ Sentiment and Discourse Regarding Post–COVID-19 Condition in Children and Young People: Mixed Methods Study

    Abstract:

    Background: The COVID-19 pandemic has had a significant global impact, with millions of cases and deaths. Research highlights the persistence of symptoms over time (post–COVID-19 condition), a situation of particular concern in children and young people with symptoms. Social media such as Twitter (subsequently rebranded as X) could provide valuable information on the impact of the post–COVID-19 condition on this demographic. Objective: With a social media analysis of the discourse surrounding the prevalence of post–COVID-19 condition in children and young people, we aimed to explore the perceptions of health care workers (HCWs) concerning post–COVID-19 condition in children and young people in the United Kingdom between January 2021 and January 2022. This will allow us to contribute to the emerging knowledge on post–COVID-19 condition and identify critical areas and future directions for researchers and policy makers. Methods: From a pragmatic paradigm, we used a mixed methods approach. Through discourse, keyword, sentiment, and image analyses, using Pulsar and InfraNodus, we analyzed the discourse about the experience of post–COVID-19 condition in children and young people in the United Kingdom shared on Twitter between January 1, 2021, and January 31, 2022, from a sample of HCWs with Twitter accounts whose biography identifies them as HCWs. Results: We obtained 300,000 tweets, out of which (after filtering for relevant tweets) we performed an in-depth qualitative sample analysis of 2588 tweets. The HCWs were responsive to announcements issued by the authorities regarding the management of the COVID-19 pandemic in the United Kingdom. The most frequent sentiment expressed was negative. The main themes were uncertainty about the future, policies and regulations, managing and addressing the COVID-19 pandemic and post–COVID-19 condition in children and young people, vaccination, using Twitter to share scientific literature and management strategies, and clinical and personal experiences. Conclusions: The perceptions described on Twitter by HCWs concerning the presence of the post–COVID-19 condition in children and young people appear to be a relevant and timely issue and responsive to the declarations and guidelines issued by health authorities over time. We recommend further support and training strategies for health workers and school staff regarding the manifestations and treatment of children and young people with post–COVID-19 condition.

  • ​A resident is being checked using a fully self-service fundus camera. Source: Image created by the Authors; Copyright: The Authors; URL: https://www.jmir.org/2024/1/e45545/; License: Creative Commons Attribution + Noncommercial + NoDerivatives (CC-BY-NC-ND).

    Service Quality and Residents’ Preferences for Facilitated Self-Service Fundus Disease Screening: Cross-Sectional Study

    Abstract:

    Background: Fundus photography is the most important examination in eye disease screening. A facilitated self-service eye screening pattern based on the fully automatic fundus camera was developed in 2022 in Shanghai, China; it may help solve the problem of insufficient human resources in primary health care institutions. However, the service quality and residents’ preference for this new pattern are unclear. Objective: This study aimed to compare the service quality and residents’ preferences between facilitated self-service eye screening and traditional manual screening and to explore the relationships between the screening service’s quality and residents’ preferences. Methods: We conducted a cross-sectional study in Shanghai, China. Residents who underwent facilitated self-service fundus disease screening at one of the screening sites were assigned to the exposure group; those who were screened with a traditional fundus camera operated by an optometrist at an adjacent site comprised the control group. The primary outcome was the screening service quality, including effectiveness (image quality and screening efficiency), physiological discomfort, safety, convenience, and trustworthiness. The secondary outcome was the participants’ preferences. Differences in service quality and the participants’ preferences between the 2 groups were compared using chi-square tests separately. Subgroup analyses for exploring the relationships between the screening service’s quality and residents’ preference were conducted using generalized logit models. Results: A total of 358 residents enrolled; among them, 176 (49.16%) were included in the exposure group and the remaining 182 (50.84%) in the control group. Residents’ basic characteristics were balanced between the 2 groups. There was no significant difference in service quality between the 2 groups (image quality pass rate: P=.79; average screening time: P=.57; no physiological discomfort rate: P=.92; safety rate: P=.78; convenience rate: P=.95; trustworthiness rate: P=.20). However, the proportion of participants who were willing to use the same technology for their next screening was significantly lower in the exposure group than in the control group (P<.001). Subgroup analyses suggest that distrust in the facilitated self-service eye screening might increase the probability of refusal to undergo screening (P=.02). Conclusions: This study confirms that the facilitated self-service fundus disease screening pattern could achieve good service quality. However, it was difficult to reverse residents’ preferences for manual screening in a short period, especially when the original manual service was already excellent. Therefore, the digital transformation of health care must be cautious. We suggest that attention be paid to the residents’ individual needs. More efficient man-machine collaboration and personalized health management solutions based on large language models are both needed.

  • Source: The Authors/ Placeit; Copyright: The Authors/Placeit; URL: https://www.jmir.org/2024/1/e56655/; License: Licensed by JMIR.

    Quality of Answers of Generative Large Language Models Versus Peer Users for Interpreting Laboratory Test Results for Lay Patients: Evaluation Study

    Abstract:

    Background: Although patients have easy access to their electronic health records and laboratory test result data through patient portals, laboratory test results are often confusing and hard to understand. Many patients turn to web-based forums or question-and-answer (Q&A) sites to seek advice from their peers. The quality of answers from social Q&A sites on health-related questions varies significantly, and not all responses are accurate or reliable. Large language models (LLMs) such as ChatGPT have opened a promising avenue for patients to have their questions answered. Objective: We aimed to assess the feasibility of using LLMs to generate relevant, accurate, helpful, and unharmful responses to laboratory test–related questions asked by patients and identify potential issues that can be mitigated using augmentation approaches. Methods: We collected laboratory test result–related Q&A data from Yahoo! Answers and selected 53 Q&A pairs for this study. Using the LangChain framework and ChatGPT web portal, we generated responses to the 53 questions from 5 LLMs: GPT-4, GPT-3.5, LLaMA 2, MedAlpaca, and ORCA_mini. We assessed the similarity of their answers using standard Q&A similarity-based evaluation metrics, including Recall-Oriented Understudy for Gisting Evaluation, Bilingual Evaluation Understudy, Metric for Evaluation of Translation With Explicit Ordering, and Bidirectional Encoder Representations from Transformers Score. We used an LLM-based evaluator to judge whether a target model had higher quality in terms of relevance, correctness, helpfulness, and safety than the baseline model. We performed a manual evaluation with medical experts for all the responses to 7 selected questions on the same 4 aspects. Results: Regarding the similarity of the responses from 4 LLMs; the GPT-4 output was used as the reference answer, the responses from GPT-3.5 were the most similar, followed by those from LLaMA 2, ORCA_mini, and MedAlpaca. Human answers from Yahoo data were scored the lowest and, thus, as the least similar to GPT-4–generated answers. The results of the win rate and medical expert evaluation both showed that GPT-4’s responses achieved better scores than all the other LLM responses and human responses on all 4 aspects (relevance, correctness, helpfulness, and safety). LLM responses occasionally also suffered from lack of interpretation in one’s medical context, incorrect statements, and lack of references. Conclusions: By evaluating LLMs in generating responses to patients’ laboratory test result–related questions, we found that, compared to other 4 LLMs and human answers from a Q&A website, GPT-4’s responses were more accurate, helpful, relevant, and safer. There were cases in which GPT-4 responses were inaccurate and not individualized. We identified a number of ways to improve the quality of LLM responses, including prompt engineering, prompt augmentation, retrieval-augmented generation, and response evaluation.

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Latest Submissions Open for Peer-Review:

View All Open Peer Review Articles
  • Online Forum Discourse on Abortion: A Multifaceted Analysis of Medical, Emotional, and Legal Conversations

    Date Submitted: Apr 15, 2024

    Open Peer Review Period: Apr 18, 2024 - Jun 13, 2024

    Background: Abortion is one of the most common procedures worldwide. Despite this, access to abortion on demand is restricted in many countries, including Poland. As a result, many women undergo the p...

    Background: Abortion is one of the most common procedures worldwide. Despite this, access to abortion on demand is restricted in many countries, including Poland. As a result, many women undergo the procedure without medical supervision, exposing themselves to potential health consequences. Objective: The study aimed to qualitatively identify the themes present in abortion forums to analyze the problems faced by women. The forums were then quantitatively analyzed to determine which issues are potentially the most prevalent. Methods: The most popular forums on abortion were determined. An initial pilot study was conducted for qualitative analysis, followed by a manual quantitative investigation. Results: Analyzing 13,397 responses from 370 threads on four forums revealed "Abortion Process Progression" as the most discussed theme, signaling a high demand for information and support. "Emotional and Psychological Aspects" and "Medical and Pharmacological Aspects" were also significant, indicating a need for holistic care. Conclusions: This study highlights the critical need for information and support for women navigating abortion, particularly where access is restricted. It calls for addressing multifaceted challenges and promoting policy changes and support networks to enhance women's health and rights in abortion contexts. Further research is encouraged to refine support strategies.

  • Real-Time Delirium Prediction in Intensive Care Units: A Machine-Learning-Based Model Using Monitoring Data

    Date Submitted: Apr 15, 2024

    Open Peer Review Period: Apr 18, 2024 - Jun 13, 2024

    Background: Delirium in intensive care units (ICUs) poses a significant challenge and affects not only global patient outcomes but also healthcare efficiency. The development of an accurate, real-time...

    Background: Delirium in intensive care units (ICUs) poses a significant challenge and affects not only global patient outcomes but also healthcare efficiency. The development of an accurate, real-time prediction model for delirium represents a crucial advancement in critical care and addresses the need for timely intervention and resource optimization in ICUs worldwide. Objective: This study aimed to create a novel machine-learning model for real-time delirium prediction in ICUs using the random forest method. Methods: Distinct from existing approaches, the model integrated routinely available clinical data such as age, sex, and patient monitoring device outputs to ensure its practicality and adaptability in diverse clinical settings. Using these data, we trained a random forest model to predict the occurrence of delirium in patients. Retrospective data were used for training and internal validation. Retrospective data were used for training and internal validation. Prospective data were used to confirm the reliability of the delirium determination. CAM-ICU records assessed by ICU nurses were collected and validated by qualified investigators performing CAM-ICU measurements prospectively on the same patients and then determining Cohen's kappa coefficient. In addition, we additionally verified the performance of the model using a temporal validation cohort and performed external validation using data from an external hospital. Results: The Kappa coefficient between labels generated by ICU nurses and prospectively verified by qualified researchers was 0.81. This indicates that the recorded CAM-ICU results were reliable. The model showed robust performance in internal validation (area under the receiver operating characteristic curve [AUROC]: 0.82, area under the precision–recall curve [AUPRC]: 0.62) and maintained its accuracy in temporal validation (AUROC: 0.73, AUPRC: 0.85), confirming its reliability over time. External validation across various patient populations and time frames further confirmed its effectiveness (AUROC: 0.84, AUPRC: 0.77). Conclusions: Our model represents a significant breakthrough in the management of delirium in ICUs and offers a real-time, data-driven approach for improving patient care. The proven accuracy and adaptability of this model in various clinical scenarios underscore its potential to substantially improve patient outcomes and operational efficiency in ICUs. The integration of this model into current healthcare practices may lead to major advancements in early delirium detection and treatment, thereby reducing the ICU stay and improving the recovery rate.

  • Measuring the Digital Skills in nursing degree students

    Date Submitted: Apr 15, 2024

    Open Peer Review Period: Apr 18, 2024 - Jun 13, 2024

    Background: In the healthcare field the digital revolution has changed the way in which healthcare is provided through the prevention, diagnosis and monitoring of people's health. In Catalonia, work h...

    Background: In the healthcare field the digital revolution has changed the way in which healthcare is provided through the prevention, diagnosis and monitoring of people's health. In Catalonia, work has been conducted to evaluate the digital competence (DC) of healthcare professionals using a validated test based on the ACTIC (accreditation of competence in information and communication technologies) model. It is therefore important Objective: To determine the DC level of nursing students as future healthcare professionals. Methods: The aim of this study is to analyze the current DC level of students taking the Degree in Nursing at the Terres de l’Ebre Campus, Universitat Rovira i Virgili (URV), Catalonia, Spain. We have used a questionnaire to evaluate the DC level of these students. Results: Our sample comprised 147 students from various modules of the Degree in Nursing. Our results show differences in levels of self-perception and DC but also differences in the competence of students across the various academic years. Conclusions: Evaluating the level of competence of nursing degree students is fundamental for practising and enhancing the most important digital competencies required in the field of professional nursing

  • Revolutionizing Healthcare: The Transformative Impact of LLMs in Medicine

    Date Submitted: Apr 1, 2024

    Open Peer Review Period: Apr 17, 2024 - Jun 12, 2024

    Large language models (LLMs) are rapidly advancing medical AI, offering revolutionary changes in healthcare. These models excel in natural language processing, enhancing clinical support, diagnosis, t...

    Large language models (LLMs) are rapidly advancing medical AI, offering revolutionary changes in healthcare. These models excel in natural language processing, enhancing clinical support, diagnosis, treatment, and medical research. Breakthroughs like GPT-4 and BERT demonstrate LLMs' evolution through improved computing power and data. However, their high hardware requirements are being addressed through technological advancements. LLMs are unique in processing multimodal data, thereby improving emergency, elder care, and digital medical procedures. Challenges include ensuring their empirical reliability and mitigating biases while maintaining privacy and accountability. The paper emphasizes the need for human-centric, bias-free LLMs for personalized medicine and advocates for equitable development and access. LLMs hold promise for transformative impacts in healthcare.

  • Use of Behavior Change Techniques in Online HIV Prevention Programmes for Adolescents and Young People: A Systematic Review

    Date Submitted: Apr 14, 2024

    Open Peer Review Period: Apr 17, 2024 - Jun 12, 2024

    Background: HIV infections have caused severe public health and economic burdens to the world. Adolescents and young people continue to constitute a large proportion of newly diagnosed HIV cases. Onli...

    Background: HIV infections have caused severe public health and economic burdens to the world. Adolescents and young people continue to constitute a large proportion of newly diagnosed HIV cases. Online health interventions will be the trend to prevent the rising HIV epidemic. Objective: HIV infections have caused severe public health and economic burdens to the world. Adolescents and young people continue to constitute a large proportion of newly diagnosed HIV cases. Online health interventions will be the trend to prevent the rising HIV epidemic. Methods: Four databases were searched and studies from 2008 to January 2023 were screened. Eligible randomized controlled trials (RCTs) were included. Basic study characteristics, intervention strategies and study results were extracted and compared for data analysis. BCTs used were identified according to the definitions from the BCT taxonomy by Michie and Abraham in 2008. Frequencies of BCTs were counted to uncover the commonly used techniques in online HIV prevention programs. Results: A total of 27 RCTs are included in this review. Commonly used BCTs identified include prompt intention formation (100%, 27/27), provide information about behavior-health link (96%, 26/27), provide general encouragement (96%, 26/27), provide information on consequences (89%, 24/27), and provide instruction (85%, 23/27). BCTs with a provision nature are more observed in interventions with significant improvement in HIV knowledge, while more use of BCTs with the nature of initiating actions are observed in studies with significant increase in condom-use self-efficacy. Studies with a significant increase in condom use have used BCTs that manage and maintain behavior the most among the three outcomes. Conclusions: This is the first systematic review that examined the use of BCTs in online HIV prevention interventions for adolescents and young people. Commonly used BCTs found in this review can serve as important references for constructing more effective online interventions in the future. Clinical Trial: N/A

  • Associations between Low Self-Control, Meaning in Life, Internet Gaming Disorder Symptoms, and Functioning in Chinese Adolescents: A Cross-sectional Structural Equation Model

    Date Submitted: Apr 13, 2024

    Open Peer Review Period: Apr 17, 2024 - Jun 12, 2024

    Background: Internet gaming disorder (IGD) is a prevalent public health issue among adolescents. Few studies have, however, examined the relationships between IGD symptoms, low self-control, and meani...

    Background: Internet gaming disorder (IGD) is a prevalent public health issue among adolescents. Few studies have, however, examined the relationships between IGD symptoms, low self-control, and meaning in life (MIL). Objective: The present study aimed to examine the mediating role of IGD symptoms in the relationships between low self-control and meaning in life and adolescents’ family and school functioning. Methods: A sample of 2,064 adolescents (46.9% females, mean age = 14.6 years) was recruited from five middle schools in Sichuan, China in 2022. Indirect effects of low self-control and MIL on family and school functioning via IGD symptoms were analyzed via structural equation modeling (SEM). Results: All scales showed satisfactory model fit and scalar measurement invariance by gender. Males showed significantly greater IGD symptoms and lower levels of self-control than females. Impulsivity, temper, search for meaning, and lower presence of meaning were significantly associated with greater IGD symptoms. There were significant indirect effects from impulsivity, temper, and presence of meaning to family and school functioning via IGD symptoms. Multigroup SEM across gender found that the positive association between search for meaning and IGD symptoms existed in males but not females. Presence of meaning significantly and negatively moderated the association between impulsivity and IGD symptoms. Conclusions: The findings support a mediating role of IGD symptoms in the relationships between low self-control and MIL and functioning and a buffering role of MIL on the associations between impulsivity and IGD symptoms among the ethnic minority adolescents. The results have implications for targeted interventions to help males with lower self-control and presence of meaning.