Abstract
Background: Electronic early warning/track-and-trigger systems (EW/TTS) are crucial for patient monitoring, detecting clinical deterioration (CD), and activating rapid response teams. Understanding the current level of automation in EW/TTS is essential.
Objective: This study aimed to provide a comprehensive overview and critical assessment of electronic EW/TTS, including automated features, algorithms, and technologies, following a published registered study protocol.
Methods: Based on the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, we included studies from PubMed, Web of Science, and Scopus published between January 2010 and December 2025 describing EW/TTS applied in real-world settings, and electronic systems for CD detection. We excluded studies outside the clinical context or those that used manual scoring charts. We applied a descriptive narrative approach and a methodological quality assessment according to the Joanna Briggs Institute Critical Appraisal Checklist.
Results: After removing outliers and duplicates, the query returned 1181 studies. The selected studies (n=43) reported CD as the primary objective in 24 of 44 (54.5%) reported primary objectives, with ICU transfer in 16 of 68 (23.5%) reported secondary objectives, and mortality prediction in 10 of 68 (14.7%) reported secondary objectives. EW/TTS primarily relied on vital signs and assessment scores, accounting for 42 of 67 (62.7%) reported clinical indexes to detect and predict CD effectively. Among the included systems, 18 of 43 (41.9%) had a measured automation level, 11 of 43 (25.6%) had a managed automation level, and 7 of 43 (16.3%) had a defined automation level. The studies focused on several technological domains, with a strong emphasis on data analytics (24/43, 55.8%) and hardware technologies (7/43, 16.3%). Predictive algorithms, including statistical and machine learning approaches, were used in 11 of 43 (25.6%) systems. Interoperable connectivity was reported in 30 of 43 (69.8%) systems, including connectivity with electronic health records, wearable devices, and communication platforms such as Ascom Unite, as well as integrations using standards such as Health Level Seven Fast Healthcare Interoperability Resource and Health Level Seven. Evaluations of the systems showed earlier warning (14/70, 20%), higher accuracy (12/70, 17.1%), and lower specificity (9/70, 12.9%) as the main reported outcomes. Electronic EW/TTS were most prevalent in the United States (15/43, 34.9%), the United Kingdom (6/43, 14%), and the Netherlands (6/43, 14%).
Conclusions: Current EW/TTS systems implemented a measured level of automation and primarily focused on patient monitoring in hospital surgery wards. More than half of EW/TTS featured data exchange capabilities and connectivity with other systems. Reported outcomes of EW/TTS included early warning, high accuracy, and lower specificity. However, the included evidence was limited by heterogeneous prediction targets, inconsistent performance metrics and time horizons, and poor reporting of development history and system failure. Using clinically validated wearable devices and establishing a standardized data collection framework may further improve system accuracy and reliability.
International Registered Report Identifier (IRRID): RR2-10.1371/journal.pone.0283010
doi:10.2196/58233
Keywords
Introduction
Early Warning/Track-and-Trigger Systems (EW/TTS) identify patients at risk of physiological deterioration and alert appropriate medical teams in hospital wards or intensive care units (ICUs) [,]. These systems are part of hospitals’ efforts to identify patients with clinical deterioration (CD) early []. These patients are prone to worsening, leading to an increased risk of adverse events (AEs) such as organ dysfunction, prolonged hospital stay, disability, or death []. Vital signs (VS) provide essential information for assessing patients’ clinical status, as 85% of severe AE cases result from abnormal VS [,]. Thus, any acute deviation from a patient’s normal range of VS increases the risk of CD and AE []. Physicians and care providers consider the physiological shift from one clinical state to a worse status as CD. To record a quick and simple assessment of an individual’s level of consciousness, especially in an emergency, physicians apply the alert, verbal, pain, and unresponsive (AVPU) method.
In 1997, Morgan et al [] introduced a manual Early Warning Score (EWS) chart to detect CD. This chart calculates EWS using five critical VS: systolic blood pressure, heart rate (HR), respiratory rate (RR), body temperature, and blood oxygen saturation (SpO2) []. To use the chart and calculate EWS, nurses scale and aggregate VS based on patients’ records []. Later, the Royal College of Physicians, in collaboration with National Health Services in the United Kingdom, gradually substituted the manual chart with electronic versions [] due to limitations such as deteriorated patient misidentification, mis-scoring, particularly in acute cases, delay in data recording, nurses’ difficulties in score trends analysis and interpretation [], delays in CD detection, interruptions, stimuli from multiple alarms, and delays in rapid response team (RRT) activation []. Patient safety is not compromised []; hence, the electronic EW/TTS evolved gradually to improve existing systems and overcome the limitations. Now, EW/TTS automatically monitors patients’ VS and alerts health professionals at the moment of CD. EW/TTS consists of afferent and efferent limbs and mainly receives input from bedside VS observations. The afferent limb generates the EWS for CD detection, and the efferent limb represents the appropriate response and actions of the RRT [].
Electronic EW/TTS offers advantages in practice. They provide data entry with bedside capture of VS using a handheld device with automatic calculation of EW/TTS and embedded alerts, with a higher level of accuracy from 81% to 100%, and significantly improve patient-centered clinical outcomes [,]. Furthermore, automated alerts increase timely clinical attendance at patients’ bedside for EWS > 5 from 67% to 96% []. They are widely used in the United States, United Kingdom, and Australia [] and provide faster and more accurate calculations of EW/TTS compared to a manual method []. Despite these advantages, several limitations of current electronic EW/TTS have prompted further improvement. Patients prefer not to be continuously attached to an unwieldy VS monitoring machine. Only 16% of patients in hospital wards remain connected to their monitors for a 72-hour study period, while the rest desire greater mobility and comfort [,]. Developing systems that use new technologies, such as ambient sensors, may mitigate this problem []. The limitations of wearable devices and the emergence of new technologies inspire the creation of a private diagnostic space using an unobtrusive sensor approach for VS monitoring and CD detection []. Furthermore, current versions of electronic EW/TTS require the continuous presence of clinicians, and thus, the systems still need a higher level of automation []. Only a few devices are capable of measuring all VS automatically. However, none have yet been tested adequately or mature enough for widespread acceptance [].
Besides VS, other physiological data also contribute to the detection of CD [-]. A system requirement considers clinical factors to improve the afferent limb. The clinical factors and data from ventilators, dialysis machines, other devices, and VS feed the system []. Concurrently, the efferent limb of electronic EW/TTS needs enhancement for RRT’s timely activation. Wood, Chaboyer, and Carr revealed the inconsistent functionality of current electronic EW/TTS for both limbs [] because they focus on a single set of observations at one point in time, rather than observational trends, and compare datasets over a period []. Therefore, current systems may not ensure patient safety due to misidentification of CD events.
Modern technology and system automation have further advanced EW/TTS to overcome current limitations. Although automation in health monitoring can provide numerous benefits, there are challenges and considerations, including data privacy, security, ethical concerns, patient safety, and human oversight in critical decision-making []. Consequently, the level of automation needs harmonization with other essential prerequisites.
It is important to use a structured framework that distinguishes early, partially implemented automation from more advanced, measurable, and continuously improving systems to understand the maturity of automation in EW/TTS. This review used the capability maturity model (CMM), as modified by Informatics-Savvy Health Organizations (ISHO), which delineates 6 tiers of digital health maturity: absent, initial, managed, defined, measured, and optimized [].
In a previous requirement analysis, we identified that an intelligent EW/TTS requires five subsystems to effectively monitor patients, detect cardiac arrests, and alert the RRT: (1) direct patient monitoring, (2) electronic health record (EHR), (3) clinical decision support, (4) remote patient monitoring, and (5) dashboards and registries []. Each subsystem needs appropriate technologies for adequate patient monitoring, cardiac arrest detection, and automatic alarming of the RRT. To this end, we need to know the current level of available EW/TTS from a technical perspective. So far, reviews have focused on manual systems of score calculation for specific patient groups, particularly in hospital settings []. These reviews mainly target the efficiency, strengths, and limitations of manual EWS for enhancing care levels and preventing AE []. The introductory review by Despins on automated CD detection in the ICU does not include electronic EW/TTS to detect CD and activate RRT [].
This study aims to conduct a comprehensive review of the in-depth application of EW/TTS for different target groups of patients in both private spaces and hospital settings. In previous work, we proposed a registered study protocol to systematically assess the current status of EW/TTS in terms of automation capabilities, applied algorithms, and performance []. Furthermore, we address the functionality of current systems and justify the suitability of available EW/TTS in terms of automation and intelligence.
Methods
Study Design
We published the details of the study and the design rationale in a registered study protocol [] and in the PROSPERO database (registration number: CRD322838). We conducted the review according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines and flowchart () [] to answer the following questions:
- Which automated features does the EW/TTS consider?
- Which predictive algorithms, including statistical and machine learning approaches, are applied?
- Which technologies and communication standards do EW/TTS use?
- Which settings host EW/TTS (hospital wards or others)?
- Which clinical parameters or VS do EW/TTS monitor?
- What are the primary and secondary purposes of EW/TTS?
- Does EW/TTS analyze data for CD detection or prediction?
- What are the results of evaluating EW/TTS and its algorithms?
Search Strategy and Selection Criteria
We searched the databases PubMed, Web of Science, and Scopus without restrictions on the document type. We used the MeSH to determine the relevant keywords and their synonyms. Two clinical specialists in the areas of emergency medicine and medical informatics approved the search terms. We composed English terms to search the databases by title, abstract, and keywords to find relevant studies published between January 2010 and December 2025. The search strategy covered two main concept areas relevant to the technical details of EW/TTS: technological and clinical terminology. We provided further details in the registered study protocol () [].
Eligibility Criteria
We predefined the eligibility criteria presented in in the registered study protocol [] for the focused analysis of automated features, algorithms, and technologies of EW/TTS.
Inclusion criteria
- All original studies are in the English language.
- The studies that report electronic systems for CD detection via human vital sign monitoring.
- The studies that report electronic EW/TTS have already been developed and applied in the real world.
- The reported EW/TTSs are applied either for physiological data monitoring or other risk factors of CD detection or monitoring.
- The reported EW/TTS in any setting, including hospitals, clinics, or smart ambients.
- The reported EW/TTS across all types, including bed-connected systems, wearable devices, and unobtrusive sensing technologies.
Exclusion criteria
- Studies conducted outside the medical or health care context.
- The reports of EW scoring charts that manually calculate risk scores such as MEWS, EWS, PEWS, and MEWT.
- Studies published in languages other than English.
- Studies available only as abstracts.
- Study protocols and ongoing work descriptions were excluded unless they described an existing EW/TTS and provided sufficient technical detail relevant to this review.
- Studies that do not provide any details on the system’s technologies, algorithms, or features.
- Studies that report only models, system designs, or prototypes.
Selection Process
After searching the databases, we transferred the results into an EndNote library and removed duplicates. We imported the remaining records into Covidence [] to support systematic screening. Four authors (SRNK, MDT, PH, and VMGS) with expertise in Medical Informatics and Biomedical Engineering independently reviewed the titles and abstracts to identify relevant studies. Subsequently, they assessed the full texts against the predefined inclusion and exclusion criteria following the PRISMA framework. We summarized the selection process in the PRISMA flow diagram (Figure S1 in ). During data extraction, the reviewers developed an Excel-based data extraction sheet that included variables reflecting the study aims and key features and functions of EW/TTSs. Two additional authors (MH and NG) contributed to data extraction and helped resolve inconsistencies in the extracted data through discussion until consensus was reached.
Data Extraction and Analysis
After completing the selection process, four authors (SRNK, MDT, PH, and VMGS) extracted the relevant parameters from the included studies. These parameters included the first author’s last name, title, publication year, country, study duration, study design, study population, hospital ward, primary and secondary objectives, clinical index, automation level, technology type, predictive algorithms, including statistical and machine learning approaches, and reported outcomes.
The extracted data were analyzed using a descriptive narrative approach, with results organized according to the review objectives. To assess automation levels, we adopted the CMM, as adapted by ISHO []. This framework evaluates the stages of maturity of digital health systems and defines six levels: absent, initial, managed, defined, measured, and optimized. Their operational definitions and decision rules are summarized in . The six levels are defined as follows: level 1, absent (no meaningful automation in data acquisition, analysis, or alerting); level 2, initial (limited, isolated automation without an integrated workflow); level 3, managed (automation implemented in practice without standardization or performance tracking); level 4, defined (structured and integrated automation workflow with limited measurement or feedback); level 5, measured (automation supported by explicit evaluation or performance monitoring); and level 6, optimized (automation continuously refined through feedback or quality improvement). The adapted CMM was used to assess workflow and system automation maturity rather than the sophistication of the underlying analytic method. To improve transparency and reproducibility, we operationalized the adapted CMM maturity levels using explicit decision rules based on the degree of automation reported for each EW/TTS. Classification considered whether the system included automated data acquisition, automated data analysis and/or score calculation, automated alert generation or escalation support, integration with other digital systems, and evidence of performance monitoring or continuous improvement. Reviewers independently assigned each EW/TTS to one maturity level using these criteria and the operational definitions presented in . Disagreements were resolved through discussion until consensus was reached. When a study did not provide sufficient evidence to support a higher maturity level, the lower level was assigned based on the available evidence. Furthermore, we grouped the applied technologies into six mutually exclusive domains: Data Analytics, Hardware, Data Collection, Communication, Software, and Unimplemented Systems; their operational definitions and representative examples are summarized in .
| Maturity level | Operational definition or decision rule | Typical EW/TTS characteristics | Representative examples |
| Absent | No meaningful automation in data acquisition, analysis, or alerting. | Manual or minimally digitized workflow. | Pediatric rapid response system []: manual human-triggered activation with no electronic monitoring, scoring, or alerting. |
| Initial | Limited, isolated automation without an integrated workflow. | Standalone digital function; fragmented automation. | Wearable heart attack detection system []: a standalone ECG chest belt wearable system operating independently from clinical workflows. |
| Managed | Automation is implemented in practice without standardization or performance tracking. | Operational system; partial workflow integration. | ViSi Mobile and HealthPatch []: continuous wearable vital sign monitoring implemented on general wards as a pilot project, but has not yet been integrated into the standardized clinical workflow. |
| Defined | Structured and integrated automation workflow with limited measurement or feedback. | Organized workflow; some interoperability or standardization. | Two-tiered clinical warning system []: structured architecture featuring EMR-based risk identification with wireless sensor monitoring and automated nurse notification, but the real-time event detection remains at the feasibility stage. |
| Measured | Automation supported by explicit evaluation or performance monitoring. | Integrated system with tracked outcomes or metrics. | Advance alert monitor []: automated EHR-based predictive model implemented across 19 hospitals with remote monitoring, featuring explicit outcome evaluation, including reduced mortality and ICU admissions. |
| Optimized | Automation is continuously refined through feedback or quality improvement. | Mature system with iterative optimization. | ESCALATION system []: evidence-based pediatric early warning system developed using an iterative methodology, stakeholder coproduction, and prototyping, incorporating refinement through feedback from diverse stakeholder groups. |
aEW/TTS: early warning/track-and-trigger systems.
bECG: electrocardiogram.
cEMR: electronic medical record.
dEHR: electronic health record.
eICU: intensive care unit.
| Technology domain | Operational definition and decision rule | Typical EW/TTS characteristics | Representative examples |
| Data analytics | Technologies used for data processing, score calculation, prediction, visualization, or decision support. | Risk scoring, prediction, dashboards, trend analysis. | Advance alert monitor []: automated EHR-based risk model |
| Hardware | Physical monitoring or computing devices used in EW/TTS. | Wearables, patches, bedside monitors, sensors. | ViSi Mobile & HealthPatch []: wearable monitoring hardware |
| Data collection | Technologies used to capture or acquire patient data before analysis. | ECG capture, sensor input, vital-sign acquisition. | None among included studies. |
| Communication | Technologies supporting alerts, messaging, connectivity, or information transfer. | Alert transmission, escalation, interoperability, wireless exchange. | SEND [,]: digital notification and alerting system |
| Software | Digital applications or platform functions supporting EW/TTS workflow. | Mobile apps, dashboards, APIs, digital charting. | Abuelómetro []: mobile application |
| Unimplemented systems | Proposed, conceptual, or feasibility-stage systems not yet deployed in routine care. | Prototype, pilot, simulation, feasibility-stage workflow. | Two-tiered clinical warning system []: feasibility-stage architecture |
aEW/TTS: early warning/track-and-trigger systems.
bEHR: electronic health record.
cECG: electrocardiogram.
Quality Assessment
We assessed the methodological quality of the included studies using the Joanna Briggs Institute (JBI) critical appraisal checklist with 8 main items []. We adapted the JBI case report checklist, which considers the step-by-step cycle of system development ().
Results
Overview
Using PRISMA [], we identified 1181 studies and removed 133 records due to duplication (). We further excluded 927 records at the title and abstract level. We screened 121 full-text records, of which 43 studies [,,,,-,-] met the eligibility criteria (Figure S1 in ). We classified the studies according to the Study Design Classification (SDC) framework []. The analysis included descriptive studies (cross-sectional: 10/43, 23.3% [,,,,,,-,], qualitative: 5/43, 11.6% [,,,,]) and analytical studies. The latter consisted of experimental (randomized clinical trials: 3/43, 7% [,,], nonrandomized clinical trials: 9/43, 20.9% [,,,,,,,,]) and observational designs (cohort: 6/43 [,,,,,], 14%, retrospective: 10/43, 23.3% [,,,,,,,,,]). There were reports from 16 countries; 26 of 43 (60.5%) [,,,,,,,,,-,,,-,,] studies were from the United States, United Kingdom, and the Netherlands. The studies ranged from 0.8 to 78 months, with an average of 22.8 months ().

| Authors | Year | Country | Study design | Study duration (month) | System name | Chart | Patient population | Primary objective | Secondary objective | Connectivity | Data analysis algorithm usage |
| Youssef Ali Amer et al [] | 2020 | Belgium, Netherlands | Cohort | 24 | NS | A | Cardiology, postsurgical dialysis | Score calculation | EWS error reduction | NS | HybridKNN-LS-SVM |
| Bassin et al [] | 2023 | Australia | Non-RCT | 28 | BTF + DI | A | NS | CD | RRT activation, ICU transfer, Death, Length of stay | EHR | Logistic regression |
| Bell et al [] | 2021 | Australia | Non-RCT | 32 | Deterioration Index (DI) | A | NS | CD, Adverse event | ICU transfer, Adverse events, Death | EHR | Logistic regression |
| Breteler et al [] | 2020 | Netherlands | Cross-sectional | 7 | NS | A | Atrial fibrillation | Adverse event | Heart rate | None | None |
| Chowdhury et al [] | 2019 | Qatar | Cross-sectional | 24 | NS | A | NS | Adverse event | Heart rate | None | SVM (Polynomial Kernel) |
| Durán-Vega et al [] | 2019 | Mexico | Cross-sectional | NS | Abuelómetro | A | NS | Nurse satisfaction | Clinical intervention | Wearable device | None |
| Edelson et al [] | 2024 | United States | Retrospective | 48 | eCART | A | NS | CD | ICU transfer, Death, EWS error reduction | EHR | eCART |
| Ehara et al [] | 2024 | Japan | Retrospective | 3 | VSI | A | NS | CD | ICU transfer | EHR | Multivariate probabilistic model |
| Emmanuel and Torres [] | 2018 | United States | Retrospective | 5 | EPIC | C | NS | Clinical intervention | Score calculation | None | None |
| Escobar et al [] | 2020 | United States | Non-RCT | 42 | AAM Advance Alert Monitor | A | NS | CD | ICU transfer, Length of stay | EHR | Logistic regression |
| Fletcher et al [] | 2017 | United States | Cross-sectional | 5 | RRT | A | NS | ICU transfer | Death | NS | None |
| Gill et al [] | 2022 | Australia | Cross-sectional | 4 | Escalation | C | NS | CD | Clinical intervention | None | None |
| González et al [] | 2025 | Mexico | Retrospective | 40 | NEURO-EWS | A | Neurological conditions | CD | Death, ICU transfer, Clinical intervention | EHR | Logistic regression |
| Gorham et al [] | 2020 | United States | Retrospective | 78 | VRI | C | Hospitalized | CD | Score calculation | None | None |
| Hackmann et al [] | 2011 | United States | Retrospective | 38 | NS | A | NS | ICU transfer | Clinical intervention | EHR | None |
| Hanson et al [] | 2010 | United States | Non-RCT | 45 | PRRS | C | NS | CD | Death | NS | None |
| Hobensack et al [] | 2024 | United States | Qualitative | 7 | Concern | A | NS | CD | Early sepsis | EHR with FHIR | None, Only rule-based score calculation |
| Howard et al [] | 2022 | United States | Qualitative | 22 | Decision System | A | NS | Death | Length of stay | EHR | None |
| Huete-Garcia & Rodriguez-Lopez [] | 2024 | Spain | Retrospective | 73 | AI-mNEWS2-Lab | A | NS | CD | ICU transfer, Adverse events, Death, Length of stay, EWS error reduction | EHR | Logistic regression, Decision trees, Neural networks, Ensemble models |
| Huff et al [] | 2019 | United States | Qualitative | 4 | VAS | A | Chronic conditions | Early sepsis | CD | None | None |
| Itelman et al ] | 2022 | Israel | Retrospective | NS | NS | A | Hospitalized | CD | NS | None | None |
| Jerry et al [] | 2025 | Netherlands | Cohort | 8 | ViQtor | A | NS | CD | Adverse events, ICU transfer, RRT activation, Clinical intervention | EHR | None |
| Lakshman et al [] | 2025 | India | Retrospective | 6 | S-MEWS | A | NS | CD | ICU transfer | Wearable device | None |
| Lang et al [] | 2019 | United Kingdom | Cross-sectional | 9 | eObs | A | Hospitalized | Nurse satisfaction | NS | None | None |
| Lee et al [] | 2017 | ROK | RCT | 3 | MES | A | Pulmonary disease | Clinical intervention | RRT activation | EHR | None |
| Padilla et al [] | 2025 | United States | Non-RCT | 18 | E-MEWS | PW | NS | CD | Death, EWS error reduction, Adverse events | EHR | None |
| Picker et al [] | 2017 | United States | Retrospective | 12 | NS | A | Palliative care | Death | Clinical intervention | EHR | None |
| Posthuma et al [] | 2020 | United Kingdom, France, Netherlands | Qualitative | NS | Sensium Vitals | A | NS | CD | Clinical intervention | NS | None |
| Rossetti et al [] | 2021 | United States | Cross-sectional | 12 | CONCERN CDS | A | NS | ICU transfer | Length of stay | EHR with FHIR | NLP, decision trees, and logistic regression |
| Schmidt et al [] | 2015 | United Kingdom | Cross-sectional | 84 | EPSS VitalPAC | A | NS | Death | CD | EHR | None |
| Shields et al [] | 2016 | United States | Cross-sectional | 37 | NS | PW | NS | Death | ICU transfer | EHR | None |
| Teheux et al [] | 2019 | Netherlands | Cohort | 47 | Press | C | Cardio- pulmonary disease | ICU transfer | CD | EHR | None |
| Tomasi et al [] | 2020 | Canada | Non-RCT | 3 | Bedside PEWS | C | NS | Nurse satisfaction | Score calculation | EHR | None |
| Tran et al [] | 2025 | Canada | Cohort | 12 | VSM + EWS | A | NS | CD | ICU transfer, RRT activation, Nurse satisfaction | EHR with HL7 | None, Only rule-based score calculation |
| Un et al [] | 2021 | Hong Kong | Cross-sectional | 0.8 | NS | A | SARS- COVID-19 | CD | Score calculation | NS | None |
| Verma et al [] | 2024 | Canada | Non-RCT | 67 | CHARTwatch | A | NS | CD | Death, ICU transfer, Length of stay | EHR | Time-aware MARS model |
| Weenk et al [] | 2017 | Netherlands | Qualitative | 4 | ViSi Mobile & Health Patch | A | Internal medicine, Surgical ward | CD | Score calculation | Wearable device | None |
| Weller et al [] | 2018 | United States | Non-RCT | 5 | VSAS | A | Neurosurgical patients | RRT activation | ICU transfer | EHR with Ascom platform (Morrisville) | None |
| Wilson et al [] | 2016 | United Kingdom | Cohort | 12 | eT&T | A | NS | CD | Score calculation | EHR | None |
| Wong et al [] | 2015 | United Kingdom | RCT | 9 | SEND | A | NS | Score calculation | Heart rate | EHR with FHIR | None |
| Wong et al [] | 2024 | United Kingdom | RCT | 20 | SEND | A | NS | CD | ICU transfer, Clinical intervention, Length of stay, Death | EHR | None, Only rule-based score calculation |
| Wu et al [] | 2021 | Taiwan | Cohort | 15 | E-NEWS | A | Cancer, Cardio-vascular, Neurological disorders | CD | ICU transfer | EHR | None |
| Yadav et al [] | 2024 | India | Non-RCT | 3 | Dozee-EWS | A | NS | CD | ICU transfer, EWS error reduction | Proprietary cloud platform (NS) | None, Only rule-based score calculation |
aStudy design (the type of study used to report or evaluate the EW/TTS): RCT: randomized clinical trial, non-RCT: nonrandomized clinical trial.
bSystem name (the name of the EW/TTS): NS: not specified.
cChart (the type of chart or tool used to monitor and assess patients in three main groups): A: adult, C: children, PW: pregnant women.
dPatient population (the specific disease, condition, or patient group addressed by the EW/TTS): NS: not specified.
ePrimary objective (The main goal or objective of the EW/TTS): NS: not specified, RRT = rapid response team, PEWS: pediatric early warning system.
fSecondary objective (Additional goals or objectives of the EW/TTS, if any): NS = not specified.
gConnectivity (If the EW/TTS is connected with other systems and the applied standard is reported, it is reported in a format such as EHR with HL7): EHR = electronic health record, HL7 = Health Level Seven, NS = not specified, None = system was not connected.
hData analysis algorithm (predictive algorithms used in the EW/TTS, including statistical and machine learning approaches): Rule-based score calculation = automated score calculation based on predefined rules or thresholds, such as EWS tables.
iFHIR: Fast Healthcare Interoperability Resource.
Electronic EW/TTS Characteristics
Different EWS charts for adults, pediatric patients, and pregnant women reflect each group’s physiological norms and clinical risks, ensuring accurate assessment and timely intervention. This differentiation enhances the sensitivity and specificity of monitoring, improving patient outcomes through tailored clinical responses [,,,,]. We identified different participant groups across the included studies: adults older than 18 years (35/43, 81.3% [,,,,-,-,,,-,-,-]), children, patients younger than 18 years (6/43, 14% [,,,,,]), and pregnant women (2/43, 4.7% [,]). Most EW/TTS were applied in health monitoring in hospitals (39 of 46, 84.8% reported settings [,,,,,-,-,,-,,,-,,,]). Health care providers use them primarily in hospitals: surgery wards 12 of 46 (26.2%) reported settings [,,-,,,,,,], general wards 10 of 46 (21.7%) reported settings [,,,,,,,,,], pediatric wards 6 of 46 (13%) reported settings [,,,,,], emergency wards 3 of 46 (6.5%) reported settings [,,], and other wards including ICU, respiratory, maternal, oncology, and short-stay 8 of 46 (17.4%) [,,,,,] reported settings. In addition, 7 of 46 (15.2%) reported settings [,,,,,,] applied in other settings (Figure S2 in ); one study applied VS monitoring for CD detection in cars [] while another applied it in older adult care residences and hospices [].
The primary objectives of EW/TTS were CD detection in 24 of 44 reported primary objectives (54.5%), ICU transfer in 4 of 44 (9.1%), death in 4 of 44 (9.1%), and other objectives in 12 of 44 (27.3%). The secondary objectives were ICU transfer in 16 of 68 reported secondary objectives (23.5%), death in 10 of 68 (14.7%), clinical intervention in 8 of 68 (11.8%), length of stay in 7 of 68 (10.3%), and other objectives in 27 of 68 (39.7%; ).

To detect and predict CD, the EW/TTS used various clinical indexes, such as VS, assessment scores, clinical conditions, diagnostic results, demographics, and specialized measurements. VS parameters such as HR, RR, SpO2, BT, and BP, along with measurements such as stroke volume and cardiac index, dominate the landscape in 29 of 67 reported clinical indexes (43.3%), underscoring their critical role in patient monitoring. Assessment scores (EWS, pediatric EWS, patient status index, AVPU, and modified EWS) accounted for 13 of 67 (19.4%), highlighting their significance in evaluating patients’ conditions. Clinical conditions, such as consciousness, blood infections, and pain level, accounted for 9 of 67 (13.4%), underscoring the role of specific symptoms. Diagnostic results (6 of 67, 9%), demographics and history (6 of 67, 9%), and specialized measurements (4 of 67, 6%) were less frequent but still integral to comprehensive patient assessment. In summary, EW/TTS majorly relied on VS in CD detection or prediction (Figure S3 in ).
Applied Technology, Algorithms, and Automated Features
According to ISHO’s adapted CMM [], 18 of the 43 implemented EW/TTS (41.9%) were classified at the measured automation level. At this level, the EW/TTS data analysis processes are systematically implemented and actively managed. Ongoing efforts are in place to develop and refine the system, with established mechanisms to measure performance, track progress, and ensure coordination among involved teams. The managed automation level, identified in 11 of 43 (25.6%) [,,,,,,,,,] studies, represented an intermediate stage of automation maturity in which EW/TTS processes were implemented in practice but had not yet been systematically documented or institutionalized.
Seven of 43 (16.3%) studies [,,,,-] were classified at a defined automation level. Systematic, ongoing efforts to develop EW/TTS are underway; however, there is no comprehensive method to measure progress or ensure coordination. On the other hand, only 4 of 43 (9.3%) studies [,,,], 2 of 43 (4.7%) studies [,], and 1 of 43 (2.3%) studies [] were classified as initial, optimized, and absent automation levels, respectively. The absent level represents a complete lack of automation capability, whereas the initial level is characterized by ad hoc and informal automation efforts. In contrast, the optimized level corresponds to the most advanced stage of automation, characterized by systematic, ongoing development of EW/TTS, supported by continuous quality improvement activities that align EW/TTS outcomes with the strategic objectives and performance metrics ().

More than half of the included (24/43, 55.8%) studies [,,,,,,,-,-,,,,,-,,] focused on data analytics technologies. Across the measured, defined, and managed automation levels, data analytics was the dominant technological focus in EW/TTS implementations. Data analytics included machine learning and AI, statistical analysis, visualization tools, and cloud services. Cloud services and visualization tools supported real-time dashboards for visual analytics. Predictive algorithms, including statistical and machine learning approaches, were identified in 11 of 43 (25.6%) studies [,,-,,,,].
Hardware technologies were identified in 7 of 43 (16.3%) studies [,,,,,,], primarily comprising wearable devices and sensors. Wearable devices include HealthPatch [], Hexiwear [], ViSi Mobile [], and waterproof patches [], all of which are essential for continuously monitoring VS and other health metrics. These devices use sensors to record photoplethysmography (PPG) and other physiological data. Additionally, communication technologies accounting for 5 of 43 (11.6%) studies [,-,] use Bluetooth [,,], Wi-Fi [,], and Bluetooth low energy (BLE) [] to ensure seamless connectivity. Software technologies encompass mobile apps, eHandover, Node.js API, and eObs for remote health monitoring ().
The trend in EW/TTS automation indicated a clear long-term progression toward increased automation. During the early years (2010‐2015), there was minimal automation. Since 2016, there has been a consistent shift toward managed and measured automation levels. This transition drives a sharp rise in the weighted total, which peaks around 2020‐2021 and temporarily declines in 2022‐2023. We observed a strong rebound in 2024‐2025, with high levels of managed, defined, and measured automation signaling mature, data-driven, and continuously improving automation practices ().

Data analysis using predictive algorithms, including statistical and machine learning approaches, occurred in only 11 of 43 (25.6%) [,,-,,,,] studies, all published in 2019 or later (). The applied algorithms included eCART [], a multivariate probabilistic model [], logistic regression-based models [,,,], logistic regression, decision trees, neural networks, and ensemble models [], hybrid k-nearest neighbors least-squares support vector machines (SVMs) [], natural language processing for text analysis, decision trees, and logistic regression [], and a time-aware MARS model []. Furthermore, Chowdhury et al applied an SVM [] for electrocardiogram (ECG) analysis and CD prediction within EW/TTS. summarizes the predictive algorithms identified in the included studies, together with their reported data sources, prediction targets, time horizons, and performance metrics, where available. Thirty of 43 systems (69.8%) [,,,,-,-,,-,,,-,-,-] had a data exchange feature and connectivity with other systems. Connectivity with EHRs was reported in 21 of 43 systems (48.8%) [,,,,-,,,,,-,-,,], wearable-device connectivity in 3 of 43 systems (7%) [,,], and connectivity through a proprietary cloud platform in 1 of 43 systems (2.3%) []. Among connected systems, 5 of 43 (11.6%) [,,,,] reported interoperability standards or communication platforms, including Fast Healthcare Interoperability Resource (FHIR), Health Level Seven (HL7)-based connectivity, and Ascom. Eight of 43 systems (18.6%) [,,,,,,,] had no connectivity, and connectivity was not specified in 5 of 43 systems (11.6%) [,,,,].
The reported outcomes of EW/TTS were earlier warning in 14 of 70 reported outcomes (20%), higher accuracy in 12 of 70 (17.1%), lower specificity in 9 of 70 (12.9%), more timely reaction in 7 of 70 (10), and reduced mortality in 6 of 70 (8.6%; Figure S4 in ).
| Study or system | Algorithm type | Data sources | Prediction target | Time horizon | Performance reported |
| Youssef Ali Amer et al [] | Hybrid KNN-LS-SVM | Wearable vital-sign data | Clinical deterioration | 1 h, 2 h, 3 h, dialysis: 1 h | MAPE 4.1%, 4.5%, and 5% for cardiology patients; real-time EWS feasible |
| Bassin et al [] | Logistic regression | Demographics, vital signs, laboratory tests, temporal changes | ICU transfer, RRT activation, death | 48 h | AUC 0.87 (prior validation); higher sensitivity than BTF up to 24 h; lower false alarms |
| Bell et al [] | Logistic regression | Vital signs, laboratory values, EHR | Clinical deterioration, death, ICU transfer, urgent surgery, or RRT activation | 1‐48 h | AUC 0.87; sensitivity 0.474; specificity 0.972 |
| Chowdhury et al [] | SVM (polynomial kernel) | Wearable ECG from chest dry electrodes | STEMI/NSTEMI detection | 10 s | Accuracy 97.4% (STEMI); 96.3% (NSTEMI) |
| Edelson et al [] | eCARTv5 | EHR-based ward observations and clinical variables | Clinical deterioration, ICU transfer, death | 24 h | AUROC 0.895; PPV 17.3% and 23.3% |
| Ehara et al [] | Multivariate probabilistic AI model (VSI) | RR, SpO₂, BP, HR, temperature | ICU transfer, intubation, vasopressor use, composite outcome | 24 h | AUC 0.767 (ICU transfer); 0.712 (intubation); 0.733 (vasopressor use); 0.647 (composite outcome) |
| Escobar et al [] | Logistic-regression model; automated predictive model | EHR, laboratory tests, vital signs, neurologic status, severity of illness | Clinical deterioration, ICU transfer, death in hospital ward, 30-day mortality after alert | 12 h | Sensitivity 49%; adjusted relative risk for 30-day mortality after alert 0.84 (95% CI 0.78‐0.90) |
| González et al [] | Multivariable logistic regression | Age, sex/type of patient, HR, RR, temperature, supplemental O₂, GCS | ICU transfer, death, composite outcome | 8 h | AUC 0.832 (composite outcome); 0.832 (death); 0.723 (ICU transfer) |
| Huete-Garcia and Rodriguez-Lopez [] | Logistic regression; decision trees; neural networks; ensemble models | Vital signs, laboratory test results | Critical events | NS | AUROC 0.85 (logistic regression); 0.88 (decision trees); 0.92 (neural networks) |
| Rossetti et al [] | NLP, decision trees, and logistic regression | Nursing documentation, vital signs, administered medications, withheld medications, clinical notes | Clinical deterioration, RRT activation, cardiac arrest, sepsis, ICU transfer, death | 42 h | Clinical deterioration detected 42 h earlier than MEWS |
| Verma et al [] | Time-aware MARS model | Real-time EMR data, vital signs, prior scores, temporal changes | Clinical deterioration, death | NS | Sensitivity 53%; PPV 31%; PPV threshold 30% |
aKNN-LS-SVM: k-nearest neighbors least-squares support vector machine.
bMAPE: mean absolute percentage error.
cICU: intensive care unit.
dRRT: rapid response team.
eBTF: between the flags of clinical deterioration.
fEHR: electronic health record.
gSVM: support vector machine.
hECG: electrocardiogram.
iST-elevation myocardial infarction / Non-ST-elevation myocardial infarction detection.
jArea under the Receiver Operating Characteristic Curve.
kPPV: positive predictive value.
lRR: respiratory rate.
mSaturation of Peripheral Oxygen.
nBP: blood pressure.
oHR: heart rate.
pAUC: area under the curve.
qGCS: Glasgow Coma Scale.
rNS: not specified.
sNLP: natural language processing.
tEMR: electronic medical record.
Quality Assessment of Studies
We critically appraised the quality of the studies using the adapted JBI checklist comprising eight criteria []. Most studies received a high proportion of “Yes” responses, suggesting good compliance, particularly in “System evaluation,” “Lessons learned,” “Characteristics,” “Post-implementation,” “Pre-implementation,” and “Implementation.” However, criteria related to “Development history” and “System failure” were less well reported. Only 19 of 43 (44.2%) studies [,,,,,,,,,,,,,-,,,] clearly addressed each of these items, whereas 24 of 43 (55.8%) studies [,,,,,,,,,,,-,,,,-] were rated as No, Unclear, or Not Applicable ().
| Criteria | Quality index | |||
| Yes, n (%) | No, n (%) | Unclear (%) | Not applicable, n (%) | |
| Characteristics | 36 (83.7) | 3 (7) | 1 (2.3) | 3 (7) |
| Development history | 19 (44.2) | 16 (37.2) | 6 (14) | 2 (4.7) |
| Preimplementation | 35 (81.4) | 2 (4.7) | 2 (4.7) | 4 (9.3) |
| Implementation | 31 (72.1) | 4 (9.3) | 4 (9.3) | 4 (9.3) |
| System failure | 19 (44.2) | 13 (30.2) | 7 (16.3) | 4 (9.3) |
| Postimplementation | 36 (83.7) | 1 (2.3) | 1 (2.3) | 5 (11.6) |
| System evaluation | 39 (90.7) | 1 (2.3) | 0 (0) | 3 (7) |
| Lessons learned | 37 (86) | 2 (4.7) | 2 (4.7) | 2 (4.7) |
Discussion
Principal Findings
This systematic review explored the automated features, algorithms, and technologies of electronic EW/TTS. We identified 43 systems that revealed the transition from manual charts to electronic data. We found only 16 countries implementing electronic EW/TTS; the majority were reported in the United States (15/43, 34.9%), the United Kingdom (6/43, 14%), and the Netherlands (6/43, 14%). This distribution may partly reflect differences in digital health readiness, interoperability capacity, and policy support for the implementation of standardized early warning systems. In the United States, near-universal hospital EHR adoption and increasing interoperable health information exchange may have facilitated the integration of EW/TTS into routine care workflows []. In the United Kingdom, the national standardization of NEWS/NEWS2 across the National Health Services probably made them easier to use by ensuring that escalation criteria, documentation practices, and clinical training were consistent []. In the Netherlands, sustained national efforts to promote eHealth and electronic health data exchange, including the proposed Wegiz framework, may likewise have strengthened readiness for digitally enabled monitoring and alerting systems []. In combination, these factors may have made it easier for EW/TTS to be developed, implemented, and published than in places with lower digital maturity or less standardized escalation frameworks.
Nevertheless, we assume that many countries still consider electronic EWS calculations or have not yet reported their EW/TTS. Since 2016, electronic EW/TTS have advanced gradually through integration with machine learning and AI models, particularly in critical care and emergency medicine [].
The automation levels of electronic EW/TTS ranged from electronic VS monitoring to real-time risk score prediction. Current EW/TTS largely focus on EWS calculation [], with only a limited proportion of the included studies applying predictive algorithms to support earlier detection of deterioration. However, shorter prediction intervals and more accurate models are still needed. Although several tools to predict CD already use deep learning [], they are not yet integrated into current EW/TTS.
The adapted CMM categories reflected differences in how automation was implemented and governed in practice. Managed systems generally showed operational automation in routine use but limited standardization or performance tracking, whereas measured systems were supported by explicit evaluation, outcome monitoring, or both. From a clinical perspective, this distinction is important because more mature automation may support better workflow integration, greater transparency of system performance, and more reliable decision support, even when the underlying predictive intelligence remains limited.
Automation maturity and algorithmic intelligence should not be interpreted as equivalent. In this review, the adapted CMM reflected the maturity of workflow automation, implementation, integration, and performance monitoring, whereas intelligence referred to the sophistication of the analytic approach, ranging from automated rule-based score calculation to statistical, machine learning, and more advanced AI-based models. Accordingly, a system could achieve a relatively advanced automation level through structured data acquisition, score calculation, alert delivery, and outcome monitoring without necessarily using machine learning. Conversely, the presence of predictive or AI-based models did not by itself indicate mature workflow integration ().

The distinction between managed and measured automation also had practical implications beyond technical classification. Managed systems generally indicated that core automation functions were operational in routine care, but they often showed limited evidence of standardized evaluation, feedback, or outcome monitoring. By contrast, measured systems were supported by explicit assessment of performance, outcome tracking, or both. From a patient-safety perspective, this distinction is important because systems with measured automation may provide greater transparency regarding alert behavior, reliability, and unintended consequences. From a workflow perspective, measured systems may also be better positioned to support integration into escalation pathways and more consistent clinical use. In this sense, higher automation maturity may strengthen decision-making reliability not only through automation itself but through monitoring, validation, and governance of the automated process. Although the heterogeneity of study designs, outcomes, and performance metrics prevented a formal comparative analysis of maturity level against effectiveness, the reviewed evidence suggested that more mature systems were more often associated with structured evaluation, earlier warning, and workflow-oriented implementation features. At the same time, outcome trade-offs such as false alarms and lower specificity remained important, indicating that higher maturity should not be interpreted as uniformly better performance across all settings.
Predictive algorithms in the reviewed studies were primarily used to stratify patients according to their risk of CD, ICU transfer, AEs, or death [,,]. For example, Chowdhury et al [] reported an accuracy of 97.4% using SVM-based ECG analysis in a real-time wearable system. In this case, the high accuracy reflects the model’s ability to identify ECG patterns associated with myocardial infarction within a 10-second analysis window. This highlights that integrating AI-based analysis into EW/TTS enables real-time early warning of CD, extending beyond traditional EWS calculation. Preventive care and CD control aim not only at CD detection or prediction [] but also at improving the quality of care, such as EWS error reduction [], more timely reaction, and better decision-making for patient transfer to ICU, activating RRT, or optimizing the length of hospitalization []. Research in critical care has shifted the focus of EW/TTS’s outcomes from mortality reduction toward quality improvement.
Most EW/TTS operate in hospitals, especially in surgery wards (Figure S2 in ). Only 2 studies [,] considered CD detection in smart cars or in older adult care facilities. However, turning our medical systems from a curative to a preventive approach is essential []. Home care, particularly for older adults after hospital discharge or those living alone, increasingly relies on electronic EW/TTS to ensure safety monitoring within the private environment []. Deserno has already documented the general idea of transforming such places into a diagnostic space [], and Wang et al [] provided a comprehensive review on unobtrusive health monitoring in smart homes. Bringing this preventive approach to prehospital care may enhance the overall health care level and reduce AE, such as heart or respiratory failure, which are often precursors to death [].
Gerry et al [] assessed the efficacy of manual systems, whereas our systematic review evaluated electronic systems. The main reported outcomes of EW/TTS evaluation included early warning, high accuracy, and lower specificity (Figure S4 in ). These outcomes were generally positive, primarily for accurate, timely decision-making. Despite these positive results, electronic EW/TTS still need to improve through automation using AI technology.
Several studies reported the use of deep learning or machine learning to calculate predictive EWS [,]. The predictive models generated higher-level knowledge to support clinical decision-making. Hence, clinicians should replace the EWS calculation based on charts [] with valid predictive models using AI methods []. Scores from charts indicate CD at the point of care, whereas the predicted value provides a forecast of CDs, which gives the nurse enough time to support the patient and activate RRT quickly. However, directly comparing algorithm performance across studies remains challenging because of substantial heterogeneity in clinical settings, input variables, prediction targets, and reported outcome measures. Cross-study comparability remained limited because the included EW/TTS differed substantially in clinical setting, prediction target, time horizon, and reported performance metrics. Prediction targets included CD, ICU transfer, AEs, and mortality; time horizons ranged from near-real-time alerts to forecasts several hours in advance; and performance was reported inconsistently using measures such as AUC, sensitivity, specificity, and PPV. As a result, the reported performance values should be interpreted within the context of each individual study rather than as directly comparable measures of superiority across systems or settings.
For instance, the system described by Alam et al [] predicted EWS earlier based on different clinical, demographic, and physiological VS. The output alerted, reminded, and notified users based on their roles to ensure more sensitive, accurate, and timely actions.
Besides the remarkable advancements and achievements in AI, data analytics, cloud computing, and mobile technologies, significant improvements have occurred. Furthermore, high-speed internet, the Internet of Things, and standardized protocols facilitated seamless data exchange. Therefore, the full potential of AI and data analytics in electronic EW/TTS has not yet been realized [].
Comparison With Prior Work
Recent reviews have reported limited predictive performance of traditional aggregate-weighted EW/TTS []. Muralitharan et al [] demonstrated that machine learning-based EW/TTS outperformed the conventional risk scoring approach in predicting CD. These findings align with the results identified in our review, which indicate a growing shift toward an automated EW/TTS approach.
Despite this advancement, the literature provides a limited synthesis of the extent of automation across EW/TTS components, particularly regarding data acquisition, algorithmic processing, and alert generation. Our review identified key enabling technologies and mapped their implementation across EW/TTS components. Based on the synthesized evidence, we propose a conceptual framework describing intelligent EW/TTS integration across three functional domains: automated data collection (afferent limb), inference and predictive analytics (inference engine), and automated output (efferent limb). In this conceptual model, the afferent limb is responsible for automated data acquisition, whereas the inference engine performs analytic functions such as VS interpretation, critical score calculation, and predictive modeling. The efferent limb is responsible for output functions, including alert generation, escalation, and communication to clinicians or RRTs (). Intelligent EW/TTS integrates automated data acquisition within the afferent limb. This enables an embedded inference engine to continuously monitor VS, calculate and predict EWS, and apply advanced analytics to support actionable clinical decision-making. The inference engine links the afferent limb to the efferent limb by generating trigger outputs when predefined thresholds are exceeded. The efferent limb generates timely alerts to clinicians and RRTs, coordinates escalation pathways, and facilitates prompt intervention. By accelerating recognition and enhancing informed decision-making, these systems may improve patient outcomes. We therefore suggest that future intelligent EW/TTS should align both limbs with this model [] and incorporate automation together with smart features. Sensors and wearable technologies for VS data collection may improve data quality. Research has shown that patch sensors provide higher precision for HR and RR [].
The quality appraisal findings also affected the strength of evidence in this review. While most studies adequately described system characteristics, implementation, and evaluation, many provided limited information on development history and system failure. This gap makes it harder to assess how mature, reproducible, and thoroughly tested a system was before deployment. It also makes it more difficult to identify technical flaws, safety risks, and unintended effects that could arise during real-world use. As a result, the evidence may overemphasize reported benefits while underrepresenting implementation challenges and system-level risks. Readers should consider this limitation when interpreting the results.

Limitations
However, this review also has limitations. First, most of the studies included in this review were conducted in hospital settings, which may limit the generalizability of the findings to nonclinical environments. Second, the collection of VS using wearable devices poses challenges, as some wearable monitoring systems still require further clinical evaluation and validation before broader adoption [,,]. This may affect measurement accuracy and reliability. Third, regulatory and ethical factors, as well as the complexity of the health care system, may constrain widespread adoption of the EW/TTS. We also did not conduct a formal comparative analysis of country-level health system characteristics, including digital infrastructure readiness, EHR adoption, interoperability maturity, and national policy frameworks for early warning implementation, which may partially elucidate the concentration of reported EW/TTS in a limited number of countries.
Finally, the possible outcomes of implemented EW/TTS may include no change, statistically insignificant effects, or inconclusive results. However, we did not extract these outcomes because they were outside the scope of this review, which may limit the generalizability of our findings.
Future Directions
Future research should focus on collecting high-quality, real-time VS data across diverse settings beyond hospitals, including smart home and in-vehicle environments, to improve the validity and accuracy of predictive models with acceptable sensitivity and specificity. The use of clinically validated wearable devices and the development of a standardized data collection framework may further improve model accuracy and reliability. Furthermore, adopting modern technologies such as smart devices, cloud computing, AI, robotics, and the Internet of Medical Things can revolutionize EW/TTS. AI technology powers intelligent EW/TTS to enhance decision-making and automate interventions. These advances offer opportunities to leverage modern technologies for transformative applications in health care, ultimately enhancing the quality of care and saving lives. As EW/TTS increasingly integrate AI-driven analytics and decision support, their deployment must also be evaluated within the context of evolving regulatory and digital health safety frameworks. Recent FDA guidance on AI-enabled device software functions and clinical decision support software emphasizes the need for clinical AI systems to be transparent, to undergo lifecycle oversight, to support performance monitoring, and to enable safe model updates.
Conclusions
Current EW/TTS primarily focused on patient monitoring in hospital surgery wards and most commonly demonstrated measured automation. The primary objective of EW/TTS was to detect CD, while ICU transfers and mortality prediction were the most common secondary objectives. EW/TTS predominantly relied on VS and assessment scores to detect and predict CD. The included studies primarily used data analytics technologies. More than half of EW/TTS featured data exchange capabilities and connectivity with other systems. The primary reported outcomes of EW/TTS implementation included early warning, high accuracy, and lower specificity.
Acknowledgments
No generative AI was used to generate scientific content.
Funding
This research was partly supported by the Alexander von Humboldt Foundation (Georg Foster Stipend).
Data Availability
All data are included in the manuscript and its supplementary materials.
Authors' Contributions
SRNK and TMD conceptualized and designed the study. SRNK prepared the original draft of the manuscript. SRNK, MH, TMD, MDT, VMGS, PH, and NG contributed to data extraction, analysis, and manuscript editing. SRNK, TMD, MDT, VMGS, and PH reworked the data extraction and analysis and contributed substantially to manuscript revision and editing. SRNK conducted the edition and manuscript improvement. TMD supervised the entire work.
Conflicts of Interest
None declared
References
- Breteler MJM, KleinJan E, Numan L, et al. Are current wireless monitoring systems capable of detecting adverse events in high-risk surgical patients? A descriptive study. Injury. May 2020;51 Suppl 2:S97-S105. [CrossRef] [Medline]
- Patterson C, Maclean F, Bell C, et al. Early warning systems in the UK: variation in content and implementation strategy has implications for a NHS early warning system. Clin Med (Lond). Oct 2011;11(5):424-427. [CrossRef] [Medline]
- Hackmann G, Chen M, Chipara O, et al. Toward a two-tier clinical warning system for hospitalized patients. AMIA Annu Symp Proc. 2011;2011:511-519. [Medline]
- Huff S, Stephens K, Whiteman K, Swanson-Biearman B, Mori C. Implementation of a vital sign alert system to improve outcomes. J Nurs Care Qual. 2019;34(4):346-351. [CrossRef] [Medline]
- Le Lagadec MD, Dwyer T. Scoping review: the use of early warning systems for the identification of in-hospital patients at risk of deterioration. Aust Crit Care. Jul 2017;30(4):211-218. [CrossRef] [Medline]
- Tegegne MD, Niakan Kalhori SR, Haas P, Sobotta VM, Warnecke J, Deserno TM. Wearable devices for remote monitoring of chronic diseases: systematic review. JMIR Mhealth Uhealth. Feb 11, 2026;14:e74071. [CrossRef] [Medline]
- Morgan R, Williams F, Wright M. An early warning scoring system for detecting developing critical illness. Clin Intensive Care. 1997;8(2):100. URL: https://scispace.com/papers/an-early-warning-scoring-system-for-detecting-developing-1h705595d7 [Accessed 2026-07-27]
- Alam N, Vegting IL, Houben E, et al. Exploring the performance of the National Early Warning Score (NEWS) in a European emergency department. Resuscitation. May 2015;90:111-115. [CrossRef] [Medline]
- Jones D, Mitchell I, Hillman K, Story D. Defining clinical deterioration. Resuscitation. Aug 2013;84(8):1029-1034. [CrossRef] [Medline]
- Georgaka D, Mparmparousi M, Vitos M. Early warning systems. Hospital Chronicles. 2012;7(1 Sup):37-43. URL: https://scispace.com/pdf/early-warning-systems-2efkirxlqe.pdf [Accessed 2026-07-27]
- Shiloh AL, Lominadze G, Gong MN, Savel RH. Early warning/track-and-trigger systems to detect deterioration and improve outcomes in hospitalized patients. Semin Respir Crit Care Med. Feb 2016;37(1):88-95. [CrossRef] [Medline]
- Despins LA. Automated deterioration detection using electronic medical record data in intensive care unit patients: a systematic review. Comput Inform Nurs. Jul 2018;36(7):323-330. [CrossRef] [Medline]
- Wood C, Chaboyer W, Carr P. How do nurses use early warning scoring systems to detect and act on patient deterioration to ensure patient safety? A scoping review. Int J Nurs Stud. Jun 2019;94:166-178. [CrossRef] [Medline]
- Subbe CP, Duller B, Bellomo R. Effect of an automated notification system for deteriorating ward patients on clinical outcomes. Crit Care. Mar 14, 2017;21(1):52. [CrossRef] [Medline]
- Jones S, Mullally M, Ingleby S, Buist M, Bailey M, Eddleston JM. Bedside electronic capture of clinical observations and automated clinical alerts to improve compliance with an early warning score protocol. Crit Care Resusc. Jun 2011;13(2):83-88. [Medline]
- Gerry S, Bonnici T, Birks J, et al. Early warning scores for detecting deterioration in adult hospital patients: systematic review and critical appraisal of methodology. BMJ. May 20, 2020;369:m1501. [CrossRef] [Medline]
- Wu CL, Kuo CT, Shih SJ, et al. Implementation of an electronic national early warning system to decrease clinical deterioration in hospitalized patients at a tertiary medical center. Int J Environ Res Public Health. Apr 25, 2021;18(9):4550. [CrossRef] [Medline]
- Bonnici T, Tarassenko L, Clifton DA, Watkinson P. The digital patient. Clin Med. Jun 2013;13(3):252-257. [CrossRef]
- Malycha J, Bacchi S, Redfern O. Artificial intelligence and clinical deterioration. Curr Opin Crit Care. Jun 1, 2022;28(3):315-321. [CrossRef] [Medline]
- Deserno TM. Transforming smart vehicles and smart homes into private diagnostic spaces. Presented at: APIT 2020; Jan 17, 2020:165-171; Bali Island Indonesia. [CrossRef]
- Rostam Niakan Kalhori S, Deserno TM. Requirement analysis for an intelligent warning system to alarm the rapid response team prior to patient deterioration. Stud Health Technol Inform. Jun 29, 2022;295:5-11. [CrossRef] [Medline]
- Kabrhel C, Okechukwu I, Hariharan P, et al. Factors associated with clinical deterioration shortly after PE. Thorax. Sep 2014;69(9):835-842. [CrossRef] [Medline]
- Kofflard MJM, Ten Cate FJ, van der Lee C, van Domburg RT. Hypertrophic cardiomyopathy in a large community-based population: clinical outcome and identification of risk factors for sudden cardiac death and clinical deterioration. J Am Coll Cardiol. Mar 19, 2003;41(6):987-993. [CrossRef] [Medline]
- Song YH, Shin TG, Kang MJ, et al. Predicting factors associated with clinical deterioration of sepsis patients with intermediate levels of serum lactate. Shock. Aug 2012;38(3):249-254. [CrossRef] [Medline]
- Grant S, Crimmons K. Limitations of track and trigger systems and the National Early Warning Score. Part 2: sensitivity versus specificity. Br J Nurs. Jun 28, 2018;27(12):705-710. [CrossRef] [Medline]
- Sacristán JA. Patient-centered medicine and patient-oriented research: improving health outcomes for individual patients. BMC Med Inform Decis Mak. Jan 8, 2013;13(1):1-8. [CrossRef] [Medline]
- Informatics-savvy health organizations assessment: strengthening health systems and public health informatics. Digital Initiatives Group at the University of Washington Department of Global Health. 2026. URL: https://digi.uw.edu/isho/ [Accessed 2026-07-17]
- Rostam Niakan Kalhori S, Deserno TM, Haghi M, Ganapathy N. A protocol for a systematic review of electronic early warning/track-and-trigger systems (EW/TTS) to predict clinical deterioration: focus on automated features, technologies, and algorithms. PLoS ONE. 2023;18(3):e0283010. [CrossRef] [Medline]
- Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. Aug 18, 2009;151(4):264-269. [CrossRef] [Medline]
- Kellermeyer L, Harnke B, Knight S. Covidence and rayyan. jmla. 2018;106(4):580-583. [CrossRef]
- Hanson CC, Randolph GD, Erickson JA, et al. A reduction in cardiac arrests and duration of clinical instability after implementation of a paediatric rapid response system. Postgrad Med J. May 2010;86(1015):314-318. [CrossRef] [Medline]
- Chowdhury MEH, Alzoubi K, Khandakar A, et al. Wearable real-time heart attack detection and warning system to reduce road accidents. Sensors (Basel). Jun 20, 2019;19(12):2780. [CrossRef] [Medline]
- Weenk M, van Goor H, Frietman B, et al. Continuous monitoring of vital signs using wearable devices on the general ward: pilot study. JMIR Mhealth Uhealth. Jul 5, 2017;5(7):e91. [CrossRef] [Medline]
- Escobar GJ, Liu VX, Schuler A, Lawson B, Greene JD, Kipnis P. Automated identification of adults at risk for in-hospital clinical deterioration. N Engl J Med. Nov 12, 2020;383(20):1951-1960. [CrossRef] [Medline]
- Gill FJ, Cooper A, Falconer P, Stokes S, Leslie GD. Development of an evidence-based ESCALATION system for recognition and response to paediatric clinical deterioration. Aust Crit Care. Nov 2022;35(6):668-676. [CrossRef] [Medline]
- Wong D, Bonnici T, Knight J, Morgan L, Coombes P, Watkinson P. SEND: a system for electronic notification and documentation of vital sign observations. BMC Med Inform Decis Mak. Aug 13, 2015;15(1):68. [CrossRef] [Medline]
- Wong DCW, Bonnici T, Gerry S, Birks J, Watkinson PJ. Effect of digital early warning scores on hospital vital sign observation protocol adherence: stepped-wedge evaluation. J Med Internet Res. Jun 20, 2024;26:e46691. [CrossRef] [Medline]
- Durán-Vega LA, Santana-Mancilla PC, Buenrostro-Mariscal R, et al. An IoT system for remote health monitoring in elderly adults through a wearable device and mobile application. Geriatrics (Basel). May 7, 2019;4(2):34. [CrossRef] [Medline]
- The joanna briggs institute critical appraisal tools for use in JBI systematic reviews: checklist for case reports. Joanna Briggs Institute; 2017. URL: https://jbi.global/sites/default/files/2019-05/JBI_Critical_Appraisal-Checklist_for_Case_Reports2017_0.pdf [Accessed 2026-07-17]
- Youssef Ali Amer A, Wouters F, Vranken J, et al. Vital signs prediction and early warning score calculation based on continuous monitoring of hospitalised patients using wearable technology. Sensors (Basel). Nov 18, 2020;20(22):6593. [CrossRef] [Medline]
- Bassin L, Raubenheimer J, Bell D. The implementation of a real time early warning system using machine learning in an Australian hospital to improve patient outcomes. Resuscitation. Jul 2023;188:109821. [CrossRef] [Medline]
- Bell D, Baker J, Williams C, Bassin L. A trend-based early warning score can be implemented in a hospital electronic medical record to effectively predict inpatient deterioration. Crit Care Med. Oct 1, 2021;49(10):e961-e967. [CrossRef] [Medline]
- Edelson DP, Churpek MM, Carey KA, et al. Early warning scores with and without artificial intelligence. JAMA Netw Open. Oct 1, 2024;7(10):e2438986. [CrossRef] [Medline]
- Ehara J, Masuda Y, Hayashi K, Norisue Y, Fujitani S. Efficacy of early warning scores as the prediction tool for detecting patients with acute deterioration in a high dependent unit. Cureus. Oct 2024;16(10):e71971. [CrossRef] [Medline]
- Emmanuel J, Torres A. The impact of automated electronic surveillance of electronic medical records on pediatric inpatient care. Cureus. Oct 1, 2018;10(10):e3395. [CrossRef] [Medline]
- Fletcher GS, Aaronson BA, White AA, Julka R. Effect of a real-time electronic dashboard on a rapid response system. J Med Syst. Nov 20, 2017;42(1):5. [CrossRef] [Medline]
- Arellano González C, Niembro Muñoz LE, Aguilar-Lugo-Gerez JJ, Sanchez Závala J. A new early warning system for predicting adverse outcomes in hospitalized patients with neurological conditions: a retrospective cohort study. Cureus. Sep 2025;17(9):e92068. [CrossRef] [Medline]
- Gorham TJ, Rust S, Rust L, et al. The vitals risk index-retrospective performance analysis of an automated and objective pediatric early warning system. Pediatr Qual Saf. 2020;5(2):e271. [CrossRef] [Medline]
- Hobensack M, Withall J, Douthit B, et al. Identifying barriers to the implementation of communicating narrative concerns entered by registered nurses, an early warning system smartapp. Appl Clin Inform. Mar 2024;15(2):295-305. [CrossRef] [Medline]
- Howard C, Amspoker AB, Morgan CK, et al. Implementation of automated early warning decision support to detect acute decompensation in the emergency department improves hospital mortality. BMJ Open Qual. Apr 2022;11(2):e001653. [CrossRef] [Medline]
- Huete-Garcia A, Rodriguez-Lopez S. Development and implementation of an artificial intelligence-enhanced care model to improve patient safety in hospital wards in Spain. Acute Crit Care. Nov 2024;39(4):488-498. [CrossRef] [Medline]
- Itelman E, Shlomai G, Leibowitz A, et al. Assessing the usability of a novel wearable remote patient monitoring device for the early detection of in-hospital patient deterioration: observational study. JMIR Form Res. Jun 9, 2022;6(6):e36066. [CrossRef] [Medline]
- Jerry EE, Bouwman AR, Nienhuijs SW. Remote Monitoring by ViQtor Upon Implementation on a Surgical Department (REQUEST-Trial): protocol for a prospective implementation study. JMIR Res Protoc. Jul 3, 2025;14:e70707. [CrossRef] [Medline]
- Lakshman P, Gopal PT, Khurdi S. Effectiveness of remote patient monitoring equipped with an early warning system in tertiary care hospital wards: retrospective cohort study. J Med Internet Res. Jan 15, 2025;27:e56463. [CrossRef] [Medline]
- Lang A, Simmonds M, Pinchin J, et al. The impact of an electronic patient bedside observation and handover system on clinical practice: mixed-methods evaluation. JMIR Med Inform. Mar 6, 2019;7(1):e11678. [CrossRef] [Medline]
- Lee SH, Leem AY, Nho Y, et al. A pilot study of the effectiveness of medical emergency system implementation at a single center in Korea. Korean J Crit Care Med. May 2017;32(2):133-141. [CrossRef] [Medline]
- Padilla CR, Carvalho B, Oakeson AM, Riley ET, Abir G. Development and implementation of an automated electronic maternal early warning system (E-MEWS) in a level IV obstetric unit. Cureus. May 2025;17(5):e84740. [CrossRef] [Medline]
- Picker D, Dans M, Heard K, et al. A randomized trial of palliative care discussions linked to an automated early warning system alert. Crit Care Med. Feb 2017;45(2):234-240. [CrossRef] [Medline]
- Posthuma LM, Downey C, Visscher MJ, et al. Remote wireless vital signs monitoring on the ward for early detection of deteriorating patients: a case series. Int J Nurs Stud. Apr 2020;104(103515):103515. [CrossRef] [Medline]
- Rossetti SC, Dykes PC, Knaplund C, et al. The communicating narrative concerns entered by registered nurses (CONCERN) clinical decision support early warning system: protocol for a cluster randomized pragmatic clinical trial. JMIR Res Protoc. Dec 10, 2021;10(12):e30238. [CrossRef] [Medline]
- Schmidt PE, Meredith P, Prytherch DR, et al. Impact of introducing an electronic physiological surveillance system on hospital mortality. BMJ Qual Saf. Jan 2015;24(1):10-20. [CrossRef] [Medline]
- Shields LE, Wiesner S, Klein C, Pelletreau B, Hedriana HL. Use of maternal early warning trigger tool reduces maternal morbidity. Am J Obstet Gynecol. Apr 2016;214(4):527. [CrossRef] [Medline]
- Teheux L, Verlaat CW, Lemson J, Draaisma JMT, Fuijkschot J. Risk stratification to improve pediatric early warning systems: it is all about the context. Eur J Pediatr. Oct 2019;178(10):1589-1596. [CrossRef] [Medline]
- Tomasi JN, Hamilton MV, Fan M, et al. Assessing the electronic bedside paediatric early warning system: a simulation study on decision-making and usability. Int J Med Inform. Jan 2020;133:103969. [CrossRef] [Medline]
- Tran A, Ramchandani R, Brehaut J, et al. Assessing clinical impressions of early warning score integration with the rapid response team: protocol for a prospective cohort study. JMIR Res Protoc. Jul 31, 2025;14:e65360. [CrossRef] [Medline]
- Un KC, Wong CK, Lau YM, et al. Observational study on wearable biosensors and machine learning-based remote monitoring of COVID-19 patients. Sci Rep. 2021;11(1):4388. [CrossRef]
- Verma AA, Stukel TA, Colacci M, et al. Clinical evaluation of a machine learning-based early warning system for patient deterioration. CMAJ. Sep 15, 2024;196(30):E1027-E1037. [CrossRef] [Medline]
- Weller RS, Foard KL, Harwood TN. Evaluation of a wireless, portable, wearable multi-parameter vital signs monitor in hospitalized neurological and neurosurgical patients. J Clin Monit Comput. Oct 2018;32(5):945-951. [CrossRef] [Medline]
- Wilson SJ, Wong D, Pullinger RM, Way R, Clifton DA, Tarassenko L. Analysis of a data-fusion system for continuous vital sign monitoring in an emergency department. Eur J Emerg Med. Feb 2016;23(1):28-32. [CrossRef] [Medline]
- Yadav A, Dandu H, Parchani G, et al. Early detection of deteriorating patients in general wards through continuous contactless vital signs monitoring. Front Med Technol. 2024;6:1436034. [CrossRef] [Medline]
- Creswell JW, Creswell JD. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. 6th ed. SAGE Publications; 2018. ISBN: 9781506386713
- National trends in hospital and physician adoption of electronic health records. Office of the National Coordinator for Health Information Technology. 2022 URL: https://healthit.gov/data/quickstats/national-trends-hospital-and-physician-adoption-electronic-health-records/ [Accessed 2026-07-17]
- National early warning score (NEWS) 2. Royal College of Physicians. 2017. URL: https://www.rcp.ac.uk/resources/national-early-warning-score-news-2/ [Accessed 2026-07-17]
- Government encouraging the use of ehealth (telehealth). Government of the Netherlands. 2019. URL: https://www.government.nl/topics/ehealth/government-encouraging-use-of-ehealth [Accessed 2026-07-17]
- Mann KD, Good NM, Fatehi F, et al. Predicting patient deterioration: a review of tools in the digital hospital setting. J Med Internet Res. Sep 30, 2021;23(9):e28209. [CrossRef] [Medline]
- Alkahlout BH, Ahmad S. Optimizing patient care in the emergency department: insights from automated alert systems and triage strategies. globecc. Aug 21, 2023;2(2):71-76. [CrossRef]
- Rostam Niakan Kalhori S, Rahmani Katigari M, Talebi Azadboni T, Pahlevanynejad S, Hosseini Eshpala R. The effect of m-health applications on self-care improvement in older adults: a systematic review. Inform Health Soc Care. Jul 3, 2023;48(3):292-331. [CrossRef] [Medline]
- Wang J, Warnecke JM, Haghi M, Deserno TM. Unobtrusive health monitoring in private spaces: the smart vehicle. Sensors. 2020;20(9):2442. [CrossRef]
- Wang J, Spicher N, Warnecke JM, Haghi M, Schwartze J, Deserno TM. Unobtrusive health monitoring in private spaces: the smart home. Sensors. 2021;21(3):864. [CrossRef]
- van der Vegt AH, Campbell V, Mitchell I, et al. Systematic review and longitudinal analysis of implementing artificial intelligence to predict clinical deterioration in adult hospitals: what is known and what remains uncertain. J Am Med Inform Assoc. Jan 18, 2024;31(2):509-524. [CrossRef] [Medline]
- Levin MA, Kia A, Timsina P, et al. Real-time machine learning alerts to prevent escalation of care: a nonrandomized clustered pragmatic clinical trial. Crit Care Med. Jul 1, 2024;52(7):1007-1020. [CrossRef] [Medline]
- Romero-Brufau S, Huddleston JM, Naessens JM, et al. Widely used track and trigger scores: are they ready for automation in practice? Resuscitation. Apr 2014;85(4):549-552. [CrossRef] [Medline]
- Muralitharan S, Nelson W, Di S, et al. Machine learning-based early warning systems for clinical deterioration: systematic scoping review. J Med Internet Res. Feb 4, 2021;23(2):e25187. [CrossRef] [Medline]
Abbreviations
| AE: adverse event |
| AVPU: alert, verbal, pain, and unresponsive |
| BLE: Bluetooth low energy |
| CD: clinical deterioration |
| CMM: capability maturity model |
| ECG: electrocardiogram |
| EHR: electronic health record |
| EW/TTS: early warning/track-and-trigger systems |
| EWS: Early Warning Score |
| FHIR: Fast Healthcare Interoperability Resources |
| HL7: Health Level Seven |
| HR: heart rate |
| ICU: intensive care unit |
| ISHO: Informatics-Savvy Health Organization |
| JBI: Joanna Briggs Institute |
| PPG: photoplethysmography |
| PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses |
| RR: respiratory rate |
| RRT: rapid response team |
| SDC: Study Design Classification |
| SpO2: blood oxygen saturation |
| SVM: support vector machine |
| VS: vital sign |
Edited by Andrew Coristine; submitted 28.Apr.2025; peer-reviewed by Dillon Chrimes, Martin Jacobsson; final revised version received 23.Jun.2026; accepted 24.Jun.2026; published 10.Aug.2026.
Copyright© Sharareh Rostam Niakan Kalhori, Mostafa Haghi, Masresha Derese Tegegne, Viktor MG Sobotta, Paulo Haas, Nagarajan Ganapathy, Thomas M Deserno. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 10.Aug.2026.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.

