Published on 19.08.16 in Vol 18, No 8 (2016): August
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/5533, first published Jan 19, 2016.
Effectiveness of mHealth Interventions Targeting Health Care Workers to Improve Pregnancy Outcomes in Low- and Middle-Income Countries: A Systematic Review
Background: Low- and middle-income countries (LMICs) face the highest burden of maternal and neonatal deaths. Concurrently, they have the lowest number of physicians. Innovative methods such as the exchange of health-related information using mobile devices (mHealth) may support health care workers in the provision of antenatal, delivery, and postnatal care to improve maternal and neonatal outcomes in LMICs.
Objective: We conducted a systematic review evaluating the effectiveness of mHealth interventions targeting health care workers to improve maternal and neonatal outcomes in LMIC.
Methods: The Cochrane Library, PubMed, EMBASE, Global Health Library, and Popline were searched using predetermined search and indexing terms. Quality assessment was performed using an adapted Cochrane Risk of Bias Tool. A strength, weakness, opportunity, and threat analysis was performed for each included paper.
Results: A total of 19 studies were included for this systematic review, 10 intervention and 9 descriptive studies. mHealth interventions were used as communication, data collection, or educational tool by health care providers primarily at the community level in the provision of antenatal, delivery, and postnatal care. Interventions were used to track pregnant women to improve antenatal and delivery care, as well as facilitate referrals. None of the studies directly assessed the effect of mHealth on maternal and neonatal mortality. Challenges of mHealth interventions to assist health care workers consisted mainly of technical problems, such as mobile network coverage, internet access, electricity access, and maintenance of mobile phones.
Conclusions: mHealth interventions targeting health care workers have the potential to improve maternal and neonatal health services in LMICs. However, there is a gap in the knowledge whether mHealth interventions directly affect maternal and neonatal outcomes and future research should employ experimental designs with relevant outcome measures to address this gap.
J Med Internet Res 2016;18(8):e226
The risk for maternal or newborn death is considerably higher in low- and middle-income countries (LMICs) as compared with high-income countries. Despite progress with global decline in maternal mortality, many LMICs still have high maternal mortality rates  in particular in LMICs in sub-Saharan Africa and Asia, where the majority of maternal deaths occur [ ]. Between 1990 and 2010, globally the under-five mortality rate was reduced by only 28% instead of the targeted 67% [ , ]. Neonatal mortality rate counts toward 41% of the total under-five mortality rate and plays an important role in the slow reduction of under-five mortality rate.
High neonatal mortality rate particularly persists in LMICs . This high burden of maternal and neonatal deaths is compounded with low numbers of physicians and midwives [ ]. These human resource challenges are worsened by factors including migration of qualified health workers to better resourced countries, inadequate investment in national health systems, and devastation by major epidemics such as human immunodeficiency virus (HIV) and acquired immune deficiency syndrome (AIDS), and malaria [ ]. Task shifting as well as innovation in service delivery using available technology provides a promising opportunity to improve maternal and neonatal outcomes [ ].
A potential tool to address maternal and neonatal outcome in LMICs is provided by the global increase in mobile technology. The International Telecommunication Union reported that in 2013, global mobile-phone subscriptions reached 6.8 billion and that the mobile-cellular penetration rate or the number of active mobile phone users within a specific population reached 89% in developing countries . This has facilitated the development of a new component of electronic health, namely mobile health (mHealth). The main feature of mHealth is the exchange of health-related information in the form of coded data, text, images, audio, and video using mobile devices. This technology can be used to address challenges such as access, quality, affordability, matching of resources, and behavioral norms [ ]. mHealth can be used by health care workers in LMICs to improve affordability of interventions for health promotion, increase health education, and address disease prevention [ - ]. mHealth could also play a prominent role in task shifting, allowing health care workers closely related to the community, such as community health workers (CHWs), to become an important intermediate between higher health institutions and the community. Although the global use of mHealth interventions is increasing, evidence of the effectiveness of mHealth apps is mostly limited to high-income countries, with a focus on the prevention and management of classic chronic diseases, such as diabetes and hypertension [ ]. In LMICs, mHealth interventions have been successfully implemented for the management of HIV and tuberculosis [ - ]. Less evidence exists on the effectiveness of mHealth interventions aimed at health care workers providing maternal and neonatal services in LMICs. Therefore, the main objective of this study was to perform a systematic review to assess the effectiveness of mHealth interventions aimed at health care workers providing maternal and neonatal services in improving maternal and neonatal outcomes in LMIC.
Protocol and Registration
The current systematic review is based on the guidelines provided by PRISMA  and was registered in the PROSPERO registry for systematic reviews: (CRD42014010292). This review is part of a larger systematic review that investigated the potential of mHealth interventions targeting both health workers and pregnant women in LMICs to improve maternal and neonatal outcomes.
Information Sources and Search
An electronic systematic literature search was conducted within the following 5 databases: The Cochrane Library (Cochrane Database of Systemic Reviews), PubMed or MEDLINE, EMBASE, Global Health Library, and POPLINE using predefined search terms (Title or Abstract) and indexing terms (MeSH, Emtree) during the period of June 1, 2014, and August 31, 2014. In addition, Grey literature search was performed between October 2014 and April 2015 because many studies focusing on mHealth interventions are not published in peer-reviewed journals. A list was created of organizations working with mHealth interventions. These organizations consisted of nongovernmental organizations, governments’ agencies, and the World Health Organization working group on mHealth (). The websites of these organizations were searched for publications fitting the eligibility criteria. Furthermore, personal contacts (met through working in the field or at conferences) were approached for papers or documents to be included. Additional papers were found via the snowballing effect, using the reference list of included papers.
Studies focusing on the domain health care workers in combination with maternal and neonatal care in LMICs were eligible for inclusion. The list of LMICs was created according to the World Bank Classification . The determinant mHealth was defined as a medical and public health practice supported by mobile devices, such as mobile phones, tablets, and other wireless devices [ , , ]. It makes use of voice messaging, short messaging service (SMS) text messaging, and apps that can be accessed via general packet radio service, third and fourth generation mobile telecommunications (3G and 4G systems), global positioning system, and Bluetooth technology. The outcomes were not prespecified because of the interest for any outcome related to our domain and determinant. Keywords used in these searches included pregnancy, pregnant, midwife, midwives, traditional midwives, traditional birth attendants (TBAs), CHW, maternal, antenatal, delivery, postnatal, neonatal, perinatal, baby, low resource setting, constrained resource, mHealth, mobile phone, smartphone, mobile app, tablet computer, SMS, short messaging, and telemedicine. The full search strategy can be found in .
Included papers were all peer-reviewed, written in English, Dutch, French, German, or Spanish, and primary study papers. Papers were excluded when they did not match the domains and determinants, or were reports of proceedings, project protocols, secondary analysis, animal, biomolecular, or genetic studies. Citations of secondary analysis were reviewed for relevant citations. Interventions relating to the termination of pregnancy were excluded when they targeted the termination of pregnancy before 26-week gestation, as the fetus is then not yet regarded as viable. Interventions making use of a radio were excluded because these interventions fell outside the scope of our definition of mHealth.
The database searches were carried out by ABB and SFS. Subsequent review of search results was undertaken by ABB, MAC, SFS, JB, and KKG. Three reviewers (ABB, ASM, and MV) screened the papers found in the grey literature search. There were no disagreements on paper inclusion.
Data extraction was done according to a standardized data extraction form based on: the study, study design, location, target population or size, form of mHealth, focus of evaluation measure (whether maternal or neonatal), mHealth function, relevant study findings with respect to outcome used in the study, role of mHealth, and the strengths, weaknesses, opportunities, and threats of the intervention.
Extraction of the data from database papers was done by a single reviewer (ABB) who was not blinded for journal or author details. Lack of clarity during the extraction process was resolved by consulting the second reviewer (MAC). Data extraction of the grey literature was done by 4 reviewers (ABB, ASM, MV, and MAC). In case of incomplete data, one attempt was made to contact the corresponding author by email.
The quality of the included papers was assessed according to an adapted Cochrane Risk of Bias Tool . mHealth interventions as well as the target populations differed between the studies. This tool was used because it gives more guidance on details for classifying the risk of bias and therefore enhances uniformity of assessment ( ). Bias was assessed on the selection process of the study population, completeness of data (example number of dropouts), origin of the data (measurements performed by authors or database research), blinding of the researchers or clinicians, the presence of a clear definition of the outcomes that were used, and whether confounders were taken into account in analysis. Risk of bias was assigned as either low risk, high risk, or unclear risk. The quality assessment tool can be found in . Validity of the papers was taken into account in the Discussion section.
Synthesis of Results
Studies were grouped into 2 types: intervention and descriptive. Intervention studies employed more rigorous nonrandomized study designs used for evaluating interventions , whereas descriptive studies used mainly cross-sectional designs or were case studies. Data synthesis aims to give a narrative analysis. First, an overview of the scope of mHealth interventions is provided. The scope of the studies consists of the year of publication, region of the world, form of mHealth intervention, the mHealth function, topic addressed, and target population.
Narrative synthesis of the intervention studies are presented in an evidence table, in which the studies are analyzed according to their year of publication, study design, location or setting, target population, whether evaluation measures are maternal or neonatal, form of mHealth, mHealth functions related to data collection, educational, and communication and finally relevant findings. A similar evidence table was used to summarize the findings of the descriptive studies. Heterogeneous outcomes, settings, and varying study designs limited our ability to group the results of 2 or more papers together to conduct a meta-analysis for an overall quantitative conclusion. A strengths, weaknesses, opportunities, and threat analysis was also performed for all the included studies, as well as for mHealth as an intervention.
Overview of Included Studies
A total of 3725 papers were identified in the database and grey literature searches. After removal of duplicates using Endnote (version 11), 2965 articles remained and were screened by title and abstract. This resulted in exclusion of 2909 articles, leaving 56 articles to screen for eligibility. Thirty-seven articles were further excluded. Reasons for exclusion included unavailability of full text (n=17), language (n=2), secondary analysis (n=8), reports (n=7), and unavailability of records providing additional but key information on studies (n=3). A total of 19 articles were included in our study, 10 intervention studies and 9 descriptive studies.illustrates the study screening and selection process, whereas provides an overview of the scope of mHealth interventions in the included studies. Overall, 73.7% (14 of 19) of the studies were conducted in Africa and 26.3% (5 of 19) in Asia. Most interventions (68.4%) used SMS text messaging, but the form of text messaging varied between the studies. Text messaging forms included unidirectional and multidirectional text messages. Furthermore, 10.5% (2 of 19) of studies combined SMS text messages with another form of mHealth. mHealth function as well as target populations differed between the studies.
Regarding the quality of mHealth evaluations in the studies, only one of the intervention studies was a randomized controlled trial (RCT) . The others [ - ] had quasi-experimental nonrandomized designs. provides an overview of the characteristics of the intervention studies, respectively by RCT and nonrandomized controlled trial status. Study designs reported for the descriptive studies ranged from case studies to cross-sectional study designs [ - ]. provides an overview of the characteristics of the descriptive studies and their key findings.
|Category||Subcategory||Intervention studies (N=10)||Descriptive studies (N=9)|
|Number of studies||% of studies||Number of studies||% of studies|
|Form of mHealth||Unidirectional text messaging||3||30.0||3||33.3|
|Multidirectional text messaging||2||20.0||1||11.1|
|Multidirectional text and voice messages||1||10.0||1||11.1|
|Unidirectional text messaging and Web-based technology||1||10.0||1||11.1|
|Mobile phone health apps or surveys||2||20.0||2||22.2|
|Mobile phone software||-||-||1||11.1|
|Mobile phone recording||1||10.0||-||-|
|mHealth function (certain studies contain multiple forms)||Data collection||6||60.0||4||44.4|
|Communication or information sharing||5||50.0||2||22.2|
|Topic (certain studies contain multiple topics)||Postpartum hemorrhage||1||10.0|
|Skilled maternal and newborn care||4||40.0||2||22.2|
|Training or educating midwives and nurses||2||20.0||4||44.4|
|HIV and pregnancy||2||20.0||1||11.1|
|Malaria in pregnancy||-||-||1||11.1|
|Target population (certain studies target multiple populations)||Traditional birth attendants||2||20.0||1||11.1|
|Health extension workers||1||10.0||1||11.1|
|Health care staff||2||20.0||2||22.2|
|Community health workers||3||30.0||4||44.4|
|Health surveillance assistants||1||10.0||-||-|
Overall Risk of Bias Assessment of Intervention Studies
The overall risk of bias assessment is reported inand . All included studies provided a clear definition of the outcomes and made use of self-measured data. Only one study accounted for confounders in the analysis [ ], 2 studies did not [ , ], and the remaining 8 of the included studies did not mention whether or not this was the case [ , , , , , , , ]. Most studies had a high risk of bias for selection of study population, with one study with unclear risk of bias [ ]. Two studies scored a high-risk bias for completeness of data, one study did not make use of a control group [ ], and another paper performed the study without secondary monitoring [ ].
Narrative Synthesis of Results of Intervention Studies
The intervention studies distinguish the use of mHealth directed at health care providers for data collection, communication, or educational purposes.
mHealth as a Data Collection Tool
Six papers described an mHealth intervention used as a data collection tool [- , - ].
Two of these studies assessed the knowledge and skill retention of midwives and TBAs after training sessions on how to use mobile phones as data collection tool [, ]. In rural Liberia, TBAs were trained in SMS texting data collection protocol and performed a 1-year posttest evaluation that showed that 63.6% of them displayed evidence of statistically significant knowledge and skill retention [ ]. However, only 11.0% of the TBAs were able to perform more complex tasks, such as adding credit to the mobile phone to increase mobile phone usage time. This task proved to be difficult due to low literacy and poor mobile phone reception and 69.8% of TBAs relied on people with higher education to support them with mobile functions. In rural Liberia, traditional midwives were trained to use SMS texting for real-time remote data collection using a pregnancy reporting protocol. They showed a significant mean increase in mobile phone knowledge and skill acquisition afterward [ ].
In a study conducted in Ethiopia, most health workers were able to use mobile phone health apps that are appropriate for their technical needs in terms of maternal health data collection , suggesting that mobile technologies allow health managers to more quickly and reliably have access to data which can help them identify whether and where there are issues in service delivery. Evaluation of mobile phone use by TBAs to report incidence, management, and outcome of postpartum hemorrhage, showed that 90.0% of the TBAs used their mobile phones to send SMS text messages in the 90 days following training and were able to use the protocols to report clinical outcomes [ ]. In 4 Chinese villages, the use of mobile phone questionnaire for data collection on infant feeding practices was compared with a pen-and-paper method. The pen-and-paper method was observed to be more error prone [ ] as 65.0% of the pen-and-paper records did not match and needed additional checking. Cost-wise, however, the mobile phone method was considerably more expensive at US $23 per questionnaire, compared with the pen-and-paper method that cost US $13 per questionnaire. In a study in Myanmar, a combination of Web-based and mobile technology was used to generate antenatal care and expanded program on immunization visit dates, in which the health worker was able to cross-check, identify, and update the mother and child status at the health facility or during home visits [ ]. This tool improved antenatal care and expanded program on immunization coverage in the study area with less delay in antenatal and immunization visits.
mHealth as Communication Tool
Three studies assessed the use of mHealth interventions as a communication tool [, , ]. In Malawi, it was shown that mobile phones can be used to reduce the communication gap between health workers and their district teams [ ]. The intervention consisted of SMS text messages used to report stock-outs, asking for general information, reporting emergencies, confirming meetings, and requesting technical support. For CHWs in the intervention group, an average of 9 minutes and at an average cost of $0.6 to report issues and receive feedback per contact was estimated. The most common modes of communication among this group were phone calls (94.4%) and SMS text messages (100.0%). Face-to-face communication was only reported by 8.0% of the participants. For CHWs in the control district, 1681 minutes (28 hours) and an average cost of US $4.6 to report and receive feedback per contact were estimated. The most common modes of communication amongst this group were use of face-to-face communication with their supervisors at district level (92.0%) and phone calls (6.0%) with none of them using SMS text messages. The mHealth intervention was at least 4 times cheaper and 134 times more efficient, compared with traditional and most common methods of walking, biking, or using public transport to reach supervisors face to face.
SMS texting between CHWs and either ambulance, health facility staff, district hospital, and central level, enabled an effective and real-time 2-way communication alert system to reduce maternal and child health deaths in Rwanda . The mHealth intervention resulted in a 20.0% increase in facility-based delivery, from 72.0% to 92.0%. In addition, CHWs became more proactive in identifying pregnant women and following up on registered pregnant women for appropriate care, by sending reminders to their mobile phones. In a study conducted in Zambia, SMS text messaging was used for transmission of test results between health facilities and caregivers to reduce the time needed for diagnosis of infant HIV infection [ ]. The mean turnaround time for delivery of a test result to the relevant health facility decreased from 44.2 days preimplementation to 26.7 days postimplementation. The mean turnaround time for delivery of test results to the caregiver of the tested child decreased from 66.8 days to 35 days [ ].
|Study/ (Focus of evaluation)||Study design||Target population or size (Setting)||Form of mHealth||mHealth function||Relevant findings|
|2014, Munro et al  |
|Nonrandomized design (preintervention and postintervention evaluation)||99 TBAsa trained; 63 retained 1-year posttraining for complete evaluation |
(Rural Bong county in Liberia)
|Utilization of mobile phone functions, coded SMS text messaging||Data collection and transmission (locating pregnant women; take data on age and referring them for antenatal care)||Participants demonstrated an increase in the mean number of skills that they were able to perform between pretest and both the immediate posttest and 1-year posttest. |
Mean number of skills that the participants were able to complete did decrease slightly between immediate and posttest.
Individual skills verified a significant retention of knowledge between the pretest and posttest.
Many TBAs continued to have trouble with the more complex skills of adding credit to a mobile phone (11% was able to do this at posttest).
70% of TBAs relied primarily on others with higher education to assist them with mobile functions; 24% used their phone to communicate with the certified midwife; 14.3 % wanted to communicate, but had poor reception.
|2014, Pathfinder (Grey Literature)  |
|Nonrandomized design (preintervention and postintervention evaluation)||258 participants in an infant feeding health education program |
(Abuja and Nasawara in Nigeria)
|150 CHWc in 10 primary health clinics||Education and communication (ANCd protocols, and client follow-up)||CHWs increased HIVe testing from 68% to 82%. |
Blood pressure measurement increased from 87% to 97%.
The quality of care score from client interviews increased from 13.33 at baseline to 17.15 at end line, with the most significant improvements related to health counseling.
Individual and group health counseling sessions became structured.
|2013, Little et al  |
|Nonrandomized design (preintervention and postintervention evaluation||20 HEWf, 12 midwives, 5 supervisors (Kilte and Awelalo districts in the Tigray region of Ethiopia)||Mobile phone app using open source components||Data collection (using appropriate technologies to meet needs of HEW and midwives||GPRSg connection was available in 35 health posts and centers (74%) of the study districts. |
There were very few instances of the mobile data network being unavailable for a substantial period of time.
34 of the 36 phones were retained; 2 were stolen with one later recovered; 3 phones had issues with insensitive screens and were replaced.
Most health workers rapidly learned how to use and became comfortable with the touch screen devices so only limited technical support was needed.
|2012, Zhang et al  |
(Maternal and Neonatal)
|Randomized controlled trial||10 students of the Hebei Union School of Public Health |
(Zhaozhou Township, Hebei Province, China)
|Mobile phone data collection||Data collection (Use of mobile phones for data collection on infant feeding practices compared with use of pen and paper)||In 120 copies of pen-and-paper questionnaires, 55 questionnaires contained errors. |
65% of the pen-and-paper records did not match and needed to be checked.
There was no significant difference between duration of pen-and-paper method versus mobile phone method.
The mean cost per questionnaire was higher for the mobile phone questionnaire (US $23) than for the pen-and-paper questionnaire (US $13).
The mobile phone method was acceptable to interviewers, with only minor problems that did not result in data loss.
|2012, Lori et al  |
|Nonrandomized design (preintervention and postintervention evaluation)||99 TBAs |
|SMS text messaging||Data collection (using a pregnancy reporting protocol)||Mean increase in mobile phone knowledge scores was 3.67 (95% CI 3.39-3.95). |
Data collectors also demonstrated a significant increase in their ability to perform each individual mobile phone task.
Participants with a mobile phone in the family did significantly better on 3 of the 7 tasks in pretest.
|2012, Seidenberg et al  |
|Nonrandomized design (preintervention and postintervention evaluation)||At least 2 health workers from each facility |
(2 districts in Southern Zambia)
|SMS text messaging||Data collection and transmission (to reduce the time between blood sampling for the detection of infant HIV infection and notification of the test results to the relevant point-of-care health facility by using SMS-based system||Mean turnaround time for delivery of a test result to the relevant health facility fell from 44.2 days (SDh:28) preimplementation to 26.7 days (SD:31.8) postimplementation. |
Mean turnaround times for delivery of a test result to a caregiver of the tested infant were 66.8 (SD: 38.8) preimplementation and 35 days (SD: 31.2) postimplementation.
|2012, Lemay et al  |
|Nonrandomized controlled trial (staged design)||Health surveillance assistants and community health workers. 95 SMS users in Salima. 95 nonusers in Salima. 95 nonusers in Kasungu |
(Salima, Nkhotakota, and Kasungu Districts in Malawi)
|SMS text messaging||Communication (reducing communication gaps between health workers and their district teams; increasing access to information and improve quality of services)||SMS used to report stock-outs, asking general information, reporting emergencies, confirming meetings, and requesting technical support. |
Among respondents who received phones, the most common form of communication was SMS (100%), phone calls (94%), public transport to travel (8%).
Among respondents who did not receive phones: 92% used transport and only 6% used phone calls. None used SMS for communication.
SMS participants needed an average of 9 minutes to report issues and receive feedback at an average of USD 0.61$.
Health workers with no access to SMS spend an average of 1445 minutes (24 hours) to report and receive feedback at an average of USD 2.70$.
In control district, it took 1681 minutes to report and receive feedback at an average of USD 4.56$.
|2012, Ngabo et al  |
|Nonrandomized design (pre intervention and postintervention evaluation)||432 community health workers and the rest of the health system (Musanze, Rwanda)||SMS Text messaging (Rapid SMS-MCHi system)||Communication (SMS-based platform, enabling effective and real time 2-way communication for action, between CHWs at community level, and the rest of the health system. Used to improve access to antenatal, postnatal care, institutional delivery, and emergency obstetric care)||5734 SMS were sent. |
11,502 pregnancies (81% of the 14,200 estimated annual pregnancies in district) were monitored.
A 20% increase in facility-based delivery from 72% 12 months before to 92% at the end of pilot phase.
|2011, Andreatta et al  |
|Nonrandomized design (posttraining evaluation)||8 TBA, 2 professional nurse midwives (Sene District in Ghana)||SMS text messaging||Data collection and communication (reporting postpartum hemorrhage occurrence, management, and outcome)||Both professionals and TBAs were able to use the specified reporting and text messaging protocols to report clinical outcomes. |
425 births were reported during study period, with 13 cases of PPHjoccurring (3.1%) cases.
|2010, Kwaewkungwal et al  |
(Maternal and child, including neonatal)
|Nonrandomized design (preintervention and postintervention evaluation)||Health workers in charge of ANC or EPIk services (sample size not indicated in paper) (Phung district, Thai-Myanmar)||SMS text messaging and Web-based apps||Data collection, automated generation of list, and update information regarding the antenatal care and child\'s immunization status on mobile phone when performing ANC or EPI activities off health care clinic||59% come on time as per scheduled dates after implementation compared with 44% before implementation. |
44% of children who came to receive scheduled vaccines on time on the preset monthly immunization date after intervention compared with 35% before.
Updating immunization data on mobile phone increased odds of EPI on time by 2.04.
aTBA: traditional birth attendant.
bSMS: short message service.
cCHW: community health worker.
dANC: antenatal care visit.
eHIV: human immunodeficiency virus.
fHEW: health extension worker.
gGPRS: general packet radio service.
hSD: standard deviation.
iMCH: maternal and child health.
jPPH: postpartum hemorrhage.
kEPI: expanded program on immunization.
Narrative Synthesis of Results of the Descriptive Studies
In Indonesia, a theoretical model on the use of mobile phones to enhance the capacity of health workers was developed and tested among 223 midwives . Mobile phone use was positively associated with midwives’ access to institutional and peer information resources. SMS text messaging was used to educate midwives in a study conducted in South Africa and improved clinical practice was reported by 72.0% of participants. More than two-thirds (68.0%) of the midwives commonly shared and discussed the messages with their colleagues. All participants requested to receive more text messages on other important topics [ ]. Again, in rural South Africa, the feasibility and acceptability of using mobile phone app for data collection amongst pregnant women living with HIV was explored [ ]. Acceptability was high, as well as perceived usefulness and ease of use. Feasibility of conducting the interviews in the setting was also high, with no significant challenges with respect to network coverage, cost of hardware and software, and secure transmission of data. Among nurses receiving midwifery education, mobile phone usage facilitated authentic problem solving, reflective practice, and life-long learning [ ]. In Afghanistan, World Vision rolled out an mHealth intervention, using the open source CommCare platform [ ]. This was aimed at improving the quality of counseling for pregnant women, promote facility delivery, and facilitate timely referral of women and newborns to facilities and hopefully result in decreased maternal and newborn deaths following increase in utilization of services [ ]. The study does not report on how these were achieved but mentions that it was successful, and the project was further expanded to deal with childhood nutrition. In one study, 9 health workers were provided with mobile phones with an installed algorithm that allowed for real-time access to data. This reduced time lag in patient data transmission and allowed for pregnant women to be categorized based on risk for treatment [ ]. The Safer Deliveries project in Zanzibar, which employed an open source mobile app enrolled TBAs and resulted in an increase in registration of pregnant women as well as increase of facility delivery from 33.6% to 71.0% [ ]. Finally, the International Institute for Communication and Development in 2013 piloted a project in Mali in which CHWs and specialists used a mobile app to report and monitor cases of malaria in pregnancy and among children aged younger than 5 years, as well as detect and respond promptly to any outbreak [ ]. This resulted in a 31% reduction in malaria in pregnancy and 33% reduction in children under 5 years with malaria. presents an overview of the characteristics and relevant findings of the descriptive studies.
Strengths, Weaknesses, Opportunities, and Threats Analysis of Included Studies
A Strengths, Weaknesses, Opportunities, and Threat analysis was conducted for all included studies. All studies included are relatively current studies published from 2010 onward providing up-to-date information. There is also a good variation of settings within the domain of LMIC, with studies conducted in West, East, and Southern Africa, and different parts of Asia. All forms of mHealth interventions as well as different functions that can be served by mHealth are represented in these studies. In all but one study, standardized phones were procured for participants. Strength of the included studies is the broad range of health worker categories considered, allowing for easy assessment of feasibility of mHealth apps for the daily work of health care workers. Weaknesses in the studies related mainly to their study design. Only one of the intervention studies was a RCT , the others combined various nonrandomized study designs, such as preintervention and postintervention comparison, and in this regard, lack the specific rigor associated with intervention studies. The descriptive studies ranged from surveys to case studies. For each broad mHealth function, various apps were reported. For example, under communication function, one study reported mHealth used to report stock-outs to higher levels [ ], whereas another study reported mHealth used to follow-up women and report clinical outcomes [ ]. This could have been an advantage if more than one study reported specific apps to allow for comparison of results. Most of the studies report on process rather than outcome measures, and thus, this systematic provides an indication for opportunity for more rigorous intervention studies that focus on both specific maternal and neonatal outcome measures in the future.
Strengths, Weaknesses, Opportunities, and Threats Analysis of mHealth as an Intervention
Multiple studies mention low costs to be strength of the mHealth interventions compared with traditional methods [, , , ]. mHealth interventions were found to be considerably more efficient than traditional methods used for communication [ ], and to improve the effectiveness of community health services in terms of managing logistics, reporting events, and addressing emergencies. mHealth allowed for integration of all levels of health workers, including TBAs, to expedite emergency referrals and communicate with skilled providers like midwives [ ].
Weaknesses included that the information in the text messages was too simple and needed additional detailed information . In addition, remoteness of study sites was a limitation to Web-based education due to lack of or poor access to the Web [ ]. Technological problems such as poor reception, lost and damaged phones, and difficulty with certain mobile phone models were also identified [ ]. mHealth interventions that are dependent on existing information systems, with modular systems that are not interoperable, cannot be linked to other settings and data structures [ ]. Other weaknesses include poor telephone maintenance and lack of or limited access to electricity in a number of communities.
Clear opportunities exist for utilization of mHealth. This includes the additional functions of the technology, such as global positioning system, taking and storing pictures and videos, as well as the ability to record sound. These can facilitate data collection tools in the future . Another opportunity offered by mHealth is for a broader mobile network coverage that could expand the reach of health information to frontline health workers in remote areas and accelerate knowledge exchange between health workers and higher levels in the health system [ ]. mHealth offers the opportunity for strengthening of health care infrastructure with the requisite financial support, and the technology can be applied to a broader scope of public health care [ ]. It is also possible to address various health system issues using one mHealth program or intervention [ , ], and there are various software available that could be adapted to suit specific needs of health care [ ]. Opportunities for public–private partnership also exist [ ].
Factors that threaten mHealth implementation included lack of reliable Web coverage, which limits the potential of mHealth in the public sector [, ], limited capacity to manage damaged phones, low literacy levels [ ], and lack of appreciation by health workers of the need to use data where it is generated [ ]. Several of the reported interventions were conducted by foreign agencies that could potentially result in limited sustainability [ , , , ]. This, however, could be overcome if local stakeholders and institutions engaged in the program appreciate the value of the capacity building offered. Finally, it is important that any tool adapted to be used through mHealth be itself efficient, to maximize the benefits of mHealth functions [ ].
(Focus of Evaluation Measures)
|Study design||Target health workers or size |
|Form of mHealth||mHealth function||Relevant findings|
|2014, Lee et al  |
Maternal and Neonatal)
|Cross-sectional||223 midwives |
(15 sub-districts of Aceh Besar, Indonesia)
|One-way mobile phone use||Improving access to health-related resources: formal (medical professionals) and informal (peer workers) resources||Mobile phone use was positively associated with midwives\' access to institutional and peer information resources. |
Access to institutional resources was positively associated with midwives\' health knowledge, whereas access to peer resources was not.
Access to peer resources was associated with higher self-efficacy, which was positively associated with health knowledge.
Implications for technology interventions strategies targeted to community health workers in rural communities provided.
|2014, Tsai et al  |
|2 Cross-sectional studies||Community health workers (sample size not stated in paper) (Khayelitsha Cape Town, South Africa)||Mobile phone program||Case finding (use of mobile phones for administering the EPDSa during the routine course of their community-based outreach and wellness work||CHWsb were able to detect probable antenatal depression using the scale during their routine outreaches with excellent discrimination, with area under the receiver-operating characteristic curve (AUC) values ranging from 0.91 to 0.99; 0.97 sensitivity and 0.76 specificity. |
|2014, Pimmer et al  |
|Case study||16 nurses attending an advanced midwifery course |
(Rural South Africa)
|Mobile phones||Nurse education (mobile phones as educational tools)||Nursing students in resource poor settings use mobile technology as educational tools. |
These learning practices involve sociocognitive processes, learning in the form of joint problem solving and reflection, as well as more intensive forms of sociocultural participation.
In order for educational institutions to more fully and more systematically harness the potentials of these media, a number of ethical and practical issues need to be addressed.
|2014, D-Tree International  (Grey Literature) |
(Maternal and neonatal)
|Cross-sectional||24 TBAs in phase I and 223 CHWs in phase II |
|Mobile phone with open source mobile app||Data collection and communication and information sharing||There was an increase in access to skilled care during pregnancy, childbirth, and post-partum care. |
71% facility delivery compared with 33.6% in DHS.c
77% facility delivery in phase II (DHS range between 25% and 41%).
Increase in primary care level deliveries (44% compared with 4% in 2011).
Geographical differences in delivery habits highlighted.
Increased self-efficacy and capability of frontline workers.
|2014, World Vision  |
(Maternal and neonatal)
|Cross-sectional||CHWs (sample size not provided in paper) |
|Mobile phone||Counseling and referrals||Promotion of health facility deliveries. |
Timely referrals of women and newborns.
Decrease in maternal and new-born deaths (worth noting that exact measures of these are not stated in the paper).
|2013, van Heerden et al  |
|Cross-sectional||16 data collectors; |
(Rural South Africa)
|MPAPId||Data collection (feasibility of face-to-face maternal health data collection from pregnant women living with HIV using a mobile phone survey app)||Perceived usefulness was reported to be slightly higher than perceived ease of use. |
After 3 months of field use, interviewer perceptions of both perceived ease of use and perceived usefulness were found to be higher than before training.
High feasibility of conducting MPAPI interviews in this setting.
Network coverage was available in all clinics and hardware, software, cost, and secure transmission to the data center presented no significant challenges over the 21-month period.
For the 12 MLHfparticipants in group 2, anxiety about the multimedia capabilities of the phone was evident. Their concern centered on the possibility that their privacy may be invaded by interviewers using the mobile phone camera to photograph them.
For participants in group 3, having the interviewer sit beside versus across from the interviewee during the MPAPI interview was received positively by 95% of MLH. Privacy (6%) and confidentiality (5%) concerns were low for group 3 MLH.
Mobile phones were found both to be acceptable and feasible in the collection of maternal and child health data from women living with HIV in South Africa.
|2013, IICDg  (Grey Literature) |
(Maternal and children)
|Cross-sectional||50 CHWs and 10 health specialists (Yirimodjo, Mali)||MAMMAh||Data collection and monitoring (questionnaire with malaria indicators and monitoring of disease evolution)||31% reduction in malaria in pregnancy cases. |
Faster treatment response (65%).
32% reduction in malaria in children under 5 years.
20% increase in pregnant women sleeping under bed net.
42% increase in pregnant women receiving preventative medication.
|2012, Woods et al  |
(Maternal and neonatal)
|Cross-sectional||50 midwives out of 2500 midwives from public and private sectors |
|SMS text messaging; with link to a website with additional information||Education||86% enjoyed and learned from weekly text messages. |
72% felt that the messages improved clinical practice.
68% shared and discussed the messages with colleagues.
|2010, Alam et al  (Grey Literature) |
|Case study||9 BRACi health workers |
(3 urban slums of Dhaka, Bangladesh)
|Mobile phones with smart algorithms (The Click Module)||Data collection (real-time access to data)||Health workers could send data directly to the central MISj system. |
Reduced time lag in data transmission.
Established a secured Web page containing all patient data.
Established an automated decision tree that categorizes patients depending on their risk levels.
aEPDS: Edinburgh Postnatal Depression Scale.
bCHWs: community health workers.
cDHS: demographic and health survey.
dMPAPI: mobile phone-assisted personal interviewing.
eHIV: human immune deficiency virus.
fMLH: mothers living with HIV.
gIICD: International Institute for Communication and Development.
hMAMMA: Mamans Mobiles contre le Malaria au Mali.
iBRAC: building resources across community (a nongovernmental organization).
jMIS: management information system.
This systematic review shows effective use of mHealth interventions as communication, educational, and data collection tools by health workers to report on medical events related to maternal and child health within their community. These constitute health systems strengthening app tools . The specific mHealth functions have enabled health workers to track pregnant women in their care, as well as facilitate referrals. Such strategies, targeted at data collection and reminders for antenatal visits, directly impact on service utilization such as antenatal coverage, whereas those aimed at improving skilled attendance at delivery and facility delivery impact more directly on mortality [ ]. Unfortunately, only one of the studies included in our review directly reports the effect of mHealth on maternal and neonatal mortality, without exact details of coverages. Although other studies have shown that mHealth interventions targeted at clients can reduce perinatal mortality by 50% [ ], we could not convincingly demonstrate this effect for health worker-targeted interventions.
The fact that most of the studies included in this review targeted health workers at community level provides insights into the possibility of creating an intermediate layer in which health workers form an important linkage between higher health institutions and the community in harnessing the befits of mHealth.
Some challenges of mHealth were identified, and these were mainly technological problems, such as mobile network coverage, Web-based access, electricity access, and maintenance of mobile phones [, , ]. These could negatively affect the expansion of the mHealth interventions in LMIC if not addressed. However, technological improvement comes with associated costs. Engaging the private sector in a public-private partnership can reduce such cost [ ] and facilitate the expansion of mHealth interventions in LMIC in the future. Decreasing costs of handsets will potentially reduce further the cost of mHealth interventions.
Given the large investments in mHealth [, ], with the highest cost of service provision in LMIC [ ], experimental evaluations which will thoroughly assess its impact [ ], more specifically on maternal and neonatal health outcomes, will be most beneficial. Future studies should investigate the effectiveness of the interventions by measuring similar outcomes. Health workers’ level of literacy affected their ability to perform complex tasks on mobile devices [ ]. It is important to address this challenge if the full complement, respectively potential of mHealth is to be deployed at all levels of service delivery, including the community level. Lower cadre of health staff will need adequate training to ensure their optimization of such interventions.
Limitations of our review include a high risk of bias observed for some of the intervention studies, mainly relating to limited consideration of confounding. Only one study was a RCT. Most studies were pilot or implementation studies. A further limitation of the current systematic review is the domain limitation of LMIC. This affects the generalizability of our results to other settings, as we are aware that some studies in high-income countries or low-income mothers in high-income countries could provide informative insight in the effectiveness of mHealth interventions to improve health outcomes .
The strength of the current systematic review is the comprehensive search conducted including available grey literature reflecting current activities of nongovernmental organizations, which are often not published in peer-reviewed journals. This paper thus provides a comprehensive overview of the available literature on the effectiveness of mHealth interventions to date and narratively assesses the broad function of mHealth. The methodology used in the narrative synthesis looks at the broad function of mHealth as used in the study, the targeted frontline providers, and the effectiveness of the mHealth intervention, an approach that facilitated easy assessment of the usefulness of the various mHealth functions.
This systematic review indicates that mHealth interventions targeting health care workers have the potential to materially improve maternal and neonatal health services in LMICs. There is, however, a gap in the knowledge of how mHealth interventions directly affect maternal and neonatal outcomes and future research should employ experimental designs to address this gap.
MAC gratefully acknowledge technical support from the Julius Center for Health Sciences and Primary Care. The authors also thank the Netherlands Organization for Scientific Research (NWO) Global Health Policy and 396 Health Systems Research Program, Netherlands, for providing funds for the conduct of the study (Grant number: 07.45.102.00) and Verena Schier for the use of her adapted Cochrane Bias Tools for assessing risk of bias.
Conflicts of Interest
Multimedia Appendix 1
List of organizations contacted for grey literature.PDF File (Adobe PDF File), 35KB
Multimedia Appendix 2
Full search strategy.PDF File (Adobe PDF File), 63KB
Multimedia Appendix 3
Adapted quality assessment tool.PDF File (Adobe PDF File), 57KB
Multimedia Appendix 4
Table showing Risk of Bias assessment for included intervention studies.PDF File (Adobe PDF File), 55KB
- World Health Organization. 2015 Nov. Maternal mortality: Facts sheets URL: http://www.who.int/mediacentre/factsheets/fs348/en/ [accessed 2016-08-01] [WebCite Cache]
- van Lonkhuijzen L, Stekelenburg J, van Roosmalen J. Maternity waiting facilities for improving maternal and neonatal outcome in low-resource countries. Cochrane Database Syst Rev 2009(3):CD006759. [CrossRef] [Medline]
- Countdown Coverage Writing Group, Countdown to 2015 Core Group, Bryce J, Daelmans B, Dwivedi A, Fauveau V, et al. Countdown to 2015 for maternal, newborn, and child survival: the 2008 report on tracking coverage of interventions. Lancet 2008 Apr 12;371(9620):1247-1258. [CrossRef] [Medline]
- Lawn JE, Kerber K, Enweronu-Laryea C, Cousens S. 3.6 million neonatal deaths--what is progressing and what is not? Semin Perinatol 2010 Dec;34(6):371-386. [CrossRef] [Medline]
- Chen L, Evans T, Anand S, Boufford JI, Brown H, Chowdhury M, et al. Human resources for health: overcoming the crisis. Lancet 2004;364(9449):1984-1990. [CrossRef] [Medline]
- Sanou B. e-agriculture. The World in 2013: ICT Facts and Figures URL: http://www.e-agriculture.org/news/itu-world-2013-ict-facts-and-figures [accessed 2016-08-01] [WebCite Cache]
- Qiang C, Yamamichi M, Hausman V, Altman D. World Bank. 2011 Dec. Mobile Applications for the Health Sector URL: http://siteresources.worldbank.org/INFORMATIONANDCOMMUNICATIONANDTECHNOLOGIES/Resources/mHealth_report.pdf [accessed 2016-08-01] [WebCite Cache]
- Black AD, Car J, Pagliari C, Anandan C, Cresswell K, Bokun T, et al. The impact of eHealth on the quality and safety of health care: a systematic overview. PLoS Med 2011;8(1):e1000387 [FREE Full text] [CrossRef] [Medline]
- Blaya JA, Fraser HS, Holt B. E-health technologies show promise in developing countries. Health Aff (Millwood) 2010 Feb;29(2):244-251 [FREE Full text] [CrossRef] [Medline]
- Kouris I, Mougiakakou S, Scarnato L, Iliopoulou D, Diem P, Vazeou A, et al. Mobile phone technologies and advanced data analysis towards the enhancement of diabetes self-management. Int J Electron Healthc 2010;5(4):386-402. [CrossRef] [Medline]
- Center for Global Health and Economic Development Earth Institute, Columbia University. mHealth Knowledge. 2010 May. Barriers and Gaps Affecting mHealth in Low and Middle Income Countries: Policy White Paper URL: http://www.mhealthknowledge.org/sites/default/files/28_barriers_and_gaps.pdf [accessed 2016-08-02] [WebCite Cache]
- World Health Organization. 2010. Telemedicine: Opportunities and Developments in Member States: Report on the second Global Survey on eHealth URL: http://www.who.int/goe/publications/goe_telemedicine_2010.pdf [accessed 2016-08-02] [WebCite Cache]
- Chi BH, Stringer JS. Mobile phones to improve HIV treatment adherence. Lancet 2010 Nov 27;376(9755):1807-1808. [CrossRef] [Medline]
- Hoffman JA, Cunningham JR, Suleh AJ, Sundsmo A, Dekker D, Vago F, et al. Mobile direct observation treatment for tuberculosis patients: a technical feasibility pilot using mobile phones in Nairobi, Kenya. Am J Prev Med 2010 Jul;39(1):78-80. [CrossRef] [Medline]
- Kunutsor S, Walley J, Katabira E, Muchuro S, Balidawa H, Namagala E, et al. Using mobile phones to improve clinic attendance amongst an antiretroviral treatment cohort in rural Uganda: a cross-sectional and prospective study. AIDS Behav 2010 Dec;14(6):1347-1352. [CrossRef] [Medline]
- Lester R, Ritvo P, Mills E, Kariri A, Karanja S, Chung M, et al. Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): a randomised trial. The Lancet 2010 Nov 27;376(9755):1838-1845.
- Liberati A, Altman D, Tetzlaff J, Mulrow C, Gøtzsche P, Ioannidis J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 2009 2009 Jul 21;339:b2700.
- The World Bank. 2015. World Bank Country and Lending Groups URL: https://datahelpdesk.worldbank.org/knowledgebase/articles/906519 [accessed 2016-07-28] [WebCite Cache]
- Global Observatory for eHealth, World Health Organization. 2011 Jun. mHealth - New horizons for health through mobile technologies. Global Observatory for eHealth Series - Volume 3 URL: http://www.who.int/goe/publications/ehealth_series_vol3/en/ [accessed 2016-08-02] [WebCite Cache]
- Higgins J, Green S. The Cochrane Collaboration. 2011. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011] URL: http://training.cochrane.org/handbook [accessed 2016-08-02] [WebCite Cache]
- Cochrane Childhood Cancer. Non-randomised controlled study (NRS) designs URL: http://childhoodcancer.cochrane.org/non-randomised-controlled-study-nrs-designs [accessed 2016-08-02] [WebCite Cache]
- Zhang S, Wu Q, van Velthoven MH, Chen L, Car J, Rudan I, et al. Smartphone versus pen-and-paper data collection of infant feeding practices in rural China. J Med Internet Res 2012;14(5):e119 [FREE Full text] [CrossRef] [Medline]
- Andreatta P, Gans-Larty F, Debpuur D, Ofosu A, Perosky J. Evaluation of simulation-based training on the ability of birth attendants to correctly perform bimanual compression as obstetric first aid. Int J Nurs Stud 2011 Oct;48(10):1275-1280. [CrossRef] [Medline]
- Kaewkungwal J, Singhasivanon P, Khamsiriwatchara A, Sawang S, Meankaew P, Wechsart A. Application of smart phone in “Better Border Healthcare Program”: a module for mother and child care. BMC Med Inform Decis Mak 2010;10:69 [FREE Full text] [CrossRef] [Medline]
- Lemay NV, Sullivan T, Jumbe B, Perry CP. Reaching remote health workers in Malawi: baseline assessment of a pilot mHealth intervention. J Health Commun 2012;17 Suppl 1:105-117. [CrossRef] [Medline]
- Little A, Medhanyie A, Yebyo H, Spigt M, Dinant GJ, Blanco R. Meeting Community Health Worker Needs for Maternal Health Care Service Delivery Using Appropriate Mobile Technologies in Ethiopia. PLOS ONE 2013 Oct 29;8(10):e77563.
- Lori J, Munro ML, Boyd CJ, Andreatta P. Cell phones to collect pregnancy data from remote areas in Liberia. J Nurs Scholarsh 2012 Sep;44(3):294-301 [FREE Full text] [CrossRef] [Medline]
- Munro ML, Lori JR, Boyd CJ, Andreatta P. Knowledge and skill retention of a mobile phone data collection protocol in rural Liberia. J Midwifery Womens Health 2014;59(2):176-183 [FREE Full text] [CrossRef] [Medline]
- Ngabo F, Nguimfack J, Nwaigwe F, Mugeni C, Muhoza D, Wilson DR, et al. Designing and Implementing an Innovative SMS-based alert system (RapidSMS-MCH) to monitor pregnancy and reduce maternal and child deaths in Rwanda. Pan Afr Med J 2012;13:31 [FREE Full text] [Medline]
- Pathfinder International. 2014. Assessment of the Quality of Antenatal Care Services Provided by Health Workers using a Mobile Phone Decision Support Application in Northern Nigeria: A Pre/Post-intervention Study URL: http://www.pathfinder.org/publications-tools/antenatal-care-services-northern-nigeria.html [accessed 2016-08-02] [WebCite Cache]
- Seidenberg P, Nicholson S, Schaefer M, Semrau K, Bweupe M, Masese N, et al. Early infant diagnosis of HIV infection in Zambia through mobile phone texting of blood test results. Bulletin of the World Health Organization 2012;90:348-356.
- Alam M, Khanam T, Khan R. Assessing the scope for use of mobile based solution to improve maternal and child health in Bangladesh: A case study. 2010 Dec Presented at: 4th ACM/IEEE International Conference on Information and Communication Technologies and Development; December 13-16, 2010; London, UK.
- D-Tree International. Safer Deliveries in Zanzibar URL: http://www.d-tree.org/saving-lives/womens-lives/safer-deliveries/ [accessed 2016-07-28] [WebCite Cache]
- Eugelink H. IICD. 2013. Combating Mother and Child Malaria Mortality with Mobiles URL: http://www.iicd.org/articles/combating-mother-and-child-malaria-mortality-with-mobiles [accessed 2016-08-03] [WebCite Cache]
- Lee S, Chib A, Kim JN. Midwives' cell phone use and health knowledge in rural communities. J Health Commun 2011 Oct;16(9):1006-1023. [CrossRef] [Medline]
- Pimmer C, Brysiewicz P, Linxen S, Walters F, Chipps J, Gröhbiel U. Informal mobile learning in nurse education and practice in remote areas--a case study from rural South Africa. Nurse Educ Today 2014 Nov;34(11):1398-1404. [CrossRef] [Medline]
- Tsai A, Tomlinson M, Dewing S, le Roux IM, Harwood J, Chopra M, et al. Antenatal depression case finding by community health workers in South Africa: feasibility of a mobile phone application. Arch Womens Ment Health 2014 Oct;17(5):423-431 [FREE Full text] [CrossRef] [Medline]
- van Heerden A, Norris S, Tollman S, Richter L, Rotheram-Borus MJ. Collecting maternal health information from HIV-positive pregnant women using mobile phone-assisted face-to-face interviews in Southern Africa. J Med Internet Res 2013;15(6):e116 [FREE Full text] [CrossRef] [Medline]
- World Vision International. Afghanistan mHealth URL: http://www.wvi.org/health/afghanistan-mhealth [accessed 2016-08-02] [WebCite Cache]
- Woods D, Attwell A, Ross K, Theron G. Text messages as a learning tool for midwives. S Afr Med J 2012 Feb;102(2):100-101. [Medline]
- Labrique A, Vasudevan L, Kochi E, Fabricant R, Mehl G. mHealth innovations as health system strengthening toolscommon applications and a visual framework. Glob Health Sci Pract 2013 Aug;1(2):160-171.
- Jo Y, Labrique A, Lefevre A, Mehl G, Pfaff T, Walker N, et al. Using the lives saved tool (LiST) to model mHealth impact on neonatal survival in resource-limited settings. PLoS One 2014;9(7):e102224. [CrossRef] [Medline]
- Lund S, Rasch V, Hemed M, Boas I, Said A, Said K, et al. Mobile phone intervention reduces perinatal mortality in zanzibar: secondary outcomes of a cluster randomized controlled trial. JMIR Mhealth Uhealth 2014;2(1):e15. [CrossRef] [Medline]
- Brettlecker G, Cáceres C, Fernández A, Fröhlich N, Kinnunen A, Ossowski S, et al. Technology in Healthcare. In: Schumacher M, Helin H, Schuldt H, editors. CASCOM: Intelligent Service Coordination in the Semantic Web. Basel: Birkhäuser; 2008:125-139.
- Schweitzer J, Synowiec C. The economics of eHealth and mHealth. J Health Commun 2012;17 Suppl 1:73-81. [CrossRef] [Medline]
|CHW: community health worker|
|HIV: human immunodeficiency virus|
|LMIC: low- and middle-income country|
|RCT: randomized controlled trial|
|SMS: short messaging service|
|TBA: traditional birth attendant|
Edited by G Eysenbach; submitted 19.01.16; peer-reviewed by M Larsen, I Ibiebele, J Watterson, C Hawke; comments to author 03.03.16; revised version received 27.04.16; accepted 04.06.16; published 19.08.16
©Mary Amoakoh-Coleman, Alexander Berend-Jan Borgstein, Stephanie FV Sondaal, Diederick E Grobbee, Andrea Solnes Miltenburg, Mirjam Verwijs, Evelyn K Ansah, Joyce L Browne, Kerstin Klipstein-Grobusch. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 19.08.2016.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.