Review
Abstract
Background: Telepharmaceutical services (TPS) led by pharmacists, an emerging telehealth service, improve access to medical services and enable patients to receive specialized services in areas with limited resources. With a lower risk of infection and no restriction of isolation measures, TPS showed great potential during the COVID-19 pandemic. However, whether the effectiveness of TPS changed before and after the outbreak of the COVID-19 pandemic remained unclear.
Objective: This study aimed to evaluate the effectiveness of TPS, compare the effectiveness before and after the outbreak of the COVID-19 pandemic, and explore whether the effectiveness changed over time.
Methods: We searched PubMed, Embase (Ovid), SinoMed, China National Knowledge Infrastructure, Wanfang, and VIP databases for randomized controlled trials that evaluated the effectiveness of TPS. The search covered studies published from inception to October 24, 2023. Eligible studies were conducted before May 5, 2023, when the World Health Organization (WHO) declared the end of the COVID-19 pandemic as a Public Health Emergency of International Concern. We used the random-effect model to pool the results and the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) system to assess the certainty of evidence. To explore whether the effectiveness of TPS changed over time, we applied subgroup analyses (studies conducted before December 31, 2019, and studies conducted after January 1, 2020). Using the independent-sample z test, we compared the effectiveness of TPS between the 2 subgroups. When a significant difference arose between them, we conducted a meta-regression analysis to further evaluate the trend of effectiveness over time.
Results: In addition, 40 studies were finally included. Compared with no TPS or usual care (ie, face-to-face pharmaceutical services), TPS probably increased patient medication adherence (risk difference [RD] 0.15, 95% CI 0.09-0.20, moderate certainty), and may reduce the occurrence of adverse events (RD –0.10, 95% CI –0.18 to –0.02, low certainty) and improve the proportion of patients who were satisfied with medication (RD 0.16, 95% CI 0.05-0.26, low certainty). Moderate to high evidence indicated that patients accepting TPS probably achieved superior management of diabetes and hypertension. The effectiveness of TPS was not significantly different before and after the outbreak of the COVID-19 pandemic except for medication adherence (RD 0.12, 95% CI 0.03-0.21, P=.007), which also increased over time (coefficient=0.01, 95% CI 0.01-0.02, P<.001).
Conclusions: TPS probably improved patient medication adherence and may lead to better satisfaction and the incidence of adverse events. The effectiveness of TPS in general did not change after the outbreak of the COVID-19 pandemic.
Trial Registration: PROSPERO CRD42023487476; https://tinyurl.com/3s47enj6
doi:10.2196/64073
Keywords
Introduction
Telepharmaceutical services (TPS) led by pharmacists were an emerging telehealth service, including pharmaceutical counseling sessions, medication therapy management, drug review and monitoring, clinical consultation, and some other pharmacy services delivered through telecommunications technology []. TPS showed potential benefits in the management of chronic disease management, particularly for rural and geographically isolated areas [-]. Especially, the COVID-19 pandemic increased the demand of patients for TPS, leading to a surge in use. Patients with potential medical and pharmaceutical problems may be in greater need of professional care after the outbreak of the COVID-19 pandemic than before since those were more susceptible to COVID-19 infection. In addition, patients who accepted regular pharmaceutical services before the outbreak of the COVID-19 pandemic had difficulty in accessing care after the outbreak of the COVID-19 pandemic due to quarantine measures, conducted by countries to isolate the transmission of the virus []. Thus, they had to turn to TPS.
Previous systematic reviews related to TPS synthesized results for effective implications. Furthermore, 2 systematic reviews compared the effectiveness of TPS versus no TPS or face-to-face pharmaceutical services, with evidence that TPS appeared to be at least as effective as face-to-face care in the management of diabetes and anticoagulation [,]. Two additional systematic reviews after the outbreak of the COVID-19 pandemic supported effective TPS in a qualitative way []. However, these previous systematic reviews did not include patient-reported outcomes (ie, health-related quality of life, satisfaction, health behavior, and medication adherence), which were important for assessing how patients were feeling and functioning when evaluating the interventions []. More importantly, no evidence compared the difference in TPS before and after the outbreak of the COVID-19 pandemic and analyzed the effectiveness of TPS over time. Compared with TPS before the outbreak of the COVID-19 pandemic, whether TPS addressed the patients’ needs adequately or not after the outbreak remained unclear. This uncertainty has posed a barrier to deciding whether TPS should be improved on a large scale in the future.
We performed a systematic review to evaluate the effectiveness of TPS, compare the effectiveness of TPS before and after the outbreak of the COVID-19 pandemic, and analyze the effectiveness of TPS with time passing. This study included the most comprehensive and latest studies about TPS, which may provide useful evidence of TPS and policy making in the post–COVID-19 pandemic era.
Methods
We registered this study in PROSPERO (International Prospective Register of Systematic Reviews; CRD42023487476). We revised the protocol after registration (). We reported this study according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement () [].
Search Strategy and Selection Criteria
We searched PubMed, Embase (Ovid), SinoMed, China National Knowledge Infrastructure, Wanfang, and VIP databases from inception to October 24, 2023 (). In addition, 2 reviewers independently screened the studies based on titles and abstracts. Reviewers had a discussion in case of disagreement to reach a consensus with the guidance of the third reviewer.
We set the inclusion criteria based on Population, Intervention, Comparison, and Outcome principles []. Eligible studies were randomized controlled trials relevant to TPS led by pharmacists. The authors defined the comparison between TPS and no TPS or usual care (ie, face-to-face pharmaceutical services). To compare the effectiveness of TPS before and after the outbreak of the COVID-19 pandemic through prespecified subgroup analyses, we included studies conducted before May 5, 2023, when the World Health Organization (WHO) declared COVID-19 was no longer a Public Health Emergency of International Concern []. To ensure comparability, we only selected studies from countries with the same income level before and after the outbreak. We excluded studies related to other telehealth services, even if they involved pharmaceutical care, or if pharmacists were only involved in supporting a research role (ie, recruitment). We excluded studies without full-text or published in languages other than English and Chinese. We also excluded the studies with a significant difference in the baseline for outcomes of interest between the comparison (P≤.05).
Outcomes of Interest
The primary outcomes of interest were medication adherence, medication satisfaction, and adverse events. We focused on the multiple measures of medication adherence, including pharmacy-based data (eg, the proportion of days covered), patient self-report measures (eg, measured by questionnaires, scales, or instruments), and reports from health care professionals or carers. Similarly, satisfaction, another patient-reported outcome, was evaluated in multiple forms (eg, proportion of satisfaction for patients and score of satisfaction with different scales). We also assessed other disease-specific measures (eg, hemoglobin A1c [HbA1c], systolic blood pressure [SBP], diastolic blood pressure [DBP], and international normalized ratio [INR]). We were interested in endpoints at the end of the follow-up, not changing indexes during the follow-up.
Data Extraction
In addition, 2 reviewers (PZ and XL) independently extracted the following information: regions and income level of countries, year of study conduction, type of intervention, characteristics of participants, and outcomes of interest with data. Country regions and income levels were classified according to the World Bank (2022-2023) [].
Risk-of-Bias Assessment and Certainty of Evidence
Using the Cochrane Risk of Bias (RoB) tool, 2 reviewers (PZ and XL) assessed the RoB of the methodological quality of eligible individual studies []. We summarized the overall RoB for each study with low, moderate, or high risk (). Applying the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) system, 2 reviewers (PZ and XL) rated the certainty of a body of evidence regarding the specific outcome in the meta-analysis independently () []. We rated the certainty of evidence in GRADE based on whether TPS had a true effect. Certainty reflected our confidence that the observed effects differed from the null [,]. We used a null effect as the threshold in absolute effect size and assessed the certainty based on absolute measures (eg, risk difference [RD] and mean difference) rather than relative measures (eg, risk ratio). When facing disagreement, the 2 reviewers reached a consensus by discussing with the third reviewer.
Data Analysis
For dichotomous outcomes (eg, medication adherence or patient satisfaction), we calculated risk ratio and RD with 95% CI values to estimate the combined effect size associated with TPS.
For continuous outcomes (eg, score of satisfaction and medication adherence with different scales), based on the extracted means and SDs between the comparisons, we calculated mean difference with 95% CI values. If SDs were unavailable, we calculated values by converting SEs or CIs, as informed in Chapter 7.7.3.2 of the Cochrane Handbook [].
We used a random-effect model to pool effect estimates []. Pooling effect estimates of medication adherence and satisfaction were difficult because of different measures. To address this problem, we reported data in the original form defined by the authors (dichotomous and continuous data). To simplify the pooled process of continuous data, we transferred the total scale to 100 points. Using Funnel plots and Egger test (≥10 included studies), we assessed potential publication bias []. We also made sensitivity analyses to assess the robustness of the synthesized results.
Subgroup Analyses
Prespecified Subgroup Analysis: TPS Before and After the Outbreak of COVID-19
According to the year of conduction, we categorized the studies into 2 subgroups: before and after the outbreak of the COVID-19 pandemic. We defined “before the outbreak of the COVID-19 pandemic” as studies conducted before December 31, 2019—the date of WHO’s first official report about the same cluster of cases of “pneumonia of unknown cause” in Wuhan [-]—and “after the outbreak of COVID-19” as studies conducted after January 1, 2020.
We tested a priori hypothesis that effect sizes in the “after the outbreak of the COVID-19 pandemic” subgroup would be different statistically from the “before the outbreak” subgroup because of the rapid advancement of telehealth during the COVID-19 pandemic. Using the independent-sample z test, we explored the difference in TPS before and after the outbreak of the COVID-19 pandemic []. For each outcome, we calculated the absolute effect size difference (RD or mean difference) and its corresponding SE between subgroups (). We then computed the z value and P value. If the subgroup difference was significant (P≤.05), we further performed a univariate meta-regression analysis using the year in which the included studies were conducted as the independent variable to explore potential temporal trends.
Post Hoc Subgroup Analysis: TPS by Intervention Types and Geographic Regions
For the primary outcomes, we conducted 2 additional subgroup analyses. First, we categorized TPS by intervention type into “TPS by pharmacists” and “TPS by pharmacists with a telemonitoring device” to assess their impact on effectiveness. Second, we performed regional subgroup analyses to examine potential geographical variations. We conducted all the analyses in RStudio (version 4.3.3). The P values were 2-sided, with an α level of .05 considered significant.
Ethical Considerations
This study is a systematic review and meta-analysis based on previously published trials. It does not involve any individual patient data collection or new clinical interventions. Therefore, ethical approval was not required.
Results
Overview
The literature search in databases yielded 12,751 studies, and citation searching yielded another 39 studies. A total of 40 studies that met the eligibility criteria were finally included ( and and ) [-].


Study Characteristics and RoB Assessment
A total of 27 out of 40 (67.5%) studies were conducted before the outbreak of the COVID-19 pandemic [-] and 13 out of 40 (32.5%) studies after the outbreak () [-]. All 40 studies reported overlapping and various formats of TPS, including medication selection and recommendation, pharmaceutical counseling, medication monitoring, medication adherence assessments, medication guidance, and health management ( and ) [-]. A total of 34 out of 40 (85%) studies were categorized as TPS by pharmacists [-,,-,-], while the other 6 out of 40 (15%) studies involved TPS by pharmacists assisted by a telemonitoring device focused on home blood pressure monitoring () [-,,]. A total of 23 out of 40 (57.5%) studies were from East Asia and Pacific [-,,-,-,-], 13 out of 40 (32.5%) studies from North America [,,-,,,,], 2 out of 40 (5%) studies from Europe and Central Asia [,], 2 out of 40 (5%) studies from Middle East and North Africa [,], and none from Latin America and Caribbean, South Asia, or Sub-Saharan Africa.

A total of 11 out of 40 (27.5%) studies identified as high RoB [,,,,,,-], 21 out of 40 (52.5%) studies as moderate [,,,-,-,-,-,,,,,,] and 8 out of 40 (20.0%) studies as low () [,-,,,,]. The major concern is performance bias. None of the 40 studies blinded participants, and only 5 (12.5%) studies blinded outcome assessors [,,,,]. Outcomes with a larger sample size did not find publication bias in the proportion of medication adherence (P=.29) or adverse events (P=.20) with the Egger test ().
Effectiveness of TPS
Medication Adherence
TPS probably increased the proportion of patients who achieved medication adherence (RD 0.15, 95% CI 0.09-0.20, moderate certainty) and the mean medication adherence score (mean difference 14.03, 95% CI 7.37-20.69 on a 0-100 scale, moderate certainty) versus no TPS or usual care ().
Medication Satisfaction
The proportion of patients who were satisfied with medication in the TPS group may be higher than that in the control group (RD 0.16, 95% CI 0.05-0.26, low certainty), while the effect of the mean satisfaction score was nonsignificant (mean difference 3.73, 95% CI –1.96 to 9.43 on a 0-100 scale, low certainty; ).
Adverse Events
Compared with no TPS or usual care, TPS may lead to fewer adverse events (RD –0.10, 95% CI –0.18 to –0.02, low certainty; ).
Disease-Specific Measures
Diabetes
Compared with the control group, patients accepting TPS probably achieved greater glucose management of HbA1c (mean difference –0.48, 95% CI –0.93 to –0.03, moderate certainty) and 2-hour postprandial blood glucose (mean difference –2.77, 95% CI –3.47 to –2.07, moderate certainty). TPS had a nonsignificant statistical reduction in fasting blood glucose (FBG) versus no TPS or usual care (mean difference –1.12, 95% CI –2.69 to 0.45, low certainty; ).
Hypertension
Compared with no TPS or usual care, TPS probably had a better blood pressure control of SBP (mean difference –5.03, 95% CI –9.10 to –0.95, moderate certainty) and DBP (mean difference –4.13, 95% CI –4.40 to –3.85, high certainty), achieving minimally important difference (MID; MIDSBP=3 mm Hg, MIDDBP=2 mm Hg; ) [].
Anticoagulation
Current guidelines recommend that warfarin adjusted to a value of INR of 2-3 is most advantageous for patients after trading off the benefits and risks []. TPS may increase the proportion of INR of 2-3 (RD 0.07, 95% CI –0.06 to 0.21, low certainty), despite no statistically significant improvement. In addition, moderate-certainty evidence indicated TPS probably increased time within the therapeutic range (TTR; mean difference 12.97, 95% CI 5.02-20.92, moderate certainty; ).
Other Diseases
Patients with stroke accepting TPS may result in a lower recurrence (mean difference –0.20, 95% CI –0.38 to –0.02, low certainty) and a higher Barthel index score (mean difference 14.75, 95% CI 8.78-20.72, low certainty) versus no TPS or usual care. Regarding patients with cancer, the evidence is very uncertain about the effect of TPS on pain (mean difference –2.39, 95% CI –2.56 to –2.22, very low certainty). In terms of respiratory diseases, TPS probably improved peak expiratory flow (mean difference 88.66, 95% CI 60.03-117.29, moderate certainty) and respiratory function (mean difference –0.69, 95% CI –0.72 to –0.66, moderate certainty), and might improve forced expiratory volume in one second (mean difference 8.51, 95% CI 6.77-10.25, low certainty; ).
Subgroup Analyses
Comparison of the Effectiveness of TPS Before and After the Outbreak of the COVID-19 Pandemic
An independent-sample z test showed significant differences between subgroups (before and after the outbreak of the COVID-19 pandemic) for the proportion of patients who achieved medication adherence (P=.007) and FBG (P<.001; ). However, only the proportion of patients who achieved medication adherence displayed a positive subgroup difference (RD 0.12, 95% CI 0.03-0.21, P=.007), suggesting a potential improvement in medication adherence after the outbreak of the COVID-19 pandemic.

Meta-regression further revealed a positive association between medication adherence and conducted year of study (coefficient=0.01, 95% CI 0.01-0.02, P<.001), indicating a progressive improvement in TPS effectiveness over time (). We did not perform a meta-regression for FBG because only 2 studies were included.
Comparison of the Effectiveness of TPS by Intervention Types and Geographic Regions
The intervention-based subgroup analysis showed that the effectiveness of TPS by pharmacists with telemonitoring was similar to that of TPS by pharmacists in point estimates (). However, the combined intervention had a smaller sample size, which likely led to the lack of statistical significance, as the confidence intervals crossed the null effect. In the regions-based subgroup analysis, TPS may show potential effectiveness across different regions overall, although the effect size might vary ().
Sensitivity Analyses
We conducted sensitivity analyses to assess the robustness of the results regarding the effectiveness of TPS. Specifically, we recalculated the pooled effect estimates by removing each included study. Detailed results of the sensitivity analyses are provided in .
Discussion
Principal Findings
This systematic review showed that TPS may result in a benefit in patient medication adherence, the proportion of satisfaction, and adverse events. For disease-specific measures, TPS also displayed larger point estimates in the control of diabetes, hypertension, anticoagulation, stroke, and respiratory diseases. The effect of TPS on cancer pain was uncertain due to only one included study though the effect size was attenuated versus no TPS or usual care. Subgroup analysis before and after the outbreak of the COVID-19 pandemic suggested no statistical difference in the outcomes of interest, except the proportion of medication adherence and FBG. Meta-regression analysis verified a positive association between the proportion of medication adherence and time passing.
Comparison With Previous Work
The studies by Moschonis et al [] and Siopis et al [] evaluated the effectiveness of SMS, smartphone app, and website interventions on adults with diabetes and hypertension. Our study and that of and Moschonis et al [] showed that TPS could decrease HbA1c (mean difference –0.30% and –0.48%) versus usual care. For hypertension, our study and that of Siopis et al [] similarly displayed that TPS could achieve better management of SBP (mean difference –3.62 and –5.03 mm Hg) and DBP (mean difference –2.45 and –4.13 mm Hg). The point estimates in our study seemed to be larger than theirs. We might conclude that pharmacists with professional knowledge may exert a more significant function than simple digital health intervention in the management of chronic diseases.
Our study showed that TPS may increase the proportion of patients who were satisfied with their medication but did not increase the mean score of patients’ medication satisfaction statistically. The point estimate in the mean score of satisfaction in the TPS group was still higher than that in the control group though no statistical difference. For one thing, only 2 studies with small sample sizes were included in the score of satisfaction. Moreover, the attitude of patients to TPS may not be consistent actually. Previous qualitative interviews might account for this phenomenon. Some patients with positive feelings for TPS may deem TPS as time or cost-saving, flexible, and accessible care while others with negative feelings may think TPS lacked adequate clinical assessment and threatened their confidentiality [-].
Reasons for the Limited Improvement of TPS After the Outbreak of COVID-19
Telehealth services, vital measures in response to the pandemic, have expanded substantially during the COVID-19 pandemic []. TPS, one form of telehealth services, made a rapid advancement as well. Nevertheless, the benefits of TPS, in general, seemed independent whether they occurred before or after the outbreak of the COVID-19 pandemic. Several reasons may explain this limited improvement.
One key reason could be the challenges TPS faced due to the pandemic. In contrast with TPS before the outbreak of COVID-19, the number of patients accepting TPS was increasing rapidly due to quarantine after the outbreak. This surge in demand might have overwhelmed the system, making it difficult to maintain quality service []. Furthermore, many pharmacists said that they were not ready to deal with the disasters when facing the COVID-19 pandemic []. Although the pandemic sparked increased attention toward TPS, the anticipated improvement in its effectiveness did not materialize as expected. The rapid shift to telehealth, while essential, may have outpaced the adaptation of health care providers.
Strengths and Limitations
Our study had the following strengths. First, to our knowledge, this systematic review provided the most comprehensive summary of the available evidence on the effectiveness of TPS up to now. Different from previous systematic reviews [-,-], we evaluated all important outcomes for patients, including clinical outcomes and patient-reported outcomes. Second, to explore the impact of COVID-19 on TPS, we compared the effect size of TPS before and after the outbreak of the COVID-19 pandemic. Third, we provided the certainty of evidence using the GRADE approach.
This systematic review also had some limitations. First, the generalizability to different income contexts may be limited. Studies included were from higher-income countries with a lower prevalence of poverty, which may not fully represent the lower-income countries. Certainly, we acknowledged implementation of TPS in lower-income countries was challenging due to limited resources. This may account for why the studies came from higher-income countries. Meanwhile, the practice of TPS in lower-income countries warrants examination. Second, some studies displayed relatively low quality attributed to the unclear descriptions of methodology. More high-quality studies will be also needed in the future. Third, heterogeneity between studies was not ideal. An inherent source of heterogeneity may be TPS itself. Because constrained by culture and awareness, TPS across the included studies have different components (). Patient characteristics also contributed, including their attitude toward TPS, disease severity, and digital literacy. In addition, pharmacists’ capabilities of conducting TPS varied and provided different extents of attention for patients, which may have further introduced heterogeneity. Fourth, we did not assess the impact of pandemic-related policies (eg, lockdowns and restrictions of entry into public localities) when comparing the effectiveness of TPS before and after the outbreak of COVID-19. Different countries altered the prevention and control policies aligned with the condition of the pandemic after the outbreak of COVID-19, which might also influence health care practices (eg, increased attention to patients) and patient behavior regarding TPS (eg, increased demand for pharmaceutical counseling). Fifth, we did not evaluate the effectiveness of TPS in the post–COVID-19 era, when most countries lifted quarantine restrictions. Our search strategy was set on October 24, 2023, and we have not retrieved eligible studies conducted in the post–COVID-19 era.
Implications for Future Research
Our systematic review highlighted several areas for future research. First, more original studies are needed to examine the impact of the COVID-19 outbreak and related policies, such as controlled before-after studies and interrupted time series studies. Second, systematic reviews that incorporated these original studies are also needed to provide a comprehensive analysis of the impact. Third, future studies could include research conducted in the post–COVID-19 era. These studies could categorize the timeline into 3 periods to update our findings and further assess the effectiveness of TPS over time.
Conclusion
This systematic review suggested that TPS probably enhanced patient medication adherence, might have improved medication satisfaction, and might reduce the incidence of adverse events. However, no positive significant changes except for the proportion of patients who achieved medication adherence in the comparison of before and after the outbreak of the COVID-19 pandemic. The effectiveness of TPS may vary depending on context-specific factors, and further research is needed to better understand these variations. In the long term, performing TPS may be an important approach for lower costs and resources in the long run. Therefore, our findings sound a call to the relevant stakeholders, emphasizing the improvement of TPS in the post–COVID-19 era is still needed to better address patients’ requirements.
Acknowledgments
The authors would like to express their appreciation to the participants and West China Second University Hospital, Sichuan University.
Authors' Contributions
LNZ and LLZ designed the work. PWZ, LNZ, and LLZ had full access to all of the data in the study and took responsibility for the integrity of the data and the accuracy of the data analysis. PWZ and SYH conducted the search. PWZ and XYL collected, analyzed, and verified the data. PWZ wrote the first draft of the manuscript and protocol. LNZ, LLZ, PWZ, MTY, and BCL contributed to the revision of the manuscript.
Conflicts of Interest
None declared.
Amendments to the protocol.
PDF File (Adobe PDF File), 86 KBPRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist.
PDF File (Adobe PDF File), 193 KBSearch strategies.
PDF File (Adobe PDF File), 129 KBRisk of bias for included studies.
PDF File (Adobe PDF File), 175 KBGRADE (Grading of Recommendations, Assessment, Development, and Evaluations) for evidence.
PDF File (Adobe PDF File), 107 KBThe independent sample z test strategies and methods.
PDF File (Adobe PDF File), 1112 KBSummary of findings.
PDF File (Adobe PDF File), 142 KBCharacteristics of included studies.
PDF File (Adobe PDF File), 354 KBClassification and characteristic of telepharmaceutical services.
PDF File (Adobe PDF File), 171 KBFunnel plots.
PDF File (Adobe PDF File), 192 KBForest plots for meta-analysis.
PDF File (Adobe PDF File), 2000 KBBubble plots for meta-regression.
PDF File (Adobe PDF File), 172 KBSubgroup analysis for telepharmaceutical services by intervention type.
PDF File (Adobe PDF File), 305 KBSubgroup analysis for different regions of telepharmaceutical services.
PDF File (Adobe PDF File), 378 KBSensitivity analyses.
PDF File (Adobe PDF File), 1294 KBReferences
- Alexander E, Butler CD, Darr ASHP, Jenkins MT, Long RD, Shipman CJ, et al. ASHP statement on telepharmacy. Am J Health Syst Pharm. 2017;74(9):e236-e241. [CrossRef] [Medline]
- Peterson CD, Rathke AM, Skwiera J, Anderson HC. Hospital telepharmacy network: Delivering pharmacy services to rural hospitals. Journal of Pharmacy Technology. 2007;23(3):158-165. [FREE Full text] [CrossRef]
- Stratton TP, Worley MM, Schmidt M, Dudzik M. Implementing after-hours pharmacy coverage for critical access hospitals in northeast Minnesota. Am J Health Syst Pharm. 2008;65(18):1727-1734. [CrossRef] [Medline]
- Johnson M, Jastrzab R, Tate J, Johnson K, Hall-Lipsy E, Martin R, et al. Evaluation of an academic-community partnership to implement MTM services in rural communities to improve pharmaceutical care for patients with diabetes and/or hypertension. J Manag Care Spec Pharm. 2018;24(2):132-141. [FREE Full text] [CrossRef] [Medline]
- Jin Y, Sun T, Zheng P, An J. Mass quarantine and mental health during COVID-19: A meta-analysis. J Affect Disord. 2021;295:1335-1346. [FREE Full text] [CrossRef] [Medline]
- Cao DX, Tran RJC, Yamzon J, Stewart TL, Hernandez EA. Effectiveness of telepharmacy diabetes services: A systematic review and meta-analysis. Am J Health Syst Pharm. 2022;79(11):860-872. [CrossRef] [Medline]
- Tran RJC, Yamzon J, Stewart TL, Hernandez EA, Cao DX. Effectiveness of telepharmacy versus face-to-face anticoagulation services in the ambulatory care setting: A systematic review and meta-analysis. Ann Pharmacother. 2021;55(9):1084-1095. [FREE Full text] [CrossRef] [Medline]
- Al-Dossari DS, Ali Laghbi Y, Saud Almutairi A, Mohammad Alsupail M, Khulaif Alharbi F, Hamdan Alharbi M, et al. Impact of telepharmacy during COVID-19 on patients’ outcome during COVID-19: a systematic literature review. PHARMPRACT. 2024;21(4):01-08. [FREE Full text] [CrossRef]
- Weinfurt KP, Reeve BB. Patient-reported outcome measures in clinical research. JAMA. 2022;328(5):472-473. [CrossRef] [Medline]
- Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339(jul21 1):b2535. [FREE Full text] [CrossRef] [Medline]
- Oxman AD, Guyatt GH. Guidelines for reading literature reviews. CMAJ. 1988;138(8):697-703. [FREE Full text] [Medline]
- Statement on the fifteenth meeting of the IHR (2005) Emergency Committee on the COVID-19 pandemic. URL: https://tinyurl.com/4yc5as5p [accessed 2025-03-31]
- The World Bank. New World Bank country classifications by income level: 2022-2023. URL: https://wfh.org/wp-content/uploads/2022/10/Country_Classifications_by_Income_2022-2023.pdf [accessed 2024-07-06]
- Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Cochrane Bias Methods Group, et al. Cochrane Statistical Methods Group. The cochrane collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011;343(oct18 2):d5928-d5928. [FREE Full text] [CrossRef] [Medline]
- Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE Working Group. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924-926. [FREE Full text] [CrossRef] [Medline]
- Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schünemann HJ, et al. GRADE Working Group. What is "quality of evidence" and why is it important to clinicians? BMJ. 2008;336(7651):995-998. [FREE Full text] [CrossRef] [Medline]
- von Philipsborn P, Stratil JM, Burns J, Busert L, Pfadenhauer L, Polus S, et al. Environmental interventions to reduce the consumption of sugar-sweetened beverages: Abridged cochrane systematic review. Obes Facts. 2020;13(4):397-417. [FREE Full text] [CrossRef] [Medline]
- Higgins JP, Deeks JJ. Selecting Studies and Collecting Data, eds. Cochrane handbook for systematic reviews of interventions. 2008. URL: https://onlinelibrary.wiley.com/doi/abs/10.1002/9780470712184.ch7 [accessed 2024-07-06]
- Zhai C, Guyatt G. Fixed-effect and random-effects models in meta-analysis. Chin Med J (Engl). 2024;137(1):1-4. [CrossRef]
- Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629-634. [FREE Full text] [CrossRef] [Medline]
- Timeline: WHO's COVID-19 response. URL: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/interactive-timeline [accessed 2025-03-31]
- Wu YC, Chen CS, Chan YJ. The outbreak of COVID-19. Journal of the Chinese Medical Association. 2020;83(3):217-220. [CrossRef]
- WHO COVID-19 dashboard. URL: https://data.who.int/dashboards/covid19/cases?n=c [accessed 2025-03-31]
- Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Subgroup analyses. In introduction to meta-analysis (eds M. Borenstein, L.V. Hedges, J.P.T. Higgins and H.R. Rothstein). 2009. URL: https://onlinelibrary.wiley.com/doi/abs/10.1002/9780470743386.ch19 [accessed 2024-07-06]
- Bynum A, Hopkins D, Thomas A, Copeland N, Irwin C. The effect of telepharmacy counseling on metered-dose inhaler technique among adolescents with asthma in rural Arkansas. Telemed J E Health. 2001;7(3):207-217. [CrossRef] [Medline]
- Staresinic AG, Sorkness CA, Goodman BM, Pigarelli DW. Comparison of outcomes using 2 delivery models of anticoagulation care. Arch Intern Med. 2006;166(9):997-1002. [CrossRef] [Medline]
- Elliott RA, Barber N, Clifford S, Horne R, Hartley E. The cost effectiveness of a telephone-based pharmacy advisory service to improve adherence to newly prescribed medicines. Pharm World Sci. 2008;30(1):17-23. [FREE Full text] [CrossRef] [Medline]
- Green BB, Cook AJ, Ralston JD, Fishman PA, Catz SL, Carlson J, et al. Effectiveness of home blood pressure monitoring, Web communication, and pharmacist care on hypertension control: a randomized controlled trial. JAMA. 2008;299(24):2857-2867. [FREE Full text] [CrossRef] [Medline]
- Ralston JD, Cook AJ, Anderson ML, Catz SL, Fishman PA, Carlson J, et al. Home blood pressure monitoring, secure electronic messaging and medication intensification for improving hypertension control: A mediation analysis. Appl Clin Inform. 2014;5(1):232-248. [FREE Full text] [CrossRef] [Medline]
- Magid DJ, Ho PM, Olson KL, Brand DW, Welch LK, Snow KE, et al. A multimodal blood pressure control intervention in 3 healthcare systems. Am J Manag Care. 2011;17(4):e96-103. [Medline]
- Magid DJ, Olson KL, Billups SJ, Wagner NM, Lyons EE, Kroner BA. A pharmacist-led, American heart association heart360 web-enabled home blood pressure monitoring program. Circ: Cardiovascular Quality and Outcomes. 2013;6(2):157-163. [CrossRef]
- Alsabbagh MW, Lemstra M, Eurich D, Wilson TW, Robertson P, Blackburn DF. Pharmacist intervention in cardiac rehabilitation: a randomized controlled trial. J Cardiopulm Rehabil Prev. 2012;32(6):394-399. [CrossRef]
- Margolis KL, Asche SE, Bergdall AR, Dehmer SP, Groen SE, Kadrmas HM, et al. Effect of home blood pressure telemonitoring and pharmacist management on blood pressure control: A cluster randomized clinical trial. JAMA. 2013;310(1):46-56. [FREE Full text] [CrossRef] [Medline]
- Young HN, Havican SN, Griesbach S, Thorpe JM, Chewning BA, Sorkness CA. Patient and phaRmacist telephonic encounters (PARTE) in an underserved rural patient population with asthma: results of a pilot study. Telemed J E Health. 2012;18(6):427-433. [FREE Full text] [CrossRef] [Medline]
- Lyons I, Barber N, Raynor DK, Wei L. The medicines advice service evaluation (MASE): a randomised controlled trial of a pharmacist-led telephone based intervention designed to improve medication adherence. BMJ Qual Saf. 2016;25(10):759-769. [FREE Full text] [CrossRef] [Medline]
- Choudhry NK, Isaac T, Lauffenburger JC, Gopalakrishnan C, Lee M, Vachon A, et al. Effect of a remotely delivered tailored multicomponent approach to enhance medication taking for patients with hyperlipidemia, hypertension, and diabetes: The STIC2IT cluster randomized clinical trial. JAMA Intern Med. 2018;178(9):1182-1189. [FREE Full text] [CrossRef] [Medline]
- Shi N, Zhen J, Liang J. Practice and evaluation of telemedicine-based pharmaceutical care for elderly patients with hypertension. Chin J Hosp Pharm. 2021;41(10):1069-1074. [FREE Full text]
- Chen Y, Lu Y, Xiao WX, Huang XM. Feasibility and usefulness of utilizing the internet for medication management of chronically ill patients in the community. Chin J Pharm Econ. 2017;12(04):149-151. [CrossRef]
- Lu Y, Chen BH, Chen Y. Use of the Internet community patients with chronic medication management research. Chin J Pharm Econ. 2017;12(03):159-161. [CrossRef]
- Lauffenburger JC, Ghazinouri R, Jan S, Makanji S, Ferro CA, Lewey J, et al. Impact of a novel pharmacist-delivered behavioral intervention for patients with poorly-controlled diabetes: The ENhancing outcomes through Goal Assessment and Generating Engagement in Diabetes Mellitus (ENGAGE-DM) pragmatic randomized trial. PLoS One. 2019;14(4):e0214754. [FREE Full text] [CrossRef] [Medline]
- Sudas Na Ayutthaya N, Sakunrak I, Dhippayom T. Clinical outcomes of telemonitoring for patients on warfarin after discharge from hospital. Int J Telemed Appl. 2018;2018:7503421. [FREE Full text] [CrossRef] [Medline]
- Margolis KL, Bergdall AR, Crain AL, JaKa MM, Anderson JP, Solberg LI, et al. Comparing pharmacist-led telehealth care and clinic-based care for uncontrolled high blood pressure: The hyperlink 3 pragmatic cluster-randomized trial. Hypertension. 2022;79(12):2708-2720. [FREE Full text] [CrossRef]
- Xu JY, Zhong KH, Chen XY, Zhang XS. Application effect of "Internet +" pharmaceutical care combined with conventional medication guidance in the health management of patients with chronic obstructive pulmonary disease. Chin Pharm. 2023;32(16):28-31. [FREE Full text]
- Wan JW, Xiong CH, Cui WJ, Chen M. Effect of continuous pharmaceutical care based on internet platform on the anticoagulant quality of warfarin. Chin Pharm. 2022;31(06):121-124. [CrossRef]
- Zhang XS, Deng HD, Shao CX. A study of the role of telepharmacy service intervention in the management of chronic diseases in T2DM. J North Pharm. 2019;16(12):172-173. [CrossRef]
- Lu Z, Li Y, He Y, Zhai Y, Wu J, Wang J, et al. Internet-based medication management services improve glycated hemoglobin levels in patients with type 2 diabetes. Telemedicine and e-Health. 2020;27(6):686-693. [FREE Full text] [CrossRef]
- Zhao JY, Qiao J, Zhao Y. Practice and effect analysis of internet plus new pharmaceutical care mode in management of chronic asthma in hospital. J Chin Prescr Drug. 2023;21(01):82-85. [CrossRef]
- Li J. Study of the difference of application effect between online and offline warfarin anticoagulation management model [thesis]. China. Kunming Medical University; 2022.
- Jin X, Liang YM. Analysis of the value of "Internet + cell phone APP" pharmacy service in the health management of COPD patients. Health Guide. 2021;(7):284. [FREE Full text]
- Feng H, Xu Y. Application of "Internet" pharmaceutical care in cancer pain treatment of cancer patients. Chin Community Doctors. 2021;37(17):6-7. [CrossRef]
- Peasah SK, Granitz K, Vu M, Jacob B. Effectiveness of a student pharmacist-led telephone follow-up intervention to improve hemoglobin A in diabetic patients. J Pharm Pract. 2020;33(6):832-837. [FREE Full text] [CrossRef] [Medline]
- Yu JK, Gong YH, Yu WL, Qin J, Chen R, You YZ. Establishment and evaluation of the Internet+ intelligent pharmaceutical care pathway management model in the pharmacist-managed cough and wheeze Clinic of PCCM. Her Med. 2023;42(08):1158-1165. [CrossRef]
- Ye Q, Wang T, Zeng J. Study on the application and effect of Internet pharmacy service on secondary prevention of ischemic stroke patients. J Chin Prescr Drug. 2022;20(11):42-44. [CrossRef]
- Wang ZM, Sun BY, Hu YY. Effect of tele - pharmaceutical care on home medication in older patients with coronary heart disease. Int J Geriatr. 2023;44(02):172-175. [CrossRef]
- Wang ZM, Sun BY, Hu YY. Influence of remote clinical pharmacy service platform on drug use in older patients with type 2 diabetes mellitus. Int J Geriatr. 2023;44(03):280-283. [CrossRef]
- Liu Y, Wang LP. Evaluation and analysis of the effect of "Internet + pharmacy service" on the endocrine treatment of breast cancer. Health Guide. 2022;(35):149-152. [FREE Full text]
- Jiang HC, Liu CC, Wang M, Changcui W, Hu C, Yaqi E. Influence of remote pharmaceutical care for chronic disease on blood pressure control and compliance in elderly hypertension. Hebei Med J. 2022;44(24):3782-3784. [CrossRef]
- Ibrahim OM, Al Meslamani AZA, Ibrahim R, Kaloush R, Al Mazrouei NA. The impact of telepharmacy on hypertension management in the United Arab Emirates. PHARMPRACT. 2022;20(4):01-11. [FREE Full text] [CrossRef]
- Zhang YL, Chen GG, Xu XR. Adverse drug reaction monitoring for psychiatric patients at home with WeChat. Chin Community Doctors. 2023;39(03):6-8. [CrossRef]
- Zhang W. Construction and application of "Internet+" out-of-hospital pharmacy service model for stroke patients based on the WeChat platform. Sci health care. 2022;25(23):204-206. [CrossRef]
- Liu H, Liu Y, Wang QQ. Application of internet pharmaceutical care in oral PARP inhibitors in ovarian cancer patients. Chin Sci Technol J Database (full text version) Med Health Care. 2022;(10):018-021. [CrossRef]
- Liao QQ. Effectiveness of an online pharmacy service model with pharmacist-enhanced Internet science for patients with type 2 diabetes mellitus. Chin Sci Technol J Database. 2023;(7):12-15. [FREE Full text]
- Chen XQ. Impact of constructing Internet+community-based diabetes medication management service based on WeChat public platform on patients' blood glucose, self-management, and complications. Chin Sci Technol J Database (cited version) Med Health Care. 2022;(9):046-048. [FREE Full text]
- Khan YH, Alzarea AI, Alotaibi NH, Alatawi AD, Khokhar A, Alanazi AS, et al. Evaluation of impact of a pharmacist-led educational campaign on disease knowledge, practices and medication adherence for type-2 diabetic patients: A prospective pre- and post-analysis. Int J Environ Res Public Health. 2022;19(16):10060. [FREE Full text] [CrossRef] [Medline]
- Ge L, Sadeghirad B, Ball GDC, da Costa BR, Hitchcock CL, Svendrovski A, et al. Comparison of dietary macronutrient patterns of 14 popular named dietary programmes for weight and cardiovascular risk factor reduction in adults: systematic review and network meta-analysis of randomised trials. BMJ. 2020;369:m696. [FREE Full text] [CrossRef] [Medline]
- Hirsh J, Fuster V, Ansell J, Halperin JL. American heart association/American college of cardiology foundation guide to warfarin therapy. Circulation. 2003;107(12):1692-1711. [FREE Full text] [CrossRef]
- Moschonis G, Siopis G, Jung J, Eweka E, Willems R, Kwasnicka D, et al. DigiCare4You Consortium. Effectiveness, reach, uptake, and feasibility of digital health interventions for adults with type 2 diabetes: a systematic review and meta-analysis of randomised controlled trials. Lancet Digit Health. 2023;5(3):e125-e143. [FREE Full text] [CrossRef] [Medline]
- Siopis G, Moschonis G, Eweka E, Jung J, Kwasnicka D, Asare BY, et al. DigiCare4You Consortium. Effectiveness, reach, uptake, and feasibility of digital health interventions for adults with hypertension: a systematic review and meta-analysis of randomised controlled trials. Lancet Digit Health. 2023;5(3):e144-e159. [FREE Full text] [CrossRef] [Medline]
- Alhmoud E, Al Khiyami D, Barazi R, Saad M, Al-Omari A, Awaisu A, et al. Perspectives of clinical pharmacists on the provision of pharmaceutical care through telepharmacy services during COVID-19 pandemic in Qatar: A focus group. PLoS One. 2022;17(10):e0275627. [FREE Full text] [CrossRef] [Medline]
- Matsumoto Y, Kizaki H, Ikeda Y, Nakamura S, Kina S, Nagai T, et al. Telepharmacy in mountainous depopulated areas of Japan: an exploratory interview study of patients' perspectives. Drug Discov Ther. 2022;15(6):337-340. [FREE Full text] [CrossRef] [Medline]
- Isleem N, Shoshaa S, AbuGhalyoun A, Khatib M, Naseralallah LM, Ibn-Mas'ud Danjuma M, et al. Critical care tele-pharmacy services during COVID-19 pandemic: A qualitative exploration of healthcare practitioners' perceptions. J Clin Pharm Ther. 2022;47(10):1591-1599. [FREE Full text] [CrossRef] [Medline]
- Cutler DM, Nikpay S, Huckman RS. The business of medicine in the Era of COVID-19. JAMA. 2020;323(20):2003-2004. [FREE Full text] [CrossRef] [Medline]
- Strnad K, Shoulders BR, Smithburger PL, Kane-Gill SL. A systematic review of ICU and non-ICU clinical pharmacy services using telepharmacy. Ann Pharmacother. 2018;52(12):1250-1258. [FREE Full text] [CrossRef] [Medline]
- Pathak S, Blanchard CM, Moreton E, Urick BY. A systematic review of the effect of telepharmacy services in the community pharmacy setting on care quality and patient safety. J Health Care Poor Underserved. 2021;32(2):737-750. [CrossRef] [Medline]
- Alfian SD, Insani WN, Puspitasari IM, Wawruch M, Abdulah R. Effectiveness and process evaluation of using digital health technologies in pharmaceutical care in low- and Middle-Income Countries: A systematic review of quantitative and qualitative studies. Telemed J E Health. 2023;29(9):1289-1303. [CrossRef] [Medline]
Abbreviations
| DBP: diastolic blood pressure |
| FBG: fasting blood glucose |
| GRADE: Grading of Recommendations, Assessment, Development, and Evaluations |
| HbA1c: hemoglobin A1c |
| INR: international normalized ratio |
| MID: minimally important difference |
| PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses |
| PROSPERO: International Prospective Register of Systematic Reviews |
| RD: risk difference |
| RoB: risk of bias |
| SBP: systolic blood pressure |
| TPS: telepharmaceutical services |
| TTR: time within the therapeutic range |
| WHO: World Health Organization |
Edited by KJ Craig; submitted 09.07.24; peer-reviewed by S Arsić, R Halkes; comments to author 18.03.25; revised version received 31.03.25; accepted 19.04.25; published 02.07.25.
Copyright©Puwen Zhang, Mengting Yang, Siyi He, Xiayan Li, Bingchen Lang, Linan Zeng, Lingli Zhang. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 02.07.2025.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.

