Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, March 11, 2019 at 4:00 PM to 4:30 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 26.05.17 in Vol 19, No 5 (2017): May

This paper is in the following e-collection/theme issue:

    Original Paper

    Virtual Visits and Patient-Centered Care: Results of a Patient Survey and Observational Study

    1Centre for Health Services and Policy Research, Vancouver, BC, Canada

    2Canada Health Infoway, Toronto, ON, Canada

    *all authors contributed equally

    Corresponding Author:

    Kimberlyn Marie McGrail, PhD

    Centre for Health Services and Policy Research

    201-2206 East Mall

    Vancouver, BC, V6T 1Z3

    Canada

    Phone: 1 778 998 3821

    Fax:1 604 822 5690

    Email: kim.mcgrail@ubc.ca


    ABSTRACT

    Background: Virtual visits are clinical interactions in health care that do not involve the patient and provider being in the same room at the same time. The use of virtual visits is growing rapidly in health care. Some health systems are integrating virtual visits into primary care as a complement to existing modes of care, in part reflecting a growing focus on patient-centered care. There is, however, limited empirical evidence about how patients view this new form of care and how it affects overall health system use.

    Objective: Descriptive objectives were to assess users and providers of virtual visits, including the reasons patients give for use. The analytic objective was to assess empirically the influence of virtual visits on overall primary care use and costs, including whether virtual care is with a known or a new primary care physician.

    Methods: The study took place in British Columbia, Canada, where virtual visits have been publicly funded since October 2012. A survey of patients who used virtual visits and an observational study of users and nonusers of virtual visits were conducted. Comparison groups included two groups: (1) all other BC residents, and (2) a group matched (3:1) to the cohort. The first virtual visit was used as the intervention and the main outcome measures were total primary care visits and costs.

    Results: During 2013-2014, there were 7286 virtual visit encounters, involving 5441 patients and 144 physicians. Younger patients and physicians were more likely to use and provide virtual visits (P<.001), with no differences by sex. Older and sicker patients were more likely to see a known provider, whereas the lowest socioeconomic groups were the least likely (P<.001). The survey of 399 virtual visit patients indicated that virtual visits were liked by patients, with 372 (93.2%) of respondents saying their virtual visit was of high quality and 364 (91.2%) reporting their virtual visit was “very” or “somewhat” helpful to resolve their health issue. Segmented regression analysis and the corresponding regression parameter estimates suggested virtual visits appear to have the potential to decrease primary care costs by approximately Can $4 per quarter (Can –$3.79, P=.12), but that benefit is most associated with seeing a known provider (Can –$8.68, P<.001).

    Conclusions: Virtual visits may be one means of making the health system more patient-centered, but careful attention needs to be paid to how these services are integrated into existing health care delivery systems.

    J Med Internet Res 2017;19(5):e177

    doi:10.2196/jmir.7374

    KEYWORDS



    Introduction

    A greater orientation to information technology in primary care opens new possibilities for health care delivery, one of which is virtual care. “Virtual care” is a broad term meant to capture all clinical interactions in health care that do not involve the patient and provider being in the same room at the same time [1]. Consultations may be asynchronous, whereby patients answer structured clinical questions online and then receive care from a physician at a later time (“e-visits”), or synchronous, whereby patients interact with physicians in real time via telephone (“teleconsultations”), videoconference (“virtual visits”) [2-5], or even by text [6].

    Canada is a geographically large country, and physicians are disproportionately clustered within urban and semiurban settings, with known shortages of primary care providers in more rural and remote areas [7]. However, limited access to primary care is not a feature of rural areas only. There are well-documented accessibility issues in urban areas as well, whereby many patients do not have a regular primary care physician or cannot access their physician for in-person appointments within a timeframe that meets their current needs [8-10]. New modes of contact, including virtual visits, are one potential way to solve at least some of these access issues.

    Some health systems are integrating virtual care into primary care practices as a complement to existing modes of care. The US health care provider Kaiser Permanente has altered their delivery of health care services to improve information continuity and to provide easy access to appropriate care for patients through initiatives such as electronic messaging with the care team, scheduled telephone visits, and a comprehensive patient portal [11]. This is, at least in part, a response to a growing focus on patient-centered care that aims to provide care that is both “accessible” and “acceptable” [12,13]. Virtual care can, for example, increase access to care for individuals who have difficulty presenting in-person for primary care services, such as those living in long-term care facilities and/or those with mobility issues [14].

    Virtual care is also understood as a means of making care more convenient to patients and is gaining momentum in the United States and other advanced health systems alongside other innovations such as retail clinics and other forms of walk-in care [15-20]. There is, at present, limited empirical evidence about how patients view virtual care and more specifically virtual visits, how such care affects overall primary care use, and whether integration of virtual visits in existing relationships or more as a “walk-in” service matters. This research aims to fill that gap, focusing on British Columbia, Canada, a province with a population of 4.5 million people, which has had public funding of virtual visits since 2012.

    This study has both descriptive and analytic objectives. The descriptive objectives are to assess the users and providers of virtual visits, as well as the reasons patients give for their use. The analytic objective is to assess empirically the influence of the use of virtual visits on overall primary care use and costs, paying specific attention to whether virtual care is provided by a known or a new primary care physician.


    Methods

    This was a mixed-methods study that included a patient survey and an analysis of administrative health care data. The study was undertaken in British Columbia, Canada, a province with universal health care coverage for a population of approximately 4.5 million. IRB-Services Canada provided research ethics approval for the patient survey, and the University of British Colombia Behavioural Research Ethics Board for the observational study.

    Observational Study

    Data Sources

    We used data for fiscal years 2010/2011 to 2013/2014. The following files were linked:

    Medical Services Plan (MSP) Payment Information File: this file includes all fee-for-service payment data for physicians and contains the information needed to identify virtual visit encounters between physicians and patients [21];

    Consolidation file (MSP Registration and Premium Billing): this file includes patient characteristics for all BC residents who are eligible and receive publicly funded health care services, including patient demographic, location, and socioeconomic status (SES) information based on neighborhood income [22];

    PharmaNet: this file includes all prescriptions filled in British Columbia, regardless of payment source. This file was used in a measure to classify physician practice style and to examine the frequency of prescribing as part of virtual visits [23]; and

    MSP Practitioner Information File: this file includes demographic, specialty, location of training, and location of practice of all primary care providers in British Columbia [24].

    We used the Johns Hopkins’ adjusted clinical group (ACG) case-mix system to assess patients’ morbidity burden. This system uses a risk-adjustment methodology to describe and predict expected use and cost of health care services and has been validated for use with BC administrative data [25]. More specifically, we used aggregated diagnosis groups (ADGs), a midlevel grouping based on diagnosis codes in health care encounters, to assess comorbidities. There are 32 ADGs in the overall system, eight of which are considered major; we used a count of major ADGs as our measure of health status [26].

    Defining the Cohort and Comparison Group

    The cohort was everyone who had one or more virtual visit fee codes billed on their behalf at any point in the study period. The population comparison group used for initial descriptive analyses were all other BC residents.

    A second (and main) comparison group was matched (3:1) on 5-year age group, sex, health service delivery area (HSDA) of residence (there are 16 HSDAs in British Columbia), and number of major ADGs. This comparison group enabled analysis of the effects of virtual visits on overall patterns of health care services use. We anchored the match so that the comparison group had a primary care encounter at approximately the same time as the case’s virtual visit. This was done because a virtual visit will naturally create a spike in use because it represents an individual’s decision to access the health care system. Matching based on that access creates a similar spike in the comparison group and thus increases the likelihood that any differences preceding or following that spike were attributable to the virtual visit.

    Other Variables and Analysis

    Our outcome of interest was costs associated with primary care visits. We used broader physician data to assess referrals to specialists and for laboratory and imaging services, but these aspects of care were not included in the cost outcome because, in the BC context, primary care physicians do not typically provide in-office laboratory or imaging services. Descriptive analyses assessed the age, sex, location, and morbidity distribution of individuals who had virtual visits, and the specialty, age, and sex of primary care physicians who provided them. We further separated users into those who saw a provider with whom they have had a traditional office visit versus seeing a new provider. Referrals and prescriptions within 30 days of a visit (except 90 days for imaging to allow for longer wait times) were captured using physician and pharmaceutical data.

    Primary care physician practice style was classified into three groups—high responsibility, mixed practice, and low responsibility—based on a cluster analysis using five variables derived from fee-for-service payment data. This approach was developed previously [27] and was shown to create distinct groups, with high-responsibility physicians providing more comprehensive or full-service care and low-responsibility physicians providing care more consistent with a walk-in clinic-style practice.

    Time series analysis was used to assess the effect of virtual visits on overall visits with primary care physicians. A time series approach helps identify changes in both the trend (slope) in service use and amount (level) of service use before and after an initial virtual visit encounter. No change in amount of service will be interpreted as virtual visits serving a substitute function for other health care services use.

    More specifically, we will analyze time series data using segmented regression [28] in the form:

    Yjkt01×timet2×groupk3×groupk×timet4×leveljt+ β5×trendjt6×leveljt×groupk7×trendjt×groupkjkt

    where Y is the mean number of primary care visits / costs per month, j is the intervention status, k is the group, and t represents time. In these models, β0 is the intercept and β1 is the existing trend in the matched comparison group, β2 estimates the preintervention difference in level between the intervention group and its matched controls, and β3 estimates the difference in trend, and β4 and β5 estimate the changes in level and trend for matched controls postintervention, respectively. The real parameters of interest are β6 and β7 because they estimate the difference in level (β6) and trend (β7) between the intervention group and matched controls following the intervention. Statistically significant values for these latter two parameters would indicate that the use of telemedicine had an effect on primary care services use. Analyses were completed using the autoreg procedure in SAS 9.0 and were assessed for autocorrelation.

    Patient Survey

    Recruitment and Analysis

    Inclusion criteria for the patient survey were 18 years of age or older, had at least one virtual visit with a primary care physician in the past 6 months, currently living in British Columbia, and able to complete the survey in English. A total of 3025 patients were deemed eligible. The virtual visit technology provider issued an electronic invitation to participate in the survey and a single reminder to all eligible registrations. No monetary incentives were offered, but patients who completed the full survey were entered into a draw to win a prize (worth up to Can $500) identified by Harris-Decima, the survey company. Informed consent was obtained electronically before commencing the survey. Analyses focused on descriptive statistics, including univariate and bivariate analyses with tests of statistical significance. Analyses were conducted with SPSS version 21.


    Results

    Observational Study

    In 2013/14, 144 of 5598 primary care physicians provided at least one virtual visit, or 2.57% of the total primary care physician population (Figure 1). Male and female providers were equally likely to provide these services (P=.89). There were physicians in every age group providing virtual visits, although the likelihood decreased monotonically with increasing age—from 5.3% (33/624) of physicians younger than 35 years to 0.8% (6/724) of those aged 65 years and older (P<.001). Physicians defined as low responsibility (ie, practices appear to be walk-in style) were the most likely to bill virtual visit fee items (3.24%, 51/1574), whereas those defined as high responsibility were least likely (1.40%, 14/1000, P=.04).

    There were 5441 patients who had at least one virtual visit, which equates to 105.45 people per 100,000 of the provincial population. Table 1 shows demographics and health status of virtual visit users, both in numbers and as a percentage of the total population. Use of these services was highest in the 20 to 44 years age group (53.45%, 2908/5441) and lowest among those 85 years and older (0.77%, 42/5441). Use was highest (in percentage of population terms) in the Northern Health Authority (11.27%, 613/5441), a largely rural and remote part of the province, but the next highest rates of use were in the two most urbanized regions—Vancouver Coastal (24.74%, 1346/5441) and Fraser Health (45.07%, 2452/5441).

    Figure 1. Percentage of primary care physicians who billed for virtual visits by sex, age group, and responsibility level in 2013/2014.
    View this figure
    Figure 2. Percentage of patients who saw a known provider for first virtual visit, by sex, age group, region, neighborhood income, and health status in 2013/2014.
    View this figure
    Table 1. Demographics of virtual visit users (cohort), the BC total population (comparison group), and traditional primary care users (matched control).
    View this table

    When limited to the first virtual visit per person, just over one-third (35.58%, 1936/5441) of those visits were with providers already known to the patient and two-thirds (64.42%, 3505/5441) were with a new provider (Figure 2). Males and females were equally likely to have seen their physician before their virtual visit (P=.69). People older than 45 years, those who lived in the Fraser Health Authority (largest urban health authority), and those who had more complex health conditions (≥3 major ADGs) were the most likely to have seen their virtual visit provider previously in a nonvirtual setting (P<.001). There was no clear pattern by SES, but those in the lowest quintile were the least likely to have seen their virtual visit provider previously (24.32%, 259/1065; P<.001).

    Virtual Visit Users Who Saw a Known Versus a New Provider

    Table 2 provides the diagnoses for patients who had a virtual visit in the study period compared to the matched controls. A larger proportion of BC patients with a virtual visit sought care for a “mental disorder” compared to the general population (14.86%, 1262/8494 vs 8.50%, 2103/24,738; P<.001), and for “supplementary factors” (11.80%, 1002/8494 vs 2.50%, 618/24,738; P<.001), the latter of which was largely driven by requests for contraception and contraception advice.

    Table 3 provides an overview of visit outcomes for virtual visit users segmented by those seeing a known provider (seen before) or new provider (not seen before) compared to the matched control group with “traditional” visits. The likelihood of receiving a prescription was higher for virtual visit users than in-person visits (49.40%, 3599/7286 vs 45.69%, 10,043/21,981; P<.001). Referral to diagnostic imaging was lower for virtual visit users than in-person visits (1.88%, 137/7286 vs 6.59%, 1448/21,981; P<.001), but more likely if seeing a known provider (P<.001). Referral for laboratory testing was about the same for a virtual visit with a known provider (15.36%, 520/3385) and traditional visits (14.96%, 3289/21,981), but much lower (5.95%, 232/3901) for virtual visits with new providers (P<.001).

    Figure 3 provides the interrupted times series results (regression parameter estimates) comparing patients seeing a known provider to patients seeing a new provider. Before the first virtual visit, the group who saw a known provider had both a higher cost (Can $16.41, P<.001) and a larger increasing trend in costs (Can $2.34, P<.001) compared to those who saw a new provider. After the intervention, the known provider group showed a decreasing trend (Can –$8.68, P<.001) compared to the new provider group, with the values approaching each other by the end of the follow-up period. Follow-up ended after six quarters because the numbers declined to the point that outcomes were not stable after this.

    Figure 4 provides the interrupted time series results (regression parameter estimates) of the total virtual visit group compared to a matched comparison group of people who did not have a primary care virtual visit during the study period, but who do had at least one traditional general practitioner (GP) visit. In this case, both groups showed an increasing trend in primary care spending before the GP visit. After the intervention, the patients with a virtual visit had a lower trend than their matched controls (Can –$3.79, P=.01). The result was an apparent lower expenditure among the virtual visit group at the end of the follow-up period, but again this period was limited. The trends were the same when the outcome was primary care visits rather than costs (data not shown).

    Patient Survey

    A total of 399 of 3025 (13.19%) BC residents who had a virtual visit in the past year completed the online patient survey from April 17 to May 1, 2015. The survey took a mean 18 minutes to complete. The majority of respondents, were female (71.4%, 285/399), between 35 and 54 years (45.1%, 180/399), and married (67.4%, 269/399). Population comparisons were provided along with sample demographics, health service utilization, and detailed results are available in the full report [29].

    A number of aspects of the patient-physician engagement on the virtual visit were viewed positively, with 93.2% (372/399) reporting that their most recent visit was of high quality, 95.0% (379/399) reporting confidence in the security and privacy of their personal information when using a virtual visit, and 79.0% (315/399) saying their most recent virtual visit was as thorough as an in-person visit.

    In terms of visit outcome, 91.2% (364/399) of respondents reported that the virtual visit was “very” or “somewhat” helpful to resolve health issue for which they needed the appointment. Only 1.5% (6/399) of patients reported that they were advised to call 9-1-1 or visit an emergency department immediately. Nearly half (48.4%, 193/399) of patients indicated they would have gone to a walk-in clinic if the virtual visit had not been available, 20.3% (81/399) would have had an in-person visit with their doctor or regular place of care, and 10.8% (43/399) would have gone to the emergency department. A total of 12.5% (50/399) reported that they would not have sought care at that time.

    Table 2. Diagnoses for virtual visits, 2011-2014.
    View this table
    Table 3. Number of visits resulting in a referral or other follow-up care for virtual and matched control visits, 2013/2014.
    View this table
    Figure 3. Time series analyses comparing virtual visit patients seeing a known provider to patients seeing a new provider, 2011-2014.
    View this figure
    Figure 4. Time series analyses comparing patients with a virtual visit to matched controls with a traditional visit, 2011-2014.
    View this figure

    Discussion

    Patients from all demographic and medical backgrounds are using virtual visits. Similar to other studies, younger patients are more likely to have a virtual visit compared to older individuals [3,4], perhaps emphasizing a digital divide between younger patients more comfortable with technology than older patients [30] or patients most likely to not have a regular care provider [31]. Patients with one or more major ADGs are more highly represented, which makes sense if these services are being used for monitoring existing conditions and providing services such as prescription refills that help patients avoid taking time and money to attend an in-person visit.

    A small number of physicians are providing virtual visits. Male and female physicians are equally likely to be providing virtual visits, but there is a clear age gradient, with younger physicians far more likely to be using this new technology for patient care. In addition, we see that physicians who are identified as operating low-responsibility practices are significantly more likely to be providing virtual visits than those running high-responsibility practices. This suggests that at least some proportion (and likely a high proportion) of virtual visits may be essentially a virtual walk-in clinic [27].

    Virtual visits were being provided in communities in British Columbia regardless of whether they were in urban and rural settings, indicating that virtual visits may not necessarily be filling all geographic gaps in primary care delivery [32]. Our analyses show that approximately one-third of people using virtual visits are seeing physicians with whom they previously interacted in a traditional office visit setting, whereas the remainder are seeing new providers. There were no sex differences in these percentages, but older people and those with more health problems were more likely to see a known provider. These appear to be positive trends from a patient care standpoint, consistent with monitoring of chronic conditions [33] and provision of patient-centered care [34]. Not seeing a known provider may reflect a desire for convenience over continuity [35], but may also indicate (at least in some cases) a specific preference for a new provider, such as for questions or care (eg, contraception) that patients wish to keep from their regular providers. Although there is no socioeconomic gradient in the use of virtual visits overall, individuals from lower income neighborhoods are less likely to see a known provider in their virtual visit.

    The time series analyses comparing virtual versus traditional visits suggests that virtual visits may be beneficial in moderating total primary care costs over the longer term. At the same time, seeing a known versus new provider is better from an overall cost/use perspective. Putting these together, the conclusion is that virtual visits may have a beneficial effect—they are well-liked by patients (as seen in survey results) and they appear to control costs—but that benefit is most associated with seeing a known provider. Some caution is needed with these interpretations given the small N and limited follow-up period, but they are at least suggestive. The implication is that it matters (potentially quite a lot) how virtual visits are embedded in health care delivery systems.

    This is consistent with previous research showing that virtual visits can complement existing patterns of care and, in fact, reduce overall primary and urgent care visits for patients [18,36]. Similarly, an evaluation by the US National Institute of Justice found that virtual care more generally (including synchronous and asynchronous care) has specific value for defined patient populations, reducing external visits to specialists and costly off-site transfers for care of prisoners [37] and providing a cost-effective solution for patients with limited access to mental health services [38].

    Limitations

    Patient-initiated virtual visits in primary care are a relatively new model of access to primary care. Their use is growing rapidly, including in British Columbia, but is still a very small portion of total primary care. Although interrupted time series is a strong quasi-experimental analytic approach for evaluating population-level health interventions [39,40], it does not deal with selection bias and that may influence what we see in these analyses. Patients are not randomized to receive virtual visits, they choose to pursue them, and those who do and do not choose to use these visits may be different in unmeasured ways that are also related to primary care costs. Our comparison of users who see known versus new providers is further limited by the fact that these two groups are different in demographic and health status characteristics. Not all physicians choose to provide virtual visits, so selection at the physician level has some influence on which patients receive health care in this new format. These analyses consider only the costs of primary care. Future analyses should consider broader health care system effects of virtual visits and also the timing of virtual visits in longitudinal episodes of care.

    Conclusions

    British Columbia is unique in Canada in offering publicly funded virtual visits in primary care. The province-wide implementation—both available for interactions among patients and physicians who know each other and for walk-in-type visits—makes this research valuable to other jurisdictions in Canada and beyond. The number of virtual visits is continuing to increase and it appears that there is no simple conclusion about their effect on existing patterns of health care services use. In some cases, the care is complementary, providing a new way for patients and providers with existing relationships to interact. In other cases, the care may be easing access, perhaps providing patients with needed care at a convenient point in time, but not necessarily displacing subsequent service use. A patient-centered system is one that is organized to respond to patient need without these unintended side effects. Virtual visits may be one means by which the system can be reoriented to be more patient-centered.

    In the context of primary care transformation, there are discussions of new models of care and the role of technology in care, with the understanding that technology may be one way to improve care delivery [35]. Our analyses suggest that it is important to consider how such technologies are integrated into the system, whether as an adjunct to existing relationships or simply another way to see a provider on-demand. As technology continues to develop, it is important to ensure health care systems harness it to increase opportunities for patient-centered care.

    Acknowledgments

    This independent study, including publication costs for this article, was funded by Canada Health Infoway Inc., a non-profit corporation funded by the Government of Canada. The opinions, results, and conclusions reported here are those of the authors. No endorsement by the University of British Columbia or Canada Health Infoway is intended or should be inferred. The funders had no role in study design, data collection and analysis, or decision to publish the manuscript. Population Data BC provided the data for the study with unique identifiers used for practitioners and patients to prevent identification of specific individuals. All inferences, opinions, and conclusions drawn in this report are those of the authors, and do not reflect the opinions or policies of the Data Steward(s). We would like to thank Dawn Mooney for development of tables and figures for the manuscript.

    Conflicts of Interest

    None declared.

    References

    1. Jamieson T, Wallace R, Armstrong K, Agarwal P, Griffin B, Wong I, et al. Virtual Care: A Framework for a Patient-Centric System. Toronto, ON: Women’s College Hospital Institute for Health Systems Solutions and Virtual Care; 2015.   URL: http://www.womenscollegehospital.ca/assets/pdf/wihv/WIHV_VirtualHealthSymposium.pdf [accessed 2017-01-16] [WebCite Cache]
    2. Al-Mahdi I, Gray K, Lederman R. Online medical consultation: a review of literature and practice. In: Proceedings of the 8th Australasian Workshop on Health Informatics and Knowledge Management. 2015 Presented at: 8th Australasian Workshop on Health Informatics and Knowledge Management; Jan 27-30, 2015; Sydney, Australia p. 97-100   URL: http://crpit.com/confpapers/CRPITV164Al-Mahdi.pdf
    3. Jung C, Padman R. Virtualized healthcare delivery: understanding users and their usage patterns of online medical consultations. Int J Med Inform 2014 Dec;83(12):901-914. [CrossRef] [Medline]
    4. Mehrotra A, Paone S, Martich GD, Albert SM, Shevchik GJ. Characteristics of patients who seek care via eVisits instead of office visits. Telemed J E Health 2013 Jul;19(7):515-519 [FREE Full text] [CrossRef] [Medline]
    5. Verhoeven F, Tanja-Dijkstra K, Nijland N, Eysenbach G, van Gemert-Pijnen L. Asynchronous and synchronous teleconsultation for diabetes care: a systematic literature review. J Diabetes Sci Technol 2010 May;4(3):666-684 [FREE Full text] [Medline]
    6. Kannisto KA, Koivunen MH, Välimäki MA. Use of mobile phone text message reminders in health care services: a narrative literature review. J Med Internet Res 2014;16(10):e222 [FREE Full text] [CrossRef]
    7. Pong RW, Pitbaldo JR. Geographic Distribution of Physicians in Canada: Beyond How Many and Where. Ottawa, ON: Canadian Institute of Health Information; 2005.   URL: https://secure.cihi.ca/free_products/Geographic_Distribution_of_Physicians_FINAL_e.pdf [accessed 2017-01-15] [WebCite Cache]
    8. Sibley LM, Weiner JP. An evaluation of access to health care services along the rural-urban continuum in Canada. BMC Health Serv Res 2011 Jan 31;11(1):20 [FREE Full text] [CrossRef] [Medline]
    9. The College of Family Physicians of Canada. 2010 National Physician Survey. 2010.   URL: http://nationalphysiciansurvey.ca/wp-content/uploads/2012/05/NPS2010-National-Binder.pdf [accessed 2017-01-14] [WebCite Cache]
    10. Osborn R, Squires D, Doty MM, Sarnak DO, Schneider EC. In new survey of eleven countries, US adults still struggle with access to and affordability of health care. Health Aff (Millwood) 2016 Dec 01;35(12):2327-2336. [CrossRef] [Medline]
    11. McCarthy D, Mueller K. The Commonwealth Fund. 2009 Jun. Kaiser Permanente: Bridging the quality divide with integrated practice, group accountability, and health information technology   URL: http:/​/www.​commonwealthfund.org/​~/​media/​files/​publications/​case-study/​2009/​jun/​1278_mccarthy_kaiser_case_study_624_update.​pdf [accessed 2017-01-16] [WebCite Cache]
    12. Penchansky R, Thomas JW. The concept of access: definition and relationship to consumer satisfaction. Med Care 1981 Feb;19(2):127-140. [Medline]
    13. Stewart M. Towards a global definition of patient centred care. BMJ 2001 Feb 24;322(7284):444-445 [FREE Full text] [Medline]
    14. Shah MN, Gillespie SM, Wood N, Wasserman EB, Nelson DL, Dozier A, et al. High-intensity telemedicine-enhanced acute care for older adults: an innovative healthcare delivery model. J Am Geriatr Soc 2013 Nov;61(11):2000-2007. [CrossRef] [Medline]
    15. Deloitte. eVisits: The 21st Century Housecall. 2014.   URL: https:/​/www2.​deloitte.com/​content/​dam/​Deloitte/​au/​Documents/​technology-media-telecommunications/​deloitte-au-tmt-evisits-011014.​pdf [accessed 2017-01-15] [WebCite Cache]
    16. Terry K. Physicians and telehealth: is it time to embrace virtual visits? Med Econ 2015 Jul 10;92(13):48-52. [Medline]
    17. Dorsey ER, Topol EJ. State of Telehealth. N Engl J Med 2016 Jul 14;375(2):154-161. [CrossRef] [Medline]
    18. Gordon AS, Adamson WC, DeVries AR. Virtual visits for acute, nonurgent care: a claims analysis of episode-level utilization. J Med Internet Res 2017 Feb 17;19(2):e35 [FREE Full text] [CrossRef] [Medline]
    19. Mehrotra A, Lave JR. Visits to retail clinics grew fourfold from 2007 to 2009, although their share of overall outpatient visits remains low. Health Aff (Millwood) 2012 Sep;31(9):2123-2129 [FREE Full text] [CrossRef] [Medline]
    20. Ashwood JS, Gaynor M, Setodji CM, Reid RO, Weber E, Mehrotra A. Retail clinic visits for low-acuity conditions increase utilization and spending. Health Aff (Millwood) 2016 Mar;35(3):449-455. [CrossRef] [Medline]
    21. British Columbia Ministry of Health. Medical Services Plan (MSP) Payment Information File. Vancouver, BC: Population Data BC; 2015.   URL: https://www.popdata.bc.ca/data/internal/health/msp [accessed 2017-05-15] [WebCite Cache]
    22. British Columbia Ministry of Health. Consolidation File (MSP Registration & Premium Billing). Vancouver, BC: Population Data BC; 2015.   URL: https://www.popdata.bc.ca/data/internal/population/consolidationfile [WebCite Cache]
    23. British Columbia Ministry of Health. PharmaNet. Vancouver, BC: Population Data BC; 2015.   URL: https://www.popdata.bc.ca/data/external/PharmaNet [accessed 2017-01-19] [WebCite Cache]
    24. British Columbia Ministry of Health. Medical Services Plan (MSP) Practitioner Information File. Vancouver, BC: Population Data BC; 2015.   URL: https://www.popdata.bc.ca/data [accessed 2017-01-20] [WebCite Cache]
    25. Reid RJ, MacWilliam L, Verhulst L, Roos N, Atkinson M. Performance of the ACG case-mix system in two Canadian provinces. Med Care 2001 Jan;39(1):86-99. [Medline]
    26. Puyat JH, Kazanjian A, Goldner EM, Wong H. How often do individuals with major depression receive minimally adequate treatment? A population-based, data linkage study. Can J Psych 2016 Mar;61(7):394-404 [FREE Full text]
    27. McGrail K, Lavergne R, Lewis SJ, Peterson SL, Barer M, Garrison SR. Classifying physician practice style: a new approach using administrative data in British Columbia. Med Care 2015 Mar;53(3):276-282. [Medline]
    28. Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther 2002 Aug;27(4):299-309. [Medline]
    29. Canada Health Infoway. Virtual Visits in British Columbia: 2015 Patient Survey and Physician Interview Study. 2016.   URL: https:/​/www.​infoway-inforoute.ca/​en/​component/​edocman/​3105-virtual-visits-in-british-columbia-2015-patient-survey-and-physician-interview-study/​view-document [accessed 2017-01-17] [WebCite Cache]
    30. Kontos E, Blake KD, Chou WY, Prestin A. Predictors of eHealth usage: insights on the digital divide from the Health Information National Trends Survey 2012. J Med Internet Res 2014;16(7):e172 [FREE Full text] [CrossRef] [Medline]
    31. Statistics Canada. 2015. Access to a regular medical doctor, 2014   URL: http://www.statcan.gc.ca/pub/82-625-x/2015001/article/14177-eng.htm [accessed 2017-01-17] [WebCite Cache]
    32. Uscher-Pines L, Mulcahy A, Cowling D, Hunter G, Burns R, Mehrotra A. Access and quality of care in direct-to-consumer telemedicine. Telemed J E Health 2016 Apr;22(4):282-287. [CrossRef] [Medline]
    33. Hernandez C, Mallow J, Narsavage GL. Delivering telemedicine interventions in chronic respiratory disease. Breathe (Sheff) 2014 Sep;10(3):198-212 [FREE Full text] [CrossRef] [Medline]
    34. Dixon RF. Enhancing primary care through online communication. Health Aff (Millwood) 2010 Jul;29(7):1364-1369 [FREE Full text] [CrossRef] [Medline]
    35. Daniel H, Sulmasy LS, Health and Public Policy Committee of the American College of Physicians. Policy recommendations to guide the use of telemedicine in primary care settings: an American College of Physicians position paper. Ann Intern Med 2015 Nov 17;163(10):787-789. [CrossRef] [Medline]
    36. Chen C, Garrido T, Chock D, Okawa G, Liang L. The Kaiser Permanente Electronic Health Record: transforming and streamlining modalities of care. Health Aff (Millwood) 2009 Apr;28(2):323-333 [FREE Full text] [CrossRef] [Medline]
    37. Abt Associates Inc. Telemedicine Can Reduce Correctional Health Care Costs: An Evaluation of a Prison Telemedicine Network. Washington, DC: US Department of Justice Office of Justice Programs; 1999.   URL: https://www.ncjrs.gov/pdffiles1/175040.pdf [accessed 2017-05-02] [WebCite Cache]
    38. Hubley S, Lynch SB, Schneck C, Thomas M, Shore J. Review of key telepsychiatry outcomes. World J Psychiatry 2016 Jun 22;6(2):269-282 [FREE Full text] [CrossRef] [Medline]
    39. Shadish W, Cook T, Campbell D. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston, MA: Houghton Mifflin; 2002.
    40. Lopez Bernal J, Cummins S, Gasparrini A. Interrupted time series regression for the evaluation of public health interventions: a tutorial. Int J Epidemiol 2017;46(1):348-355 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    EMR: electronic medical record
    GP: general practitioner
    HSDA: health service delivery area
    ACG: adjusted clinical group
    ADG: aggregated diagnosis group
    SES: socioeconomic status


    Edited by G Eysenbach; submitted 20.01.17; peer-reviewed by T Jamieson, N Lea; comments to author 23.02.17; revised version received 06.04.17; accepted 14.04.17; published 26.05.17

    ©Kimberlyn Marie McGrail, Megan Alyssa Ahuja, Chad Andrew Leaver. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 26.05.2017.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.