Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, March 11, 2019 at 4:00 PM to 4:30 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?


Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 27.02.15 in Vol 17, No 2 (2015): February

This paper is in the following e-collection/theme issue:


    Advantages and Disadvantages of Educational Email Alerts for Family Physicians: Viewpoint

    Information Technology Primary Healthcare Research Group, Department of Family Medicine, McGill University, Montreal, QC, Canada

    Corresponding Author:

    Pierre Pluye, MD, PhD

    Information Technology Primary Healthcare Research Group

    Department of Family Medicine

    McGill University

    5858, chemin de la Côte-des-Neige

    3rd floor

    Montreal, QC, H3S 1Z1


    Phone: 1 (514) 398 8483

    Fax:1 (514) 398 4202



    Background: Electronic knowledge resources constitute an important channel for accredited Continuing Medical Education (CME) activities. However, email usage for educational purposes is controversial. On the one hand, family physicians become aware of new information, confirm what they already know, and obtain reassurance by reading educational email alerts. Email alerts can also encourage physicians to search Web-based resources. On the other hand, technical difficulties and privacy issues are common obstacles.

    Objective: The purpose of this discussion paper, informed by a literature review and a small qualitative study, was to understand family physicians’ knowledge, attitudes, and behavior in regard to email in general and educational emails in particular, and to explore the advantages and disadvantages of educational email alerts. In addition, we documented participants’ suggestions to improve email alert services for CME.

    Methods: We conducted a qualitative descriptive study using the “Knowledge, Attitude, Behavior” model. We conducted semi-structured face-to-face interviews with 15 family physicians. We analyzed the collected data using inductive-deductive thematic qualitative data analysis.

    Results: All 15 participants scanned and prioritized their email, and 13 of them checked their email daily. Participants mentioned (1) advantages of educational email alerts such as saving time, convenience and valid information, and (2) disadvantages such as an overwhelming number of emails and irrelevance. They offered suggestions to improve educational email.

    Conclusions: The advantages of email alerts seem to compensate for their disadvantages. Suggestions proposed by family physicians can help to improve educational email alerts.

    J Med Internet Res 2015;17(2):e49





    Educational email alerts have the potential to improve the quality of health care services, but present some disadvantages. Email alerts have been associated with learning, practice change, and expected benefits for patient health, among other outcomes [1,2]. They can be used for two-way knowledge translation, a process that involves sending evidence-based clinical recommendations to physicians and then receiving their constructive feedback [3,4].

    Two examples of educational email alerts are “Daily-POEMs” (Patient-Oriented Evidence that Matters) and “Highlights from e-Therapeutics+” [1,3,5]. These alerts support continuing education programs that involve more than 10,000 Canadian physicians and pharmacists [3]. First, Daily-POEMs are tailored for family physicians. POEMs are synopses of original research and systematic reviews, selected after scanning and critically appraising new articles from more than 100 journals. Second, Highlights are treatment recommendations tailored for a primary care audience. They are based on a synthesis of research results and systematic reviews, and graded using the Strength of Recommendation Taxonomy System. They consist of key updated paragraphs from a Web-based text called e-Therapeutics+, published by the Canadian Pharmacists Association (CPhA). Highlights have been delivered to members of the College of Family Physicians of Canada since 2010 and to CPhA members since 2012.

    However, physicians face email-related obstacles such as technical difficulties [3]. Privacy and security of email communication remain of major concern [6]. Other issues are changes of email address or service provider [7]. In addition, physicians complain about “email fatigue”, that is, too many emails and lack of time [8].

    Understanding physicians’ knowledge, attitude, and behavior regarding email alerts can help to address obstacles associated with email as an educational channel. We found studies on the use of information derived from educational emails by physicians, but no studies on the advantages or disadvantages of email for the delivery of educational material. Therefore, our main objective was to explore the viewpoint of family physicians on advantages and disadvantages of educational email alerts.

    By 2009, 80.3% of Canadians were using the Internet on a regular basis; the main reason for Internet usage was email, with 93.0% of Canadians using it for email [9]. Almost all physicians use email as do 94.7% of Canadians with a university degree [9]. In the clinical setting, physicians use email to consult with colleagues, obtain laboratory data, follow up with staff about patient care issues, and learn about new research findings [3,10]. When used as a method of communication between physician and patient, email can improve the doctor patient relationship, despite privacy and security concerns [6,11]. According to the 2010 Canadian National Physician Survey, 50.1% of family physicians email their colleagues for clinical purposes [12]. Increasingly, family physicians are using email for their continuing education [13]. However, in a review of the literature guided by a specialized librarian, we found no studies on family physicians’ perception about positive and negative aspects of educational emails. This justifies our exploratory work on the family physician viewpoint.

    Educational Email Alerts

    We identified nine studies on physicians’ use of information from educational email alerts. Three studies globally evaluated satisfaction and usefulness of receiving health information via email [14-16]. In these studies, users of email alerts reported high levels of satisfaction and perceived them to be useful for continuing education. A fourth study evaluated the effect of email alerts on information awareness and knowledge acquisition [17]. While subscribers of email alerts became more familiar with the recent literature, their medical knowledge was not improved. A fifth study evaluated the effect of email alerts on subsequent information retrieval by physicians and demonstrated that users of email alerts are more likely to search for information [18]. The sixth study examined self-reported cognitive impact of emailed synopses of recently published clinical research, and indicated that email alerts have a positive impact [19]. Subsequently, another study indicated that email alerts are infrequently retrieved after initial reading [20]. Finally, two studies suggested that email dissemination of synopses of systematic literature reviews [21], and of treatment recommendations is associated with anticipated benefits for patient health [3].

    Advantages and Disadvantages of Educational Email Alerts

    While we found no studies that specifically focused on advantages and disadvantages of emails according to health care professionals, four studies and one literature review on email [2,7,8,11,22] did mention this in passing (Table 1). For example, physicians are knowledgeable and familiar with email as a way of educating and communicating with medical students, by sending evidence-based clinical recommendations and individualized feedback [2]. In contrast, physicians can face technical difficulties when using email, because of slow Internet connections or software incompatibility. They complain about receiving too much information by email while not having time to read it [8]. Therefore, our research questions were: what are the advantages and disadvantages of educational email alerts from the physicians’ viewpoint?

    Table 1. Advantages and disadvantages of email, as mentioned in the literature.
    View this table


    Study Design

    A qualitative descriptive study [23] was conducted through semi-structured face-to-face interviews with 15 family physicians. Participants were members of the Department of Family Medicine, McGill University, who had received an email to briefly explain the study. An invitation to participate in the study was emailed to 290 family physicians affiliated with this department. Of 17 family physicians who replied, two were not interviewed because we could not arrange an interview. Yet, the saturation of data was confirmed during the interviews, through the repetition of similar answers to our interview questions. We decided to conduct semi-structured face-to-face individual interviews because we were interested mainly in their individual experience and perceptions. The interview was conducted in four main parts (see Multimedia Appendix 1).

    Part 1. Demographic Questions

    In this part, four demographic questions were asked (ie, age, years of practice, practice setting (s), and special interests).

    Part 2. Participants’ Knowledge, Attitude, and Behavior (Theory of Planned Behavior) Regarding Email

    In this part, four questions were asked to assess participants’ experience (knowledge, attitude, and behavior) with email in general and educational email in particular. Using the Theory of Planned Behavior [24], we explored the daily experience of participants with email (knowledge), their psychological reaction toward email (attitude), and their behavior when they received an email. This theory was chosen because it is validated and commonly used for assessing health education programs and health care professional behavior [25]. The interview questions included: Knowledge: Please describe your daily experience with email, Attitude: How do you usually feel about email, eg, welcoming, disliking, feeling overwhelmed, or something else?, and Behavior: What do you usually do when you receive email, eg, reading, deleting, flagging, ignoring, saving, classifying, or anything else?

    Part 3. Perception of the Advantages and Disadvantages of Educational Email

    In this part, participants were asked three questions about their preferences for Continuing Medical Education (CME), specifically, the advantages and disadvantages of educational email.

    Part 4. Recommendations to Improve Educational Email

    In this part, participants were asked about their recommendations to improve educational email alerts.

    Data Analysis

    Interviews were transcribed, reviewed, summarized, and then a deductive-inductive thematic analysis was conducted [26]. To this end, we assigned preliminary themes based on the Theory of Planned Behavior, the literature review, and the interview guide, and then searched for emerging themes. The inductive process involved the identification of themes through careful reading and re-reading of the data in six sessions. The coding process was conducted in six stages [26]: (1) we developed the code manual, (2) we tested the reliability of the codes, (3) we summarized the data and identified the initial themes, (4) we applied a template, (5) we connected the codes in accordance with the process of discovering themes and patterns in the data, and (6) we corroborated and legitimated coded themes, especially the item-related codes.

    Finally, the results were reviewed by two of us (PP, RG). We prepared a table of findings for each group of questions related to: (1) demographic data, (2) participants’ preference for continuing education activities, (3) participants’ experience with email, (4) participants’ perception of the advantages and disadvantages of educational email, and (5) participants’ recommendations to improve educational email. The data analysis process and final results were discussed with colleagues who conduct research in the fields of Information Technology and Primary Health Care. We distributed a report of the data analysis process and our results to members of the Information Technology Primary Care Research Group, and we allowed a week for detailed reading and commenting. Then, at one meeting, group members helped to interpret the results.

    Ethical Approval

    This study was conducted according to the ethical principles stated in the declaration of Helsinki. Ethical approval was obtained from the McGill University Institutional Review Board (IRB).


    Part 1. Demographic Results

    A total of 15 family physicians were interviewed (nine male and six female). Nine family physicians were working in academic health science centers, university, or teaching units while the other six worked in community-based clinics. The participants’ number of years in practice ranged from 9 to 38. Five participants indicated no clinical focus to their practice, while 10 expressed a special focus such as maternity and newborn care (Table 2).

    Participants were involved in many CME activities (eg, conferences and Web-based activities) (see Table 3). While six family physicians mentioned no specific preference for CME activities, five family physicians expressed interest in Web-based activities (eg, educational email), three expressed interest in group learning (eg, conferences and clinical rounds), and one family physician expressed interest in reading magazines and journals.

    All interviews were done face-to-face in participants’ offices. Interviewees were welcoming and co-operative: 11 of 15 gave adequate time for the interview while only four seemed rushed. All interviewees answered all questions. Based on our interpretation of viewpoints, results are presented in three parts. First, participants reported their knowledge, attitude, and behavior regarding email in general, and educational email in particular. Second, they specifically reported advantages and disadvantages of educational email. Third, they proposed recommendations to improve educational email.

    Table 2. Participants’ demographic data.
    View this table
    Table 3. Continuing medical education (CME) activities reported by the participants (n=15).
    View this table

    Part 2. Participants’ Knowledge, Attitude, and Behavior Regarding Email


    Of 15 family physicians, 13 said they were familiar with email and checked their email from one to four times per day. These regular users checked email for clinical, educational, and personal reasons. Regular users received from 10 to 100 emails per day. In contrast, the two family physicians who were not familiar with email, used email for personal communication and checked it two or three times a week. Their two main reasons for not being regular users were (1) limited time because of family obligations, and (2) issues with technology (such as familiarity).


    Of 15 family physicians, nine family physicians felt comfortable with and liked email, three expressed a neutral attitude, and three disliked or felt overwhelmed by email. Only three family physicians were not overwhelmed by the volume of email, and only one family physician expressed a concern regarding confidentiality when using email in communication with patients.


    The 15 family physicians mentioned they scanned emails by reading the title, and prioritized them according to urgency and relevance. First, they replied to the urgent emails, then, time permitting, they replied to others. Second, they deleted irrelevant email. In addition, 13 family physicians mentioned that they archive important email in a folder, while the other two delete all email after reading. Regarding participants’ behavior toward educational email, all 15 family physicians mentioned they follow the same procedure, namely scan and prioritize.

    Part 3. Perceptions of the Advantages and Disadvantages of Educational Email


    Participants mentioned six types of advantages (see Table 4).


    Of 15 family physicians, 12 mentioned disadvantages that we grouped into six main types (see Table 5).

    Table 4. Advantages of educational email as reported by the participants (n=15).
    View this table
    Table 5. Disadvantages of educational emails as reported by the participants (n=15).
    View this table

    Part 4. Recommendations to Improve Educational Email

    Participants provided 23 recommendations, presented in Textbox 1. They suggested five general recommendations such as “Avoid sponsorship by pharmaceutical companies”. They provided six recommendations regarding the informational content of email, for example, “Add a description of the writers’ affiliation”. There were 11 recommendations concerning the design of educational email, such as “Add a link to a discussion board on the topic”.

    Textbox 1. Participants’ recommendations to improve educational email.
    View this box


    Principal Findings

    No previous studies have specifically focused on the pros and cons of email from a physicians’ viewpoint, although four studies and one review [2,7,8,11,22] have mentioned this in passing (Table 1). This literature suggests physicians are familiar with email for their education and for communication [2]. In addition, it shows that some physicians face technical difficulties when using email, and complain about receiving too much information by email while not having time to read it [8]. Our results are aligned with the literature in that most of our participants were familiar with email, while many felt comfortable and liked using email in their professional life, and some felt overwhelmed by the volume of email they receive.

    In addition, our results suggest types of advantages and disadvantages of educational email that were not previously mentioned in the literature. First, with respect to the advantages: (1) educational email can contain valid and trustworthy information, (2) is an easy way to disseminate information to multiple recipients, (3) broadens the spectrum of family physician knowledge, (4) is regularly sent at a specific time, (5) contains brief clinical synopses, and (6) gives the reader an option to use them.

    Second, with respect to the disadvantages of educational email not previously mentioned in the literature: (1) educational emails are overwhelming in number and because of the information they contain, (2) they are not relevant to specialized practice, (3) they can resemble commercial email, and (4) some writers of educational email are not professionals.

    However, there were two contradictions in the viewpoints expressed. First, physicians do not want advertisements within educational email, in line with Canadian CME policies [27], while they want this service for free. Second, they want brief “bottom-line” information, while asking for more information about the underlying “black-box” process surrounding the submission, peer-review, and editing of research articles.

    Similar to usual qualitative research, our exploratory study faces two main limitations: small sample size and researchers’ interpretation. As researchers, we are involved in the evaluation of email-based CME programs [3,4,28]. In addition, the homogeneity of participants and investigators may have limited the scope of participants’ comments. This experience influenced our interpretation of participant viewpoints. In line with the “blind-spot” effect proposed by the anthropologist George Devereux [29], this might have lead us to miss some issues reported by participants. Participants were recruited by email invitation. We interviewed them in their offices. They were very welcoming, interested in our research topic, and 11 of 15 gave plenty of time to the interview. Having said this, in-depth face-to-face interviews with 15 family physicians provided rich data, as participants had a wide range of familiarity with email. In addition, we obtained redundant answers from participants suggesting data saturation was reached.

    Finally, all participants made suggestions for improving educational email such as enabling links to a discussion board. A number of their suggestions are relevant to the providers of educational email alerts, namely to use valid studies, to add background information on pathophysiology, to enable a printable summary, and to provide comment boxes.


    Given email still has some disadvantages as an educational channel, there is room to improve educational email alerts. Hence, information providers would be well advised to consider both the advantages and disadvantages of educational email as suggested by physicians.


    Badran was a recipient of the IAM Bursary, provided by the Canadian Pharmacists Association. Pluye holds an Investigator Award from the Fonds de recherche du Québec en santé (FRQS). The Information Assessment Method (IAM) is protected by Registered Copyrights (2008): # CA 1057518 “A scale to assess the cognitive impact, relevance and use of information hits derived from electronic resources”, and # CA 1057519 “Une échelle pour évaluer l’impact cognitif, la pertinence et l’utilisation des informations issues de ressources électroniques”.

    Two sources of funding supported this study. First was the Canadian Pharmacists Association: Project title: Two-way knowledge translation between information providers and health professionals; Nominated Principal Investigator: Pierre Pluye (McGill); Co-principal Investigator: Roland Grad (McGill); Total Amount: $50,000 (unrestricted grant); Duration: 2 years (2012-2014). Second was Practice Solutions (a subsidiary of the Canadian Medical Association): Project title: Evaluating the effect of information technology on medical practice; Nominated Principal Investigator: Roland Grad (McGill); Co-principal Investigator: Pierre Pluye (McGill); Total Amount: $98,910 (unrestricted grant). Duration: 3 years (2011-2014).

    Authors' Contributions

    Badran carried out the study. Pluye and Grad supervised the work and contributed to all stages of the research. All authors participated in drafting the manuscript. All authors read and approved the final version of the manuscript.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    The interview guide.

    PDF File (Adobe PDF File), 22KB


    1. Pluye P, Grad RM, Granikov V, Jagosh J, Leung K. Evaluation of email alerts in practice: Part 1. Review of the literature on clinical emailing channels. J Eval Clin Pract 2010 Dec;16(6):1227-1235. [CrossRef] [Medline]
    2. Barnhart A, Lausen H, Smith T, Lopp L. Electronic health communication: an educational application for this principle of the Patient-Centered Medical Home. Fam Med 2010 May;42(5):322-326 [FREE Full text] [Medline]
    3. Grad R, Pluye P, Repchinsky C, Jovaisas B, Marlow B, Marques Ricarte IL, et al. Physician assessments of the value of therapeutic information delivered via e-mail. Can Fam Physician 2014 May;60(5):e258-e262 [FREE Full text] [Medline]
    4. Pluye P, Grad R, Repchinsky C, Jovaisas B, Lewis D, Tang DL, et al. "Better-than-best" evidence? Using family physicians' feedback for 2-way knowledge translation. Can Fam Physician 2014 May;60(5):415-417 [FREE Full text] [Medline]
    5. Pluye P, Grad RM, Johnson-Lafleur J, Bambrick T, Burnand B, Mercer J, et al. Evaluation of email alerts in practice: Part 2. Validation of the information assessment method. J Eval Clin Pract 2010 Dec;16(6):1236-1243. [CrossRef] [Medline]
    6. Neville RG, Marsden W, McCowan C, Pagliari C, Mullen H, Fannin A. Email consultations in general practice. Inform Prim Care 2004;12(4):207-214. [Medline]
    7. Seguin R, Godwin M, MacDonald S, McCall M. E-mail or snail mail? Randomized controlled trial on which works better for surveys. Can Fam Physician 2004 Mar;50:414-419 [FREE Full text] [Medline]
    8. Bennett NL, Casebeer LL, Kristofco R, Collins BC. Family physicians' information seeking behaviors: a survey comparison with other specialties. BMC Med Inform Decis Mak 2005;5:9 [FREE Full text] [CrossRef] [Medline]
    9. Internet use by individuals, by selected characteristics. Ottawa, Canada: Statistics Canada; 2014.   URL: [accessed 2015-02-15] [WebCite Cache]
    10. Widman LE, Tong DA. Requests for medical advice from patients and families to health care providers who publish on the World Wide Web. Arch Intern Med 1997 Jan 27;157(2):209-212. [Medline]
    11. Moyer CA, Stern DT, Dobias KS, Cox DT, Katz SJ. Bridging the electronic divide: patient and provider perspectives on e-mail communication in primary care. Am J Manag Care 2002 May;8(5):427-433 [FREE Full text] [Medline]
    12. College of Family Physicians of Canada, Canadian Medical Association, Royal College of Physicians and Surgeons of Canada. 2010 National Physician Survey. Mississauga, ON   URL: [accessed 2015-02-15] [WebCite Cache]
    13. Ladouceur R. Family physicians and electronic communication. Can Fam Physician 2014 Apr;60(4):310 [FREE Full text] [Medline]
    14. Davies S, Cleave-Hogg D. Continuing medical education should be offered by both e-mail and regular mail: a survey of Ontario anesthesiologists. Can J Anaesth 2004 May;51(5):444-448. [CrossRef] [Medline]
    15. Johnston JM, Leung GM, Tin KY, Ho LM, Lam W, Fielding R. Evaluation of a handheld clinical decision support tool for evidence-based learning and practice in medical undergraduates. Med Educ 2004 Jun;38(6):628-637. [CrossRef] [Medline]
    16. Mukohara K, Schwartz MD. Electronic delivery of research summaries for academic generalist doctors: a randomised trial of an educational intervention. Med Educ 2005 Apr;39(4):402-409. [CrossRef] [Medline]
    17. Tanna GV, Sood MM, Schiff J, Schwartz D, Naimark DM. Do e-mail alerts of new research increase knowledge translation? A "Nephrology Now" randomized control trial. Acad Med 2011 Jan;86(1):132-138. [CrossRef] [Medline]
    18. Haynes RB, Holland J, Cotoi C, McKinlay RJ, Wilczynski NL, Walters LA, et al. McMaster PLUS: a cluster randomized clinical trial of an intervention to accelerate clinical use of evidence-based information from digital libraries. J Am Med Inform Assoc 2006;13(6):593-600 [FREE Full text] [CrossRef] [Medline]
    19. Grad RM, Pluye P, Mercer J, Marlow B, Beauchamp ME, Shulha M, et al. Impact of research-based synopses delivered as daily e-mail: a prospective observational study. J Am Med Inform Assoc 2008;15(2):240-245 [FREE Full text] [CrossRef] [Medline]
    20. Grad R, Pluye P, Johnson-Lafleur J, Granikov V, Shulha M, Bartlett G, et al. Do family physicians retrieve synopses of clinical research previously read as email alerts? J Med Internet Res 2011;13(4):e101 [FREE Full text] [CrossRef] [Medline]
    21. Pluye P, Grad R, Granikov V, Theriault G, Frémont P, Burnand B, et al. Feasibility of a knowledge translation CME program: Courriels Cochrane. J Contin Educ Health Prof 2012;32(2):134-141. [CrossRef] [Medline]
    22. Kenny C, Steele K. E-mail consultations. Br J Gen Pract 2000 Jun;50(455):503-504 [FREE Full text] [Medline]
    23. Sandelowski M. What's in a name? Qualitative description revisited. Res Nurs Health 2010 Feb;33(1):77-84. [CrossRef] [Medline]
    24. Ajzen I. The theory of planned behavior. Organizational Behavior and Human Decision Processes 1991 Dec;50(2):179-211. [CrossRef]
    25. Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals' intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci 2008;3:36 [FREE Full text] [CrossRef] [Medline]
    26. Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: A hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods 2006;5(1):80-92.
    27. Canadian Medical Association. Continuing Medical Education. Ottawa, ON   URL: [accessed 2015-02-15] [WebCite Cache]
    28. Grad R, Pluye P, Granikov V, Johnson-Lafleur J, Shulha M, Sridhar SB, et al. Physicians' assessment of the value of clinical information: Operationalization of a theoretical model. J Am Soc Inf Sci 2011 Jul 22;62(10):1884-1891. [CrossRef]
    29. Devereux G. From anxiety to method in the behavioral sciences. Germany: De Gruyter Mouton; 1967:1-376.


    CME: Continuing Medical Education
    CPhA: Canadian Pharmacists Association
    IAM: Information Assessment Method
    POEM: Patient-Oriented Evidence that Matters

    Edited by G Eysenbach; submitted 11.08.14; peer-reviewed by R Haase, FH Leung; comments to author 20.11.14; revised version received 30.12.14; accepted 31.12.14; published 27.02.15

    ©Hani Badran, Pierre Pluye, Roland Grad. Originally published in the Journal of Medical Internet Research (, 27.02.2015.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.