The Informed Choice Project was initiated to combat misinformation by having volunteers address vaccine-hesitant comments on the social media platform, Facebook. The goal of the Informed Choice Project was to directly address vaccine hesitancy sentiment (eg, comments on Facebook posts) by empowering health care professionals to engage with vaccine-hesitant individuals and counteract the spread of vaccine misinformation through tailored messaging.

Participants were recruited using social media and email advertising and the University of Calgary, School of Nursing student contact list, ensuring adherence to ethical guidelines and informed consent protocols. Eligible participants were health care workers and students in health care–related disciplines (eg, doctors, nurses, pharmacists, and postsecondary students interested in health care). Those who were interested in participating self-identified by contacting a member of the research team. As an honorarium for participating, volunteers were given CAD $300 (US $222) for 30 hours of volunteer work.

Participants who expressed interest in the project attended an online Informed Choice Project information session followed by one 30-minute training session through the platform Zoom software (version 5.14.12; Zoom Video Communications, Inc). Prior to attending the training session, volunteers were asked to review a training manual (Multimedia Appendix 1) outlining behavioral principles for addressing vaccine hesitancy, strategies for identifying productive interaction opportunities, and tips for how the volunteers could safely engage on social media. Both the information and training sessions included comprehensive briefings on the project’s objectives, data collection methods, ethical considerations, and an example of how to engage in vaccine conversations with social media users. These sessions were conducted by the project team and were designed to equip participants with the necessary knowledge and skills for their involvement using behavior change theory principles. There were several opportunities throughout the session for volunteers to actively participate and practice. At the end of the session, participants were expected to have a working knowledge of health communication, behavior change, and correcting misinformation.

From January to August 2023, the Informed Choice Project volunteers engaged in conversations with individuals posting antivaccine comments and on social media. The research team provided volunteers with a file containing a list of Facebook posts that discussed COVID-19 vaccines (Multimedia Appendix 2). The list was compiled by searching the CrowdTangle database (Meta) for public posts from American or Canadian accounts containing keywords related to the vaccine. CrowdTangle is a tool provided by Meta that allows access to information about what is happening on public accounts on their social media platforms. This tool allows researchers to track the performance of different accounts and use search terms to view popular social media content (Multimedia Appendix 3). CrowdTangle only provides information that is already publicly available through Facebook (eg, the name of a person running a public account, number of likes, keyword searching, engagement histories, and so on).

Volunteers were asked to engage in at least 3‐5 conversations per week, in which they accessed a relevant Facebook post and scrolled through comments before deciding whether to either (1) leave a new comment on the thread or (2) respond to an existing comment. Once they decided, volunteers opened a web-based online survey tool (Qualtrics) and entered information about the post or comment, including their name, the text of the comment, the username of the original poster, and a link to the post. The survey then randomly instructed the volunteer to leave or not leave a response through the web-based survey’s built-in randomization function (Qualtrics). If they were told to leave a response, the survey asked them to type their response into a text box. To assist them in crafting their responses, volunteers were provided with an FAQ (frequently asked question) document that provided suggested responses and links to information on key vaccine issues.

To develop an understanding of the volunteers’ experience with the Informed Choice Project, the research team conducted a series of semistructured interviews. Volunteers were contacted via email and were asked to attend a 30-minute online interview with members of the research team via Zoom software (version 5.14.12). The interviews were conducted using a standardized interview guide developed specifically for this project (Multimedia Appendix 4). The guide was designed to capture relevant information pertaining to the volunteer’s experience within the project. Questions were structured to facilitate clear and consistent data collection across all participants. A facilitator and moderator met volunteers on Zoom software, individually, and audiorecorded and transcribed the conversation.

Following the completion of interviews, the facilitator and moderator independently reviewed the transcripts and inductively developed a set of codes to represent the dataset. A final codebook was agreed upon by both researchers (Multimedia Appendix 5), and one researcher coded the transcripts independently. Once coded, 2 researchers agreed on the coding, and a reflexive thematic analysis was conducted by each researcher independently to identify common themes across the dataset [10]. The final list of themes was agreed upon by the research team.

Ethical approval was obtained from the University of Calgary Joint Ethics Board (REB22-0315_REN1). Prior to beginning the interviews, participants were read a consent script that outlined their ability to withdraw from the study at any time. All participants provided verbal consent to proceed with the interviews. Interviews were recorded and transcribed verbatim; however, no identifying information was included in the transcripts. In alignment with institutional ethics requirements, the interview data were destroyed once transcription was complete. As an honorarium for participating in the interview, volunteers were offered a CAD $50 (US $37) gift card.

In total, 8108 posts were included in the dataset and 716 were responded to by volunteers. After 60 people attended the Informed Choice Project training sessions, 14 volunteers actively participated in the project and engaged in social media discussions about COVID-19 vaccine misinformation. Of these 14 initial volunteers, 8 were retained until the end of the project (August 2023) and participated in the evaluative interviews.

From the interviews, 3 key themes emerged surrounding the Informed Choice Project’s format and training model, the drivers for volunteers to participate, and their experiences interacting with the public on social media to address misinformation (Table 1).

Overall, the volunteers had positive opinions on how the Informed Choice Project was structured. Participants felt that the training was helpful and provided all the necessary information to begin correcting misinformation. The interactive components of the training were praised for their effectiveness and participants felt that the training leads were accessible to troubleshoot and provide clarification once the project was underway. Some participants identified that the self-paced model presented challenges such as procrastination, distractions from personal life, and occasional technological issues. However, a majority of participants appreciated the flexibility that this model offered and identified that it allowed them to continue volunteering despite busy and varied schedules.

The volunteers’ reasons for participating were deeply rooted in both their personal and professional spheres. Several participants felt that this opportunity would provide the chance to develop skills that would benefit their careers in health care, and some stated that they would be applying their experiences from the Informed Choice Project to communicate with their patients about vaccines. Others saw this as an opportunity to contribute meaningfully to a public health crisis and wanted to do their part in preventing the spread of COVID-19. This dual motivation was a driving force behind their active participation and commitment to the project. However, most participants expressed that the impact on society and their patients was the key factor, which motivated them.

The volunteers’ experiences in interacting with the public revealed a rich tapestry of emotions and perspectives. The vaccine hesitancy they encountered was not just a matter of misinformation but also deeply tied to emotional responses and personal beliefs. This experience was eye-opening for many volunteers, as it broadened their understanding of the public’s fears and hesitations.

The Informed Choice Project, set against the backdrop of the COVID-19 pandemic, represents a pivotal effort in addressing the surge of misinformation in the digital age. Conversations on social media surrounding COVID-19 vaccines were underscored by “COVID fatigue,” or the general weariness toward pandemic-related news and guidelines likely influenced both the public’s reception of health information [11,12]. Furthermore, the highly politicized nature of pandemic discourse, especially surrounding vaccines, added another layer of complexity to public discourse [13]. To combat these issues, global calls have been made for health care providers to address vaccine misinformation on social media [9]. A meta-analysis conducted prior to the COVID-19 pandemic identified that on social media, misinformation debunking interventions are most effective when they come from credible experts [14], and a recent study found that when COVID-19 misinformation comments on social media were refuted by a reputable source, such as the Centers for Disease Control and Infection—vaccine misperceptions shifted [15].

Some efforts to address COVID-19 misinformation on social media have been documented, including providing “myth busting” informative posts [16]. However, most research has investigated the impact on social media COVID-19 misinformation organically, observationally, and without intervention [7,8,17-19]. As such, the Informed Choice Project aimed to fill the gap using a unique and evidence-informed approach to correcting COVID-19 misinformation on social media, by using health care providers to engage in personal contact with those perpetuating these messages.

Overall, the Informed Choice Project was considered a positive experience by volunteers who completed the evaluative interviews. Volunteers who felt that this work made a difference in the web-based vaccine conversation landscape were retained through this process. Most notably, participants felt that this opportunity allowed them to increase their confidence and self-efficacy in having vaccine conversations, both on social media and in health care settings. These volunteers appreciated the self-paced format for participating, and despite minor technological hiccups and procrastination, completed the required hours without major barriers. As health care professionals, the Informed Choice Project model allowed them to participate in an extracurricular volunteer activity, without imposing clinical obligations.

This project has not only contributed to the immediate goal of addressing vaccine hesitancy but has also provided valuable insights into the dynamics of public engagement and communication in the era of digital interconnectedness. Our findings contribute to the growing understanding of the drivers for vaccine hesitancy among health care providers, which has notably increased empathy and upskilled these individuals for having conversations with vaccine-hesitant individuals in their clinical practice.

One of the main limitations to completing the Informed Choice Project was the introduction of Canada’s federal Bill C-18, which prompted Meta to block news media content to Canadian social media platform users, including on Facebook [20]. This legislation was adopted in the Summer of 2023, at which point all news content was removed from Canadian Facebook users’ feeds [21]. This legislation severely limits the content that Informed Choice Project volunteers can access and respond to.

Another challenge experienced through this project was retaining volunteers. The Informed Choice Project information sessions had a good attendance rate (n=60); however, onboarding and retaining volunteers was challenging as the project had 14 volunteers complete their required hours and 8 volunteers participate in evaluative interviews. Given the high number of vaccine-related posts on Facebook, higher participation rates would have garnered better correction of misinformation. Thus, recruitment strategies would need to be reconsidered for future efforts.

Finally, there exist limitations in the impact that the Informed Choice Project has on Facebook audiences. The most important group to target vaccine communications efforts is the “moveable middle”—defined as a group of unvaccinated individuals who are unsure about getting the vaccine, but have a mid-range probability of receiving it [22]. True “antivaccine” audiences have entrenched their views in echo chambers and confirmation bias by the content they consume on social media [23,24]. These audiences may respond better to community-based vaccine promotion, namely from members of their trusted networks [25]. While volunteers were instructed to focus on comments from vaccine-hesitant, rather than antivaccine, individuals, many of their responses in practice were to the latter group. As such, targeting individuals who have engaged in blatant COVID-19 vaccine fear-mongering and misinformation spread on Facebook may not be the most efficient use of health care provider time and resources.

Based on the lessons learned throughout the project, the Informed Choice Project model would lend itself well to training and empowering health care providers and health volunteers to address health-related topics in web-based discussions. Based on the qualitative evaluation of this project, the following suggestions can be made for future efforts:

The Informed Choice Project was a collaborative, innovative, and adaptive effort to mitigate the harms of vaccine information on social media during the COVID-19 pandemic. The program upskilled more than a dozen health care professionals and students to engage in vaccine conversations on social media, and the resulting increase in self-efficacy and confidence for having these conversations was a major success. This project not only addressed the immediate challenges of the COVID-19 pandemic but also set the foundation for stronger, more informed future public health communication strategies. Future interventions should consider adopting a similar, self-paced format and flexible hours to ensure participant satisfaction and compliance. However, considerations must be made to increase recruitment and retention of volunteers, and while choosing appropriate social media platforms for engagement. The lessons learned through this evaluation highlight the potential for even greater impact for health care providers to continue to be key advocates for vaccination and trusted sources of information for the public. As the world navigates through an evolving digital and social landscape, the Informed Choice Project can serve as a roadmap for future initiatives to promote vaccination and combat misinformation.