Published on in Vol 23, No 11 (2021): November

Preprints (earlier versions) of this paper are available at, first published .
Social Media Sharing of Articles About Measles in a European Context: Text Analysis Study

Social Media Sharing of Articles About Measles in a European Context: Text Analysis Study

Social Media Sharing of Articles About Measles in a European Context: Text Analysis Study

Original Paper

Department of Education and Research in Health Sciences, Medical University of Warsaw, Warsaw, Poland

Corresponding Author:

Dominik Wawrzuta, MD

Department of Education and Research in Health Sciences

Medical University of Warsaw

Żwirki i Wigury 81

Warsaw, 02-091


Phone: 48 22 57 20 490

Fax:48 22 57 20 491


Background: Despite the existence of an effective vaccine, measles still threatens the health and lives of many Europeans. Notably, during the COVID-19 pandemic, measles vaccine uptake declined; as a result, after the pandemic, European countries will have to increase vaccination rates to restore the extent of vaccination coverage among the population. Because information obtained from social media are one of the main causes of vaccine hesitancy, knowledge of the nature of information pertaining to measles that is shared on social media may help create educational campaigns.

Objective: In this study, we aim to define the characteristics of European news about measles shared on social media platforms (ie, Facebook, Twitter, and Pinterest) from 2017 to 2019.

Methods: We downloaded and translated (into English) 10,305 articles on measles published in European Union countries. Using latent Dirichlet allocation, we identified main topics and estimated the sentiments expressed in these articles. Furthermore, we used linear regression to determine factors related to the number of times a given article was shared on social media.

Results: We found that, in most European social media posts, measles is only discussed in the context of local European events. Articles containing educational information and describing world outbreaks appeared less frequently. The most common emotions identified from the study’s news data set were fear and trust. Yet, it was found that readers were more likely to share information on educational topics and the situation in Germany, Ukraine, Italy, and Samoa. A high amount of anger, joy, and sadness expressed within the text was also associated with a higher number of shares.

Conclusions: We identified which features of news articles were related to increased social media shares. We found that social media users prefer sharing educational news to sharing informational news. Appropriate emotional content can also increase the willingness of social media users to share an article. Effective media content that promotes measles vaccinations should contain educational or scientific information, as well as specific emotions (such as anger, joy, or sadness). Articles with this type of content may offer the best chance of disseminating vital messages to a broad social media audience.

J Med Internet Res 2021;23(11):e30150




The first measles vaccine was approved in 1963. Before the invention of this vaccine, measles caused 6 million deaths annually [1]. Since use of this vaccine became common, the number of measles cases worldwide has started to decline. A few years after the first vaccination campaign, the number of new measles cases plunged to one-twentieth of the previous figure [2]. In some countries, the cases of measles have been eliminated almost completely, although local epidemics still occur from time to time [3].

Despite the proven effectiveness of vaccination in saving millions of lives annually, some individuals have questioned the safety and long-term benefits of vaccine use. In 1998, Andrew Wakefield, a British physician and academic, published an article connecting the measles, mumps, and rubella (MMR) vaccine to autism among children [4]. This paper was retracted 12 years later; however, antivaccine activists still argue against vaccination. Antivaccination movements are one of the main obstacles for public health professionals in conducting vaccination campaigns. Vaccine hesitancy is a significant problem as only a high measles vaccination coverage—of about 95%—can enable the complete eradication of this disease. Currently, global vaccination coverage against measles is approximately 70%. Measles vaccines protect not only human lives but also the economies of low- and middle-income countries, generating US $58 for an investment of US $1 [5].

One example of the result of the decline in measles vaccination coverage was the outbreak in Samoa. In September 2019, in Samoa, a country with a small population of 200,000, a measles outbreak led to over 5000 infections and 83 deaths [6]. The reason behind the outbreak was the suspension of the country's immunization program by the Samoan government in July 2018 following the death of 2 children as a result of nurses’ inadvertent use of curare muscle relaxant anesthetic instead of water to dilute the MMR vaccine. This led to a decrease in measles vaccination coverage in Samoa to 31% by the end of 2019 [7]. After multiple measles-related deaths, the authorities decided to organize a vaccination campaign. Approximately 95% of eligible people in Samoa were vaccinated against measles, which put an end to the outbreak [8]. This case shows how quickly the measles virus can spread when a vaccination program is suspended. Therefore, it is important to constantly monitor measles epidemiology and people’s attitudes toward it to promptly prevent vaccine hesitancy.

This problem surrounding vaccination coverage has also been observed in Europe. The European Centre for Disease Prevention and Control (ECDC) data suggests that the second dose of MMR vaccine coverage is over 95% in only 5 European Union countries. This extent of coverage can ensure the immunity of the population against this disease and eliminate the chance of an outbreak [9]. In the European Union, the number of measles cases declined in 2020—mainly caused by the COVID-19 pandemic and the result of wearing masks, practicing social distancing, and conducting social lockdowns [10]—except for Romania and Bulgaria. In 2020, there were over 20 measles cases per million inhabitants in these 2 countries [11]. After the COVID-19 pandemic ends, European societies will probably notice an increase in measles morbidity as there was a decline in measles vaccine administration among children during the lockdowns [12]. Moreover, Europeans have been using social media more frequently during the COVID-19 pandemic. This may result in the growth of negative attitudes in the public toward vaccination as exposure to disinformation on social media increases vaccine hesitancy [13,14]. As social media contribute significantly, analyzing social media content and the activities of users can help better understand public attitudes and opinions regarding measles. The knowledge gathered from this analysis will inform the actions to increase MMR vaccine coverage and prevent the spread of misinformation.

Study Aim

We aim to characterize European measles news reports shared on social media platforms (ie, Facebook, Twitter, and Pinterest) during 2017 to 2019 (ie, the pre–COVID-19 period). For this purpose, we formulated the following 3 research questions: (1) What are the main topics of the articles on measles published in the European Union countries? (2) What sentiments are associated with these news articles? (3) Which features of the articles are associated with an increased number of shares on social media?

Data Collection and Preparation

We collected articles on measles that were shared on Facebook, Twitter, or Pinterest from 28 European Union countries.

First, we translated the word “measles” into all 23 official languages of the European Union using Wiktionary [15] and used a social media data analysis platform (ahrefs, Ahrefs Pte. Ltd [16]), which continuously collects, processes, and stores information from social media platforms about users’ content and activities, to collect news articles. For each European Union country, we downloaded all articles on measles published from January 1, 2017, to December 31, 2019. We chose this time range because there was a significant increase in the number of measles infections in Europe in 2017 that lasted until the start of the COVID-19 pandemic [17]. We selected articles containing the word “measles” in the national language and published on websites with national domains (eg, “.de” domain for Germany, “.pl” for Poland). Our data set contained the URL of the article, the publication date, and the number of shares (ie, the total number of shares for all instances of the article) on Facebook, Twitter, and Pinterest.

As the next step, we obtained the full text of the articles (n=12,638) and read the content. To accomplish this task, we used a Python newspaper package (version 0.3.0) [18] that allows an automated download of the website content.

We automatically translated all non-English articles into English using Yandex Translate [19]. Finally, we removed all duplicate articles and those that had been improperly downloaded or translated. Our final data set comprised 10,305 articles. This dataset, containing the text of translated news, country of origin, and the total number of shares, was published and publicly made available on the Zenodo platform [20]. Finally, we processed the data in order to be able to apply the latent Dirichlet allocation (LDA) method. We used R packages (tidytext [21] and textstem [22]) to tokenize text; remove numbers, punctuation, and English stop words; and lemmatize all words.

Statistical Analysis

Topic Modeling

We used LDA [23] to identify the main topics of the 10,305 articles in our data set. We trained multiple LDA models with a different number of topics (ranging from 1 to 40). We then analyzed perplexity and coherence levels to select the model that best describes our data set. In the next step, 2 researchers individually labeled the topics chosen by LDA to categorize them. The researchers analyzed not only the keywords assigned to each topic but also the content of the 20 articles with the highest amount of contribution to the topic. Initially, they independently described each topic with a freely chosen category. Then, they analyzed the created categories (without knowing the topic they were assigned to) and together created a unified set of categories (eg, education, Europe, and the world). Finally, they classified the topics again with a new set of categories. In this final stage, there were no discrepancies in assessment.

Sentiment Analysis

We calculated the main emotions associated with each article using the syuzhet R package [24]. This package uses the National Research Council Canada (NRC) Word-Emotion Association lexicon. The NRC lexicon is a set of 14,182 English words that are not just concerned with polarity (reporting positive or negative words) but associated with 8 fundamental emotions introduced by Plutchik [25] (ie, anger, anticipation, disgust, fear, joy, sadness, surprise, and trust) [26]. These words were labeled manually by crowdsourcing—each word could be associated with more than one emotion). The sentiment of an article is the sum of emotions related to the words that make it up. The occurrence of each word from one of the categories in the article translates as “1” in the sentiment score for that category. Finally, each article is scored for each sentiment category [27].

Linear Regression

We considered a linear regression model to find the factors determining the number of shares of an article on social media (ie, the dependent variable). We used forward selection regression to create our model. We also used Cook distance method to identify and remove outliers [28] and variance inflation factor to check the existence of collinearity [29]. As independent variables, we used topics generated by the LDA model, the emotions related to the articles, the number of new national measles cases in the month when an article was published, the population of the country, and the percentage of active social media users in each country. The number of new monthly measles cases for each country was collected from the ECDC website [30]. Data on the populations of European countries were obtained from the Eurostat database [31], and the proportion data of active social media users in each country were acquired from the Statista website [32].

Sample Description

After article selection and data processing, we had a final sample of 10,305 measles-related articles, published between January 1, 2017, and December 31, 2019, in European Union countries. The highest number of published articles retrieved was from Italy, but the articles that were the most shared ones were from the United Kingdom. Table 1 shows the number of articles from each country, and the sum and average number of shares. In Table S1 of Multimedia Appendix 1, we present more detailed yearly aggregated data.

Table 1. Description of collected data (N=10,305).
CountryArticles, n (%)Shares

TotalMean per article (SD)
Austria200 (1.94)34,539173 (425)
Belgium250 (2.43)89,442358 (1095)
Bulgaria404 (3.92)23,41858 (346)
Croatia53 (0.51)8395158 (281)
Republic of Cyprus9 (0.09)25028 (52)
Czech Republic51 (0.49)78,0431530 (3154)
Denmark114 (1.11)92,603812 (2274)
Estonia13 (0.13)2546196 (349)
Finland119 (1.15)86,076723 (2136)
France1252 (12.15)633,111506 (1826)
Germany1132 (10.98)914,665808 (4420)
Greece697 (6.76)57,08282 (792)
Hungary116 (1.13)28,851249 (568)
Ireland167 (1.62)32,226193 (389)
Italy2025 (19.65)1,462,172722 (2983)
Latvia3 (0.03)927309 (520)
Lithuania1 (0.01)156156 (0)
Luxembourg20 (0.19)2609130 (212)
Malta0 (0)0N/Aa
Netherlands313 (3.04)68,705220 (607)
Poland216 (2.10)46,658216 (1042)
Portugal964 (9.35)200,812208 (1116)
Romania544 (5.28)44,36382 (459)
Slovakia21 (0.20)4300205 (255)
Slovenia25 (0.24)245098 (232)
Spain664 (6.44)954,6131438 (18,634)
Sweden253 (2.46)86,958344 (1361)
United Kingdom679 (6.59)2,012,1182963 (23,726)

aN/A: not applicable.

Topic Modeling

We found that 13 is the best number of topics to describe all collected news articles, accounting for the perplexity and coherence values (Table S2 of Multimedia Appendix 1). After labeling, we discovered that these topics can be aggregated into 3 clusters. The first group contains the topics featured in educational articles, which describe the signs and symptoms of measles infection, debunk antivaccine claims, and explain scientific advancements in the prevention of this disease. The topics in the second group are related to European information, which contain country-specific information on measles outbreaks and health policies. The last group includes topics related to countries outside Europe, including measles cases in the United States, and the Samoa measles outbreak. Table 2 presents the main words connected with specific topics and their classification to general groups.

Table 2. Topics, their classification, and key words.
TopicMain wordsGroup classification
Topic 1immune, immune_system, study, cell, system, researcher, cancer, antibody, virus, memoryEducation
Topic 2child, measles, hospital, Samoa, epidemic, Sweden, people, disease, campaign, patientWorld
Topic 3county, York, measles, city, orthodox, Jewish, disease, USA, Brooklyn, confirmWorld
Topic 4measles, rash, symptom, fever, infection, disease, day, infect, cough, virusEducation
Topic 5vaccine, parent, autism, child, ani, polio, Wakefield, diphtheria, study, vaccinate_childEducation
Topic 6MMR, GP, December, England, measles, UK, dose_MMR, jab, HSE, NHSEurope
Topic 7vaccination, school, federal, Spahn, measles_vaccination, Germany, day_care, measles, CDU, mandatoryEurope
Topic 8DGS, health, confirm, directorate, measles, outbreak, age, Portugal, UK, LisbonEurope
Topic 9hospital, measles, Italy, health, Catania, ship, vaccinate, Sicily, hospitalize, regionEurope
Topic 10country, world, Europe, organization, world_health, health_organization, European, measles, increase, UkraineEurope
Topic 11measles, Roma, CDC, health, dose, Greece, vaccine, population, diseases, SpainEurope
Topic 12France, measles, health, agency, Aquitaine, epidemic, health_France, vaccinate, Poitiers, peopleEurope
Topic 13obligation, dolphin, Cicciobello, decree, sport, doll, Burioni, certification, time, marketEurope

Using these 3 clustered meta-topics, we evaluated the popularity of all topics in each country. Figure 1 shows that all of the European countries mainly write about the topic in the European context. Educational topics are more popular than world topics, although the difference between the two varies between countries. In Multimedia Appendix 1, we present sample articles that were highly connected to specific topics.

Figure 1. Distribution of topics across all countries analzyed.
View this figure

Sentiment Analysis

We analyzed what emotions are connected to measles-related articles in Europe. Figure 2 shows the frequency of appearance of the words associated with a specific emotion in our data set. The most common emotions were fear and trust.

We also determined which words contributed the most to the emotion levels in our data set. For each emotion, we reviewed the 15 most popular words from our data set, as shown in Table 3.

Figure 2. Number of words with a certain sentiment in the data set of articles analyzed.
View this figure
Table 3. Emotions and connected words.
EmotionConnected words
Feardisease, infection, death, hospital, epidemic, risk, infectious, contagious, die, medical, fever, prevent, bear, warn, emergency
Trustaccord, hospital, school, doctor, medical, immunization, county, system, organization, authority, recommend, ministry, continue, level, director
Sadnessdisease, death, hospital, epidemic, infectious, die, late, sick, emergency, illness, leave, mother, fatal, fall, bad
anticipationchild, death, time, patient, epidemic, risk, public, medical, organization, result, continue, warn, start, prevention, develop
Disgustdisease, death, epidemic, infect, infectious, contagious, rash, cough, sick, bad, ill, nose, elimination, lose, treat
Angerdisease, death, epidemic, bear, fatal, eradicate, bad, ill, force, fear, elimination, victim, lose, treat, fight
Joychild, organization, ministry, baby, majority, infant, mother, childhood, achieve, safe, grow, treat, create, save, progress
Surprisedeath, epidemic, organization, warn, emergency, infant, leave, alarm, expect, catch, lose, treat, sneeze, break, vote

Evidently, fear is connected to words describing the harmfulness of measles. Trust is associated with the words related to health care systems and protection. Sadness is conveyed when describing the adverse effects of the disease; anticipation is conveyed when talking about the actions being taken to reduce the spread of the disease; disgust is associated with the characteristics and signs of measles; anger is about the fight against measles; joy is about children and protecting them from the disease; and surprise is about emergent events. In Multimedia Appendix 1, we present sample articles highly connected to specific emotions.

Linear Regression

We used linear regression to identify the variables related to the number of shares of an article on social media. Table 4 presents the results of the forward selection regression. In the multicollinearity analysis, all variance inflation factor scores were determined to be lower than 5. Therefore, we assumed that there is no collinearity among variables. Detailed results are presented in Multimedia Appendix 1.

We discovered that readers were more likely to share information on topics 1, 4, and 5, which convey educational information. Topics 2, 7, 10, and 13 describe the situation in Samoa, Germany, Ukraine, and Italy, and these topics were also positively associated with the number of total shares. Topic 6, which describes the situation in the United Kingdom, resulted in a reduced number of shares. Topic 4, which describes the signs and symptoms of measles, had the highest impact on the average of shareability.

With regard to emotions, on average, a higher proportion of anger, joy, and sadness expressed in an article was associated with a higher number of article shares, whereas surprise in the article was associated with reduced number of shares. Moreover, articles published in countries with a higher population and a higher number of active social media users understandably received more shares on social media.

Table 4. Regression results (adjusted R2=0.04852).
VariableBetaStandard errort value (df)aP value
Topic 110252184.695<.001
Topic 27111275.615<.001
Topic 4183314512.651<.001
Topic 54751962.426.015
Topic 6–512171–2.994.003
Topic 710241228.42<.001
Topic 106161145.388<.001
Topic 121841241.487.14
Topic 133751812.072.04
Social media users2245.112<.001


Sample Description

The number of articles published from 2017 to 2019 varies across the different countries included in this study. The highest number of articles was published in Italy, which is likely because of the high number of measles cases reported in Italy. During this period, a total of 9252 measles cases were reported in Italy [30]—the highest reported in the European Union. The articles published in the United Kingdom received the greatest number of shares, which might be attributed to the popularity of the English language worldwide. In our data set, less than one relevant article per month was published in Malta, Slovenia, Slovakia, Lithuania, Estonia, Latvia, and Luxembourg. These countries have small populations, and most reported a low number of measles cases during 2017 to 2019. Latvia had a relatively higher number of measles cases, but as was observed (Table 1), despite the low number of measles-related articles published, they were extensively shared on social media. Topic Modeling

European media mostly published news about local events, reporting on almost all significant outbreaks of measles in Europe. However, several of the events received special media attention. The decision of the German government to make the measles vaccine mandatory in response to an increase in measles cases has been frequently discussed in those articles [33]. The measles outbreak in the Aquitaine region in France, caused by insufficient vaccination coverage, is also one of the most described events in the media [34]. Furthermore, measles clusters in the United Kingdom, Portugal, Italy, and Greece are also frequently mentioned in these articles. Some of these articles describe the case of the Cicciobello doll in Italy. The Cicciobello doll is a toy that pretends to be suffering from measles and that children can cure with plasters or cream. Experts have criticized this doll for banalizing such a severe disease [35].

The theme of world news is dominated by 2 events: One is the measles outbreak in the Orthodox Jewish community in New York [36], and the second is the measles outbreak in Samoa [7]. Both these events are interesting because they are concerned with relatively small outbreaks. During the years of analysis, millions of people contracted measles in Africa, Asia, and South America, but this did not attract the attention of European media. As indicated by our data set, media attention was mainly drawn to outbreaks in small, specific communities, and not necessarily to events that had the greatest impact on the lives of millions of people.

Educational themes focus mainly on 3 threads. Some articles describe the symptoms of measles, reflecting the readers’ interest in the signs, symptoms, and causes of the disease and their desire to recognize them. The second topic is related to the scientific findings on measles, including studies on the potential oncolytic activity of this virus [37]. The last educational topic dispels the doubts—raised by Wakefield’s paper, which has since been retracted—related to the risk of autism allegedly caused by the MMR vaccine [4]. Moreover, another paper published in 2019, of a nationwide cohort study conducted in Denmark that found that MMR vaccination does not increase the risk for autism, was widely discussed in the media [38].

Sentiment Analysis

In the course of human life, up to 34,000 different emotions can be distinguished [39]. Psychologist Robert Plutchik proposed the theory of 8 basic emotions, which have developed evolutionarily and are innate in humans and help them survive [25,40]. As a result of combining these basic emotions, more complex emotions responsible for specific experiences arise (eg, joy + trust = love; trust + fear = submission). Basic emotions are triggered by specific events, eliciting an appropriate response that has an evolutionary function. Table 5 presents the characteristics of these basic emotions as proposed by Plutchik [40].

Table 5. Characteristics of basic emotions.
EmotionStimulus eventBehavioral reactionFunctionOpposite emotion
JoyGain of a valued objectRetain or repeatGain resourcesSadness
TrustMember of the groupGroomMutual supportDisgust
SurpriseUnexpected eventStopGain time to orientAnticipation
SadnessLoss of a valued objectCryReattach to the lost objectJoy
DisgustUnpalatable objectVomitEject poisonTrust
AngerObstacleAttackDestroy obstacleFear
AnticipationNew territoryMapKnowledge of territorySurprise

Emotions are an important part of media articles, as emotional stories attract readers’ attention [41]. The most common emotion identified from all collected articles was fear. The creation of fear-based articles is consistent with the results of studies that show that fear-related news reports automatically attract public attention [42]. In the case of the articles analyzed in this study, the emotion fear was mainly concerned with the fear of the disease and its consequences. This emotion is so strong that sometimes the fear of disease is worse for a patient than the disease itself [43].

The analyzed articles were also highly connected with trust. There is a natural link between fear and trust because it is in response to concerns about a dangerous disease that we place our trust in the health care system and the vaccines that protect us against the pathogen. Research conducted during the Ebola epidemic showed that trust in the health care system increased during the outbreak [44].

In the field of marketing, the relationship between the basic emotions in the text and its potential to go viral has often been examined. An analysis of 7000 articles published in The New York Times revealed that positive content tends to go viral more than negative content. More specifically, this study has demonstrated that sad content is less likely to go viral, whereas articles expressing anger or anxiety result in higher number of shares on social media [45]. Teixeira [46] analyzed thousands of reactions to several advertisements and found that maintaining viewers’ engagement levels is associated with the emotions of joy and surprise. Libert and Tynski [47] also found that emotional activation is the key to viral success. They used Plutchik’s set of emotions [25] and found that negative emotions are not commonly present in highly viral content. Surprise and anticipation are also extremely common in highly viral content.

Linear Regression

We identified a few features of news articles that are associated with an increased number of shares on social media. All educational topics are positively connected with the number of shares. This shows that social media users generally prefer to share general educational news over informational ones. This finding is consistent with the results of previous research, wherein it was proved that Facebook users are more likely to share “soft” news related to children, health, and education than “hard” news related to politics or urgent occurrences [48]. Sharing educational and scientific articles can also be associated with the willingness to increase one’s credibility, self-confidence, and self-esteem from other social media users [49].

The results also show that information on the events in Sweden, Germany, Italy, and Ukraine was shared frequently, whereas the publication of information on the situation in the United Kingdom was negatively associated with the number of social media shares. The interest in measles in Ukraine may have been generated as a result of the country having the highest number of measles cases in Europe. In 2017-2019, the number of measles cases in Ukraine was around 100,000 [50]. This situation was similar to the interest in measles cases in Italy, where the highest number of cases among all countries in the European Union was reported during the study period [30]. Furthermore, research conducted by Facebook showed that country-based or cultural differences have an impact on Facebook activity. In the United Kingdom, social media users are younger but less active than those in Germany or Sweden [51].

The findings of previous research analyzing what type of web-based content become viral are generally in line with our results. They indicate that articles containing positive emotions or anger are more likely to be shared [45].


Articles on measles shared on social media in Europe primarily report on European events, and only a small proportion of articles report on educational news or international measles-related events. The international events mainly describe outbreaks that have occurred in a small number of infected people but are interesting from an epidemiological point of view. The distribution of topics covered by the media is similar across all European Union countries.

In this study, the two main emotions expressed in the analyzed measles-related articles were fear and trust. These emotions appeared in the articles most frequently. However, these emotions were not associated with frequent sharing of articles on social media. We found that an article has a high probability to drive public discourse if it contains educational or scientific information, as well as specific emotions (ie, anger, joy, or sadness). Making media content based on these principles can facilitate the creation of effective messages against measles vaccine hesitancy. Articles that follow these principles offer the best chance of disseminating information to a broad audience on social media and influencing the mindset of the public regarding vaccines.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Supplementary tables providing details of the analyses conducted.

DOC File , 231 KB

  1. Goodson JL, Seward JF. Measles 50 years after use of measles vaccine. Infect Dis Clin North Am 2015 Dec;29(4):725-743. [CrossRef] [Medline]
  2. Conis E. Measles and the modern history of vaccination. Public Health Rep 2019 Feb 14;134(2):118-125 [FREE Full text] [CrossRef] [Medline]
  3. Patel MK, Dumolard L, Nedelec Y, Sodha SV, Steulet C, Gacic-Dobo M, et al. Progress toward regional measles elimination - Worldwide, 2000-2018. MMWR Morb Mortal Wkly Rep 2019 Dec 06;68(48):1105-1111 [FREE Full text] [CrossRef] [Medline]
  4. Godlee F, Smith J, Marcovitch H. Wakefield's article linking MMR vaccine and autism was fraudulent. BMJ 2011 Jan 05;342(jan05 1):c7452-c7452. [CrossRef] [Medline]
  5. Durrheim DN. Measles eradication—retreating is not an option. Lancet Infect Dis 2020 Jun;20(6):e138-e141. [CrossRef]
  6. Craig AT, Heywood AE, Worth H. Measles epidemic in Samoa and other Pacific islands. The Lancet Infectious Diseases 2020 Mar;20(3):273-275. [CrossRef]
  7. Isaacs D. Lessons from the tragic measles outbreak in Samoa. J Paediatr Child Health 2020 Jan 15;56(1):175-175. [CrossRef] [Medline]
  8. WHO. Measles Outbreak in The Pacific - Situation Report No. 9. Joint WHO/UNICEF Measles Outbreak Response and Preparedness in the Pacific. 2019.   URL: https:/​/www.​​docs/​default-source/​wpro---documents/​dps/​outbreaks-and-emergencies/​measles-2019/​measles-pacific-who-unicef-sitrep-20200103.​pdf [accessed 2021-10-21]
  9. Vaccination coverage for the second dose of measles-containing vaccine, EU/EEA, 2018. European Centre for Disease Prevention and Control.   URL: https:/​/www.​​en/​publications-data/​vaccination-coverage-second-dose-measles-containing-vaccine-eueea-2018 [accessed 2021-10-21]
  10. Wu D, Liu Q, Wu T, Wang D, Lu J. The impact of COVID-19 control measures on the morbidity of varicella, herpes zoster, rubella and measles in Guangzhou, China. Immun Inflamm Dis 2020 Dec 07;8(4):844-846 [FREE Full text] [CrossRef] [Medline]
  11. Measles notification rate per million population by country, January 2020 - December 2020. European Centre for Disease Prevention and Control.   URL: https:/​/www.​​en/​publications-data/​measles-notification-rate-million-population-country-january-2020-december-2020 [accessed 2021-10-21]
  12. Santoli JM, Lindley MC, DeSilva MB, Kharbanda EO, Daley MF, Galloway L, et al. Effects of the COVID-19 pandemic on routine pediatric vaccine ordering and administration - United States, 2020. MMWR Morb Mortal Wkly Rep 2020 May 15;69(19):591-593 [FREE Full text] [CrossRef] [Medline]
  13. Wilson SL, Wiysonge C. Social media and vaccine hesitancy. BMJ Glob Health 2020 Oct 23;5(10):e004206 [FREE Full text] [CrossRef] [Medline]
  14. Wawrzuta D, Jaworski M, Gotlib J, Panczyk M. Characteristics of antivaccine messages on social media: systematic review. J Med Internet Res 2021 Jun 04;23(6):e24564 [FREE Full text] [CrossRef] [Medline]
  15. Wiktionary.   URL: [accessed 2021-10-21]
  16. Ahrefs - SEO Tools & Resources to Grow Your Search Traffic.   URL: [accessed 2021-10-21]
  17. Number of cases of measles reported monthly in the European Economic Area (EEA) from 1999 to 2021. Statista.   URL: [accessed 2021-10-21]
  18. Ou-Yang L. News, full-text, and article metadata extraction in Python 3. GitHub.   URL: [accessed 2021-10-21]
  19. Yandex Translate.   URL: [accessed 2021-10-21]
  20. Wawrzuta D. European articles about measles. Dataset on Zenodo.   URL: [accessed 2021-10-21]
  21. Silge J, Robinson D. tidytext: text mining and analysis using tidy data principles in R. JOSS 2016 Jul;1(3):37. [CrossRef]
  22. Rinker T. Tools for fast text stemming & lemmatization.   URL: [accessed 2021-10-21]
  23. Blei D, Ng A, Jordan M. Latent Dirichlet allocation. Journal of Machine Learning Research 2003;3:993-1022 [FREE Full text]
  24. Jockers M. Introduction to the syuzhet package.   URL: [accessed 2021-10-21]
  25. Plutchik R. A general psychoevolutionary theory of emotion. In: Emotion: Theory, research, and experience: Vol. 1. Theories of emotion. New York: Academic Press; 1980.
  26. Mohammad SM, Turney PD. NRC Emotion Lexicon.   URL: [accessed 2021-10-21]
  27. Naldi M. A review of sentiment computation methods with R packages. arXiv 2019:1-11.
  28. Stevens JP. Outliers and influential data points in regression analysis. Psychol Bull 1984;95(2):334-344. [CrossRef]
  29. Thompson CG, Kim RS, Aloe AM, Becker BJ. Extracting the variance inflation factor and other multicollinearity diagnostics from typical regression results. Basic Appl Soc Psych 2017 Feb;39(2):81-90. [CrossRef]
  30. Measles. European Centre for Disease Prevention and Control.   URL: [accessed 2021-10-21]
  31. Population on 1 January by age and sex. Eurostat.   URL: [accessed 2021-10-21]
  32. Tankovska H. Active social media penetration in selected European countries in 2020. Statista.   URL: [accessed 2021-10-21]
  33. Connolly K. German parliament approves compulsory measles vaccinations. The Guardian.   URL: https:/​/www.​​world/​2019/​nov/​14/​german-parliament-approves-compulsory-measles-vaccinations [accessed 2021-10-21]
  34. Bernadou A, Astrugue C, Méchain M, Le Galliard V, Verdun-Esquer C, Dupuy F, et al. Measles outbreak linked to insufficient vaccination coverage in Nouvelle-Aquitaine region, France, October 2017 to July 2018. Eurosurveillance 2018;23(30):1-5. [CrossRef]
  35. Monella L, Cuddy A. Italy’s measles doll sparks controversy. Euronews.   URL: [accessed 2021-10-21]
  36. McDonald R, Ruppert P, Souto M, Johns D, McKay K, Bessette N, et al. Notes from the field: measles outbreaks from imported cases in orthodox Jewish communities - New York and New Jersey, 2018-2019. MMWR Morb Mortal Wkly Rep 2019 May 17;68(19):444-445 [FREE Full text] [CrossRef] [Medline]
  37. Russell L, Peng K. The emerging role of oncolytic virus therapy against cancer. Chin Clin Oncol 2018 Apr;7(2):16-16 [FREE Full text] [CrossRef] [Medline]
  38. Hviid A, Hansen JV, Frisch M, Melbye M. Measles, mumps, rubella vaccination and autism. Ann Intern Med 2019 Mar 05;170(8):513. [CrossRef]
  39. Managing emotions. Deloitte.: Deloitte; 2020.   URL: https:/​/www2.​​content/​dam/​Deloitte/​us/​Images/​Misc/​infographic/​managing-emotions-infographic.​pdf [accessed 2021-10-20]
  40. Plutchik R. The Nature of Emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. Am Sci 2001;89(4):344-350. [CrossRef]
  41. Bagozzi RP, Gopinath M, Nyer PU. The role of emotions in marketing. J Acad Mark Sci 1999 Apr 01;27(2):184-206. [CrossRef]
  42. Schmidt LJ, Belopolsky AV, Theeuwes J. Potential threat attracts attention and interferes with voluntary saccades. Emotion 2015 Jun;15(3):329-338. [CrossRef] [Medline]
  43. Singh T, Newby DE. Is the fear of disease worse than the disease itself? Heart 2021 Jan 24;107(2):91-92. [CrossRef] [Medline]
  44. Nuriddin A, Jalloh M, Meyer E, Bunnell R, Bio F, Jalloh M, et al. Trust, fear, stigma and disruptions: community perceptions and experiences during periods of low but ongoing transmission of Ebola virus disease in Sierra Leone, 2015. BMJ Global Health 2018;3(2):e000410. [CrossRef]
  45. Berger J, Milkman K. What Makes Online Content Viral? J Mark Res 2012 Apr 01;49(2):192-205. [CrossRef]
  46. Teixeira T. The New Science of Viral Ads. Harvard Business Review. 2012.   URL: [accessed 2021-10-26]
  47. Libert K, Tynski K. Research: The Emotions that Make Marketing Campaigns Go Viral. Harvard Business Review. 2013.   URL: [accessed 2021-10-26]
  48. Kalsnes B, Larsson AO. Understanding news sharing across social media. Journalism Studies 2017 Mar 23;19(11):1669-1688. [CrossRef]
  49. Lee CS, Ma L, Goh DHL. Why do people share news in social media? In: Zhong N, Callaghan V, Ghorbani AA, Hu B, editors. Lecture Notes in Computer Science. Berlin, Heidelberg: Springer; 2011:129-140.
  50. Rodyna R. Measles situation in Ukraine during the period 2017-2019. European Journal of Public Health 2019;29:1. [CrossRef]
  51. Cheng J, Burke M, de Gant B. Country Differences in Social Comparison on Social Media. Proc ACM Hum Comput Interact 2021 Jan 05;4(CSCW3):1-26. [CrossRef]

ECDC: The European Centre for Disease Prevention and Control
LDA: latent Dirichlet allocation
MMR: measles, mumps, and rubella

Edited by R Kukafka; submitted 03.05.21; peer-reviewed by C Slavik, M Das; comments to author 22.05.21; revised version received 17.07.21; accepted 12.08.21; published 08.11.21


©Dominik Wawrzuta, Mariusz Jaworski, Joanna Gotlib, Mariusz Panczyk. Originally published in the Journal of Medical Internet Research (, 08.11.2021.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.