Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?


Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 15.01.21 in Vol 23, No 1 (2021): January

Preprints (earlier versions) of this paper are available at, first published Sep 05, 2020.

This paper is in the following e-collection/theme issue:

    Original Paper

    Digital Health Literacy and Web-Based Information-Seeking Behaviors of University Students in Germany During the COVID-19 Pandemic: Cross-sectional Survey Study

    1Department of Nursing and Health Sciences, Fulda University of Applied Sciences, Fulda, Germany

    2Centre for Applied Health Science, Leuphana University Lueneburg, Lueneburg, Germany

    3Interdisciplinary Centre for Health Literacy Research, Faculty of Educational Science, Bielefeld University, Bielefeld, Germany

    4Section "External Lecturer", APOLLON University of Applied Sciences, Bremen, Germany

    5Centre for Gerontological Nursing, World Health Organization Collaborating Centre for Community Health Services, School of Nursing, Hong Kong Polytechnic University, Hong Kong SAR, Hong Kong, China

    6School of Nursing, University of Minho, Braga, Portugal

    7Health Systemic Process EA 4129 Research Unit (P2S), University of Lyon, University Claude Bernard of Lyon 1, Lyon, France

    *these authors contributed equally

    Corresponding Author:

    Kevin Dadaczynski, MSc, PhD

    Department of Nursing and Health Sciences

    Fulda University of Applied Sciences

    Leipziger Sraße 123

    Fulda, 36037


    Phone: 49 661 9640 6073



    Background: Digital communication technologies are playing an important role in the health communication strategies of governments and public health authorities during the COVID-19 pandemic. The internet and social media have become important sources of health-related information on COVID-19 and on protective behaviors. In addition, the COVID-19 infodemic is spreading faster than the coronavirus itself, which interferes with governmental health-related communication efforts. This jeopardizes national public health containment strategies. Therefore, digital health literacy is a key competence to navigate web-based COVID-19–related information and service environments.

    Objective: This study aimed to investigate university students’ digital health literacy and web-based information-seeking behaviors during the early stages of the COVID-19 pandemic in Germany.

    Methods: A cross-sectional study among 14,916 university students aged ≥18 years from 130 universities across all 16 federal states of Germany was conducted using a web-based survey. Along with sociodemographic characteristics (sex, age, subjective social status), the measures included five subscales from the Digital Health Literacy Instrument (DHLI), which was adapted to the specific context of the COVID-19 pandemic. Web-based information-seeking behavior was investigated by examining the web-based sources used by university students and the topics that the students searched for in connection with COVID-19. Data were analyzed using univariate and bivariate analyses.

    Results: Across digital health literacy dimensions, the greatest difficulties could be found for assessing the reliability of health-related information (5964/14,103, 42.3%) and the ability to determine whether the information was written with a commercial interest (5489/14,097, 38.9%). Moreover, the respondents indicated that they most frequently have problems finding the information they are looking for (4282/14,098, 30.4%). When stratified according to sociodemographic characteristics, significant differences were found, with female university students reporting a lower DHLI for the dimensions of “information searching” and “evaluating reliability.” Search engines, news portals, and websites of public bodies were most often used by the respondents as sources to search for information on COVID-19 and related issues. Female students were found to use social media and health portals more frequently, while male students used Wikipedia and other web-based encyclopedias as well as YouTube more often. The use of social media was associated with a low ability to critically evaluate information, while the opposite was observed for the use of public websites.

    Conclusions: Although digital health literacy is well developed in university students, a significant proportion of students still face difficulties with certain abilities to evaluate information. There is a need to strengthen the digital health literacy capacities of university students using tailored interventions. Improving the quality of health-related information on the internet is also key.

    J Med Internet Res 2021;23(1):e24097




    Shortly after the outbreak of SARS-CoV-2 and the associated disease, COVID-19, were first reported [1], it was declared a pandemic [2,3] by the World Health Organization. When the first case of COVID-19 was reported in Germany on January 27, 2020, the government responded immediately by launching an unprecedented nationwide emergency response plan that focused on four pillars: prevention, detection, containment, and treatment [4]. In addition to the National Pandemic Plan [5] and to health care and medical interventions [4], the government endorsed a public health communication strategy that was supported by all health agencies and public health bodies on national and local levels [6-9]. This communication strategy involved public broadcasting agencies, which launched web-based media campaigns, including daily nationwide podcasts. The underlying objective of this approach was to provide citizens with the necessary information on COVID-19 and how it affected people’s health [4,10-13]. Within a short period of time, a massive amount of web-based health-related information on COVID-19 became available on issues such as protective behaviors, preventive measures, treatment options, dashboard statistics, the latest scientific insights, and various safety recommendations [14-16]. It has now become clear that this pandemic has been accompanied by an “infodemic”—an overabundance of valid and invalid health information on COVID-19 [17,18]. By means of digital communication technologies, especially the internet and social media, the COVID-19 infodemic is spreading faster than the coronavirus itself, which interferes with governmental health communication efforts and jeopardizes national public health containment strategies.

    Altogether, this situation creates a complex information environment that requires people to be able to access, navigate, understand, use, and critically evaluate information and services in ways that support healthy and protective behaviors in the time of the COVID-19 pandemic. Therefore, health literacy, which is the ability to find, understand, and evaluate health information and apply it in daily decision-making and health behavior [19], is of utmost importance during the current pandemic [14]. Digital health literacy applies this understanding of health literacy to digital contexts and environments [20], and it has become a core competence and necessity for navigating web-based information and health service environments within the realm of the COVID-19 pandemic and the associated infodemic [21]. However, in Germany, it has been shown that more than half of the population has limited health literacy; therefore, people report difficulties in dealing with health-related information [22]. A recent study conducted in Germany on health literacy in relation to information regarding COVID-19 resulted in similar findings [23]. People particularly have difficulty assessing the trustworthiness of media information on COVID-19 and its associated health problems. In addition, people with limited health literacy are more likely to be confused due to the massive amounts of information available in the media and on the internet [23]. Information is a carrier of important health knowledge to contain the virus and empower citizens to demonstrate health literacy [16,24]; the pandemic has placed increased demand on the general population to find information relevant to them and critically reflect on this information, as well as to transfer information into their everyday life and practices.

    This issue is particularly critical for university students, who consist of a significant proportion of young adults in Germany. University students comprise the population that primarily uses digital technologies and web-based health information [25,26]. Although it can be noted that students have not been the primary focus of research since the beginning of the pandemic, a recent study with over 5400 medical students from Vietnam revealed that higher levels of health literacy were associated with less fear of COVID-19 [27]. Therefore, health literacy is a critical intervention target, especially since fear is one of the toxic outcomes that result from an infodemic [17,28]. The aim of this study is to investigate the digital health literacy and web-based information-seeking behaviors among university students in Germany during the first wave of the COVID-19 pandemic, particularly during university closures. This study is informed by the conceptual model of health literacy as presented by Sørensen and colleagues [19] and the model of digital health literacy as proposed by van der Vaart and Drossaert [20]. The assumptions in both models are that personal and environmental determinants influence an individual’s capacity regarding various dimensions of personal information management, which include informing health decisions and behaviors that are beneficial for health. Our study focuses on personal and environmental determinants, personal information management, and behavioral aspects. In this context, the following research questions were addressed:

    • What are the levels of COVID-19–related digital health literacy in German university students stratified by social, economic, and geographical indicators?
    • Which sources of web-based information are used and which topics are searched for in the context of COVID-19 by German university students?
    • Can differences be identified between students with regard to health literacy, the sources used for information searching, and the topics addressed in relation to COVID-19?


    Study Design and Participants

    A national cross-sectional web-based survey was conducted including a nonrandomized sample (convenience sample) of German university students. To address as many university students as possible, all private and state universities (ie, 392 universities containing 2.9 million students [29]) were invited to participate in the study by email. A reminder was sent two weeks after the survey started. The presidencies of all the universities and the deaneries of all faculties were contacted and asked to forward an invitation letter to their students. University students enrolled at a private or state university were eligible to participate in this study. To increase the homogeneity of the sample, respondents were initially asked to indicate their current status. Those who indicated that they were not currently enrolled as students at a German university were excluded from the data set (n=245). The duration of the study was 3 weeks, and it took place from March 25 to April 17, 2020. Within the 3 weeks during which the survey was implemented, the number of confirmed COVID-19 cases in Germany increased from 44,175 to 141,016 (Figure 1 [30]). The survey was administered electronically using the Enterprise Feedback Suite survey tool (Questback) [31]. Participation was voluntary, and anonymity was ensured. Upon entering the web-based survey site, participants were presented with information regarding the background and the aims of the study. After checking a consent box at the bottom of the page, participants were directed to the questionnaire. Our study was approved by the Bielefeld University ethics committee (No. EUB 2020-053).

    Figure 1. Confirmed cumulative cases of COVID-19 in Germany from March to May 2020 (source: RKI COVID-19 Dashboard [30]).
    View this figure


    Sociodemographic information included sex (male, female, diverse), age, study course (bachelor’s degree, master’s degree, other), and subjective social status (SSS). Age was measured in absolute numbers, and based on an analysis of the distribution, four categories were created (≤20 years, 21-23 years, 24-26 years, and ≥27 years). Social status was assessed using the German version of the MacArthur Scale, which includes a ladder with 10 steps [32]. Respondents were asked to position themselves at the step that best reflected their status in the social hierarchy, with higher values indicating a higher social status. According to previous studies, respondents were categorized into three groups: low SSS (1-4), medium SSS (5-7), and high SSS (8-10) [33].

    Digital health literacy was evaluated using five of the seven subscales from the validated Digital Health Literacy Instrument (DHLI) [20], each including three items to be answered on a 4-point scale (eg, 1, very difficult; 4, very easy). The DHLI was adapted to the context of the COVID-19 pandemic (eg, “When you search the Internet for information on the coronavirus or related topics, how easy or difficult is it for you to…”). The five subscales include (1) searching the web for information on COVID-19, (2) adding self-generated content on COVID-19, (3) evaluating the reliability of COVID-19–related information, (4) determining personal relevance of COVID-19–related information, and (5) protecting privacy on the internet. The internal consistency (Cronbach α) of the first four subscales was acceptable to good (.70<α<.83). Due to low reliability (α=.46), scaling was omitted for the protecting privacy subscale.

    The section about web-based information-seeking behaviors focused on the sources that were used to receive web-based health information about COVID-19 and related topics. The respondents were presented with a 10-item list of different web-based sources (eg, search engines, websites of public health bodies, government agencies, and social media providers), in which the frequency of their use could be rated on a 5-point scale (0, don't know; 4, often) [34]. Students were also asked to indicate the specific topics they searched for in the context of COVID-19. The assessment was based on a self-developed list of 9 topics (eg, current spread of COVID-19, symptoms of COVID-19, measures to protect against infection, dealing with psychological stress caused by the COVID-19 pandemic), using yes or no answers.

    An overview of all items and scales used for this paper can be found in Multimedia Appendix 1. The entire questionnaire is available on request from the first authors.

    Statistical Analysis

    To control for the selection bias caused by a convenience sampling procedure, we used weighting to adjust the sample distribution to the characteristics of the general population of German university students. Based on the data provided by the Federal Statistical Office via the GENESIS database [35], the data could be weighted for gender and desired study degree. In the first step, all data on digital health literacy and information-seeking behavior were analyzed descriptively. Subsequently, bivariate analyses were conducted by cross-tabulating the two levels of digital health literacy (limited vs sufficient) with sociodemographic characteristics using chi-square tests. For this purpose, all DHLI subscales (except “protecting privacy”) were dichotomized using median splits. Due to the low internal consistency for the dimension “protecting privacy” and the fact that two subscales from the original DHLI instrument were not used, we also refrained from calculating an overall mean value, as done by Van der Vaart and Drossaert [20]. For all analyses, P values <.05 were considered statistically significant. However, due to the large sample size, the strength of the association was determined using the Cramer index (Cramer V). The Cramer V is a normalized version of the chi square statistic test for nominal scaled variables. According to Cohen [36], the strength of each association was interpreted as an effect size measure using the following conventions: ≥0.1 (small), ≥0.3 (medium), ≥0.5 (large). In further analyses, chi-square tests were also performed for the levels of digital health literacy and the topics searched for with regard to COVID-19. Finally, to analyze differences between the levels of digital health literacy and the sources used to search for COVID-19–related information, t tests for independent samples were conducted. Cohen d was used as an effect size measure by applying the following conventions: ≥0.2 (small), ≥0.5 (medium), ≥0.8 (large) [36].


    After further plausibility checks and adjustment for incorrect data, the data set contained complete questionnaires from 14,916 participants aged between 18 and 72 years (mean age: 24.3). Students from 130 universities and all 16 federal states participated (see Table 1). In terms of geographical coverage (see Figure 2), most respondents were from the west of Germany (6355/14,833, 42.8%), followed by students from the south (3694/14,833, 24.9), and almost equally from the north (2307/14,833, 15.6%) and the east (2476/14,833, 16.7%).

    Table 1. Characteristics of the study participants (N=14,916; values are weighted).
    View this table
    Figure 2. Geographical distribution of the study sample (N=14,916). BB: Brandenburg; BE: Berlin; BW: Baden-Wuerttemberg, BY: Bavaria; HB: Bremen; HE: Hesse; HH: Hamburg; MV: Mecklenburg-Western Pomerania; NI: Lower Saxony; NW: North Rhine-Westphalia; RP: Rhineland-Palatinate; SH: Schleswig-Holstein; SL=Saarland; SN: Saxony; ST: Saxony Anhalt; TH: Thuringia.
    View this figure

    In comparison with the whole population of German university students via the GENESIS database, some deviations could be observed. While students from Baden-Wuerttemberg (12.7% vs 4.5%) and North Rhine-Westphalia (27.5% vs 12.4%) were underrepresented in our study, our sample includes significantly more students from Bavaria (14.0% vs 20.4%) and Hesse (9.4% vs 21.7%). The gender distribution was almost balanced, with 51.5% male university students (7687/14,916) and 48.5% female students (7229/14,913). Regarding SSS, more than two-thirds of respondents reported a middle SSS (10,090/14,913, 67.7%), while 17.3% (2575/14,916) reported a low SSS and 15.1% (2247/14,913) reported a high SSS (mean SSS 6.0, SD 1.54).

    Figures 3 to 7 show the different dimensions of digital health literacy and the percentages of student scoring. Within the “information search” subscale, university students indicated that they most frequently had problems finding the information they were looking for (4282/14,098, 30.4%), while the use of suitable words and search queries caused less difficulty (1644/14,101, 11.7%). Regarding the dimension of “adding self-generated content,” respondents reported the most difficulties in expressing their own opinion, in expressing thoughts or feelings in writing (3975/13,754, 28.9%), and in writing a message in a way that is understandable for others (4661/13,752, 33.9%). Across all dimensions, the greatest difficulties could be found in assessing the reliability of health-related information (5964/14,103, 42.3%) and the ability to determine whether the information was written with commercial interest (5489/14,097, 38.9%). The use of the found information for one’s own health-related decisions (eg, regarding protective measures, 2443/14,079, 14.4%) and the application of this information in daily life caused difficulties for approximately one-fifth of the respondents (2812/14,067, 20.0%). Finally, some heterogeneity could also be found in the items relating to the dimension of “protecting privacy.” Although approximately 35% of the respondents experienced difficulties to judge who could read messages posted on the web (4768/13,589, 35.1%), only 6.7% stated that they sometimes or often shared private information on the web (914/13,715).

    Figure 3. Responses to questions in the Digital Health Literacy Instrument subscale “information search” (n=14,098 to n=14,110), %.
    View this figure
    Figure 4. Responses to questions in the Digital Health Literacy Instrument subscale “adding self-generated content” (n=13,721 to n=13,754), %.
    View this figure
    Figure 5. Responses to questions in the Digital Health Literacy Instrument subscale “evaluating reliability” (n=14,081 to n=14,103), %.
    View this figure
    Figure 6. Responses to questions in the Digital Health Literacy Instrument subscale “determining relevance” (n=14,076 to n=14,092), %.
    View this figure
    Figure 7. Responses to questions in the Digital Health Literacy Instrument subscale “protecting privacy” (n=13,589 to n=13,715), %.
    View this figure

    Table 2 and Table 3 show the digital health literacy levels of the respondents, stratified by sociodemographic and geographic characteristics. Concerning gender, significant differences were found, with female university students showing lower digital health literacy across all subscales. However, taking the strength of the association (V) into account, small effect sizes could be identified only for the dimensions “information searching” (male: 2087/7219, 28.9%, female: 2711/6865, 39.5%, χ21=175.37, P<.001, V=0.11) and “evaluating reliability” (male: 2156/5994, 36.0%, female: 2660/5630, 47.2%, χ21=152.16, P<.001, V=0.11). All other differences were below the threshold for small effects and were hence considered trivial. When considering differentiation by age group, in all subscales, a slight tendency of increasing level of digital health literacy with increasing age was observed. However, these significant differences proved to be trivial when calculating effect sizes. The same was observed for study course, SSS, and geographical distribution. Slight differences between the groups were observed; however, the differences remained below the threshold for small effects.

    Table 2. Digital health literacy levels of university students for the subscales of “information search” and “adding self-generated content” according to their sociodemographic and geographic characteristics.
    View this table
    Table 3. Digital health literacy levels of university students for the subscales of “evaluating reliability” and “determining relevance” according to their sociodemographic and geographic characteristics.
    View this table

    Search engines, news portals, and websites of public bodies were most often used by the respondents as sources to search for and find information on COVID-19 and related issues (see Figure 8 and Figure 9). These sources were followed by social media platforms such as Facebook, Instagram, and Twitter, or video portals such as YouTube, with 37.6% of respondents (5302/14,092) stating that they used these media sometimes or frequently. In contrast, health-related blogs or web-based guides were used much less frequently. When stratified by sociodemographic characteristics, relevant differences could only be observed for gender. Female students were found to use social media (t13,921=–19.09, P<.001, d=–0.32) and health portals (t13,463=–14.42, P<.001, d=–0.24) more frequently than male students. In contrast, Wikipedia and other web-based encyclopedias (t14,051=19.19, P<.001, d=0.32), as well as YouTube (t14,054=18.13, P<.001, d=0.30), were more often used by male students. Regarding the topics, respondents stated that they most frequently searched for information on the current spread of SARS-CoV-2 (12,648/14,114, 89.6%) and associated restrictions (12,126/14,114, 85.9%), recommendations and assessments regarding the situation (10,975/14,114, 77.8%), and the symptoms of COVID-19 (10,089/14,114, 71.5%). Although significantly less often, one-fifth of the university students stated that they looked for information on how to cope with psychological stress caused by the COVID-19 situation (2921/14,114, 20.7%). When differentiated by sociodemographic variables, gender differences could be found, as male students searched significantly more often for information on economic and social consequences of the COVID-19 pandemic (male: 4943/7237, 68.3%, female: 3817/6878, 55.5%, χ21=245.62, P<.001, V=.13).

    Figure 8. Internet search queries related to COVID-19 (n=14,111), %.
    View this figure
    Figure 9. Frequency of use of internet sources for web-based health information seeking (n=14,012 to n=14,094), %.
    View this figure

    Finally, digital health literacy was stratified according to web-based information-seeking behavior. No relevant differences could be found for the topics that students searched for. Regarding the sources used for the search and the handling of health-related information, significant and relevant differences emerged for the DHLI subscale “evaluating reliability.” Respondents with sufficient digital health literacy in that dimension reported using the websites of public bodies (eg, Robert Koch Institute) more frequently (t9344=19.44, P<.001, d=0.37). The opposite could be observed for social media (Facebook, Instagram, Twitter) (t10,019=–14.29, P<.001, d=–0.27) and support communities (t9028=–12.06, P<.001, d=–0.23), which were more frequently used by respondents who reported more difficulties in evaluating the reliability of information (see Table 4 and Table 5).

    Table 4. Sources used for COVID-19 information search stratified by digital health literacy level for the “information search” and “adding self-generated content” subscales.
    View this table
    Table 5. Sources used for COVID-19 information search stratified by digital health literacy level for the “evaluating reliability” and “determining relevance” subscales.
    View this table


    To our knowledge, this study is the first to investigate the digital health literacy and information-seeking behaviors in university students during the COVID-19 outbreak in Germany. Nationwide and overall, university students show high levels of digital health literacy. However, one-third of all students (4282/14,098, 30.4%) reported having problems finding the correct information on a particular health-related topic. Also, almost half of all students (5964/14,103, 42.3%) had problems evaluating the reliability of web-based information, which includes difficulties in identifying commercial interests behind the information presented in the news (5489/14,097, 38.9%). Moreover, the greatest challenges were related to assessing the reliability of COVID-19–related information and to judging whether commercial interests were attached to this information. Female students reported more difficulties in searching and evaluating web-based COVID-19–related information than male students.

    Although digital health literacy levels were sufficient in a large proportion of the respondents, the results must be viewed in a more differentiated way. Germany applied a very successful health communication strategy [4] based on easily understandable and easy-to-use health information regarding COVID-19 (eg, washing hands, physical distancing, wearing masks), which was of low complexity compared to other health or disease information [23]. The communication mode was primarily push-based, directing information toward people through all media and communication channels. In comparison, for noncrisis communication, people must supply themselves with information (pull communication) to a greater extent, which requires active searching for information and hence requires strong health literacy. The way in which communication was altered (push vs pull) could explain the lack of differences in digital health literacy levels in relation to socioeconomic status, which are usually found in health literacy studies [22,37]. In addition, our study reports on the state of students’ digital health literacy levels during the early stages of the so-called first wave of the pandemic, at a time when adherence to policies of measures to protect against COVID-19 was high. However, this could change in the current second wave, when people lose trust in official sources and the support for compliance with official recommendations diminishes. Declining support of public measures can already be observed in Germany. Demonstrations against restrictions are taking place, and people are demanding a return to prepandemic conditions and the reopening of the economy, all of which manifests through a refusal to apply the recommended protective measures (eg, no physical distancing, no face masks) [38].

    Data protection and security is also an important issue in the context of digitalization and of the digital transformation of society. Using digital health services and communicating about health topics on the internet and on social media requires particular communication technologies to ensure user safety and user-friendliness. Our findings indicate that one-third of all students (4768/13,589, 35.1%) reported problems judging whether a third party can read their messages posted on the web. Studies on web-based data protection in the German population showed that 72% of respondents doubted the safety of the personal data they shared on the internet [39]. Moreover, 55% even believed that they had no control over what happens to their web-based data [40]. Despite its importance, we were required to exclude the subdimension “protecting privacy” from further bivariate analyses due to low reliability. When introducing the original DHLI, van der Vaart and Drossaert [20] also reported an unsatisfactory Cronbach alpha for this subscale (α=.57). Although this supports the validity of our study findings, it also suggests a need for further refinement (eg, by reformulating the item “…do you find it difficult to judge who can read along?“ to “…do you find it difficult to judge how the security of your private information is secured by the media provider?” to emphasize the role of protective measures taken by the media provider).

    The most preferred sources to look for web-based health- and COVID-19–related information among students included search engines, news portals, and websites of public bodies, followed by social media and video portals. Favorite search topics were the current spread of COVID-19 (12,648/14,114, 89.6%), restrictions (12126/14,114, 85.9%), recommendations and risk assessments (10,975/14,114, 77.8%), and COVID-19 symptoms (10089/14,114, 71.5%). Similarly to earlier studies on population health literacy, which focus on both generic health literacy [22,41] and health literacy in relation to COVID-19 [15,23], making a judgment about the reliability of COVID-19–related information in the media and identifying potential commercial interests represent the most difficult tasks. There is also a significant positive association between having sufficient levels of digital health literacy and accessing more trustworthy and thus more reliable web-based health content. Students with higher levels of digital health literacy in the dimension of “evaluating information reliability” accessed the official websites of public bodies and agencies more often and turned less often to sources such as support communities, including forums, and social media compared to students with lower competencies in this dimension. While the ability to seek information and to produce and provide information did not show any significant differences across digital health literacy levels, students with higher abilities to determine the personal relevance of the information they obtained show similar patterns to those shown for the subscale “evaluating reliability.”

    Interestingly, only one-fifth of students (2921/14,114, 20.7%) reported having searched for information related to psychological stress and the consequences of the COVID-19 pandemic on mental health. This finding is surprising, as other studies show that the COVID-19 pandemic has enormous effects on mental health [42,43], and an infodemic can trigger an epidemic of fear and anxiety [28]. On the other hand, it should be emphasized that this survey was conducted at the beginning of the first wave of the pandemic and that psychological problems became more important as the pandemic progressed. Therefore, reliable and trustworthy (mental) health information is key in this situation for citizens to act upon information and knowledge provided by governments, health authorities, and scientists, and thereby to help slow the spread of COVID-19 [14,16,44-47]. In this context, infodemiology becomes important to better understand communication patterns, information routes and content, and how they affect behaviors, attitudes, and health status [28]. Citizen behavior, however, must be facilitated by adequate government actions and policies that provide not only health information but also health, social, and economic services for citizens to cope with the situation [14]. The impact of the ongoing COVID-19 infodemic places an additional burden on web-based health information seekers. This threat amplifies the negative effects of low digital health literacy. In their representative survey of COVID-19–related health literacy during the pandemic, Okan and colleagues [23] found that 56% of the German population felt confused about the vast amount of information regarding COVID-19. Women, younger age groups, and families with children younger than 18 years in their household are significantly more affected. At the same time, people with lower income and who reside in federal states of the former East Germany were found to feel less informed than their counterparts. This ongoing study highlights that the infodemic must be acknowledged “as a meta-risk in its own right” that aggravates the current situation [23]. Therefore, this infodemic requires particular attention during the COVID-19 emergency, which includes public policy strategies aiming to address the toxic spread of misinformation and disinformation about SARS-CoV-2 and COVID-19 [14,15,23]. Moreover, producers, providers, and suppliers of health information must ensure that information is evidence-based and adheres to health literacy principles, including barrier-free and easy access, user-friendliness and ease of understanding, cultural appropriateness, and relevance for everyday public use [21,23]. Social media platforms should also counteract the spread of misinformation and disinformation about COVID-19. The fight against misinformation and disinformation should become an important issue in public policy [17,18]. As proposed by Gunter Eysenbach, the four pillars to fight an infodemic include (1) infoveillance (the monitoring of information), (2) strengthening health literacy and digital health literacy in the population, (3) applying constant knowledge refinement (eg, fact checking), and (4) adequate knowledge transfer and minimizing political and commercial influence on health information [45]. This is supported by the World Health Organization within their infodemic management framework, which suggests six policy recommendations to manage infodemics during an emergency such as the COVID-19 pandemic [46]. These recommendations include (1) basing interventions and messages on the latest evidence, (2) applying knowledge transfer and making health information easy to understand, (3) collaborating with communities to better understand their information needs, (4) analyzing information impact and cooperating with social media platforms, information suppliers, and civil society, (5) informing these actions by reliable information and adapt action based on the respective and latest narratives, and (6) further improving infodemic management by all means necessary and also through interdisciplinary research collaboration [46]. Skills to navigate digital information environments were already crucial before the COVID-19 pandemic to mitigate the effects of digital inequalities [47,48]. These skills have become even more essential during the pandemic, as the importance and use of communication technologies and media have changed massively since the outbreak of COVID-19 [14,16,45,48,49].

    The most important finding of the stratified analyses is that among students with limited digital health literacy, female students reported having more problems finding the correct information and evaluating the reliability of COVID-19–related information. In Germany, women often have more care responsibilities and are generally more engaged with health issues than men [23], and they are also more active in searching the internet for health information [49,50]. This may lead them to be more critical vis-à-vis health information on COVID-19, as they have a more sensible awareness that not all information is reliable. In addition to this, a recent study showed that women are much more worried about the sheer amount of COVID-19–related information on the internet [23]. They were more concerned when they had children ≤18 years of age. Many young women are faced with difficulties and challenges when they search for and evaluate health information, especially because there is so much conflicting information on COVID-19 available on the web.

    To sum up, the findings from this study raise concern and have important implications for public health. First, problems related to access to accurate and situation-specific information in the context of a public health emergency may lead to the use of invalid information, which is unhelpful or even detrimental to the causes of slowing infection rates and sustaining a successful infectious disease strategy. Second, when students access disinformation or false information and they have difficulty making judgments about the correctness of the information, they will most likely not identify that information for what it is (eg, “fake news,” commercial messaging). In turn, using the wrong information can again cause harm and impede engagement in effective health behaviors. Third, feeling safe in the digital world, especially when seeking health-related information and interacting with others about health concerns, is a critical issue. Many students expressed uncertainties regarding the safety of personal information shared on the web. These findings suggest the need to implement health education measures to strengthen students’ health literacy capacities. In addition, there is a need for more accurate public health information platforms to provide timely and evidence-based information with a view to inform individual behavior and system-level responses. Studies on health literacy in Germany conducted in 2011 [37], 2013 [41,50], and 2014 [22,41] have shown that half of the adult population, including both younger and older adults, have limited health literacy. In response, health literacy policy initiatives were launched, such as the science and civil society–led German National Action Plan on Health Literacy [51] and the Alliance for Health Literacy [52], which is led by the federal Ministry of Health. These initiatives focus on strengthening population health literacy, starting in early childhood and at school, to enable children to grow into health-literate adults. However, little progress has been made since then, and a health education curriculum that addresses health literacy is still lacking in Germany. Furthermore, people with lower education in Germany have more often lower levels of health literacy [22,37]. If students, who belong to a population group with higher education, already have difficulties with their digital health literacy, it can be assumed that people with less education are also vulnerable to having lower levels of health literacy and associated information tasks, such as finding, understanding, and evaluating COVID-19–related information on the web.

    Our study has several limitations. The sample, although weighted, is not representative of all university students in Germany. We may have missed many students who use the internet less frequently and those who may have been troubled due to university closures and associated changes to their lives. The implications may not be transferable to other populations and age groups in Germany. Additionally, students in Germany are privileged in terms of educational achievement and therefore in terms of socioeconomic status compared to people seeking a tertiary education with non–degree level requirements. This survey was conducted in the early days of the first wave of the pandemic, when adherence was high; this could explain the finding that students perceived information tasks to be easy to undertake and therefore reported high levels of digital health literacy. This may not be the case in a second phase, after enduring lengthy restrictions on everyday and university life activities and rapidly emerging conflicting information on COVID-19, all of which could make judgment much more difficult. Due to the effects of the COVID-19 pandemic on physical contact and face-to-face meeting, we had to use a web-based survey in adherence to German COVID-19 policies, whereas the developers of the original questionnaire, van der Vaart and Drossaert [20], highlighted that the application of a web-based questionnaire may exclude people with weak digital competencies. Therefore, a potential bias in our sample is that it may have excluded students who use the internet to a lesser extent or those with lower digital competencies. Nevertheless, due to web-based activities related to their studies (eg, access to e-learning and university communication platforms) and given that most German universities provide their services via web-based systems, students in Germany in general represent a proportion of the population who have more intersections with the digital world, inevitably use the internet more often, and have a higher affinity to using web-based media content.

    Our findings show that overall, the level of digital health literacy in relation to dealing with web-based COVID-19–related information was high. However, a significant proportion of university students still face difficulties with certain abilities to deal with information, such as finding the right information and evaluating its reliability. There is a need to strengthen the digital health literacy capacities of university students, particularly female students, using tailored interventions. Actions must also include the design of interventions to increase the quality of health information on the internet, to implement fact-checking strategies in web-based and social media, and to increase the health literacy of people who produce, supply, and provide health information and services on the web. For example, universities can provide courses on digital health literacy and health information to their staff and students and can also disseminate reliable news on COVID-19 through their web-based channels. Raising awareness among universities and education administrators might aid the emergency response, and it could also increase the health literacy responsiveness of organizations and students. The benefit of the COVID-HL survey is that it provides first-time knowledge that could help decision-makers develop policies and programs that foster healthy and protective behaviors, plan for preventive measures, and promote adherence to COVID-19 policies, on the basis of students’ needs in terms of digital health literacy. Digital health literacy will empower university students and all other population groups to take greater control in the prevention and spread of COVID-19, which in turn is likely to lead to better health outcomes.

    Authors' Contributions

    KD and OO contributed equally and prepared the first draft of the manuscript. MM, AYML, RR, ED, and KR provided feedback on the first draft. KD, OO, and KR designed and conducted the survey. MM, AYML, RR, ED, and KR helped with the analyses and contributed to data interpretation. All authors contributed to writing and revising the manuscript and approved the final version for submission.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Overview of scales and items.

    DOCX File , 97 KB


    1. Lu R, Zhao X, Li J, Niu P, Yang B, Wu H, et al. Genomic characterisation and epidemiology of 2019 novel coronavirus: implications for virus origins and receptor binding. Lancet 2020 Feb 22;395(10224):565-574 [FREE Full text] [CrossRef] [Medline]
    2. World Health Organization. Novel Coronavirus (2019-nCoV) - Situation Report 13. 2020 Feb 02.   URL: https:/​/www.​​docs/​default-source/​coronaviruse/​situation-reports/​20200202-sitrep-13-ncov-v3.​pdf [accessed 2020-09-05]
    3. European Centre for Disease Prevention and Control. ECDC Communicable Disease Threats Report (CDTR).   URL: https:/​/www.​​sites/​default/​files/​documents/​Communicable-disease-threats-report-21-mar-2020-PUBLIC.​pdf [accessed 2020-09-05]
    4. Wieler L, Gottschalk R. Emerging COVID-19 success story: Germany?s strong enabling environment. Our World in Data. 2020 Jun 30.   URL: [accessed 2020-09-05]
    5. Robert Koch Institut. Ergänzung zum Nationalen Pandemieplan – COVID-19 – neuartige Coronaviruserkrankung. 2020 Mar 04.   URL: [accessed 2020-09-05]
    6. Bundesministerium für Gensundheit. Zusammen gegen Corona. Aktuelle Informationen zum neuartigen Coronavirus/Covid-19 Together against corona.   URL: [accessed 2020-09-05]
    7. Bundesministerium für Gesundheit. Coronavirus in Deutschland.   URL: [accessed 2020-09-05]
    8. Bundeszentrale für gesundheitliche Aufklärung. Informationen zum neuartigen Coronavirus / COVID-19 Information about the novel coronavirus/COVID-19, webpage on German.   URL: [accessed 2020-09-05]
    9. Robert Koch-Institut. COVID-19 (Coronavirus SARS-CoV-2). Webpage in German.   URL: [accessed 2020-09-05]
    10. Corona – verlässliche Informationen zu COVID 19.   URL: [accessed 2020-09-05]
    11. Zweites Deutsches Fernsehen. Coronavirus: Alles zu Covid-19.   URL: [accessed 2020-09-05]
    12. Norddeutscher Rundfunk. Coronavirus-Update mit Christian Drosten.   URL: [accessed 2020-09-05]
    13. Corona-Krise. Das Erste.   URL: [accessed 2020-09-05]
    14. Paakkari L, Okan O. COVID-19: health literacy is an underestimated problem. Lancet Public Health 2020 May;5(5):e249-e250 [FREE Full text] [CrossRef] [Medline]
    15. Okan O, de Sombre S, Hurrelmann K, Berens EM, Bauer U, Schaeffer D. Covid-19-Gesundheitskompetenz der Bevölkerung COVID-19 based health literacy in the German population. Monitor Versorgungsforschung 2020 Mar;13:40-45 [FREE Full text]
    16. Okan O, Sørensen K, Messer M. COVID-19: A guide to good practice on keeping people well informed. The Conversation. 2020 Mar 19.   URL: [accessed 2020-09-05]
    17. Hua J, Shaw R. Corona Virus (COVID-19) "Infodemic" and Emerging Issues through a Data Lens: The Case of China. Int J Environ Res Public Health 2020 Mar 30;17(7):2309 [FREE Full text] [CrossRef] [Medline]
    18. Zarocostas J. How to fight an infodemic. Lancet 2020 Feb 29;395(10225):676 [FREE Full text] [CrossRef] [Medline]
    19. Sørensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, (HLS-EU) Consortium Health Literacy Project European. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health 2012 Jan 25;12:80 [FREE Full text] [CrossRef] [Medline]
    20. van der Vaart R, Drossaert C. Development of the Digital Health Literacy Instrument: Measuring a Broad Spectrum of Health 1.0 and Health 2.0 Skills. J Med Internet Res 2017 Jan 24;19(1):e27 [FREE Full text] [CrossRef] [Medline]
    21. Sørensen K. Covid-19: Digital health literacy is a key to saving time, costs and lives. ICT & health. 2020 Mar 30.   URL: https:/​/www.​​news/​covid-19-digital-health-literacy-is-a-key-to-saving-time-costs-and-lives [accessed 2020-09-05]
    22. Schaeffer D, Berens E, Vogt D. Health Literacy in the German Population. Dtsch Arztebl Int 2017 Jan 27;114(4):53-60 [FREE Full text] [CrossRef] [Medline]
    23. Okan O, Bollweg TM, Berens E, Hurrelmann K, Bauer U, Schaeffer D. Coronavirus-Related Health Literacy: A Cross-Sectional Study in Adults during the COVID-19 Infodemic in Germany. Int J Environ Res Public Health 2020 Jul 30;17(15):5503 [FREE Full text] [CrossRef] [Medline]
    24. Van den Broucke S. Why health promotion matters to the COVID-19 pandemic, and vice versa. Health Promot Int 2020 Apr 01;35(2):181-186 [FREE Full text] [CrossRef] [Medline]
    25. Horgan Á, Sweeney J. University students' online habits and their use of the Internet for health information. Comput Inform Nurs 2012 Aug;30(8):402-408. [CrossRef] [Medline]
    26. Dadaczynski K, Okan O, Messer M, Rathmann K. Digitale Gesundheitskompetenz von Studierenden in Deutschland während der Corona-Pandemie. Ergebnisse einer bundesweiten Online-Befragung. Hochschule Fulda. 2020 Aug 14.   URL: [accessed 2020-09-05]
    27. Nguyen HT, Do BN, Pham KM, Kim GB, Dam HTB, Nguyen TT, et al. Fear of COVID-19 Scale-Associations of Its Scores with Health Literacy and Health-Related Behaviors among Medical Students. Int J Environ Res Public Health 2020 Jun 11;17(11):4164 [FREE Full text] [CrossRef] [Medline]
    28. Eysenbach G. Infodemiology and infoveillance tracking online health information and cyberbehavior for public health. Am J Prev Med 2011 May;40(5 Suppl 2):S154-S158. [CrossRef] [Medline]
    29. Statistische Daten zu Studienangeboten an Hochschulen in Deutschland. Studiengänge, Studierende, Absolventinnen und Absolventen. Wintersemester 2019. In: Hochschulrektorenkonferenz. Berlin, Germany: HRK; 2019.
    30. Robert Koch-Institut: COVID-19-Dashboard. Webpage in German. Robert Koch-Institut.   URL: [accessed 2020-09-05]
    31. EFS Survey, Version EFS Winter 2018. Questback GmbH. Cologne: Questback GmbH; 2019.   URL: [accessed 2021-01-09]
    32. Hoebel J, Müters S, Kuntz B, Lange C, Lampert T. Measuring subjective social status in health research with a German version of the MacArthur Scale. Article in German. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2015 Jul;58(7):749-757. [CrossRef] [Medline]
    33. Schricker J, Rathmann K, Dadaczynski K. Soziale Unterschiede in der Gesundheitskompetenz von Studierenden: Ergebnisse einer Online-Studie an der Technischen Universität Dortmund. Präv Gesundheitsf 2019 Jul 31;15(1):8-14. [CrossRef]
    34. Marstedt G. Das Internet: Auch Ihr Ratgeber für Gesundheitsfragen? Bevölkerungsumfrage zur Suche von Gesundheitsinformationen im Internet und zur Reaktion der Ärzte. Gütersloh, Germany: Bertelsmann Stiftung; 2018.
    35. Die Datenbank des Statistischen Bundesamtes. Federal Statistical Office of Germany.   URL: [accessed 2021-01-07]
    36. Cohen J. Statistical Power Analysis for the Behavioral Sciences. Hoboken, NJ: Taylor and Francis; 2013.
    37. Sørensen K, Pelikan JM, Röthlin F, Ganahl K, Slonska Z, Doyle G, HLS-EU Consortium. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Public Health 2015 Dec;25(6):1053-1058 [FREE Full text] [CrossRef] [Medline]
    38. Sueddeutsche Z. Berlin: 20.000 Menschen demonstrieren gegen Corona-Auflagen. Süddeutsche Zeitung. 2020 Aug 01.   URL: https:/​/www.​​politik/​demonstrationen-berlin-20-000-menschen-demonstrieren- gegen-corona-auflagen-dpa.​urn-newsml-dpa-com-20090101-200801-99-04333 [accessed 2020-09-05]
    39. Nagler K, Schröder D, Schilling A, Weber T. DsiN-Sicherheitsindex 2020. Studie von Deutschland sicher im Netz. 2020.   URL: [accessed 2020-09-05]
    40. Studie zu Datenschutz: Mehrheit der Deutschen zweifelt an Datensicherheit. Sinus Institut.   URL: https:/​/www.​​veroeffentlichungen/​meldungen/​detail/​news/​studie-zu-datenschutz-mehrheit-der-deutschen-zweifelt-an-datensicherheit/​news-a/​show/​news-c/​NewsItem [accessed 2020-09-05]
    41. Berens E, Vogt D, Messer M, Hurrelmann K, Schaeffer D. Health literacy among different age groups in Germany: results of a cross-sectional survey. BMC Public Health 2016 Nov 09;16(1):1151 [FREE Full text] [CrossRef] [Medline]
    42. Ahorsu DK, Lin C, Imani V, Saffari M, Griffiths MD, Pakpour AH. The Fear of COVID-19 Scale: Development and Initial Validation. Int J Ment Health Addict 2020 Mar 27:1-9 [FREE Full text] [CrossRef] [Medline]
    43. Satici B, Gocet-Tekin E, Deniz ME, Satici SA. Adaptation of the Fear of COVID-19 Scale: Its Association with Psychological Distress and Life Satisfaction in Turkey. Int J Ment Health Addict 2020 May 08:1-9 [FREE Full text] [CrossRef] [Medline]
    44. Sentell T, Vamos S, Okan O. Interdisciplinary Perspectives on Health Literacy Research Around the World: More Important Than Ever in a Time of COVID-19. Int J Environ Res Public Health 2020 Apr 26;17(9):3010 [FREE Full text] [CrossRef] [Medline]
    45. Eysenbach G. How to Fight an Infodemic: The Four Pillars of Infodemic Management. J Med Internet Res 2020 Jun 29;22(6):e21820 [FREE Full text] [CrossRef] [Medline]
    46. Tangcharoensathien V, Calleja N, Nguyen T, Purnat T, D'Agostino M, Garcia-Saiso S, et al. Framework for Managing the COVID-19 Infodemic: Methods and Results of an Online, Crowdsourced WHO Technical Consultation. J Med Internet Res 2020 Jun 26;22(6):e19659 [FREE Full text] [CrossRef] [Medline]
    47. Beaunoyer E, Dupéré S, Guitton MJ. COVID-19 and digital inequalities: Reciprocal impacts and mitigation strategies. Comput Human Behav 2020 Oct;111:106424 [FREE Full text] [CrossRef] [Medline]
    48. Guitton MJ. Cyberpsychology research and COVID-19. Comput Human Behav 2020 Oct;111:106357 [FREE Full text] [CrossRef] [Medline]
    49. Bidmon S, Terlutter R. Gender Differences in Searching for Health Information on the Internet and the Virtual Patient-Physician Relationship in Germany: Exploratory Results on How Men and Women Differ and Why. J Med Internet Res 2015 Jun 22;17(6):e156 [FREE Full text] [CrossRef] [Medline]
    50. Jordan S, Hoebel J. [Health literacy of adults in Germany: Findings from the German Health Update (GEDA) study]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2015 Sep;58(9):942-950. [CrossRef] [Medline]
    51. Schaeffer D, Hurrelmann K, Bauer U, Kolpatzik K. National Action Plan Health Literacy. Promoting Health Literacy in Germany. Berlin, Germany: KomPart; 2018.   URL: https:/​/www.​​app/​download/​7775450763/​National%20Action%20Plan%20Health%20Literacy.​pdf?t=1607442028 [accessed 2021-01-08]
    52. Bundesministerium für Gesundheit. Allianz für Gesundheitskompetenz.   URL: https:/​/www.​​fileadmin/​Dateien/​3_Downloads/​E/​Erklaerungen/​Allianz_fuer_Gesundheitskompetenz_Abschlusserklaerung.​pdf [accessed 2020-09-05]


    DHLI: Digital Health Literacy Instrument
    SSS: subjective social status

    Edited by G Eysenbach; submitted 05.09.20; peer-reviewed by E Sakellari, S Bidmon; comments to author 13.10.20; revised version received 30.10.20; accepted 08.12.20; published 15.01.21

    ©Kevin Dadaczynski, Orkan Okan, Melanie Messer, Angela Y M Leung, Rafaela Rosário, Emily Darlington, Katharina Rathmann. Originally published in the Journal of Medical Internet Research (, 15.01.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.