Published on 28.06.07 in Vol 9, No 2 (2007)
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/625, first published Dec 01, 2006.
Language Preferences on Websites and in Google Searches for Human Health and Food Information
Background: While it is known that the majority of pages on the World Wide Web are in English, little is known about the preferred language of users searching for health information online.
Objectives: (1) To help global and domestic publishers, for example health and food agencies, to determine the need for translation of online information from English into local languages. (2) To help these agencies determine which language(s) they should select when publishing information online in target nations and for target subpopulations within nations.
Methods: To estimate the percentage of Web publishers that translate their health and food websites, we measured the frequency at which domain names retrieved by Google overlap for language translations of the same health-related search term. To quantify language choice of searchers from different countries, Google provided estimates of the rate at which its search engine was queried in six languages relative to English for the terms “avian flu,” “tuberculosis,” “schizophrenia,” and “maize” (corn) from January 2004 to April 2006. The estimate was based on a 20% sample of all Google queries from 227 nations.
Results: We estimate that 80%-90% of health- and food-related institutions do not translate their websites into multiple languages, even when the information concerns pandemic disease such as avian influenza. Although Internet users are often well-educated, there was a strong preference for searching for health and food information in the local language, rather than English. For “avian flu,” we found that only 1% of searches in non-English-speaking nations were in English, whereas for “tuberculosis” or “schizophrenia,” about 4%-40% of searches in non-English countries employed English. A subset of searches for health information presumably originating from immigrants occurred in their native tongue, not the language of the adopted country. However, Spanish-language online searches for “avian flu,” “schizophrenia,” and “maize/corn” in the United States occurred at only <1% of the English search rate, although the US online Hispanic population constitutes 12% of the total US online population. Sub-Saharan Africa and Bangladesh searches for health information occurred in unexpected languages, perhaps reflecting the presence of aid workers and the global migration of Internet users, respectively. In Latin America, indigenous-language search terms were often used rather than Spanish.
Conclusions: (1) Based on the strong preference for searching the Internet for health information in the local language, indigenous language, or immigrant language of origin, global and domestic health and food agencies should continue their efforts to translate their institutional websites into more languages. (2) We have provided linguistic online search pattern data to help health and food agencies better select languages for targeted website publishing.
J Med Internet Res 2007;9(2):e18
- food security;
- avian flu;
The World Wide Web has more than 15 billion pages  and has become an important source of health-related information [ - ]. In the United States, for example, it has been reported that 82% of female users and 77% of male users used the Internet to obtain medical information on a routine basis [ ]. Google searches have even been shown to assist physicians in the correct diagnosis of medical ailments [ ]. However, two thirds of the pages on the Web are published in English [ , ], even though the world has over 5 billion non-English speakers [ ], including approximately 700 million non-English-speaking Internet users [ ]. In fact, the vast majority of the world’s 6900 living linguistic groups [ ] have little Web content available in their language [ , ]. Adding to this problem, search engines such as Google do not translate search terms into other languages [ ]—perhaps a surprise to many users. To overcome linguistic barriers, the World Health Organization (WHO) and the Food and Agricultural Organization (FAO) now publish their websites in six and four major languages, respectively. However, other globally authoritative organizations, such as the Centers for Disease Control (CDC) in the United States, primarily publish online information in only one or two languages of domestic importance.
In spite of the significant challenges created by linguistic differences in effectively communicating health information to the world’s peoples online, we could find little quantitative data on this issue. Do the world’s online users, presumably wealthier and more educated than the general population, primarily search online for health information in their local language, or do they employ Web-prevalent languages such as English? Are current online translation efforts by the world’s health and food agencies beneficial, and should these agencies be spending more resources on these efforts? In a world of human migration, which language(s) should domestic governments and international agencies use in order to communicate online health information to target populations? To transmit information to front-line health professionals in developing nations, a group that can include international aid workers from wealthy nations, which language(s) should be employed to target a particular nation? Do indigenous peoples search for online health-related information using search terms belonging to their own language or the colonial language? Real-time, accurate communication of health information might be especially critical during a pandemic infectious disease outbreak or famine. To begin to answer these questions, we have used a case-study approach that examines linguistic preferences in Internet search engine queries.
Specifically, we measured search patterns on Google for four health- and food-related terms in seven languages in 227 nations. The four search terms we chose for our study were “avian flu,” “tuberculosis,” “schizophrenia,” and “maize” (corn). We chose “avian flu” because it is an ideal model for searching for online information concerning an emerging infectious disease pandemic; as of August 2006, avian influenza (virus subtype H5N1) had killed 141 people in 10 countries [, ] in addition to prompting the slaughter of millions of animals [ ]. We chose “tuberculosis” because it is a good model for searching an established global infectious disease, as it is a major cause of death for HIV-positive patients [ ] and currently afflicts about 15 million people in 207 nations [ ]. We chose “schizophrenia” because psychiatric and neurological diseases affect more than 450 million people globally [ , ] and because online mental health information has the potential to help nations that have few mental health specialists [ ]. Schizophrenia afflicts over 24 million people worldwide [ ]. Finally, because there are currently around 850 million chronically undernourished people in the world [ ], under frequent threat of famine, and because malnutrition is a major underlying contributor to infectious disease susceptibility [ ], we chose “maize” (corn) because it is an important search term for global food security agencies. Maize supplies one third of all human calories in Latin America and Sub-Saharan Africa [ ] and, combined with its genetic relatives rice and wheat, supplies approximately 50% of all human calories globally, either directly or via animal feed [ ].
In this paper, we quantitatively demonstrate the need for health and food website translation that not only targets the world’s major languages, but also linguistic minorities within nations, including immigrants, foreign aid workers, and indigenous groups.
Measuring the Extent to Which Health and Food Agencies Translate Websites
When an online publisher translates its Web site across languages, the same source domain name can be found in the different result lists of a search engine when entering different translated search terms. In an URL, the domain name is the identifier before the first slash (eg, for the WHO, the domain name is www.who.int). Therefore, to estimate the percentage of institutions, news agencies, and other sources that translate their health and food websites, we measured the frequency that domain names overlap (institutional sources overlap) in different results lists when Google is queried using different language translations of the same search term (eg, English “tuberculosis” versus Bahasa Indonesia “tuberkulosa”). The language translations used in this study are shown in. We first extracted URLs from Google.com listed as “the most relevant” (about 500-1000 URLs) based on the Google page rank algorithm [ ] on July 10, 2006. We then excluded nonunique domain names from within each query group; the remaining unique subset was then compared to the URLs retrieved using the comparison language.
Measurements of Online Search Rates and Language Choice
For each of the four terms and their translations, we measured the rate at which users from 227 different countries searched Google (). The country of origin for each search was identified using the geographic locations of Internet Protocol (IP) addresses. The search rates were based on proprietary Google Inc. (Mountain View, CA) data using an algorithm that measured 20% of all first-page Web search queries from January 2004 to April 2006.
The search rate, M, for a term, T, originating from a specific country was then estimated from this large sample: the algorithm calculated the ratio of searches using a specific term (T) divided by all searches (A) from that nation during the time period, such that M = T/A.contains the standard error (SE) for each search rate. To calculate the standard error, a normal distribution for the statistic was assumed. To convert standard error to the 95% confidence interval of the estimate, the following formula was used: 95% CI = M ± (1.96 × SE). Only the search rates for selected languages are shown for each nation, not the total search rate across languages or the total number of searches, which are proprietary.
For ease of database searching and validation, we chose languages that share a Latin-based script similar to English. For detailed analysis, the languages chosen were English, Bahasa Indonesia, Spanish, Portuguese, German, and French, as they represent the primary or secondary language of about 100-500 million people worldwide and/or are significant post-colonial languages . Because Turkey has reported cases of avian influenza [ , ], Turkish was added as a language of interest. A search term may be common to multiple languages, not all of which are noted here. contains a complete list of the language translations used to retrieve search rate data from the Google database.
Health and Food Security Indicators
For the number of human avian influenza cases (subtype H5N1), we employed the WHO Epidemic and Pandemic Alert and Response Database , updated on August 9, 2006. For the number of poultry outbreaks of type H5 since 2003, we used the August 16, 2006 Avian Flu Update from the Organisation Mondiale de la Santé Animale (OiE) [World Organisation for Animal Health] [ ]. For tuberculosis (TB), we used Millennium Development Goal (MDG) Indicator 23, the estimated TB prevalence in 2004 from the Global Tuberculosis Database of the WHO Global Health Atlas [ ]. The number of psychiatrists per 100000 people in 2005 was obtained from Project Atlas: Resources for Mental Health and Neurological Disorders, from the WHO Global Health Atlas Database [ ]. The most recent maize consumption data (kcal/person/day in 2004) was from the Supply Utilization Accounts (SUA) Database of the Food and Agricultural Organization Statistical Division (FAOSTAT) [ ].
Measuring the Extent to Which Institutions Currently Translate Online Information
We measured the extent to which the world’s institutions, including health and food agencies, news organizations, and other sources, currently publish Web content in multiple languages. To quantify this, we measured the institutional source (host-domain) overlap between search results (first 500-1000 URLs) retrieved using English-language queries versus select comparison languages (). For example, as shown in , “avian flu” resulted in 906 hits, which included 539 unique hosts. The same search in French resulted in 801 hits, which included 375 hosts. Only 7.1% of the 539 hosts found in the English search were also found in the French search, while 10.1% of the 375 hosts found with the French search were also found in the English search. This means that approximately 7.1%-10.1% of all hosts have an English/French translation.
For “avian flu,” which has afflicted 56 people in Indonesia , only 6.8% and 2.4% of institutional domain names overlapped between Bahasa Indonesia searches and English-language searches, respectively ( ). For “tuberculosis,” we discovered only about 9% overlap in the institutional domain names retrieved for English and French/Portuguese translations: French and Portuguese are widely spoken by TB-afflicted nations in Africa and Brazil [ ]. The host domain overlap was typically less than 10% between European languages; we were surprised by this low rate given the presence of common governmental institutions in Europe (eg, European Union). We extrapolate that 80%-90% of health- and food-related institutions do not translate their websites into multiple languages, even when the information concerns pandemic disease. This does not exclude the possibility that other agencies, such as domestic health agencies, might be translating this information.
We then specifically screened for Web pages belonging to the WHO and the CDC, both authoritative agencies for infectious disease information. Because the first page of search results is the most viewed , the rank order in which search results appear is critical. When we searched for “avian flu” in English on Google.com, the CDC website was the first hit, followed second by the WHO website. In the French translation, however, no CDC-affiliated Web pages appeared in the first 100 hits. When we searched Google Indonesia using the Bahasa Indonesia translation of “avian flu,” a WHO-affiliated Web page did not appear until page three of the search results (rank 21), and the first CDC-affiliated page appeared on page six (rank 63). Most significant, by searching for “avian flu” in Turkish using Google Turkey, we were unable to retrieve the websites of either the WHO or CDC in the first 500 search results.
As a cautionary note, we found that a single accent or special character in the search term sometimes changed the rank order of health search results significantly, consistent with more detailed analysis conducted for nonmedical terms [, ]: for example, for avian flu, we found that “gripe aviária” (accent, Portuguese) yielded 49/100 top search results of Brazilian origin (ie, “br” in domain name), whereas “gripe aviaria” (no accent, Portuguese) yielded 40/100 top search results from Spanish-speaking nations and only 4/100 search results from Brazil. This is significant, because we found that Brazil, Portugal, and other Portuguese-speaking nations (Angola, Mozambique) searched Google for this term with and without the accent at nearly equal rates ( ).
|English Language Search||Comparative Language Search|
|Host Overlap with|
|Host Overlap with|
Malay (Bahasa Malayu)
Language-Specific Searching of Infectious Disease Information
Though we did not retrieve many WHO- and CDC-affiliated Web pages when we searched across different languages, one possibility is that Internet users, many of whom are well-educated, are supplementing their Google searches for online health information by searching in English. If true, then there would be less of a need for the WHO and other global agencies to translate online information into diverse languages.
In our case study, we found the actual results to be variable (; ): for “avian flu,” we often found that only 1% of searches in non-English-speaking nations were in English, whereas for “tuberculosis” or “schizophrenia,” about 4%-40% of searches in non-English countries employed English. Brazil, which had an estimated 141000 cases of TB in 2004 [ ], had an 18-fold higher query rate for “tuberculose” (Portuguese) than “tuberculosis” (English). However, the comparison is more important for languages that have much less Web content, such as Bahasa Indonesia and Turkish. Indonesia, which had the highest number of reported cases of human H5N1 viral infections in 2006 [ ], had a 15-fold higher query rate for “avian flu” in Bahasa Indonesia (“flu burung”) than in English. We found that Turks used Turkish to search Google for health terms at 3- to over 1000-fold higher rates than English, French, German, or Spanish ( ; ). We did, however, find sites in Turkish that had translated information from the WHO. Whether or not the WHO, CDC, and FAO wish to leave it up to others to translate their information accurately and rapidly must be decided based on their confidence level of the eHealth capabilities of each target nation. Given the Google language-based search patterns, we conclude that during times of infectious disease outbreaks, though English may be useful, global agency–affiliated Web pages translated into local languages would likely be highly accessed and would have the benefits of being viewed as authoritative and accurate and of being transmitted in real time.
Language of Online Mental Health Information Searches
In terms of mental health, many developing nations have 10- to 100-fold fewer psychiatrists per capita than many developed nations  ( ). For this reason, global accessibility of online mental health information has the potential to be very beneficial to physicians and families of patients in developing nations [ ]. Given ethnic taboos [ ], we first asked whether or not Internet users from developing nations are searching online for mental health information—potentially useful information for global mental health experts. Indeed, we found that the search rate for “schizophrenia” was similar between developed and developing nations in the local language, demonstrating an active need for online mental health information in poor countries. We have made the full mental health dataset available ( ). Given that Google estimates 3-fold more search results concerning schizophrenia in English versus the next 10 languages combined (data not shown), we asked whether middle- and low-income nations searched for this topic in English. We found that people from Brazil, a nation of about 180 million people, searched for “schizophrenia” in Portuguese at a 28-fold higher rate than in English ( ).
|Search Term||Country||Public Health Comparison Metric||Local Language||English Searches (% of Local Language Searches)|
|Avian flu||Human Cases† (Poultry Outbreaks)‡|
|United States||0 (0)||English||100.0|
|Democratic Republic of Congo||0 (0)||French||1.1|
|Cote d’Ivoire||0 (3)||French||1.4|
|Burkina Faso||0 (4)||French||100.0|
|Indonesia||56 (211)||Bahasa Indonesia||6.5|
|Democratic Republic of Congo||307554||French||23.6|
|Schizophrenia||Psychiatrists per 100000|| People|
|Democratic Republic of Congo||0.04||French||43.0|
*Based on sampling 20% of all searches on Google.com from January 2004 to April 2006.
†Subtype H5N1, from the WHO Epidemic and Pandemic Alert and Response Database , updated August 9, 2006.
‡Type H5 outbreaks since 2003, from the OiE , updated August 16, 2006.
§Estimated TB prevalence in 2004 from the WHO Global Tuberculosis Database .
||2005 data from Project Atlas: Resources for Mental Health and Neurological Disorders, from the WHO Global Health Atlas Database .
In contrast, people from Indonesia, a nation of 220 million people, searched for “schizophrenia” at similar rates in Bahasa Indonesia as in English. As with infectious disease searching, our data would suggest that users from most nations tend to search Google for “schizophrenia” in their official language at up to 10-fold higher rates than other languages (). Many of the world’s people might therefore benefit if the world’s most authoritative mental health agencies (eg, US National Institute of Mental Health) translated information into other languages, even though this is not part of their domestic mandate.
The Online Search Rates of Immigrant Minorities
In some developed nations, there is concern that immigrant groups might spread infectious diseases. In Europe, the TB prevalence is 43/100000 people in Turkey but lower in wealthier nations such as Germany (6/100000); in Asia, the TB prevalence is 273/100000 people in Indonesia, compared to 48/100000 in Singapore  ( ). Unlike many of their neighbors, both Turkey and Indonesia have reported human cases of avian influenza [ ]. Governments may be interested to know whether their immigrant communities consult infectious disease–related websites originating from their adopted country or their native country. As a case study, we examined the search rates of Turks and Indonesians after they migrated to other nations in Europe or Asia, respectively, as determined by searches in Turkish and Bahasa Indonesia originating outside Turkey and Indonesia. The Turkish and Indonesian languages are distinct relative to many of their surrounding nations, permitting us to discern the search behavior of these populations after they have emigrated, provided they search in their native language. As shown in , we detected searches in Turkish for “avian flu” and “tuberculosis” throughout Europe, including high rates in Belgium and Austria, respectively. In Asia, we could detect searches in Bahasa Indonesia for “tuberculosis” and very high rates for “avian flu” throughout Asia and the Pacific region, including Hong Kong, Singapore, and Australia. We cannot exclude that these (presumed) Turkish and Indonesian immigrants also searched online in their adopted language(s), nor could we measure the fraction of their searches in their native language versus adopted language(s). However, based on the fraction of a country’s population that belongs to a particular immigrant group versus the fraction of searches conducted in the immigrant language compared to the adopted language, then if every person in a country searched the Internet for the same term at the same rate, but in different languages, we could then extrapolate that Turkish immigrants in Belgium searched for “avian flu,” “schizophrenia,” and “tuberculosis” 100%, 40%, and 15% of the time, respectively, in Turkish rather than French ( ). Using the same simplistic assumptions, in Austria, 39% of searches for “tuberculosis” by Turkish immigrants were in Turkish rather than German. In reality, immigrant groups are likely searching for a term such as “avian flu” at a higher rate than the general population when the corresponding disease affects their homeland and is in the news. However, we also found high search rates for “tuberculosis” and even “schizophrenia” in Turkish in these nations, which are less featured in the news. We conclude that it is important for health officials to be aware that if they wish to disseminate health information to susceptible immigrant groups, they should not rely on websites published in the majority language(s) of the nation. High priority domestic health-related websites should be multilingual, particularly those that concern infectious disease.
Our analysis also revealed surprises: for example, in Bangladesh, one of the world’s poorest and most populated nations, with 136 million residents, we found that the search rate for “avian flu” in Bahasa Indonesia (“flu burung”) was equivalent to the search rate in English (); the Bahasa Indonesia translation of “schizophrenia” was also high in Bangladesh. The high Bahasa Indonesia search rate may reflect the fact that many Bangladeshi citizens work in Singapore and Malaysia, nations that speak a similar language, Malay (Bahasa Malayu) [ ]; it would appear that when they return to Bangladesh, Bangladeshis continue to use the terminology they learned while away, but the reason is unclear. We suggest that international health organizations aiding Bangladesh should publish or meta tag health information in Malay (Bahasa Malayu) to reach health practitioners in that nation. This result also highlights the practical value of analyzing linguistic preferences during online searching.
Finally, we were surprised to find that online searches for “avian flu,” “schizophrenia,” and “maize/corn” in Spanish in the United States occurred at less than 1% of the English search rate (). The US online Hispanic population (legal and illegal) is estimated to be 12% of the total US online population, of which nearly half use Spanish for some (28%) or all (21%) of their Internet usage [ , ]. Therefore, our data suggest that Latin American immigrant groups in the United States search for health information to a lesser degree in Spanish than might be predicted, although these data could also be a result of the digital divide between the groups.
|Search Term||Country||Immigrant Language||Comparative Major Language* of Adopted Country||Immigrant Language Searches per 10000 Major Language Searches||Relevant Immigrants per 10000 Total Population†|
|Turkish immigrants in Europe|
|Indonesian/Malaysian immigrants in Asia/Pacific|
|Avian flu||Australia||Bahasa Indonesia||English||234.7||625.2¶|
|Hong Kong||Bahasa Indonesia||English||3424.4||N/A|
|Tuberculosis||Hong Kong||Bahasa Indonesia||English||23.3||N/A|
|Hong Kong||Bahasa Indonesia||English||295.1||N/A|
|Spanish immigrants in English-Speaking North America#|
|Avian flu||Unites States||Spanish||English||102.8||> 503.0**|
|Corn (maize)‡‡||Unites States||Spanish|
*a major language for which Google search rates were accessible, not necessarily the largest linguistic group of the nation.
†Total population data are from United Nations Population Division, 2005 data. URL: http://www.un.org/esa/population/unpop.htm.
‡Data are from Institut National De Statistique, 2003 data. Population et Ménages: Mouvement de la population et migrations, "Immigrations extérieures par nationalité et groupe d\'âges – Belgique." URL: http://www.statbel.fgov.be.
§Data are from Statistics Austria, Volkszählung. Hauptergebnisse I – Österreich, 2001 census data. URL: statistik.at/neuerscheinungen/vzaustria.shtml.
||Data are from Statistisches Bundesamt (Federal Statistical Office, Germany), 2006 data. URL: http://www.destatis.de/themen/e/thm_bevoelk.htm.
¶Data are from Australia Bureau of Statistics, Cultural and Language Diversity, 2001 Census data. URL: http://www.abs.gov.au/.
#“Tuberculosis” is not included as it is the same term in both English and Spanish.
**Data are from Department of Homeland Security Yearbook of Immigration Statistics. Legal immigrants, 2005 data. URL: uscis.gov/graphics/shared/aboutus/statistics/ybpage.htm.
‡‡The search term used was “corn.”
|Country||ColonialLanguage*||Minority Language||Minority Language Searches per 10000 Colonial Language Searches|
|Search Term: Avian Flu|
|Search Term: Tuberculosis|
|Democratic Republic of Congo||French Portuguese||English|
|Search Term: Schizophrenia|
|Democratic Republic of Congo||French||English||4304|
*When two languages are noted, the term is the same in both languages.
Search Rates in European Languages in Sub-Saharan Africa
Sub-Saharan Africa suffers from high rates of infectious disease, including TB and HIV , and high rates of malnutrition [ ]. As demonstrated in , our search results suggest that the dissemination of online health or food security information to this region by international agencies should not be limited to the colonial language(s) of the target nations. For example, in English-speaking Ghana, 20% of searches for avian flu were in French (“grippe aviaire”), 17% in German (“vogelgrippe”), and 5% in Dutch (“vogelgriep”) relative to English ( ). In Mozambique, a former Portuguese colony, we found 1.4 times more searches for “avian flu” in English relative to Portuguese, and a high rate in French. In the Democratic Republic of Congo (DRC), a former French colony with more than 300000 TB infections in 2004 [ ], 24% of the searches for tuberculosis were in English relative to French. Because Internet use is only 1.9% is Ghana, 0.7% in Mozambique, and 0.2% in DRC [ ], it is plausible that these high rates of non-colonial language searches using Google may reflect searches by health professionals trained in other nations, including workers from international agencies who would be expected to have better Internet access than the general population.
The Effect of Region-Specific Cultural and Indigenous Terminology
Finally, we measured the effects of cultural bias within the same linguistic group, using a term important for human nutrition and food security, “maize.” Maize is eaten directly, but it is also a major source of animal feed worldwide. Maize is known as “corn” in the United States and the United Kingdom, but as “maize” in many other English-speaking nations. We found that the US searches for “corn” were at a 28-fold higher rate than for “maize,” while other English-speaking nations such as Nigeria and Zimbabwe queried “maize” at a 1.5- to 4-fold higher rate than “corn,” respectively (); in the latter nations, “corn” may also refer to any large cereal grain (eg, wheat). This search behavior has consequences, as we found only three domain names that overlapped between searches for “maize” versus “corn” out of the first 50 unique Google search results.
Therefore, when African nations attempt to retrieve information about growing maize in English, they may unknowingly be excluding authoritative information from the United States and other Western English-speaking nations, such as practical information from the US National Corn Growers’ Association, whose website does not appear in the first 100 Google hits for “maize,” but ranks sixth when “corn” is searched. Similarly, when international organizations such as the FAO wish to transmit knowledge, for example, using Spanish or Portuguese in Latin America, indigenous terminology usage may make some of this information inaccessible. Maize originated from Southern Mexico and fed indigenous Latin American civilizations . In Mexico and Guatemala, we found that an indigenous synonym for maize, “elote,” was searched at a similar rate to the Spanish term, “maíz” ( ). In Peru, however, we found that a different indigenous term, “choclo,” was searched at a 2-fold higher rate than “maíz.” We conclude that cultural and indigenous linguistic divisions may be preventing large numbers of food security and nutrition websites from reaching those people aiding 800 malnourished people or 1.2 billion agricultural workers that live in developing countries [ ]. Cultural and indigenous bias may be particularly prevalent for terms related to crops, diseases, or pathogens that have pre-colonial origins.
|Country||Calories from Maize (kcal/person/day)*||Search Term Comparison||Search Rate Ratio|
*Data from FAOSTAT .
†N/A: Data not available.
In a world where infectious disease pandemics and threats of famine are always present, and in spite of the fact that the World Wide Web offers great hope for rapid and accurate sharing of information between peoples, we have demonstrated that one linguistic group does not or cannot access the health and food security websites of a different linguistic group. Our data suggest at least three reasons for this.
The first reason is that the websites of most institutions are not published in more than one or two languages. When we sampled Web pages found by the English-language queries “avian flu,” “tuberculosis,” “schizophrenia,” and “maize/corn” and their counterpart queries in other languages, the Google search results typically overlapped by only less than 10% in terms of the domain names retrieved, indicating that 90% of the relevant Web pages had not been translated into at least two languages (see). For example, when Turkish or Bahasa Indonesia was used as the search language, Web pages from very authoritative sources, such as the CDC or WHO, were not retrieved by Google. We also found that a single linguistic accent or special character in the search query could significantly alter the number and content of health-related search results retrieved by Google. Therefore, one reason for the linguistic digital divide is that the majority of health and food Web pages are not translated into multiple languages and/or that their cross-language retrieval by search engines is poor.
The first problem would not be important if the world’s online community, better educated than the general public, searched in English, since the majority of the world’s Web pages are published in English [, ]. However, we found that there was a 2- to 100-fold higher Google search rate for health and food terms in the native language of a country compared to English (see ).
Finally, within a nation, it might be assumed that language would not be a problem if a domestic agency only published their health websites in the majority language of their own people. However, we found that in Asia and Western Europe, a subset of immigrants from Indonesia and Turkey, respectively, searched Google for health and food information in their native language, not the language(s) of their adopted countries (see). In Sub-Saharan Africa, we detected unexpectedly high search rates for health information in non-colonial European languages (see ), perhaps reflecting the presence of international aid workers. Finally, in Latin America, we found that indigenous words were used to search Google for information about food, rather than the colonial language of Spanish (see ). Therefore, domestic agencies, in addition to global agencies, face a linguistic challenge when publishing information online: their target audiences still require information to be published in different languages, even though Internet users are presumably more educated and thus more multilingual than the general population.
Given our observation that the world’s peoples appear to be searching for health and food terms in their local language or mother tongue, not in English, previous online language translation efforts by the WHO and FAO have no doubt been worthwhile. This is also revealed by the high page rank (first page results) of WHO-affiliated search results when Google is searched for infectious disease information in one of the WHO’s six online languages. We recommend that these efforts be continued and further expanded to include more languages; this recommendation applies to global agencies, but also to domestic agencies, in order to meet immigrant or indigenous needs and/or to make information accessible to other nations. To achieve such translation goals, better health-specific translation software must be developed and more translators are needed who specialize in human health and food security terminology. For example, improved cross-language search retrieval  of health information by online search engines would be beneficial. These investments should then be used to initially target health and food security information to the world’s most important linguistic groups, which include speakers of Chinese (1080 million people), Hindi (about 500 million), English (350-500 million), Spanish (390 million), Arabic (255 million), Portuguese (190 million), Bengali (215 million), Russian (255 million), Bahasa Indonesia (200 million), Japanese (127 million), Punjabi (104 million), German (123 million), and French (119 million) [ ]. In a world that is primarily non-English speaking, such attempts will help to reduce the linguistic digital divide in health and food information on the World Wide Web.
Furthermore, as we did in this study (seeto ), we recommend that when global or domestic health and food security organizations wish to use the Internet to disseminate information to other nations [ ] or to their own immigrant or indigenous communities, they should first consult search engine query rates for different translations of possible search terms in order to determine which online languages are most needed. contains extensive linguistic online search pattern data to help health and food agencies better select languages for targeted website publishing. In order to measure search rates for other subjects of interest, we note that free online tools exist, such as Google Trends. In some situations, such as targeting indigenous groups, who often speak the majority language of a nation, all that may be needed is to imbed translated keywords into a majority-language website (eg, Spanish) so that search engines such as Google can cross-retrieve relevant information.
Though this study examined the extent to which agencies such as the WHO are publishing information in multiple languages, we did not systematically address the quality of health and food information available in different languages. Quality analysis would especially be important for minor languages that have little content available on the Web: for example, we estimate that there are more than 4000-fold fewer search results in Bahasa Indonesia than in English for “tuberculosis,” more than 200-fold fewer search results for “avian flu” in Arabic or Japanese than in English, and about 500-fold fewer search results for “schizophrenia” in Arabic than in English. Though these precise numbers are considered to be unreliable , they do illustrate the point that most of the world’s linguistic groups, even major ones, have much less available online health information relative to English. As to the quality of the websites that are available, this will require systematic analysis, which poses significant methodological problems [ ]. One could, however, perform a subjective survey-based evaluation by multilingual physicians, as has been performed to evaluate disease-specific websites published in English [ ]. Such a survey should include quantifying to what extent online information from the WHO, CDC, and FAO is being translated into the world’s minor languages in order to help these agencies determine where they need to target their online translation efforts.
This work was funded by an Ontario Premier’s Research Excellence Award to MNR as part of the CropLink Online Global Initiative. No external sponsors were involved in the preparation or review of this manuscript.
Conflicts of Interest
Olcan Sercinoglu and Artem Boytsov are employees of Google Inc.
Multimedia Appendix 1
Language translations used in this study (pdf) PDF file (Adobe Acrobat), 32 KB
Multimedia Appendix 2
Rate at which users from 227 different countries searched Google (xls) XLS file (MS Excel), 211 KB
- Pandia Search Engine News. The size of the World Wide Web. 2007 Feb 25. Pandia.com. URL: http://www.pandia.com/sew/383-web-size.html [accessed 2007 Jun 14] [WebCite Cache]
- Cooper CP, Mallon KP, Leadbetter S, Pollack LA, Peipins LA. Cancer Internet search activity on a major search engine, United States 2001-2003. J Med Internet Res 2005 Jul 1;7(3):e36 [FREE Full text] [Medline] [CrossRef]
- Phillipov G, Phillips PJ. Frequency of health-related search terms on the Internet. JAMA 2003 Nov 5;290(17):2258-2259. [Medline] [CrossRef]
- Eysenbach G, Köhler C. Health-related searches on the Internet. JAMA 2004 Jun 23;291(24):2946. [Medline] [CrossRef]
- Giustini D. How Google is changing medicine. BMJ 2005 Dec 24;331(7531):1487-1488 [FREE Full text] [Medline] [CrossRef]
- Fox S. Online Health Search 2006: Most internet users start at a search engine when looking for health information online. Very few check the source and date of the information they find. Washington, DC: Pew Internet & American Life Project; 2006. URL: http://www.pewinternet.org/pdfs/PIP_Online_Health_2006.pdf [accessed 2007 Jan 18] [WebCite Cache]
- Tang H, Ng JHK. Googling for a diagnosis--use of Google as a diagnostic aid: internet based study. BMJ 2006 Dec 2;333(7579):1143-1145 [FREE Full text] [Medline] [CrossRef]
- Gordon R. Ethnologue: Languages of the World. 15th edition. Dallas, TX: SIL International; 2005. URL: http://www.ethnologue.com/ [accessed 2007 Jun 14]
- Usage and Population Statistics. 2006. Internet World Stats. URL: http://www.internetworldstats.com/ [accessed 2007 Jun 14] [WebCite Cache]
- Bar-Ilan J, Gutman T. How do search engines respond to some non-English queries? J Info Sci 2005;31(1):13-28. [CrossRef]
- Epidemiology of WHO-confirmed human cases of avian influenza A(H5N1) infection. Wkly Epidemiol Rec 2006 Jun 30;81(26):249-257 [FREE Full text] [Medline]
- Epidemic and Pandemic Alert and Response Database. World Health Organization (WHO). Geneva, Switzerland: World Health Organization; 2006. URL: http://www.who.int/csr/en/ [accessed 2006 Aug 9] [WebCite Cache]
- ; Organisation Mondiale de la Santé Animale (OiE) [World Organisation for Animal Health]. Animal Diseases Data: Avian Influenza. Paris, France: World Organisation for Animal Health; 2006. URL: http://www.oie.int/eng/info/hebdo/A_DSUM.htm [accessed 2006 Aug 16] [WebCite Cache]
- Harries AD, Dye C. Tuberculosis. Ann Trop Med Parasitol 2006;100(5-6):415-431. [Medline] [CrossRef]
- ; World Health Organization (WHO). Global Tuberculosis Database: Global Health Atlas. Geneva, Switzerland: World Health Organization; 2004. URL: http://www.who.int/globalatlas [accessed 2006 Aug 24] [WebCite Cache]
- ; World Health Organization (WHO). The World Health Report: 2001: Mental Health: New Understanding, New Hope. Geneva, Switzerland: World Health Organization; 2001. URL: http://www.who.int/entity/whr/2001/en/whr01_en.pdf [WebCite Cache]
- ; World Health Organization (WHO). Project Atlas: Resources for Mental Health and Neurological Disorders. Geneva, Switzerland: World Health Organization; 2005. URL: http://globalatlas.who.int/ [accessed 2006 Aug 28] [WebCite Cache]
- Mathers C, Stein C, Ma FD, Rao C, Inoue M, Tomijima N. Global Burden of Disease 2000: Version 2 Methods and Results. GPE Discussion paper No. 50. Geneva, Switzerland: World Health Organization; 2002. URL: http://www.who.int/entity/healthinfo/paper50.pdf [WebCite Cache]
- ; Food and Agricultural Organization, Statistical Division (FAOSTAT). FAOSTAT Database. Rome, Italy: FAOSTAT; 2006. URL: http://faostat.fao.org/ [accessed 2006 Apr 26] [WebCite Cache]
- Keusch GT. The history of nutrition: malnutrition, infection and immunity. J Nutr 2003 Jan;133(1):336S-340S [FREE Full text] [Medline]
- Brin S, Page L. The anatomy of a large-scale hypertextual web search engine. Comput Networks ISDN 1998;30(1-7):107-117. [CrossRef]
- Wolfram D, Spink A, Jansen B, Saracevic T. Vox populi: the public searching of the Web. J Amer Soc Info Sci 2001;52(12):1073-1074. [CrossRef]
- Freitas-Junior H, Ribeiro-Neto B, Vale R, Laender A, Lima L. Categorization-driven cross-language retrieval of medical information. J Amer Soc Info Sci Tech 2006;57(4):501-510. [CrossRef]
- Miller G. Mental health in developing countries. The unseen: mental illness's global toll. Science 2006 Jan 27;311(5760):458-461. [Medline] [CrossRef]
- Rahman MM. Emigration and development: the case of a Bangladeshi village. Int Migr 2000;38(4):109-130. [Medline] [CrossRef]
- A Year in Review: U.S. Hispanic Internet Usage. ComScore Press Release, Comscore Networks. 2003 Nov 13. URL: http://www.comscore.com/press/release.asp?press=370 [accessed 2006 Oct 5] [WebCite Cache]
- Sluyter A, Dominguez G. Early maize (Zea mays L.) cultivation in Mexico: dating sedimentary pollen records and its implications. Proc Natl Acad Sci U S A 2006 Jan 24;103(4):1147-1151 [FREE Full text] [Medline] [CrossRef]
- Edejer TT. Disseminating health information in developing countries: the role of the internet. BMJ 2000 Sep 30;321(7264):797-800 [FREE Full text] [Medline] [CrossRef]
- Bar-Ilan J. Expectations versus reality – Search engine features needed for Web research at mid 2005. Cybermetrics 2005;9:Paper 2.
- Eysenbach G, Powell J, Kuss O, Sa ER. Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA 2002;287(20):2691-2700 [FREE Full text] [Medline] [CrossRef]
- Craigie M, Loader B, Burrows R, Muncer S. Reliability of health information on the Internet: an examination of experts' ratings. J Med Internet Res 2002 Jan 17;4(1):e2 [FREE Full text] [Medline] [CrossRef]
|CDC: Centers for Disease Control|
|DRC: Democratic Republic of Congo|
|FAO: Food and Agricultural Organization|
|MDG: Millennium Development Goal|
|OiE: Organisation Mondiale de la Santé Animale [World Organisation for Animal Health]|
|WHO: World Health Organization|
Edited by G. Eysenbach; submitted 01.12.06; peer-reviewed by J Bar-Ilan; comments to author 22.12.06; revised version received 23.03.07; accepted 17.05.07; published 28.06.07
© Punam Mony Singh, Carly A Wight, Olcan Sercinoglu, David C Wilson, Artem Boytsov, Manish N Raizada. Originally published in the Journal of Medical Internet Research (http://www.jmir.org, 28.06.2007). Except where otherwise noted, articles published in the Journal of Medical Internet Research are distributed under the terms of the Creative Commons Attribution License (http://www.creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited, including full bibliographic details and the URL (see "please cite as" above), and this statement is included.