Published on 18.09.14 in Vol 16, No 9 (2014): September
Internet Search and Krokodil in the Russian Federation: An Infoveillance Study
This is a corrected version. See correction statement: http://www.jmir.org/2015/3/e76/
This is a corrected version. See correction statement: http://www.jmir.org/2016/1/e16/
Background: Krokodil is an informal term for a cheap injectable illicit drug domestically prepared from codeine-containing medication (CCM). The method of krokodil preparation may produce desomorphine as well as toxic reactants that cause extensive tissue necrosis. The first confirmed report of krokodil use in Russia took place in 2004. In 2012, reports of krokodil-related injection injuries began to appear beyond Russia in Western Europe and the United States.
Objective: This exploratory study had two main objectives: (1) to determine if Internet search patterns could detect regularities in behavioral responses to Russian CCM policy at the population level, and (2) to determine if complementary data sources could explain the regularities we observed.
Methods: First, we obtained krokodil-related search pattern data for each Russia subregion (oblast) between 2011 and 2012. Second, we analyzed several complementary data sources included krokodil-related court cases, and related search terms on both Google and Yandex to evaluate the characteristics of terms accompanying krokodil-related search queries.
Results: In the 6 months preceding CCM sales restrictions, 21 of Russia's 83 oblasts had search rates higher than the national average (mean) of 16.67 searches per 100,000 population for terms associated with krokodil. In the 6 months following restrictions, mean national searches dropped to 9.65 per 100,000. Further, the number of oblasts recording a higher than average search rate dropped from 30 to 16. Second, we found krokodil-related court appearances were moderately positively correlated (Spearman correlation=.506, P≤.001) with behaviors consistent with an interest in the production and use of krokodil across Russia. Finally, Google Trends and Google and Yandex related terms suggested consistent public interest in the production and use of krokodil as well as for CCM as analgesic medication during the date range covered by this study.
Conclusions: Illicit drug use data are generally regarded as difficult to obtain through traditional survey methods. Our analysis suggests it is plausible that Yandex search behavior served as a proxy for patterns of krokodil production and use during the date range we investigated. More generally, this study demonstrates the application of novel methods recently used by policy makers to both monitor illicit drug use and influence drug policy decision making.
J Med Internet Res 2014;16(9):e212
Krokodil, otherwise known as desomorphine, is a cheap injectable drug easily synthesized in household kitchens from codeine-containing medication (CCM). The first confirmed report of krokodil use in Russia occurred in 2004. In 2012, reports of horrific krokodil-related injection injuries began to appear beyond Russia in Western Europe  and the United States [ ]. We conducted this exploratory study to determine if several complementary data sources may provide insight into the relative scale and spatial patterns of behaviors consistent with an interest in the production and use of krokodil before and after the imposition of Russian federal restrictions on CCM sales in 2012.
Review of Literature on Krokodil
Current scientific literature on krokodil is limited. We reviewed international literature available through PubMed and Google Scholar. In addition, we searched the four most popular Russian online news sources  for the term “desomorphine” in the date range January 2009 to December 2012 using Yandex News (see ). Across the four sources, we identified 929 Russian language articles associated with the term “desomorphine” in this date range, which was bounded by a period of increasing public interest in 2009, and the 6-month period following federal restrictions on CCM sales across Russia in June 2012.
|Vesti.ru (Website of Russia 24 TV)||vesti.ru||38||State-owned|
|Komsomlskaya Pravda||kp.ru||748||Private, tabloid|
|Russia business consulting||rbk.ru||40||Private, business focus|
The Origins of Krokodil
Current literature describing the origins of krokodil in Russia is vague. Time magazine reported the first appearance of krokodil in the Siberian and the Far East Federal Regions of Russia in the early 2000s . We identified the first Russian news report of krokodil use in the Komi Republic in the western part of the Siberian Federal Region in May 2004 [ ]. A police report from 2004 described the seizure of a new illicit drug never before seen in Russia called desomorphine. Conversely, a 2010 video produced by the Russian Drug Control Service (FSKN) suggested krokodil first appeared in the Komi Republic in 2002 [ ] and that by 2006, 19 Russian oblasts (subregional administrative units) were affected. These affected oblasts were primarily in the Siberian, Volga, Northwestern, and Central Federal Regions. From 2006 onwards, krokodil use increased dramatically according to Russian news reports [ ]. The ease of access to low-cost CCM and ease of domestic manufacture were widely reported as contributing to the spread of krokodil use [ ]. Shortages of heroin during 2010 have been described as a further factor contributing to krokodil use. Several authors suggested krokodil largely displaced traditional opiates as a consequence of Afghan heroin shortages after 2010 [ , , , ]. A 2012 police report stated seizures of krokodil grew by 40 times from 2 kg in 2006 to 100 kg in 2011. By comparison, a mean of 2922 kg of heroin were seized each year between 2006 and 2010 in the Russian Federation [ , ].
Prevalence of Krokodil Use
Estimates of the scale of krokodil use diverged markedly. In 2011, a senior Russian addiction medicine specialist reported 5000 krokodil users were receiving treatment nationally, out of a total estimated national population of 20,000-30,000 users . In June 2012, the FSKN estimated between 5000 and 7000 deaths were attributable to krokodil in Russia over the preceding 2 years [ ]. Also in 2012, international researchers estimated 100,000 people were krokodil dependent in Russia, while suggesting the actual number could be higher [ ]. Pharmacy sales of CCM provided a further indicator of the scale and spatial distribution of krokodil use. For example, in the Urals Region, the FSKN reported an increase in annual CCM sales from 4.2 million in 2007 to 12 million packets in 2010 [ ].
There were limited data describing the spatial distribution of krokodil use before the federal restrictions on sales of CCM in June 2012. Krokodil use had been widely reported across Russia and bordering Ukrainian regions [, ]. A December 2011 news report citing “various sources” described the results of toxicology tests conducted in several Russian oblasts [ ]. According to this unreferenced news report, toxicology tests suggested 20% of people who inject drugs (PWID) in Chechnya were krokodil users, compared with 60% in Kazan and Ryazan, and 90% in Yaroslavl oblast. Overall, the publicly available data on the scale and prevalence were both limited and fragmented [ ] before the introduction of restrictions in June 2012.
A series of articles reviewing the current scientific understanding of krokodil appeared in the International Journal of Drug Policy in 2013. One of these articles by Grund et al consolidated current scientific information, including interview data from Russian key informants . The authors pointed to the paucity of scientific research into krokodil prevalence and use. Several commentary articles accompanied Grund et al’s review. In one accompanying commentary piece, Heimer described the difficulties of investigating the prevalence of krokodil use without ethnographic and epidemiological data [ ]. Heimer further noted the time lag between submitting research proposals and fieldwork, describing how his personal efforts to set up field interviews were thwarted by changes in krokodil use patterns resulting from federal restrictions on the sale of CCM in June 2012. In summary, conducting research into krokodil was more complex than with many established illicit drugs because of the novel nature of the substance and policy changes.
Morbidity and Mortality Associated With Krokodil in Russia
Desomorphine was originally developed as a morphine substitute. It was first synthesized in the United States in 1932, with the aim of producing a low-cost substitute with minimal side effects . However, laboratory-synthesized desomorphine was regarded as an unsuccessful substitute, being shorter lasting, stronger, and more addictive than morphine. In Russia, krokodil, or what is termed desomorphine, is an illicit injectable drug domestically manufactured from codeine, iodine, phosphorus, paint thinner, and lighter fuel [ ]. The resulting substance is regarded as impure, creating the potential for severe injury among PWID. It is the presence of impurities that has produced consistent reports of injuries characteristic of krokodil use. Characteristic injuries have included vascular damage, skin and soft tissue infections, necrosis and gangrene [ , ], as well as burns associated with domestic manufacture [ ]. The short duration of narcotic effects, strong dependence, and chemical instability of the domestically produced drug has led to reports of binges of frequent injecting among krokodil users [ ].
Frequent injecting is generally regarded as a risk factor for human immunodeficiency virus (HIV) and other injecting-related harms [, ]. Further, PWID experience multiple comorbidities, creating a disproportionate need for health services [ , ]. However, as a consequence of punitive drug laws, Russian PWID are often particularly unwilling to seek medical assistance, exacerbating injecting-related injuries [ - ]. In summary, the characteristics of drug preparation and use, as well as the legal environment in which PWID use illicit drugs increased the morbidity and mortality associated with krokodil use in Russia before the restrictions on CCM in 2012.
Russian Policy Responses to Krokodil
The easing of restrictions on access to CCM may have increased the production and use of krokodil in Russia. During the Soviet period up to 1991, CCM was available only through pharmacies with a medical prescription . Following the fall of USSR in 1991, restrictions on sales of CCM were removed. In 2004, Russian manufacturers introduced new CCMs targeted at Russian consumers. Following advocacy by the largest Russian manufacturer, Pharmstandard, these new CCMs remained accessible to consumers without medical prescriptions [ ]. While a two-packet-per-person limit on CCM sales formally existed, this was routinely ignored by pharmacists [ ]. From the mid-2000s, Russian government agencies explicitly linked the unrestricted access to CCM with the illicit consumption of krokodil [ ]. After 2009, krokodil became increasingly recognized as a public health and policy problem. Increasing public concern was accompanied by Russian media reports of conflicts of interest. In particular, the relationship between Pharmstandard and the Russian Minister of Health became the target of media scrutiny [ , ]. Media reports suggested Pharmstandard’s advocacy had prevented the imposition of restrictions on the sale of CCM. In summary, several failures in CCM regulation may have facilitated the expansion of krokodil use in Russia.
National Restrictions on Codeine-Containing Medication
At a national drug control conference in 2011, Russian President Medvedev announced restrictions on the sale of CCM without medical prescriptions . Federal restrictions on CCM sales were original scheduled to start mid-2011. However, the Russian Ministry of Health effectively delayed the implementation of restrictions for 12 months. Ministry of Health officials argued that 40 million individuals using CCM for intended analgesic purposes would be disadvantaged by premature restrictions [ ]. In opposing immediate restrictions, the Ministry of Health also drew on widespread public opposition to restrictions on CCM sales [ ] (see ). The delays in restrictions led to conflict in Russian national media between the FSKN, academics [ ], and the Ministry of Health [ ]. The public debate over CCM restrictions thus illuminated interagency tensions in an otherwise generally opaque Russian federal health policy landscape.
|How will this affect the battle against drugs in Russia?||How will this affect the needs of ordinary patients?|
|Difficult to answer||14%||12%|
The Effect of Restrictions on Codeine-Containing Medication
From 2011 to June 2012, several Russian oblast governments implemented interim local restrictions on CCM sales [, ]. These interim restrictions were directed at reducing the production and consumption of krokodil in advance of federal bans [ , ]. On June 1, 2012, a federal law restricted CCM sales across all of Russia. Russian media subsequently reported decreased sales volumes of CCM [ ]. However, media reports of krokodil production and use and krokodil-related arrests continued [ , ]. These media reports suggested the federal restrictions on CCM sales had been only partially effective in curtailing krokodil production and use.
Krokodil and the Internet
Between 2010 and 2012, Russian policy makers emphasized the negative influence of the Internet in disseminating krokodil-related information. In April 2011, the FSKN presented the results of its research into Internet search patterns for krokodil-associated terms . The FSKN described a marked increase in Internet searches for methods of preparing and purchasing krokodil, from 3000 searches during 2010, to 50,000 in the first 3 months of 2011. Several days later, Russian President Dmitry Medvedev reiterated Russian government concerns about the relationship between krokodil and the Internet at a national forum dedicated to illicit drug use prevention. President Medvedev demonstrated that when the term “desomorphine” was entered into the Yandex search engine, the first results revealed information on how to prepare the drug [ ]. Medvedev suggested these results proved that Internet users were most interested in producing desomorphine, rather than simply searching for general information about the drug. This widely reported demonstration by the Russian President served as the catalyst for subsequent federal restrictions on CCM.
Russian Government Statements About Krokodil
President Medvedev’s demonstration stimulated increased public interest in krokodil. The FSKN had reported steadily increasing Internet searches in the 12 months before President Medvedev’s speech. However, extensive media coverage and the highest recorded volume of searches for “desomorphine” emerged in the week following the President’s speech (see). Further, searches remained consistently elevated after April 2011 until the Russian CCM restrictions in June 2012. Medvedev’s speech may thus have contributed to the Russian government’s unintentional amplification of popular interest in krokodil production and use [ - ]. Both before and after President Medvedev’s speech, Russian media consistently reported the harms of krokodil alongside the low price and ease of access to ingredients, and ease of drug synthesis in domestic laboratories.
Political and public concern over illicit drug use preceded President Medvedev’s speech. Public opinion polls since 2005 consistently rated illicit drug use as one of the most serious social problems in Russia . Between 2010 and 2012, the Russian government progressively tightened restrictions on all illicit drug information available online. For example, in 2011, a website operated by the nongovernmental organization, Andrey Rylkov Foundation, was suspended for publishing public health information about opioid substitution therapy and harm reduction [ ]. Russian government policy towards illicit drug use and drug users is regarded as punitive. Moreover, in the post-Soviet period, drug use came to represent an existential threat, implicated in national spiritual and demographic decay (eg, [ ]). The intensity of public concern and political action directed at illicit drug use in Russia has been described as a moral panic [ ]. Moral panics are a sociological concept describing the disproportionate public response to issues represented in media [ , ]. Over two decades, intense social and political pressures led to the demonization of drug users in Russia. After 2009, krokodil increasingly served as a focus for illicit drug-related concerns. However, President Medvedev’s April 2011 speech may have triggered a moral panic surrounding krokodil, amplified public interest, and stimulated Internet search behavior.
Public Curiosity Stimulated by Media Reporting on Illicit Drugs
Exposure to stories about illicit drugs in traditional and online media has been found to increase public curiosity and the use of illicit drugs [, ]. Dasgupta et al found mortality from prescription opiates increased significantly in the months following media reporting [ ]. In addition to the news effects, online media has increased information about manufacture, sales, and use of novel illicit drugs, and undermined international drug control efforts [ - ]. Further, researchers have noted the cohort most likely to experiment with new drugs is also most likely to use the Internet [ ]. The Internet is now regarded as the main medium from spreading information about novel illicit drugs [ - ]. Notably, Forsythe directly linked news reporting to increased rates of Internet search to increased use of the novel illicit drug mephedrone in the United Kingdom during 2010 [ ].
We conducted this exploratory infodemiology study in order to better understand if the relative scale and spatial distribution of search behavior was consistent with an interest in the production and use of krokodil in Russia before and after the imposition of federal restrictions on CCM sales in 2012. In conducting this study, we examined “the science of distribution and determinants of information...(on) the Internet (and) a population, with the ultimate aim to inform public health and public policy” .
This study had two main objectives: (1) to determine if Internet search patterns could detect regularities in behavioral responses to Russian CCM policy at population level, and (2) if complementary data sources could explain the regularities we observed.
Search Patterns and Illicit or Stigmatized Behaviors
Each Internet search is a behavioral measure of an issue’s importance to an individual . If individuals are concerned or interested in an issue, they are more likely to search for information related to that issue. The relative importance of an issue can thus be inferred from the volume of search queries for a specific term or terms representing that issue. The use of aggregated Internet search patterns may be considered a method of unobserved, real time behavioral field research at population scale [ ]. Researchers have used Internet search patterns to investigate illegal or stigmatized behaviors. For example, researchers analyzed search patterns to monitor US cigarette tax avoidance [ ] and the use of racist terms when searching for information about Barak Obama prior to the 2012 US presidential elections [ ]. Other investigators have studied global abortion patterns, finding higher search rates in those geographic regions where abortions were illegal or restricted [ ]. In each of these instances, the authors suggested Internet search provided insights into behavior at a population level, beyond that available to traditional survey research.
Google and Yandex Search in Russia
Most Internet search pattern studies have used Google Trends as the data source. Google Trends has been deployed in studies of influenza [, ], dengue [ ], and HIV checks [ , ]. Globally, Google provided 84% of global Internet search queries in May 2011 [ ]. In Russia, Google’s market share in Russia was only 25% in 2011 [ ], whereas Yandex had a 60% share. The proportion of the Russian population using the Internet grew from 43% in 2010 to 55% in 2012 [ ]. Further, there was near universal Internet use among the age groups most likely to use illicit drugs [ ]. Among both males and females aged under 35 years and living in major Russian urban centers, more than 90% were regular Internet users during 2012.
Case Study: Why Is Search-Based Krokodil Surveillance Important in Russia?
Illicit drug use data are generally regarded as difficult to obtain. Drug use estimates are imperfect even in high-income countries with adequate resources . Researchers have generally divided illicit drug use estimation methods into direct and indirect approaches. Direct methods involve surveying household members about patterns of drug use. However, this method is expensive and may not produce truthful responses, particularly in countries such as Russia, where illicit drug use carries severe criminal penalties and stigma [ ]. Further, household surveys may fail to reach drug-using populations such as prisoners and the homeless. Indirect methods aim to estimate the size of drug-using populations through comparing data sources. Examples of indirect methods include the multiplier method, based on estimates of the proportion of drug users receiving treatment each year [ ]. Additional methods include capture-recapture and back-projection [ ], using data sources such as arrest, overdose, and needle exchange data [ , ]. Drug use researchers suggest the main advantage of indirect methods is their lower cost and greater accuracy, as several measures from different data sources are generally combined to produce a single aggregated measure.
In addition, we identified two references to national drug agencies using novel methods for estimating illicit drug use prevalence. The UK government made use of Google Trends when considering restrictions on the novel substance mephedrone in 2010 . Similarly, the Russian FSKN used Internet searches to develop a case for restricting CCM sales in Russia in 2011 [ ]. These two instances suggest online search pattern data have been used by national governments in shaping national drug policies. Through conducting this study, we aimed to develop search patterns as an additional method to complement indirect estimates of illicit drug-using populations in Russian-speaking countries.
RQ1: Were There Regularities in the Internet Search Patterns for “Desomorphine” Across Russia in 2011-2013?
To answer this question, we examined search patterns using Yandex and Google Internet search engines. First, we determined the most appropriate search term to represent the informal term “krokodil” in Internet searches. We initially selected two search terms that we believed reflected the majority of searches for the concept central to this study . These two search terms we selected were “desomorphine” (дезоморфин in Russian) and “Krokodil” (крокодил). We referred to the Google Trends related terms (Top Searches) feature to ensure each term referred to the subject of this study. Google related terms provide information on the relative importance of searches related to the specific search term entered into Google Trends. In the case of “desomorphine”, all terms were related to the drug desomorphine, whereas the term “krokodil” revealed primarily unrelated terms (see ). The term “krokodil” also means “crocodile” in Russian, leading to considerable ambiguity in search results. For example, the most popular term associated with “krokodil” (crocodile) referred to a 1960s Soviet-era children’s animated character “Gena the Crocodile”. Conversely, there is anecdotal evidence to suggest that some Russian PWID may not immediately associate the term krokodil with desomorphine [ ]. Overall, based on information available from Google Trends and Russian respondents, we anticipated that the search term “desomorphine” would be more likely to reflect search patterns consistent with an interest in the production and use of krokodil.
|Desomorphine how to prepare||дезоморфин как приготовить||100|
|Prepare desomorphine||приготовить дезоморфин||100|
|Krokodil desomorphine||крокодил дезоморфин||80|
|Drug desomorphine||наркотик дезоморфин||60|
|Desomorphine recipe||дезоморфин рецепт||50|
|Krokodil drug||крокодил наркотик||30|
|Gena the crocodile (Children’s animation)||крокодил гена||100|
|Crocodile game (Children’s game)||игра крокодил||50|
|Krokodil drug||крокодил наркотик||50|
|Crocodile/krokodil online||крокодил онлайн||45|
|Crocodile Dundee (Australian film)||крокодил данди||35|
|Dundee (Australian film)||данди||35|
|Cheburashka (Children’s animation)||чебурашка||30|
Publicly available Google Trends data for Russia has several limitations. First, Google did not provide complete results, returning only oblasts with the highest search volume. Google data for the term desomorphine was available for only 8 of Russia’s 83 oblasts and 3 cities during the date range 2011-2013. Second, Google did not provide raw search data. This made direct comparisons between oblasts using Google data impossible. We thus used WordStat as the primary data source. Yandex made publicly available a complete raw search dataset for all Russian regions and oblasts for 6 months before and after the implementation of federal CCM restrictions in June 2012. We used Google Trends as a secondary source of aggregated search results for validation purposes.
Second, we obtained desomorphine search data for each Russia oblast from September 1, 2011, to August 31, 2013. Yandex provides 2 years of publicly available monthly search pattern data at any time. Additionally, we had 6 months previously downloaded monthly search pattern data for the term desomorphine for each Russian oblast, from February to August 2011.
Third, we converted raw search figures for the term desomorphine to population prevalences. This allowed direct comparison across regions and oblasts. We used 2010 federal Russian census data  for our population prevalence calculation. We then multiplied each result by 100,000 to increase ease of comprehension, and to provide a population prevalence measure.
Fourth, we analyzed search patterns before and after federal restrictions on CCM sales in June 2012. We obtained the mean search volume for 6 months before the restrictions, as well as 6 and 12 months after (ie, to August 31, 2013). We excluded June 2012 data, as we anticipated atypical search patterns in the immediate post-restriction period. Overall, we segmented the available data to examine the effects of a federal policy change on the relative scale and geographic patterns of krokodil search across the Russia.
Fifth, we obtained all available Google data for the term desomorphine from September 2011 to August 2012. Google search data for the term desomorphine was available for 8 of 83 oblasts only (see). We did not consider this sample adequate to conduct correlations. Similar limitations with regional Russian Google search results have been reported in earlier studies [ , ].
|Saint Petersburg city||71|
RQ2: Can Complementary Data Sources Explain the Observed Regularities for “Desomorphine” Across Russia in 2011-2013?
To answer this question, we initially reviewed the approaches used to validate search pattern data and drug population data. Search pattern studies have generally validated against an offline measure. For example, the initial search pattern studies established correlations between search patterns and epidemiological surveillance data for influenza [, ]. Other studies focusing on issue salience, established a correlation between search patterns, traditional media, and opinion polling [ ]. Each of these search studies revealed regular patterns of behavior corresponding to a valid offline measure. However, in this case, there was no analogous source of illicit drug use data available. We therefore combined several complementary data sources with a view to providing a plausible explanation for the observed regularities in Internet search patterns.
First, we obtained first court appearance data available for krokodil-related criminal charges for the 77 of 83 Russian oblast data available from the Rospravosudie website. The site is a publicly available, non-government Russian criminal justice research project displaying criminal court case data across all Russian oblasts . One part of the project is dedicated to court appearance data for popular illicit recreational drugs. In addition to krokodil, Rospravosudie provides arrest data on 24 illicit drugs, including krokodil marijuana, amphetamines, JWH (“spice”), and heroin. The available krokodil data is a single per-oblast figure covering the date range 2010 to 2012. The Rospravosudie website publishers note several limitations. First, the arrest data are based on sentencing documents. Only 50% of complete sentencing data are published, and only 50% of cases appear in courts. Second, the database allows comparison of the relative popularity of various illicit drugs. It is not possible to describe the absolute prevalence of illicit drug use based on these data. Third, there is an assumption that the detection rates for illicit drug crimes were on average the same nationally. Fourth, only the first court appearances for illicit drug cases are recorded. Subsequent appeals and cassations for illicit drugs are excluded. In summary, the site authors suggest that despite these limitations, the data reflect the differences in access to illicit drugs across Russian regions.
To analyze krokodil-related court data, we first obtained arrest rates for krokodil for 2010-2012 as a single figure for each Russian oblast. We then converted the arrest rates for each oblast to a per 100,000 population measure. This allowed us to investigate the relationship between court appearances and krokodil searches. We used the mean searches for “desomorphine” per 100,000 population from November 2011 to May 2012 to represent pre-CCM restriction searches. We then conducted Spearman correlation between arrest rates and searches per 100,000 population for “desomorphine” for the 77 regions for which court data were available.
Second, we used Google Trends visual data to provide indicative national search results for popular CCMs and “desomorphine” from January 2009 to January 2013. We identified several popular CCM available in Russia prior to the June 2012 ban . The four CCM we analyzed with Google Trends were kaffetin, solpadeine, pentalgin, and codelac. Historical Yandex data were not available for this complete date range.
Third, we used Google Trends related searches to analyze several popular CCM available in Russia prior to the June 2012 restrictions. Through analyzing these related searches, we sought to obtain additional information on the characteristics of public interest in CCM and the term desomorphine before and after federal restrictions. Historical Yandex data were not available for this complete date range.
Fourth, we used Yandex keyword feature nationally to confirm that searches for the term desomorphine were associated with illicit drug use. Yandex provides a keyword function that lists word combinations associated with a specified search term. Keywords are analogous to the Google related terms (Top Searches) feature . We identified 85 Yandex keyword combinations incorporating the term desomorphine. These combinations included “desomorphine prepare” and “desomorphine recipe” (see ).Yandex keywords are available nationally, for each Russian region and 83 oblasts, and many smaller intra-oblast cities. However, the date range is limited to the preceding 30 days only. As the search patterns from month to month are likely to be volatile within smaller geographic units, we obtained and analyzed the results for Yandex national keywords only. In order to identify the main themes present in keyword results, we hand coded the 85 keyword combinations from the national level Yandex keyword feature in the latest available date range, November 2013. Two Russian-speaking researchers then coded each keyword combination into one of three primary themes.
RQ1: Were There Regularities in the Internet Search Patterns for “Desomorphine” Across Russia in 2011-13?
In the 6 months before the CCM restrictions in June 2012, 21 of Russia’s 89 oblasts had Internet search rates higher than the national average (mean) of 16.67 per 100,000 (see). In the 6 months immediately after restrictions, national average search rates dropped to 9.65 per 100,000. Further, the number of oblasts with a higher than average search rate dropped from 30 to 16. In the 6-month date range from March to August 2013, search rates dropped further to 8.75 per 100,000, with 11 oblasts recording higher than average search rates. However, there were a number of oblasts where searches for “desomorphine” persisted after the federal restriction on CCM sales. These included Sverdlovsk oblast (146.898 before CCM restrictions vs 81.098 post restrictions), Moscow city (31.245 vs 20.586), and Vologda oblast (34.061 vs 17.998). See . A further detailed analysis of subnational search pattern results appears in narrative form in .
|Cities||Pre-ban, 6 months, Dec 2011-June 2012||Post-ban, 6 months, July-Dec 2012||Post-ban, 6 months, Feb-Sept 2013||% change post-ban, 6 months||% change, Feb-Sept 2013|
RQ2: Can Complementary Data Sources Explain the Observed Regularities for “Desomorphine” Across Russia in 2011-13?
To answer this question, we used several complementary sources of krokodil-related data. We found a Spearman correlation of .506 (P≤.001) between searches for the term “desomorphine” and first court appearance data for krokodil related charges for all Russian oblasts. That is a moderately strong positive correlation (see).
Second, we examined national Google Trends results for four CCMs and “desomorphine”. Overall, search volumes for both CCM decreased in the 6 months before the June 2012 federal restrictions, as did searches for the term “desomorphine”. Public interest in CCM and the term desomorphine was roughly similar in the 6 months before the implementation of restrictions. The exception was an increase in search for the CCM pentalgin immediately before the June 2012 restrictions (see). We attribute this marked increase in interest due to public concern over access to CCM for therapeutic analgesic purposes.
Third, we examined Google Trends related terms for CCMs and desomorphine. We found related terms for CCMs consistent with therapeutic and analgesic uses (see). By contrast, related terms for desomorphine were consistent with an interest in the production and use of krokodil. The Google related terms data did not record all search results. We attribute this to the Google “threshold effect” described in earlier analysis of drug policy [ ]. That is, below an unspecified threshold value, Google records a nil value.
|Date range||Pentalgin (пенталгин)||Value||Codelac (коделак)||Value||Desomorphine (дезоморфин)||Value|
|2009-2013||Pentalgin N||100||Codelac broncho||100||Desomorphine how to prepare||100|
|Pentalgin instructions||65||Codelac phyto||75||Desomorphine krokodil||75|
|Pentalgin composition||50||Codelac instructions||75||Krokodil||70|
|Pentalgin price||45||Codelac price||65|
|Dec 2011-May 2012||Pentalgin N||100||Codelac phyto||100||How to prepare desomorphine||100|
|Pentalgin instructions||85||Codelac instructions||100||Krokodil||55|
|July 2012-Aug 2013||Insufficient search volume||Nil||Insufficient search volume||Nil||Insufficient search volume||Nil|
Fourth, we used the Yandex keyword feature to analyze the word combinations used with the search term desomorphine. We found combinations associated with krokodil preparation and use accounted for 46.613% of searches, images, and general information for 24.175%, and ambiguous terms for 29.212% (seeand ). We used Cohen’s Kappa to assess intercoder reliability on all 85 search combinations across three categories using two coders (kappa=.772).
The preparation and use category included all terms associated with drug preparation and use. Images and entertainment included visual material and terms unlikely to be associated with drug use and preparation (eg, “YouTube desomorphine”, “junkies desomorphine”). In summary, we found the combination of search patterns with complementary methods useful for identifying behaviors consistent with an interest in the production and use of krokodil.
We found federal CCM restrictions in June 2012 coincided with changes in the relative scale and spatial patterns of Internet search behaviors consistent with an interest in the production and use of krokodil. These changes in Internet search appeared consistent with behaviors that may be anticipated in the production and use of krokodil in response to changed access to CCM.
We observed marked reductions in searches for the term desomorphine following CCM sales restrictions in June 2012. By comparison with the 6 months preceding federal restrictions, searches dropped by 42.095% nationally (see). However, the patterns of decreased search for “desomorphine” varied considerably. This suggests that CCM restrictions changed but did not extinguish behaviors consistent with an interest in the production and use of krokodil.
Third, we found the Google data available were inadequate for statistical analysis. Insufficient Google Trends data were available to conduct statistical analysis to identify oblasts where krokodil use may be prevalent. Google Trends data were available for only 8 of 83 regions (see).
We identified several complementary data sources that provided a plausible explanation for the observed regularities in Internet search data. First, we found a moderately strong positive correlation (Spearman correlation=.506) between the geographic distribution of court appearances for krokodil-related charges, and Internet searches for the term desomorphine. This result should be treated with some caution. Court appearance data were available for 78 of 83 statistical regions. This may have affected the strength of correlations. More significantly, international researchers generally regard Russian policing as predatory and beyond the rule of law [, ]. A 2010 study of PWID found reports of evidence planted by police, extortion money, arbitrary arrests, and violence to be widespread. Further, Russian court processes are regarded by researchers and Russian public opinion as likely to produce outcomes favoring police and prosecutors [ - ]. Both policing and judicial practices may be expected to distort court appearance data. It is possible that in the absence of these law enforcement practices the strength of correlation may differ. Conversely, the uncertainty surrounding Russian law enforcement data is consistent with descriptions of other data sources used for indirect drug population estimation by international researchers.
Second, the available Google Trends data suggested public interest in CCM and the term desomorphine was roughly similar in the 6 months prior to federal restrictions. However, the searches for CCM and desomorphine-related terms were not identical. The interest in CCM and in desomorphine manifested as different national level search patterns over the date range. While we had insufficient Google data to conduct correlations, this difference is evident on visual inspection (see). Similarly, Google Trends related terms results suggest different themes for “desomorphine” and CCM (see ). Whereas searches for the term desomorphine were associated with illicit drug use themes, the CCM search themes were primarily associated with therapeutic use of drugs. Finally, there is anecdotal evidence from Russian informants that CCM was also widely consumed orally rather than injected prior to the introduction of federal restrictions (P. Meylakhs, Personal Communication, 2014). The restrictions on CCM sales thus also affected oral use of CCM as a recreational drug.
Yandex keyword analysis revealed a consistent pattern of behavior that was consistent with an interest in the production and use of krokodil. Yandex keyword data also revealed a strong popular interest in visual images of desomorphine use (see). Overall, 23.59% of searches were coded as pertaining to the images and general information theme. These graphic images were actively employed in Russian government campaigns aimed at reducing krokodil use. However, the wide distribution of images may also have created a popular demand for viewing necrotic injuries as voyeurism or entertainment. While the available Yandex keyword data were outside of the date range of the study, they reveal persistent interest in behavior consistent with an interest in the production and use of krokodil in Russia.
In summary, we used complementary data sources in order to investigate behaviors consistent with an interest in the production and use of krokodil. Our analysis suggests that these combined complementary sources, including online news sources, provided a useful addition to the conventional approaches used to analyze krokodil use in Russia. Further, our analysis also suggests it is plausible that Yandex search behavior served as a proxy for krokodil production and use in the date range 2011-2012.
Further Research and Limitations
Our research suggests that further research into the use of search patterns for investigating illicit drug use prevalence is warranted. First, search patterns offer researchers and non-government groups an additional source of indirect data with which to track the prevalence of traditional and emerging synthetic drugs at low cost and in near real time. We identified two references to national drug agencies in United Kingdom and Russia using Internet search methods to research patterns of illicit drug use [, ]. Search pattern methods offer non-government groups similar capabilities. Further, the methods described in this paper are directly applicable to the study of other illicit drugs and in Russian-speaking countries where Yandex is widely used alongside Google.
Second, the krokodil case represents an example of a broader class of illicit drug policy events. International and Russian researchers have partially attributed increased use of krokodil to decreased heroin supply after 2009. Similarly, in 2012, government policy blocked easy access to CCM. In each case, existing networks of PWID were disrupted, and patterns of illicit drug use rapidly changed . Combining Internet search and offline qualitative methods would extend understanding of rapid shifts in illicit drug markets and potentially improve public health responses to emerging synthetic drugs. This qualitative research may include existing drug use prevalence, strength of the heroin market, and Internet access among PWID in Russia. In particular, this research would assist researchers with discerning rapid shifts in drug use patterns in response to policy changes and other external shocks to existing illicit drug markets. The relationship of searches for "desomorphine" to other illicit drugs appears in and .
Third, media censorship is increasing in contemporary Russia. However, our analysis of online information relied on measures of unobserved population level demand for online information only. By contrast, censorship may be expected to influence the supply of illicit drug-related information. Russian government actions restricting the supply of illicit drug information are well documented in international literature (eg, [, ]). Future research should investigate the relationship between searches for information and the censored supply of information.
Finally, search methods do not estimate actual drug user population size. However, our research suggests search methods can complement existing drug-using population estimation methods. For example, the Yandex keywords feature potentially provides a novel data source with which to track monthly shifts in keywords for illicit drug–related terms. Keywords measures provide a low-cost method for identifying spatial shifts in the relative scale of public interest in terms that are consistent with an interest in the production and use of novel and emerging illicit drugs in an increasingly complex environment where the opportunities for conventional field work and surveys in Russia for international researchers are decreasing.
Illicit drug use data are generally regarded as difficult to obtain through traditional survey methods. We used complementary methods to explain observed regularities in patterns of Internet search behavior before and after the imposition of Russian federal restrictions on CCM sales in 2012. Our analysis suggests it is plausible that Yandex search behavior served as a proxy for patterns of krokodil production and use during the date range we investigated. More generally, this study demonstrates the application of novel methods recently used by policy makers to both monitor illicit drug use and influence drug policy decision making.
The work of Peter Meylakhs was funded by the Basic Research Program of the National Research University Higher School of Economics, Russia. The authors would also like to thank Ms Svetlana Chernova in Ukraine for her assistance with data collection and coding, Associate Professor James Gillespie at the Menzies Centre for Health Policy, University of Sydney for his advice and support, and Ms Anya Sarang from the Andrey Rylkov Foundation in Moscow for facilitating contacts within Russia.
Conflicts of Interest
Multimedia Appendix 1
Yandex Wordstat Keywords: combinations of words searched for with "desomorphine", November 2013.PDF File (Adobe PDF File), 53KB
Multimedia Appendix 2
Per-capita mean searches for "desomorphine" in all Russian federal regions & subregions (**= region or subregion above national mean).PDF File (Adobe PDF File), 55KB
Multimedia Appendix 3
Analysis of regional Internet search patterns.PDF File (Adobe PDF File), 34KB
Multimedia Appendix 4
Illicit drug search popularity of related terms in Google Trends 2009-2014.JPG File, 282KB
Multimedia Appendix 5
Google searches for popular illicit drugs in the Russian Federation 2009-2014.JPG File, 313KB
- Gahr M, Freudenmann RW, Hiemke C, Gunst IM, Connemann BJ, Schönfeldt-Lecuona C. Desomorphine goes "crocodile". J Addict Dis 2012;31(4):407-412. [CrossRef] [Medline]
- Thekkemuriyi DV, John SG, Pillai U. 'Krokodil'--a designer drug from across the Atlantic, with serious consequences. Am J Med 2014 Mar;127(3):e1-e2. [CrossRef] [Medline]
- TNS Web Index December 2011. Moscow: TNS URL: http://tns-global.ru/media/content/B7525726-B5E1-4C12-BE25-4C543F42F3EE/!Web%20Index%20Report%20201112.zip [accessed 2013-12-13] [WebCite Cache]
- Shuster S. Time. 2011 Jun 20. The curse of the crocodile: Russia's deadly designer drug URL: http://content.time.com/time/world/article/0,8599,2078355,00.html [accessed 2013-12-13] [WebCite Cache]
- Regnum.ru. A new illicit drug, never before seen in Russia has been identified in Komi URL: http://www.regnum.ru/news/accidents/260274.html [accessed 2013-12-13] [WebCite Cache]
- FSKN. A film about desomorphine addicts. 2010. URL: http://www.youtube.com/watch?feature=player_embedded&v=vKHBF_hXits
- RIAN. Experts: Russia is ready for the ban on unrestricted sales of codeine containing medications URL: http://ria.ru/beznarko_law/20120601/662265774.html [accessed 2013-12-10] [WebCite Cache]
- ARF. Results of the Internet survey on the heroin situation in Russia. Drug scene in Russia 2010 URL: http://en.rylkov-fond.org/blog/drug-policy-and-russia/drug-policy-in-russia/drugscene-in-russia/ [accessed 2013-12-14] [WebCite Cache]
- 1tv. More than 20 Russian oblasts will introduce restrictions on sales of codeine containing medications in advance of a federal ban. URL: http://www.1tv.ru/news/social/190424 [accessed 2013-12-13] [WebCite Cache]
- World Drug Report. Vienna: UNODC; 2010. URL: http://www.unodc.org/unodc/en/data-and-analysis/WDR-2010.html [accessed 2014-05-31] [WebCite Cache]
- World Drug Report. Vienna: UNODC; 2012. URL: http://www.unodc.org/unodc/en/data-and-analysis/WDR-2012.html [accessed 2014-05-30] [WebCite Cache]
- RIAN. FSKN states that desomorphine seizures in the Urals have increased by 5 times since 2008 URL: http://ria.ru/beznarko_danger/20111226/527639443.html [accessed 2013-12-10] [WebCite Cache]
- Grund JP, Latypov A, Harris M. Breaking worse: the emergence of krokodil and excessive injuries among people who inject drugs in Eurasia. Int J Drug Policy 2013 Jul;24(4):265-274. [CrossRef] [Medline]
- FSKN. Analysis of desomoprhine use prevalence in the Urals Federal Region including volumes of codeine containing medications. 2011. URL: http://www.ufo.fskn.gov.ru/?articleID=826 [accessed 2013-12-13] [WebCite Cache]
- Booth RE. 'Krokodil' and other home-produced drugs for injection: a perspective from Ukraine. Int J Drug Policy 2013 Jul;24(4):277-278. [CrossRef] [Medline]
- Rospravosudie. Angel dust on the map of Russia. URL: https://rospravosudie.com/society/narko [accessed 2013-12-13] [WebCite Cache]
- Borzunova K. RIAN. The victims of Krokodil URL: http://ria.ru/columns/20111220/521480375.html [accessed 2013-12-14] [WebCite Cache]
- Heimer R. Patterns of new drug emergence: a comment in light of 'krokodil'. Int J Drug Policy 2013 Jul;24(4):275-277 [FREE Full text] [CrossRef] [Medline]
- Eddy NB. Synthetic substances with morphine-like effect: clinical experience; potency, side-effects, addiction liability. Bull World Health Organ 1957;17(4-5):569-863 [FREE Full text] [Medline]
- Priymak A. Desomorphine, drug for the poor, kills all of its victims. 2011 Jun 23. URL: http://english.pravda.ru/hotspots/crimes/23-06-2011/118296-desomorphine-0/ [accessed 2013-12-14] [WebCite Cache]
- Skowronek R, Celiński R, Chowaniec C. "Crocodile"--new dangerous designer drug of abuse from the East. Clin Toxicol (Phila) 2012 Apr;50(4):269. [CrossRef] [Medline]
- RIAN. 2011 Mar 31. Explosion in a house in Rostov on Don while drugs being prepared URL: http://ria.ru/antidrugs/20110331/359573834.html [accessed 2013-12-10] [WebCite Cache]
- Walker S. The Independent. 2011 Jun 22. Krokodil: the drug that eats junkies URL: http://www.independent.co.uk/news/world/europe/krokodil-the-drug-that-eats-junkies-2300787.html [accessed 2013-12-14] [WebCite Cache]
- WHO. Management of common health problems of drug users. New Delhi: WHO SEARO; 2009. URL: http://www.who.int/hiv/topics/idu/drug_dependence/hiv_primary_care_guidelines_searo.pdf [accessed 2013-12-16] [WebCite Cache]
- Degenhardt L, Mathers B, Vickerman P, Rhodes T, Latkin C, Hickman M. Prevention of HIV infection for people who inject drugs: why individual, structural, and combination approaches are needed. Lancet 2010 Jul 24;376(9737):285-301. [CrossRef] [Medline]
- Islam MM, Topp L, Day CA, Dawson A, Conigrave KM. The accessibility, acceptability, health impact and cost implications of primary healthcare outlets that target injecting drug users: a narrative synthesis of literature. Int J Drug Policy 2012 Mar;23(2):94-102. [CrossRef] [Medline]
- Niccolai LM, Verevochkin SV, Toussova OV, White E, Barbour R, Kozlov AP, et al. Estimates of HIV incidence among drug users in St. Petersburg, Russia: continued growth of a rapidly expanding epidemic. Eur J Public Health 2011 Oct;21(5):613-619 [FREE Full text] [CrossRef] [Medline]
- Amirkhanian YA, Kelly JA, Kuznetsova AV, DiFranceisco WJ, Musatov VB, Pirogov DG. People with HIV in HAART-era Russia: transmission risk behavior prevalence, antiretroviral medication-taking, and psychosocial distress. AIDS Behav 2011 May;15(4):767-777 [FREE Full text] [CrossRef] [Medline]
- Wolfe D, Carrieri M, Shepard D. Treatment and care for injecting drug users with HIV infection: a review of barriers and ways forward. Lancet 2010 Jul 31;376(9738):355-366. [CrossRef] [Medline]
- Skobeyda Y. Komsomolskaya Pravda. 2011 Jun 03. Pharmacies freely sell the medications from which illicit drugs are made URL: http://www.kp.md/daily/25696/899094/?cp=0 [accessed 2013-12-14] [WebCite Cache]
- kp.ru. Drug police check pharmacies. 2011 Jun 20. URL: http://www.kp.ru/online/news/916804 [accessed 2013-12-16] [WebCite Cache]
- izvmor.ru. Drug police to investigate sales of medications in pharmacies. 2007 Jan 19. URL: http://old.izvmor.ru/index.php?q=article_981.html [accessed 2014-05-30] [WebCite Cache]
- Yermakov O. Ministerial kickbacks or a corrupt tumour in ministerial families?. 2009 Oct 05. URL: http://www.rospres.com/finance/5240 [accessed 2013-12-14] [WebCite Cache]
- Sterligov I. slon.ru. 2010 May 05. The end of codeine innovations URL: http://slon.ru/business/konec_kodeinovyh_innovaciy-369152.xhtml [accessed 2013-12-14] [WebCite Cache]
- RIAN. 2011 Apr 18. Medvedev calls for closure of websites promoting illicit drugs URL: http://old.rian.ru/society/20110418/365642510.html [accessed 2013-12-10] [WebCite Cache]
- RIAN. 2011 May 16. Bryun: codeine-containing medications should not be demonised in Russia URL: http://ria.ru/beznarko_danger/20110516/377488902.html [accessed 2013-12-10] [WebCite Cache]
- WCIOM. Russian Public Opinion Research Centre. 2011 Jun 07. Codeine containing medication by prescription: for and against URL: http://wciom.ru/index.php?id=459&uid=111674
- RIAN. 2011 May 19. FSKN calls for ban on sale of codeine containing medication without a medical prescription URL: http://ria.ru/society/20110519/376834039.html [accessed 2013-12-10] [WebCite Cache]
- Malinina E. kp.ru. 2011 Dec 12. Astrakhan becomes 10th Russian region to restrict sales of codeine-containing medications URL: http://www.kp.ru/online/news/1039373 [accessed 2013-12-14] [WebCite Cache]
- RIAN. 2012 Jan 01. Codeine containing medication will be sold strictly with a medical prescription in Orenburg oblast URL: http://volga.ria.ru/society/20120101/82047502.html [accessed 2013-12-17] [WebCite Cache]
- RIAN. 2011 Sep 28. Drug den numbers fall in regions where codeine sales restricted URL: http://ria.ru/beznarko_danger/20110928/445240710.html [accessed 2013-12-10] [WebCite Cache]
- aktualno.ru. 2102 Jul 23. Sales of codeine containing medications in Chelyabinsk oblast have fallen by 5 times in 6 months URL: http://aktualno.ru/view2/16359 [accessed 2013-12-14] [WebCite Cache]
- Chernaya E. RIAN. 2012 Jul 24. Sales of codeine containing medications in Tomsk oblast have fallen - FSKN URL: http://ria.ru/beznarko_news/20120724/710654402.html [accessed 2013-12-14] [WebCite Cache]
- Kravtsova K. prm.ru. 2013 Nov 11. Perm locals organised a network of desomorphine laboratories URL: http://prm.ru/accident/292096/ [accessed 2013-12-14] [WebCite Cache]
- Yanyshev A. dvnovosti.ru. 2013 Nov 13. Thieves, addicts and hooligans - a day in the life of police on the beat URL: http://www.dvnovosti.ru/khab/2013/11/13/13491/ [accessed 2013-12-13] [WebCite Cache]
- pravda.ru. 2011 Apr 13. Internet users have become more interested in preparation of drugs URL: http://www.pravda.ru/news/society/13-04-2011/1073604-drugs-0/ [accessed 2013-12-14] [WebCite Cache]
- Zvonkaya A. aifudm.net. 2013 Dec 14. Krokodil eats addicts in Udmutriya oblast URL: http://aifudm.net/news/news31191.html [accessed 2013-12-14] [WebCite Cache]
- Bogdanov V. rg.ru. 2011 Aug 05. Pain without a prescription URL: http://www.rg.ru/2011/08/05/kodein.html [accessed 2013-12-14] [WebCite Cache]
- medvestnik.ru. 2012 Mar 11. FSKN: In 20 regions sales of codeine containing medications have decreased up to thirtyfold URL: http://www.medvestnik.ru/news/fskn_v_20_regionah_rf_prodazhi_kodeinsoderzhaschih_lekarstv_snizilis_do_30_raz/ [accessed 2014-09-07] [WebCite Cache]
- Levada Center. 3013 Sep 03. Which social problems most disturb you, and you consider to be the most important? URL: http://www.levada.ru/03-09-2013/problemy-i-trevogi-rossiyan [accessed 2013-12-14] [WebCite Cache]
- openinform.ru. 2012 May 16. Court case against website closure order by Federal Drug Control Agency begins in Moscow URL: http://openinform.ru/news/unfreedom/16.05.2012/26828/ [accessed 2013-12-14] [WebCite Cache]
- Kolesnikov V. narkotiki.ru. 2009. Weapons of genocide destroying the genofund of the nation URL: http://www.narkotiki.ru/oinfo_6657.html [accessed 2013-12-14] [WebCite Cache]
- Meylakhs P. The Discourse of the Press and the Press of Discourse: The Construction of the Drug Problem in Russian Media. In Critical Readings: Moral Panics and the Media. In: Critcher C, editor. Critical readings: moral panics and the media. Maidenhead, Berkshire: Open University Press; 2006.
- Cohen S. Folk Devils and Moral Panics. New York, NY: Routledge; 2011.
- Jenkins P. Synthetic panics: the symbolic politics of designer drugs. New York, NY: New York University Press; 1999.
- Lancaster AR. What Does Curiosity Really Do to the Cat? A Look at How Message Exposure Can Lead to Illicit Drug Trial Among College Students. Mass Communication and Society 2004 Mar;7(1):77-95. [CrossRef]
- Lancaster K, Hughes CE, Spicer B, Matthew-Simmons F, Dillon P. Illicit drugs and the media: models of media effects for use in drug policy research. Drug Alcohol Rev 2011 Jul;30(4):397-402. [CrossRef] [Medline]
- Dasgupta N, Mandl KD, Brownstein JS. Breaking the news or fueling the epidemic? Temporal association between news media report volume and opioid-related mortality. PLoS One 2009;4(11):e7758 [FREE Full text] [CrossRef] [Medline]
- Davey Z, Corazza O, Schifano F, Deluca P. Mass-information: mephedrone, myths, and the new generation of legal highs. Drugs and Alcohol Today 2010;10(3):24-28. [CrossRef]
- Gallagher CT, Assi S, Stair JL, Fergus S, Corazza O, Corkery JM, et al. 5,6-Methylenedioxy-2-aminoindane: from laboratory curiosity to 'legal high'. Hum Psychopharmacol 2012 Mar;27(2):106-112. [CrossRef] [Medline]
- Report of the International Narcotics Control Board. Vienna: INCB; 2011. URL: http://www.incb.org/documents/Publications/AnnualReports/AR2010/AR_2010_English.pdf [accessed 2013-12-15] [WebCite Cache]
- EC. Eurobarometer: young people and drugs among 15–24 year olds. Analytical report. Dublin: European Commission; 2008. URL: http://ec.europa.eu/public_opinion/flash/fl_233_en.pdf [accessed 2013-12-14] [WebCite Cache]
- Hillebrand J, Olszewski D, Sedefov R. Legal highs on the Internet. Subst Use Misuse 2010 Feb;45(3):330-340. [CrossRef] [Medline]
- Corazza O, Schifano F, Farre M, Deluca P, Davey Z, Torrens M, et al. Designer drugs on the internet: a phenomenon out-of-control? the emergence of hallucinogenic drug Bromo-Dragonfly. Curr Clin Pharmacol 2011 May;6(2):125-129. [Medline]
- Corazza O, Assi S, Schifano F. From "Special K" to "Special M": the evolution of the recreational use of ketamine and methoxetamine. CNS Neurosci Ther 2013 Jun;19(6):454-460. [CrossRef] [Medline]
- Forsyth AJ. Virtually a drug scare: mephedrone and the impact of the internet on drug news transmission. Int J Drug Policy 2012 May;23(3):198-209. [CrossRef] [Medline]
- Eysenbach G. Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet. J Med Internet Res 2009;11(1):e11 [FREE Full text] [CrossRef] [Medline]
- Granka L. Inferring the Public Agenda from Implicit Query Data. Boston, MA: ACM SIGIR Conference; 2009. URL: http://ceur-ws.org/Vol-512/paper07.pdf [accessed 2013-11-05] [WebCite Cache]
- Zheluk A, Quinn C, Hercz D, Gillespie JA. Internet search patterns of human immunodeficiency virus and the digital divide in the Russian Federation: infoveillance study. J Med Internet Res 2013;15(11):e256 [FREE Full text] [CrossRef] [Medline]
- Ayers JW, Ribisl K, Brownstein JS. Using search query surveillance to monitor tax avoidance and smoking cessation following the United States' 2009 "SCHIP" cigarette tax increase. PLoS One 2011;6(3):e16777 [FREE Full text] [CrossRef] [Medline]
- Stephens-Davidowitz S. SSRN Journal. 2012. The Effects of Racial Animus on a Black Presidential Candidate: Using Google Search Data to Find What Surveys Miss URL: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2050673 [accessed 2014-09-05] [WebCite Cache]
- Reis BY, Brownstein JS. Measuring the impact of health policies using Internet search patterns: the case of abortion. BMC Public Health 2010;10:514 [FREE Full text] [CrossRef] [Medline]
- Eysenbach G. Infodemiology: tracking flu-related searches on the web for syndromic surveillance. AMIA Annu Symp Proc 2006:244-248 [FREE Full text] [Medline]
- Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, Brilliant L. Detecting influenza epidemics using search engine query data. Nature 2009 Feb 19;457(7232):1012-1014. [CrossRef] [Medline]
- Chan EH, Sahai V, Conrad C, Brownstein JS. Using web search query data to monitor dengue epidemics: a new model for neglected tropical disease surveillance. PLoS Negl Trop Dis 2011 May;5(5):e1206 [FREE Full text] [CrossRef] [Medline]
- Jena AB, Karaca-Mandic P, Weaver L, Seabury SA. Predicting new diagnoses of HIV infection using internet search engine data. Clin Infect Dis 2013 May;56(9):1352-1353 [FREE Full text] [CrossRef] [Medline]
- Netmarketshare.com. 2011. Search Engine Market Share URL: http://www.netmarketshare.com/report.aspx?qprid=4&qptimeframe=M&qpsp=148
- Crisp T. ComScore Voices. 2011 Jun 27. Yandex: From Russia with Love URL: http://www.comscore.com/Insights/Blog/Yandex-From-Russia-with-Love [accessed 2014-09-07] [WebCite Cache]
- WCIOM. Russian Public Opinion Research Center. 2102 Feb 13. Russians networking: rating of social media URL: http://wciom.ru/index.php?id=459&uid=112476
- TNS Web Index: The audience as a whole. Moscow: TNS; 2013. URL: http://www.tns-global.ru/media/content/B7525726-B5E1-4C12-BE25-4C543F42F3EE/!Web%20Index%20Report%20201212_EN.zip [accessed 2013-12-14] [WebCite Cache]
- Degenhardt L, Bucello C, Calabria B, Nelson P, Roberts A, Hall W, GBD illicit drug use writing group, et al. What data are available on the extent of illicit drug use and dependence globally? Results of four systematic reviews. Drug Alcohol Depend 2011 Sep 1;117(2-3):85-101. [CrossRef] [Medline]
- Reuter P, Trautmann F. Utrecht Eur Comm. 2009. A report on global illicit drugs markets 1998-2007 URL: http://ec.europa.eu/justice/anti-drugs/files/report-drug-markets-short_en.pdf [accessed 2013-12-15] [WebCite Cache]
- Hickman M, Taylor C. Sci Drug Abuse Epidemiol. 2002. Estimating the prevalence of problematic drug use: a review of methods and their application URL: https://www.unodc.org/pdf/bulletin/bulletin_2002_01_01_Art2.pdf [accessed 2013-12-15] [WebCite Cache]
- Law MG, Lynskey M, Ross J, Hall W. Back-projection estimates of the number of dependent heroin users in Australia. Addiction 2001 Mar;96(3):433-443. [CrossRef] [Medline]
- Hall WD, Ross JE, Lynskey MT, Law MG, Degenhardt LJ. How many dependent heroin users are there in Australia? Med J Aust 2000 Nov 20;173(10):528-531. [Medline]
- Degenhardt L, Hall W. Extent of illicit drug use and dependence, and their contribution to the global burden of disease. Lancet 2012 Jan 7;379(9810):55-70. [CrossRef] [Medline]
- Yang AC, Tsai SJ, Huang NE, Peng CK. Association of Internet search trends with suicide death in Taipei City, Taiwan, 2004-2009. J Affect Disord 2011 Jul;132(1-2):179-184. [CrossRef] [Medline]
- gks.ru. All-Russian Census. Moscow, Russia: Russ Fed State Stat Serv; 2012. URL: http://www.gks.ru/free_doc/new_site/perepis2010/croc/perepis_itogi1612.htm [accessed 2013-12-15] [WebCite Cache]
- Zheluk A, Gillespie JA, Quinn C. Searching for truth: internet search patterns as a method of investigating online responses to a Russian illicit drug policy debate. J Med Internet Res 2012;14(6):e165 [FREE Full text] [CrossRef] [Medline]
- Polgreen PM, Chen Y, Pennock DM, Nelson FD. Using internet searches for influenza surveillance. Clin Infect Dis 2008 Dec 1;47(11):1443-1448 [FREE Full text] [CrossRef] [Medline]
- Mellon J. Where and When Can We Use Google Trends to Measure Issue Salience? APSC 2013 Mar 28;46(02):280-290. [CrossRef]
- Aleksandrov M. Vechernyaya Moskva. 2011 Feb 23. The codeine itch URL: http://moskva.bezformata.ru/listnews/kodeinovij-zud/522253/ [accessed 2014-05-30] [WebCite Cache]
- Google.com. 2011. What are top searches? URL: https://support.google.com/trends/answer/4355000?hl=en&rd=1 [accessed 2014-09-05] [WebCite Cache]
- Rhodes T, Platt L, Sarang A, Vlasov A, Mikhailova L, Monaghan G. Street policing, injecting drug use and harm reduction in a Russian city: a qualitative study of police perspectives. J Urban Health 2006 Sep;83(5):911-925 [FREE Full text] [CrossRef] [Medline]
- Gerber TP, Mendelson SE. Public Experiences of Police Violence and Corruption in Contemporary Russia: A Case of Predatory Policing? Law Soc Rev 2008 Mar;42(1):1-44. [CrossRef]
- Kurkchiyan M. The illegitimacy of law in post-Soviet societies. Law and Informal Practices: The Post-Communist Experience 2003:25-46. [CrossRef]
- Hendley K. Cardozo Journal of International and Comparative Law. 2006. Assessing the rule of law in Russia URL: https://media.law.wisc.edu/m/ytdxn/assessing_rol.pdf [accessed 2014-09-06] [WebCite Cache]
- ARF. rylkov-fond.org. 2012. Additional information to the Report to the ICESCR on implementation by the RF of article 12 of the International Covenant on ESCR as it relates to access of people who inject drugs to drug treatment and HIV prevention, care and treatment programs URL: http://en.rylkov-fond.org/wp-content/uploads/2012/01/AndreyRylkovFoundation_RussianFederation_CESCR46-eng.pdf [accessed 2013-12-15] [WebCite Cache]
- Parfitt T. Vladimir Mendelevich: fighting for drug substitution treatment. The Lancet 2006 Jul;368(9532):279. [CrossRef]
|CCM: codeine-containing medication|
|HIV: human immunodeficiency virus|
|PWID: people who inject drugs|
|FSKN: Russian Federal Drug Control Service|
Edited by G Eysenbach; submitted 21.12.13; peer-reviewed by R Heimer, G Woody; comments to author 28.04.14; revised version received 03.06.14; accepted 22.08.14; published 18.09.14
©Andrey Zheluk, Casey Quinn, Peter Meylakhs. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 18.09.2014.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.