Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 02.06.20 in Vol 22, No 6 (2020): June

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/17104, first published Apr 30, 2020.

This paper is in the following e-collection/theme issue:

    Original Paper

    Modifications to Electronic Nicotine Delivery Systems: Content Analysis of YouTube Videos

    1School of Public Health, Georgia State University, Atlanta, GA, United States

    2Department of Communication Studies and Department of Public Health, The College of New Jersey, Ewing, NJ, United States

    3Research and Training Institute, John Snow Incorporated, Boston, MA, United States

    4Department of Communication, University of Arizona, Tuscon, AZ, United States

    Corresponding Author:

    Lucy Popova, PhD

    School of Public Health

    Georgia State University

    P.O. Box 3995

    Atlanta, GA, 30302-3995

    United States

    Phone: 1 4044139338

    Fax:1 4044131140

    Email: lpopova1@gsu.edu


    ABSTRACT

    Background: As user modification can alter the addictiveness and toxicity of electronic nicotine delivery systems (ENDS), more research is needed to understand the types, motivations, risks, and information sources that lead to these product alterations. YouTube has been identified as a major platform where ENDS users obtain and share information about ENDS products and modifications. However, a comprehensive study of ENDS modification videos on YouTube is lacking.

    Objective: This study aimed to analyze the content of YouTube videos depicting modifications of ENDS.

    Methods: YouTube was searched in March 2019 to identify videos depicting ENDS modifications. Search terms were derived from interviews with ENDS users and current literature. We used 28 search phrases that combined the words vape and vaping with modification-related key terms (eg, custom build, modification, and dripping). The final sample included 168 videos.

    Results: Videos were 1 to 108 min long (median 9.55). Presenters were largely male (117/168, 69.6%), white (94/168, 56.0%), and older than 25 years (94/168, 56.0%). Most videos gave how to instructions (148/168, 88.1%), but few offered warnings (30/168, 17.9%) or mentioned commercial alternatives to modifications they presented (16/168, 9.5%). The ENDS devices most often featured were drippers (63/168, 37.5%) and refillable tanks (37/168, 22.0%). The most often modified ENDS components were coils (82/168, 48.8%) and e-liquids (34/168, 20.2%), which included adding other substances, such as cannabis, to the e-liquids (6/168, 3.6%). Most videos portrayed ENDS modifications positively (106/168, 63.1% positive; 60/168, 35.7% neutral; and 2/168, 1.2% negative) and were either neutral or positive in their overall portrayal of ENDS devices (78/168, 46.4% positive; 89/168, 53.0% neutral; and 1/168, 0.6% negative).

    Conclusions: This study identified several concerning trends in popular YouTube videos on ENDS modifications, including lack of warnings, the addition of marijuana derivatives to e-liquids, and the positive portrayal of ENDS devices and modifications. By identifying the types of modifications (coil and e-liquid being the most prevalent), this study sets an agenda for research on the effects of modifications.

    J Med Internet Res 2020;22(6):e17104

    doi:10.2196/17104

    KEYWORDS



    Introduction

    Background

    Since the mid-2000s, electronic nicotine delivery systems (ENDS) have become an increasingly popular method for inhaling nicotine from tobacco in the United States [1]. As a category, ENDS include a wide variety of products consisting of a battery, a heater (coil), a mouthpiece, and a chamber containing e-liquid (a solution of propylene glycol [PG] or vegetable glycerine [VG] and other chemicals, usually nicotine and flavors). The heater vaporizes the e-liquid, producing an aerosol that is inhaled. ENDS can also be called vapes, e-hookahs, and e-cigarettes. Since June 2019, an outbreak of lung disease linked to vaping and the use of ENDS has sickened 2506 and killed 54 people [2]. Although this outbreak is ongoing, the US Centers for Disease Control and Prevention urges ENDS users not to modify the products or add substances not intended by the manufacturer, highlighting the potential role ENDS modifications might play in this outbreak [3]. For this study, we define modification as both product misuse and tampering unintended by the manufacturers as well as alteration, customization, adjustment, and user choice of e-liquid or accessories made within manufacturer specifications. Examples of ENDS modifications include coil replacement, mixing of e-liquids, or increasing battery voltage. Although some users view the modifiability of ENDS devices as a positive attribute [4,5], research has found that modifications can have harmful effects, such as creating higher levels of toxic emissions when users increase power to the coil [6-8]. Given the popularity of ENDS and health risks from modification, research is needed to understand the primary ways ENDS are modified by users.

    To date, little research has described the methods of ENDS modifications. YouTube is the most popular video-sharing site in the world [9], and there are a large number of ENDS videos on YouTube [10], including videos about ENDS modifications [11]. YouTube has been identified as a major platform where ENDS users obtain and share information about ENDS products and modifications [12-14]. However, a comprehensive study of ENDS modification videos on YouTube is lacking. One recent study examined YouTube videos depicting orthodox (intended by manufacturer) and unorthodox (unintended by the manufacturer) ENDS modifications [11]. Results showed that videos depicting unorthodox use were three times more prevalent than videos depicting orthodox use, although the analysis only focused on open devices and e-liquids and not on closed devices [11]. Furthermore, the sample was collected in 2016 and may not account for recent trends in ENDS modification. A more in-depth study is needed to update and assess the breadth of ENDS modifications on YouTube.

    Objectives

    In this paper, we examined YouTube videos posted between 2013 and 2019 showing modifications of ENDS devices pertaining to hardware (eg, coil, battery, pods, and other modifications) and e-liquids. Our objective was to understand the video features (including presenter characteristics, if applicable) as well as the types, motivations, communication of risks, and information sources of ENDS modifications. Although other studies have examined the social acceptability of ENDS on YouTube [15], unorthodox use of ENDS on YouTube [11], and promotion of vape tricks on YouTube [16], this study, to the best of our knowledge, is the first to analyze modifications to the full spectrum of ENDS devices on YouTube.


    Methods

    Identifying Electronic Nicotine Delivery Systems Modification Videos

    YouTube was searched on March 15, 2019, to identify videos depicting ENDS modifications. An account was created on an incognito (private) browser to ensure browsing history did not influence the results. Search terms were derived from interviews with ENDS users [14] and the current literature [10] indicating that “vape” and “vaping” are common and inclusive terms used by ENDS enthusiasts to describe a number of different ENDS devices. Search phrases included the following: “vape DIY (ie, do it yourself),” “vape build DIY,” “vape custom build,” “vape modification,” “vape rebuild DIY,” “vape coil rebuild,” “vape coil DIY,” “vape ohm rebuild,” “vape ohm DIY,” “vape e-juice DIY,” “vape e-juice custom build,” “vape voltage DIY,” “vape voltage custom build,” “vape RBA (ie, rebuildable atomizer) custom build,” “vape RBA DIY,” “vape dripping custom build,” “vape dripping DIY,” “vape refill custom build,” “vape refill DIY,” “vaping custom build,” “vaping DIY,” “vaping modif* custom build,” “vaping rebuild DIY,” “mods rebuild DIY,” “vape chang* DIY,” “vape chang* custom build,” “vape wattage DIY,” and “vape wattage custom build.” Search terms were entered into the YouTube search engine, and the top 10 results for each phrase were included (N=280). After removing duplicates, non-English videos, and those not presenting ENDS modifications, 207 videos remained. Each video was reviewed by trained coders to ensure that the content included ENDS modifications. This verification process excluded 39 videos, resulting in a final sample of 168 videos. This study was approved by the Georgia State University Institutional Review Board (H19055).

    Coding Scheme

    We developed a codebook based on interviews with ENDS users [14], previous literature [10,15], and expert consensus. By expert consensus, we refer to review by our interdisciplinary team of collaborators with substantial expertise in ENDS use behavior and ENDS product research. We collected information on the attributes of the videos (eg, length, number of views, number of likes and dislikes, and date of posting). We coded the video source as individual, retailer, manufacturer, or group or organization. We noted whether the videos included links to vendors, whether the videos were followed by other modification videos via YouTube’s auto-play feature (ie, showing content based on user search history), gave how to instructions, included a warning (a warning statement about the health risks of smoking or a formal, legal, or conflict of interest disclaimer), or offered information about commercially available alternatives to modifications. If a person appeared in the video, we recorded if it was a single presenter or multiple presenters and their sex (male or female), race (white, black, other, or cannot be determined), and estimated age range (youth: younger than 18 years, young adult: approximately 18-25 years, or adult: older than 25 years). We classified the device(s) featured in the video as dripper, refillable tank, closed pod, refillable pod, home-built refillable tank, cig-a-like, squonk, 2-pod systems, and stem/salt hybrid [17]. Definitions for ENDS devices are provided in Table 1. If multiple devices were shown in a single video, all devices, regardless of their prominence, were included in the coding.

    Table 1. Content codes for electronic nicotine delivery systems devices (N=168) and the percentage and number of videos in the final sample that featured each device type.
    View this table

    We developed a coding scheme to capture ENDS modifications to the coil, e-liquid, battery, pods, and other modifications. For each type of modification, we developed codes for common reasons for this modification, including an other option with text descriptions. Each modification was coded as 1 (present) or 0 (absent). The detailed codes with descriptions for modifications and reasons are presented in Table 2.

    Finally, we coded the video’s tone toward the featured ENDS modification and ENDS devices in general as positive, neutral, or negative.

    Table 2. Codes and definitions of modifications and reasons for modifications (N=168).
    View this table

    Video Coding

    The coding team consisted of 5 members, who received a minimum of four 2-hour training sessions. The coders coded 5 to 10 videos for each training session, and discrepancies were discussed and resolved. Training videos were not included in the final data analysis because the code book was further revised during the training. To establish intercoder reliability, approximately 15% of videos (25/168, 14.9%) were randomly selected from the final sample. Due to the large amount of time spent to code each video, sequential-overlapping coding was used for reliability testing [18]. Specifically, each of the 25 videos was coded by 2 coders, and each coder coded 10 videos in total. Using Randolph’s free-marginal kappa [19,20], the intercoder reliability of each variable was high, ranging from 0.74 to 1.0. The remaining videos were then divided and independently coded by 4 coders.

    Data Analysis

    Data were analyzed using IBM SPSS 25. Descriptive statistics were performed to assess the frequency of each coding variable.


    Results

    Characteristics of Videos, Presenters, and Device Types

    Videos (N=168) ranged from 1 to 108 min in length (median 9.55) and accounted for a total of 112,043,718 views (median 168,234) as of March 15, 2019. Videos had more likes than dislikes (12 to 1 ratio). Examining videos by year showed an increase from 2013 (2/168, 1.2%) to 2014 (19/168, 11.3%), to 2015 (27/168, 16.1%), to 2016 (34/168, 20.2%), peaking in 2017 (51/168, 30.4%), and decreasing from 2018 (29/168, 17.3%) to 2019 (6/168, 3.6%). The most common source for videos were individuals (135/168, 80.4%), followed by retailers (18/168, 10.7%), manufacturers (8/168, 4.8%), and groups/organizations (7/168, 4.2%). A majority of videos (120/168, 71.4%) provided a link to a vendor’s site, and most videos (136/168, 81.0%) were followed by another modification video via auto-play. Most videos gave how to instructions (148/168, 88.1%); few videos offered warnings (30/168, 17.9%) or mentioned commercially available alternatives (16/168, 9.5%).

    Most videos showed 1 or more persons (125/168, 74.5%), and presenters were largely male (117/168, 69.6%), white (94/168, 56.0%), and appeared to be adults older than 25 years (94/168, 56.0%). Modifications were most frequently performed on drippers (63/168, 37.5%) and refillable tanks (37/168, 22.0%; Table 3).

    Table 3. Modification by device type.
    View this table

    Coil Modifications

    Modifications to the coil were the most frequently portrayed; building coils from scratch was featured in 35.7% (60/168) of the videos. Coil replacement with a manufactured alternative was depicted in 5.4% (9/168) of videos, and 4.8% (8/168) of the videos showed how to alter coil voltage through controls in the device. Less than 0.6% (1/168) of the videos gave instructions on how to alter the number of coils in the device, and 1.8% (3/168) showed how to replace coils with a wire of different gauge. Only 1.2% (2/168) of the videos showed how to clean the coils in a nonmodifiable pod.

    Reasons for modifying in many of the coil videos (31/168, 18.5%) were not in the prespecified list. Among these reasons, building coils from scratch (17/168, 10.1%) and enhancing flavor (6/168, 3.6%) were the most commonly described. Building coils from scratch included home builds (necessitating a new coil) and adding coils in store-bought devices. According to the presenters, enhancing flavor can be achieved by changing the wire gauge (eg, 28 vs 24 gauge), wire composition (eg, nickel vs stainless steel), or number of wire wraps. Increasing voltage was also listed as a reason for modifying coils (9/168, 5.4%).

    The most viewed coil modification video (3,017,588 views) shows a presenter instructing the audience on how to build a sleeper coil (ie, double-wrapped coil made from a single wire). The tutorial includes instructions on how to wrap the coil and attach it to the battery posts. The how to portion is book-ended by discussion and demonstration of the modification. Before the tutorial, the presenter describes how the sleeper coil heats e-liquid efficiently, producing a greater cloud and better flavor. After the tutorial, the presenter vapes to demonstrate the size of his aerosol cloud, presumably the result of the sleeper coil.

    Modifications of E-Liquids

    Modifications of e-liquids were depicted in 20.2% (34/168) of videos. Many of the e-liquid modification videos showed mixing (20/168, 11.9%; eg, mixing store-bought glycol). Separately, 1.8% (3/168) of videos included mixing liquids to increase nicotine levels. Adding other substances (eg, cannabis oil) was found in 3.6% (6/168) of videos.

    Enhancing flavor (16/168, 9.5%) and saving money (10/168, 6.0%) were reasons given for e-liquid modifications, as were other reasons (15/168, 8.9%). Descriptions of other reasons included creating better clouds, making nicotine-free liquid, and creating marijuana e-liquid. Overall, e-liquid modifications centered on allowing users to control the flavor, price, and composition of e-liquids.

    The most viewed e-liquid mixing video (1,769,171 views) shows how to make e-liquids with store-bought materials. The presenter’s face is not shown, although the video is narrated. The presenter describes 4 components necessary to make e-liquid: VG, PG, premixed liquid nicotine (75% VG and 25% PG), and store-bought flavoring (eg, strawberry and banana). Before mixing the components, the presenter uses a web-based e-liquid calculator. The calculator uses batch size, nicotine strength (mg/ml), and VG/PG ratio to calculate the mixing recipe. However, the calculator does not account for the addition of flavor. Therefore, the presenter explains the conversion necessary to add these liquids. At the completion of the conversion, the presenter combines the liquids in a cylinder and then attaches a clamp to a power drill, wraps the clamp fingers around the cylinder, and engages the drill, spinning the cylinder and mixing the liquids within. The liquid is then steeped in warm water to allow the ingredients to blend together. The video closes by encouraging viewers to document mixes in a spreadsheet.

    The most viewed adding substances video (717,781 views) gives a tutorial on how to make weed e-cig juice. The presenter bakes marijuana on a cooking sheet, breaks it apart by hand, and mixes it with VG. After 3 months of iteratively adding glycerin and remixing the solution, the presenter strains marijuana-infused glycerin through a mesh and then injects the liquid into an ENDS tank. The video closes with the presenter blowing vapor clouds over an advertisement for marijuana accessories. Among the adding substances videos, most (5 of 6) focused on adding marijuana derivatives to e-liquids.

    Battery Modifications

    No videos showed modifications to increase battery power, change configurations, or add additional batteries. The only videos coded for battery modifications were those in the other battery modification category (13/168, 7.7%), which showed variations of adding batteries to home-built devices. Examining descriptions for the other category showed that all entries were home builds, either adapting household items (eg, a flashlight) or using commercially made parts. Adapting household items to create a vape involved a premade battery, whereas building from scratch sometimes required wiring batteries. This distinction could indicate differences in battery modification hazards.

    The most viewed (1,645,630 views) battery modification video transforms a flashlight into an ENDS device. The presenter does not address the audience, but text is displayed to highlight important steps. In the video, the presenter disassembles a flashlight and uses the parts as well as household materials to create a small vape. The body of the flashlight is retrofitted to hold a battery and the head with an atomizer (ie, a coil and wick attached to battery posts housed on a deck). The flashlight button engages the battery, heating the coil and producing a stream of vapor from the atomizer. The battery does not require wiring and appears to be a standard battery consistent with those used in any flashlight.

    Other battery videos, however, depict more advanced constructions. One example (763,291 views) shows how to build a box mod, which is a highly modifiable ENDS device characterized by a removable atomizer, open tank, and accessible battery housing. The presenter walks the audience through the build, which includes wiring of 2 lithium polymer batteries (ie, LiPo) into the device. LiPos are lightweight batteries that can explode if they are overcharged. Such explosions have been linked to injury of ENDS users [21]. The presenter warns viewers not to let battery wires touch during construction. However, the breadth of the hazard is not disclosed, and the video contains no warnings about the danger of explosions.

    Modifications of Pods and Cartridges

    A pod is a cartridge containing e-liquids to be inserted in an ENDS device. When the liquid is gone, many manufacturers intend that the cartridge is discarded and not reused (although there are some refillable pods on the market). Refilling nonreusable pods with e-liquid was found in 5.4% (9/168) of videos. The primary reasons for pod modifications (7/168, 4.2%) were not in the specified list, and thus, they were coded as other. Descriptions of other reasons included customizing the look of devices, increasing vapor production, and enhancing flavor. Extending the life of a pod was listed as a reason for 2.4% (4/168) of videos.

    An example of pod modification (182,621 views) depicts a presenter changing the liquid in a nonreusable pod. In the video, the presenter uses scissors to open the cartridge. The presenter pours the liquid into another container, cleans the pod, and then refills it with an e-liquid called Heisenberg (fruit-flavored menthol). After the refill, the presenter takes several drags until the tobacco flavor is gone, and only Heisenberg remains. In this case, the pod modification is motivated by the choice of the flavor.

    Other Modifications

    Only 1.2% (2/168) of videos showed modifications to the software regulating built-in controls. Replacement of an existing device with another with improved features was found in 0.6% (1/168) of videos, whereas replacing an existing device with another device with additional features was featured in 1.8% (3/168) of videos. Although drippers were the most featured devices (63/168, 37.5%), our analyses did not show any instances of converting nondripping devices to drippers.

    Finally, 13.1% (22/168) of videos did not fit within our specified coding categories and were coded as other modifications. These videos showed building ENDS as the primary activity. Several videos depicted unusual builds, such as creating a vape from an empty mint box or adapting a soda can into an e-liquid tank. One unique example (66,573 views) showed how to build an ENDS in the dashboard of a car. Other videos showed how to make drip tips to replace lost mouthpieces for drippers. In one example (85,006 views), the mouthpiece was made from a copper plumbing fitting. Together, videos coded as other showed unique modification behaviors mostly related to building from scratch.

    Tone

    Most videos used a positive tone to portray ENDS modifications (106/168, 63.1% positive; 60/168, 35.7% neutral; and 2/168, 1.2% negative) but were either neutral or positive in their portrayal of ENDS devices (78/168, 46.4% positive; 89/168, 53.0% neutral; and 1/168, 0.6% negative).


    Discussion

    Principal Findings

    This study provides information about the ways in which users modify ENDS devices on YouTube. Results identified several concerning trends, including lack of warnings, addition of marijuana derivatives to e-liquids, and the positive portrayal of ENDS devices and modifications. Regarding specific modifications, the most often modified components were coils and e-liquids. Modifications to the wick and battery were less often discussed. The sample of modification videos did not depict potentially harmful practices identified in past literature, such as modifying a device for dripping or increasing battery power. Together, these results help inform public health researchers by identifying trends in ENDS modifications on YouTube, the most popular video-sharing website in the world [9] and a primary source of information on ENDS devices and modifications [11,15,16].

    Our findings identified several concerning trends in modification videos. Specifically, the majority of videos gave how to instructions without warning viewers about potential dangers (eg, exploding batteries or lung exposure to harmful constituents). The majority also failed to mention commercially available alternatives, which could be less dangerous than home-grown modifications. ENDS devices and modifications were also depicted in a favorable light, and a majority of videos were followed by another modification video, likely the result of YouTube’s default auto-play feature, which queues similar content based on search history. In a situation where YouTube users search for ENDS modifications, favorable portrayals and lack of warnings, coupled with auto-play features, could potentially create a self-reinforcing loop where users search for modification videos. The dangers of modifications are underemphasized to viewers, and these videos are followed by additional videos portraying ENDS in a favorable light, further underemphasizing the dangers of modification. Repeated, user-driven exposure to videos underemphasizing risks could normalize ENDS modifications, which is of particular concern given YouTube’s primary audience.

    YouTube is the most popular video-sharing site in the world [9], and YouTube has been identified as a major platform where ENDS users obtain and share information about ENDS products and modifications [12-14]. Many YouTube users are young, with 81% of those aged 15 to 25 years in the United States using YouTube [22]. This demographic is often targeted by tobacco companies [23,24] and is a group that often experiments with cigarettes and ENDS [25]. Positive portrayals of modifications without safety warnings, which are algorithmically linked and shown in sequence to impressionable audiences, bear serious consideration from tobacco control experts. Future research may explore how YouTube modification videos could potentially detract from nicotine cessation campaigns aimed at youth and young adults.

    Altering the coil was the most prevalent type of modification in our study. Little research has investigated the effects of exposure to the components of coils on user health. One notable study tested e-liquids for neurotoxicants before and after contact with ENDS devices [26]. Results showed higher levels of toxic metals in the aerosol, suggesting that the contamination resulted from the contact of e-liquids with the metals in ENDS devices, including coils. As coil modifications were most prevalent in our analysis, we suggest future research investigating possible health effects of coil modifications.

    E-liquid was the second most often modified characteristic in our sample. E-liquid modifications included mixing from scratch and adding other substances. In terms of mixing, most videos cited a desire to control the flavor as a reason for the modification. This finding is informative given the recent interest among policy makers to ban flavored e-liquids from the market [27]. Regulatory policy should consider how regulating ENDS flavors might influence the likelihood that these actions will impact the frequency at which consumers mix their own flavored e-liquids.

    Marijuana derivatives were used in most videos depicting substances added to e-liquids. This finding is significant given the recent outbreak of vaping-related lung disease [28]. Early investigation revealed that the majority of patients had a history of vaping tetrahydrocannabinol (THC) products, suggesting that the outbreak may be related to the source of THC or vaping THC in a device intended to be used with nicotine [29]. Given the deadly nature of the new vaping lung disease, this particular modification may demand greater scrutiny from public health experts.

    Tampering with devices to expose heating coils for dripping has been cited as a modification trend in past research [30]. Yet, none of the videos in our sample showed how to adapt a nondripping device into a dripper. This finding resonates with recent interviews of ENDS enthusiasts, indicating that dripping modifications may be less frequent due to increased availability of commercially produced drippers and other devices that were previously only available via users’ modifications [14]. However, it should be noted that drippers were the most featured devices in YouTube videos. Thus, although dripping conversions were absent in our sample, modifications to drippers were frequent.

    Although exploding batteries are a risk [6], we found only a few videos on battery modifications. They were generally associated with building ENDS mods from scratch and showed some dangerous practices (eg, wiring LiPo batteries) that have not been widely discussed previously.

    Limitations

    As this sample was collected in early 2019, it is unclear if the decline in videos on ENDS modifications we observed since 2017 will continue. Although this decrease corroborates our findings from interviews with ENDS enthusiasts [14], more research is needed to determine if this decrease continues. As this study was conducted before the first cases of e-cigarette– and vaping-associated lung injury were reported, we do not know what impact this outbreak may have had on ENDS modification activities. Our search keywords were not exhaustive and may not capture all ENDS modification videos on YouTube. Due to the variation of ENDS modification videos, our results are descriptive. More research is needed to isolate and identify causal mechanisms that motivate modification behaviors. This work informs future population-level surveillance research aimed at identifying motivations for modifying ENDS devices.

    Conclusions

    Our content analysis of the full spectrum of ENDS devices and modifications in YouTube videos identified several concerning trends, including lack of warning to viewers, addition of marijuana derivatives to e-liquids, and the positive portrayal of ENDS devices and modifications. At the same time, our analysis did not find certain modifications (eg, dripper conversions or battery tampering), which have been identified previously as a public health concern. By identifying the types of modifications (with modifications to coil and e-liquid being the most prevalent), this study provides a foundation for assessing the prevalence of ENDS modifications in the population and informs the agenda for research assessing the health effects resulting from ENDS modifications.

    Acknowledgments

    Research reported in this publication was supported by the National Institute of Drug Abuse of the National Institutes of Health and Food and Drug Administration Center for Tobacco Products (R01DA047397). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or the Food and Drug Administration.

    Authors' Contributions

    ZBM wrote the first draft. YL and J Holli conducted the data analysis. DLA and LP conceptualized the study and wrote the implications. YL, J Holli, BY, KH, and VC coded videos. All authors contributed to the writing and revision and approved the final version of the manuscript.

    Conflicts of Interest

    DLA has received funds for work done for the World Health Organization Tobacco Free Initiative, has worked as a consultant for Pfizer and McKing Consulting, Inc, and has worked as a Special Government Employee of the US Food and Drug Administration.

    References

    1. McMillen RC, Gottlieb MA, Shaefer RM, Winickoff JP, Klein JD. Trends in electronic cigarette use among US adults: use is increasing in both smokers and nonsmokers. Nicotine Tob Res 2015 Oct;17(10):1195-1202. [CrossRef] [Medline]
    2. Centers for Disease Control and Prevention. 2019. Outbreak of Lung Injury Associated with the Use of E-Cigarette, or Vaping, Products   URL: https://www.cdc.gov/tobacco/basic_information/e-cigarettes/severe-lung-disease.html [accessed 2019-10-14]
    3. Centers for Disease Control and Prevention. 2020. Smoking & Tobacco Use: Frequently Asked Questions   URL: https:/​/www.​cdc.gov/​tobacco/​basic_information/​e-cigarettes/​severe-lung-disease/​need-to-know/​index.​html [accessed 2019-10-14]
    4. Bala MM, Strzeszynski L, Topor-Madry R. Mass media interventions for smoking cessation in adults. Cochrane Database Syst Rev 2017 Nov 21;11:CD004704 [FREE Full text] [CrossRef] [Medline]
    5. Majmundar A, Kirkpatrick M, Cruz TB, Unger JB, Allem JP. Characterising KandyPens-related posts to Instagram: implications for nicotine and cannabis use. Tob Control 2019 May 30:- epub ahead of print. [CrossRef] [Medline]
    6. Kosmider L, Sobczak A, Fik M, Knysak J, Zaciera M, Kurek J, et al. Carbonyl compounds in electronic cigarette vapors: effects of nicotine solvent and battery output voltage. Nicotine Tob Res 2014 Oct;16(10):1319-1326 [FREE Full text] [CrossRef] [Medline]
    7. Sleiman M, Logue JM, Montesinos VN, Russell ML, Litter MI, Gundel LA, et al. Emissions from electronic cigarettes: key parameters affecting the release of harmful chemicals. Environ Sci Technol 2016 Sep 6;50(17):9644-9651. [CrossRef] [Medline]
    8. Talih S, Balhas Z, Salman R, Karaoghlanian N, Shihadeh A. 'Direct dripping': a high-temperature, high-formaldehyde emission electronic cigarette use method. Nicotine Tob Res 2016 Apr;18(4):453-459 [FREE Full text] [CrossRef] [Medline]
    9. Alexa. The Top 500 Sites on the Web   URL: https://www.alexa.com/topsites [accessed 2019-10-14]
    10. Huang J, Kornfield R, Emery SL. 100 million views of electronic cigarette YouTube videos and counting: quantification, content evaluation, and engagement levels of videos. J Med Internet Res 2016 Mar 18;18(3):e67 [FREE Full text] [CrossRef] [Medline]
    11. Guy MC, Helt J, Palafox S, Green K, Soule EK, Maloney SF, et al. Orthodox and unorthodox uses of electronic cigarettes: a surveillance of YouTube video content. Nicotine Tob Res 2019 Sep 19;21(10):1378-1384 [FREE Full text] [CrossRef] [Medline]
    12. McCausland K, Maycock B, Leaver T, Jancey J. The messages presented in electronic cigarette-related social media promotions and discussion: scoping review. J Med Internet Res 2019 Feb 5;21(2):e11953 [FREE Full text] [CrossRef] [Medline]
    13. Collins L, Glasser AM, Abudayyeh H, Pearson JL, Villanti AC. E-cigarette marketing and communication: how e-cigarette companies market e-cigarettes and the public engages with e-cigarette information. Nicotine Tob Res 2019 Jan 1;21(1):14-24 [FREE Full text] [CrossRef] [Medline]
    14. Li Y, Fairman RT, Churchill V, Ashley DL, Popova L. Users' modifications to electronic nicotine delivery systems (ENDS): interviews with ENDS enthusiasts. Int J Environ Res Public Health 2020 Feb 2;17(3):e918 [FREE Full text] [CrossRef] [Medline]
    15. Luo C, Zheng X, Zeng DD, Leischow S. Portrayal of electronic cigarettes on YouTube. BMC Public Health 2014 Oct 3;14:1028 [FREE Full text] [CrossRef] [Medline]
    16. Kong G, LaVallee H, Rams A, Ramamurthi D, Krishnan-Sarin S. Promotion of vape tricks on YouTube: content analysis. J Med Internet Res 2019 Jun 18;21(6):e12709 [FREE Full text] [CrossRef] [Medline]
    17. Harrell PT, Eissenberg T. Automated dripping devices for vapers: RDTAs, bottomfeeders, squonk mods and dripboxes. Tob Control 2018 Jul;27(4):480-482 [FREE Full text] [CrossRef] [Medline]
    18. Neuendorf KA. The Content Analysis Guidebook. Thousand Oaks, California: Sage Publications; 2016.
    19. Randolph JJ. Free-Marginal Multirater Kappa (multirater K[free]): An Alternative to Fleiss' Fixed-Marginal Multirater Kappa. In: Proceedings of the Joensuu Learning and Instruction Symposium. 2005 Presented at: JLIS'05; October 14-15, 2005; Joensuu, Finland   URL: https://eric.ed.gov/?id=ED490661
    20. Randolph JJ. Justus Randolph. 2008. Online Kappa Calculator   URL: http://justusrandolph.net/kappa/ [accessed 2019-10-01]
    21. Nicoll KJ, Rose AM, Khan MA, Quaba O, Lowrie AG. Thigh burns from exploding e-cigarette lithium ion batteries: first case series. Burns 2016 Jun;42(4):e42-e46. [CrossRef] [Medline]
    22. Clement J. Statista. 2019. Percentage of US Internet Users who Use YouTube as of 3rd Quarter 2019, by Age Group   URL: https://www.statista.com/statistics/296227/us-youtube-reach-age-gender/ [accessed 2020-02-14]
    23. Henriksen L, Schleicher NC, Dauphinee AL, Fortmann SP. Targeted advertising, promotion, and price for menthol cigarettes in California high school neighborhoods. Nicotine Tob Res 2012 Jan;14(1):116-121 [FREE Full text] [CrossRef] [Medline]
    24. Pierce JP, Messer K, James LE, White MM, Kealey S, Vallone DM, et al. Camel No. 9 cigarette-marketing campaign targeted young teenage girls. Pediatrics 2010 Apr;125(4):619-626. [CrossRef] [Medline]
    25. Centers for Disease Control and Prevention. 2015. E-Cigarette Use Triples Among Middle and High School Students in Just One Year   URL: http://www.cdc.gov/media/releases/2015/p0416-e-cigarette-use.html [accessed 2019-10-14]
    26. Olmedo P, Goessler W, Tanda S, Grau-Perez M, Jarmul S, Aherrera A, et al. Metal concentrations in e-cigarette liquid and aerosol samples: the contribution of metallic coils. Environ Health Perspect 2018 Feb 21;126(2):027010 [FREE Full text] [CrossRef] [Medline]
    27. US Food and Drug Administration. 2019. Trump Administration Combating Epidemic of Youth E-Cigarette Use with Plan to Clear Market of Unauthorized, Non-Tobacco-Flavored E-Cigarette Products   URL: https:/​/www.​fda.gov/​news-events/​press-announcements/​trump-administration-combating-epidemic-youth-e-cigarette-use-plan-clear-market-unauthorized-non [accessed 2020-01-13]
    28. Perrine CG, Pickens CM, Boehmer TK, King BA, Jones CM, de Sisto CL, Lung Injury Response Epidemiology/Surveillance Group. Characteristics of a multistate outbreak of lung injury associated with e-cigarette use, or vaping - United States, 2019. MMWR Morb Mortal Wkly Rep 2019 Oct 4;68(39):860-864 [FREE Full text] [CrossRef] [Medline]
    29. Lewis N, McCaffrey K, Sage K, Cheng C, Green J, Goldstein L, et al. E-cigarette use, or vaping, practices and characteristics among persons with associated lung injury-Utah, April-October 2019. MMWR Morb Mortal Wkly Rep 2019 Oct 25;68(42):953-956 [FREE Full text] [CrossRef] [Medline]
    30. Brown CJ, Cheng JM. Electronic cigarettes: product characterisation and design considerations. Tob Control 2014 May;23(Suppl 2):ii4-i10 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    DIY: do it yourself
    ENDS: electronic nicotine delivery systems
    PG: propylene glycol
    RBA: rebuildable atomizer
    THC: tetrahydrocannabinol
    VG: vegetable glycerin


    Edited by G Eysenbach; submitted 21.11.19; peer-reviewed by DM Liou, JP Allem, E Da Silva; comments to author 06.01.20; revised version received 25.02.20; accepted 26.02.20; published 02.06.20

    ©Zachary B Massey, Yachao Li, Jessica Holli, Victoria Churchill, Bo Yang, Katherine Henderson, David L Ashley, Jidong Huang, Lucy Popova. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 02.06.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.