Evaluating a Web-Based Social Anxiety Intervention Among University Students: Randomized Controlled Trial

Background Treatment rates for social anxiety, a prevalent and potentially debilitating condition, remain among the lowest of all major mental disorders today. Although computer-delivered interventions are well poised to surmount key barriers to the treatment of social anxiety, most are only marginally effective when delivered as stand-alone treatments. A new, Web-based cognitive behavioral therapy (CBT) intervention called Overcome Social Anxiety was recently created to address the limitations of prior computer-delivered interventions. Users of Overcome Social Anxiety are self-directed through various CBT modules incorporating cognitive restructuring and behavioral experiments. The intervention is personalized to each user’s symptoms, and automatic email reminders and time limits are used to encourage adherence. Objective The purpose of this study was to conduct a randomized controlled trial to investigate the effectiveness of Overcome Social Anxiety in reducing social anxiety symptoms in a nonclinical sample of university students. As a secondary aim, we also investigated whether Overcome Social Anxiety would increase life satisfaction in this sample. Methods Following eligibility screening, participants were randomly assigned to a treatment condition or a wait-list control condition. Only those assigned to the treatment condition were given access to Overcome Social Anxiety; they were asked to complete the program within 4 months. The social interaction anxiety scale (SIAS), the fear of negative evaluation scale (FNE), and the quality of life enjoyment and satisfaction questionnaire—short form (Q-LES-Q-SF) were administered to participants from both conditions during baseline and 4-month follow-up lab visits. Results Over the course of the study, participants assigned to the treatment condition experienced a significant reduction in social anxiety (SIAS: P<.001, Cohen d=0.72; FNE: P<.001, Cohen d=0.82), whereas those assigned to the control condition did not (SIAS: P=.13, Cohen d=0.26; FNE: P=.40, Cohen d=0.14). Additionally, a direct comparison of the average change in social anxiety in the 2 conditions over the course of the study showed that those assigned to the treatment condition experienced significantly more improvement than those assigned to the control condition (SIAS: P=.03, Cohen d=0.56; FNE: P=.001, Cohen d=0.97). Although participants assigned to the treatment condition experienced a slight increase in life satisfaction, as measured by Q-LES-Q-SF scores, and those assigned to the control condition experienced a slight decrease, these changes were not statistically significant (treatment: P=.35, Cohen d=−0.18; control: P=.30, Cohen d=0.18). Conclusions Our findings indicate that Overcome Social Anxiety is an effective intervention for treating symptoms of social anxiety and that it may have further utility in serving as a model for the development of new interventions. Additionally, our findings provide evidence that contemporary Web-based interventions can be sophisticated enough to benefit users even when delivered as stand-alone treatments, suggesting that further opportunities likely exist for the development of other Web-based mental health interventions. Trial Registration ClinicalTrials.gov NCT02792127; https://clinicaltrials.gov/ct2/show/record/NCT02792127 (Archived by WebCite at http://www.webcitation.org/6xGSRh7MG)

TITLE AND ABSTRACT 1a) TITLE: Identi cation as a randomized trial in the title 1a) Does your paper address CONSORT item 1a? * I.e does the title contain the phrase "Randomized Controlled Trial"? (if not, explain the reason under "other") yes Other: 1a-i) Identify the mode of delivery in the title Identify the mode of delivery. Preferably use "web-based" and/or "mobile" and/or "electronic game" in the title. Avoid ambiguous terms like "online", "virtual", "interactive". Use "Internet-based" only if Intervention includes non-web-based Internet components (e.g. email), use "computer-based" or "electronic" only if o ine products are used. Use "virtual" only in the context of "virtual reality" (3-D worlds). Use "online" only in the context of "online support groups". Complement or substitute product names with broader terms for the class of products (such as "mobile" or "smart phone" instead of "iphone"), especially if the application runs on different platforms. 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1a-i? * Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Evaluating a Web-Based Social Anxiety Intervention"

1a-ii) Non-web-based components or important co-interventions in title
Mention non-web-based components or important co-interventions in title, if any (e.g., "with telephone support").
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1a-ii?
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 1a-iii) Primary condition or target group in the title Mention primary condition or target group in the title, if any (e.g., "for children with Type I Diabetes") Example: A Web-based and Mobile Intervention with Telephone Support for Children with Type I Diabetes: Randomized Controlled Trial 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1a-iii? * Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "A Randomized Controlled Trial Among University Students" 1b) ABSTRACT: Structured summary of trial design, methods, results, and conclusions NPT extension: Description of experimental treatment, comparator, care providers, centers, and blinding status.

1b-i) Key features/functionalities/components of the intervention and comparator in the METHODS section of the ABSTRACT
Mention key features/functionalities/components of the intervention and comparator in the abstract. If possible, also mention theories and principles used for designing the site. Keep in mind the needs of systematic reviewers and indexers by including important synonyms. (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1b-i? * Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Following eligibility screening, participants were randomly assigned to a treatment condition or a wait list control condition. Only those assigned to the treatment condition were given access to Overcome Social Anxiety; they were asked to complete the program within four months." 1b-ii) Level of human involvement in the METHODS section of the ABSTRACT Clarify the level of human involvement in the abstract, e.g., use phrases like "fully automated" vs. "therapist/nurse/care provider/physician-assisted" (mention number and expertise of providers involved, if any). (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1b-ii?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 1b-iii) Open vs. closed, web-based (self-assessment) vs. face-to-face assessments in the METHODS section of the ABSTRACT Mention how participants were recruited (online vs. o ine), e.g., from an open access website or from a clinic or a closed online user group (closed usergroup trial), and clarify if this was a purely web-based trial, or there were face-to-face components (as part of the intervention or for assessment). Clearly say if outcomes were self-assessed through questionnaires (as common in web-based trials Does your paper address subitem 1b-iii? Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 1b-iv) RESULTS section in abstract must contain use data Report number of participants enrolled/assessed in each group, the use/uptake of the intervention (e.g., attrition/adherence metrics, use over time, number of logins etc.), in addition to primary/secondary outcomes. (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1b-iv?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 1b-v) CONCLUSIONS/DISCUSSION in abstract for negative trials Conclusions/Discussions in abstract for negative trials: Discuss the primary outcome -if the trial is negative (primary outcome not changed), and the intervention was not used, discuss whether negative results are attributable to lack of uptake and discuss reasons. Computer-delivered therapy represents one promising avenue for increasing access to effective treatment options for social anxiety. One of its major advantages lies in its accessibility to individuals who experience geographic, financial, or personal challenges for human-delivered therapy. Notably, because financial and confidentiality concerns are especially common barriers to treatment for people suffering from social anxiety [3], the privacy and relative affordability of computer-delivered therapy may have particular practical utility for treating social anxiety relative to other mental disorders. Also, because students infrequently seek help from professionals for mental health-related problems, but tend to be very comfortable with modern digital technologies, computer-delivered therapies may be especially effective amongst student populations [4]." 2a-ii) Scienti c background, rationale: What is known about the (type of) system Scienti c background, rationale: What is known about the (type of) system that is the object of the study (be sure to discuss the use of similar systems for other conditions/diagnoses, if appropiate), motivation for the study, i.e. what are the reasons for and what is the context for this speci c study, from which stakeholder viewpoint is the study performed, potential impact of ndings [2]. Brie y justify the choice of the comparator.
Does your paper address subitem 2a-ii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Five common limitations of many web-based CBT treatments have been identified [5]. Firstly, many treatments do not offer users individualized programs to address their unique symptoms. Secondly, many tend to provide little visual or audio surrogate human contact, despite research attesting to the importance of therapist-client interaction to a program's success [7]. Thirdly, many web-based CBT treatments lack mechanisms to facilitate adherence, and completion rates of programs can be as low as 1% [8]. Fourthly, programs often do not provide corrective feedback to participants who misunderstand important aspects of the CBT process, such as designing behavioral experiments or differentiating between thoughts, emotions, and feelings. Finally, although administration of an appropriate dose of treatment is important to CBT's success (e.g., sufficient repetition of CBT exercises) [9], many treatments fail to provide a sufficient dose of treatment to deliver lasting benefits to users...
A web-based CBT program designed to reduce social anxiety symptoms among stuttering populations, developed specifically to address the 2b) In INTRODUCTION: Speci c objectives or hypotheses Does your paper address CONSORT subitem 2b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Our primary hypothesis was that participants who were given access to Overcome Social Anxiety would experience a greater decrease in social anxiety symptoms over a four-month period than those assigned to a wait list control condition. Our secondary hypothesis was that those who were given access to the program would experience a more positive change in life satisfaction (i.e., a greater increase or a lesser decrease) than those who were not." METHODS 3a) Description of trial design (such as parallel, factorial) including allocation ratio Does your paper address CONSORT subitem 3a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Participants deemed eligible to participate in the study based on their responses to the pre-screening questionnaire were assigned (using a random number generator) to the treatment condition or the wait list control condition." 3b) Important changes to methods after trial commencement (such as eligibility criteria), with reasons Does your paper address CONSORT subitem 3b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study There were no changes to our methods after the commencement of the trial.

3b-i) Bug xes, Downtimes, Content Changes
Bug xes, Downtimes, Content Changes: ehealth systems are often dynamic systems. A description of changes to methods therefore also includes important changes made on the intervention or comparator during the trial (e.g., major bug xes or changes in the functionality or content) (5-iii) and other "unexpected events" that may have in uenced study design such as staff changes, system failures/downtimes, etc. [2].
symptoms. Prospective participants responded (1 = Not at all, 2 = A little bit, 3 = Somewhat, 4 = Very much, 5 = Extremely) to each of the three Mini-SPIN items (e.g., "I avoid activities in which I am the centre of attention") and the four DSM-5 items (e.g., "I spend a lot of time preparing what to say or how to act in social situations"). Internal consistency for this seven-item scale was good in our sample (Cronbach's α = .88). Those who endorsed at least one of these seven items with Very much or Extremely were considered eligible to participate. The eligibility questionnaire was also used to screen out those who had formerly been diagnosed with social anxiety disorder by a clinician or had received treatment for a chronic mental health condition within the past six months."

4a-i) Computer / Internet literacy
Computer / Internet literacy is often an implicit "de facto" eligibility criterion -this should be explicitly clari ed.
"Our sample consisted of 65 students (47/65, 72% female) at a large, public Canadian university, who received course credit for their participation...
During the four-month interval between participants' baseline and follow-up lab visits, participants in the treatment condition were sent periodic reminders to continue using the program, and were granted course credit incrementally depending on their progress in Overcome Social Anxiety." 4a-iii) Information giving during recruitment Information given during recruitment. Specify how participants were briefed for recruitment and in the informed consent procedures (e.g., publish the informed consent documentation as appendix, see also item X26), as this information may have an effect on user self-selection, user expectation and may also bias results.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 4a-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 4b) Settings and locations where the data were collected Does your paper address CONSORT subitem 4b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study It is clear from text in various sections of our manuscript that all data was collected in a lab setting at a large, public Canadian university. Please see the quotes from our manuscript below for examples.
"Our sample consisted of 65 students (47/65, 72% female) at a large, public Canadian university..." "During their baseline lab visits..." 4b-i) Report if outcomes were (self-)assessed through online questionnaires Clearly report if outcomes were (self-)assessed through online questionnaires (as common in web-based trials) or otherwise.
Does your paper address subitem 4b-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study subitem not at all important essential Does your paper address subitem 4b-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 5) The interventions for each group with su cient details to allow replication, including how and when they were actually administered 5-i) Mention names, credential, a liations of the developers, sponsors, and owners Mention names, credential, a liations of the developers, sponsors, and owners [6] (if authors/evaluators are owners or developer of the software, this needs to be declared in a "Con ict of interest" section or mentioned elsewhere in the manuscript).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 5-ii) Describe the history/development process Describe the history/development process of the application and previous formative evaluations (e.g., focus groups, usability testing), as these will have an impact on adoption/use rates and help with interpreting results.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study

5-iii) Revisions and updating
Revisions and updating. Clearly mention the date and/or version number of the application/intervention (and comparator, if applicable) evaluated, or describe whether the intervention underwent major changes during the evaluation process, or whether the development and/or content was "frozen" during the trial. Describe dynamic components such as news feeds or changing content which may have an impact on the replicability of the intervention (for unexpected events see item 3b).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 5-iv) Quality assurance methods Provide information on quality assurance methods to ensure accuracy and quality of information provided [1], if applicable.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-iv?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 5-v) Ensure replicability by publishing the source code, and/or providing screenshots/screencapture video, and/or providing owcharts of the algorithms used Ensure replicability by publishing the source code, and/or providing screenshots/screen-capture video, and/or providing owcharts of the algorithms used. Replicability (i.e., other researchers should in principle be able to replicate the study) is a hallmark of scienti c reporting.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-v?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study

5-vi) Digital preservation
Digital preservation: Provide the URL of the application, but as the intervention is likely to change or disappear over the course of the years; also make sure the intervention is archived (Internet Archive, webcitation.org, and/or publishing the source code or screenshots/videos alongside the article). As pages behind login screens cannot be archived, consider creating demo pages which are accessible without login.
Does your paper address subitem 5-vi?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study

5-vii) Access
Access: Describe how participants accessed the application, in what setting/context, if they had to pay (or were paid) or not, whether they had to be a member of speci c group. If known, describe how participants obtained "access to the platform and Internet" [1]. To ensure access for editors/reviewers/readers, consider to provide a "backdoor" login account or demo mode for reviewers/readers to explore the application (also important for archiving purposes, see vi).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-vii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study The intervention was accessed via the web: "A web-based CBT program designed to reduce social anxiety symptoms... has recently been updated and further developed into Overcome Social Anxiety..." Participants had to be university students, and were compensated for participation with course credit: "Our sample consisted of 65 students (47/65, 72% female) at a large, public Canadian university, who received course credit for their participation." We helped participants access the program: "Those assigned to the treatment condition... were also given a verbal overview of Overcome Social Anxiety, were left alone to browse the program's website for eight minutes, and were set up with an Overcome Social Anxiety account by the attending research assistant." subitem not at all important essential Does your paper address subitem 5-viii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "A web-based CBT program designed to reduce social anxiety symptoms among stuttering populations, developed specifically to address the aforementioned five limitations, has shown promising preliminary results [10; 11]. Originally called CBTpsych, the program has recently been updated and further developed into Overcome Social Anxiety, which is no longer tailored specifically towards stuttering populations.

5-viii
Overcome Social Anxiety has built-in mechanisms to address each of

5-ix) Describe use parameters
Describe use parameters (e.g., intended "doses" and optimal timing for use). Clarify what instructions or recommendations were given to the user, e.g., regarding timing, frequency, heaviness of use, if any, or was the intervention used ad libitum.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-ix?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study

5-x) Clarify the level of human involvement
Clarify the level of human involvement (care providers or health professionals, also technical assistance) in the e-intervention or as co-intervention (detail number and expertise of professionals involved, if any, as well as "type of assistance offered, the timing and frequency of the support, how it is initiated, and the medium by which the assistance is delivered". It may be necessary to distinguish between the level of human involvement required for the trial, and the level of human involvement required for a routine application outside of a RCT setting (discuss under item 21 -generalizability).
Does your paper address subitem 5-x?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 5-xi) Report any prompts/reminders used Report any prompts/reminders used: Clarify if there were prompts (letters, emails, phone calls, SMS) to use the application, what triggered them, frequency etc. It may be necessary to distinguish between the level of prompts/reminders required for the trial, and the level of prompts/reminders for a routine application outside of a RCT setting (discuss under item 21 -generalizability).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-xi? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study required to use the program to receive full course credit for their participation, and (b) to remind them how much time they had remaining before they would be invited to return to the lab for follow-up visits.
"During the four-month interval between participants' baseline and follow-up lab visits, participants in the treatment condition were sent periodic reminders to continue using the program, and were granted course credit incrementally depending on their progress in Overcome Social Anxiety."

5-xii) Describe any co-interventions (incl. training/support)
Describe any co-interventions (incl. training/support): Clearly state any interventions that are provided in addition to the targeted eHealth intervention, as ehealth intervention may not be designed as stand-alone intervention. This includes training sessions and support [1]. It may be necessary to distinguish between the level of training required for the trial, and the level of training for a routine application outside of a RCT setting (discuss under item 21 -generalizability.

2 3 4 5
subitem not at all important essential Does your paper address subitem 5-xii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study No co-interventions were delivered. 6a) Completely de ned pre-speci ed primary and secondary outcome measures, including how and when they were assessed Does your paper address CONSORT subitem 6a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "The primary dependent variable was the change in the severity of participants' social anxiety symptoms during the four months between their baseline and follow-up lab visits, as measured by the SIAS and the FNE. The secondary dependent variable was the change in participants' life satisfaction over that period of time, as measured by the Q-LES-QSF. For each of these three measures, within-subjects t tests were employed to determine whether baseline scores differed from follow-up scores for each condition. Additionally, a change score was calculated as the difference between each participant's baseline and follow-up 6a-i) Online questionnaires: describe if they were validated for online use and apply CHERRIES items to describe how the questionnaires were designed/deployed If outcomes were obtained through online questionnaires, describe if they were validated for online use and apply CHERRIES items to describe how the questionnaires were designed/deployed [9]. subitem not at all important essential Does your paper address subitem 6a-iii?
Copy and paste relevant sections from manuscript text 6b) Any changes to trial outcomes after the trial commenced, with reasons Does your paper address CONSORT subitem 6b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study No changes were made to trial outcomes after the trial commenced.
7a) How sample size was determined NPT: When applicable, details of whether and how the clustering by care provides or centers was addressed 7a-i) Describe whether and how expected attrition was taken into account when calculating the sample size Describe whether and how expected attrition was taken into account when calculating the sample size.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 7a-i?
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 7b) When applicable, explanation of any interim analyses and stopping guidelines Does your paper address CONSORT subitem 7b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study A research assistant conducted some interim analyses to present at an undergraduate research conference. However, at the time of these analyses, we had already ceased recruiting new participants, and thus had very little further control over our final sample size.
8a) Method used to generate the random allocation sequence NPT: When applicable, how care providers were allocated to each trial group Does your paper address CONSORT subitem 8a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Participants deemed eligible to participate in the study based on their responses to the pre-screening questionnaire were assigned (using a random number generator) to the treatment condition or the wait list control condition." 8b) Type of randomisation; details of any restriction (such as blocking and block size) Does your paper address CONSORT subitem 8b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study No restrictions were implemented. 9) Mechanism used to implement the random allocation sequence (such as sequentially numbered containers), describing any steps taken to conceal the sequence until interventions were assigned Does your paper address CONSORT subitem 9? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Participants were assigned a participant number, which had in turn already been allocated to the treatment or the control condition, upon arriving for their baseline lab visits. They had no means of knowing which group they would be assigned to prior to their baseline visits.
10) Who generated the random allocation sequence, who enrolled participants, and who assigned participants to interventions Does your paper address CONSORT subitem 10? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Hugh McCall and Ashley Clark generated the random allocation sequence. Participants self-enrolled through an online enrollment system. Hugh McCall and Keith Patena confirmed participants' eligibility and assigned participants to interventions.
11a) If done, who was blinded after assignment to interventions (for example, participants, care providers, those assessing outcomes) and how NPT: Whether or not administering co-interventions were blinded to group assignment 11a-i) Specify who was blinded, and who wasn't Specify who was blinded, and who wasn't. Usually, in web-based trials it is not possible to blind the participants [1, 3] (this should be clearly acknowledged), but it may be possible to blind outcome assessors, those doing data analysis or those administering co-interventions (if any).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 11a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study N/A 11a-ii) Discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator" Informed consent procedures (4a-ii) can create biases and certain expectations -discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator".
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 11a-ii? 11b) If relevant, description of the similarity of interventions (this item is usually not relevant for ehealth trials as it refers to similarity of a placebo or sham intervention to a active medication/intervention) Does your paper address CONSORT subitem 11b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study N/A, as we implemented a wait list control condition.
12a) Statistical methods used to compare groups for primary and secondary outcomes NPT: When applicable, details of whether and how the clustering by care providers or centers was addressed Does your paper address CONSORT subitem 12a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "The primary dependent variable was the change in the severity of participants' social anxiety symptoms during the four months between their baseline and follow-up lab visits, as measured by the SIAS and the FNE. The secondary dependent variable was the change in participants' life satisfaction over that period of time, as measured by the Q-LES-QSF. For each of these three measures, within-subjects t tests were employed to determine whether baseline scores differed from follow-up scores for each condition. Additionally, a change score was calculated as the difference between each participant's baseline and follow-up score for each measure; between-subjects t tests were then employed to compare these change scores, for each measure, across the two conditions. No data were excluded from the analyses discussed below." 12a-i) Imputation techniques to deal with attrition / missing values Imputation techniques to deal with attrition / missing values: Not all participants will use the intervention/comparator as intended and attrition is typically high in ehealth trials. Specify how participants who did not use the application or dropped out from the trial were treated in the statistical analysis (a complete case analysis is strongly discouraged, and simple imputation techniques such as LOCF may also be problematic [4]).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 12a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study N/A 12b) Methods for additional analyses, such as subgroup analyses and adjusted analyses Does your paper address CONSORT subitem 12b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study No additional analyses were conducted.

X26) REB/IRB Approval and Ethical Considerations [recommended as subheading under "Methods"] (not a CONSORT item)
X26-i) Comment on ethics committee approval 14a) Dates de ning the periods of recruitment and followup Does your paper address CONSORT subitem 14a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Participants were recruited on a rolling basis between September and January, and returned for follow-up visits four months after their baseline visits. For brevity's sake, we've simply noted that "All data were collected between September 2016 and June 2017." 14a-i) Indicate if critical "secular events" fell into the study period Indicate if critical "secular events" fell into the study period, e.g., signi cant changes in Internet resources available or "changes in computer hardware or Internet delivery resources"

15-i) Report demographics associated with digital divide issues
In ehealth trials it is particularly important to report demographics associated with digital divide issues, such as age, education, gender, social-economic status, computer/Internet/ehealth literacy of the participants, if known.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 15-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study All of our participants were university students, a group that tends to be very comfortable with digital technology (Davies, Morriss, & Glazebrook, 2014).
16) For each group, number of participants (denominator) included in each analysis and whether the analysis was by original assigned groups 16-i) Report multiple "denominators" and provide de nitions Report multiple "denominators" and provide de nitions: Report N's (and effect sizes) "across a range of study participation [and use] thresholds" [1], e.g., N exposed, N consented, N used more than x times, N used more than y weeks, N participants "used" the intervention/comparator at speci c pre-de ned time points of interest (in absolute and relative numbers per group). Always clearly de ne "use" of the intervention.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 16-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study We focused our analyses on those who completed the study, after ascertaining that "No significant differences in baseline social anxiety scores (SIAS and FNE) were found between participants who completed the study and those who did not, for either condition (all Ps > .46, t tests)."

16-ii) Primary analysis should be intent-to-treat
Primary analysis should be intent-to-treat, secondary analyses could include comparing only "users", with the appropriate caveats that this is no longer a randomized sample (see 18-i).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 16-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 17a) For each primary and secondary outcome, results for each group, and the estimated effect size and its precision (such as 95% con dence interval) Does your paper address CONSORT subitem 17a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study independent-samples t-test using participants' change scores (difference between their baseline and follow-up scores). Those assigned to the treatment condition experienced a significantly greater reduction in anxiety than those assigned to the control condition, for both the SIAS (t63=2.25, P=.03, Cohen's d=0.56) and FNE (equal variances not assumed, t42.54=3.65, P=.001, Cohen's d=0.97). No significant differences were found between the two conditions' changes in Q-LES-QSF (t61=-1.41, P=.16, Cohen's d=0.36). These results are depicted in Figures 2 and 3 below." 17a-i) Presentation of process outcomes such as metrics of use and intensity of use In addition to primary/secondary (clinical) outcomes, the presentation of process outcomes such as metrics of use and intensity of use (dose, exposure) and their operational de nitions is critical. This does not only refer to metrics of attrition (13-b) (often a binary variable), but also to more continuous exposure metrics such as "average session length". These must be accompanied by a technical description how a metric like a "session" is de ned (e.g., timeout after idle time) [1] (report under item 6a).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 17a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 17b) For binary outcomes, presentation of both absolute and relative effect sizes is recommended Does your paper address CONSORT subitem 17b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study NPT: In addition, take into account the choice of the comparator, lack of or partial blinding, and unequal expertise of care providers or centers in each group 22-i) Restate study questions and summarize the answers suggested by the data, starting with primary outcomes and process outcomes (use) Restate study questions and summarize the answers suggested by the data, starting with primary outcomes and process outcomes (use).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 22-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "The primary dependent variable of this study was change in social anxiety symptoms over a four-month period. Our hypothesis, namely that those assigned to the treatment condition would experience a greater reduction in social anxiety than those in the wait list control condition, was well supported by both the SIAS and FNE results.

20-i) Typical limitations in ehealth trials
Typical limitations in ehealth trials: Participants in ehealth trials are rarely blinded. Ehealth trials often look at a multiplicity of outcomes, increasing risk for a Type I error. Discuss biases due to non-use of the intervention/usability issues, biases through informed consent procedures, unexpected events.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 20-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Because the wait list control condition did not receive any treatment, the treatment condition's greater reduction in social anxiety symptoms may be attributable, at least in part, to an expectancy effect." "Further research will also be required to confirm that Overcome Social Anxiety would show a comparable level of effectiveness among other populations." 21) Generalisability (external validity, applicability) of the trial ndings NPT: External validity of the trial ndings according to the intervention, comparators, patients, and care providers or centers involved in the trial

21-i) Generalizability to other populations
Generalizability to other populations: In particular, discuss generalizability to a general Internet population, outside of a RCT setting, and general patient population, including applicability of the study results for other organizations 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 21-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study 21-ii) Discuss if there were elements in the RCT that would be different in a routine application setting Discuss if there were elements in the RCT that would be different in a routine application setting (e.g., prompts/reminders, more human involvement, training sessions or other co-interventions) and what impact the omission of these elements could have on use, adoption, or outcomes if the intervention is applied outside of a RCT setting.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 21-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study OTHER INFORMATION 23) Registration number and name of trial registry Does your paper address CONSORT subitem 23? *