Published on in Vol 20, No 10 (2018): October

Preprints (earlier versions) of this paper are available at, first published .
A Mobile Videoconference-Based Intervention on Stress Reduction and Resilience Enhancement in Employees: Randomized Controlled Trial

A Mobile Videoconference-Based Intervention on Stress Reduction and Resilience Enhancement in Employees: Randomized Controlled Trial

A Mobile Videoconference-Based Intervention on Stress Reduction and Resilience Enhancement in Employees: Randomized Controlled Trial

Original Paper

1Hanyang University Medical Center, Seoul, Republic Of Korea

2Seoul National University Hospital, Seoul, Republic Of Korea

3Seoul National University College of Medicine, Seoul, Republic Of Korea

4Seoul National University Bundang Hospital, Seongnam, Republic Of Korea

5Seoultop Psychiatric Clinic, Seoul, Republic Of Korea

6Korean Academy of Gifted Education, Seoul, Republic Of Korea

7Aimmed Company Ltd, Seoul, Republic Of Korea

8Seoul Metropolitan Government Seoul National University Boramae Medical Center, Seoul, Republic Of Korea

9Benson-Henry Institue for Mind Body Medicine, Massachusetts General Hospital, Boston, MA, United States

10Department of Psychiatry, Harvard Medical School, Boston, MA, United States

11Human Behavioral Medical Institute, Seoul National University Medical Research Center, Seoul, Republic Of Korea

Corresponding Author:

Jeong-Hyun Kim, MD, PhD

Seoul National University Bundang Hospital

82, Gumi-ro 173 beon-gil, Bundang-gu, Seongnam-si, Gyeonggi-do 13620


Republic Of Korea

Phone: 82 31 787 2025


Background: Videoconferencing-based treatments have shown great potential in increasing engagement and compliance by decreasing the barriers of time and distance. In general, employees tend to experience a lot of stress, but find it difficult to visit a clinic during office hours.

Objective: The purpose of this study was to investigate the effectiveness of a mobile videoconference-based intervention for stress reduction and resilience enhancement in employees.

Methods: In total, 81 participants were randomly allocated to one of the three conditions: mobile videoconferencing, in-person, and self-care; of these, 72 completed the study. All participants underwent assessment via self-reported questionnaires before, immediately after, and 1 month after the intervention. Intervention lasted for 4 weeks and consisted of elements of cognitive behavioral therapy, positive psychology, and meditation. Changes in clinical variables regarding stress and resilience across time were compared between treatment conditions.

Results: There were significant condition × time effects on variables measuring perceived stress, resilience, emotional labor, and sleep, demonstrating significantly differential effects across time according to treatment condition. Moreover, there were significant effects of condition on perceived stress and occupational stress. There were no significant differences in any variable between the mobile videoconferencing and in-person conditions at 1 month after the intervention.

Conclusions: Results indicate that both mobile videoconferencing and in-person interventions were comparably effective in decreasing stress and enhancing resilience. Further studies with a larger sample size and a longer follow-up period are warranted to investigate the long-term effect of mobile videoconferencing interventions.

Trial Registration: identifier NCT03256682; (Archived by WebCite at

J Med Internet Res 2018;20(10):e10760



Stress is a major public health concern. It can cause serious psychological and physical problems such as fatigue, sleeping problems, coronary diseases, depression, and even related mortality [1-4]. Hence, proper stress management for employees is particularly important; work-related stress affects approximately 28% of all workers [5]. Stress has also been reported to be a major factor in up to 80% of all work-related injuries and 40% of workplace turnovers [6]. Data from the American Institute of Stress show that job stress in the United States accounts for over US $300 billion annually as a result of increased absenteeism, employee turnover, diminished productivity, medical, legal, and insurance expenses, and worker compensation [7].

Traditional face-to-face or in-person stress reduction interventions for employees are proven to be effective, with small-to-moderate effect sizes [8]. However, a major barrier to managing stress is limited access due to time and location constraints, as it may be difficult for employees to find the time to see a therapist during work hours on weekdays [9]. The success of nonpsychopharmacological psychiatric treatment is related to treatment adherence, which is linked to barriers like time and distance. A useful way to increase access, and thereby increase treatment adherence, is by incorporating telemedicine-based methods. Employees can easily access videoconferencing-based treatments at their convenience, ie, during break hours in the workplace or after office hours at home [10].

There is a bulk of evidence suggesting that videoconferencing- based telepsychology is no less effective than in-person treatment in a variety of psychiatric disorders [11], including depression [12], panic disorders [13], obsessive compulsive disorder [14], posttraumatic stress disorder [15], and eating disorders [16]. A recent meta-analysis of 26 randomized controlled trials demonstrated noninferiority of remote psychiatric counseling, with respect to both assessment and treatment, compared with in-person counseling [17]. To the best of our knowledge, to date, there has been no study evaluating the effectiveness of videoconferencing in reducing stress and enhancing resilience in the workplace.

An important issue in videoconferencing is equipment. In most previous studies, participants were instructed to use the equipment provided at remote videoconference sites [11]. However, traveling to these sites is no different from traveling to see a counselor; it would still be a barrier to treatment for those whose workplace or home is far from the videoconference site. To further increase accessibility to treatment, we used mobile-based videoconferencing equipment. Access to treatment by smartphones could be particularly beneficial in South Korea, since almost all Korean employees own a smartphone (94% of population), making it one of the countries with the highest smartphone ownership worldwide [18].

The purpose of this study was to compare the effects of mobile videoconference-based intervention on stress reduction and resilience enhancement with that of in-person and self-care methods in Korean employees. We hypothesized that the effectiveness of the mobile videoconference condition would be superior to the control condition (self-care condition), but comparable to the in-person condition.


Participants were recruited via advertisements at the Seoul National University Hospital and the Seoul National University Bundang Hospital between August 2017 and November 2017 (NCT03256682). The inclusion criteria were (1) age between 19 and 65 years, (2) a score of ≥14 on the Perceived Stress Scale (PSS) at baseline, (3) possession of an Android smartphone, and (4) currently employed full-time. As stress in the workplace is commonly associated with depression, insomnia, and anxiety [1,19] and as stress management interventions have been found to be effective at treating these three conditions [20,21], we included individuals with these conditions as long as the type and dosage of their medication had not changed for the past 6 months. The exclusion criteria were (1) age <19 or >65 years; 2) cognitive disorders, such as intellectual disability or dementia; 3) neurological disorders, including epilepsy, stroke, or others; 4) history of schizophrenia or bipolar I disorder; 5) current report of suicidal ideation; and 6) nonpharmacological treatment or counseling within the past 6 months.

During the screening process, psychiatric diagnoses were confirmed using the Mini-International Neuropsychiatric Interview (MINI), which is a short, structured psychiatric interview designed to detect a wide range of Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition and International Classification of Diseases, Tenth Revision psychiatric disorders [22]. Questions are phrased to allow only “yes” or “no” answers. The Korean version has well-established validity and reliability [23]. MINI was conducted by two psychologists with a master’s degree in education and 2 hours of training in advance.

With a predicted effect size of Cohen d=0.4, an alpha level of.05, a desired power of 0.95, and a correlation of 0.5 among repeated measures, the estimated total sample size using G-Power was 69 (23 participants per condition). Considering a drop-out rate of 20%, we aimed to recruit 87 participants.

Written informed consent was obtained from all participants after sufficient explanation of the study. The study protocol was approved by the Institutional Review Board of Seoul National University Bundang Hospital.


Demographic information, including age, gender, length of work (<3 years or ≥3 years), marital status (married and not separated, others), and education status (college education or more, less than a college education), was obtained using a self-reported questionnaire. These demographic variables have been previously found to relate to occupational stress level [24]. The questionnaires were filled on paper. The primary outcome measures of this study were changes in scores of PSS and Brief Resilience Scale (BRS) scales. Changes in scores of scales assessing emotional labor, occupational stress, and insomnia were evaluated as secondary outcomes.

PSS is a 10-item questionnaire used to assess perceived stress [25]. It was designed to measure the degree to which respondents found their life situations unpredictable, uncontrollable, and overbearing. It includes 10 direct queries about incidents that brought upon states of being upset, nervous, stressed, or irritated; four items were worded negatively and the rest positively. Answers were given on a 5-point Likert scale (0: never to 4: very often). Total scores were calculated after reversing the scores from positive items and then summing up all scores. Higher scores indicated higher levels of perceived stress. The Korean version of PSS was found to have a Cronbach alpha=.74 and a test-retest reliability of intraclass correlation coefficient=0.81 [26].

We used the Korean Emotional Labor Scale (KELS) [27] to measure the level of emotional labor. Emotional labor is defined as the process by which workers have to control their feelings in accordance with the organizational demand and occupational role [28,29]. KELS was developed to measure Korean-specific emotional labor and was validated with a nation-wide random sample of 1042 Korean employees. It was based on the literature related to emotional labor [29-35]; emotional labor scales such as the Emotional Labor Inventory [36], Emotional Labor Scale [37], Emotion Work Requirements Scale [38], and Frankfurt Emotion Work Scale [39]; and a focused group interview. KELS has 5 subscales: effort to control emotion (5 items), organizational monitoring system (4 items), demands of emotional labor (3 items), emotional damage (6 items), and organizational support system (7 items). Each item was rated on a 4-point Likert scale, from 1 (not at all) to 4 (very much). Scores for each subscale were calculated based on the scoring method provided by the developers. The possible range for each subscale was 0-100, with higher scores representing higher levels of emotional labor. In this study, we only used the total score.

The level of job stress was measured using the Korean Occupational Stress Scale (KOSS)-Short Form, which is one of the most commonly used questionnaires for assessing job stress in South Korea [40]. It consists of 24 items measured on a 4-point Likert scale (1: never to 4: always). This scale comprises 7 subscales, including job demand, job control, interpersonal conflict, job insecurity, organizational system, lack of reward, and workplace environment. The sum of each subscale was calculated and then converted to 100 points. We used the KOSS total score in the analysis; higher scores indicated a higher level of job stress.

BRS was used to measure individual resilience [41]. It aims to assess the most traditional and original sense of resilience, in other words, “the ability to bounce back from stress [42].” It consists of 6 items measured on a 5-point Likert scale (1: strongly disagree to 5: strongly agree). While other resilience scales measure personal characteristics that may promote positive adaptation, BRS is the only scale that targets and assesses resilience itself.

Insomnia was measured by the Athens Insomnia Scale (AIS), which contains 8 items scored on a 4-point Likert scale [43]. Total AIS scores range from 0 to 24, with higher scores indicating greater symptom severity. AIS has been validated for screening insomnia in South Korean firefighters with good psychometric properties (Cronbach alpha=.88 and item-total correlation=0.73) [44].

All self-reported questionnaires were completed by the participants before treatment, immediately after treatment, and 1 month after treatment.

At posttreatment, participants answered 4 questions about therapeutic alliance. Each item was rated on a 5-point Likert scale (1: disagree strongly to 5: agree strongly). The 4 questions were as follows: (1) “I felt as if the therapist understood me well”; (2) “I felt as if the therapist was paying attention to what I was saying”; (3) “I could tell that the therapist was empathetic by his/her tone of voice”; and (4) “I felt comfortable during therapy sessions.”

Randomization and Treatment Conditions

We performed 1:1:1 block randomization (stratified by organization) with randomly selected block sizes (3, 6, or 9) using REDCap (Research Electronic Data Capture) tools hosted at the Medical Research Collaborating Center of Seoul National University Bundang Hospital. REDCap generates randomization codes using SAS software. The allocation sequence was concealed to the patients until they had entered the trial and to the investigators until the end of the study. Participants in the mobile videoconference and in-person conditions underwent 50-minute sessions of 1:1 therapy with 1 of 3 psychologists with a master’s degree in education for 4 weeks (one session a week). The protocol of therapy was adapted from the Stress Management and Resilience Training: Relaxation Response Resilience Program (SMART-3RP) [45]. SMART-3RP is an 8-week, 1.5-hour session program developed by the Benson-Henry Institute for Mind Body Medicine at Massachusetts General Hospital. This program is based on the principles of cognitive behavioral therapy and positive psychology in conjunction with methods that elicit a relaxation response. The goals of the program include (1) eliciting a relaxation response through meditation, (2) reducing overall stress reactivity, and (3) increasing connectedness to oneself and others. In this study, we modified the SMART-3RP program into a 4-week program (1-hour per session); a brief summary of each session is presented in Multimedia Appendix 1. The participants in the self-care condition received educational material regarding methods to self-regulate stress and were instructed to read 1 chapter each week for 4 weeks. This material was also provided to the participants in other conditions.


For mobile videoconferencing we used the “Hello Mindcare” Android app [46], which was developed to provide mobile counseling services. All participants downloaded the app free of charge. Using Web Real-Time Communication, the Hello Mindcare app provides videoconferencing by allowing direct peer-to-peer communication and eliminating the need to install plugins or ActiveX. With a highly secure system, all data shared during videoconference sessions were encoded using Transport Layer Security, 128-bit block encryption algorithm ARIA (Academy, Research Institute, Agency), and Advanced Encryption Standard. The Hello Mindcare app provides a booking system, videoconferencing, document sharing, and workbooks for clients to fill in directly via their smartphones. Therapists used the Hello Mindcare counselor Web to manage schedules, participate in videoconferencing sessions, and check participants’ workbooks.

Statistical Analysis

The demographic and clinical characteristics of each condition were compared using analysis of variance (ANOVA) for continuous variables and chi-square tests or Fisher exact tests for categorical variables. Condition, time, and condition × time effects on clinical variables were tested using repeated measure ANOVA with age and marital status included as covariates. For post hoc analyses, we conducted pairwise comparisons of the changes in scores at posttreatment (posttreatment score − pretreatment score) and at 1-month follow-up (follow-up score − pretreatment score) by analysis of covariance, with age and marital status included as covariates. All statistical analyses were performed using IBM SPSS Statistics version 22.0 software (IBM Corp, Chicago, IL, USA). A two-tailed P value of <.05 was considered statistically significant.

Of the 98 individuals screened for this study, 17 did not meet the inclusion criteria; 81 individuals were thus enrolled and randomly allocated to 1 of the 3 conditions. Among them, 4 in the mobile videoconference condition and 1 in the in-person condition dropped out after randomization but before treatment initiation (mobile videoconference condition: 3 had trouble installing the app on their smartphone and 1 refused participation due to difficulty in scheduling appointments; in-person condition: 1 needed psychiatric treatment due to aggravation of psychiatric symptoms). As a result, 21 participants were allocated to the mobile videoconference condition, 27 to the in-person condition, and 28 to the self-care condition; all 81 subjects completed the pretreatment assessment. After the start of treatment, 3 participants in the mobile videoconference condition and 1 participant in the self-care condition dropped out (mobile videoconferencing condition: 2 dropped out due to their personal schedules, 1 complained of unstable Wi-Fi connection; self-care condition: 1 dropped out of because of personal matters, but refused to give a detailed explanation). A total of 18 individuals in the videoconference condition, 27 in the in-person condition, and 27 in the self-care condition completed all 4 sessions of the intervention and underwent the posttreatment and 1-month follow-up assessment (Figure 1). The drop-out rates after treatment engagement were 14% (3/21), 0%, and 3% (1/27) for the mobile videoconferencing, in-person, and self-care conditions, respectively; this distribution was not statistically significant (P=.09 by Fisher exact test).

The demographic and clinical characteristics of participants who completed the assessments at all three time points are presented in Table 1. The mean age of participants in the mobile videoconference condition and in-person condition was higher than that of the self-care condition (P<.001), and there was a significant difference in marital status among the conditions (P=0.03); hence, age and marital status were included as covariates in the main analyses. There were no significant differences in gender, length of work, education status, or baseline scores of the clinical variables. When classifying the occupations of the participants according to the International Standard Classification of Occupations 08, 5 were managers, 26 were professionals, 6 were technicians and associate professionals, 12 were clerical support workers, 19 were service and sales workers, 1 was a plant and machine operator, and 3 had elementary occupations. Overall, 42% (30/72) were hospital employees.

The effects of condition, time, and condition × time for all clinical variables are shown in Multimedia Appendix 2; Figures 2-5 depict changes in the PSS, KELS, BRS, and AIS scores across time. The interaction between time and condition was significant for 4 clinical variables (PSS: F3.40=3.1, P=.03; BRS: F3.47=3.9, P=.008; KELS: F3.45=2.8, P=.03; AIS: F3.04=4.5, P=.005). There were significant main effects for condition on PSS (F2=8.7, P<.001) and KOS (F2=11.6, P<.001).

At posttreatment, the mobile videoconferencing condition showed a greater decrease in KELS scores at posttreatment, but this was not significant at follow-up (Multimedia Appendix 2). There were no significant differences in any clinical variable between the mobile videoconferencing condition and in-person condition at follow-up. The mobile videoconferencing condition showed a greater decrease in KELS scores compared with the self-care condition at posttreatment, but this was without significance at follow-up. The mobile videoconferencing condition showed a greater increase in BRS scores at follow-up than the self-care condition. The in-person condition showed a greater decrease in PSS, KOSS, BRS, and AIS scores at posttreatment than the self-care condition, but only KOSS, BRS, and AIS scores were significant at follow-up.

Regarding the 4 questions about therapeutic alliance, there were no differences in the scores between the videoconferencing condition and in-person condition: question 1: average score 4.7 (SD 0.6) versus 4.7 (SD 0.4), P=.58; question 2: average score 4.7 (SD 0.6) versus 4.9 (SD 0.3), P=.32; question 3: average score 4.6 (SD 0.5) versus 4.9 (SD 0.3), P=.06; question 4: average score 4.7 (SD 0.6) vs 4.7 (SD 0.6), P=.98.

Figure 1. Flowchart of the study process. f/u: follow-up.
View this figure
Table 1. Demographic and clinical characteristics of participants in videoconferencing, in-person, and self-care conditions.
CharacteristicVideoconference (n=18)In-person (n=27)Self-care (n=27)P value
Age in years, mean (SD)36.2 (9.2)36.7 (10.3)46.6 (9.6)<.001a
Sex (female), n (%)17 (94.4)25 (92.6)25 (92.6).97
Education ≥college bachelor degree, n (%)16 (88.9)24 (88.9)18 (66.7).07
Marital status (married and unseparated), n (%)10 (55.6)17 (63.0)24 (88.9).03
Employed >3 years, n (%)14 (77.8)14 (51.9)19 (70.4).16
Perceived Stress Scale, mean (SD)23.5 (4.2)23.0 (3.3)24.6 (4.1).30
Brief Resilience Scale, mean (SD)16.3 (4.1)16.9 (3.5)17.2 (4.0).75
Korean Emotional Labor Scale, mean (SD)61.1 (17.1)57.1 (15.6)59.1 (14.6).70
Korean Occupational Stress Scale, mean (SD)52.8 (7.7)53.1 (9.5)57.5 (9.3).12
Athens Insomnia Scale, mean (SD)16.3 (3.2)16.7 (4.2)16.6 (4.1).94

aPost hoc test by least significant difference; age was less in videoconference and in-person conditions than in self-care conditions.

Figure 2. Change in Perceived Stress Scale scores (PESS) across time according to condition.
View this figure
Figure 3. Change in Korean Emotional Labor Scale (KELS) scores across time according to condition.
View this figure
Figure 4. Change in Brief Resilience Scale (BRS) scores across time according to condition.
View this figure
Figure 5. Change in Athens Insomnia Scale (AIS) scores across time according to condition.
View this figure

To the best of our knowledge, this is the first study investigating the effectiveness of a mobile videoconferencing-based intervention for stress reduction and resilience enhancement in employees. Videoconferencing was delivered using a smartphone app, thus combining the merits of both videoconferencing and mobile devices. Overall, there were significantly differential effects across time according to treatment condition on perceived stress, resilience, emotional labor, and sleep. Moreover, there were no significant differences between the mobile videoconferencing and in-person conditions at follow-up, suggesting that the benefits of mobile videoconferencing therapy were comparable to those of in-person therapy.

At follow-up, both the mobile videoconferencing and in-person conditions had significantly enhanced resilience compared with the self-care condition, which was the primary goal of the intervention. Resilience enhancement has been recognized as an important part of stress reduction. Resilience refers to the process that allows individuals to adapt positively despite stress or trauma [47]. Resilience-based interventions emphasize strengths within individuals and community members to persevere and recover from environmental, physical, or emotional stress [48]. Previous research regarding resilience suggests approaches that build on strengths rather than problem-focused strategies [47]. Southwick and Charney suggested 5 essential components to resilience interventions: (1) emotional regulation training to recognize and manage reactivity and impulsivity; (2) cognitive behavioral approaches to reframe thought processes and increase positive emotion; (3) physical health information on exercise, nutrition, sleep, and relaxation to increase protective behavior; (4) social support to build connections with family, peers, and mentors to increase protective factors; and (5) neurobiological components, such as mindfulness-based stress reduction, to increase the ability to manage stress [49]. Our intervention contained most of these components, leading to successful resilience enhancement.

Most studies on videoconferencing-based treatments have focused on addressing rural populations. A few studies have investigated the effectiveness of videoconferencing in homebound populations, such as disabled adults with dementia or older adults with depression [50,51]. This study suggests that telepsychology methods can also be useful to young employees living in metropolitan areas. Most adults in their 30s and 40s are smartphone savvy, which can allow them to access treatment at their convenience as long as they have a Wi-Fi or LTE (Long-Term Evolution) connection [10]. Videoconferencing via smartphones is also cost-effective as most people already own smartphones and they will be able to save travel costs [52].

To date, a variety of effective stress management programs for employees has been proposed and made available [53]. A recent meta-analysis found that while cognitive behavioral therapy interventions yielded the largest effect sizes, relaxation and meditation techniques were the most popular [54]. A SMART-3RP program that included both of these components has been found to improve resilience and minimize perceived stress in palliative care clinicians, medical interpreters, and resident physicians [44]. The intervention duration for the original SMART-3RP program was 8 weeks; however, this study showed that the intervention was effective only after 4 sessions. Moreover, this intervention was effective and also had a low drop-out rate (videoconferencing condition 14.2%, in-person condition 0% after treatment engagement) compared with previous studies. For comparison, a recent meta-analysis found that the mean completion of workplace psychological treatments was 45%, with a range of 3%-95% [55]. With respect to the 0% drop-out rate in the in-person condition, almost 40% of participants were employees of the hospitals in which the study took place; hence, high accessibility may have contributed to the low drop-out rate.

Although there was no statistical significance at follow-up, the post hoc analysis revealed that the mobile videoconferencing condition had a greater effect on emotional labor than both the in-person and self-care conditions at posttreatment. Emotional labor is a unique type of stress experienced in employees. Brotheridge and Grandey proposed that there may be two sources to job-related stress: emotional demands of the work environment and employees’ ability to control their emotions. This indicates that workers with emotionally demanding jobs and a low capacity for emotional control likely experience the greatest job-related stress [29]. Of the participants who completed the study, 19 (26.4%) were nurses. Given that emotional labor is key to making patients feel safe and comfortable [56], many nurses experience emotional labor, resulting in higher job stress, poorer health, greater self-alienation, and increased frequency of depressive mood [57]. The results of this study suggest that mobile videoconference interventions may be effective in reducing emotional labor in employees, at least in the short-term.

A major concern of videoconference treatment is the quality of therapeutic alliance between patient and therapist [58]. Therapeutic alliance has been defined as collaborative effort by the therapist and patient to facilitate healing [59]. In this study, there were no significant differences in therapeutic alliance ratings between the conditions. Our findings demonstrate that stress intervention via mobile videoconferencing does not compromise therapeutic alliance, which is in line with previous telepsychology research results [60].

There are a few notable limitations to this study. The length of intervention and follow-up interval were relatively short. Thus, this study provides no information on the long-term effect of mobile videoconference interventions. Participants were mostly female and all were Korean, limiting the generalizability of the findings to the male gender and other ethnic groups. We did not exclude participants with depression, insomnia, or anxiety disorders, making the study population clinically heterogeneous; as the sample size was not sufficient for subgroup analyses according to the presence or absence of psychiatric diagnosis, we were unable to evaluate whether psychiatric diagnoses influenced the effect of mobile videoconference treatment. Moreover, we did not measure if the intervention improved any workplace variables, such as work performance, absenteeism, and turnover rate. There is also the possibility of a selection bias caused by the recruitment of highly motivated participants. Lastly, participants and therapists were not blinded to their treatment conditions, which may have caused an expectation bias.

In conclusion, this study demonstrates that videoconferencing- based stress reduction interventions can be effective in employees. Further studies with larger sample sizes and longer follow-up intervals may be helpful for determining the long-term effect of this intervention.


This research was supported from a fund by the Ministry of Trade, Industry and Energy of South Korea (No. 10069105 to J-HK).

Conflicts of Interest

None declared.

Multimedia Appendix 1

Protocol of stress reduction and resilience enhancement intervention.

PDF File (Adobe PDF File), 15 KB

Multimedia Appendix 2

Changes in clinical scores across time according to condition.

PDF File (Adobe PDF File), 33 KB

Multimedia Appendix 3

CONSORT‐EHEALTH checklist (V.1.6.1).

PDF File (Adobe PDF File), 2462 KB

  1. Akerstedt T. Psychosocial stress and impaired sleep. Scand J Work Environ Health 2006 Dec;32(6):493-501 [FREE Full text] [Medline]
  2. Richardson S, Shaffer JA, Falzon L, Krupka D, Davidson KW, Edmondson D. Meta-analysis of perceived stress and its association with incident coronary heart disease. Am J Cardiol 2012 Dec 15;110(12):1711-1716 [FREE Full text] [CrossRef] [Medline]
  3. Steptoe A, Kivimäki M. Stress and cardiovascular disease. Nat Rev Cardiol 2012 Apr 03;9(6):360-370. [CrossRef] [Medline]
  4. Hammen C. Stress and depression. Annu Rev Clin Psychol 2005;1:293-319. [CrossRef] [Medline]
  5. Paoli P, Merllie D. Third European survey on working conditions 2000. Luxembourg: Office for official publications of the European communities; 2001.
  6. Atkinson W. Stress: risk management's most serious challenge? Risk Manage 2004;51(6):20-24.
  7. Rosch P. The quandary of job stress compensation. Stress Health 2001;3:1-4.
  8. Bhui K, Dinos S, Stansfeld S, White P. A synthesis of the evidence for managing stress at work: a review of the reviews reporting on anxiety, depression, and absenteeism. J Environ Public Health 2012;2012:515874 [FREE Full text] [CrossRef] [Medline]
  9. Ryan C, Bergin M, Chalder T, Wells JS. Web-based interventions for the management of stress in the workplace: Focus, form, and efficacy. J Occup Health 2017 May 25;59(3):215-236 [FREE Full text] [CrossRef] [Medline]
  10. Griffiths F, Lindenmeyer A, Powell J, Lowe P, Thorogood M. Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res 2006 Jun 23;8(2):e10 [FREE Full text] [CrossRef] [Medline]
  11. Chakrabarti S. Usefulness of telepsychiatry: A critical evaluation of videoconferencing-based approaches. World J Psychiatry 2015 Sep 22;5(3):286-304 [FREE Full text] [CrossRef] [Medline]
  12. García-Lizana F, Muñoz-Mayorga I. Telemedicine for depression: a systematic review. Perspect Psychiatr Care 2010 Apr;46(2):119-126. [CrossRef] [Medline]
  13. Bouchard S, Paquin B, Payeur R, Allard M, Rivard V, Fournier T, et al. Delivering cognitive-behavior therapy for panic disorder with agoraphobia in videoconference. Telemed J E Health 2004;10(1):13-25. [CrossRef] [Medline]
  14. Wootton B. Remote cognitive-behavior therapy for obsessive-compulsive symptoms: A meta-analysis. Clin Psychol Rev 2016 Feb;43:103-113. [CrossRef] [Medline]
  15. Sloan D, Gallagher M, Feinstein B, Lee D, Pruneau G. Efficacy of telehealth treatments for posttraumatic stress-related symptoms: a meta-analysis. Cogn Behav Ther 2011;40(2):111-125. [CrossRef] [Medline]
  16. Mitchell JE, Crosby RD, Wonderlich SA, Crow S, Lancaster K, Simonich H, et al. A randomized trial comparing the efficacy of cognitive-behavioral therapy for bulimia nervosa delivered via telemedicine versus face-to-face. Behav Res Ther 2008 May;46(5):581-592 [FREE Full text] [CrossRef] [Medline]
  17. Drago A, Winding TN, Antypa N. Videoconferencing in psychiatry, a meta-analysis of assessment and treatment. Eur Psychiatry 2016 Dec;36:29-37. [CrossRef] [Medline]
  18. Korea Internet and Secury Agency. 2016 Survey on Internet Usage. Seoul, South Korea: Korea Internet and Security Agency; 2017.
  19. Melchior M, Caspi A, Milne BJ, Danese A, Poulton R, Moffitt TE. Work stress precipitates depression and anxiety in young, working women and men. Psychol Med 2007 Aug;37(8):1119-1129 [FREE Full text] [CrossRef] [Medline]
  20. Ebert DD, Heber E, Berking M, Riper H, Cuijpers P, Funk B, et al. Self-guided internet-based and mobile-based stress management for employees: results of a randomised controlled trial. Occup Environ Med 2016 May;73(5):315-323. [CrossRef] [Medline]
  21. Heber E, Ebert D, Lehr D, Cuijpers P, Berking M, Nobis S, et al. The benefit of web- and computer-based interventions for sleep: a systematic review and meta-analysis. J Med Internet Res 2017;19(2):a.
  22. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59 Suppl 20:22-33;quiz 34 [FREE Full text] [Medline]
  23. Yoo S, Kim Y, Noh J, Oh K, Kim C, Namkoong K, et al. Validity of Korean version of the Mini Interational Neuropsychiatric Interview. Anxiety Mood 2006;2:50-55.
  24. Marinaccio A, Ferrante P, Corfiati M, Di TC, Rondinone B, Bonafede M, et al. The relevance of socio-demographic and occupational variables for the assessment of work-related stress risk. BMC Public Health 2013 Dec 10;13:1157 [FREE Full text] [CrossRef] [Medline]
  25. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav 1983 Dec;24(4):385-396. [Medline]
  26. Lee E, Chung BY, Suh C, Jung J. Korean versions of the Perceived Stress Scale (PSS-14, 10 and 4): psychometric evaluation in patients with chronic disease. Scand J Caring Sci 2015 Mar;29(1):183-192. [CrossRef] [Medline]
  27. Chang SJ, Kang DM, Kang HT, Kim SY, Kim IA, Kim JI. Application research for Korean emotional labor scale and Korean workplace violence scale. Seoul: Occupational Safety and Health Research Institute, Korean Occupational Safety & Health Agency; 2014.
  28. Hochschild A. The managed heart: commercialization of human feeling. Berkeley and Los Angeles, California: University of California Press; 1983.
  29. Brotheridge C, Grandey A. Emotional labor and burnout: Comparing two perspectives of “people work”. J Vocat Behav 2002;60(1):17-39.
  30. Morris J, Feldman D. The Dimensions, Antecedents, and Consequences of Emotional Labor. The Academy of Management Review 1996 Oct;21(4):986-1010. [CrossRef]
  31. Brotheridge CM, Lee RT. Testing a conservation of resources model of the dynamics of emotional labor. J Occup Health Psychol 2002 Jan;7(1):57-67. [Medline]
  32. Gilstrap C. Closing in on closeness: Teacher immediacy as a form of emotion labor. USA: Purdue University, ProQuest Dissertations Publishing; 2005.
  33. Kruml S, Geddes D. Exploring the Dimensions of Emotional Labor. Management Communication Quarterly 2016 Aug 17;14(1):8-49. [CrossRef]
  34. Blau G, Fertig J, Surges TD, Connaughton S, Soo PD, Marshall C. Further scale refinement for emotional laborxploring distinctions between types of surface versus deep acting using a difficult client referent. Career Dev Int 2010;15(2):188-216.
  35. Van Dijk PA, Brown AK. Emotional labour and negative job outcomes: An evaluation of the mediating role of emotional dissonance. J Manag Organ 2006;12(2):101-115.
  36. Mann S. Emotion at Work: To What Extent are We Expressing, Suppressing, or Faking It? European Journal of Work and Organizational Psychology 1999 Sep;8(3):347-369. [CrossRef]
  37. Brotheridge C, Lee R. Development and validation of the emotional labour scale. J Occup Organ Psychol 2003;76(3):365-379.
  38. Best R, Downey R, Jones R. editors. 1997 Presented at: Incumbent perceptions of emotional work requirements. 12th annual conference of the Society for Industrial and Organizational Psychology; 1997; St Louis, MO.
  39. Zapf D, Vogt C, Seifert C, Mertini H, Isic A. Emotion Work as a Source of Stress: The Concept and Development of an Instrument. European Journal of Work and Organizational Psychology 1999 Sep;8(3):371-400. [CrossRef]
  40. Chang S, Koh S, Kang D, Kim S, Kang M, Lee C, et al. Developing an occupational stress scale for Korean employees. Korean J Occup Environ Med 2005;17:297-317.
  41. Smith B, Dalen J, Wiggins K, Tooley E, Christopher P, Bernard J. The brief resilience scale: assessing the ability to bounce back. Int J Behav Med 2008;15(3):194-200. [CrossRef] [Medline]
  42. Salisu I, Hashim N. A Critical Review of Scales Used in Resilience Research. IOSR JBM 2017 Apr;19(04):23-33. [CrossRef]
  43. Soldatos CR, Dikeos DG, Paparrigopoulos TJ. Athens Insomnia Scale: validation of an instrument based on ICD-10 criteria. J Psychosom Res 2000 Jun;48(6):555-560. [Medline]
  44. Jeong HS, Jeon Y, Ma J, Choi Y, Ban S, Lee S, et al. Validation of the Athens Insomnia Scale for screening insomnia in South Korean firefighters and rescue workers. Qual Life Res 2015 Oct;24(10):2391-2395. [CrossRef] [Medline]
  45. Bui E, Chad-Friedman E, Wieman S, Grasfield R, Rolfe A, Dong M, et al. Patient and Provider Perspectives on a Mind-Body Program for Grieving Older Adults. Am J Hosp Palliat Care 2018 Jun;35(6):858-865. [CrossRef] [Medline]
  46.   URL:]; [accessed 2018-09-07] [WebCite Cache]
  47. Luthar S, Cicchetti D, Becker B. The construct of resilience: a critical evaluation and guidelines for future work. Child Dev 2000;71(3):543-562 [FREE Full text] [Medline]
  48. Zautra A, Arewasikporn A, Davis M. Resilience: Promoting Well-Being Through Recovery, Sustainability, and Growth. Research in Human Development 2010 Aug 27;7(3):221-238. [CrossRef]
  49. Southwick SM, Charney DS. The science of resilience: implications for the prevention and treatment of depression. Science 2012 Oct 05;338(6103):79-82. [CrossRef] [Medline]
  50. Choi NG, Hegel MT, Marti N, Marinucci ML, Sirrianni L, Bruce ML. Telehealth problem-solving therapy for depressed low-income homebound older adults. Am J Geriatr Psychiatry 2014 Mar;22(3):263-271 [FREE Full text] [CrossRef] [Medline]
  51. Tang W, Chiu H, Woo J, Hjelm M, Hui E. Telepsychiatry in psychogeriatric service: a pilot study. Int J Geriatr Psychiatry 2001 Jan;16(1):88-93. [Medline]
  52. Simpson S. Psychotherapy via videoconferencing: a review. British Journal of Guidance & Counselling 2009 Aug;37(3):271-286. [CrossRef]
  53. van der Klink JJ, Blonk RW, Schene AH, van Dijk FJ. The benefits of interventions for work-related stress. Am J Public Health 2001 Feb;91(2):270-276. [Medline]
  54. Richardson K, Rothstein H. Effects of occupational stress management intervention programs: a meta-analysis. J Occup Health Psychol 2008 Jan;13(1):69-93. [CrossRef] [Medline]
  55. Carolan S, Harris P, Cavanagh K. Improving Employee Well-Being and Effectiveness: Systematic Review and Meta-Analysis of Web-Based Psychological Interventions Delivered in the Workplace. J Med Internet Res 2017 Jul 26;19(7):e271 [FREE Full text] [CrossRef] [Medline]
  56. Gray B, Smith. Emotional labour and the clinical settings of nursing care: the perspectives of nurses in East London. Nurse Educ Pract 2009 Jul;9(4):253-261. [CrossRef] [Medline]
  57. Kovacs M, Kovacs E, Hegedu K. Emotion work and burnout: cross-sectional study of nurses and physicians in Hungary. Croat Med J 2010 Oct;51(5):432-442 [FREE Full text] [Medline]
  58. Simpson S, Reid C. Therapeutic alliance in videoconferencing psychotherapy: a review. Aust J Rural Health 2014 Dec;22(6):280-299. [CrossRef] [Medline]
  59. Bachelor A, Horvath A. The therapeutic relationship. In: Hubble MA, Duncan, B.L., Miller, S. D., editor. The heart and soul of change: what works in therapy. Washington, DC: American Psychological Association; 1999:133-178.
  60. Simpson S, Bell L, Knox J, Mitchell D. Therapy via videoconferencing: a route to client empowerment? Clin. Psychol. Psychother 2005 Mar;12(2):156-165. [CrossRef]

AIS: Athens Insomnia Scale
ANOVA: analysis of variance
BRS: Brief Resilience Scale
KELS: Korean Emotional Labor Scale
KOSS: Korean Occupational Stress Scale
MINI: Mini-International Neuropsychiatric Interview
PSS: Perceived Stress Scale
SMART-3RP: Stress Management and Resilience Training: Relaxation Response Resilience Program

Edited by G Eysenbach; submitted 12.04.18; peer-reviewed by C Ryan, TR Soron; comments to author 23.05.18; revised version received 20.06.18; accepted 21.06.18; published 22.10.18


©Johanna Inyang Kim, Je-Yeon Yun, Heyeon Park, Suk-Young Park, Youngsheen Ahn, Hansol Lee, Tae-Kwon Kim, Sooran Yoon, Young-Joon Lee, Sohee Oh, John W. Denninger, Bung-Nyun Kim, Jeong-Hyun Kim. Originally published in the Journal of Medical Internet Research (, 22.10.2018.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.