Accessibility settings

Published on in Vol 28 (2026)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/68051, first published .
Laptop displaying an open email with warning signs, symbolizing cybersecurity threats.

Cognitive Dissonance–Based Priming Intervention: Randomized Encouragement With in-the-Wild Phishing Simulation Attack in Health Care

Cognitive Dissonance–Based Priming Intervention: Randomized Encouragement With in-the-Wild Phishing Simulation Attack in Health Care

1Department of Computer Science and IT, College of Engineering, Abu Dhabi University, Al Ain, Abu Dhabi, United Arab Emirates

2Department of Informatics Engineering, Faculty of Computer Science, University of Brawijaya, Malang, Indonesia

3Department of Information Security and Communication Technology, Faculty of Information Technology and Electrical Engineering, Norwegian University of Science and Technology (NTNU), Gjøvik, Norway

4Department of Information Security and Communication Technology, Faculty of Information Technology and Electrical Engineering, Norwegian University of Science and Technology (NTNU), Trondheim, Norway

5Department of Security and Risk Governance, Aidn AS, Oslo, Norway

6Department of Machine Learning and Computer Vision, School of Computing, Engineering and Technology, Robert Gordon University, Aberdeen, United Kingdom

Corresponding Author:

Prosper Kandabongee Yeng, PhD


Background: Phishing remains a dominant initial attack vector in health care, exploiting psychological factors such as urgency and authority. Despite extensive investment in technical controls and awareness training, health care staff remain highly susceptible in real operational conditions. Cognitive dissonance (CD), the discomfort arising from inconsistencies between beliefs and actions, has been proposed as a mechanism to disrupt unsafe rationalization at the moment of exposure, but has rarely been evaluated in live organizational settings using objective behavioral outcomes.

Objective: This study examined whether a brief CD-based priming intervention, delivered immediately prior to a real-world phishing simulation, was associated with differences in phishing susceptibility among health care staff. Secondary objectives explored whether CD exposure was associated with directional differences in security-related perceptions and self-reported practices.

Methods: A 2-stage hybrid randomized-encouragement experiment was conducted at a large Norwegian hospital. In Stage 1, staff were randomly assigned to a control or CD-primed condition and completed a survey assessing security perceptions and self-reported practices (n=62). In Stage 2, an in-the-wild phishing simulation was sent to all staff, enabling objective measurement of phishing susceptibility via observed link-click behavior. Behavioral outcomes were analyzed across 3 groups—control (n=34), CD-primed (n=32), and neutral nonresponders (n=753)—using a prespecified omnibus chi-square test as the sole confirmatory analysis. Survey-based multivariate and univariate analyses were treated as exploratory due to limited sample size and variable construct reliability.

Results: Due to voluntary uptake, only a subset of randomized participants received the intervention. Observed phishing click rates were 65% (22/34) in the control group, 44% (14/32) in the CD-primed group, and 53% (396/753) in the neutral group. The omnibus chi-square test did not detect a statistically significant association between group membership and click behavior (χ²2=3.00; n=819; P=.22; Cramér V=0.06). Descriptive comparisons within the randomized subset suggested lower click rates in the CD-primed group, but effect estimates were imprecise and associated with wide CIs. Survey-based analyses indicated group differences across combined psychological constructs; however, several constructs exhibited low internal consistency, and follow-up analyses were underpowered.

Conclusions: In a real-world hospital phishing simulation, pre-exposure CD priming was associated with a directional but statistically nonsignificant pattern of reduced phishing click behavior. This evidence does not establish a reliable behavioral effect, and construct-level findings are exploratory. CD-based prompts may serve as a lightweight behavioral signal in real-world conditions, but larger, fully randomized, and longitudinal studies with improved psychometric validation are needed before such interventions can be considered reliable complements to established cybersecurity controls.

J Med Internet Res 2026;28:e68051

doi:10.2196/68051

Keywords



Background

Phishing remains the dominant initial attack vector in health care, accounting for a substantial proportion of breaches between 2022 and 2025 through credential theft, business email compromise, and ransomware deployment [1-3]. Despite significant investment in email filtering and endpoint defenses, health care employees continue to be exposed to highly contextualized phishing campaigns that exploit clinical workflows, trust relationships, professional hierarchies, and time pressure [2-6]. Consequently, health care has become one of the costliest sectors for data breaches, with human-driven social engineering outweighing purely technical exploitation [2,2,4,7-9]. These attacks not only compromise data confidentiality but also disrupt care delivery, delay clinical workflows, and threaten patient safety [9-11].

To explain persistent phishing susceptibility, prior research has increasingly applied psychological frameworks such as the Health Belief Model (HBM) and Protection Motivation Theory (PMT) [7,10,12,13]. These models examine how perceived severity (PS), perceived vulnerability (PV), self-efficacy (SE), and response efficacy (RE) influence individual security behavior. However, most health care phishing studies rely on self-reported intentions, survey-based perceptions, or post-hoc evaluations conducted in training contexts rather than during real operational attacks [4-6,14-16]. As a result, existing interventions rarely disrupt unsafe cognition at the moment of threat exposure, nor do they validate effectiveness using objective behavioral outcomes [3,4,11,14].

The objectives of this study are therefore outlined as follows:

  • Delivering the first cognitive dissonance (CD)–based prephishing intervention tested in a live hospital;
  • Experimentally linking CD to shifts in HBM or PMT perceptions;
  • Measuring real click behavior during an in-the-wild phishing event;
  • Demonstrating a theory-driven, low-cost behavioral security control with ecological validity.

CD-Based in-the-Wild Phishing Intervention

CD theory explains how individuals experience psychological discomfort when their beliefs conflict with their actions, such as recognizing phishing risks while still clicking urgent or authoritative emails [17-19]. To reduce this discomfort, individuals often rationalize risky behavior through neutralization techniques, including denial of harm, denial of responsibility, or appeals to higher organizational goals [11,20-22]. In health care contexts, such rationalizations have been observed in email-policy violations, unsafe password practices, and delayed incident reporting justified by clinical urgency [4,10,10,23].

Phishing attackers deliberately exploit these same psychological mechanisms by embedding urgency, authority, fear, and trust cues into realistic clinical narratives, thereby intensifying cognitive conflict and impairing reflective judgment [3,6,23,24]. Recent reviews emphasize that such human-factor vulnerabilities remain inadequately addressed by purely technical controls and awareness-only training approaches [8,9,13,25].

This study introduces a CD-based priming intervention delivered immediately before an in-the-wild phishing simulation at one of Norway’s largest hospitals. Unlike traditional training, deterrence-based sanctions, or postincident awareness programs [11,13-15,25], CD priming operates as a proactive, preattack behavioral control that directly targets rationalization before exposure. The intervention is lightweight, theory-driven, and embedded within routine organizational communication, making it suitable for real clinical environments characterized by time pressure and high cognitive load [3,3,9].

Methodologically, the study advances prior work in 3 ways. First, it deploys CD priming immediately prior to a live operational phishing event rather than within simulated, laboratory, or training-only contexts [5,11,14,26]. Second, it integrates CD with established HBM and PMT constructs to examine shifts in theory-driven security perceptions [7,10,12,13,15]. Third, it validates intervention effectiveness using objective behavioral outcomes—actual link-click behavior—while minimizing ethical risk by avoiding credential harvesting and excessive deception [27,28]. To our knowledge, no prior health care study has combined CD-based priming, health-behavior theory, and in-the-wild behavioral measurement within a single experimental design [3,9,29].

Hypothesis Formulation and Contributions

The primary objective of this study was to examine whether exposure to a CD-based priming intervention was associated with differences in observed phishing susceptibility during a real-world phishing simulation (hypothesis 1). Secondary analyses explored whether CD exposure was associated with directional differences in psychological security perceptions and self-reported security practices.

The following hypothesis and research questions were therefore specified:

Hypothesis 1 (Confirmatory)

Exposure to a CD-based priming intervention is associated with differences in observed phishing susceptibility, measured by link-click behavior during an in-the-wild phishing simulation.

Research Question (RQ) 1 (Exploratory)

Is exposure to a CD-based priming message associated with directional differences in selected security-related perceptions derived from the Health Belief Model (HBM) and Protection Motivation Theory (PMT), including PV, PS, SE, RE, perceived barriers (PBs), and cues to action (CA)?

RQ2 (Exploratory)

Is exposure to a CD-based priming message associated with directional differences in self-reported security practices related to password management, incident reporting, email handling, and mobile-device security?


Overview

This study used a 2-stage randomized encouragement design [30,31], involving approximately 830 health care staff who were randomly assigned at the invitation stage to receive either a control or a CD-primed questionnaire [27,32,33]. Only a subset of invited staff completed the questionnaire and were therefore exposed to the intervention (control: n=42; CD-primed: n=40), while nonresponse was treated as nonreceipt rather than exclusion, consistent with established methodological guidance [34]. Randomization, therefore, applies only to encouragement and survey exposure, not to subsequent receipt of the phishing email or behavioral outcome measurement.

In Stage 2, an in-the-wild phishing simulation [4] message (as shown in Figure 1) was sent to all staff with valid email addresses, enabling objective measurement of phishing click behavior under real-world conditions. Primary outcome analyses for the randomized component were conducted among questionnaire respondents who received valid phishing emails. These participants were the only ones plausibly exposed to both the intervention and the behavioral outcome. In parallel, a large Neutral group comprising staff who did not complete the questionnaire but received the in-the-wild phishing email was included as an observational comparison. Analyses involving this group are reported descriptively and interpreted without causal inference in accordance with STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) guidelines [35], while the randomized encouragement component is reported following CONSORT (Consolidated Standards of Reporting Trials) principles [36], ensuring transparent reporting of participant flow, uptake, and inferential boundaries.

Figure 1. Phishing attack simulation message.

Behavioral outcomes were assessed independently of survey participation. Valid delivery and outcome records were available for 819 participants, who formed the sample used for behavioral analysis. These participants fell into 3 groups based on their prior exposure to the CD message:

  • Control group: survey respondents who did not receive the CD message and had valid phishing-outcome data (n=34).
  • Experiment group: survey respondents who received the CD message and had valid phishing-outcome data (n=32). The architecture is shown in Figure 2.
  • Neutral group: all remaining staff who did not receive any CD-related priming but successfully received the phishing email (n=753).
Figure 2. Experiment model for psychological incentive.

The difference between the invited population (~830) and the Stage 2 analyzed sample (819) reflects staff with undeliverable emails. This grouping structure enabled the study to (1) evaluate the causal effect of the CD intervention on psychological and self-reported outcomes among survey respondents and (2) compare their actual phishing susceptibility against a large neutral group not exposed to any experimental priming.

As an incentive, participants in both stages were offered a free lunch at the hospital canteen and also entered into a draw in which 10 individuals could win a US $50 gift card [37,38].

Behavioral Outcome: Phishing Click Susceptibility

Actual behavioral phishing susceptibility was measured by recording objective link-click behavior during the in-the-wild phishing simulation and coding it as a binary outcome (clicked vs not clicked) across 3 groups, including control (n=34), CD-primed (n=32), and neutral (n=753).

The primary, prespecified analysis was an omnibus Pearson chi-square test of independence (3×2 contingency table; 2-sided α=.05). While this test was designated a priori as the primary behavioral analysis, causal inference is limited to the randomized comparison between the control and CD-primed groups; comparisons involving the neutral group are observational.

Effect size was quantified using Cohen w and Cramér V, and group-specific click rates were reported with 95% CIs (Wilson method) [39]. Pairwise comparisons between the CD-primed and control groups were reported descriptively using risk difference, relative risk, and odds ratio with 95% CIs and treated as exploratory due to limited sample size [40].

A post hoc power assessment for the omnibus test was reported descriptively to characterize statistical sensitivity, rather than to support inferential claims. All analyses were conducted using the statsmodels Python (Python Software Foundation) library [16,41].

Ethical, Privacy, and Security Measures With an in-the-Wild Study

In this experiment, a questionnaire and an in-the-wild study were combined. The hybrid approach was essential, as the survey provided a basis for the researchers to understand participants’ intended phishing security behavior, while the in-the-wild study tested participants’ actual phishing security practice (ie, the clicking action). An in-the-wild study is a type of phishing simulation in which the researcher conducts a phishing attack on participants in their natural working environment without prior warning to observe real-world security behavior under realistic conditions. Unlike laboratory-based or survey-based studies, in-the-wild studies capture authentic user responses but raise additional ethical and methodological considerations [4,27].

Survey Instrument

In the first section of the questionnaire, we adopted the approach of Parsons et al [42], the human aspect of the information security questionnaire. This consists of 42 items that measure knowledge, attitude, and behavior (KAB) regarding phishing, as well as risk factors associated with password management, email use, incident reporting, and mobile device use. A 5-point Likert scale was used in this instrument. These areas of security practice are considered more vulnerable to phishing attacks. Additionally, approximately 25 items in this instrument measured other psychological constructs, including PV, SE, CA, PB, and RE. Figure 2 shows the questionnaire structure. The instrument was developed with an online, secure Norwegian version of a survey system called Nettskjema [43]. The questionnaire was then divided into 2 groups, a control group and the experiment group. The difference between them was that the experiment group questionnaire included a CD message, as shown in Multimedia Appendix 1, and in the model in Figure 3. Participants also indicated in the questionnaire if they believe in the CD message as shown in Figure 4. The questionnaire for the control group did not include the CD message item. The instrument was then pretested with 4 PhD students and a professor specializing in cybersecurity. Issues, including complex terminologies and the length of the CD message, were identified and resolved. Measures were also taken against error variances [44]. Error variance can be caused by preexisting factors that introduce differences among the study groups, beyond the treatment effect. In this regard, the health care personnel were randomly assigned to reduce potential biases. Additionally, the participants were asked not to share their questionnaires with others. Attention checkers [45] were among the survey items in the study, and these required the participants to choose specified responses. Participants who fail to correctly answer 2 of the 3 attention checkers are inferred to have not paid attention while answering the questionnaire. As a result, 2 records were discarded. This has been one of the most popular methods for improving survey response quality without compromising research findings. The participants also had to either agree or disagree with the cognitive dissonance message, as shown in Figure 5.

Figure 3. Experiment setup.
Figure 4. Response rate.
Figure 5. Cognitive dissonance message agreement for experiment group.

Phishing Simulation Setup and Experiment Process

A phishing simulation tool, known as Gophish (Jordan Wright) [28], was set up on a server, as illustrated in Figure 3. It has a feature that allows an attacker to simulate a phishing email and send it to a target. It can also record click events on links in phishing emails.

During the initial setup, the simulated phishing email was tested with the staff of the target hospital; however, it was flagged as spam by the service provider’s email filtering system. Since the study goal was not to test the technical email security controls of the target facility, we collaborated with the providers who configured the email system to allow the phishing simulation email to land in the inboxes of the targeted participants. The email message content is shown in Multimedia Appendix 2.

The in-the-wild phishing simulation was implemented using the open-source GoPhish platform, which was configured to deliver a single simulated phishing email to staff with valid institutional email addresses [28]. The platform automatically recorded email delivery status and objective link-click events, which were used as the primary behavioral outcome measure [11,26,29,46-50].

The flow of participants in both the controlled experiment and the observational study is shown in Figures 6 and 7, respectively. The CONSORT and STROBE checklists have also been provided in Checklist 1 and Checklist 2, respectively.

Figure 6. CONSORT (Consolidated Standards of Reporting Trials) diagram.
Figure 7. STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) diagram.

Fourteen dependent scale variables representing psychosocial constructs derived from the Health Belief Model and Protection Motivation Theory were included in the exploratory multivariate analysis [51,52]. Additionally, a minimum of one independent variable is required with at least 2 categorical groups. Our study also meets this condition with an independent 2-level design: in the first stage, there are 2 levels (control and experiment), and in the second stage, there are 3 groups (neutral, control, and experiment). A multivariate analysis of variance (MANOVA) assumes multivariate normality. The test also requires homogeneity of covariate metrics, and the dependent variables must not be multicollinear. A sufficient sample size is also needed in MANOVA. A sample size is required for each level of the independent variable. The rule of thumb requires 30 participants per group level [53]. The actual behavior (AB) variable has the lowest number of participants in the control and experimental groups, 30 and 32, respectively, indicating that the study met the minimum requirement [54]. Cronbach α was used in this study because it is a widely used measure of reliability [40].

Ethical Considerations

Prior to the launch of the phishing study, a press release was issued to administrators. Additionally, during the launch of the attack, data protection and the well-being of the participants were considered by providing a debriefing and obtaining informed consent [27]. Having followed these measures, this study obtained ethical clearance from the targeted hospital, the Regional Committees for Medical and Health Research Ethics of Norway (REK), and the Norwegian Center for Research Data (NSD). A phishing simulation was then conducted via email in this experiment.


Overview

To ensure methodological transparency and inferential clarity, the analytical strategy was explicitly aligned with the study objectives. The omnibus chi-square test of independence comparing click behavior across the control, CD-primed, and neutral groups (n=819) was designated a priori as the sole confirmatory test of behavioral impact (hypothesis 1). All survey-based multivariate and univariate analyses, conducted on a substantially smaller subsample (n=62), were treated as exploratory and hypothesis-generating due to limited statistical power and variable construct reliability. This alignment ensures that confirmatory claims are restricted to adequately powered, objective behavioral outcomes, while construct-level findings are interpreted conservatively and used to inform future research design. This section presents the analysis of the results, covering descriptive statistics, click rates, reliability, normality tests, and the significance of the studies.

Descriptive Statistics

All participants in the CD condition agreed with the presented message. As shown in Table 1, a total of 80 records from the survey were analyzed out of 82 participants. Two records were removed from the analysis because they did not pass the attention checks that were placed in the questionnaire [45].

Table 1. Descriptive statistics of demographic variables (N=80).
Variable categoryn (%)
Sex
Male58 (72.5)
Female22 (27.5)
Age range (years)
21‐3014 (17.5)
31‐4023 (28.8)
41‐5018 (22.5)
51‐6016 (20.0)
>609 (11.3)
Position
Administrator6 (7.5)
Nurse40 (50.0)
Doctor31 (38.8)
Others3 (3.8)
Years of experience
1‐59 (11.3)
6‐1019 (23.8)
11‐1510 (12.5)
16‐2013 (16.3)
>2029 (36.3)
Knowledge of phishing attacks
No knowledge12 (15.0)
Basic23 (28.8)
Medium26 (32.5)
High15 (18.8)
Very high3 (3.8)
Professional1 (1.3)
Opinion in cognitive dissonance
Not available40 (50.0)
Agree38 (95.0)
Disagree2 (5.0)

Furthermore, among these participants, 72.5% (58/80) were males, while 27.5% (22/80) were females. The age group 31-40 years old had the highest proportion (23/80, 28%), while participants >60 years old had the lowest proportion (9/80, 11.3%). Regarding the participants, primarily doctors, nurses, and administrators participated. Nurses comprised more than half of the total participants (40/80, 50%), followed by doctors (31/80, 38%) and administrators (6/80, 7.5%). In terms of years of work experience, participants with >20 years of experience were comparatively more numerous (29/80, 36.3%), as shown in Table 1. Meanwhile, the participants also shared their phishing security practice knowledge. Most of them (26/80, 32.5%) had medium knowledge, 28% (23/80) had basic knowledge, and 15% (12/80) reported no knowledge of phishing security practices. Additionally, participants in the experiment group shared their opinion on the treatment effect of CD. Out of the 40 participants in the experiment group, 38 (95%) agreed with the effectiveness of the treatment measure. To control for these confounding variables, the randomization approach [55] was used to assign participants to the 2 groups in this study.

As shown in Table 2, descriptive statistics were computed for all dependent variables across study groups. Overall, mean values for security practice measures were generally higher in the control group than in the experimental group. Box’s test of equality of covariance matrices was conducted to assess the assumption that the covariance matrices of the dependent variables were equivalent across groups. The test yielded a Box’s mean value of 153.081 with a nonsignificant P value (P=.24), indicating no evidence of heterogeneity in covariance matrices. Consistent with established guidelines [56], the null hypothesis of equal covariance matrices was therefore retained.

Table 2. Descriptive statistics of dependent variables across groups.
Construct (n)Mean (SD)
Actual behavior (AB)
Control (30)3.93 (1.799)
Experiment (32)2.75 (2.016)
Knowledge (K)
Control (30)1.82 (0.412)
Experiment (32)1.81 (0.494)
Attitude (A)
Control (30)1.79 (0.338)
Experiment (32)1.62 (0.541)
Intended behavior (IB)
Control (30)1.92 (0.371)
Experiment (32)1.73 (0.463)
Perceived vulnerability (PV)
Control (30)2.09 (0.711)
Experiment (32)1.85 (0.871)
Perceived severity (PS)
Control (30)2.07 (0.719)
Experiment (32)1.41 (0.534)
Perceived self-efficacy (SE)
Control (30)2.75 (0.65)
Experiment (32)2.45 (0.672)
Perceived response efficacy (RE)
Control (30)1.4 (0.395)
Experiment (32)1.41 (0.534)
Perceived barrier (PB)
Control (30)3.35 (0.842)
Experiment (32)3.34 (0.689)
Perceived cues to action (CA)
Control (30)2.98 (0.517)
Experiment (32)2.55 (0.787)
Password
Control (30)1.82 (0.482)
Experiment (32)1.67 (0.59)
Incident
Control (30)2.39 (0.708)
Experiment (32)2.07 (0.766)
Email
Control (30)1.6 (0.43)
Experiment (32)1.49 (0.523)
Mobile
Control (30)1.65 (0.355)
Experiment (32)1.65 (0.471)

Reliability, Validity, and Assumption Assessment

Table 3 presents internal consistency estimates for the study constructs. Cronbach α values ranged from 0.256 for CA to 0.792 for incident reporting. While several constructs demonstrated acceptable internal consistency, most notably CA (α=0.256), password practices (α=0.349), and PBs (α=0.476) exhibited poor internal consistency. These variables were therefore retained solely as exploratory indicators and were not used to support confirmatory inference or substantive theoretical claims.

Table 3. Reliability statistics.
NumberConstructCronbach αNumber of items (n)
1Knowledge (K)0.66013
2Attitude (A)0.539
3Behavior (B)0.64816
4Perceived vulnerability (PV)0.6543
5Perceived severity (PS)0.5403
6Perceived self-efficacy (SE)0.6556
6Perceived response efficacy (RE)0.7173
8Perceived barriers (PB)0.4764
9Cues to action (CA)0.2562
10Password0.3496
11Incident0.7929
12Email0.5547
13Mobile0.6512

Phishing Click Behavior With Chi-Square Test

Phishing susceptibility was evaluated using an omnibus chi-square test of independence comparing link-click behavior across 3 groups, including control (n=34), CD-primed (n=32), and neutral nonresponders (n=753). Observed click rates were 65% (22/34) in the control group, 44% (14/32) in the CD-primed group, and 53% (396/753) in the neutral group (Table 4; Figure 4). The corresponding 95% CIs (Wilson method) were 0.48‐0.79, 0.28‐0.61, and 0.49‐0.56, respectively.

Table 4. Observed contingency table for phishing click behavior.
OutcomeControl (n=34)CD-Primed (n=32)Neutral (n=753)
Clicked (n)2214396
Not clicked (n)1218357
Total (n)3432753

The omnibus chi-square test did not detect a statistically significant association between group membership and click behavior, (χ²2=3.00; n=819=; P=.22). The effect size was small (Cramér V=0.060; approximately 95% CI 0.00‐0.12), indicating that differences in click behavior across groups were modest and consistent with sampling variability.

To contextualize the observed pattern within the randomized subset, exploratory descriptive comparisons were computed between the CD-primed and control groups. The CD-primed group exhibited a lower observed click rate than the control group (44% vs 65%), corresponding to an absolute risk difference of −0.21 (95% CI −0.45 to 0.03), a relative risk of 0.68 (95% CI 0.42‐1.08), and an odds ratio of 0.42 (95% CI 0.16-1.14). These estimates are imprecise due to small group sizes and are reported descriptively without confirmatory inference.

Because the Neutral group was not randomized and consists of nonresponders, comparisons involving the Neutral group are observational and may reflect selection bias or baseline differences rather than intervention effects. Overall, the behavioral results indicate, at most, a directional but statistically nonsignificant association between CD exposure and immediate phishing click behavior under real-world conditions.

A post hoc power assessment based on the observed effect size (W=0.060) indicated limited sensitivity to detect effects of this magnitude (power ≈0.32) and is reported descriptively only.

Assumption Checks

Normality of the dependent variables was assessed using the Shapiro-Wilk test [57]. As shown in Table 5, several variables deviated from normality, which informed the selection of robust and nonparametric analytical approaches.

Table 5. Normality test (Shapiro-Wilk).
Construct-Shapiro-Wilk statistic, W (df)P value
Actual behavior (AB)0.627 (62)<.001
Knowledge (K)0.969 (62).11
Attitude (A)0.954 (62).02
Intended behavior (IB)0.968 (62).11
Perceived vulnerability (PV)0.917 (62)<.001
Perceived severity (PS)0.884 (62)<.001
Perceived self-efficacy (SE)0.981 (62).43
Perceived response efficacy (RE)0.814 (62)<.001
Perceived barriers (PB)0.966 (62).08
Cues to action (CA)0.828 (62)<.001
Password0.951 (62).01
Incident0.960 (62).04
Email0.887 (62)<.001
Mobile0.931 (62).002

Exploratory Multivariate Analyses

Subsequently, a one-way MANOVA was performed to examine whether group membership was associated with differences in the combined set of dependent variables, including mobile device and SMS use and incident reporting, as shown in Table 6. Statistical significance was evaluated at an ɑ level of .05.

Table 6. Correlation (n=62).
VariableABaKnowledgeAttitudeIBbPVcPSdSEeREfPBgCAhPasswordIREmail useMobile
ABi–0.371j–0.021–0.0500.0100.2270.090–0.0900.1130.0410.041–0.175–0.027–0.208
Knowledge–0.371j0.500j0.515j0.133–0.1590.440j0.336j–0.328j0.1490.390j0.495j0.538j0.683j
Attitude–0.0210.500j0.468j0.261k0.2130.0670.257k–0.2090.0740.394j0.658j0.402j0.382j
IB–0.0500.515j0.468j0.293j0.297j0.432j0.407j–0.401j0.337j0.642j0.637j0.655j0.479j
PV0.0100.1330.261k0.293j0.383j0.0300.319j–0.1470.1260.2170.291j0.0760.050
PS0.227−0.1590.2130.297j0.383j0.0620.148–0.1280.1730.243k0.272k0.150–0.019
SE0.0900.440j0.0670.432j0.0300.0620.366j–0.323j0.537j0.1580.1560.431j0.505j
RE–0.0900.336j0.257k0.407j0.319j0.1480.366j–0.1080.1460.1720.232k0.356j0.350j
PB0.113–0.328j–0.209–0.401j–0.147–0.128–0.323j–0.108–0.336j–0.264k–0.330j0.236k0.148
CA0.0410.1490.0740.337j0.1260.1730.537j0.146–0.336j0.1330.1820.2040.362j
Password0.0410.390j0.394j0.642j0.2170.243k0.1580.172–0.264k0.1330.383j0.353j0.210
IR–0.1750.495j0.658j0.637j0.291j0.272k0.1560.232k–0.330j0.1820.383j0.335j0.133
Email use–0.0270.538j0.402j0.655j0.0760.1500.431j0.356j0.236k0.2040.353j0.335j0.463j
Mobile–0.2080.683j0.382j0.479j0.050–0.0190.505j0.350j0.1480.362j0.2100.1330.463j

aAB: actual behavior.

bIB: intended behavior.

cPV: perceived vulnerability.

dPS: perceived severity.

eSE: self-efficacy.

fRE: response efficacy.

gPB: perceived barrier.

hCA: cues to action.

iNot available.

jCorrelation is significant at the 0.01 level (2-tailed).

kCorrelation is significant at the 0.05 level (2-tailed).

Given the inclusion of constructs with low internal consistency, MANOVA is interpreted strictly as a descriptive screening of group differentiation rather than as inferential evidence of multivariate effects. A multivariate effect was observed in the MANOVA. Pillai’s Trace was used for the omnibus multivariate test. The analysis yielded a Pillai’s Trace of 0.442, F14, 47=2.660; P=.006, indicating overall group differences across the combined set of dependent variables. Given the heterogeneous reliability of the included constructs and the limited survey sample size, this result is interpreted as an omnibus, exploratory indication of group differentiation rather than evidence of specific construct-level effects.

The estimated multivariate effect size suggests that approximately 44.2% of the variance in the linear combination of dependent variables was associated with group membership. Assumptions for follow-up univariate analyses were assessed using Levene test across all 14 dependent variables [58]. Although AB and CA showed statistically significant Levene results (P<.05), inspection of group standard deviations (Table 2) revealed no substantial imbalance in variance, supporting the robustness of subsequent ANOVA analyses. The CA exhibited very low internal consistency (Cronbach α=0.256) and were therefore retained solely as an exploratory indicator, without supporting confirmatory inference.

Follow-up one-way ANOVA tests indicated statistically significant group differences for AB, PS, and CA (Table 7). Findings for constructs with acceptable reliability are interpreted with greater confidence, whereas results involving CA, PBs, and password practices are treated as exploratory, with emphasis placed on effect sizes rather than P values. In particular, although statistical differences were observed for CA, this finding is interpreted cautiously due to very low internal consistency and is reported only as an exploratory pattern rather than a substantive effect.

Table 7. ANOVA results.
*Construct*Sum of SquaresdfMean SquareFP valuePartial eta squaredNoncentrality
parameter
Observed power
Actual behavior (AB)21.682121.6825.917.020.0905.9170.668
Knowledge (K)0.00310.0030.013.910.0000.0130.051
Attitude (A)0.45210.4522.186.140.0352.1860.307
Intended behavior (IB)0.57210.5723.223.080.0513.2230.423
Perceived vulnerability (PV)0.85310.8531.340.250.0221.3400.207
Perceived severity (PS)6.75316.75317.020<.0010.22117.0200.982
Perceived self-efficacy (SE)1.36511.3653.116.080.0493.1160.412
Perceived response efficacy (RE)0.00110.0010.003.960.0000.0030.050
Perceived barrier (PB)0.00310.0030.005.940.0000.0050.051
Perceived cues to action (CA)2.95012.9506.574.010.0996.5740.713
Password0.32510.3251.110.300.0181.1100.179
Incident1.65211.6523.028.090.0483.0280.402
Email0.18310.1830.792.380.0130.7920.141
Mobile0.00010.0000.000.990.0000.0000.050

Post-hoc power analysis indicated that the survey-based MANOVA and ANOVA models achieved approximately 40% power to detect medium-sized effects, confirming that these analyses were underpowered. Consequently, survey-based multivariate and univariate results are interpreted as exploratory. In contrast, the behavioral click-rate analysis, based on the full sample, was sufficiently powered.


Principal Findings

Despite substantial investment in technical email filtering and security awareness training, health care staff continue to demonstrate high susceptibility to socially engineered emails under real operational conditions [11]. Evidence from field-based phishing simulations suggests that many existing interventions show limited or inconsistent effectiveness when evaluated using objective behavioral outcomes rather than self-reported intentions [52,53]. This limitation has prompted increasing interest in behavioral and psychologically grounded approaches that aim to influence decision-making at the moment of threat exposure, particularly those capable of producing measurable short-term changes in actual user behavior.

In light of this gap, the present study examined whether a brief CD-based priming intervention, delivered immediately prior to a real-world phishing simulation, was associated with differences in phishing-related outcomes among health care staff. The analytical framework comprised one confirmatory behavioral hypothesis and 2 exploratory research questions. The primary and confirmatory hypothesis (hypothesis 1) evaluated whether exposure to the CD prompt was associated with reduced observed phishing susceptibility, operationalized as objective link-click behavior during an in-the-wild phishing simulation. This behavioral outcome served as the study’s primary endpoint and was assessed using an omnibus analysis across all staff. Two exploratory research questions (RQ1 and RQ2) examined whether CD exposure was associated with directional differences in theory-driven security perception constructs derived from the HBM and PMT, as well as with self-reported security practices related to password management, incident reporting, email handling, and mobile-device security.

Given the limited sample size and variable construct reliability, the findings for RQ1 and RQ2 are interpreted as exploratory and hypothesis-generating rather than confirmatory. Accordingly, the discussion first addresses the confirmatory behavioral findings (hypothesis 1), followed by a cautious interpretation of exploratory construct-level and self-reported outcomes.

Primary Study Finding (Hypothesis 1): Confirmatory Behavioral Outcome

The primary outcome of this study was objective phishing click behavior observed during an in-the-wild simulation [29,59,60]. Although the CD-primed group exhibited a lower observed click-through rate than the control group (44% vs 65%), the prespecified omnibus chi-square test did not detect a statistically significant association between group membership and click behavior. The estimated effect size was small, and CIs were wide, reflecting limited precision due to the modest size of the randomized experimental groups.

Accordingly, the findings do not provide confirmatory statistical support for hypothesis 1. Rather, they indicate a directional, but statistically nonsignificant, association between brief CD-based priming and immediate phishing-click behavior under real-world conditions. This cautious interpretation is warranted because only a subset of participants was randomized to receive the CD prompt, while the neutral group comprised nonresponders and was not assigned to any experimental condition. As such, causal inference is limited to comparisons within the randomized subset, whereas comparisons involving the neutral group are observational and may reflect baseline or selection differences.

When situated within the broader cybersecurity and health informatics literature, the modest magnitude of the observed effect is consistent with prior studies examining behavioral phishing outcomes, which frequently report small and heterogeneous effects following brief or one-time interventions (eg, [61-63]). These findings contrast with studies reporting stronger effects from sustained educational or motivational interventions, which typically target knowledge, risk appraisal, or SE rather than rapid, heuristic-driven decision-making.

This distinction highlights the inherent difficulty of influencing immediate phishing behavior using brief psychological cues alone. From an applied perspective, the present results suggest that CD-based prompts may function as a situational nudge, introducing momentary cognitive friction prior to exposure, rather than as a standalone behavioral control. Their potential value, therefore, lies in complementing existing phishing simulations, awareness training, and technical safeguards within a layered defense strategy.

A notable pattern in the findings is the disconnect between observed phishing behavior and self-reported security perceptions. Although phishing susceptibility was measured using an objective behavioral outcome (link-clicking), effect estimates were imprecise because the randomized comparison groups were small. At the same time, several survey-based constructs showed low internal consistency, limiting confidence in construct-level interpretation. Together, these results are consistent with prior evidence that self-reported security perceptions and intentions do not reliably predict real-world phishing behavior, particularly in high-pressure health care settings.

Construct-Level Findings With Limited Power: Exploratory Evidence (RQ1-RQ2)

In contrast to the confirmatory behavioral outcome (hypothesis 1), analyses addressing the exploratory research questions (RQ1-RQ2) focused on self-reported psychological perceptions and security practices and are interpreted as hypothesis-generating rather than confirmatory. Although the multivariate analysis indicated an overall group effect (Pillai Trace=0.442; F14,47=2.66; P=.006), this result was derived from a substantially smaller survey subsample (control n=30; CD-primed n=32) and involved multiple dependent variables, thereby limiting statistical sensitivity for reliable construct-level inference.

Follow-up univariate analyses revealed nonsignificant or marginal effects for most perception and practice constructs, including PV, SE, RE, incident-reporting intentions, password management, email handling, mobile device security practices, and self-reported knowledge, attitudes, and intended behavior (P=.08-.30). Several constructs, most notably CA, PBs, and password practices, also exhibited low internal consistency, further constraining interpretability and precluding confirmatory conclusions.

While some variables displayed directional or near-significant trends, these patterns do not provide evidence of causal mechanisms nor establish that the CD prompt directly influenced underlying psychological processes [64,65]. Rather, the observed divergence between modest behavioral effects and weak or inconsistent construct-level changes is consistent with prior health care and organizational security research documenting limited correspondence between self-reported perceptions or intentions and objectively observed security behavior [10,18]. Accordingly, the construct-level findings are best viewed as exploratory signals that motivate future research by using larger and more balanced samples, improved psychometric validation, and analytical designs capable of formally testing mediation or mechanism-based pathways.

Contextual Factors, Baseline Susceptibility, Implications of the Study

Across all study groups, phishing susceptibility remained high, with observed click rates exceeding 50%. This pattern reinforces prior evidence that health care organizations are particularly vulnerable to social engineering attacks, even in settings with established technical defenses, policies, and awareness programs [6,66]. The phishing message deployed in this study leveraged a contemporaneous geopolitical crisis, a strategy commonly observed in real-world phishing campaigns to heighten emotional salience, urgency, and perceived legitimacy [55]. While this design choice enhances ecological validity, it also underscores the context-dependent nature of phishing susceptibility and limits direct generalization beyond comparable threat scenarios.

From an applied perspective, the findings suggest that brief, lightweight psychological prompts may complement existing security awareness and simulation programs by influencing immediate decision-making at the point of exposure. Importantly, the evidence supports this implication only for short-term, observed behavioral responses. The present study does not establish the durability of the observed effects, their transferability across organizational contexts or attack types, or the specific psychological mechanisms through which CD prompting may operate. These limitations highlight the need for longitudinal and replication studies before such interventions can be considered as standalone or broadly generalizable mitigation strategies.

Conclusion

This study examined whether a brief CD-based priming intervention, delivered immediately prior to a real-world phishing simulation, was associated with differences in phishing susceptibility among health care staff. The primary behavioral analysis indicated a directional but statistically nonsignificant association, with lower observed click rates in the CD-primed group; however, effect estimates were small and imprecise due to limited randomized group sizes. Accordingly, causal inference is restricted to the randomized comparison, while differences involving the neutral group are observational.

Survey-based analyses of security perceptions and self-reported practices were conducted on a smaller subsample, and several constructs exhibited low internal consistency. These findings are therefore considered exploratory and do not support conclusions about psychological mechanisms. Overall, the results suggest that CD-based prompts may function as a lightweight, short-term behavioral nudge under real-world conditions but do not establish a reliable effect.

Larger, fully randomized, and longitudinal studies with improved psychometric validation are needed before such interventions can be considered reliable complements to established cybersecurity controls.

Acknowledgments

No generative AI was used.

Funding

No funding source to declare.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Questionnaire.

DOCX File, 17 KB

Multimedia Appendix 2

Cognitive dissonance message.

DOCX File, 14 KB

Checklist 1

CONSORT (Consolidated Standards of Reporting Trials) checklist.

PDF File, 206 KB

Checklist 2

STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) checklist.

PDF File, 121 KB

  1. The state of healthcare cybersecurity 2025. Veriti. URL: https:/​/veriti.​ai/​wp-content/​uploads/​2024/​12/​The-State-of-Healthcare-Cybersecurity-2025-_-A-Veriti-Research-Report.​pdf [Accessed 2026-04-15]
  2. Cost of a data breach: the healthcare industry. IBM. URL: https://www.ibm.com/think/insights/cost-of-a-data-breach-healthcare-industry [Accessed 2025-12-10]
  3. Keller T, Warwas JI, Klein J, Henkenjohann R, Trenz M, Trang STN. Motivational framing strategies in health care information security training: randomized controlled trial. JMIR Med Educ. Nov 7, 2025;11(1):e73245. [CrossRef] [Medline]
  4. Yeng PK, Fauzi MA, Yang B, Nimbe P. Investigation into phishing risk behaviour among healthcare staff. Information. Aug 2022;13(8):392. [CrossRef]
  5. Abdelhamid M. The role of health concerns in phishing susceptibility: survey design study. J Med Internet Res. May 4, 2020;22(5):e18394. [CrossRef] [Medline]
  6. Jalali MS, Bruckes M, Westmattelmann D, Schewe G. Why employees (still) click on phishing links: investigation in hospitals. J Med Internet Res. Jan 23, 2020;22(1):e16775. [CrossRef] [Medline]
  7. Donalds C, Osei-Bryson KM. Cybersecurity compliance behavior: exploring the influences of individual decision style and other antecedents. Int J Inf Manage. Apr 2020;51:102056. [CrossRef]
  8. Ewoh P, Vartiainen T. Vulnerability to cyberattacks and sociotechnical solutions for health care systems: systematic review. J Med Internet Res. May 31, 2024;26(1):e46904. [CrossRef] [Medline]
  9. Ewoh P, Vartiainen T, Mantere T. Sociotechnical cybersecurity framework for securing health care from vulnerabilities and cyberattacks: scoping review. J Med Internet Res. Oct 15, 2025;27(1):e75584. [CrossRef] [Medline]
  10. Yeng PK, Szekeres A, Yang B, Snekkenes EA. Mapping the psychosocialcultural aspects of healthcare professionals’ information security practices: systematic mapping study. JMIR Hum Factors. Jun 9, 2021;8(2):e17604. [CrossRef] [Medline]
  11. Rizzoni F, Magalini S, Casaroli A, Mari P, Dixon M, Coventry L. Phishing simulation exercise in a large hospital: a case study. Digit Health. 2022;8:20552076221081716. [CrossRef] [Medline]
  12. Mou J, Cohen J, Bhattacherjee A, et al. A test of protection motivation theory in the information security literature: a meta-analytic structural equation modeling approach in search advertising. J Assoc Inf Syst. Jan 2022;23(1):196-236. [CrossRef]
  13. Herath T, Rao HR. Encouraging information security behaviors in organizations: role of penalties, pressures and perceived effectiveness. Decis Support Syst. May 2009;47(2):154-165. [CrossRef]
  14. Gordon WJ, Wright A, Glynn RJ, et al. Evaluation of a mandatory phishing training program for high-risk employees at a US healthcare system. J Am Med Inform Assoc. Jun 1, 2019;26(6):547-552. [CrossRef] [Medline]
  15. Chen Y, Ramamurthy K, Wen KW. Organizations’ information security policy compliance: stick or carrot approach? J Manag Inf Syst. Dec 2012;29(3):157-188. [CrossRef]
  16. Musuva PMW, Getao KW, Chepken CK. A new approach to modelling the effects of cognitive processing and threat detection on phishing susceptibility. Comput Human Behav. May 2019;94:154-175. [CrossRef]
  17. Pepitone A. A theory of cognitive dissonance by Leon Festinger. Am J Psychol. 1959;72(1):153-155. [CrossRef]
  18. Harmon-Jones E, Mills J. An introduction to cognitive dissonance theory and an overview of current perspectives on the theory. In: Cognitive Dissonance: Reexamining a Pivotal Theory in Psychology. 2nd ed. American Psychological Association; 2019:3-24. [CrossRef]
  19. Harmon-Jones EE. Cognitive Dissonance: Reexamining a Pivotal Theory in Psychology. 2nd ed. American Psychological Association; URL: https://psycnet.apa.org/books/TOC/16109 [Accessed 2025-12-23]
  20. Altamimi S. Investigating and mitigating the role of neutralisation techniques on information security policies violation in healthcare organisations. University of Glasgow; 2022. [CrossRef]
  21. Sykes GM, Matza D. Techniques of neutralization: a theory of delinquency. In: Delinquency and Drift Revisited. Vol 21. Routledge; 2017. [CrossRef]
  22. Siponen M, Vance A. Neutralization: new insights into the problem of employee information systems security policy violations1. MIS Q. Sep 1, 2010;34(3):487-502. [CrossRef]
  23. Taylor-Jackson J, McAlaney J, Foster JL, Bello A, Maurushat A, Dale J. Bernhard M, Bracciali A, Camp LJ, Matsuo S, Maurushat A, Rønne PB, et al, editors. Incorporating Psychology into Cyber Security Education: A Pedagogical Approach. Springer International Publishing; 2020:207-217. [CrossRef]
  24. Barlow JB, Warkentin M, Ormond D, et al. Don’t even think about it! The effects of antineutralization, informational, and normative communication on information security compliance. JAIS. 2018;19(8):689-715. [CrossRef]
  25. Cazares MF, Arévalo D, Andrade RO, Fuertes W, Sánchez-Rubio M. A training web platform to improve cognitive skills for phishing attacks detection. In: Nagar AK, Jat DS, Marín-Raventós G, Mishra DK, editors. Intelligent Sustainable Systems - Selected Papers of World S4 2021. 2022:33-42. [CrossRef] ISBN: 9789811663086
  26. Braun O, Hörnemann J, Pohlmann N, Urban T, Grosse-Kampmann M. Different seas, different phishes – large-scale analysis of phishing simulations across different industries. Association for Computing Machinery; 2025. Presented at: ASIA CCS ’25:1520-1534; Hanoi Vietnam. URL: https://dl.acm.org/doi/proceedings/10.1145/3708821 [CrossRef]
  27. Sieber JE. Deception in social research I: kinds of deception and the wrongs they may involve. IRB. Nov 1982;4(9):1-5. [CrossRef] [Medline]
  28. Open source phishing framework. Gophish. URL: https://getgophish.com/ [Accessed 2025-12-12]
  29. Marshall N, Sturman D, Auton JC. Exploring the evidence for email phishing training: a scoping review. Comput Secur. Apr 2024;139:103695. [CrossRef]
  30. Hernan MA. Causal Inference: What If. Taylor & Francis; 2024.
  31. Chapter 61 using randomization in development economics research: a toolkit. In: Handbook of Development Economics. Vol 4. Elsevier; 2007:3895-3962. [CrossRef]
  32. Sparks P, Guthrie CA, Shepherd R. The dimensional structure of the perceived behavioral control construct 1. J Applied Social Pyschol. Mar 1997;27(5):418-438. URL: https://onlinelibrary.wiley.com/toc/15591816/27/5 [CrossRef]
  33. Thomopoulos G, Lyras D, Fidas C. Methodologies and ethical considerations in phishing research: a comprehensive review. Association for Computing Machinery; 2023. Presented at: CHIGREECE 2023:1-10; Athens Greece. URL: https://dl.acm.org/doi/proceedings/10.1145/3609987 [CrossRef]
  34. Hopewell S, Chan AW, Collins GS, et al. CONSORT 2025 statement: updated guideline for reporting randomised trials. Lancet. Apr 14, 2025:S0140-S6736. [CrossRef] [Medline]
  35. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. The Lancet. Oct 2007;370(9596):1453-1457. [CrossRef]
  36. Plint AC, Moher D, Morrison A, et al. Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. Sep 4, 2006;185(5):263-267. [CrossRef] [Medline]
  37. Green-Ajufo B, Chakravarty D, Maiorana A, Lightfoot M, Hamiga J, Rebchook G. Acceptability and feasibility of using educational incentives for research participation to advance antiracism. Ethics Hum Res. 2025;47(4):18-28. [CrossRef] [Medline]
  38. Sobolewski J, Rothschild A, Freeman A. The impact of incentives on data collection for online surveys: social media recruitment study. JMIR Form Res. Jul 4, 2024;8(1):e50240. [CrossRef] [Medline]
  39. Cohen J. A power primer. Psychol Bull. Jul 1992;112(1):155-159. [CrossRef] [Medline]
  40. Vaske JJ, Beaman J, Sponarski CC. Rethinking internal consistency in Cronbach’s alpha. Leis Sci. Mar 4, 2017;39(2):163-173. [CrossRef]
  41. Seabold S, Perktold J. Statsmodels: econometric and statistical modeling with Python. 2010. Presented at: Python in Science Conference:92-96; Austin, Texas. [CrossRef]
  42. Parsons K, McCormac A, Butavicius M, Pattinson M, Jerram C. The development of the human aspects of information security questionnaire (HAIS-q). 2013. Presented at: ACIS. [CrossRef]
  43. Log in. Nettskjema. URL: https://nettskjema.no [Accessed 2025-12-12]
  44. Huang JL, Bowling NA, Liu M, Li Y. Detecting insufficient effort responding with an infrequency scale: evaluating validity and participant reactions. J Bus Psychol. Jun 2015;30(2):299-311. [CrossRef]
  45. Kung FYH, Kwok N, Brown DJ. Are attention check questions a threat to scale validity? Applied Psychology. Apr 2018;67(2):264-283. URL: https://iaap-journals.onlinelibrary.wiley.com/toc/14640597/67/2 [Accessed 2026-04-15] [CrossRef]
  46. Ho G, Mirian A, Luo E, et al. Understanding the efficacy of phishing training in practice. 2025. Presented at: 2025 IEEE Symposium on Security and Privacy (SP):37-54; San Francisco, CA. [CrossRef]
  47. Zhuo S, Biddle R, Russello G, Lottridge D. Precision email simulator for research on safety-critical phishing behaviour. Association for Computing Machinery; 2025. Presented at: CHI 2025:1-12; Yokohama Japan. URL: https://dl.acm.org/doi/proceedings/10.1145/3706598 [Accessed 2026-04-15] [CrossRef]
  48. Marczak B, Scott-Railton J, Aljizawi N, Anstis S, Deibert R. The great ipwn: journalists hacked with suspected NSO group imessage ‘zero-click’ exploit. Citizen Lab. University of Toronto; Dec 2020. URL: https:/​/citizenlab.​ca/​2020/​12/​the-great-ipwn-journalists-hacked-with-suspected-nso-group-imessage-zero-click-exploit/​ [Accessed 2025-12-12]
  49. Apple sues pegasus for spyware maker. how to check if your iphone has NSO group software. CNET. URL: https:/​/www.​cnet.com/​tech/​mobile/​apple-sues-pegasus-for-spyware-maker-how-to-check-if-your-iphone-has-nso-group-software/​ [Accessed 2025-12-12]
  50. What is zero-click malware, and how do zero-click attacks work? Kaspersky. URL: https://www.kaspersky.com/resource-center/definitions/what-is-zero-click-malware [Accessed 2025-12-12]
  51. Azrain A. Multivariate analysis of variance (MANOVA). Academia. URL: https://www.academia.edu/7751963/Multivariate_Analysis_of_Variance_MANOVA [Accessed 2025-12-12]
  52. Meyers LS, Gamst G, Guarino AJ. Applied Multivariate Research: Design and Interpretation. SAGE Publications; 2017. [CrossRef]
  53. Wilson Van Voorhis CR, Morgan BL. Understanding power and rules of thumb for determining sample Sizes. Tutor Quant Methods Psychol. 2007;3(2):43-50. [CrossRef]
  54. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. Jun 27, 2011;2:53-55. [CrossRef] [Medline]
  55. Jain AK, Gupta BB. A survey of phishing attack techniques, defence mechanisms and open research challenges. Enterprise Information Systems. Apr 3, 2022;16(4):527-565. URL: https://tinyurl.com/25vumkbv [Accessed 2026-04-15] [CrossRef]
  56. Statistical methods for psychology. eBook. URL: https://tinyurl.com/ypduhk6j [Accessed 2025-12-12]
  57. Pillai KCS. Some new test criteria in multivariate analysis. Ann Math Statist. Mar 1955;26(1):117-121. [CrossRef]
  58. Handbook of applied multivariate statistics and mathematical modeling. In: Handbook of Applied Multivariate Statistics and Mathematical Modeling. Academic Press; 2000:3-36. [CrossRef]
  59. Tolsdorf J, Langer D, Lo Iacono L. Phishing susceptibility and the (in-)effectiveness of common anti-phishing interventions in a large university hospital. Association for Computing Machinery; 2025. Presented at: CCS ’25:4334-4348; Taipei Taiwan. URL: https://dl.acm.org/doi/proceedings/10.1145/3719027 [CrossRef]
  60. Althobaiti K, Alsufyani N. A review of organization-oriented phishing research. PeerJ Comput Sci. 2024;10:e2487. [CrossRef] [Medline]
  61. Canfield CI, Fischhoff B, Davis A. Quantifying phishing susceptibility for detection and behavior decisions. Hum Factors. Dec 2016;58(8):1158-1172. [CrossRef] [Medline]
  62. Jansson K, von Solms R. Phishing for phishing awareness. Behav Inf Technol. Jun 2013;32(6):584-593. [CrossRef]
  63. Phish like a boss. In: Phishing Dark Waters. John Wiley and Sons; 2015:179-188. [CrossRef]
  64. Grosz MP, Rohrer JM, Thoemmes F. The taboo against explicit causal inference in nonexperimental psychology. Perspect Psychol Sci. Sep 2020;15(5):1243-1255. [CrossRef] [Medline]
  65. Amrhein V, Greenland S, McShane B. Scientists rise up against statistical significance. Nature New Biol. Mar 2019;567(7748):305-307. [CrossRef] [Medline]
  66. Priestman W, Anstis T, Sebire IG, Sridharan S, Sebire NJ. Phishing in healthcare organisations: threats, mitigation and approaches. BMJ Health Care Inform. Sep 2019;26(1):1. [CrossRef] [Medline]


AB: actual behavior
CA: cues to action
CD: cognitive dissonance
CONSORT: Consolidated Standards of Reporting Trials
HBM: Health Belief Model
KAB: knowledge, attitude, and behavior
MANOVA : multivariate analysis of variance
NSD: Norwegian Center for Research Data
PB: perceived barrier
PMT: Protection Motivation Theory
PS: perceived severity
PV: perceived vulnerability
RE: response efficacy
REK: Regional Committees for Medical and Health Research Ethics of Norway
RQ: research question
SE: self-efficacy
STROBE: Strengthening the Reporting of Observational Studies in Epidemiology


Edited by Javad Sarvestan, Taiane de Azevedo Cardoso; submitted 27.Oct.2024; peer-reviewed by Josiah Dykstra, L S Moussaoui; final revised version received 15.Jan.2026; accepted 16.Jan.2026; published 01.Jun.2026.

Copyright

© Prosper Kandabongee Yeng, Muhammad Ali Fauzi, Arnstein Vestad, Bian Yang, Katrien De Moor, Christian Jacobsen, John-Bosco Diekuu, Meriem Bettayeb. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 1.Jun.2026.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.