https://orcid.org/0000-0001-5463-1711
Figures
Abstract
Background
Emergency responders are routinely exposed to traumatic critical incidents and other occupational stressors that place them at higher risk of mental ill health compared to the general population. There is some evidence to suggest that resilience training may improve emergency responders’ wellbeing and related health outcomes. The aim of this study was to evaluate the effectiveness of a tertiary service resilience intervention compared to psychoeducation for improving psychological outcomes among emergency workers.
Methods
We conducted a multicentre, parallel-group, randomised controlled trial. Minim software was used to randomly allocate police, ambulance, fire, and search and rescue services personnel, who were not suffering from depression or post-traumatic stress disorder, to Mind’s group intervention or to online psychoeducation on a 3:1 basis. The resilience intervention was group-based and included stress management and mindfulness tools for reducing stress. It was delivered by trained staff at nine centres across England in six sessions, one per week for six weeks. The comparison intervention was psychoeducation about stress and mental health delivered online, one module per week for six weeks. Primary outcomes were assessed by self-report and included wellbeing, resilience, self-efficacy, problem-solving, social capital, confidence in managing mental health, and number of days off work due to illness. Follow-up was conducted at three months. Blinding of participants, researchers and outcome assessment was not possible due to the type of interventions.
Results
A total of 430 participants (resilience intervention N = 317; psychoeducation N = 113) were randomised and included in intent-to-treat analyses. Linear Mixed-Effects Models did not show a significant difference between the interventions, at either the post-intervention or follow-up time points, on any outcome measure.
Citation: Wild J, El-Salahi S, Degli Esposti M, Thew GR (2020) Evaluating the effectiveness of a group-based resilience intervention versus psychoeducation for emergency responders in England: A randomised controlled trial. PLoS ONE 15(11): e0241704. https://doi.org/10.1371/journal.pone.0241704
Editor: Yutaka J. Matsuoka, National Cancer Center Japan, JAPAN
Received: February 28, 2020; Accepted: October 20, 2020; Published: November 12, 2020
Copyright: © 2020 Wild et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data are held in a public repository. The reference is: Wild, Jennifer (2020), “RCT Resilience Intervention vs Psychoeducation Emergency Workers”, Mendeley Data, V1, doi: 10.17632/y7283fkdtb.1.
Funding: Mind www.mind.org.uk, CQR00510, awarded to Dr Jennifer Wild. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Emergency responders are routinely exposed to highly stressful, often traumatic, critical incidents as well as organisational stressors, such as increased workload, staff reductions and reduced access to informal support, that place them at higher risk of mental ill health compared to the general population [1–3]. Whilst they dedicate their lives to improving health and public safety, they are more likely than the general population to suffer from trauma-related psychological disorders, such as posttraumatic stress disorder (PTSD) [4]. A survey conducted by the UK’s national mental health charity, Mind, found that 87% of UK-based emergency services staff and volunteers reported high levels of ongoing stress, low mood and poor mental health [5]. Interventions that could improve psychological resilience may improve emergency responder wellbeing and related health outcomes.
The last few decades have seen a surge in the development of interventions aimed to improve resilience in emergency worker populations, with resilience generally being defined as the capacity to maintain wellbeing in response to adversity or stress [6]. Despite widespread use, however, there is conflicting evidence for their efficacy with some resilience interventions demonstrating improvements in wellbeing, sleep or stress symptoms [7–11] whilst others show no significant effects on mental or physical health outcomes [12–17]. Evaluations have typically been hampered by heterogeneity in intervention design, content and outcome measurement, and low methodological quality among studies [18–21]. The majority of trials have evaluated interventions aimed at improving resilience against wait-list rather than an active comparator, making it impossible to determine if improvements in resilience or wellbeing are related to active components of the intervention or to non-specific factors, such as contact with a group. It is unclear whether or not a resilience intervention tailored for emergency workers would fare better than an active alternative and would lead to improvements in emergency responder wellbeing, resilience and related health outcomes.
In 2015, Mind introduced their Blue Light programme, the overall aim of which was to improve the mental health of emergency workers in England. Supported by LIBOR funding from the Cabinet Office, the programme included a number of initiatives, one of which focused on resilience. As part of their pilot phase in the development of this initiative, Mind tailored a group-based resilience intervention for delivery to police, ambulance, fire, and search and rescue workers, which had previously been used in military services and administered to high risk populations, such as new mothers and men at risk of social isolation [22]. The intervention was based on their model of resilience, which posits that improving wellbeing, social capital and use of psychological coping strategies will improve an individual’s resilience. The model incorporates the five ways to wellbeing, a set of evidence-based public health messages, identified by the New Economics Foundation, for improving the mental health and wellbeing of the population [23].
This study is a randomised controlled trial evaluating the effectiveness of Mind’s pilot phase resilience intervention for emergency workers compared to accessing psychoeducation about mental health. Overall, randomised controlled trials have found no effect of psychoeducation for reducing psychological symptoms [24] or distress in military personnel [25]. We therefore hypothesised that the resilience intervention would be more effective than psychoeducation in improving resilience, wellbeing, self-efficacy, and social capital, as well as in improving emergency workers’ confidence to manage their mental health and reduce days off work due to illness. We hypothesised that neuroticism would predict the degree of change participants would experience in wellbeing, resilience, self-efficacy and social capital.
Methods
Design
This study is a two-arm, parallel-group randomised controlled trial conducted in England. Participants were randomly allocated on a 3:1 basis to Mind’s group-based resilience intervention or to reading mental health information online. There were no changes to the trial design throughout the study. This paper was written in accordance with CONSORT guidelines [26]. Ethical approval was granted by the Medical Sciences Division Research Ethics Committee at the University of Oxford (1/4/15; ref MS-IDREC-C1-2015-059). The protocol was approved by the funder and the ethics committee prior to recruitment and no changes were made to the protocol at any point during the trial. The trial was registered retrospectively during participant follow-up. The reason for the delay in registering the trial was one of time constraints associated with the priority completion of a number of procedures at the outset to ensure the trial of N = 430 emergency responders, including their follow-up, could be completed within 12 months. The authors confirm that all ongoing and related trials for this intervention are registered, and have all been registered prospectively.
Participants and recruitment
Recruitment was conducted from May to November 2015 in collaboration with local Mind centres and local emergency services at nine selected sites across England: Andover, Brighton and Hove, Coastal West Sussex, Dudley, Southampton, Birmingham, Oxfordshire, Cambridgeshire, and Peterborough and Fenland. Recruitment methods involved giving talks at emergency service sites, circulating emails, posters, and leaflets, and using social media. Emergency workers were directed to Mind’s website where they could sign up for the trial via a link to the registration survey on Qualtrics, a secure online software platform. Participants could read and print a PDF copy of the Participant Information Sheet and pause the registration process to discuss questions with the research assistant over the telephone. If they decided to take part, they were emailed an individualised link where they could log-in, re-read the Participant Information Sheet, and complete a consent form and two short screening questionnaires. Participants were screened for depression and suicidal ideation using the Patient Health Questionnaire 9 (PHQ-9) [27], and for post-traumatic stress using the Post-Traumatic Stress Disorder Checklist for DSM-5 (PCL-5) [28]. They were considered eligible if they scored below 10 on the PHQ-9, below 33 on the PCL-5, and 0 on question nine of the PHQ-9, which assesses suicidal ideation. If participants scored above these cut-off points, they had a telephone call with the researchers to discuss whether their symptoms interfered with their lives and whether they wished treatment. They were re-included in the study if their symptoms had little impact on their lives and they did not want treatment, otherwise they were excluded and signposted for evidence-based psychological treatment within local Improving Access to Psychological Therapies services. To reduce the risk of participants dropping out, eligible participants were asked to confirm they could commit to a six-week programme before they were randomised.
Interventions
Resilience intervention.
The resilience intervention was a six-week, group-based course developed for Mind by Shaun Goodwin, a psychotherapist with expertise in transpersonal counselling, and previously delivered in their work with new mothers and men at risk of social isolation [22]. The intervention included information about mental health and experiential exercises drawn from stress management and mindfulness, with the overarching aim to improve wellbeing and use of adaptive coping strategies, such as social support. Table 1 shows an overview of the weekly content. Homework exercises were set between each session to reinforce learning. Each group session lasted 2.5 hours. Mind facilitators attended a one-day workshop on how to deliver the intervention and then weekly supervision whilst it was ongoing.
Psychoeducation.
The comparison intervention included psychoeducation about six topics: sleep, stress, depression, anger, mindfulness, and post-traumatic stress disorder. These were selected from a range freely available online from Mind’s website https://www.mind.org.uk/information-support/types-of-mental-health-problems/, which the researchers then tailored for emergency workers. Each topic was delivered as an online module, one released each week for six weeks during the same six-week period that the resilience intervention took place. Participants completed the modules remotely at a time during the week that suited them. They could contact the research assistant by email if they had any questions about any part of the modules.
Primary outcome measures
We adopted a liberal approach to primary outcome, registering seven primary outcome measures. This was for the purpose of ensuring there would be no missed effects linked to the intervention. All primary and secondary outcome measures were administered three times during the study: at baseline, post-intervention, and at three-month follow-up. All outcome measures were self-reported assessments. There were no changes to outcome measures after the trial commenced. The Warwick Edinburgh Mental Wellbeing scale [29] assessed wellbeing. Internal reliability for the scale in the sample was excellent; Cronbach’s alpha = 0.94. The Connor-Davidson Resilience Scale [5] measured resilience. Internal reliability was excellent; Cronbach’s alpha = 0.93. The General Self-Efficacy Scale [30] is a 10-item scale that assessed optimistic self-beliefs for coping with a variety of difficult demands in life. Internal reliability was good; Cronbach’s alpha = 0.89. Two questionnaires were administered to assess social capital: the Social Participation scale [31] and the Social Support scale adapted from Sarason et al’s scale [32], which has two subscales, Social Support (Home) and Social Support (Work). Internal reliability for the Social Participation scale was excellent: Cronbach’s alpha = 0.92. The Social Support scales showed good internal reliability: Social Support (Home) Cronbach’s alpha = 0.77, and Social Support (Work) Cronbach’s alpha = 0.83. A one-item measure assessed the degree to which participants felt confident to manage their mental health on a scale from 1 = Totally disagree to 7 = Totally Agree. Higher scores reflect greater confidence in managing mental health. We also administered a two-item questionnaire to assess how many days off work due to illness an individual had taken in the past three months (when administered at baseline and follow-up) and past six weeks when administered at post-intervention.
Secondary outcome measures
The Depressive Attributions Questionnaire [33] assesses attributions of negative events. Internal reliability was excellent; Cronbach’s alpha = 0.93. We administered three subscales of the Brief Coping Behaviour Questionnaire [34] to assess adaptive coping (active coping, use of emotional support, and acceptance) and five subscales to assess dysfunctional coping (self-distraction, denial, substance use, self-blame, behavioural disengagement). To the dysfunctional coping subscale, we added wishful thinking, which had previously been shown to correlate with severe stress in paramedics [35]. Internal reliability for the adaptive coping scale was good (Cronbach’s alpha = 0.81) and excellent for the dysfunctional scale (Cronbach’s alpha = 0.93). The Responses to Intrusions Questionnaire [36] assessed suppression, rumination and intentional numbing in response to stressful events. Internal reliability for each scale was good; suppression, Cronbach’s alpha = 0.84; rumination, Cronbach’s alpha = 0.90; and intentional numbing, Cronbach’s alpha = 0.74. The Ruminative Responses Scale [36] measured the frequency of engaging in dwelling. Internal reliability was excellent; Cronbach’s alpha = 0.95. An unpublished trauma screener, adapted from the Clinician Administered PTSD Scale for DSM-5 (CAPS-5) to include events relevant to emergency personnel, was used to record exposure to traumatic events [37]. The PCL-5 was administered to assess symptoms of PTSD [28]. The PHQ-9 [27] assessed severity of depression symptoms. Internal reliability of the scale was good, Cronbach’s alpha = 0.86. The General Anxiety Disorder 7 (GAD-7) [38] assessed anxiety. Internal reliability was good, Cronbach’s alpha = 0.88. The Alcohol Use Disorders Identification Test [39] measured a person’s weekly intake of alcohol and substances and whether it has caused problems for them. Internal reliability was good, Cronbach’s alpha = 0.74. We administered an unpublished questionnaire to assess problem solving, which had been used in previous evaluations of Mind’s resilience intervention [22]. The questionnaire consisted of eight items to assess a person’s perception of how well they can solve problems and achieve goals. Internal reliability in the sample was excellent; Cronbach’s alpha = 0.90. The neuroticism subscale of the Short-Form Revised Eysenck Personality Questionnaire [40] assessed emotionality. Internal reliability of this scale was good, Cronbach’s alpha = 0.84.
Perceived helpfulness and adherence assessment
To measure perceived helpfulness of the interventions, participants completed a helpfulness rating, indicating on a scale of 0 to 100% how helpful they found their interventions to be. To assess facilitator adherence to the resilience protocol, we created a short questionnaire that related to the core elements for each of the six sessions. Each group session was recorded using SanDisk MP3 players and the researchers rated 10% of the sessions for adherence to protocol.
Sample size
Guidelines set by the Cabinet Office for this study suggested a target sample size of 430. We conducted a power analysis to confirm the sample would be large enough to detect an effect should one exist. We referred to a study by Kuehl et al. [8] who compared a group-based 12-week stress management intervention for police officers against standard practice. The intervention led to between-group improvements in wellbeing with small effect (d = 0.34). A sample size calculation was performed for a superiority trial with continuous outcome. Using an alpha of 0.05, 90% power, a standard deviation for the CD-RISC of 14, and a group difference of 5 points (which equates to d = 0.34 from the previous study), would require a total of 330 participants. Allowing for 20% attrition, a total sample size of N = 398 would be required, suggesting that the target sample size was large enough to detect an effect.
Randomisation
Participants self-enrolled online, were screened and gave consent. They completed their baseline measures before they were randomised on a 3:1 basis to the resilience intervention or to online psychoeducation. The researchers used Minim software to randomly allocate participants by method of minimisation, stratifying the allocation by site and gender. The research assistant entered eligible participants into Minim and then emailed the allocation result to each participant. This randomisation method allowed allocation concealment to be maintained and reduced the risk of selection bias. Blinding was not possible due to the type of interventions.
Procedure
The period from the online screening to the onset of the interventions ranged from a few days to 8 weeks, with the majority of participants beginning their intervention within two weeks. Participants (N = 33) who waited more than four weeks to start their interventions re-completed baseline questionnaires. Participants were contacted by email at post-intervention (6 weeks) and 3 months later with a link to complete follow-up questionnaires. The resilience and psychoeducation interventions were delivered 31 times in four phases from May to December 2015. The mean number of participants per group in the resilience intervention was N = 9. The supporting CONSORT checklist for this trial is available as supporting information. See S1 and S2 Files.
Statistical methods
Data on the number of sessions/modules completed and perceived helpfulness were analysed descriptively and using one-way ANOVA. Facilitators’ adherence to the resilience intervention was assessed through independent ratings of session audio recordings.
Linear Mixed-Effects Models were used for the analysis of the primary and secondary outcome variables. Such models have the advantage of using the available data from all participants who were randomized, as well case as accounting for nested data structures and data missing at random. Time (post-intervention, and three-month follow-up), treatment condition (resilience intervention or online psychoeducation [active control]), and the time-by-condition interaction were entered as categorical fixed factors along with the stratification variables of gender and site. Baseline score was included as a covariate, and a random effect of participant was specified to account for between-person variation. Scores on the primary or secondary outcome measure being evaluated were used as the dependent variable. When analysing secondary outcome measures, the baseline scores of the primary outcome measures were included as additional covariates. All models were estimated using restricted maximum likelihood estimation. Q-Q plots indicated that the normality of residuals assumption was met for all models.
Between-group effect sizes (dCohen) were calculated by dividing the adjusted group difference by the baseline standard deviation of the full study sample. Within-group effect sizes were calculated from separate models that incorporated the baseline score as a timepoint rather than as a covariate, to permit calculation of within-group changes from baseline. These models used an unstructured covariance matrix. 95% confidence intervals for dCohen were calculated by dividing the upper and lower limits of the adjusted group difference by the baseline standard deviation of the full study sample.
A series of linear regressions was performed to examine if baseline neuroticism scores predicted the extent of Baseline-Post change in Wellbeing, Resilience, Self-efficacy, and Social Capital within the treatment group. Residualised gain scores (which represent participants’ observed change in relation to that predicted from the overall Baseline-Post relationship) were used as the dependent variable in each analysis, and Gender, Site, and Baseline score were included as covariates.
All analyses used the intention to treat sample and a significance level of 0.05. Analyses were conducted in R version 3.5.1 (R Core Team, 2017) [41]. The packages ‘tidyverse’ (Wickham, 2017) [42], ‘nlme’ (Pinheiro, Bates, DebRoy, Sarkar, & R Core Team, 2018) [43], ‘jmv’ [44] and ‘psych’ [45] were used. The Confidence in Managing Mental Health variable was log transformed prior to analysis given non-normality of the raw data. The total score for days off work due to illness was non-normal and could not be corrected with transformations. We analysed this variable at post-intervention and follow-up with Mann-Whitney U Tests.
Results
Four hundred and thirty participants (N = 317 resilience intervention, N = 113 online psychoeducation) took part in the trial from May 2015 to March 2016. Fig 1 shows an overview of the number of participants from enrolment to analysis. Follow-up began in July 2015 and continued until March 2016. The trial ended with the end of Mind’s pilot year of the Blue Light programme. The majority of participants were female (58.1%), White British (89.7%), police officers (52.3%), and were on average 41 years old (SD = 9.78). Table 2 describes the study sample by intervention arm. Table 3 shows the means and standard deviations of primary outcome measures at baseline, post-intervention and three-month follow-up.
Sessions/modules completed, perceived helpfulness and adherence assessments
Participants receiving the resilience intervention completed a mean number of 4.11 group sessions (SD = 2.02) whilst those receiving the psychoeducation intervention completed a mean number of 4.71 (SD = 2.01) modules. Participants receiving psychoeducation completed more modules than sessions attended by participants in the resilience intervention (F(1,429) = 7.21, p = 0.008). Participants rated the resilience intervention (84%, SD = 19.49) as significantly more helpful than the psychoeducation intervention (77%, SD = 22.79), (F(1,278) = 9.4, p = 0.002). Thirty audio-recordings from the group sessions (15%) were randomly selected to measure the facilitators’ adherence to protocol whilst delivering the resilience intervention. Two research assistants independently rated the recordings for inter-rater reliability, which yielded a correlation coefficient of r = 0.985, suggesting excellent inter-rater reliability. Adherence to protocol ratings ranged from 60% to 100%, with a mean rating of 85.65% (SD = 13.07), suggesting that the facilitators demonstrated good adherence to protocol.
The results of the Linear Mixed-Effects Models are given in Table 4. There were no significant differences between the intervention groups on any of the primary outcome measures at either the post-intervention or three-month follow-up timepoints. The between- and within-group effect sizes suggested there was little to no change on these measures resulting from either intervention. The groups did not differ in the number of days off work due to illness they had taken at post (Mann-Whitney U = 11,684.00, p = 0.892) or at follow-up (Mann-Whitney U = 13,715.00, p = 0.754).
Analysis of the secondary outcome measures showed the same pattern of results, indicating that the resilience intervention was not superior to psychoeducation and did not lead to significant improvements in depressive attributions, coping strategies, responses to intrusions, rumination, or symptoms of PTSD, depression, anxiety, or problematic alcohol use.
Looking at within-subjects effects, participants receiving psychoeducation demonstrated small improvements in wellbeing, social participation, confidence to manage mental health, depressive attributions, dysfunctional coping, rumination and suppression in response to stressful memories at follow-up compared to when they came into the trial. Participants who received the resilience intervention demonstrated small improvements in suppression in response to intrusive memories at post-intervention and at follow-up compared to their baseline assessment. Model results and descriptive statistics for the secondary outcomes are provided in the supplementary material.
To examine the hypothesis that baseline levels of neuroticism may predict the extent of individual pre-post change in the resilience intervention, a series of linear regressions was conducted using residualised gain scores of the primary outcome measures as the dependent variables. The results (see Table 6 in S3 File) showed that none of the overall models were significant, with low R2 values, indicating there was no evidence within this sample that neuroticism predicted the extent of change in wellbeing, resilience, self-efficacy, or social capital associated with the intervention.
Discussion
This randomised controlled trial evaluated the effectiveness of a tertiary service resilience intervention for improving psychological outcomes among emergency workers compared to a psychoeducation-only intervention. There were no significant differences between the interventions on any of the primary or secondary outcome measures at the post-intervention or follow-up timepoints although participants receiving the resilience intervention rated it as more helpful than those receiving psychoeducation.
The results of this trial are consistent with findings that resilience interventions may have limited effects on mental health outcomes in emergency workers [12–17] and the growing concern in the field that although some interventions may improve wellbeing [7–11], it remains to be seen whether or not this translates to better mental health outcomes. Interestingly, modest improvements were observed for participants receiving psychoeducation on some outcomes at follow-up compared to their baseline assessments. However, these are likely to be due to non-specific factors, such as contact with a research assistant, since the differences were not found between the groups on the same outcomes. This would be in keeping with the wider literature, which suggests psychoeducation is generally ineffective in terms of building resilience to stress. For example, a cluster randomised controlled trial attempted to directly measure the impact of psychoeducation among new firefighter recruits and evidenced no long-term benefits of psychoeducation in terms of help seeking or symptom levels [46]. Similarly, Sharpley et al. [25] compared Naval and Marine personnel who had and had not received psychoeducation about stress and stress reactions in a briefing session prior to being deployed to the 2003 Iraq war. There was no evidence that pre-deployment psychoeducation reduced subsequent psychological distress after deployment. What is emerging is evidence that it is the type of education that matters: training about the job rather than training in stress management [i.e., 46–51].
The resilience intervention evaluated in this trial included tools to promote mindfulness and manage stress with the aim of fostering wellbeing, psychological coping, and social capital in an attempt to improve overall resilience. Perhaps a more theory-driven approach to resilience-building is needed, such as identifying and then targeting predictors of resilience and also mental ill health. A recent systematic review of interventions aimed to improve wellbeing and resilience to stress among emergency responders found that those most likely to demonstrate intervention-specific improvements targeted modifiable risk factors of trauma-related psychological disorders, such as PTSD and depression [18]. This approach is echoed in medicine where interventions for building resilience to ill health target modifiable risk factors, such as targeting hypertension to reduce the risk of cardiovascular disease and mortality [52]. Targeting modifiable risk factors for psychological disorders has also been shown to be effective in preventing the development of depression [53]. A similar approach may be effective for populations, such as emergency responders, at risk of developing severe stress reactions like PTSD. To date, there is little prospective research identifying these risk factors, although a study conducted by Wild et al. [4] identified two predictors of poor mental health that could serve as targets for future interventions.
On the whole, the majority of evaluations of resilience interventions are hampered by trials of low methodological quality and comparison to wait-list rather than active comparison conditions, making it difficult to conclude whether or not any improvements are intervention-specific. The current trial overcame these shortfalls by implementing a robust design with a large sample of emergency workers. However, despite the rigorous approach employed in this trial, there are limitations worth considering. First, all outcome measures were self-report, which are subjective and open to bias. Second, there was no wait-list condition. In addition to an active comparison condition, a wait-list condition allows conclusions to be drawn about intervention-specific effects rather than natural fluctuations in outcomes over time. Third, the interventions differed in their mode of delivery, which may have advantaged one over the other. However, since no effects were found, this is unlikely. Fourth, the follow-up period was fairly short. Fifth, consistent with the model of resilience used to design the intervention, resilience was assessed as a combination of thoughts and behaviours reflective of resilient functioning. Perhaps an operationalised definition of resilience is needed that allows an assessment of better than expected outcomes following stress exposure. Future research could overcome these limitations by including objective assessment measures, such as clinical interviews, including a wait-list arm, and a longer follow-up period that measures exposure to stressful events and subsequent trajectories of outcome.
Notwithstanding the limitations mentioned above, this trial is an important step forward in the development of resilience interventions for emergency workers. It is the first randomised controlled trial to rigorously evaluate a resilience-building programme delivered to a combined sample of emergency responders (i.e., police, paramedics, firefighters and search and rescue personnel) rather than responders from a single service (i.e., police-only). The results are thought to have good generalisability since the intervention was implemented to male and female emergency workers from varied emergency services covering city and rural locations. Our trial demonstrated that a resilience intervention is acceptable to emergency workers and despite their demanding schedules, many were able to commit to a six-week group course. Future resilience interventions may benefit from being tailored to target predictors of resilience and mental ill health in this population.
Conclusion
We evaluated a tertiary service resilience intervention for emergency workers in a large-scale randomised controlled trial. Although the intervention was acceptable to emergency workers, the results demonstrated that it could not be linked to any intervention-specific improvements in health and wellbeing outcomes. Equally, the comparison condition, psychoeducation, could not be linked to intervention-specific improvements, although participants did fare better on some outcomes at the end of the follow-up period compared to their baseline assessments. Overall, the resilience intervention performed similarly to psychoeducation, suggesting that it fails to be cost-effective in its current form. The limited success of this intervention is consistent with the wider literature. A more promising approach to developing interventions to improve resilience to stress may be to identify then target modifiable risk factors of stress-related psychopathology.
Acknowledgments
We would like to express our enormous gratitude to the 430 emergency service personnel who took part in this evaluation and the local Mind facilitators who expertly delivered the intervention. We would also like to express our gratitude to the staff at local Minds and at National Mind and the University of Oxford who made this 11-month evaluation possible. In particular, we would like to thank Professor Anke Ehlers, Libby Rackham, Juliane Sachshal, John Fresen, Alice Wallace, Joanna Moss, Shaun Goodwin, Ruth McConkey, Robyn Guillaume-Smith, Krithika Subramanian, Stuart Reid, Gavin Atkins, Faye McGuinness, and Jacob Diggle. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.
References
- 1. Bennett P, Williams Y, Page N, Hood K, Woollard M. Levels of mental health problems among UK emergency ambulance workers. Emerg Med J. 2004;21: 235–236. pmid:14988360
- 2. Carleton RN, Afifi TO, Turner S, Taillieu T, Duranceau S, et al. Mental disorder symptoms among public safety personnel in Canada. Can J Psychiatry. 2017;63(1): 54–64. pmid:28845686
- 3. Jonsson A, Segesten K, Mattsson B. Post-traumatic stress among Swedish ambulance personnel. Emerg Med J. 2003;20(1): 79–84. pmid:12533382
- 4. Wild J, Smith KV, Thompson E, Béar F, Lommen MJJ, Ehlers A. A prospective study of pre-trauma risk factors for post-traumatic stress disorder and depression. Psychological Medicine. 2016;46: 2571–2582. pmid:27348599
- 5.
Mind. Blue Light Scoping Survey. January 2015. https://www.mind.org.uk/media/4627950/scoping-survey.pdf.
- 6. Connor KM, Davidson JRT. Development of a new resilience scale: The Connor-Davidson Resilience Scale (CD-RISC). Depress Anxiety. 2003;18: 76–82. pmid:12964174
- 7. Wilson SA, Tinker RH, Becker LA, Logan CR. Stress management with law enforcement personnel: A controlled outcome study of EMDR versus a traditional stress management program. Int J Stress Manag. 2001;8(3): 179–200.
- 8. Kuehl KS, Elliot DL, Goldberg L, Mackinnon DP, Vila BJ, Smith J, et al. The safety and health improvement: enhancing law enforcement departments study: Feasibility and findings. Frontiers in Public Health. 2014. 2(38), 1–7. pmid:24847475
- 9. Norris R, Carroll D, Cochrane R. The effects of aerobic and anaerobic training on fitness, blood pressure and psychological stress and well-being. Journal of Psychosomatic Research. 1990;34(4), 367–375. pmid:2376838
- 10. Arnetz BB, Arble E, Backman L Lynch A, Lublin A. Assessment of a prevention program for work-related stress among urban police officers. Int Arch Occup Environ Health. 2013;86(1): 79–88. pmid:22366986
- 11. Christopher MS, Hunsinger M, Goerling LRJ, Bowen S, Rogers BS, Gross CR, et al. Mindfulness-based resilience training to reduce health risk, stress reactivity, and aggression among law enforcement officers: A feasibility and preliminary efficacy trial. Psychiatry Res. 2018;264: 104–115. pmid:29627695
- 12. Skeffington PM, Rees CS, Mazzucchelli TG, Kane RT. The primary prevention of PTSD in firefighters: Preliminary results of an RCT with 12-month follow-up. PLoS One. 2016; 11(7): e0155873. pmid:27382968
- 13. Ângelo RP, Chambel MJ. An intervention with firefighters to promote psychological occupational health according to the Job Demands-Resources Model. Revista de Psicología Social. 2013; 28(2), 197–210.
- 14. Ireland M, Malouff JM, Byrne B. The efficacy of written emotional expression in the reduction of psychological distress in police officers. International Journal of Police Science & Management. 2007; 9(4), 303–311.
- 15. Ramey SL, Perkhounkova Y, Hein M, Bohr NL, Anderson AA. Testing a resilience training program in police recruits: A pilot study. Biol Res Nurs. 2017;19(4): 440–449. pmid:28359165
- 16. Tanigoshi H, Kontos AP, Remley TPH. The effectiveness of individual wellness counseling on the wellness of law enforcement officers. Journal of Counselling and Development. 2008; 86(1), 64–74.
- 17. Tuckey MR, Scott JE. Group critical incident stress debriefing with emergency services personnel: A randomized controlled trial. Anxiety Stress Coping. 2014;27(1): 38–54. pmid:23799773
- 18. Wild J., El-Salahi S., & Degli Esposti M. The effectiveness of interventions aimed at improving wellbeing and resilience to stress in first responders: A systematic review. In special issue: Early prediction and intervention in the context of trauma. Euro Psychol 2020.
- 19. Leppin AL, Bora PR, Tilburt JC, Gionfriddo MR, Zeballos-Palacios C, Dulohery MM, et al. The efficacy of resiliency training programs: A systematic review and meta-analysis of randomized trials. PLOS ONE. 2014; 9(10), e111420. pmid:25347713
- 20. Macedo T, Wilheim L, Gonçalves R, Coutinho ESF, Vilete L, Figueira I, et al. Building resilience for future adversity: a systematic review of interventions in non-clinical samples of adults. BMC Psychiatry. 2014;14: 227. pmid:25266031
- 21. Vanhove AJ, Herian MN, Perez ALU, Harms PD, Lester PB. Can resilience be developed at work? A meta-analytic review of resilience-building programme effectiveness. J Occup Organ Psychol. 2016;89: 278–307.
- 22.
Robinson, M., Steen, M., Robertson, S., & Raine, G. (2014). Evaluation of the local Mind resilience programme. Final report, July.
- 23.
Thompson S., & Aked J. Five ways to well-being: New applications, new ways of thinking. https://neweconomics.org/2011/07/five-ways-well-new-applications-new-ways-thinking
- 24. Wessely S, Bryant RA, Greenberg N, Earnshaw M, Sharpley J, & Hughes JH. Does psychoeducation help prevent post traumatic psychological distress? Psychiatry: Inter Bio Proc. 2008; 71(4), 287–302.
- 25. Sharpley J, Fear NT, Greenberg N, Hacker Hughes J, Jones M, Wessely S. Pre-Operational Stress Briefing: Does it have any effect? A comparison of Royal Naval and Royal Marine personnel receiving a pre-operational stress briefing before the invasion of Iraq with a group of personnel who did not. Occ Med 2008: 58(1): 30–34.
- 26. Schulz KF, Altman DG, Moher D, for the CONSORT Group. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. Ann Intern Med. 2010;152.
- 27. Kroenke K, Spitzer R, Williams JB. The PHQ-9: Validity of a Brief Depression Severity Measure. J Gen Intern Med. 2001;16: 603–13. pmid:11556941
- 28.
Weathers FW, Litz BT, Keane TM, Palmieri PA, Marx BP, Schnurr PP. The PTSD Checklist for DSM-5 (PCL-5). The National Center for PTSD. 2013. www.ptsd.va.gov; 2013.
- 29. Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, et al. The Warwick-Edinburgh Mental Well-Being Scale (WEBWBS): development and UK validation. Health Qual Life Outcomes. 2007;5: 63.
- 30.
Schwarzer R, Jerusalem M. Generalized Self-Efficacy scale. In: Weinman J, Wright S, Johnston M, editors. Measures in health psychology: A user’s portfolio. Causal and control beliefs. Windsor, UK: NFER-NELSON; 1995. pp. 35–37.
- 31. Taylor CT, Alden LE. To see ourselves as others see us: an experimental integration of the intra and interpersonal consequences of self-protection in social anxiety disorder. J Abnorm Psychol. 2011;120(1): 129–141. pmid:21319927
- 32. Sarason IG, Sarason BR, Shearin EN, Pierce GR. A brief measure of social support: Practical and theoretical implications. J Soc Pers Relat. 1987;4: 497–510.
- 33. Kleim B, Gonzalo D, Ehlers A. The Depressive Attributions Questionnaire (DAQ): Development of a Short Self-Report Measure of Depressogenic Attributions. J Psychopathol Behav Assess. 2011;33(3): 375–385.
- 34. Carver CS, Scheier MF, Weintraub JK. Assessing coping strategies: A theoretically based approach. J Pers Soc Psychol. 1989;56(2): 267–283. pmid:2926629
- 35. Clohessy S, Ehlers A. PTSD symptoms, response to intrusive memories and coping in ambulance service workers. Br J Clin Psychol. 1999;38(3): 251–265. pmid:10532147
- 36. Treynor W, Gonzalez R, Nolen-Hoeksema . Rumination Reconsidered: A Psychometric Analysis. Cognit Ther Res. 2003;27(3): 247–259.
- 37.
Weathers FW, Blake DD, Schnurr PP, Kaloupek DG, Marx BP, Keane TM. The Clinician-Administered PTSD Scale for DSM-5 (CAPS-5). Interview available from the National Center for PTSD at www.ptsd.va.gov; 2013.
- 38. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10): 1092–7.
- 39.
Babor TF, Higgins-Biddle JC, Saunders JB, Monteiro MG. The Alcohol Use Disorders Identification Test, Guidelines for Use in Primary Care. 2nd ed. Geneva, Switzerland: Department of Mental Health and Substance Dependence, World Health Organization; 2001.
- 40. Eysenck SBG, Eysenck HJ, Barrett P. A revised version of the psychoticism scale. Pers Indiv Dif. 1985;6(1): 21–29.
- 41.
R Core Team. (2017). R: A language and environment for statistical computing.
- 42.
Wickham, H. (2017). Tidyverse: Easily Install and Load the ‘Tidyverse’. [R package version 1.2.1].
- 43.
Pinheiro, J., Bates, D., DebRoy, S., Sarkar, D., & R Core Team. Nlme: Linear and Nonlinear Mixed Effects Models. 2018. [R package version 3.1–131.1.].
- 44.
Selker, R., Love, J., & Dropmann, D. Jmv: The ‘jamovi’ analyses. 2018. [R package version 0.8.6.2].
- 45.
Revelle W. (2018). psych: Procedures for Personality and Psychological Research, Northwestern University, Evanston, Illinois, USA. [R package version 1.8.3].
- 46.
Tan L, Deady M, Paterson H, Bryant RA, Harvey SB. The efficacy of a workplace mental health awareness and resilience training program on mental health and help-seeking outcomes. Under review.
- 47. Alexander DA, & Wells A. Reactions of police officers to body-handling after a major disaster a before-and-after comparison. The British Journal of Psychiatry. 1991; 159(4), 547–555.
- 48. Alexander DA. Early mental health intervention after disasters. Advances in Psychiatric Treatment. 2005; 11(1), 12–18.
- 49. Gist R & Woodall SJ. There are no simple solutions to complex problems: The rise and fall of critical incident stress debriefing as a response to occupational stress in the fire service. Response to disaster: Psychosocial, community, and ecological approaches. 1991; 211–235.
- 50. Hytten K & Hasle A. Fire fighters: a study of stress and coping. Acta Psychiatrica Scandinavica. 1989; 80, 50–55.
- 51. Weisaeth L. A study of behavioural response to an industrial disaster. Acta Psychiatrica Scandinavica. 1989; 80, 13–24.
- 52. Samadian F, Dalili N, Jamalian A. Lifestyle Modifications to Prevent and Control Hypertension. Iran J Kidney Dis. 2016;10(5): 237–263.
- 53. Topper M, Emmelkamp PMG, Watkins E, Ehring T. Prevention of anxiety disorders and depression by targeting excessive worry and rumination in adolescents and young adults: A randomized controlled trial. Behav Res Ther. 2017;90: 123–136. pmid:28049069