Previous article Table of Contents  Next article

ORIGINAL ARTICLE
Year : 2013  |  Volume : 7  |  Issue : 3  |  Page : 277-282

Does the Maslach Burnout Inventory correlate with cognitive performance in anesthesia practitioners? A pilot study


Department of Neurosurgery, O. U. of Neuroanesthesia and Intensive Care, IRCCS Neurological Institute C. Besta of Milan, Italy

Correspondence Address:
Eleonora Francesca Orena
Via Celoria 11, 20133, Milan
Italy
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/1658-354X.115351

Rights and Permissions
Date of Web Publication20-Jul-2013
 

  Abstract 

Background: Chronic stress is a common condition among health-care operators, anesthetists in particular. It is known to cause cognitive weakening and pathological outcomes, as the Burnout syndrome. Nevertheless, the impact of clinicians' health on their performance has received limited attention thus far. Our pilot study, aims at evaluating the influence of burnout on the cognitive performance in a population of anesthesia practitioners. Methods: In 18 practitioners we assessed attention by means of reaction times (RTs), pre- and post-shift, with a five-subtest computerized neuropsychological battery. RTs were controlled for the situational anxiety with the State-Trait Anxiety Inventory X1. The burnout level was evaluated with the Maslach Burnout Inventory (MBI). The three MBI sub-scores (emotional exhaustion, depersonalization and professional achievement) were combined to obtain two groups according to the burnout score (high and low). Results: Anesthetists showed a significantly worse performance in the fifth test post-shift (P=0.041) than pre-shift. The high-score burnout group reacted slower than the low-score burnout group in three of the five cognitive subtests, without reaching a statistical significance. Nevertheless, our effect size, which is independent from the sample size, is very large (d=1.165). Conclusion: We found that in a population of health-care operators, burnout may affect the cognitive and potentially, the working performance. Qualitative and quantitative measurements should be integrated to ensure a better management of burnout and its consequences in workplaces.

Keywords: Anesthesia, attention, burnout, psychological factors, medical error


How to cite this article:
Orena EF, Caldiroli D, Cortellazzi P. Does the Maslach Burnout Inventory correlate with cognitive performance in anesthesia practitioners? A pilot study. Saudi J Anaesth 2013;7:277-82

How to cite this URL:
Orena EF, Caldiroli D, Cortellazzi P. Does the Maslach Burnout Inventory correlate with cognitive performance in anesthesia practitioners? A pilot study. Saudi J Anaesth [serial online] 2013 [cited 2019 Sep 18];7:277-82. Available from: http://www.saudija.org/text.asp?2013/7/3/277/115351


  Introduction Top


"While anesthesia, like all of medicine, is considered to be increasingly safe for patients, it is becoming more dangerous for its practitioners."

Jackson,
1999

In the last two decades there has been an increased attention for the working conditions of health-care operators, as they experience a major discomfort and a higher risk to develop work-stress related diseases. [1] Anesthesia practitioners in particular suffer from chronic stress, due to the peculiar work context (low control, high demand, risk and responsibilities, production pressure, conflicts) and content (proximity with situations of pain and death). [2],[3]

This kind of distress can often lead to pathological outcomes such as the Burnout syndrome. [4],[5] Burnout is a prolonged response to chronic emotional and interpersonal stressors on the job, and is defined by the three dimensions of exhaustion, cynicism and inefficacy. [6]

These conditions of chronic stress have also remarkable consequences on the functioning of one's cognitive systems, in particular memory and attention, [7],[8],[9],[10],[11],[12] in terms of mental overload. These so-called non-technical skills, like the capability of handling several simultaneous stimuli, are absolutely essential for clinicians to properly carry out their work and manage every-day emergency situations [7],[8] and their integrity is an elementary pre-condition for the overall performance of the cognitive system. [7]

Hence, burned-out workers could also present a weakened cognitive performance, which does not define the professional skill, but, if detected, can help in preventing errors. That is why recently, Byrne et al. have underlined that anesthetists' performance is a prominent issue for a safe clinical practice [13] and cognitive overload caused by distress has been recognized as a significant cause of error in industries such as aviation. Measuring mental workload is becoming a key method of improving safety, also in hospital contexts. [13]

However, the cognitive functioning of distressed workers has received limited attention thus far. [14] The impact of clinicians' health on their performance is now-a-days largely unknown and is often treated as a taboo.

Hence, to evaluate the influence of burnout level on cognitive performance, in the present preliminary study we applied an original protocol to assess the effects of burnout on the attentional cognitive system in a specific population of anesthesia practitioners. We therefore, collected not only qualitative data, but also objective measures of performance by means of reaction times (RTs). Our aim is to evaluate if and how burnout could affect the subject's ability of information speed processing and attention. We expect that the presence of burnout will lead to a poorer performance, indicated by slower RTs.


  Methods Top


We followed the Strengthening the Reporting of Observational Studies in Epidemiology STROBE Statement Checklist for observational cohort study.

Subjects

Our sample consisted of 23 specialised operators, 15 anesthetists and 8 anesthesia nurses, the whole Anesthesia Service at our Neurological Institute in Milan, a tertiary hospital devoted to neurological and neurosurgical procedures. As participation was voluntary, five practitioners decided not to take part in the study, three anesthetists and two nurses.

The experimental group comprised 18 subjects, 11 men (9 anesthetists and 2 nurses) and 7 women (3 anesthetists and 4 nurses) and with a mean age of 42 (±10.9). All participants were staff operators at the Neurosurgical Department and O. U. of Neuroanesthesia and Intensive Care, with a mean experience in the field of 17 years (±10) (9 years ± 8 years at the Neurological Institute C. Besta) and a mean of 44 ± 6 working hours per week. All subjects signed an informed consent to the anonymous treatment of the data.

Ethical approval for this study was provided from the Institutional Review Board (Record n. 17), Milan, Italy (Chairperson Prof. Muller) on 6 th July 2011.

Measures

Psychological testing

Every subject completed two tests: The State-Trait Anxiety Inventory X1 version (STAI-X1, Spielberger, 1979) and the Maslach Burnout Inventory (MBI, Maslach and Jackson, 1981, 1986), in the version specifically designed for health-care workers. The STAI-X1 assesses the state (situational) anxiety with 20 items to which answer on a 4-point scale (not at all- a little- quite- a lot). This allowed us to detect high levels of state anxiety that could affect the rest of the assessment. [15] Note that there is not a cut-off value to interpret STAI-X1 scores. Since, in our case, the STAI-X1 had not a diagnostic value, we considered scores >1 standard deviation as a deviation from the normality (statistically meant) and scores >3 standard deviations as outliers.

The MBI is a 22-item questionnaire that evaluates the burnout level on three scales, emotional exhaustion (EE), depersonalization (DP) and professional achievement (PA), as theorised by Maslach (1982). For the MBI cut-off values are available, specifically validated for health professions, and allow to categorize scores in low, medium and high. Specifically, they are: For EE, low ≤14, medium 15-23, high ≥24; for DP, low ≤3, medium 4-8, high ≥9; for PA, low ≥37, medium 36-30, high ≤29 (this scale is inverted; the higher the PA, the lower the burnout).

Every subject also completed a brief questionnaire collecting demographic data (age, sex, marital status) and professional information (profession, seniority, weekly working hours).

Cognitive assessment

A computerised neuropsychological battery with five subtests was used to perform selective and sustained attention and RTs in ms were acquired. RT is defined as the interval time between application of a stimulus and detection of response. It is used to assess attention and is considered a measure of cognitive resources. [11]

Our battery was a progressive order and included a difficulty scale. Stimuli in the tests were automatically randomized at every start of the program, in order to avoid learning effects on the performance. In the first cognitive test the subject only had to push the bar button on a keyboard when a yellow dot compared randomly on the display. The second, the third and the fourth were tests of selective and sustained attention: The subject had to push the button only when the target stimulus compared on the display, with, respectively, a color, color and shape and orientation criterion. The last was a spatial selective attention test, in which the participant had to click on every H letter he/she could see among other non-target letters in the shortest time possible. The battery was built by digitizing already existing and standardized tests, in detail: The first, second and third test from Posner (1984), the fourth test from Cooper and Shepard (1973) and the fifth test by Mesulam (1985).

Methodology

All participants were assessed one time before and one time after the routinary working day shift, in block randomization order. The method of block randomization allows to divide in blocks the participants according to a factor, that is than controlled for. In our case, we block randomized the order in which participants should complete the pre- or post-shift assessment, in order to avoid bias due to the order or the sequency of the assessment.

To avoid differences due to fatigue, all participants were tested before and after an ordinary morning shift in the operatory room (8 working hours per shift for all participants). The uniformity of the context, being stress a context-related phenomenon, [3] allowed us to control for this variable.

During every session, the subject filled the STAI-X1 and performed the cognitive tests. The MBI was given on the first session and had to be filled only once.

The experiment took place in a protected-from-external- stimuli environment at the Neurological Institute C. Besta of Milan.

Outcomes and hypothesis

Our primary outcome was to investigate the phenomenon of burnout in our sample population. In particular, we wanted to verify whether high levels of chronic stress (resulting in high burnout scores) could affect the performance of simple reaction time tests. Therefore, our primary outcome measures were MBI scores and RTs.

We speculated that RTs could vary for different level-of-burnout group (the higher the burnout level, the slower RTs) and also between the pre- and post-shift session, because of the fatigue due to mental workload developed during the working shift.

Data handling and statistics

We scored the two psychological tests taking into account demographic variables, i.e., age, sex, and education, using the correction tables provided by each manual. The three sub-scores obtained from the MBI were recoded into low-medium-high. In addition, the MBI does not return a unique score and our subjects all showed heterogeneous profiles. Therefore, we applied a recombination of the three MBI scores that allowed us to divide our sample into two groups, according to the burnout level: The low-score group, i.e., all subjects with none/only one subscale high-score (N=15), and the high-score group, i.e., all participants with at least two subscale high-scores ( N=3) [Figure 1]. We applied this recoding based on previous considerations regarding the combination of the three MBI subscales. [16]
Figure 1: Sample flow chart

Click here to view


The mean RT was calculated for every subtest, subject, and experimental session.

Data were analyzed using the Statistical Package for Social Science version 17.0 (SPSS Inc., Chicago, IL). All testing was two-tailed with the significance level set at P≤0.05 and P≤0.01 for multiple comparisons, according to the Bonferroni correction . We used non-parametric statistics: The Mann-Whitney's test for independent data, for between-group analysis, the Wilcoxon's signed-rank test for coupled data, for within-group analysis, and the Kendall's Tau for correlation analysis.


  Results Top


Our sample reveals high levels of burnout [Table 1]. The Kendall's Tau test did not show any correlation between the MBI subscales and demographic and job variables (age, sex, marital status, profession, seniority).
Table 1: Sample burnout description for low, medium and high Maslach Burnout Inventory sub‑scores

Click here to view


The STAI-X1 was used to control our reaction time measures for the situational anxiety. In our sample, there were not outliers (>3 standard deviations), but we had three high scores at the anxiety test (>1 standard deviation), the same in the pre- and the post-shift session. Despite this, we could include these subjects in the following analysis, due to the fact that STAI-X1 scores did not show any significant correlation with RTs and were stable over the two measurements ( P=0.006).

RTs of the fifth cognitive test were significantly slower in the post-shift session for the overall sample ( P=0.035), but it was the group of anesthetists that showed this effect prominently ( P=0.041) [Figure 2].
Figure 2:

Click here to view


RTs of the two level-of-burnout groups did not show any statistical significant difference, although the graph is quite eloquent [Figure 3]. In order to understand the scope of our results, we then calculated the effect size (ES) of the differences in pre-shift RTs between low-score and high-score burnout group. Note that ES is independent from the sample size (unlike the P value) and gives a degree of departure from the null hypothesis. We found a mean ES d=1.17 (respectively, for RTs of the five pre-shift tests: d=1.02; d=1.11; d=1.36; d=1.05; d=1.29), which, according to Choen, [17] is a very large ES (d>0.8).
Figure 3:

Click here to view



  Discussion Top


Work-related stress is a growing phenomenon in our society and there are specific working populations, like health-care operators, that are more affected. [18],[19],[20]

In the literature, there are conflicting data concerning the correlation between burnout and other variables, such as demographic and occupational factors and methods are quite heterogeneous. [21] Despite this, it is well known that among anesthetists, and health-care operators in general, there is a high prevalence of burnout, between 20% and 60%, considering the large variance between cultures. In our sample, we detected levels of burnout higher than normal population's and in line with previous results. [6],[21] On the other hand, also our results do not confirm any correlation between burnout level and demographic features, affirming the variability of these factors between different contexts.

Most of the studies on stress and burnout among clinicians, however, had used mainly questionnaires or postal surveys as evaluating tools. [3],[6],[18],[19],[20] Even so, a questionnaire is not meant to provide measures of cognitive overload, but a subjective evaluation of one's stress condition. Moreover, they make adequate comparisons difficult, limit the development of causal inferences and are exposed to bias. [22] Instead, and easy-to-acquire measure such as RTs can provide a quantitative index of working performance. [13],[23],[24] That is why a current of studies have focused on investigating new methods to measure the mental load during clinical practice. [13],[23],[24] These studies demonstrate that increased RTs in a double task correspond to higher mental workload, because of an increased demand of attentive resources.

The originality of our protocol stands in the combination of a validated and widely accepted questionnaire (the MBI) and a quantitative measure (the RT) controlled for the state anxiety, to provide an assessment of burnout and its cognitive consequences on a working population of health-care operators.

Our first result indicates a weakening of the performance in the post-shift assessment that becomes evident in the last attentive test. Anesthetists in particular show this effect. It arises only at the end of the battery probably because of the difficulty order of the tests and means that the first four tests reach a "ceiling effect"; instead the fifth test overcomes the threshold of the residual cognitive resources and ends in a slowdown of RTs. A possible explanation is that anesthetists experience a major stress and cognitive load during the working shift, which ends in a mental fatigue and in a worse performance.

Furthermore, congruent to our hypothesis, we found differences, though not statistically significant, in RTs between a high-score and a low-score burnout profile group, in that the first group shows slower RTs throughout all tests. It is remarkable that these differences are detected in pre-shift session, therefore, excluding the possibility to ascribe them to ordinary mental fatigue and pointing out a baseline mental overload due to chronic stress. RTs, as an index of cognitive overload, allowed us to detect a weakening of the attentive and potentially, working performance.

Being our research novel and exploratory in nature, it presents the major limitation of the small sample size and therefore, has a limited external validity. However, this limit does not undermine the importance of our results, as previous authors' experience demonstrate. [24],[25],[26] This is even more true if we consider the large ES of our results. Taken together with the small sample size and the lack of statistical significance, it indicates a high probability of making an error type II (>20%). Our sample is too small to detect a statistical significance, but the ES of our results clearly demonstrates a trend towards a difference between subjects with and without burnout.

Moreover, this kind of study, being the participation voluntary, are susceptible of a self-selection bias. [22] In our case, this means that people who believed to suffer from burnout may had decided not to take part in the study (for example for fear of being judged), therefore, weakening the power of our results.

Thus, we suggest that further investigations based on our data are needed on a larger scale, concentrating on the cognitive outcomes of burnout and how to detect them. Should our results be confirmed, they may open the way to further analysis and suggestions for safety of both operators and patients.


  Conclusions Top


Based on our evidences and on the literature, a questionnaire alone could not be enough for an all-round assessment of work-related stress. Qualitative and quantitative tools should be integrated in a protocol like the one we propose, which is more accurate and reliable for an effective management of stress in working contexts, since it provides both subjective and objective measures of stress and performance.

Currently the topic of burnout and mental overload is intensely under researched and results from this line of investigation are particularly relevant for the issue of a safe practice and for operators' health.

Our results are only explorative, but give a preliminary and significant answer to the question we pose in the title, and can be a useful guide for future investigations and to implement an agile protocol to monitor operators' health.

 
  References Top

1.Embriaco N, Azoulay E, Barrau K, Kentish N, Pochard F, Loundou A, et al. High level of burnout in intensivists: Prevalence and associated factors. Am J Respir Crit Care Med 2007;175:686-92.  Back to cited text no. 1
    
2.Felton JS. Burnout as a clinical entity - Its importance in health care workers. Occup Med (Lond) 1998;48:237-50.  Back to cited text no. 2
    
3.Jackson SH. The role of stress in anaesthetists' health and well-being. Acta Anaesthesiol Scand 1999;43:583-602.  Back to cited text no. 3
    
4.Raggio B, Malacarne P. Burnout in intensive care unit. Minerva Anestesiol 2007;73:195-200.  Back to cited text no. 4
    
5.Ahola K, Pulkki-Råback L, Kouvonen A, Rossi H, Aromaa A, Lönnqvist J. Burnout and behavior-related health risk factors: Results from the population-based finnish health 2000 study. J Occup Environ Med 2012;54:17-22.  Back to cited text no. 5
    
6.Maslach C, Schaufeli WB, Leiter MP. Job burnout. Annu Rev Psychol 2001;52:397-422.  Back to cited text no. 6
    
7.Coburn M, Henzler D, Baumert JH, Fimm B, Drüke B, Rossaint R. Influence of a 30-min break on divided attention and working memory in resident anaesthetists on daily routine. Br J Anaesth 2006;97:315-9.  Back to cited text no. 7
    
8.Reader T, Flin R, Lauche K, Cuthbertson BH. Non-technical skills in the intensive care unit. Br J Anaesth 2006;96:551-9.  Back to cited text no. 8
    
9.McEwen BS, Sapolsky RM. Stress and cognitive function. Curr Opin Neurobiol 1995;5:205-16.  Back to cited text no. 9
    
10.Vedhara K, Hyde J, Gilchrist ID, Tytherleigh M, Plummer S. Acute stress, memory, attention and cortisol. Psychoneuroendocrinology 2000;25:535-49.  Back to cited text no. 10
    
11.Van der Linden D, Keijsers PJ, Eling P, Van Schaijk R. Work stress and attentional difficulties: An initial study on burnout and cognitive failures. Work Stress 2005;19:23-6.  Back to cited text no. 11
    
12.Lupien SJ, McEwen BS, Gunnar MR, Heim C. Effects of stress throughout the lifespan on the brain, behaviour and cognition. Nat Rev Neurosci 2009;10:434-45.  Back to cited text no. 12
    
13.Byrne AJ, Oliver M, Bodger O, Barnett WA, Williams D, Jones H, et al. Novel method of measuring the mental workload of anaesthetists during clinical practice. Br J Anaesth 2010;105:767-71.  Back to cited text no. 13
    
14.Marin MF, Lord C, Andrews J, Juster RP, Sindi S, Arsenault-Lapierre G, et al. Chronic stress, cognitive functioning and mental health. Neurobiol Learn Mem 2011;96:583-95.  Back to cited text no. 14
    
15.Broadbent D, Broadbent M. Anxiety and attention bias: State and trait. Cogn Emot 1988;2:165-83.  Back to cited text no. 15
    
16.Golembiewski RT, Munzenrider RF, Stevenson GJ. Stress in Organizations. Towards a Phase Model Burnout. New York: Praeger Publisher; 1986.  Back to cited text no. 16
    
17.Cohen J. A power primer. Psychol Bull 1992;112:155-9.  Back to cited text no. 17
    
18.Nyssen AS, Hansez I, Baele P, Lamy M, De Keyser V. Occupational stress and burnout in anaesthesia. Br J Anaesth 2003;90:333-7.  Back to cited text no. 18
    
19.Larsson J, Sanner M. Doing a good job and getting something good out of it: On stress and well-being in anaesthesia. Br J Anaesth 2010;105:34-7.  Back to cited text no. 19
    
20.Coomber S, Todd C, Park G, Baxter P, Firth-Cozens J, Shore S. Stress in UK intensive care unit doctors. Br J Anaesth 2002;89:873-81.  Back to cited text no. 20
    
21.Capuzzo M, Gilli G, Paparella L, Gritti G, Gambi D, Bianconi M, et al. Factors predictive of patient satisfaction with anesthesia. Anesth Analg 2007;105:435-42.  Back to cited text no. 21
    
22.Rama-Maceiras P, Parente S, Kranke P. Job satisfaction, stress and burnout in anaesthesia: Relevant topics for anaesthesiologists and healthcare managers? Eur J Anaesthesiol 2012;29:311-9.  Back to cited text no. 22
    
23.Gaba DM, Lee T. Measuring the workload of the anesthesiologist. Anesth Analg 1990;71:354-61.  Back to cited text no. 23
    
24.Davis DH, Oliver M, Byrne AJ. A novel method of measuring the mental workload of anaesthetists during simulated practice. Br J Anaesth 2009;103:665-9.  Back to cited text no. 24
    
25.Yee B, Naik VN, Joo HS, Savoldelli GL, Chung DY, Houston PL, et al. Nontechnical skills in anesthesia crisis management with repeated exposure to simulation-based education. Anesthesiology 2005;103:241-8.  Back to cited text no. 25
    
26.Hackshaw A. Small studies: Strengths and limitations. Eur Respir J 2008;32:1141-3.  Back to cited text no. 26
    


    Figures

  [Figure 1], [Figure 2], [Figure 3]
 
 
    Tables

  [Table 1]


This article has been cited by
1 Care and caring in the intensive care unit: Family membersę distress and perceptions about staff skills, communication, and emotional support
Eve B. Carlson,David A. Spain,Luma Muhtadie,Liz McDade-Montez,Kathryn S. Macia
Journal of Critical Care. 2015; 30(3): 557
[Pubmed] | [DOI]
2 Emotional exhaustion and burnout among medical professors; a nationwide survey
Joeri K Tijdink,Anton CM Vergouwen,Yvo M Smulders
BMC Medical Education. 2014; 14(1)
[Pubmed] | [DOI]



 

Top
 
Previous article    Next article
 
  Search
 
    Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
 Related articles
    Access Statistics
    Email Alert *
    Add to My List *
* Registration required (free)  

 
  IN THIS Article
   Abstract
  Introduction
  Methods
  Results
  Discussion
  Conclusions
   References
   Article Figures
   Article Tables

 Article Access Statistics
    Viewed2373    
    Printed49    
    Emailed1    
    PDF Downloaded242    
    Comments [Add]    
    Cited by others 2    

Recommend this journal