Year : 2017 | Volume
| Issue : 5 | Page : 19-30
Development and validation of Arabic version of the postoperative quality of recovery scale
Abdullah Sulieman Terkawi1, Siny Tsang2, Waleed Riad3, Sumaya Nemer Nassar3, Maissa Mahmoud3, Ghadah Jumaan AlKahtani4, Hanin Hussain Alsharif4, Khalid S Doais4, Fatima Jaina Sala4, Anas Abdulrahman4, Colin F Royse5
1 Department of Anesthesiology, University of Virginia, Charlottesville, VA, USA; Department of Anesthesiology, King Fahad Medical City, Riyadh, Saudi Arabia; Outcomes Research Consortium, Cleveland, OH, USA
2 Department of Epidemiology, Columbia University, New York, USA
3 Department of Anesthesiology, Corniche Hospital, Abu Dhabi, United Arab Emirates
4 Department of Anesthesiology, King Fahad Medical City, Riyadh, Saudi Arabia
5 Department of Surgery, University of Melbourne; The Royal Melbourne Hospital, Melbourne, Australia
Abdullah Sulieman Terkawi
1215 Lee Street, Charlottesville, VA 22903, USA
Source of Support: None, Conflict of Interest: None
|Date of Web Publication||25-May-2017|
Introduction: The postoperative quality of recovery scale (PostopQRS) is a widely used tool to assess the postoperative quality of recovery. Our aim was to translate, culturally adapt, and validate the PostopQRS questionnaire in Arabic.
Methodology: A systematic translation process was used to translate the original English PostopQRS into Arabic. After the pilot study, the translated version was validated among patients who underwent different types of surgeries. We examined the reliability (using internal consistency) and validity of the translated version. To examine the responsiveness of the translated PostopQRS, the questionnaire was administered 6 times among the same group of patients (once before surgery as baseline measure, and 5 times after surgery, up to 1 week after surgery).
Results: A total of 190 patients (10 men, 180 women) were included. Internal consistencies vary across each domain and overtime, with mostly good to excellent reliability. Most patients found the PostopQRS questions to be clear and easy to understand and thought the questionnaire items covered all their problem areas regarding their quality of recovery. In general, patients showed recovery across all five domains starting from postoperative day 1 (POD1). Patients showed the fastest recovery in the emotional domain, and the proportion of recovered patients remained stable over time. Most patients were recovered in the cognitive domain by POD1. Although only a small proportion of patients were recovered in the physiological and activities of daily living domains in POD1, most patients were recovered by POD3. The proportion of patients recovered in the nociceptive domain declined initially, but more patients showed recovery by POD3 and most were recovered by POD7. Furthermore, quality of recovery was related to the extent of surgery (major vs. minor).
Conclusion: Our translated version of PostopQRS was reliable and valid for use among Arabic-speaking patients. In addition, we showed that the PostopQRS was able to track the changes in recovery among patients in our study.
Keywords: Anesthesia; Arabic; postoperative quality of recovery scale; quality of recovery; reliability; validity
|How to cite this article:|
Terkawi AS, Tsang S, Riad W, Nassar SN, Mahmoud M, AlKahtani GJ, Alsharif HH, Doais KS, Sala FJ, Abdulrahman A, Royse CF. Development and validation of Arabic version of the postoperative quality of recovery scale. Saudi J Anaesth 2017;11, Suppl S1:19-30
|How to cite this URL:|
Terkawi AS, Tsang S, Riad W, Nassar SN, Mahmoud M, AlKahtani GJ, Alsharif HH, Doais KS, Sala FJ, Abdulrahman A, Royse CF. Development and validation of Arabic version of the postoperative quality of recovery scale. Saudi J Anaesth [serial online] 2017 [cited 2019 Dec 13];11, Suppl S1:19-30. Available from: http://www.saudija.org/text.asp?2017/11/5/19/207060
| Introduction|| |
Postoperative quality of recovery has become an important measure that reflects on the surgeon, the anesthesiologist, and the institute performance. It has become an important primary endpoint in many clinical trials. A recent study suggests that using a single outcome (e.g., pain scores) as a surrogate measure for quality of recovery does not necessarily correlate with other important outcomes (e.g., length of hospital stay or patient satisfaction). Thus, a more comprehensive scale was suggested to be used as a primary endpoint for assessing quality of recovery.
Multiple quality of recovery scales were developed in the last two decades, among which the postoperative quality of recovery scale (PostopQRS) is the most comprehensive and objective instrument. The PostopQRS is designed to be administered at multiple time points and includes the assessment of patients' cognition across time. Furthermore, recovery is dichotomized as recovered versus not recovered, which is clinically useful.
The PostopQRS was designed as a verbal only scale, so that it can be used either face-to-face or through telephone interview. In English version, face validity, feasibility, and discriminate validity have been shown, and it has been translated into eight languages.,,,, The background and use of the scale have been described elsewhere, including the recalibration of cognitive scoring. The PostopQRS assess quality of recovery in five domains: physiological, emotive, nociceptive, functional (i.e., activities in daily living), and cognitive. Baseline measurements are acquired before surgery. Recovery is a dichotomized outcome defined by a return to baseline values or better at each of the postoperative measurement time points. “Overall recovery” requires recovery in all domains being assessed.
The cognitive domain consists of five verbal tests, and domain recovery requires recovery in all five tests. Variance in cognitive performance is a normal event and accordingly, the definition of recovery in cognitive tests was modified to include a tolerance factor to account for normal variability. Participants are allowed to perform a little worse than their baseline performance and still be scored as recovered. However, if the baseline scores in participants are lower than the tolerance factor, they would automatically be scored as recovered. As such, patients with low baseline scores cannot be evaluated for cognitive recovery. These patients are further excluded from scoring overall recovery if they fail recovery in another recovery domain. However, these participants are not excluded from other recovery domains.
The aim of this study was to translate, culturally adapt, and validate PostopQRS questionnaire into Arabic.
| Methodology|| |
A repeated measures' study was conducted between April 2015 and December 2016 in three tertiary hospitals; Corniche Hospital, Abu Dhabi, United Arab Emirates (Institutional Review Board [IRB] approval No. Ch10041501), King Fahad Medical City (IRB approval No. 14-107), Riyadh, Saudi Arabia, and King Faisal Specialist Hospital and Research Center (IRB approval No. ORA/0626/36), Riyadh, Saudi Arabia.
Translation and cultural adaptation
Initial translation (forward translation)
Five bilingual translators, from five Arabic countries (Syria, Saudi Arabia, Yemen, Sudan, and Egypt) with different dialects, were assigned. All translators speak Arabic as their mother language. Two of them are naive translators with no prior knowledge of the concepts being quantified; they are also not from the medical field. Each translator produced a written report of the translation that they complete, after which all the translators met and discussed translation and came to a consensus of the translation.
Two translators who were blinded to the original (English) questionnaires were assigned to translate the final Arabic version back into English. This is a process of validity checking to make sure that the translated version is reflecting the same item content as the original version. These two translators have their source language (English) as their mother tongue. The two translators were not aware of the concepts explored.
It was composed of methodologist, health professionals, and language professionals. The expert committee's role was to consolidate all the versions of the questionnaire and develop the prefinal version of the questionnaire for field testing. The committee eventually reviewed all the translations and reaches a consensus on any discrepancy.
Postoperative quality of recovery scale
The questionnaire consists six domains:
- Physiology: It measures systolic blood pressure, heart rate, temperature, respiratory rate, and oxygen saturation. Airway control, level of agitation, level of consciousness, and activity on command relate to emergence and airway safety. This domain is tested in the immediate and early period. It is designed to assess physiologic safety and “home readiness” for day care surgery
- Nociceptive: Assesses of pain and nausea, using 1–5 Likert rating scale
- Emotional: Assesses of feelings of anxiety and depression at the time of measurement with scoring as for nociceptive domain
- Activities of daily living: Assesses physical return to normality through activities of daily living (ADL). Ability to stand, walk, and dress without assistance and ability to eat and drink and scored as 3 - easily, 2 - with difficulty, and 1 - not at all
- Cognitive: Assess orientation, verbal memory, executive functioning, attention, and concentration. Tests produce performance scores. The tests are derived from validated and extensively used neurocognitive tests. Performance variability tolerance factor is applied. Participants not included in subsequent analysis if baseline scores are equal to or less than the tolerance factor. The tolerance factors are orientation – no tolerance factor, digits forward – tolerance factor = 2, digits back – tolerance factor = 1, word recall – tolerance factor = 3, and word generation – tolerance factor = 3
- Overall patient perspective: Patients rate of their recovery with respect to their ADL, clarity of thought, ability to work, and satisfaction with anesthetic care. This domain differs from the others because there are no baseline measurements. It is complimentary to the other “recovery domains” but is not included in analysis of return to baseline.
An Arabic version of the PostopQRS questionnaire was administered six times to patients undergoing predetermined variable surgical procedures as follows [Figure 1]: patients were administered the questionnaires preoperation (T0), postanesthesia care unit (PACU) 15 min (T0 + 15 min), pre-PACU discharge (T0 + 40 min), day 1 postoperative (T0 + 1 day), day 3 postoperative (T0 + 3 days), and day 7 postoperative (T0 + 7 days). Data were entered into the PostopQRS website (www.postopqrs.com), which automatically scores recovery for each question and domain. The website also calculates the recovery in each domain and provides summary figures and tables. Eligible patients were any patient who are between 17- and 80-year-old undergoing any one of the procedures listed in [Table 1]. Exclusion criteria were patients with psychosis, significant visual impairment, physical disability, or patient's refusal to participate in the study. Data were entered in a special data entry template that where designed on http://www.postopqrs.com.
|Figure 1: Administration of the questionnaire subscales over time. Since the physiological factors require physical examinations they were inapplicable for postdischarge assessment. Activities of daily living factors not applicable for postanesthesia care unit. Overall patients prospective only applicable after surgery|
Click here to view
|Table 1: Frequencies of surgery types among patients in the current study|
Click here to view
The prefinal version was pilot tested on a group of 31 patients (all females), data not shown. The committee met at this point and approved the prefinal version as final. Examples from the final Arabic version presented in the [Appendix 1 [Additional file 1] ] and [Appendix 2 [Additional file 2] ], the complete English version is available at the website http://www.postopqrs.com and for Arabic versions contact email@example.com.
Assessing face validity
After completing the PostopQRS for the first time, patients responded to five statements regarding the PostopQRS items on a 5-point Likert-type scale: 1 = totally disagree, 2 = disagree, 3 = undecided, 4 = agree, and 5 = strongly agree. The five statements were (1) questions were clear and easy; (2) questions covered all your problem areas with your recovery; (3) you would like the use of this questionnaire for future assessments; (4) the questionnaire lacks important questions regarding your recovery; (5) any of the questions violate your privacy.
All data analyses were performed in R version 3.3.2 (2016-10-31). Descriptive statistics (number of patients, mean, standard deviation [SD]) was presented for the PostopQRS factors.
The internal consistency of the PostopQRS was examined using Cronbach's α. Cronbach's α ranges from 0 (no internal consistency; none of the items are correlated with each other) to 1 (perfect internal consistency; all of the items are perfectly correlated with each other). α was computed for each dimension in the PostopQRS. An instrument with α ≥0.70 is typically considered to have adequate internal consistency. As α is a function of the questionnaire's length, α is expected to be lower for the scales with fewer items than those with more items.
As two of the PostopQRS factors (nociceptive and emotional) consist of only two items, Spearman–Brown coefficients were estimated instead. The Spearman–Brown coefficients can be interpreted similarly as with the Cronbach's α.
Responsiveness was modeled as changes in the number of recovered items in each PostopQRS factor over time. Considering the repeated nature of the multiple assessments, generalized linear mixed effects models (GLMMs) are used to take into account the correlated observations within patients. The changes in the number of recovered items were estimated using GLMMs, modeled as count data. Time of administration (in days) was modeled as fixed effects and patients as the random effect.
To examine the extent to which patients' characteristics (e.g., gender, age, American Society of Anesthesiologists [ASA], in/outpatient) and surgical information (e.g., type of surgery) were associated with the number of recovered items in each PostopQRS factor, these variables were included as fixed effects in the GLMMs as well. Results from these GLMMs provide information with respect to whether patients' overall number of recovered items (averaged across time) is associated with patients' characteristics and surgical information.
Responsiveness of the overall patient perspective was assessed by the repeated administrations of the overall patient perspective items at days 1, 3, and 7 postoperative. Considering the repeated nature of the multiple assessments, linear mixed-effects models (LMMs) are used to take into account the correlated observations within patients. The changes of the individuals' responses were estimated using LMMs, with time of administration (in days) as fixed effects and patients as the random effect.
To further examine the extent to which patients' characteristics (e.g., gender, age, ASA, in/out patient) and surgical information (e.g., type of surgery, anesthesia duration) were associated with changes in patients' responses, these variables were included as fixed effects in the subsequent LMMs as well. Results from these LMMs provide information with respect to whether patients' responses in overall patient satisfaction (averaged across time) are associated with patients' characteristics and surgical information.
| Results|| |
A total of 190 patients (10 men, 180 women) participated in the validation study of the PostopQRS questionnaire. The average age was 37.1 (SD = 8.8), with an average body mass index of 31.8 (SD = 9.0). Most patients had university level education (66.3%), with smaller proportions having received some high school (22.1%), less than high school (6.8%), or no education (4.7%). Of the enrolled patients, 21.6% were rated as 1, 68.4% were rated as 2, and 8.9% were rated as 3 on the ASA score. 138 (72.6%) patients were from Corniche Hospital, Abu Dhabi, 42 (22.1%) from King Fahad Medical City, and 10 (5.2%) from King Faisal Specialized Hospital.
Twenty-seven (14.2%) patients were outpatient admission, and 163 (85.8%) were inpatient admission. Most patients (n = 187; 98.4%) did not report having previous anesthesia problems. One hundred and forty-three (75.2%) patients underwent major surgery, and 47 (24.7%) underwent minor surgery [Table 1], 148 underwent obstetrics and gynecology surgery, 19 abdominal surgery, 14 orthopedic and spine surgery, and 9 breast and endocrine surgery. The majority of the operations were open surgery (n = 182), with seven being endoscopic and one being closed surgery. The average duration of anesthesia time was 80.7 min (SD = 73.5, median = 60, range = 15–600). Completion and missing rates are presented in [Table 2]. The proportion of patients recovered in each factor of the PostopQRS are presented in [Table 3] and plotted in [Figure 2].
|Table 3: Percentage of patients recovered on all items of the postoperative quality recovery scale|
Click here to view
|Figure 2: Proportion of patients recovered at each time point by postoperative quality of recovery scale factors|
Click here to view
Reliability estimates for the PostopQRS factors are presented in [Table 4]. Cronbach's αs were computed for the physiological, ADL, cognitive, and overall patient perspective factors. Spearman–Brown estimates were computed for the nociceptive and emotive factors as these two factors consisted of only two items. Internal consistencies for the physiological factor were good for baseline and T0 + 15 min, poor for T0 + 40 min, and excellent for T0 + 1 day. The reliability for the two nociceptive items was consistently poor across all assessments, whereas reliability for the two emotional items was moderate to good, except at the T0 + 40 min assessment. Internal consistencies for the ADL and cognitive factors were consistently good across all assessment time points. The overall patient perspective showed moderate to good internal consistencies at different time points.
|Table 4: Reliability estimates for Postoperative Quality of Recovery Scale factors at different assessment timepoints|
Click here to view
Patients' responses to the five questions assessing the face validity of the PostopQRS are presented in [Table 5]. The majority of the patients endorsed agree or strongly agree that the PostopQRS questions to be clear and easy to understand, the questionnaire items covered all their problem areas regarding their postoperative recovery, and that most would like to use the PostopQRS for their long-term follow-up assessment. Most patients disagreed that the PostopQRS lacks important questions regarding their postoperative recovery, suggesting that the PostopQRS addressed most, if not all, of the important issues associated with their postoperative recovery. Finally, most patients felt that the PostopQRS questions did not violate their privacy.
The extent to which recovery (in terms of the number of items recovered in each factor) is associated with varying patient and surgical characteristics were examined using GLMMs. Time (in days) was modeled as the fixed effect (from T0 + 15 min to 7 days when appropriate), with patients modeled as the random effect. Patients' characteristics (gender, age, ASA, in/outpatient) and surgical features (major/minor surgery) were also modeled as fixed effects. Age was divided by 10 to assist with model convergence. Results are presented in [Table 6]. Consistently across all five factors, the number of recovered items increased over time as to be expected with patients' recovery.
|Table 6: Fixed effects from generalized linear mixed effects models estimating the change in the number of recovered items in each Postoperative Quality of Recovery Scale factor over time|
Click here to view
On average, older patients were more likely to have more recovered items in the physiological factor than younger patients. However, the difference was small that it is not clinically meaningful. Patients who underwent minor surgery were more likely to have more recovered items in the nociceptive, ADL, and cognitive factors than those who underwent major surgery.
Patients' average responses to the items in the overall patient perspective factor are illustrated in [Figure 3]. The extent to which patients' responses changes are associated with varying patient and surgical characteristics were examined using LMMs, and other model specifications are similar to those with the GLMMs. Results are presented in [Table 7]. Consistently across all four items in the overall patient perspective factor, patients' responses decreased over time, indicating being less impacted as they recover. On average, patients who underwent minor surgery were more likely to indicate being less impacted in their work and ADL than those who underwent major surgery.
|Figure 3: Patients' average responses to the overall patient perspective items at different time points. Error bars represent standard deviations|
Click here to view
|Table 7: Fixed effects from generalized linear mixed effects models estimating the change in the responses in each overall patient satisfaction item over time|
Click here to view
| Discussion|| |
In this study, we translated and validated the PostopQRS questionnaire among patients undergoing a variety of operations in three major medical centers in two countries. We strived to develop a questionnaire that can be easily administered to Arabic-speaking patients speaking different dialects. The current results demonstrated validity of this Arabic version, sufficient for incorporation into clinical practice. Our study is the first cross-cultural validation of the PostopQRS in Arabic-speaking patients, providing physicians with a new tool with which to evaluate the recovery of patients after surgery. Our translated version of PostopQRS is reliable and valid for use among Arabic-speaking patients.
Quality of recovery is a relatively new area for anesthesiology as it is a deviation from hospital- and doctor-based outcomes to patient-reported outcomes. These outcomes are complimentary rather than competitive. As recovery will change over time, it is important that the assessment tool is objective and designed for repeated measures. The PostopQRS was designed specifically for this purpose. The scale also includes assessment of the cognitive domain and is designed for verbal use. A completely verbal scale allows the instrument to be administered face-to-face or through telephone interview, which is vital once patients are discharged from the hospital. Surveys, which rely on face-to-face interviews typically, have low follow-up rates as many patients do not wish to return to the hospital for research purpose.
Further, the PostopQRS was designed to be a clinically useful tool. Recovery was dichotomized into “recovered” or “not recovered,” allowing the instrument to identify patients who recovered well versus those who did not recover in one or more domains. The practical implication is that patients have recovered well early will remain recovered and can be fast tracked. By identifying patients who did not recover in one or more domains at different time points, clinicians can make use of the information to implement additional treatments to improve the patients' recovery profile.
The PostopQRS Scientific Committee approves groups to translate the scale. The standard procedure is both forward and reverse translation, followed by a validation in clinical practice in the countries where the language is primarily spoken. This allows assessment of cultural appropriateness as well as any language differences. For example, in the cognitive scale, lists of words or letters used for the word generation task may have different frequencies in different languages.
In this study, we showed that recovery improves over time, which is consistent with studies found in English., Certain items (such as the emotive domain) typically show high early recovery, which remained that way, whereas nociception and cognition tend to have a slower recovery profile over days to weeks. The findings of this study were consistent with prior studies conducted in English. The tool was well received by the patients indicating feasibility for clinical use. We also showed that the quality of recovery was related to patients' age and the extent of surgery (major vs. minor). The overall low baseline scores can be explained by the fact that the majority of our patients were pregnant coming for cesarean delivery and had the negative effects of late-term pregnancy.
Our study has some limitations. First, there was no cohort of nonoperative controls in the current study. Test-retest reliability cannot be performed in a clinical cohort, as the actual recovery is a dynamic process, rather than a static (unchanging) process. Second, as the types of surgery among our patients were relatively homogeneous, discriminant validation was not performed for the translated PostopQRS. However, discriminant validation has been shown in English version. Finally, as the majority of our patients were female, we were unable to examine whether the quality of postoperative recovery differs by gender in the current study.
| Conclusion|| |
Our Arabic version of the PostopQRS was translated using forward and reverse translation. The translated PostopQRS was found to be valid and was shown to be feasible for application in a clinical population.
We would like to thank Dr. Sumaya Hussain Al-Mousa from the Department of Anesthesiology, King Faisal Specialist Hospital, Riyadh, Saudi Arabia, for her help in patients' recruitments.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Terkawi AS, Mavridis D, Sessler DI, Nunemaker MS, Doais KS, Terkawi RS, et al
. Pain Management Modalities after Total Knee Arthroplasty: A Network Meta-analysis of 170 Randomized Controlled Trials. Anesthesiology 2017. doi: 10.1097/ALN.0000000000001607.
Bowyer A, Jakobsson J, Ljungqvist O, Royse C. A review of the scope and measurement of postoperative quality of recovery. Anaesthesia 2014;69:1266-78.
Royse CF, Newman S, Chung F, Stygall J, McKay RE, Boldt J, et al.
Development and feasibility of a scale to assess postoperative recovery: The post-operative quality recovery scale. Anesthesiology 2010;113:892-905.
Royse CF, Williams Z, Ye G, Wilkinson D, De Steiger R, Richardson M, et al.
Knee surgery recovery: Post-operative quality of recovery scale comparison of age and complexity of surgery. Acta Anaesthesiol Scand 2014;58:660-7.
Royse CF, Williams Z, Purser S, Newman S. Recovery after nasal surgery vs. tonsillectomy: Discriminant validation of the postoperative quality of recovery scale. Acta Anaesthesiol Scand 2014;58:345-51.
Royse CF, Newman S, Williams Z, Wilkinson DJ. A human volunteer study to identify variability in performance in the cognitive domain of the postoperative quality of recovery scale. Anesthesiology 2013;119:576-81.
Newman S, Wilkinson DJ, Royse CF. Assessment of early cognitive recovery after surgery using the post-operative quality of recovery scale. Acta Anaesthesiol Scand 2014;58:185-91.
Shadlen MF, Siscovick D, Fitzpatrick AL, Dulberg C, Kuller LH, Jackson S. Education, cognitive test scores, and black-white differences in dementia risk. J Am Geriatr Soc 2006;54:898-905.
Nunnally J. Psychometric Theory. New York: McGraw-Hill; 1978.
Eisinga R, Grotenhuis MT, Pelzer B. The reliability of a two-item scale: Pearson, Cronbach, or Spearman-Brown? Int J Public Health 2013;58:637-42.
Bowyer A, Royse C. The importance of postoperative quality of recovery: Influences, assessment, and clinical and prognostic implications. Can J Anaesth 2016;63:176-83.
[Figure 1], [Figure 2], [Figure 3]
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5], [Table 6], [Table 7]