Effects of a rapid response system on quality of life: a prospective cohort study in surgical patients before and after implementing a rapid response system

Abstract

Background

The aim of a rapid response system (RRS) is to improve the timely recognition and treatment of ward patients with deteriorating vital signs The system is based on a set of clinical criteria that are used to assess patient’s vital signs on a general ward. Once a patient is evaluated as critical, a medical emergency team is activated to more thoroughly assess the patient’s physical condition and to initiate treatment. The medical emergency team included a critical care physician and a critical care nurse.

Aim

To assess the effect of an RRS on health-related quality of life (HRQOL).

Methods

Prospective cohort study in surgical patients before and after implementing an RRS. HRQOL was measured using the EuroQol-5 dimensions (EQ-5D) and the EQ visual analogue scale (VAS) at pre surgery and at 3 and 6 months following surgery.

Results

No statistical significant effects of RRS implementation on the EQ-5D index and EQ-VAS were found. This was also true for the subpopulation of patients with an unplanned intensive care unit admission. Regarding the EQ-5D dimensions, deterioration in the ‘mobility’ and ‘usual activities’ dimensions in the post-implementation group was significantly less compared to the pre-implementation group with a respective mean difference of 0.08 (p = 0.03) and 0.09 (p = 0.04) on a three-point scale at 6 months. Lower pre-surgery EQ-5D index and higher American Society of Anesthesiologists physical status (ASA-PS) scores were significantly associated with lower EQ-5D index scores at 3 and 6 months following surgery.

Conclusions

Implementation of an RRS did not convincingly affect HRQOL following major surgery. We question if HRQOL is an adequate measure to assess the influence of an RRS. Pre-surgery HRQOL- and ASA-PS scores were strongly associated with HRQOL outcomes and may have abated the influence of the RRS implementation.

Background

Rapid response systems (RRSs) are considered a powerful tool in patient safety. The aim of an RRS is to improve the timely recognition and treatment of general ward patients with deteriorating vital signs. The system is based on a set of clinical criteria that are used to assess patient’s vital signs on a general ward. Once a patient’s status is evaluated as critical according to these criteria [1], a rapid response team is activated to more thoroughly assess the patient’s physical condition and to initiate treatment [2].

The most frequently used outcome measure to evaluate the effectiveness of an RRS is the incidence of serious adverse events (SAEs), including cardiac arrest rate, (unexpected) death and unplanned intensive care unit (ICU) admission [3–6]. Previously, we showed that the introduction of an RRS on a surgical ward resulted in a statistically non- significant decrease in patients who experienced a cardiac arrest and/or who died unexpectedly on the ward while unplanned ICU admissions of patients increased significantly [7]. In addition to these medical outcomes, quality of life measures are also becoming increasingly important to health care research. Quality of life outcomes reflect a patient’s health perspective and are relevant to better understand and improve healthcare expenditure and resource utilisation in patient care [8]. We hypothesised that the RRS system would positively influence patient’s quality of life. The aim of the current study was to estimate the effect of an RRS on the quality of life at 3 and 6 months following surgery in the entire study population and in the subset of patients with an unplanned ICU admission.

Methods

We measured health-related quality of life (HRQOL) at pre-surgery and at 3 and 6 months following surgery in patients admitted to the surgical ward of a university hospital. Measurements were taken over two 12-months periods. Period 1 was conducted before the implementation of an RRS from January 2006 until December 2006. Period 2 was conducted after introduction of an RSS from April 2007 until April 2008. The local medical ethics committee waived the need for informed consent.

In our study we included patients staying on the surgical ward ≥72 hours because of major general surgery, including central or extensive peripheral vascular surgery, major oncologic surgery, lung surgery, extensive abdominal surgery and trauma. The 72-hours limit was used to exclude patients with minor surgical procedures. Patients unable to communicate effectively were also excluded. In period 1, a convenience sample of 518 of 1376 eligible patients were screened for participation and in period 2, 549 of 2410 patients.

HRQOL was measured using the Euroqol 5 dimensions (EQ-5D) and Euroqol visual analogue scale (EQ-VAS) questionnaire, an extensively validated instrument and approved by the Euroqol Translation Committee [9]. EQ-5D measures the following health dimensions: mobility, self-care, usual activities, pain/discomfort and anxiety/depression. Each dimension is divided into three levels: level 1 = no problems, level 2 = some/moderate problems, level 3 = severe/ extreme problems. The EQ-5D index values are derived from a general Dutch population sample [10] and range from minus 0.33 to plus 1. The EQ-VAS measures overall health on a scale from 0 to 100.

In addition, socio-demographic and clinical variables influencing HRQOL were recorded. These included age, sex, education level, employment status and smoking behaviour [11, 12]. We also recorded the length of stay (LOS) of planned and unplanned ICU admissions and the American Society of Anaesthesiologists physical status (ASA-PS) classifications score at ICU admission.

The RRS system was introduced in January 2007 and was fully operational by April 2007. The system required ward nurses to systematically observe and record patient’s vital signs at least three times daily. If nurses felt worried about a patient’s condition or observed abnormal vital indicators, then they were instructed to immediately call the ward physician. Abnormal vital indicators included respiratory rate <8 or >30 per minute, oxygen saturation <90%, systolic blood pressure <90 or >200 mm Hg, heart rate <40 or >130 per minute, and a decrease of two points in the eye, motor, and verbal (EMV) score [13]. Once called, the ward physician was required to evaluate the patient at bedside within 10 minutes and to immediately call the medical emergency team (MET) if the patient’s condition was serious or if the patient did not stabilise after an initial intervention. The MET included a critical care physician and a critical care nurse. If the ward physician could not see the patient within 10 minutes, nurses were instructed to activate the MET directly.

Data collection

Eligible patients were approached on the surgical ward before surgery, or in the case of emergency surgery, immediately after surgery. The research assistant explained the study objectives orally and in writing. Participating patients were asked to fill in the EQ-5D and EQ-VAS based on their condition the day before hospital admission. Patients were also asked to fill in the questionnaires at 3 and 6 months after surgery. Non-responders were contacted twice. Additional clinical variables were retrieved from the hospital’s electronic databases.

Statistical analysis

Normally distributed data were parametrically tested with the independent Student’s t test, non-normally distributed data with the Mann–Whitney U test, and nominal data with the chi-square test. Differences in HRQOL outcomes in period 1 and 2 were tested with the analysis of covariance (ANCOVA). At Pre- surgery the fixed factors ‘gender’, ‘ASA-PS’ and the covariate ‘age at admission’ were used. At the 3- and 6-month follow-up, the covariates ‘EQ-5D pre-surgery’ or ‘EQ-VAS pre-surgery’ and ‘planned ICU LOS’ were also used. In addition, we compared HRQOL in period 1 and 2 in a subset of patients with unplanned ICU admissions. For statistical analysis, the statistical package for the social sciences (SPSS) version 17 was used. In our analysis a p < 0.05 was considered statistically significant.

Results

In period 1, 84% (437/518) of the screened patients were included in the study, while in period 2, 85% (466/549) of the screened patients were included (Figure 1). Table 1 shows the characteristics of the in- and excluded patients. Excluded patients were not significantly different from included patients regarding gender or age. However, the ASA-PS score of excluded patients was 0.3 points (p < 0.001) higher in both periods. Demographics for the final study group are shown in Table 2. Patients lost to follow up were significantly younger: 6 years (p = 0.05) in period 1, and 8 years (p ≤ 0.01) in period 2.

Figure 1

Overview of included surgical patients. RRS = rapid response system; before = before implementing the RRS; after = after implementing the RRS; EQ-5D = Euroqol 5 dimensions; EQ VAS = Euroqol visual analogical scale; pts = patients. *Not all patients filled in the VAS score.

Table 1 Characteristics of excluded and included patients

Table 2 Characteristics of included patients

Effects of RRS implementation on quality of life

Figure 2 shows the results of RRS implementation on the quality of life. In both period 1 and 2 patients’ HRQOL was improved at 3 and 6 months following surgery. When we compared period 1 and 2, there were no statistical differences in either the EQ-5D index (0.72 versus 0.73, p = 0.54 at 3 months following surgery and 0.70 versus 0.72, p = 0.29 at 6 months following surgery) or the EQ-VAS scores (67 versus 65, p = 0.28 at 3 months following surgery and 67 versus 67, p = 0.80 at 6 months following surgery). This was also true for patients with an unplanned ICU admission. HRQOL, however, decreased at 3 months and was near pre-surgery level at 6 months following surgery. In this subset of patients the EQ-5D index was 0.61 versus 0.61, p = 0.99 at 3 months following surgery and 0.62 versus 0.66, p = 0.79 at 6 months following surgery while the EQ-VAS was 69 versus 70, p = 0.91 at 3 months following surgery and 71 versus 65, p = 0.56 at 6 months following surgery.

Figure 2

EQ-5D and VAS mean scores of surgical patients. Grey: period 1 = before implementing the rapid response system; black: period 2 = after implementing the rapid response system; 3 m. = 3months after surgery, 6m. = 6 months after surgery; EQ-5D = Euroqol 5, scale -0.33 - 1; VAS = visual analogue scale 0–100; RRS = rapid response system. Pre-surgery: fixed factors: gender, American Society of Anaesthesiologists’ physical status (ASA-PS), covariates: age at admission. Following surgery: fixed factors: gender, ASA-PS, covariates: age at admission, planned intensive care length of stay not because of a serious adverse event, EQ-5D dimension pre-surgery. *Not all patients filled in the VAS score.

EQ-5D dimensions

Results of the EQ-5D dimensions are shown in Table 3. In both period 1 and 2, patients reported fewer problems on the EQ dimensions ‘pain/discomfort’ and ‘anxiety/depression’ but more problems with ‘mobility’, ‘self-care’ and ‘usual activities’ at 3 and 6 months following surgery. In period 2 at 6 months, however, patients experienced slightly less deterioration regarding ‘mobility’ and ‘usual activities’ than they did in period 1 (mean difference between period 1 and 2 was 0.08, p = 0.03 for ‘mobility’ and 0.09, p = 0.04 for ‘usual activities’ on a 3 point scale).

Table 3 EQ-5D dimensions of surgical patients

Variables related with HRQOL outcomes

Table 4 shows the results for variables related to HRQOL outcomes. The pre-surgery EQ-5D index and ASA scores were significantly related to the EQ-5D index at 3 and 6 months following surgery (p ≤ 0.01 for EQ-5D and ASA at 3 months, p ≤ 0.01 for EQ-5D and p = 0.02 for ASA at 6 months). Gender, age and LOS of planned ICU admissions were not significantly related with EQ-5D index scores at 3 and 6 months following surgery.

Table 4 Variables related with health-related quality of life outcomes

Discussion

We conclude that the implementation of an RRS does not result in a clinically relevant improvement of HRQOL as measured with the EQ-5D and EQ-VAS in patients at 3 and 6 months following major surgery. It is unlikely that the slightly less deterioration in period 2 regarding ‘mobility’ and ‘usual activities’ dimensions, which may enable patients to more actively participate in social life, can be attributed to the implementation of the RRS.

The lack of effect on HRQOL may partly be explained by the fact that our RRS was not fully mature. In particular, the MET was not consulted in 50% prior to an SAE, even though abnormal vital indicators were observed [7]. Furthermore, the percentage of included patients who experienced one or more unplanned ICU admissions in period 1 and 2 was considerably low: 2.8% and 4.5%, respectively. The number of unplanned ICU admissions could, therefore, not substantially influence the mean HRQOL scores.

Comparison of HRQOL in the subset of patients with an unplanned ICU admission also showed no improvement after RRS implementation. These results are in line with our original study on the effects of an RRS on SAEs where we showed no decrease in the Acute Physiology and Chronic Health Evaluation (APACHE) II score at admission to the ICU after RRS implementation, indicating that patients were not referred to the ICU in an earlier stage of illness [7].

Our choice to use the EQ-5D as a measure for HRQOL could be questioned, as Brazier et al. (2004) showed a ceiling effect in the EQ-5D in comparison with the short form 6 dimensions (SF-6D) instrument. This ceiling effect may partially explain the lack of effect in our study because ‘no problems’ were reported in both periods in 25% to 50% of the EQ dimensions at pre-surgery, making improvement on those scores impossible. However, Brazier et al. (2004) also showed that the SF-6D, compared to the EQ-5D, differentiates less accurately when patients experience severe health problems, which was the case for a considerable part of our study population [14]. Moreover, a comparative review of seven generic HRQOL instruments shows no uniformly ‘best’ or ‘worst’ performing instrument. The choice of the instrument should be driven by the purpose of the measurement [15]. We used the EQ-5D because the instrument is short and user friendly, which was important since a part of our study population was severely ill. The EQ-5D takes respondents about 7 minutes to complete. We believe, however, that measuring HRQOL with another generic instrument would have yielded similar results.

The most important explanation for our lack of effect is most likely that other factors had a larger influence on HRQOL than merely the implementation of an RRS. We found that pre-surgery HRQOL and ASA-PS were strongly associated with HRQOL following surgery. Similarly, another study showed that HRQOL strongly associates with diagnostic categories [16]. Associations between HRQOL and these factors may have abated the influence of the RRS implementation on HRQOL. Therefore, the question arises if HRQOL is an adequate measure to assess the influence of an RRS.

EQ-5D and EQ-VAS outcomes showed slightly different patterns. Even though the EQ-VAS scores are predictable from the EQ-5D scores, other group variables also contribute to the EQ-VAS score, such as psychological disposition, age, education and clinically-important distress. These variables explain the differences between the EQ-5D and EQ-VAS outcomes [17].

To our knowledge, this is the first study evaluating the influence of an RRS on HRQOL in patients 3 and 6 months following surgery. We conducted a cohort study before and after RRS implementation. Confounders other than the implementation of an RRS may have biased the results. However, no major changes in surgical procedures or ward policy were implemented during the study period. The pre-surgery HRQOL enabled us to study the impact of pre-admission HRQOL scores on the HRQOL at 3 and 6 months following surgery, which we considered one of the study’s strengths. One may argue that the 6-month follow-up period was too short to evaluate HRQOL improvement in surgical patients. However, improvement was most obvious during the first three months, whereas during the last three months only a slight improvement was observed. Furthermore, a longer observation period usually results in the occurrence of other confounders.

Finally, this study was conducted in one hospital and included only patients with major surgery. Results may therefore be different in other settings and with other study populations.

Conclusions

Implementation of an RRS did not convincingly affect HRQOL outcomes. We question if HRQOL is an adequate measure to assess the influence of an RRS. Pre-surgery HRQOL and ASA-PS scores were strongly associated with HRQOL outcomes following surgery and may have abated the influence of the RRS implementation.