Development and validation of the Efficacy Safety Score (ESS), a novel tool for postoperative patient management

Erlend Skraastad, Johan Ræder, Vegard Dahl, Lars J. Bjertnæs, Vladimir Kuklin

Several reports have shown that postoperative monitoring of general safety and quality issues, including pain treatment, after discharge from recovery is often non-systematic and inadequate. We suggest a new score with assessment of key recovery parameters, as a supportive tool for postoperative care and a call-out algorithm for need of extra help. The aim of this investigation was to validate the score. After suggesting a prototype score from a pilot study in 182 postoperative patients, we performed a Delphi process by using international experts to create consensus on the final score contents and called the revised tool the Efficacy Safety Score (ESS). Then, we performed a prospective observational study with the ESS throughout the first 24 h postoperatively in 207 surgical in-patients. We compared ESS with Modified Early Warning Systems (MEWS), and postoperative journal information. We subsequently validated ESS by addressing recognized quality criteria for measurement of health status questionnaires. A call-out value of ESS ≥10 correlated with MEWS > 0 values and journal information about postoperative concerns with a sensitivity of 94% and 92%, respectively. All serious safety issues were identified with the ESS ≥ 10, and a higher number of quality issues were identified than with routine care or MEWS. We obtained positive ratings for six out of seven tested criteria of questionnaire quality; one criterion had an indeterminate rating. ESS fulfils suggested criteria for score quality validation and reflects the patient's postoperative status adequately and with high sensitivity. Further clinical trials are warranted to evaluate the usefulness of ESS as a simple tool for assessment of the postoperative safety and quality of patients.