Computers in emergency medicineThe Soterion Rapid Triage System: Evaluation of inter-rater reliability and validity
Introduction
Triage, or the “sorting” of patients, is a critical function for the timely delivery of emergency health care and the appropriate allocation of medical resources. Without well-defined guidelines, triage is dependent upon the skill, education and experience of the individual performing triage. Australia, Canada and England have each adopted national five-level triage acuity systems due to the recognized need for a more uniform triage tool and the demonstration of greater inter-rater reliability with a five-level system as compared to previous three- and four-level systems (1, 2, 3, 4, 5, 6, 7).
The need for a uniform triage tool has been underscored by the American College of Emergency Physicians and the Emergency Nurses Association’s recent approval of resolutions for the development of a national five-level triage acuity system for the United States (8, 9). A national triage acuity system may provide the data necessary for determining whether a system provides timely and safe access to emergency care, allows for greater comparison of case mix between hospitals, and promotes the development of health care policy pertaining to the allocation of medical resources stemming from the emergency department care of patients.
The Soterion Rapid Triage System (SRTS) is a new, computerized, algorithm-driven five-level triage acuity system. The use of algorithms has the potential benefit of minimizing the variability of the triage decision-making process. The computerized nature of the system allows for the electronic capture and retrieval of all data acquired during the triage process, facilitating future use of this information in a national triage database.
The purpose of this study was to determine whether the SRTS possesses a high degree of inter-rater reliability and whether the system successfully stratifies patients of different acuity based on several acuity outcome measures.
Section snippets
Methods
The SRTS is a stand-alone, web-based computer application developed using Microsoft Visual Studio.NET Professional Version software. The database for the SRTS was created using the relational database management and analysis system SQL Server 2000. Authorized access to the software application was accomplished through a local intra-net web server using Internet Explorer version 6.0.
The SRTS is based on a five-level triage acuity scale. Level 1 conditions are defined as life- or limb-threatening
Characteristics of the Study Subjects
During the time period between April 12, 2003 and December 12, 2003, there were a total of 38,763 ED patient visits. Of those, 2587 (7%) were non-ambulatory ambulance patients and 1989 (5%) were deemed ill enough to warrant being brought back immediately without undergoing triage by the SRTS. There were 337 patients (< 1%) who left the ED without being seen. The remaining 33,850 patients (87%) were triaged by the SRTS.
The characteristics of the study subjects triaged by the SRTS are shown in
Discussion
In 1999, the American College of Emergency Physician’s (ACEP’s) Subcommittee on the National Triage Scale published the informational paper, “A Uniform Triage Scale in Emergency Medicine” (13). This document provided background on the history of triage, a comparison of existing standardized triage scales, the characteristics of an ideal triage scale, and the benefits to having a national standardized triage scale. The authors recommended that the ideal triage scale should possess the
Limitations
Our study excluded non-ambulatory ambulance patients as well as those patients that the triage nurse felt appeared ill enough that they needed to be brought back immediately without undergoing triage by the SRTS. These two groups represented 12% of the total ED visits, of whom 47% (2134/4576) were admitted. If patients in these two groups underwent triage by the SRTS and were included in the study, the percentage of patients in the higher acuity levels would have been larger and the differences
Conclusions
We have demonstrated that the Soterion Rapid Triage System possesses high inter-rater reliability and validity. In addition, the system’s functionality, effectiveness in clinical practice, and the availability of the system’s electronically archived data are characteristics beneficial to the development of a national standardized five-level triage acuity system.
Acknowledgments—
Dr. Maningas, Mr. Hime, and Dr. McMurry are partners of Soterion L.L.C., which developed the software application. Dr. Maningas is the inventor to whom Patent No. 6,786,406 B1 has been granted.
References (27)
- et al.
Triagelimitations in predicting need for emergent care and hospital admission
Ann Emerg Med
(1996) - et al.
Disagreement among health care professionals about the urgent care needs of emergency department patients
Ann Emerg Med
(1996) - et al.
Inconsistency of emergency department triage
Ann Emerg Med
(1998) - et al.
Reliability of the Canadian emergency department triage and acuity scaleinterpreter agreement
Ann Emerg Med
(1999) - et al.
Computerized algorithm-directed triage in the emergency department
Ann Emerg Med
(1989) - et al.
The Frontlines of Medicine Projecta proposal for the standardized communication of emergency department data for public health uses including syndromic surveillance for biological and chemical terrorism
Ann Emerg Med
(2002) - et al.
Prospective identification and triage of non-emergency patients out of an emergency departmenta 5 year study
Ann Emerg Med
(1995) A survey of emergency department triage in 185 hospitalsphysical facilities, fast-track systems, patient-classification systems, waiting times, and qualification, training, and skills of triage personnel
J Emerg Nurs
(1991)- Australasian College for Emergency Medicine. Policy document: The Australasian triage scale. 2000. Available at:...
- Beveridge R, Clarke B, Janes L, et al. Implementation guidelines for the Canadian Emergency Department Triage and...
Emergency triage
Cited by (28)
Validity of ED: Addressing heterogeneous definitions of over-triage and under-triage
2017, American Journal of Emergency MedicinePerformance of the canadian triage and acuity scale for children: A multicenter database study
2013, Annals of Emergency MedicineThe Canadian Triage and Acuity Scale for children: A prospective multicenter evaluation
2012, Annals of Emergency MedicineCitation Excerpt :Also, nurses are invited to receive formal training provided by a certified Canadian Triage and Acuity Scale instructor before performing triage with the scale. Despite recognition of the importance of appropriate validation and reliability testing of triage tools,15-17 there is paucity of prospective studies assessing validity and reliability of triage tools in children.18-32 Most studies were performed at a single center and using written scenarios, which may inadequately incorporate the clinical appearance of the patient.18-32
Managing patient flow with triage streaming to identify patients for Dutch emergency nurse practitioners
2012, International Emergency NursingCitation Excerpt :To evaluate the validity of triage systems, researchers have used different proxy reference standards for prognosis. Amongst others, these include: length of stay (LOS), admission rate, intensive care admission rate, hospital charges, mortality, resource use, and a combination of vital signs at presentation, potentially life threatening conditions, diagnostic resources, therapeutic interventions and follow up, (Cooke and Jinks, 1999; Wuerz et al., 2000; Maningas et al., 2006; Worster et al., 2007; van Veen et al., 2008; Travers et al., 2009). Since resource use and admission rates are associated with the complexity and severity of a patient’s status, these parameters have been used as validity criteria in many studies (Wuerz et al., 2000; Tanabe et al., 2004; Roukema et al., 2006; Taboulet et al., 2009).
The Use of and Satisfaction with the Emergency Severity Index
2012, Journal of Emergency NursingCalculating kappas from adjusted data improved the comparability of the reliability of triage systems: A comparative study
2010, Journal of Clinical Epidemiology
Computers in Emergency Medicine is coordinated by James Killeen, md, of the University of California San Diego Medical Center, San Diego, California