- Open Access
- Open Peer Review
Calculating trauma triage precision: effects of different definitions of major trauma
Journal of Trauma Management & Outcomes volume 6, Article number: 9 (2012)
Triage is the process of classifying patients according to injury severity and determining the priority for further treatment. Although the term “major trauma” represents the reference against which over- and undertriage rates are calculated, its definition is inconsistent in the current literature. This study aimed to investigate the effects of different definitions of major trauma on the calculation of perceived over- and undertriage rates in a Norwegian trauma cohort.
We performed a retrospective analysis of patients included in the trauma registry of a primary, referral trauma centre. Two “traditional” definitions were developed based on anatomical injury severity scores (ISS >15 and NISS >15), one “extended” definition was based on outcome (30-day mortality) and mechanism of injury (proximal penetrating injury), one ”extensive” definition was based on the “extended” definition and on ICU resource consumption (admitted to the ICU for >2 days and/or transferred intubated out of the hospital in ≤2 days), and an additional four definitions were based on combinations of the first four.
There were no significant differences in the perceived under- and overtriage rates between the two “traditional” definitions (NISS >15 and ISS >15). Adding “extended” and “extensive” to the “traditional” definitions also did not significantly alter perceived under- and overtriage. Defining major trauma only in terms of the mechanism of injury and mortality, with or without ICU resource consumption (the “extended” and “extensive” groups), drastically increased the perceived overtriage rates.
Although the proportion of patients who were defined as having sustained major trauma increased when NISS-based definitions were substituted for ISS-based definitions, the outcomes of the triage precision calculations did not differ significantly between the two scales. Additionally, expanding the purely anatomic definition of major trauma by including proximal penetrating injury, 30-day mortality, ICU LOS greater than 2 days and transferred intubated out of the hospital at ≤2 days did not significantly influence the perceived triage precision. We recommend that triage precision calculations should include anatomical injury scaling according to NISS. To further enhance comparability of trauma triage calculations, researchers should establish a consensus on a uniform definition of major trauma.
Early appreciation of major trauma enables emergency medical service (EMS) providers to match the available resources to each victim’s needs. Triage is the process of classifying patients according to injury severity and determining the priority for further treatment [1, 2]. Field triage has become increasingly important, as regionalised trauma care with dedicated trauma teams has been shown to improve patient outcome [3–5]. Nevertheless, some mistriage is unavoidable, as field triage is performed close to the time of injury, with limited diagnostic resources in a multifarious pre-hospital environment. If major trauma victims are undertriaged and therefore denied access to high-resource resuscitation, avoidable negative outcomes may ensue [1, 6]. Conversely, overtriage may cause minor trauma victims to be unnecessarily transferred to dedicated trauma care facilities, thereby consuming scarce financial and human resources. Overtriage thus decreases the available resources for other patients with greater needs [7, 8].
The rates of over- and undertriage are considered to be trauma system quality indicators . Although these data are debated, the American College of Surgeons - Committee on Trauma (ACS-COT) states that an undertriage rate of 5–10% is unavoidable, and most systems are associated with an overtriage rate of 30–50% [2, 9].
The definition of major trauma provides the reference standard against which the over- and undertriage rates are calculated . There is a 40-year tradition of grading the severity of individual injuries using the Abbreviated Injury Scale (AIS), and based on this scale, the Injury Severity Score (ISS) can be calculated as the sum of the squares of the highest AIS code in each of the three most severely injured ISS body regions [11, 12]. The US Major Trauma Outcome Study (MTOS) found that an ISS >15 was associated with a mortality risk of at least 10% and was related to a distinct increase in mortality . Following this study, many subsequent triage studies dichotomised study populations into “major trauma” patients, who were defined as having an ISS >15, and “minor and moderate trauma” patients (ISS ≤15), and they presented two-by-two tables describing the diagnostic accuracy of triage algorithms [10, 14]. Several limitations of the ISS have been highlighted [15, 16], providing a basis for the New Injury Severity Score (NISS) . The NISS is a simple modification of the ISS and is calculated from the three most severe injuries regardless of body region. The NISS has been considered to be more predictive of survival, especially in patients suffering from multiple head injuries or penetrating trauma [17–20]. Although the ISS is still the dominant scale in papers published on triage precision, an NISS >15 is recommended as an inclusion criterion in the Utstein template for uniform reporting of data following major trauma .
Mortality and morbidity are the principal outcomes after trauma, and their relevance remains undisputed [22, 23]. To define major trauma, several studies have therefore combined anatomic injury scales, such as the ISS or NISS, with variables associated with mortality, morbidity, type of injury, or resource consumption [24–26]. The rationale is an understanding of major trauma as more complex than anatomic injury alone. The compound definitions in these studies often include process-mapping variables, making the definitions more system-specific and thereby reducing the external validity and reproducibility.
Butcher et al. reported, in their review on the definitions of “polytrauma”, that there was no consensus on the term . This lack of consensus was corroborated by a recent systematic review of pre-hospital prognostic trauma models , in which the authors also questioned the external validity of published studies on triage precision and emphasised the challenges inherent in the comparison of triage systems.
To compare data sets, assess external validity and facilitate multicentre trials, the impact of different definitions of major trauma on quality assessments should be clarified. The aim of the present study was to investigate how various definitions of major trauma influence the calculation of under- and overtriage in a trauma cohort.
Stavanger University Hospital (SUH) is a 630-bed hospital and is the primary trauma centre for a mixed rural/urban population of approximately 330,000 inhabitants. It is also the trauma referral centre for all 440,000 people living in Rogaland County in southwestern Norway. SUH admits approximately 140 adult and paediatric patients annually with NISS scores >15 and treats approximately 3,400 patients per year with minor injuries . During the study period, the hospital practised the informal activation of a one-tiered, 13-personnel, large, multidisciplinary trauma team. Pre-hospital emergency care in the catchment area was provided by on call general practitioners, ground ambulance units staffed with paramedics, and anaesthesiologist-staffed rapid response cars and helicopters.
Since 2004, a hospital-based trauma registry has been fully operational. An Association for the Advancement of Automotive Medicine certified AIS coder (a registered nurse) manually searches the hospital administrative data system for eligible patients and annually codes the data from approximately 360 individuals (see Table 1 for the trauma registry inclusion and exclusion criteria).
We performed a retrospective analysis of the SUH trauma registry data and included consecutive patients who were admitted to SUH between January 1, 2004, and December 31, 2008, and had been assigned one or more AIS codes (AIS 98; Abbreviated Injury Scale, 1990 Revision, Update 98). Inter-hospital transfers to SUH and patients transported by non-healthcare personnel were excluded, as they were not subject to SUH field triage practices. Survival status 30 days after injury was obtained from the Norwegian Population Registry and from patient records .
The Regional Committee for Medical and Health Research Ethics deemed their formal approval unnecessary (2009/228-CAG). The Norwegian Social Science Data Services approved our access to anonymous data from relevant patients in the trauma registry (20840 KS/LR).
Definitions of major trauma
We constructed eight different definitions of major trauma (Table 2). Both ISS >15 and NISS >15 have been recommended as definitions of major trauma, and therefore two of the definitions were based solely on these anatomic injury severity scores.
It has been argued that trauma resulting in patient death must be considered as major [24–26]. Further, penetrating trauma to vital body structures results in rapid deterioration and death if not treated urgently, and this provides a rationale for defining proximal penetrating injury as major trauma. Therefore, one “extended” definition based on death within 30 days and/or proximal penetrating injury was added. Additionally, one “extensive” definition based on the “extended” definition combined with high resource consumption was constructed. Based on available variables in our registry, we defined high resource consumption as intensive care of more than two days. As some SUH patients are transferred to other hospitals during ongoing intensive care due to need for specialised care or limited ICU capacity, both "admitted to the ICU for >2 days" and "transferred intubated out of the hospital at ≤2 days" were included in this definition. Four additional definitions were constructed from combinations of the original definitions (Table 2). Perceived triage precision was calculated according to each of these eight separate definitions of major trauma.
The calculation of perceived triage precision was based on the assumption that all of the patients suffering from major trauma, according to the above definitions, should have access to the trauma team upon hospital admission. Undertriage rate was defined as the proportion of patients who were not triaged to a trauma team despite having a major trauma (c/(a + c) in Table 3), i.e., the complement of the sensitivity (1-sensitivity) . Overtriage rate was defined as the proportion of patients without major trauma among those who were triaged to a trauma team (b/(a + b) in Table 3), i.e., the complement of the positive predictive value (1-PPV), where PPV denotes the probability that a patient suffers from a major trauma when the trauma team is activated. The 95% confidence intervals (95% CI) for over- and undertriage were calculated as , where p is the proportion of patients that had been over- or undertriaged and n is the total number of patients who were triaged by a trauma team or had experienced major trauma (a + b and a + c in Table 3). Significant differences were defined as non-overlapping 95% confidence intervals.
During the study period, of the 1 481 patients who were coded in the SUH trauma registry, 1 384 fulfilled our eligibility criteria (cf. Table 1 and Figure 1). Among these included patients, 1 315 (95%) suffered blunt injuries, and 69 (5%) suffered penetrating injuries. The median age was 31 years old (IQR 19–51), and 997 (72%) of the patients were male. The median ISS score was 10 (IQR 5–19), the median NISS score was 12 (IQR 5–24), and 80 patients died within 30 days (mortality 5.8%). Figure 1 shows the number of patients falling within the combinations of the various definitions and highlights the proportion of patients who were met by a trauma team. There was a significant increase in the percentage of patients who were defined as having sustained a major trauma when the NISS-based definitions were compared to their ISS-based counterparts (p < 0.01 for all comparisons). Table 4 shows the proportions of the included patients having sustained a major trauma according to the various definitions, with the corresponding values for over- and undertriage (see also Figure 2).
Triage quality assessment
There were no significant differences between perceived under- and overtriage using NISS >15 or ISS >15, NISS “extended” or ISS “extended”, or NISS “extensive” or ISS “extensive” as definitions of major trauma, except for the ISS Traditional definition (i.e., ISS >15), which had higher perceived overtriage than NISS “extended” and NISS “extensive” (Table 4 and Figure 2). The major trauma definitions without anatomic criteria, i.e., “extended” (based on type of injury and 30-day survival only) or “extensive” (“extended” combined with ICU LOS >2 days or transferred out intubated within 2 days), resulted in significantly lower perceived undertriage than the NISS-based definitions and significantly higher perceived overtriage than any other definition (Table 4 and Figure 2).
The definition of major trauma is commonly based on anatomic injury alone, and both ISS >15 and NISS >15 are recommended cut-off values. Our study revealed no significant differences in the perceived under- and overtriage rates between NISS >15 or ISS >15 as the definitions for major trauma. This finding suggests that the outcomes of triage precision calculations may be comparable between trauma systems, regardless of the use of NISS >15 or ISS >15 as definitions. In contrast, the NISS will be equal to or greater than the ISS for any given patient, depending on the injuries sustained. Accordingly, utilising NISS >15 instead of ISS >15 will result in an increased number of included patients in most trauma populations (cf. Table 4 and Figure 1). In the present population, we found a 24% relative increase in the number of patients who were defined as having sustained a major trauma when NISS >15 was applied, compared to ISS >15 (from 470 to 585; see Table 4). This increase might be interpreted as improved sensitivity without loss of specificity, implying that NISS >15 is superior to ISS >15 as a definition of major trauma [18, 29]. However, this difference in sensitivity caused by the use of a different injury scale obviously makes the results less comparable. It has therefore been argued that a compound definition of major trauma is necessary . Factors other than anatomic injury influence outcome, and the inclusion of the mechanism of injury and/or outcome variables, such as mortality, in the definition of major trauma seems relevant. The Utstein template recommends 30-day mortality, Glasgow Outcome Scale (GOS), discharge destination, and hospital length of stay (LOS) to be reported as outcome measurements after trauma . In an attempt to capture the complexity of trauma, several studies have included such outcomes in their definitions of major trauma [6, 25, 30–32]. In our cohort, expanding the purely anatomic definition of major trauma by including proximal penetrating injury, 30-day mortality, ICU LOS greater than 2 days and transferred intubated out of the hospital at ≤2 days did not significantly influence the perceived triage precision.
Defining major trauma only in terms of the mechanism of injury, death within 30 days and resource consumption, without including anatomic injury scaling, drastically reduced the number of cases defined as major trauma. The proportions of perceived major trauma patients in the study population were reduced from 34.0% and 42.3% with ISS >15 and NISS >15, respectively, to 9.5% in the “extended” group and 22.6% in the “extensive” group (Table 4), thereby putting into serious doubt the usefulness of these definitions for triage precision calculations.
The present study presents a fairly small amount of data from a single centre, and its findings are dependent on the SUH trauma population’s characteristics, including a very low number of penetrating injuries. The findings may also be susceptible to bias caused by idiosyncrasies of the informal trauma triage system at SUH. Thus, applicability to other trauma populations could be limited. Furthermore, the retrospective nature of this study restricted the data to variables that were already defined and coded in the institutional trauma registry.
The definition of major trauma provides a reference standard when calculating the precision of trauma triage. However, the definitions are inconsistent in the current literature. In our cohort, although the proportion of patients who were defined as having sustained major trauma increased when NISS-based definitions were substituted for ISS-based definitions, the outcomes of the triage precision calculations did not differ significantly between the two scales. Additionally, adding the mechanism of injury and outcome variables did not significantly influence the triage precision calculations. Based on our findings we recommend that triage precision calculations should include anatomical injury scaling according to NISS. To further enhance comparability of trauma triage calculations, researchers should establish a consensus on a uniform definition of major trauma.
Sasser S, Varghese M, Kellermann A, Lormand J: Prehospital trauma care systems. 2005, World Health Organization, Geneva
Resources for optimal care of the injured patient: 2006. 2006, American College of Surgeons, Chicago
Davenport RA, Tai N, West A, Bouamra O, Aylwin C, Woodford M, McGinley A, Lecky F, Walsh MS, Brohi K: A major trauma centre is a specialty hospital not a hospital of specialties. Br J Surg. 2010, 97: 109-117.
MacKenzie EJ, Rivara FP, Jurkovich GJ, Nathens AB, Frey KP, Egleston BL, Salkever DS, Scharfstein DO: A national evaluation of the effect of trauma-center care on mortality. N Engl J Med. 2006, 354: 366-378. 10.1056/NEJMsa052049.
Petrie D, Lane P, Stewart TC: An evaluation of patient outcomes comparing trauma team activated versus trauma team not activated using TRISS analysis. Trauma and Injury Severity Score. J Trauma. 1996, 41: 870-873. 10.1097/00005373-199611000-00020. discussion 873–875
Rehn M, Eken T, Kruger AJ, Steen PA, Skaga NO, Lossius HM: Precision of field triage in patients brought to a trauma centre after introducing trauma team activation guidelines. Scand J Trauma Resusc Emerg Med. 2009, 17: 1-10.1186/1757-7241-17-1.
Fishman PE, Shofer FS, Robey JL, Zogby KE, Reilly PM, Branas CC, Pines JM, Hollander JE: The impact of trauma activations on the care of emergency department patients with potential acute coronary syndromes. Ann Emerg Med. 2006, 48: 347-353. 10.1016/j.annemergmed.2006.02.021.
Boutros F, Redelmeier DA: Effects of trauma cases on the care of patients who have chest pain in an emergency department. J Trauma. 2000, 48: 649-653. 10.1097/00005373-200004000-00011.
Mohan D, Rosengart MR, Farris C, Cohen E, Angus DC, Barnato AE: Assessing the feasibility of the American College of Surgeons' benchmarks for the triage of trauma patients. Arch Surg. 2011, 146: 786-792. 10.1001/archsurg.2011.43.
Lerner EB: Studies evaluating current field triage: 1966–2005. Prehosp Emerg Care. 2006, 10: 303-306. 10.1080/10903120600723921.
CoMAoA S: Rating the severity of tissue damage. I. The abbreviated scale. Jama. 1971, 215: 277-280.
Baker SP, O'Neill B, Haddon W, Long WB: The injury severity score: a method for describing patients with multiple injuries and evaluating emergency care. J Trauma. 1974, 14: 187-196. 10.1097/00005373-197403000-00001.
Champion HR, Copes WS, Sacco WJ, Lawnick MM, Keast SL, Bain LW, Flanagan ME, Frey CF: The Major Trauma Outcome Study: establishing national norms for trauma care. J Trauma. 1990, 30: 1356-1365. 10.1097/00005373-199011000-00008.
Sasser SM, Hunt RC, Sullivent EE, Wald MM, Mitchko J, Jurkovich GJ, Henry MC, Salomone JP, Wang SC, Galli RL: Guidelines for field triage of injured patients. Recommendations of the National Expert Panel on Field Triage. MMWR Recomm Rep. 2009, 58 (RR-1): 1-35. Recommendations & Reports
Copes WS, Champion HR, Sacco WJ, Lawnick MM, Keast SL, Bain LW: The Injury Severity Score revisited. J Trauma. 1988, 28: 69-77. 10.1097/00005373-198801000-00010.
Osler T: Injury severity scoring: perspectives in development and future directions. Am J Surg. 1993, 165 (2A Suppl): 43 S-51S.
Osler T, Baker SP, Long W: A modification of the injury severity score that both improves accuracy and simplifies scoring. J Trauma. 1997, 43: 922-925. 10.1097/00005373-199712000-00009. discussion 925–926
Lavoie A, Moore L, LeSage N, Liberman M, Sampalis JS: The New Injury Severity Score: a more accurate predictor of in-hospital mortality than the Injury Severity Score. J Trauma. 2004, 56: 1312-1320. 10.1097/01.TA.0000075342.36072.EF.
Sullivan T, Haider A, DiRusso SM, Nealon P, Shaukat A, Slim M: Prediction of mortality in pediatric trauma patients: new injury severity score outperforms injury severity score in the severely injured. J Trauma. 2003, 55: 1083-1087. 10.1097/01.TA.0000102175.58306.2A. discussion 1087–1088
Tay SY, Sloan EP, Zun L, Zaret P: Comparison of the New Injury Severity Score and the Injury Severity Score. J Trauma. 2004, 56: 162-164. 10.1097/01.TA.0000058311.67607.07.
Ringdal KG, Coats TJ, Lefering R, Di Bartolomeo S, Steen PA, Røise O, Handolin L, Lossius HM: The Utstein template for uniform reporting of data following major trauma: a joint revision by SCANTEM, TARN, DGU-TR and RITG. Scand J Trauma Resusc Emerg Med. 2008, 16: 7-10.1186/1757-7241-16-7.
Skaga NO, Eken T, Jones JM, Steen PA: Different definitions of patient outcome: consequences for performance analysis in trauma. Injury. 2008, 39: 612-622. 10.1016/j.injury.2007.11.426.
Jennett B, Bond M: Assessment of outcome after severe brain damage. Lancet. 1975, 1: 480-484.
Leach SR, Swor RA, Jackson RE, Fringer RC, Bonfiglio AX: Do outcome measures for trauma triage agree?. Prehosp Emerg Care. 2008, 12: 467-469. 10.1080/10903120802290836.
Lossius HM, Langhelle A, Pillgram-Larsen J, Lossius TA, Soreide E, Laake P, Steen PA: Efficiency of activation of the trauma team in a Norwegian trauma referral centre. Eur J Surg. 2000, 166: 760-764. 10.1080/110241500447371.
Rehn M, Lossius HM, Tjosevik KE, Vetrhus M, Ostebo O, Eken T: Efficacy of a two-tiered trauma team activation protocol in a Norwegian trauma centre. Br J Surg. 2012, 99: 199-208. 10.1002/bjs.7794.
Butcher N, Balogh ZJ: The definition of polytrauma: the need for international consensus. Injury. 2009, 40 (Suppl 4): S12-22.
Rehn M, Perel P, Blackhall K, Lossius HM: Prognostic models for the early care of trauma patients: a systematic review. Scand J Trauma Resusc Emerg Med. 2011, 19: 17-10.1186/1757-7241-19-17.
Balogh Z, Offner PJ, Moore EE, Biffl WL: NISS predicts postinjury multiple organ failure better than the ISS. J Trauma. 2000, 48: 624-627. 10.1097/00005373-200004000-00007. discussion 627–628
Davis T, Dinh M, Roncal S, Byrne C, Petchell J, Leonard E, Stack A: Prospective evaluation of a two-tiered trauma activation protocol in an Australian major trauma referral hospital. Injury. 2010, 41: 470-474. 10.1016/j.injury.2010.01.003.
Uleberg O, Vinjevoll OP, Eriksson U, Aadahl P, Skogvoll E: Overtriage in trauma - what are the causes?. Acta Anaesthesiol Scand. 2007, 51: 1178-1183.
Kouzminova N, Shatney C, Palm E, McCullough M, Sherck J: The efficacy of a two-tiered trauma activation system at a level I trauma center. J Trauma. 2009, 67: 829-833. 10.1097/TA.0b013e3181b57b6d.
The authors are deeply grateful to the members of the Norwegian Air Ambulance Foundation for their continued economic support.
The authors declare that they have no conflicts of interests regarding this study.
HML and MR conceived and planned the study. TE designed and built the SUH trauma registry, KET included and coded all of the patients, KET and MR extracted the data, and TE performed the analyses. All of the authors participated in the drafting and completion of the manuscript. All authors read and approved the final manuscript.