|Year : 2020 | Volume
| Issue : 2 | Page : 81-87
Variability of radiological grading of blunt cerebrovascular injuries in trauma patients
Aimee K LaRiccia1, Timothy W Wolff2, David J Magee3, Roocha Patel3, David W Hoenninger3, M Shay Oxs'Mara4, Urmil B Pandya4, Joshua H Hill4, Thanh V Nguyen4, M Chance Spalding4
1 Division of Trauma and Acute Care Surgery, Ohio Health Grant Medical Center; Department of Surgery, Ohio Health Doctors Hospital; Ohio University Heritage College of Osteopathic Medicine, Athens, OH, USA
2 Division of Trauma and Acute Care Surgery, Ohio Health Grant Medical Center; Department of Surgery, Ohio Health Doctors Hospital, 3Ohio University Heritage College of Osteopathic Medicine, Athens, OH, USA
3 Columbus Radiology, Columbus, OH, USA
4 Division of Trauma and Acute Care Surgery, Ohio Health Grant Medical Center; Ohio University Heritage College of Osteopathic Medicine, Athens, OH, USA
|Date of Submission||02-Dec-2019|
|Date of Acceptance||13-Feb-2020|
|Date of Web Publication||8-Jun-2020|
Dr. Aimee K LaRiccia
Division of Trauma and Acute Care Surgery, Grant Medical Center, 111 South Grant Avenue, Columbus, OH 43215
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Context: Blunt cerebrovascular injury (BCVI) occurs in 1%–2% of all blunt trauma patients. Computed tomographic angiography of the neck (CTAn) is commonly used for the diagnosis and grading of BCVIs. Grade of injury dictates treatment, and there remains a lack in understanding the inter-reader reliability of these interpretations.
Aims: The aim of this study is to determine the extent of variability in BCVIs among specialized neuroradiologist interpretation of CTAn.
Settings and Design: Retrospective review of trauma patients admitted to a level one trauma center with a BCVI from January 2012 to December 2017. Patients were randomly assigned for CTAn re-evaluation by two of three blinded, neuroradiologists.
Statistical Analysis Used: The variability in BCVI grades was measured using the coefficient of unalikeability (u), and inter-reader reliability was calculated using weighted Cohen's kappa (k).
Results: Two hundred and twenty-eight BCVIs were analyzed with initial grades of 71 (31%) grade one, 74 (32%) grade two, 26 (11%) grade three, 57 (25%) grade four, and 0 grade five. Variability was present in 93 (41%) of all BCVIs. Grade one injuries had the lowest occurrence of total agreement (31%) followed by grade three (61%), grade two (63%), and grade four (92%). Total variability of grade interpretations (u = 100) occurred most frequently with grade three BCVIs (21%). Weighted Cohen's k calculations had a mean of 0.07, indicating poor reader agreement.
Conclusions: This novel study demonstrated the BCVI variability of radiological grade interpretation occurs in more than a third of patients. The reliability of CTAn interpretation of BCVI grades is not uniform, potentially leading to undertreatment and overtreatment.
Keywords: Blunt cerebrovascular injury, radiologic variability, trauma
|How to cite this article:|
LaRiccia AK, Wolff TW, Magee DJ, Patel R, Hoenninger DW, Oxs'Mara M S, Pandya UB, Hill JH, Nguyen TV, Spalding M C. Variability of radiological grading of blunt cerebrovascular injuries in trauma patients. Int J Crit Illn Inj Sci 2020;10:81-7
|How to cite this URL:|
LaRiccia AK, Wolff TW, Magee DJ, Patel R, Hoenninger DW, Oxs'Mara M S, Pandya UB, Hill JH, Nguyen TV, Spalding M C. Variability of radiological grading of blunt cerebrovascular injuries in trauma patients. Int J Crit Illn Inj Sci [serial online] 2020 [cited 2020 Jul 14];10:81-7. Available from: http://www.ijciis.org/text.asp?2020/10/2/81/286191
| Introduction|| |
Traumatic blunt cerebrovascular injuries (BCVIs) have a risk of stroke that increases as a function of injury grade., The pathophysiology of injury relates to endothelial damage-causing ischemic neurologic sequela from an embolic source; treatment ranges from antiplatelet therapy to anticoagulation based on grade and algorithm.,,,,
BCVI screening criteria include high-risk mechanisms and computed tomographic angiography of the neck (CTAn) is the preferred modality, although the reliability of grade is not understood [Table 1].,,,, We hypothesized there would be poor agreement among radiologists interpretation of BCVI grades; thus, changes in treatment recommendations could ensue.
|Table 1: Blunt cerebrovascular injury grading defined by angiographic findings|
Click here to view
| Methods|| |
This was a retrospective study of patients at an urban level one trauma center from January 1, 2012, to December 31, 2017. The study was approved by the OhioHealth institutional review board before initiation. All adult trauma patients that suffered a blunt mechanism and obtained a CTAn study were included in the analysis. Patients with no CTAn evaluation, who were prisoners, who were pregnant, or who were <16 years of age were excluded from the study. Data were obtained from a combination of electronic medical records and institutional trauma databases.
In all cases, CTAn was performed with multidetector scans (three total in hospital computed tomographys [CTs]: One Cannon 320 and two GE Medical Systems Optima CT64) with at least three detectors and a low radiation dose. CT acquisition parameters included 120 kV and 85–560 effective mAs (milliampere-seconds/pitch). Slice thickness is 0.625 mm on each machine with a reconstructed slice thickness of 2.0 mm. Maximum intensity projections were also performed in the sagittal and coronal planes. Isovue-370 intravenous contrast was the contrast used in all patients; 75 ml of contrast is injected and image capturing begins once the contrast reaches the carotid arteries for all CTA imaging that includes a CTAn.
Patients who met inclusion criteria and were originally diagnosed with a BCVI (all grades included) were divided randomly yet evenly into three BCVI groupings (A, B, C). Three neuroradiologists were assigned two of the groupings (AB, BC, and AC) so that each CTAn was independently interpreted by two neuroradiologists. All neuroradiologists were blinded to the original BCVI grades assigned at the initial clinical interpretation which was recorded from the medical record. The three neuroradiologists used only the patients' CTAn as patients did not receive conventional angiography or magnetic resonance angiography (MRA) in this study.
We compared the BCVI grades reported from the re-evaluations to both each other and the initial evaluation and analyzed the degree and frequency of grade variability. Given that BCVI grades are ordinal values, variability was quantified using the coefficient of unalikeability (u) discussed by Kader and Perry. The scale was adjusted from 0 to 1–100 where the lower the value, the more alike the data. The data were entered into an Excel spreadsheet (2013; Microsoft, Redmond, Washington), and u was calculated for each CTAn read that met inclusion criteria. Coefficient values of 1, 67, or 100 were calculated which represent no variability, some variability and total variability, respectively, for each BCVI grade. The frequency of each coefficient was reported as a percentage for all BCVIs lesions, isolated carotid vessel injuries, and isolated vertebral artery injuries.
Significant BCVI grade differences were defined as those that would directly change recommended clinical treatment based on institution treatment guidelines [Appendix A]. The significant grade differences were categorized as: (1) grade zero (no identified BCVI) versus any grade; (2) grades one or two versus grades three, four, or five; and (3) grades one, two, three versus grades 4 or 5. These significant grade differences were not analyzed in relation to specific vessel involvement (carotid vs. vertebral) or vertebral level, as neither specification would affect clinical management recommendations.
Inter-reader agreement (AB, BC, and AC) was calculated using weighted Cohen's kappa (k). We used value characterization as defined by Landis and Koch: <0 = no agreement, 0–0.20 = slight agreement, 0.21–0.40 = fair agreement, 0.41–0.60 = moderate agreement, 0.61–0.80 = substantial agreement, and 0.81–1.0 = near perfect agreement.,
| Results|| |
Our study started with 222 patients who originally met inclusion criteria. Five patients were excluded due to a combination of chronic lesions and the lack of additional radiologist interpretation. Therefore, we had a total of 228 BCVIs in 217 patients. The majority of the BCVIs diagnosed occurred after a motor vehicle collision (48.6%), followed by falls (26.4%) and assaults (6.0%). Other mechanisms included motorcycle collisions, pedestrian versus auto, ATV accidents, bicycle accidents, and encounters with animals. The majority of our patients were male (63.9%) and Caucasian (84.3%). The mean age was 49 years old ± 21 years. When examined by trauma acuity, 84.2% of patients had full trauma activation and 14.8% were trauma consultations. The initial grades consisted of 71 (31%) grade one, 74 (32%) grade two, 26 (11%) grade three, 57 (25%) grade four, and zero grade five. Seventy-six (33%) involved only the carotid vessels, 144 (63%) involved only the vertebral vessels, and eight (4%) involved both vessels.
Among all the patient groups (AB, BC, and AC), read variability was the highest among grade one lesions with agreement (u = 1) occurring an average of only 31.0% ± 10.5% [Figure 1]. Also for grade one injuries, incomplete agreement occurred an average of 55.7% ± 5.68% and complete disagreement an average of 13.3% ± 7.73%. Grade two and three lesions had similar variability with complete agreement occurring an average of 62.8% ± 8.79% and 61.4% ± 11.0%, respectively. Grade three lesions also had a complete disagreement (u = 100) an average of 20.5% ±12.8. Grade four lesions had the least amount of variability, with complete agreement occurring an average of 91.6% ± 4.50%. The average frequencies of BCVI grade variability for the carotid and vertebral injuries did not significantly differ with one exception [Figure 2]. There was a significant difference in complete agreement among grade 4 lesions (carotid 65.0% vs. vertebral 97.2%; P < 0.01). Among both vessels, variability continued to be highest among grade one lesions.
|Figure 1: Mean frequency of blunt cerebrovascular injury grade variability for carotid and vertebral vessels combined|
Click here to view
|Figure 2: Frequency averages of blunt cerebrovascular injury grade variability for carotid vessels (top) and vertebral vessels (bottom). u = coefficient of unalikeability|
Click here to view
Analysis of BCVI grade differences revealed a total of 65 (30%) injury interpretations when the difference would have changed clinical management. Grade zero versus any other grade occurred among 39 (17%) of the reads, grades one or two versus grades three or four occurred among 25 (11%) of the reads, and grades one, two, or three versus grade four occurred among nine (4%) of the interpretations. These differences would have changed treatment in 30% of patients, with treatment scope downgraded in 22% of patients and upgraded in 8%.
Weighted Cohen's k for each BCVI grade among each patient group (AB, BC, AC) was calculated and showed a very poor overall inter-reader agreement. As shown in [Figure 3], the mean k was 0.19 for group AB. This indicated slight agreement and was the strongest degree of agreement among all the groups. The mean k was − 0.04 for group AC, indicating no agreement, and the mean k was 0.06 for group BC, indicating slight agreement.
|Figure 3: Inter-reader agreement for blunt cerebrovascular injury grades|
Click here to view
| Discussion|| |
The results of this study show significant inter-reader variability exists among neuroradiologists interpreting BCVI using CTAn in trauma patients. The degree of disagreement was an indirect function of BCVI grade with initial grade one injuries having the largest amount of inter-reader variability. This was reflected in both the weighted Cohen's k analysis and the coefficient of u. Measuring both the weighted Cohen's k and coefficient of u strengthens our overall findings in two ways. First, the coefficient of u analyzed the incidence of difference among these groups but did not account for the grade differences. By using the second form of analysis weighted Cohen's k, we were able to evaluate for consistency and account for the grade differences amongst the BCVI reads.
Grade four injuries to both carotid and vertebral arteries had the most amount of agreement which is important as the treatment of these injuries includes full anticoagulation at this institution. For grades one and two, the large negative weight Cohen's k value would suggest the reads differed more than what would be read by chance. In fact, some of the disagreement found original grade one or two injuries were interpreted as grade zero on the reevaluations, indicating no BCVI was present. When deciding to treat these injuries, knowledge that the interpretation is not consistent should impact decision-making discussions. Our data on the high amount of disagreement among low-grade BVCIs zero to two should make the clinician skeptical about the diagnosis of these injuries. The clinician not only has to weight the risks of not treating a BCVI (future stroke) but also the risk of treating the BCVI (hemorrhage, coagulopathy, and bleeding risk).
Downgrading or upgrading a BCVI could mean clinically the patient's treatment recommendation would change. The study showed that 36% of patients could have been downgraded to a grade zero (no BCVI) based on the initial CTAn reevaluation and subsequently receive no treatment. For grade four injuries, 7% of these patients could be downgraded, which means 7% of these patients may have been fully anticoagulated without additional benefit. For grade three injuries, 7.8% of patients could have been upgraded to a grade four, meaning they may have benefitted from full anticoagulation. For grade two BCVIs, 13.5% of patients could have been upgraded to a grade three or four, meaning these patients may have benefitted from additional surgical subspecialty input or full anticoagulation. These significant upgrades and downgrades raise many questions about the reliability of our radiological interpretation of BCVIs.
Although this study of variability among radiologist interpretation of BCVI is not found in the current literature, some studies have examined interobserver agreement in other types of radiologic imaging. A study published in Radiology in 2013 examined the interobserver variability among the diagnosis of honeycombing on chest CTs. Watadani et al. found a weighted Cohen's k value range of 0.4 up to 0.58 for expert chest radiologist. Interpretation of honeycombing on chest CT has similarities to the diagnosis of BCVIs in that both are diagnosed based on grading systems: Fleischner society guidelines for honeycombing and Denver grading for BCVIs. Comparing this to our BCVI study, only one grade four BCVI group had the degree of agreement published in the above study.
Chun et al. examined inter-reader variability of CT diagnosis of traumatic brain injury (TBI). This study evaluated the head CTs of 50 trauma patients with blunt mechanisms and graded their TBI injuries using both the Marshall CT classification and Rotterdam CT classification. The average Cohen's k score for TBI classification was 0.568, indicating moderate agreement. Once again compared to our study of agreement in BCVIs, grade four injuries had an agreement of 0.4 at best. This study was similar in nature to our study as the diagnosis of the injury is solely based on radiological findings. All other grades of BCVIs had less than moderate agreement in our study. Although the two cited studies above do not directly examine BCVI diagnosis, both have an inter-reader agreement greater than what was found in our study, indicating that we are less certain of our BCVI grading than other conditions diagnosed by CT evaluation.
Our study has several limitations. As a single institution study, the data represents the imaging and radiological interpretation of one radiologist group. Secondary to its retrospective design, this study also does not address the actual clinical impact of inter-reader variability. Our other limitations related to the CT scanners and contrast timing. At our institution, we have two different CT scanners. Although all the reconstructed slice thicknesses were the same, the actual scanners are slightly different. Each of our patients in this study received the same contrast, but we were unable to control for the timing of this contrast; as the contrast timing and scanner type can affect image quality. CT scans are also affected by motion, bone, and metallic artifact as well as possible pathologies involving atherosclerotic plaques. Another area of limitation is the use of only one type of imaging. MRA and Doppler ultrasound have been shown to have beneficial secondary roles in patients with BCVI diagnosis., CTAn does not account for the active arterial flow as Doppler ultrasound does, addition of US or MRA could be a future area of study. Future directions of this study could include prospective analysis to analyze optimal timing of contrast to minimize variability as well as investigate the clinical impact of BCVI read variability. Another future study would be to compare variability in BCVI diagnosis between CTAn and conventional angiography or MRA.
| Conclusions|| |
BCVIs are more common than originally thought and with the liberalized screening and the use of CTAn, these injuries are more often identified.,, Clinical decision-making about BCVIs for trauma patients is multifactorial and often complicated in patients with multiple injuries. This study illustrates the variability and frequency among the radiologic interpretation of BCVIs. This study is meant to highlight problems with diagnosing and grading BCVIs that may have a significant clinical impact. This study raises questions related to additional imaging to confirm the injury before treatment, especially in grade one and grade four carotid BCVIs.
Special acknowledgements to the trauma research department at Grant Medical Center including Micheal Lieber MS statistician, Joshua Burton MSN RN trauma research program manager and the trauma base registars including Monica Rozzell.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
Research quality and ethics statement
This study was approved by the Institutional Review Board / Ethics Committee. The authors followed applicable EQUATOR Network (http://www.equator-network.org/) guidelines during the conduct of this research project.
| Appendix|| |
Appendix A: GMC Trauma Clinical Pathway blunt cerebrovascular injury: Screening/Identification, Classification and Treatment
- CT Angiogram of the cerebrovascular vessels (neck and skull base) should be done in all patients who meet criteria for “pan scan” (plan to obtain CT head, Cervical spine, chest, abdomen, pelvis, Thoracic and Lumbar Spine)
- “High mechanism blunt trauma” (defined as fall from height > 14 feet, MVC > 35 mph, pedestrian vs. auto, physician discretion)
- Any of the following:
- GCS <8
- Mid-face fractures, LeFort II or III fractures
- Mandible fracture
- Complex skull fracture
- Basilar skull fracture, occipital condyle fracture
- Cervical spine fracture at any level (including transverse processes)
- Near hanging
- Consider with other concerning injuries: Diffuse Axonal Injury, Clothesline type injury/“Seat belt sign” across neck, Scalp degloving, Thoracic vascular injuries, Upper rib fractures, Blunt cardiac injury
- Focal/unexplained neurological deficit, including: Transient Ischemic Attack, hemiparesis, Horner's syndrome, vertebrobasilar symptoms, anisocoria
- Cervical hematoma or bruit
- Arterial hemorrhage from neck/nose/mouth
Denver Grading Scale for Blunt Cerebrovascular Injuries:
Grade 1: Irregularity of the vessel wall or a dissection/intramural hematoma with <25% luminal stenosisa
Grade 2: Intraluminal thrombus or raised intimal flap is visualized, or dissection/intramural hematoma with ≥ 25% luminal narrowing
Grade 3: Pseudoaneurysm
Grade 4: Vessel occlusion
Grade 5: Vessel transection
Radiologists reading the CT angiogram will identify grade of injury, injury location, and presence or absence of thrombus.
Vascular Surgery Consult:
- Grade 4 and Grade 5 injuries.
- Carotid Artery injury with intraluminal thrombus.
- Carotid Artery injury with complex or flow limiting (>70% stenosis) dissection.
- Vertebral Artery injury within 2 cm of basilar artery (level of C2 or above).
- Progressive symptoms or progressive injury.
- Concern by treating team with desire for vascular evaluation.
Grade 1/Grade 2/Grade 3:
- 325 mg ASA daily for 10 days.
- Repeat CT angiogram in 7–10 days, or if new symptoms arise.
- Follow up in trauma office.
- If angiogram is normal or the blunt cerebrovascular injury resolved, stop ASA.
- If angiogram is unchanged with an injury, continue ASA and CT angiogram at 6 weeks.
- If angiogram is abnormal at 6 weeks, call RMH vascular neurology for a referral.
Grade 4 (occlusion):
- Vascular surgery consultation (routine) with Vascular surgery outpatient follow-up.
- Proximal occlusions: 325 mg ASA daily, Follow up in trauma office.
- Distal Occlusions-Carotid Artery at the skull base or Vertebral Artery injury within 2 cm of basilar artery (level of C2 or above):
- Full anticoagulation (heparin or weight based LMWH).
- Transition to long-term anticoagulation.
Grade 5 (transection):
- Vascular surgery consultation (Emergent– call and see within one hour).
- Should be held if patient has another contraindication (ICH)
- If patient at high bleeding risk, antiplatelet agent can be deescalated to ASA 81 mg only
- No patient with blunt cerebrovascular injury will be transferred to another facility for further care unless discussion with the Trauma Medical Director or Associate Trauma Medical Director has occurred.
| References|| |
- Bruns BR, Tesoriero R, Kufera J, Sliker C, Laser A, Scalea TM, et al. Blunt cerebrovascular injury screening guidelines: What are we willing to miss? J Trauma Acute Care Surg 2014;76:691-5.
- Demetriades D, Gomez H, Velmahos GC, Asensio JA, Murray J, Cornwell EE 3rd, et al. Routine helical computed tomographic evaluation of the mediastinum in high-risk blunt trauma patients. Arch Surg 1998;133:1084-8.
- Franz RW, Willette PA, Wood MJ, Wright ML, Hartman JF. A systematic review and meta-analysis of diagnostic screening criteria for blunt cerebrovascular injuries. J Am Coll Surg 2012;214:313-27.
- Fabian TC. Blunt cerebrovascular injuries: Anatomic and pathologic heterogeneity create management enigmas. J Am Coll Surg 2013;216:873-85.
- Burlew CC, Biffl WL, Moore EE, Pieracci FM, Beauchamp KM, Stovall R, et al. Endovascular stenting is rarely necessary for the management of blunt cerebrovascular injuries. J Am Coll Surg 2014;218:1012-7.
- Biffl WL, Cothren CC, Moore EE, Kozar R, Cocanour C, Davis JW, et al. Western Trauma Association critical decisions in trauma: screening for and treatment of blunt cerebrovascular injuries. J Trauma 2009;67:1150-3.
| References|| |
Biffl WL, Ray CE Jr, Moore EE, Franciose RJ, Aly S, Heyrosa MG, et al
. Treatment-related outcomes from blunt cerebrovascular injuries: Importance of routine follow-up arteriography. Ann Surg 2002;235:699-706.
Crawford JD, Allan KM, Patel KU, Hart KD, Schreiber MA, Azarbal AF, et al
. The natural history of indeterminate blunt cerebrovascular injury. JAMA Surg 2015;150:841-7.
Fabian TC, Patton JH Jr, Croce MA, Minard G, Kudsk KA, Pritchard FE. Blunt carotid injury. Importance of early diagnosis and anticoagulant therapy. Ann Surg 1996;223:513-22.
Cothren CC, Moore EE, Biffl WL, Ciesla DJ, Ray CE Jr, Johnson JL, et al
. Anticoagulation is the gold standard therapy for blunt carotid injuries to reduce stroke rate. Arch Surg 2004;139:540-5.
Cothren CC, Biffl WL, Moore EE, Kashuk JL, Johnson JL. Treatment for blunt cerebrovascular injuries: Equivalence of anticoagulation and antiplatelet agents. Arch Surg 2009;144:685-90.
Biffl WL, Cothren CC, Moore EE, Kozar R, Cocanour C, Davis JW, et al
. Western Trauma Association critical decisions in trauma: Screening for and treatment of blunt cerebrovascular injuries. J Trauma 2009;67:1150-3.
Rutman AM, Vranic JE, Mossa-Basha M. Imaging and management of blunt cerebrovascular injury. Radiographics 2018;38:542-63.
Biffl WL, Moore EE, Offner PJ, Brega KE, Franciose RJ, Elliott JP, et al
. Optimizing screening for blunt cerebrovascular injuries. Am J Surg 1999;178:517-22.
Bruns BR, Tesoriero R, Kufera J, Sliker C, Laser A, Scalea TM, et al
. Blunt cerebrovascular injury screening guidelines: What are we willing to miss? J Trauma Acute Care Surg 2014;76:691-5.
Kerwin AJ, Bynoe RP, Murray J, Hudson ER, Close TP, Gifford RR, et al
. Liberalized screening for blunt carotid and vertebral artery injuries is justified. J Trauma 2001;51:308-14.
Miller PR, Fabian TC, Croce MA, Cagiannos C, Williams JS, Vang M, et al
. Prospective screening for blunt cerebrovascular injuries: Analysis of diagnostic modalities and outcomes. Ann Surg 2002;236:386-93.
Kader GD, Perry M. Variability for Categorical Variables. J Stats Edu 2007;15:1-16.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159-74.
McHugh ML. Interrater reliability: The kappa statistic. Biochem Med (Zagreb) 2012;22:276-82.
Watadani T, Sakai F, Johkoh T, Noma S, Akira M, Fujimoto K, et al
. Interobserver variability in the CT assessment of honeycombing in the lungs. Radiology 2013;266:936-44.
Chun KA, Manley GT, Stiver SI, Aiken AH, Phan N, Wang V, et al
. Interobserver variability in the assessment of CT imaging features of traumatic brain injury. J Neurotrauma 2010;27:325-30.
Sharma P, Hegde R, Kulkarni A, Sharma S, Soin P, Kochar PS, et al
. Traumatic vertebral artery injury: A review of the screening criteria, imaging spectrum, mimics, and pitfalls. Pol J Radiol 2019;84:e307-e318.
Sharma P, Kochar P, Soin P, Cohen S. Bisystolic vertebral artery: Critical finding or can be ignored? J Clin Imaging Sci 2019;9:2.
] [Full text]
[Figure 1], [Figure 2], [Figure 3]