1
|
Chin O, Alshafai L, O'Sullivan B, Su J, Hope A, Bartlett E, Hansen AR, Waldron J, Chepeha D, Xu W, Huang SH, Yu E. Inter-rater concordance and operating definitions of radiologic nodal feature assessment in human papillomavirus-positive oropharyngeal carcinoma. Oral Oncol 2022; 125:105716. [PMID: 35038657 DOI: 10.1016/j.oraloncology.2022.105716] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2021] [Revised: 12/21/2021] [Accepted: 01/06/2022] [Indexed: 01/07/2023]
Abstract
BACKGROUND AND PURPOSE This study aims to evaluate the reliability of radiologic nodal feature assessment in clinical node-positive human papillomavirus-positive oropharyngeal carcinoma. MATERIALS AND METHODS Baseline CTs or MRIs of clinical node-positive human papillomavirus-positive oropharyngeal carcinoma diagnosed between 2012 and 2015 were reviewed independently by two neuroradiologists for seven nodal features: radiologic nodal involvement, cystic change, presence of necrosis, clustering, conglomeration, coalescence, and extranodal extension. Consensus operating definitions were derived after discussion. The features were re-reviewed in a randomly selected cohort. Levels of certainty (probability of presence: <25%, ∼50%, ∼75%, and >90%) were recorded. Interrater concordance was calculated using Cohen's kappa coefficient. RESULTS A total of 413 patients (826 necks) were eligible. At initial review, the inter-rater kappa values for: radiologic nodal involvement, cystic change, necrosis, clustering, conglomeration, coalescence, and extranodal extension were 0.92, 0.64, 0.48, 0.32, 0.32, 0.62, and 0.56, respectively. A re-review of 94 randomly selected cases (188 necks) after consolidation of operating definitions for nodal features showed that the inter-rater kappa values of these features were 0.83, 0.62, 0.58, 0.32, 0.18, 0.68, and 0.74 when considering ≥50% certainty as positive, and improved to 0.94, 0.66, 0.59, 0.33, 0.19, 0.76, and 0.86 when considering ≥75% certainty as positive. CONCLUSION Clearly defined nomenclature results in improved interrater reliability when assessing radiologic nodal features, especially for coalescent adenopathy and extranodal extension. Higher levels of certainty are associated with higher inter-rater agreement. Radiology reporting should include clear definitions of clinically relevant nodal features as well as levels of certainty to serve various needs in clinical care and research.
Collapse
Affiliation(s)
- Olivia Chin
- Department of Neuroradiology, University of Toronto, Toronto, Canada
| | - Laila Alshafai
- Department of Neuroradiology, University of Toronto, Toronto, Canada; Department of Neuroradiology and Head and Neck Imaging, Princess Margaret Cancer Centre, University of Toronto, Toronto, Canada
| | - Brian O'Sullivan
- Department of Radiation Oncology, University of Toronto, Toronto, Canada; Radiation Medicine Program, Princess Margaret Cancer Centre, University Health Network, Toronto, Canada; Department of Otolaryngology - Head & Neck Surgery, University of Toronto, Toronto, Canada; Princess Margaret Cancer Centre, University Health Network, Toronto, Canada
| | - Jie Su
- Princess Margaret Cancer Centre, University Health Network, Toronto, Canada; Department of Biostatistics, Princess Margaret Cancer Centre, University of Toronto, Toronto, Canada
| | - Andrew Hope
- Department of Radiation Oncology, University of Toronto, Toronto, Canada; Radiation Medicine Program, Princess Margaret Cancer Centre, University Health Network, Toronto, Canada
| | - Eric Bartlett
- Department of Neuroradiology, University of Toronto, Toronto, Canada; Department of Neuroradiology and Head and Neck Imaging, Princess Margaret Cancer Centre, University of Toronto, Toronto, Canada
| | - Aaron R Hansen
- Division of Medical Oncology, Princess Margaret Cancer Centre, University of Toronto, Toronto, Canada
| | - John Waldron
- Department of Radiation Oncology, University of Toronto, Toronto, Canada; Radiation Medicine Program, Princess Margaret Cancer Centre, University Health Network, Toronto, Canada
| | - Douglas Chepeha
- Princess Margaret Cancer Centre, University Health Network, Toronto, Canada
| | - Wei Xu
- Department of Biostatistics, Princess Margaret Cancer Centre, University of Toronto, Toronto, Canada
| | - Shao Hui Huang
- Department of Radiation Oncology, University of Toronto, Toronto, Canada; Radiation Medicine Program, Princess Margaret Cancer Centre, University Health Network, Toronto, Canada; Department of Otolaryngology - Head & Neck Surgery, University of Toronto, Toronto, Canada; Princess Margaret Cancer Centre, University Health Network, Toronto, Canada.
| | - Eugene Yu
- Department of Neuroradiology, University of Toronto, Toronto, Canada; Department of Neuroradiology and Head and Neck Imaging, Princess Margaret Cancer Centre, University of Toronto, Toronto, Canada.
| |
Collapse
|
2
|
Dmytriw AA, El Beltagi A, Bartlett E, Sahgal A, Poon CS, Forghani R, Fatterpekar G, Yu E. CRISPS: a pictorial essay of an acronym to interpreting metastatic head and neck lymphadenopathy. Can Assoc Radiol J 2013; 65:232-41. [PMID: 24209637 DOI: 10.1016/j.carj.2013.07.004] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2013] [Revised: 07/01/2013] [Accepted: 07/15/2013] [Indexed: 11/28/2022] Open
Affiliation(s)
- Adam A Dmytriw
- Joint Department of Medical Imaging, University Health Network, Toronto, Ontario, Canada.
| | | | - Eric Bartlett
- Department of Medical Imaging, University of Toronto, Toronto, Ontario, Canada
| | - Arjun Sahgal
- Department of Radiation Oncology, University of Toronto, Toronto, Ontario, Canada
| | - Colin S Poon
- Department of Diagnostic Radiology, Yale Medical School, New Haven, Connecticut, USA
| | - Reza Forghani
- Department of Radiology, McGill University, Montreal, Quebec, Canada
| | | | - Eugene Yu
- Department of Medical Imaging, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|