1
|
Kerr WT, Cho AY, Anderson A, Douglas PK, Lau EP, Hwang ES, Raman KR, Trefler A, Cohen MS, Nguyen ST, Reddy NM, Silverman DH. Balancing Clinical and Pathologic Relevence in the Machine Learning Diagnosis of Epilepsy. ... INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION IN NEUROIMAGING. INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION IN NEUROIMAGING 2013; 2013:86-89. [PMID: 25302313 PMCID: PMC4188528 DOI: 10.1109/prni.2013.31] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
The application of machine learning to epilepsy can be used both to develop clinically useful computer-aided diagnostic tools, and to reveal pathologically relevant insights into the disease. Such studies most frequently use neurologically normal patients as the control group to maximize the pathologic insight yielded from the model. This practice yields potentially inflated accuracy because the groups are quite dissimilar. A few manuscripts, however, opt to mimic the clinical comparison of epilepsy to non-epileptic seizures, an approach we believe to be more clinically realistic. In this manuscript, we describe the relative merits of each control group. We demonstrate that in our clinical quality FDG-PET database the performance achieved was similar using each control group. Based on these results, we find that the choice of control group likely does not hinder the reported performance. We argue that clinically applicable computer-aided diagnostic tools for epilepsy must directly address the clinical challenge of distinguishing patients with epilepsy from those with non-epileptic seizures.
Collapse
Affiliation(s)
- Wesley T. Kerr
- Laboratory of Integrative Neuroimaging Technology University of California, Los Angeles Los Angeles, USA
| | - Andrew Y. Cho
- Laboratory of Integrative Neuroimaging Technology University of California, Los Angeles Los Angeles, USA
| | - Ariana Anderson
- Laboratory of Integrative Neuroimaging Technology University of California, Los Angeles Los Angeles, USA
| | - Pamela K. Douglas
- Laboratory of Integrative Neuroimaging Technology University of California, Los Angeles Los Angeles, USA
| | - Edward P. Lau
- Laboratory of Integrative Neuroimaging Technology University of California, Los Angeles Los Angeles, USA
| | - Eric S. Hwang
- Laboratory of Integrative Neuroimaging Technology University of California, Los Angeles Los Angeles, USA
| | - Kaavya R. Raman
- Laboratory of Integrative Neuroimaging Technology University of California, Los Angeles Los Angeles, USA
| | - Aaron Trefler
- Laboratory of Integrative Neuroimaging Technology University of California, Los Angeles Los Angeles, USA
| | - Mark S. Cohen
- Laboratory of Integrative Neuroimaging Technology University of California, Los Angeles Los Angeles, USA
| | - Stefan T. Nguyen
- Ahmanson Translational Imaging Division University of California, Los Angeles Los Angeles, USA
| | - Navya M. Reddy
- Ahmanson Translational Imaging Division University of California, Los Angeles Los Angeles, USA
| | - Daniel H. Silverman
- Ahmanson Translational Imaging Division University of California, Los Angeles Los Angeles, USA
| |
Collapse
|
2
|
Kerr WT, Nguyen ST, Cho AY, Lau EP, Silverman DH, Douglas PK, Reddy NM, Anderson A, Bramen J, Salamon N, Stern JM, Cohen MS. Computer-Aided Diagnosis and Localization of Lateralized Temporal Lobe Epilepsy Using Interictal FDG-PET. Front Neurol 2013; 4:31. [PMID: 23565107 PMCID: PMC3615243 DOI: 10.3389/fneur.2013.00031] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2013] [Accepted: 03/18/2013] [Indexed: 11/13/2022] Open
Abstract
Interictal FDG-PET (iPET) is a core tool for localizing the epileptogenic focus, potentially before structural MRI, that does not require rare and transient epileptiform discharges or seizures on EEG. The visual interpretation of iPET is challenging and requires years of epilepsy-specific expertise. We have developed an automated computer-aided diagnostic (CAD) tool that has the potential to work both independent of and synergistically with expert analysis. Our tool operates on distributed metabolic changes across the whole brain measured by iPET to both diagnose and lateralize temporal lobe epilepsy (TLE). When diagnosing left TLE (LTLE) or right TLE (RTLE) vs. non-epileptic seizures (NES), our accuracy in reproducing the results of the gold standard long term video-EEG monitoring was 82% [95% confidence interval (CI) 69-90%] or 88% (95% CI 76-94%), respectively. The classifier that both diagnosed and lateralized the disease had overall accuracy of 76% (95% CI 66-84%), where 89% (95% CI 77-96%) of patients correctly identified with epilepsy were correctly lateralized. When identifying LTLE, our CAD tool utilized metabolic changes across the entire brain. By contrast, only temporal regions and the right frontal lobe cortex, were needed to identify RTLE accurately, a finding consistent with clinical observations and indicative of a potential pathophysiological difference between RTLE and LTLE. The goal of CADs is to complement - not replace - expert analysis. In our dataset, the accuracy of manual analysis (MA) of iPET (∼80%) was similar to CAD. The square correlation between our CAD tool and MA, however, was only 30%, indicating that our CAD tool does not recreate MA. The addition of clinical information to our CAD, however, did not substantively change performance. These results suggest that automated analysis might provide clinically valuable information to focus treatment more effectively.
Collapse
Affiliation(s)
- Wesley T. Kerr
- Department of Biomathematics, David Geffen School of Medicine, University of California Los AngelesLos Angeles, CA, USA
- Laboratory of Integrative Neuroimaging Technology, Department of Psychiatry, Neuropsychiatric Institute, University of California Los AngelesLos Angeles, CA, USA
| | - Stefan T. Nguyen
- Ahmanson Translational Imaging Division, Department of Molecular and Medical Pharmacology, David Geffen School of Medicine, University of California Los AngelesLos Angeles, CA, USA
| | - Andrew Y. Cho
- Laboratory of Integrative Neuroimaging Technology, Department of Psychiatry, Neuropsychiatric Institute, University of California Los AngelesLos Angeles, CA, USA
| | - Edward P. Lau
- Laboratory of Integrative Neuroimaging Technology, Department of Psychiatry, Neuropsychiatric Institute, University of California Los AngelesLos Angeles, CA, USA
| | - Daniel H. Silverman
- Ahmanson Translational Imaging Division, Department of Molecular and Medical Pharmacology, David Geffen School of Medicine, University of California Los AngelesLos Angeles, CA, USA
| | - Pamela K. Douglas
- Laboratory of Integrative Neuroimaging Technology, Department of Psychiatry, Neuropsychiatric Institute, University of California Los AngelesLos Angeles, CA, USA
| | - Navya M. Reddy
- Ahmanson Translational Imaging Division, Department of Molecular and Medical Pharmacology, David Geffen School of Medicine, University of California Los AngelesLos Angeles, CA, USA
| | - Ariana Anderson
- Laboratory of Integrative Neuroimaging Technology, Department of Psychiatry, Neuropsychiatric Institute, University of California Los AngelesLos Angeles, CA, USA
| | - Jennifer Bramen
- Laboratory of Integrative Neuroimaging Technology, Department of Psychiatry, Neuropsychiatric Institute, University of California Los AngelesLos Angeles, CA, USA
| | - Noriko Salamon
- Department of Neurology, Seizure Disorder Center, University of California Los AngelesLos Angeles, CA, USA
| | - John M. Stern
- Department of Neurology, Seizure Disorder Center, University of California Los AngelesLos Angeles, CA, USA
| | - Mark S. Cohen
- Laboratory of Integrative Neuroimaging Technology, Department of Psychiatry, Neuropsychiatric Institute, University of California Los AngelesLos Angeles, CA, USA
- Laboratory of Integrative Neuroimaging Technology, Departments of Psychiatry, Neurology, Radiology, Biomedical Physics, Psychology and Bioengineering, University of California Los AngelesLos Angeles, CA, USA
| |
Collapse
|