1
|
Martín Vicario C, Rodríguez Salas D, Maier A, Hock S, Kuramatsu J, Kallmuenzer B, Thamm F, Taubmann O, Ditt H, Schwab S, Dörfler A, Muehlen I. Uncertainty-aware deep learning for trustworthy prediction of long-term outcome after endovascular thrombectomy. Sci Rep 2024; 14:5544. [PMID: 38448445 PMCID: PMC10917742 DOI: 10.1038/s41598-024-55761-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 02/27/2024] [Indexed: 03/08/2024] Open
Abstract
Acute ischemic stroke (AIS) is a leading global cause of mortality and morbidity. Improving long-term outcome predictions after thrombectomy can enhance treatment quality by supporting clinical decision-making. With the advent of interpretable deep learning methods in recent years, it is now possible to develop trustworthy, high-performing prediction models. This study introduces an uncertainty-aware, graph deep learning model that predicts endovascular thrombectomy outcomes using clinical features and imaging biomarkers. The model targets long-term functional outcomes, defined by the three-month modified Rankin Score (mRS), and mortality rates. A sample of 220 AIS patients in the anterior circulation who underwent endovascular thrombectomy (EVT) was included, with 81 (37%) demonstrating good outcomes (mRS ≤ 2). The performance of the different algorithms evaluated was comparable, with the maximum validation under the curve (AUC) reaching 0.87 using graph convolutional networks (GCN) for mRS prediction and 0.86 using fully connected networks (FCN) for mortality prediction. Moderate performance was obtained at admission (AUC of 0.76 using GCN), which improved to 0.84 post-thrombectomy and to 0.89 a day after stroke. Reliable uncertainty prediction of the model could be demonstrated.
Collapse
Affiliation(s)
- Celia Martín Vicario
- Department of Neuroradiology, Friedrich-Alexander University of Erlangen-Nuremberg, University Hospital Erlangen, Erlangen, Germany.
- Pattern Recognition Lab, Friedrich Alexander University, Erlangen, Germany.
| | - Dalia Rodríguez Salas
- Department of Neuroradiology, Friedrich-Alexander University of Erlangen-Nuremberg, University Hospital Erlangen, Erlangen, Germany
- Pattern Recognition Lab, Friedrich Alexander University, Erlangen, Germany
| | - Andreas Maier
- Pattern Recognition Lab, Friedrich Alexander University, Erlangen, Germany
| | - Stefan Hock
- Department of Neuroradiology, Friedrich-Alexander University of Erlangen-Nuremberg, University Hospital Erlangen, Erlangen, Germany
| | - Joji Kuramatsu
- Department of Neurology, Friedrich-Alexander University of Erlangen-Nuremberg, University Hospital Erlangen, Erlangen, Germany
| | - Bernd Kallmuenzer
- Department of Neurology, Friedrich-Alexander University of Erlangen-Nuremberg, University Hospital Erlangen, Erlangen, Germany
| | | | | | | | - Stefan Schwab
- Department of Neurology, Friedrich-Alexander University of Erlangen-Nuremberg, University Hospital Erlangen, Erlangen, Germany
| | - Arnd Dörfler
- Department of Neuroradiology, Friedrich-Alexander University of Erlangen-Nuremberg, University Hospital Erlangen, Erlangen, Germany
| | - Iris Muehlen
- Department of Neuroradiology, Friedrich-Alexander University of Erlangen-Nuremberg, University Hospital Erlangen, Erlangen, Germany
| |
Collapse
|
2
|
Thamm A, Thamm F, Sawodny A, Zeitler S, Merklein M, Maier A. Unsupervised Deep Learning for Advanced Forming Limit Analysis in Sheet Metal: A Tensile Test-Based Approach. Materials (Basel) 2023; 16:7001. [PMID: 37959598 PMCID: PMC10647507 DOI: 10.3390/ma16217001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 10/25/2023] [Accepted: 10/30/2023] [Indexed: 11/15/2023]
Abstract
An accurate description of the formability and failure behavior of sheet metal materials is essential for an optimal forming process design. In this respect, the forming limit curve (FLC) based on the Nakajima test, which is determined in accordance with DIN EN ISO 12004-2, is a wide-spread procedure for evaluating the formability of sheet metal materials. Thereby the FLC is affected by influences originating from intrinsic factors of the Nakajima test-setup, such as friction, which leads to deviations from the linear strain path, biaxial prestress and bending superposition. These disadvantages can be circumvented by an alternative test combination of uniaxial tensile test and hydraulic bulge test. In addition, the forming limit capacity of many lightweight materials is underestimated using the cross-section method according to DIN EN ISO 12004-2, due to the material-dependent occurrence of multiple strain maxima during forming or sudden cracking without prior necking. In this regard, machine learning approaches have a high potential for a more accurate determination of the forming limit curve due to the inclusion of other parameters influencing formability. This work presents a machine learning approach focused on uniaxial tensile tests to define the forming limit of lightweight materials and high-strength steels. The transferability of an existing weakly supervised convolutional neural network (CNN) approach was examined, originally designed for Nakajima tests, to uniaxial tensile tests. Additionally, a stereo camera-based method for this purpose was developed. In our evaluation, we train and test materials, including AA6016, DX54D, and DP800, through iterative data composition, using cross-validation. In the context of our stereo camera-based approach, strains for different materials and thicknesses were predicted. In this cases, our method successfully predicted the major strains with close agreement to ISO standards. For DX54D, with a thickness of 0.8 mm, the prediction was 0.659 (compared to ISO's 0.664). Similarly, for DX54D, 2.0 mm thickness, the predicted major strain was 0.780 (compared to ISO 0.705), and for AA6016, at 1.0 mm thickness, a major strain of 0.314 (in line with ISO 0.309) was estimated. However, for DP800 with a thickness of 1.0 mm, the prediction yielded a major strain of 0.478 (as compared to ISO 0.289), indicating a divergence from the ISO standard in this particular case. These results in general, generated with the CNN stereo camera-based approach, underline the quantitative alignment of the approach with the cross-section method.
Collapse
Affiliation(s)
- Aleksandra Thamm
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Martensstr. 3, 91058 Erlangen, Germany; (F.T.); (S.Z.); (A.M.)
| | - Florian Thamm
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Martensstr. 3, 91058 Erlangen, Germany; (F.T.); (S.Z.); (A.M.)
| | - Annette Sawodny
- Institute of Manufacturing Technology, Friedrich-Alexander-Universität Erlangen-Nürnberg, Egerlandstr. 13, 91058 Erlangen, Germany; (A.S.); (M.M.)
| | - Sally Zeitler
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Martensstr. 3, 91058 Erlangen, Germany; (F.T.); (S.Z.); (A.M.)
| | - Marion Merklein
- Institute of Manufacturing Technology, Friedrich-Alexander-Universität Erlangen-Nürnberg, Egerlandstr. 13, 91058 Erlangen, Germany; (A.S.); (M.M.)
| | - Andreas Maier
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Martensstr. 3, 91058 Erlangen, Germany; (F.T.); (S.Z.); (A.M.)
| |
Collapse
|
3
|
Thamm F, Juergens M, Taubmann O, Thamm A, Rist L, Ditt H, Maier A. An algorithm for the labeling and interactive visualization of the cerebrovascular system of ischemic strokes. Biomed Phys Eng Express 2022; 8. [PMID: 36137477 DOI: 10.1088/2057-1976/ac9415] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 09/22/2022] [Indexed: 11/11/2022]
Abstract
During the diagnosis of ischemic strokes, the Circle of Willis and its surrounding vessels are the arteries of interest. Their visualization in case of an acute stroke is often enabled by Computed Tomography Angiography (CTA). Still, the identification and analysis of the cerebral arteries remain time consuming in such scans due to a large number of peripheral vessels which may disturb the visual impression. We propose VirtualDSA++, an algorithm designed to segment and label the cerebrovascular tree on CTA scans. Especially with stroke patients, labeling is a delicate procedure, as in the worst case whole hemispheres may not be present due to impeded perfusion. Hence, we extended the labeling mechanism for the cerebral arteries to identify occluded vessels. In the work at hand, we place the algorithm in a clinical context by evaluating the labeling and occlusion detection on stroke patients, where we have achieved labeling sensitivities comparable to other works between 92% and 95%. To the best of our knowledge, ours is the first work to address labeling and occlusion detection at once, whereby a sensitivity of 67% and a specificity of 81% were obtained for the latter. VirtualDSA++ also automatically segments and models the intracranial system leading to further processing possibilities. We present the generic concept of iterative systematic search for pathways on all nodes of said model, which enables new interactive features. Exemplary, we derive in detail, firstly, the interactive planning of vascular interventions like the mechanical thrombectomy and secondly, the interactive suppression of vessel structures that are not of interest in diagnosing strokes (like veins). We discuss both features as well as further possibilities emerging from the proposed concept.
Collapse
Affiliation(s)
- Florian Thamm
- Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nuremberg, Martensstr. 3, Erlangen, 91058, GERMANY
| | - Markus Juergens
- Computed Tomography, Siemens Healthcare GmbH Forchheim, Siemensstr. 3, Forchheim, Bayern, 91301, GERMANY
| | - Oliver Taubmann
- Computed Tomography, Siemens Healthcare GmbH Forchheim, Siemensstr. 3, Forchheim, Bayern, 91301, GERMANY
| | - Aleksandra Thamm
- Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nuremberg, Martensstr. 3, Erlangen, 91058, GERMANY
| | - Leonhard Rist
- Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nuremberg, Martensstr. 3, Erlangen, 91058, GERMANY
| | - Hendrik Ditt
- Computed Tomography, Siemens Healthcare GmbH Forchheim, Siemensstr. 3, Forchheim, Bayern, 91301, GERMANY
| | - Andreas Maier
- Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nuremberg, Martensstr. 3, Erlangen, Bayern, 91058, GERMANY
| |
Collapse
|
4
|
Hoppe E, Thamm F, Körzdörfer G, Syben C, Schirrmacher F, Nittka M, Pfeuffer J, Meyer H, Maier A. Magnetic Resonance Fingerprinting Reconstruction Using Recurrent Neural Networks. Stud Health Technol Inform 2019; 267:126-133. [PMID: 31483264 DOI: 10.3233/shti190816] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Magnetic Resonance Fingerprinting (MRF) is an imaging technique acquiring unique time signals for different tissues. Although the acquisition is highly accelerated, the reconstruction time remains a problem, as the state-of-the-art template matching compares every signal with a set of possible signals. To overcome this limitation, deep learning based approaches, e.g. Convolutional Neural Networks (CNNs) have been proposed. In this work, we investigate the applicability of Recurrent Neural Networks (RNNs) for this reconstruction problem, as the signals are correlated in time. Compared to previous methods based on CNNs, RNN models yield significantly improved results using in-vivo data.
Collapse
Affiliation(s)
- Elisabeth Hoppe
- Pattern Recognition Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Florian Thamm
- Pattern Recognition Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | | | - Christopher Syben
- Pattern Recognition Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Franziska Schirrmacher
- Pattern Recognition Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Mathias Nittka
- Siemens Healthcare, Application Development, Erlangen, Germany
| | - Josef Pfeuffer
- Siemens Healthcare, Application Development, Erlangen, Germany
| | - Heiko Meyer
- Siemens Healthcare, Application Development, Erlangen, Germany
| | - Andreas Maier
- Pattern Recognition Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| |
Collapse
|
5
|
Szabó G, Kocsis L, Thamm F, Szántó P, Wohlfart R, Mike A. [Model of abutment screw fixation for single tooth implantation]. Fogorv Sz 1999; 92:203-12. [PMID: 10489730] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 02/14/2023]
Abstract
An experimental model was constructed to test the abutment screw fixation for two Hungarian implant systems. First, abutments were tightened to 22.4 Ncm and after 4.25 hour loosening torques varied between 13.8-20.9 Ncm. Secondly, premolar-form crowns were casted and cemented on abutment-implant assemblies and cyclic load between 20-60 N was applied. 3.8-18.3 Ncm of loosening torques were measured. Four abutments of nine test assemblies were completely loosened and the cement fixation of one crown was destroyed. It was concluded that the test procedure and the model of crown-abutment-implant assemblies had given a reproducible technique to record changes in torques during a dynamic load.
Collapse
Affiliation(s)
- G Szabó
- Pécsi Orvostudományi Egyetem, Fogászati és Szájsebészeti Klinika, Pécs
| | | | | | | | | | | |
Collapse
|