Detecting shortcut learning for fair medical AI using shortcut testing

Machine learning (ML) holds great promise for improving healthcare, but it is critical to ensure that its use will not propagate or amplify health disparities. An important step is to characterize the (un)fairness of ML models-their tendency to perform differently across subgroups of the population-and to understand its underlying mechanisms. One potential driver of algorithmic unfairness, shortcut learning, arises when ML models base predictions on improper correlations in the training data. Diagnosing this phenomenon is difficult as sensitive attributes may be causally linked with disease. Using multitask learning, we propose a method to directly test for the presence of shortcut learning in clinical ML systems and demonstrate its application to clinical tasks in radiology and dermatology. Finally, our approach reveals instances when shortcutting is not responsible for unfairness, highlighting the need for a holistic approach to fairness mitigation in medical AI.

Multitask prediction of organ dysfunction in the intensive care unit using sequential subnetwork routing

Objective

Multitask learning (MTL) using electronic health records allows concurrent prediction of multiple endpoints. MTL has shown promise in improving model performance and training efficiency; however, it often suffers from negative transfer – impaired learning if tasks are not appropriately selected. We introduce a sequential subnetwork routing (SeqSNR) architecture that uses soft parameter sharing to find related tasks and encourage cross-learning between them.

Materials and Methods

Using the MIMIC-III (Medical Information Mart for Intensive Care-III) dataset, we train deep neural network models to predict the onset of 6 endpoints including specific organ dysfunctions and general clinical outcomes: acute kidney injury, continuous renal replacement therapy, mechanical ventilation, vasoactive medications, mortality, and length of stay. We compare single-task (ST) models with naive multitask and SeqSNR in terms of discriminative performance and label efficiency.

Results

SeqSNR showed a modest yet statistically significant performance boost across 4 of 6 tasks compared with ST and naive multitasking. When the size of the training dataset was reduced for a given task (label efficiency), SeqSNR outperformed ST for all cases showing an average area under the precision-recall curve boost of 2.1%, 2.9%, and 2.1% for tasks using 1%, 5%, and 10% of labels, respectively.

Conclusions

The SeqSNR architecture shows superior label efficiency compared with ST and naive multitasking, suggesting utility in scenarios in which endpoint labels are difficult to ascertain.

Fast temporal dynamics and causal relevance of face processing in the human temporal cortex

We measured the fast temporal dynamics of face processing simultaneously across the human temporal cortex (TC) using intracranial recordings in eight participants. We found sites with selective responses to faces clustered in the ventral TC, which responded increasingly strongly to marine animal, bird, mammal, and human faces. Both face-selective and face-active but non-selective sites showed a posterior to anterior gradient in response time and selectivity. A sparse model focusing on information from the human face-selective sites performed as well as, or better than, anatomically distributed models when discriminating faces from non-faces stimuli. Additionally, we identified the posterior fusiform site (pFUS) as causally the most relevant node for inducing distortion of conscious face processing by direct electrical stimulation. These findings support anatomically discrete but temporally distributed response profiles in the human brain and provide a new common ground for unifying the seemingly contradictory modular and distributed modes of face processing.

Predicting anxiety from wholebrain activity patterns to emotional faces in young adults: a machine learning approach

Background

It is becoming increasingly clear that pathophysiological processes underlying psychiatric disorders categories are heterogeneous on many levels, including symptoms, disease course, comorbidity and biological underpinnings. This heterogeneity poses challenges for identifying biological markers associated with dimensions of symptoms and behaviour that could provide targets to guide treatment choice and novel treatment. In response, the research domain criteria (RDoC) (Insel et al., 2010) was developed to advocate a dimensional approach which omits any disease definitions, disorder thresholds, or cut-points for various levels of psychopathology to understanding the pathophysiological processes underlying psychiatry disorders. In the present study we aimed to apply pattern regression analysis to identify brain signatures during dynamic emotional face processing that are predictive of anxiety and depression symptoms in a continuum that ranges from normal to pathological levels, cutting across categorically-defined diagnoses.

Methods

The sample was composed of one-hundred and fifty-four young adults (mean age=21.6 and s.d.=2.0, 103 females) consisting of eighty-two young adults seeking treatment for psychological distress that cut across categorically-defined diagnoses and 72 matched healthy young adults. Participants performed a dynamic face task involving fearful, angry and happy faces (and geometric shapes) while undergoing functional Magnetic Resonance Imaging (fMRI). Pattern regression analyses consisted of Gaussian Process Regression (GPR) implemented in the Pattern Recognition for Neuroimaging toolbox (PRoNTo). Predicted and actual clinical scores were compared using Pearson's correlation coefficient (r) and normalized mean squared error (MSE) to evaluate the models' performance. Permutation test was applied to estimate significance levels.

Results

GPR identified patterns of neural activity to dynamic emotional face processing predictive of self-report anxiety in the whole sample, which covered a continuum that ranged from healthy to different levels of distress, including subthreshold to fully-syndromal psychiatric diagnoses. Results were significant using two different cross validation strategies (two-fold: r=0.28 (p-value=0.001), MSE=4.47 (p-value=0.001) and five fold r=0.28 (p-value=0.002), MSE=4.62 (p-value=0.003). The contributions of individual regions to the predictive model were very small, demonstrating that predictions were based on the overall pattern rather than on a small combination of regions.

Conclusions

These findings represent early evidence that neuroimaging techniques may inform clinical assessment of young adults irrespective of diagnoses by allowing accurate and objective quantitative estimation of psychopathology.

•

The RDoC advocate a dimensional approach which omits any disorder thresholds.

•

Combine fMRI and pattern regression to predict dimensional psychiatry symptoms.

•

Patterns of neural activity predict anxiety which covered a continuum.

•

Neuroimaging inform clinical assessment of adults from healthy to different levels of distress.

Embedding Anatomical or Functional Knowledge in Whole-Brain Multiple Kernel Learning Models

Pattern recognition models have been increasingly applied to neuroimaging data over the last two decades. These applications have ranged from cognitive neuroscience to clinical problems. A common limitation of these approaches is that they do not incorporate previous knowledge about the brain structure and function into the models. Previous knowledge can be embedded into pattern recognition models by imposing a grouping structure based on anatomically or functionally defined brain regions. In this work, we present a novel approach that uses group sparsity to model the whole brain multivariate pattern as a combination of regional patterns. More specifically, we use a sparse version of Multiple Kernel Learning (MKL) to simultaneously learn the contribution of each brain region, previously defined by an atlas, to the decision function. Our application of MKL provides two beneficial features: (1) it can lead to improved overall generalisation performance when the grouping structure imposed by the atlas is consistent with the data; (2) it can identify a subset of relevant brain regions for the predictive model. In order to investigate the effect of the grouping in the proposed MKL approach we compared the results of three different atlases using three different datasets. The method has been implemented in the new version of the open-source Pattern Recognition for Neuroimaging Toolbox (PRoNTo).

Correlation between resting state fMRI total neuronal activity and PET metabolism in healthy controls and patients with disorders of consciousness

INTRODUCTION

The mildly invasive 18F-fluorodeoxyglucose positron emission tomography (FDG-PET) is a well-established imaging technique to measure 'resting state' cerebral metabolism. This technique made it possible to assess changes in metabolic activity in clinical applications, such as the study of severe brain injury and disorders of consciousness.

OBJECTIVE

We assessed the possibility of creating functional MRI activity maps, which could estimate the relative levels of activity in FDG-PET cerebral metabolic maps. If no metabolic absolute measures can be extracted, our approach may still be of clinical use in centers without access to FDG-PET. It also overcomes the problem of recognizing individual networks of independent component selection in functional magnetic resonance imaging (fMRI) resting state analysis.

METHODS

We extracted resting state fMRI functional connectivity maps using independent component analysis and combined only components of neuronal origin. To assess neuronality of components a classification based on support vector machine (SVM) was used. We compared the generated maps with the FDG-PET maps in 16 healthy controls, 11 vegetative state/unresponsive wakefulness syndrome patients and four locked-in patients.

RESULTS

The results show a significant similarity with ρ = 0.75 ± 0.05 for healthy controls and ρ = 0.58 ± 0.09 for vegetative state/unresponsive wakefulness syndrome patients between the FDG-PET and the fMRI based maps. FDG-PET, fMRI neuronal maps, and the conjunction analysis show decreases in frontoparietal and medial regions in vegetative patients with respect to controls. Subsequent analysis in locked-in syndrome patients produced also consistent maps with healthy controls.

CONCLUSIONS

The constructed resting state fMRI functional connectivity map points toward the possibility for fMRI resting state to estimate relative levels of activity in a metabolic map.

Decoding intracranial EEG data with multiple kernel learning method

•

Multiple Kernel Learning (MKL) can explore multiple dimensions simultaneously.

•

MKL method is sparse and performs feature selection during modeling of the data.

•

We propose to use the MKL method to analyze electrophysiology data (EEG or MEG).

•

We provide a prototype example of how MKL method can apply to ECoG data.

•

We show multiple dimensions of ECoG signal can contribute to numerical processing.

Background

Machine learning models have been successfully applied to neuroimaging data to make predictions about behavioral and cognitive states of interest. While these multivariate methods have greatly advanced the field of neuroimaging, their application to electrophysiological data has been less common especially in the analysis of human intracranial electroencephalography (iEEG, also known as electrocorticography or ECoG) data, which contains a rich spectrum of signals recorded from a relatively high number of recording sites.

New method

In the present work, we introduce a novel approach to determine the contribution of different bandwidths of EEG signal in different recording sites across different experimental conditions using the Multiple Kernel Learning (MKL) method.

Comparison with existing method

To validate and compare the usefulness of our approach, we applied this method to an ECoG dataset that was previously analysed and published with univariate methods.

Results

Our findings proved the usefulness of the MKL method in detecting changes in the power of various frequency bands during a given task and selecting automatically the most contributory signal in the most contributory site(s) of recording.

Conclusions

With a single computation, the contribution of each frequency band in each recording site in the estimated multivariate model can be highlighted, which then allows formulation of hypotheses that can be tested a posteriori with univariate methods if needed.

Cross-Modal Decoding of Neural Patterns Associated with Working Memory: Evidence for Attention-Based Accounts of Working Memory

Recent studies suggest common neural substrates involved in verbal and visual working memory (WM), interpreted as reflecting shared attention-based, short-term retention mechanisms. We used a machine-learning approach to determine more directly the extent to which common neural patterns characterize retention in verbal WM and visual WM. Verbal WM was assessed via a standard delayed probe recognition task for letter sequences of variable length. Visual WM was assessed via a visual array WM task involving the maintenance of variable amounts of visual information in the focus of attention. We trained a classifier to distinguish neural activation patterns associated with high- and low-visual WM load and tested the ability of this classifier to predict verbal WM load (high-low) from their associated neural activation patterns, and vice versa. We observed significant between-task prediction of load effects during WM maintenance, in posterior parietal and superior frontal regions of the dorsal attention network; in contrast, between-task prediction in sensory processing cortices was restricted to the encoding stage. Furthermore, between-task prediction of load effects was strongest in those participants presenting the highest capacity for the visual WM task. This study provides novel evidence for common, attention-based neural patterns supporting verbal and visual WM.

Biased binomial assessment of cross-validated estimation of classification accuracies illustrated in diagnosis predictions

Multivariate classification is used in neuroimaging studies to infer brain activation or in medical applications to infer diagnosis. Their results are often assessed through either a binomial or a permutation test. Here, we simulated classification results of generated random data to assess the influence of the cross-validation scheme on the significance of results. Distributions built from classification of random data with cross-validation did not follow the binomial distribution. The binomial test is therefore not adapted. On the contrary, the permutation test was unaffected by the cross-validation scheme. The influence of the cross-validation was further illustrated on real-data from a brain-computer interface experiment in patients with disorders of consciousness and from an fMRI study on patients with Parkinson disease. Three out of 16 patients with disorders of consciousness had significant accuracy on binomial testing, but only one showed significant accuracy using permutation testing. In the fMRI experiment, the mental imagery of gait could discriminate significantly between idiopathic Parkinson's disease patients and healthy subjects according to the permutation test but not according to the binomial test. Hence, binomial testing could lead to biased estimation of significance and false positive or negative results. In our view, permutation testing is thus recommended for clinical application of classification with cross-validation.

PRoNTo: pattern recognition for neuroimaging toolbox

In the past years, mass univariate statistical analyses of neuroimaging data have been complemented by the use of multivariate pattern analyses, especially based on machine learning models. While these allow an increased sensitivity for the detection of spatially distributed effects compared to univariate techniques, they lack an established and accessible software framework. The goal of this work was to build a toolbox comprising all the necessary functionalities for multivariate analyses of neuroimaging data, based on machine learning models. The “Pattern Recognition for Neuroimaging Toolbox” (PRoNTo) is open-source, cross-platform, MATLAB-based and SPM compatible, therefore being suitable for both cognitive and clinical neuroscience research. In addition, it is designed to facilitate novel contributions from developers, aiming to improve the interaction between the neuroimaging and machine learning communities. Here, we introduce PRoNTo by presenting examples of possible research questions that can be addressed with the machine learning framework implemented in PRoNTo, and cannot be easily investigated with mass univariate statistical analysis.

Multiclass classification of FDG PET scans for the distinction between Parkinson's disease and atypical parkinsonian syndromes

Most available pattern recognition methods in neuroimaging address binary classification problems. Here, we used relevance vector machine (RVM) in combination with booststrap resampling (‘bagging’) for non-hierarchical multiclass classification. The method was tested on 120 cerebral ¹⁸fluorodeoxyglucose (FDG) positron emission tomography (PET) scans performed in patients who exhibited parkinsonian clinical features for 3.5 years on average but that were outside the prevailing perception for Parkinson's disease (PD). A radiological diagnosis of PD was suggested for 30 patients at the time of PET imaging. However, at follow-up several years after PET imaging, 42 of them finally received a clinical diagnosis of PD. The remaining 78 APS patients were diagnosed with multiple system atrophy (MSA, N = 31), progressive supranuclear palsy (PSP, N = 26) and corticobasal syndrome (CBS, N = 21), respectively. With respect to this standard of truth, classification sensitivity, specificity, positive and negative predictive values for PD were 93% 83% 75% and 96%, respectively using binary RVM (PD vs. APS) and 90%, 87%, 79% and 94%, respectively, using multiclass RVM (PD vs. MSA vs. PSP vs. CBS). Multiclass RVM achieved 45%, 55% and 62% classification accuracy for, MSA, PSP and CBS, respectively. Finally, a majority confidence ratio was computed for each scan on the basis of class pairs that were the most frequently assigned by RVM. Altogether, the results suggest that automatic multiclass RVM classification of FDG PET scans achieves adequate performance for the early differentiation between PD and APS on the basis of cerebral FDG uptake patterns when the clinical diagnosis is felt uncertain. This approach cannot be recommended yet as an aid for distinction between the three APS classes under consideration.

•

Multiclass classification is one of the challenges of computer-aided diagnosis.

•

This was addressed here using relevance vector machine and bootstrap aggregation.

•

Performance was tested on FDG-PET scans from 120 parkinsonian patients.

•

Four diagnostic classes under consideration as defined on average 3.5 years after PET.

•

Confusion matrices, majority confidence ratio and discriminant maps were computed.

Decoding semi-constrained brain activity from FMRI using support vector machines and gaussian processes

Predicting a particular cognitive state from a specific pattern of fMRI voxel values is still a methodological challenge. Decoding brain activity is usually performed in highly controlled experimental paradigms characterized by a series of distinct states induced by a temporally constrained experimental design. In more realistic conditions, the number, sequence and duration of mental states are unpredictably generated by the individual, resulting in complex and imbalanced fMRI data sets. This study tests the classification of brain activity, acquired on 16 volunteers using fMRI, during mental imagery, a condition in which the number and duration of mental events were not externally imposed but self-generated. To deal with these issues, two classification techniques were considered (Support Vector Machines, SVM, and Gaussian Processes, GP), as well as different feature extraction methods (General Linear Model, GLM and SVM). These techniques were combined in order to identify the procedures leading to the highest accuracy measures. Our results showed that 12 data sets out of 16 could be significantly modeled by either SVM or GP. Model accuracies tended to be related to the degree of imbalance between classes and to task performance of the volunteers. We also conclude that the GP technique tends to be more robust than SVM to model unbalanced data sets.

Brain functional integration decreases during propofol-induced loss of consciousness

Consciousness has been related to the amount of integrated information that the brain is able to generate. In this paper, we tested the hypothesis that the loss of consciousness caused by propofol anesthesia is associated with a significant reduction in the capacity of the brain to integrate information. To assess the functional structure of the whole brain, functional integration and partial correlations were computed from fMRI data acquired from 18 healthy volunteers during resting wakefulness and propofol-induced deep sedation. Total integration was significantly reduced from wakefulness to deep sedation in the whole brain as well as within and between its constituent networks (or systems). Integration was systematically reduced within each system (i.e., brain or networks), as well as between networks. However, the ventral attentional network maintained interactions with most other networks during deep sedation. Partial correlations further suggested that functional connectivity was particularly affected between parietal areas and frontal or temporal regions during deep sedation. Our findings suggest that the breakdown in brain integration is the neural correlate of the loss of consciousness induced by propofol. They stress the important role played by parietal and frontal areas in the generation of consciousness.