1
|
MacInnes JJ, Adcock RA, Stocco A, Prat CS, Rao RPN, Dickerson KC. Pyneal: Open Source Real-Time fMRI Software. Front Neurosci 2020; 14:900. [PMID: 33041750 PMCID: PMC7522368 DOI: 10.3389/fnins.2020.00900] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2020] [Accepted: 08/03/2020] [Indexed: 11/13/2022] Open
Abstract
Increasingly, neuroimaging researchers are exploring the use of real-time functional magnetic resonance imaging (rt-fMRI) as a way to access a participant's ongoing brain function throughout a scan. This approach presents novel and exciting experimental applications ranging from monitoring data quality in real time, to delivering neurofeedback from a region of interest, to dynamically controlling experimental flow, or interfacing with remote devices. Yet, for those interested in adopting this method, the existing software options are few and limited in application. This presents a barrier for new users, as well as hinders existing users from refining techniques and methods. Here we introduce a free, open-source rt-fMRI package, the Pyneal toolkit, designed to address this limitation. The Pyneal toolkit is python-based software that offers a flexible and user friendly framework for rt-fMRI, is compatible with all three major scanner manufacturers (GE, Siemens, Phillips), and, critically, allows fully customized analysis pipelines. In this article, we provide a detailed overview of the architecture, describe how to set up and run the Pyneal toolkit during an experimental session, offer tutorials with scan data that demonstrate how data flows through the Pyneal toolkit with example analyses, and highlight the advantages that the Pyneal toolkit offers to the neuroimaging community.
Collapse
Affiliation(s)
- Jeff J. MacInnes
- Institute for Learning and Brain Sciences, University of Washington, Seattle, WA, United States
| | - R. Alison Adcock
- Department of Psychiatry and Behavioral Sciences, Center for Cognitive Neuroscience, Duke Institute for Brain Sciences, Duke University, Durham, NC, United States
| | - Andrea Stocco
- Institute for Learning and Brain Sciences, University of Washington, Seattle, WA, United States
- Department of Psychology, University of Washington, Seattle, WA, United States
| | - Chantel S. Prat
- Institute for Learning and Brain Sciences, University of Washington, Seattle, WA, United States
- Department of Psychology, University of Washington, Seattle, WA, United States
| | - Rajesh P. N. Rao
- Department of Computer Science and Engineering, Center for Neurotechnology, University of Washington, Seattle, WA, United States
| | - Kathryn C. Dickerson
- Department of Psychiatry and Behavioral Sciences, Center for Cognitive Neuroscience, Duke Institute for Brain Sciences, Duke University, Durham, NC, United States
| |
Collapse
|
2
|
Kopel R, Sladky R, Laub P, Koush Y, Robineau F, Hutton C, Weiskopf N, Vuilleumier P, Van De Ville D, Scharnowski F. No time for drifting: Comparing performance and applicability of signal detrending algorithms for real-time fMRI. Neuroimage 2019; 191:421-429. [PMID: 30818024 PMCID: PMC6503944 DOI: 10.1016/j.neuroimage.2019.02.058] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2018] [Revised: 02/19/2019] [Accepted: 02/22/2019] [Indexed: 01/15/2023] Open
Abstract
As a consequence of recent technological advances in the field of functional magnetic resonance imaging (fMRI), results can now be made available in real-time. This allows for novel applications such as online quality assurance of the acquisition, intra-operative fMRI, brain-computer-interfaces, and neurofeedback. To that aim, signal processing algorithms for real-time fMRI must reliably correct signal contaminations due to physiological noise, head motion, and scanner drift. The aim of this study was to compare performance of the commonly used online detrending algorithms exponential moving average (EMA), incremental general linear model (iGLM) and sliding window iGLM (iGLMwindow). For comparison, we also included offline detrending algorithms (i.e., MATLAB's and SPM8's native detrending functions). Additionally, we optimized the EMA control parameter, by assessing the algorithm's performance on a simulated data set with an exhaustive set of realistic experimental design parameters. First, we optimized the free parameters of the online and offline detrending algorithms. Next, using simulated data, we systematically compared the performance of the algorithms with respect to varying levels of Gaussian and colored noise, linear and non-linear drifts, spikes, and step function artifacts. Additionally, using in vivo data from an actual rt-fMRI experiment, we validated our results in a post hoc offline comparison of the different detrending algorithms. Quantitative measures show that all algorithms perform well, even though they are differently affected by the different artifact types. The iGLM approach outperforms the other online algorithms and achieves online detrending performance that is as good as that of offline procedures. These results may guide developers and users of real-time fMRI analyses tools to best account for the problem of signal drifts in real-time fMRI.
Collapse
Affiliation(s)
- R Kopel
- Department of Radiology and Medical Informatics, CIBM, University of Geneva, Geneva, Switzerland; Institute of Bioengineering, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - R Sladky
- Department of Psychiatric, Psychotherapy and Psychosomatics, Psychiatric Hospital, University of Zürich, Zürich, Switzerland; Social, Cognitive and Affective Neuroscience Unit, Department of Basic Psychological Research and Research Methods, Faculty of Psychology, University of Vienna, Vienna, Austria.
| | - P Laub
- Institute of Bioengineering, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Y Koush
- Department of Radiology and Medical Informatics, CIBM, University of Geneva, Geneva, Switzerland; Institute of Bioengineering, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland; Department of Radiology and Medical Imaging, Yale University, New Haven, USA
| | - F Robineau
- Laboratory for Behavioral Neurology and Imaging of Cognition, Department of Neuroscience, University Medical Center, Geneva, Switzerland; Geneva Neuroscience Center, Geneva, Switzerland
| | - C Hutton
- Wellcome Trust Centre for Neuroimaging, UCL Institute of Neurology, University College London, London, UK
| | - N Weiskopf
- Geneva Neuroscience Center, Geneva, Switzerland; Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - P Vuilleumier
- Laboratory for Behavioral Neurology and Imaging of Cognition, Department of Neuroscience, University Medical Center, Geneva, Switzerland; Geneva Neuroscience Center, Geneva, Switzerland
| | - D Van De Ville
- Department of Radiology and Medical Informatics, CIBM, University of Geneva, Geneva, Switzerland; Institute of Bioengineering, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - F Scharnowski
- Department of Radiology and Medical Informatics, CIBM, University of Geneva, Geneva, Switzerland; Institute of Bioengineering, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland; Department of Psychiatric, Psychotherapy and Psychosomatics, Psychiatric Hospital, University of Zürich, Zürich, Switzerland; Neuroscience Center Zürich, University of Zürich and Swiss Federal Institute of Technology, Winterthurerstr. 190, 8057, Zürich, Switzerland; Zürich Center for Integrative Human Physiology (ZIHP), University of Zürich, Winterthurerstr. 190, 8057, Zürich, Switzerland
| |
Collapse
|
3
|
Heunis S, Besseling R, Lamerichs R, de Louw A, Breeuwer M, Aldenkamp B, Bergmans J. Neu 3CA-RT: A framework for real-time fMRI analysis. Psychiatry Res Neuroimaging 2018; 282:90-102. [PMID: 30293911 DOI: 10.1016/j.pscychresns.2018.09.008] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/06/2018] [Revised: 09/25/2018] [Accepted: 09/27/2018] [Indexed: 10/28/2022]
Abstract
Real-time functional magnetic resonance imaging (rtfMRI) allows visualisation of ongoing brain activity of the subject in the scanner. Denoising algorithms aim to rid acquired data of confounding effects, enhancing the blood oxygenation level-dependent (BOLD) signal. Further image processing and analysis methods, like general linear models (GLM) or multivariate analysis, then present application-specific information to the researcher. These processes are typically applied to regions of interest but, increasingly, rtfMRI techniques extract and classify whole brain functional networks and dynamics as correlates for brain states or behaviour, particularly in neuropsychiatric and neurocognitive disorders. We present Neu3CA-RT: a Matlab-based rtfMRI analysis framework aiming to advance scientific knowledge on real-time cognitive brain activity and to promote its translation into clinical practice. Design considerations are listed based on reviewing existing rtfMRI approaches. The toolbox integrates established SPM preprocessing routines, real-time GLM mapping of fMRI data to a basis set of spatial brain networks, correlation of activity with 50 behavioural profiles from the BrainMap database, and an intuitive user interface. The toolbox is demonstrated in a task-based experiment where a subject executes visual, auditory and motor tasks inside a scanner. In three out of four experiments, resulting behavioural profiles agreed with the expected brain state.
Collapse
Affiliation(s)
- Stephan Heunis
- Department of Electrical Engineering, Eindhoven University of Technology, Postal address: PO box 513; Flux buidling, room 7.066, 5600MB Eindhoven, The Netherlands.
| | - René Besseling
- Department of Electrical Engineering, Eindhoven University of Technology, Postal address: PO box 513; Flux buidling, room 7.066, 5600MB Eindhoven, The Netherlands; Department of Research and Development, Epilepsy Centre Kempenhaeghe, Heeze, The Netherlands
| | - Rolf Lamerichs
- Department of Electrical Engineering, Eindhoven University of Technology, Postal address: PO box 513; Flux buidling, room 7.066, 5600MB Eindhoven, The Netherlands; Philips Research Laboratories Eindhoven, Eindhoven, The Netherlands
| | - Anton de Louw
- Department of Electrical Engineering, Eindhoven University of Technology, Postal address: PO box 513; Flux buidling, room 7.066, 5600MB Eindhoven, The Netherlands; Department of Research and Development, Epilepsy Centre Kempenhaeghe, Heeze, The Netherlands
| | - Marcel Breeuwer
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands; Philips Healthcare, Best, The Netherlands
| | - Bert Aldenkamp
- Department of Electrical Engineering, Eindhoven University of Technology, Postal address: PO box 513; Flux buidling, room 7.066, 5600MB Eindhoven, The Netherlands; Department of Research and Development, Epilepsy Centre Kempenhaeghe, Heeze, The Netherlands; Laboratory for Clinical and Experimental Neurophysiology, Neurobiology and Neuropsychology, Ghent University Hospital, Ghent, Belgium; Department of Neurology, Maastricht University Medical Center, Maastricht, The Netherlands
| | - Jan Bergmans
- Department of Electrical Engineering, Eindhoven University of Technology, Postal address: PO box 513; Flux buidling, room 7.066, 5600MB Eindhoven, The Netherlands
| |
Collapse
|
4
|
Assessment of physical function and participation in chronic pain clinical trials: IMMPACT/OMERACT recommendations. Pain 2017; 157:1836-1850. [PMID: 27058676 DOI: 10.1097/j.pain.0000000000000577] [Citation(s) in RCA: 141] [Impact Index Per Article: 17.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Although pain reduction is commonly the primary outcome in chronic pain clinical trials, physical functioning is also important. A challenge in designing chronic pain trials to determine efficacy and effectiveness of therapies is obtaining appropriate information about the impact of an intervention on physical function. The Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT) and Outcome Measures in Rheumatology (OMERACT) convened a meeting to consider assessment of physical functioning and participation in research on chronic pain. The primary purpose of this article is to synthesize evidence on the scope of physical functioning to inform work on refining physical function outcome measurement. We address issues in assessing this broad construct and provide examples of frequently used measures of relevant concepts. Investigators can assess physical functioning using patient-reported outcome (PRO), performance-based, and objective measures of activity. This article aims to provide support for the use of these measures, covering broad aspects of functioning, including work participation, social participation, and caregiver burden, which researchers should consider when designing chronic pain clinical trials. Investigators should consider the inclusion of both PROs and performance-based measures as they provide different but also important complementary information. The development and use of reliable and valid PROs and performance-based measures of physical functioning may expedite development of treatments, and standardization of these measures has the potential to facilitate comparison across studies. We provide recommendations regarding important domains to stimulate research to develop tools that are more robust, address consistency and standardization, and engage patients early in tool development.
Collapse
|
5
|
Feng IJ, Jack AI, Tatsuoka C. Dynamic adjustment of stimuli in real time functional magnetic resonance imaging. PLoS One 2015; 10:e0117942. [PMID: 25785856 PMCID: PMC4364703 DOI: 10.1371/journal.pone.0117942] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2013] [Accepted: 01/06/2015] [Indexed: 11/19/2022] Open
Abstract
The conventional fMRI image analysis approach to associating stimuli to brain activation is performed by carrying out a massive number of parallel univariate regression analyses. fMRI blood-oxygen-level dependent (BOLD) signal, the basis of these analyses, is known for its low signal-noise-ratio and high spatial and temporal signal correlation. In order to ensure accurate localization of brain activity, stimulus administration in an fMRI session is often lengthy and repetitive. Real-time fMRI BOLD signal analysis is carried out as the signal is observed. This method allows for dynamic, real-time adjustment of stimuli through sequential experimental designs. We have developed a voxel-wise sequential probability ratio test (SPRT) approach for dynamically determining localization, as well as decision rules for stopping stimulus administration. SPRT methods and general linear model (GLM) approaches are combined to identify brain regions that are activated by specific elements of stimuli. Stimulus administration is dynamically stopped when sufficient statistical evidence is collected to determine activation status across regions of interest, following predetermined statistical error thresholds. Simulation experiments and an example based on real fMRI data show that scan volumes can be substantially reduced when compared with pre-determined, fixed designs while achieving similar or better accuracy in detecting activated voxels. Moreover, the proposed approach is also able to accurately detect differentially activated areas, and other comparisons between task-related GLM parameters that can be formulated in a hypothesis-testing framework. Finally, we give a demonstration of SPRT being employed in conjunction with a halving algorithm to dynamically adjust stimuli.
Collapse
Affiliation(s)
- I. Jung Feng
- Case Western Reserve University, Department of Epidemiology and Biostatistics, Cleveland, Ohio, United States of America
| | - Anthony I. Jack
- Case Western Reserve University, Department of Cognitive Science, Cleveland, Ohio, United States of America
| | - Curtis Tatsuoka
- Case Western Reserve University, Department of Epidemiology and Biostatistics, Cleveland, Ohio, United States of America
- Case Western Reserve University, Department of Neurology, Cleveland, Ohio, United States of America
- * E-mail:
| |
Collapse
|
6
|
Magland JF, Childress AR. Task-correlated facial and head movements in classifier-based real-time FMRI. J Neuroimaging 2013; 24:371-8. [PMID: 23551805 DOI: 10.1111/jon.12015] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2012] [Revised: 12/12/2012] [Accepted: 12/21/2012] [Indexed: 12/01/2022] Open
Abstract
BACKGROUND Real-time fMRI is especially vulnerable to task-correlated movement artifacts because statistical methods normally available in conventional analyses to remove such signals cannot be used in the context of real-time fMRI. Multi-voxel classifier-based methods, although advantageous in many respects, are particularly sensitive. Here we systematically studied various movements of the head and face to determine to what extent these can "masquerade" as signal in multi-voxel classifiers. METHODS Ten subjects were instructed to move systematically (twelve instructed movements) throughout fMRI exams and data from a previously published real-time study was also analyzed to determine the extent to which non-neural signals contributed to the high reported accuracy in classifier output. RESULTS Of potential concern, whole-brain classifiers based solely on movements exhibited false positives in all cases (P < .05). Artifacts were also observed in the spatial activation maps for two of the twelve movement tasks. In the retrospective analysis, it was determined that the relatively high reported classification accuracies were (fortunately) mostly explainable by neural activity, but that in some cases performance was likely dominated by movements. CONCLUSION Movement tasks of many types (including movements of the eyes, face, and body) can lead to false positives in classifier-based real-time fMRI paradigms.
Collapse
Affiliation(s)
- Jeremy F Magland
- Department of Radiology, University of Pennsylvania Perelman School of Medicine, Philadelphia
| | | |
Collapse
|
7
|
Soldati N, Calhoun VD, Bruzzone L, Jovicich J. The Use of a priori Information in ICA-Based Techniques for Real-Time fMRI: An Evaluation of Static/Dynamic and Spatial/Temporal Characteristics. Front Hum Neurosci 2013; 7:64. [PMID: 23483841 PMCID: PMC3593622 DOI: 10.3389/fnhum.2013.00064] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2012] [Accepted: 02/18/2013] [Indexed: 11/13/2022] Open
Abstract
Real-time brain functional MRI (rt-fMRI) allows in vivo non-invasive monitoring of neural networks. The use of multivariate data-driven analysis methods such as independent component analysis (ICA) offers an attractive trade-off between data interpretability and information extraction, and can be used during both task-based and rest experiments. The purpose of this study was to assess the effectiveness of different ICA-based procedures to monitor in real-time a target IC defined from a functional localizer which also used ICA. Four novel methods were implemented to monitor ongoing brain activity in a sliding window approach. The methods differed in the ways in which a priori information, derived from ICA algorithms, was used to monitor a target independent component (IC). We implemented four different algorithms, all based on ICA. One Back-projection method used ICA to derive static spatial information from the functional localizer, off-line, which was then back-projected dynamically during the real-time acquisition. The other three methods used real-time ICA algorithms that dynamically exploited temporal, spatial, or spatial-temporal priors during the real-time acquisition. The methods were evaluated by simulating a rt-fMRI experiment that used real fMRI data. The performance of each method was characterized by the spatial and/or temporal correlation with the target IC component monitored, computation time, and intrinsic stochastic variability of the algorithms. In this study the Back-projection method, which could monitor more than one IC of interest, outperformed the other methods. These results are consistent with a functional task that gives stable target ICs over time. The dynamic adaptation possibilities offered by the other ICA methods proposed may offer better performance than the Back-projection in conditions where the functional activation shows higher spatial and/or temporal variability.
Collapse
Affiliation(s)
- Nicola Soldati
- Center for Mind/Brain Sciences, University of Trento Trento, Italy
| | | | | | | |
Collapse
|
8
|
Micoulaud-Franchi JA, Fakra E, Cermolacce M, Vion-Dury J. [Towards a new approach of neurophysiology in clinical psychiatry: functional magnetic resonance imaging neurofeedback applied to emotional dysfunctions]. Neurophysiol Clin 2012; 42:79-94. [PMID: 22500698 DOI: 10.1016/j.neucli.2011.12.002] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2011] [Revised: 10/25/2011] [Accepted: 12/27/2011] [Indexed: 10/14/2022] Open
Abstract
Emotions color in a singular way our everyday life and constitute important determinants of human cognition and behavior. Emotional regulation is an essential process involved in neuropathophysiology and therapeutic efficacy in many psychiatric disorders. Yet, traditional psychiatric therapeutic has focused on symptomatic rather than neurophysiological criteria. Therefore, it was proposed to teach patients to modify their own brain activity directly, in order to obtain a therapeutic effect. These techniques, which are named neurofeedback, were originally developed using electroencephalography. Recent technical advances in fMRI enable real-time acquisition, and open opportunities to its utilization in neurofeedback. This seems particularly interesting in emotion regulation, which, at a neurofunctional level, lies on cortico-limbic pathways that, in great parts, were previously identified by traditional fMRI paradigms. This emotion regulation plays a central role in the etiopathogeny psychiatric, especially depressive and anxious, disorders. It is possible to devise new therapeutic strategies and research approach for addressing directly the neurophysiological processes of emotion regulation by integrating the neurofunctional activities of a subject. These prospects seem to be in line with the neurophenomenology project, which proposes to establish a link between subjective experiences and objective neurophysiological measures.
Collapse
Affiliation(s)
- J-A Micoulaud-Franchi
- Solaris, pôle de psychiatrie universitaire, CHU Sainte-Marguerite, 270, boulevard Sainte-Marguerite, 13009 Marseille, France.
| | | | | | | |
Collapse
|