1
|
Hartman AG, Caspero K, Bodison SC, Soehner A, Akcakaya M, DeAlmeida D, Bendixen R. Pediatric Occupational Therapists' Perspectives on Sleep: A Qualitative Descriptive Study. Am J Occup Ther 2024; 78:7803205010. [PMID: 38512128 DOI: 10.5014/ajot.2024.050352] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/22/2024] Open
Abstract
IMPORTANCE Insufficient sleep is common among children seeking occupational therapy services but is rarely a focus of therapy despite sleep's critical impact on health. OBJECTIVE To examine pediatric occupational therapists' experiences, views, and confidence in addressing sleep concerns in their practice as well as barriers to and supports for doing so. DESIGN A qualitative descriptive study with thematic analysis of data from 1-hr virtual interviews. Rapport building, multiple-coder analysis, and member checking were used to ensure reliability and validity. SETTING Interviews were conducted remotely at each participant's preferred time and location. PARTICIPANTS Pediatric occupational therapists (N = 20) practicing across multiple settings in the United States were recruited through emails directed to their place of work and social media posts. A goal of 20 participants was set a priori with the goal of thematic saturation. OUTCOMES AND MEASURES A semistructured interview guide. RESULTS Participants were predominately cisgender (95%), female (85%), and White, non-Hispanic (90%). Overall, they voiced the importance of sleep but reported almost never writing sleep-related goals. Reported barriers that affected the participants' ability to fully address sleep in practice included therapists' lack of confidence and knowledge and low caregiver buy-in. CONCLUSIONS AND RELEVANCE The findings identify themes on the basis of which actionable steps toward promoting occupational therapists as sleep champions can be developed. Future implications include increasing sleep education opportunities, enhancing awareness of sleep health's impact on goal areas, and facilitating discussions about occupational therapy's role within the medical system and family system in supporting sleep. Plain-Language Summary: This qualitative study identifies what helps and hinders occupational therapists in addressing the sleep health concerns of their clients. We give occupational therapy clinicians and educators key supports to seek out or barriers to address.
Collapse
Affiliation(s)
- Amy G Hartman
- Amy G. Hartman, PhD, OTR/L, is Postdoctoral Fellow, Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA;
| | - Kaitlyn Caspero
- Kaitlyn Caspero, MS, OTR/L, is Occupational Therapist and Founder, OT Graphically, Frederick, MD
| | - Stefanie C Bodison
- Stefanie C. Bodison, OTD, OTR/L, FAOTA, is Assistant Professor, Department of Occupational Therapy, University of Florida, Gainesville
| | - Adriane Soehner
- Adriane Soehner, PhD, is Assistant Professor, Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA
| | - Murat Akcakaya
- Murat Akcakaya, PhD, is Associate Professor, Department of Engineering, University of Pittsburgh, Pittsburgh, PA
| | - Dilhari DeAlmeida
- Dilhari DeAlmeida, PhD, is Associate Professor and Program Director, Department of Health Information Management, University of Pittsburgh, Pittsburgh, PA
| | - Roxanna Bendixen
- Roxanna Bendixen, PhD, OTR/L, FAOTA, is Associate Professor and Division Director, Department of Occupational Therapy, Medical University of South Carolina, Charleston
| |
Collapse
|
2
|
Elkhadrawi M, Akcakaya M, Fulton S, Yates BJ, Fisher LE, Horn CC. Prediction of gastrointestinal functional state based on myoelectric recordings utilizing a deep neural network architecture. PLoS One 2023; 18:e0289076. [PMID: 37498882 PMCID: PMC10374095 DOI: 10.1371/journal.pone.0289076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Accepted: 07/10/2023] [Indexed: 07/29/2023] Open
Abstract
Functional and motility-related gastrointestinal (GI) disorders affect nearly 40% percent of the population. Disturbances of GI myoelectric activity have been proposed to play a significant role in these disorders. A significant barrier to usage of these signals in diagnosis and treatment is the lack of consistent relationships between GI myoelectric features and function. A potential cause of this issue is the use of arbitrary classification criteria, such as percentage of power in tachygastric and bradygastric frequency bands. Here we applied automatic feature extraction using a deep neural network architecture on GI myoelectric signals from free-moving ferrets. For each animal, we recorded during baseline control and feeding conditions lasting for 1 h. Data were trained on a 1-dimensional residual convolutional network, followed by a fully connected layer, with a decision based on a sigmoidal output. For this 2-class problem, accuracy was 90%, sensitivity (feeding detection) was 90%, and specificity (baseline detection) was 89%. By comparison, approaches using hand-crafted features (e.g., SVM, random forest, and logistic regression) produced an accuracy from 54% to 82%, sensitivity from 46% to 84% and specificity from 66% to 80%. These results suggest that automatic feature extraction and deep neural networks could be useful to assess GI function for comparing baseline to an active functional GI state, such as feeding. In future testing, the current approach could be applied to determine normal and disease-related GI myoelectric patterns to diagnosis and assess patients with GI disease.
Collapse
Affiliation(s)
- Mahmoud Elkhadrawi
- Department of Electrical and Computer Engineering, University of Pittsburgh School of Engineering, Pittsburgh, PA, United States of America
| | - Murat Akcakaya
- Department of Electrical and Computer Engineering, University of Pittsburgh School of Engineering, Pittsburgh, PA, United States of America
| | - Stephanie Fulton
- UPMC Hillman Cancer Center, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States of America
| | - Bill J. Yates
- Department of Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States of America
- Center for Neuroscience, University of Pittsburgh, Pittsburgh, PA, United States of America
| | - Lee E. Fisher
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, United States of America
- Department of Physical Medicine & Rehabilitation, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States of America
- Department of Bioengineering, University of Pittsburgh School of Engineering, Pittsburgh, PA, United States of America
| | - Charles C. Horn
- UPMC Hillman Cancer Center, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States of America
- Center for Neuroscience, University of Pittsburgh, Pittsburgh, PA, United States of America
- Division of Hematology/Oncology, Department of Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States of America
- Department of Anesthesiology and Perioperative Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States of America
| |
Collapse
|
3
|
Al-Zaiti SS, Martin-Gill C, Zègre-Hemsey JK, Bouzid Z, Faramand Z, Alrawashdeh MO, Gregg RE, Helman S, Riek NT, Kraevsky-Phillips K, Clermont G, Akcakaya M, Sereika SM, Van Dam P, Smith SW, Birnbaum Y, Saba S, Sejdic E, Callaway CW. Machine learning for ECG diagnosis and risk stratification of occlusion myocardial infarction. Nat Med 2023; 29:1804-1813. [PMID: 37386246 PMCID: PMC10353937 DOI: 10.1038/s41591-023-02396-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Accepted: 05/11/2023] [Indexed: 07/01/2023]
Abstract
Patients with occlusion myocardial infarction (OMI) and no ST-elevation on presenting electrocardiogram (ECG) are increasing in numbers. These patients have a poor prognosis and would benefit from immediate reperfusion therapy, but, currently, there are no accurate tools to identify them during initial triage. Here we report, to our knowledge, the first observational cohort study to develop machine learning models for the ECG diagnosis of OMI. Using 7,313 consecutive patients from multiple clinical sites, we derived and externally validated an intelligent model that outperformed practicing clinicians and other widely used commercial interpretation systems, substantially boosting both precision and sensitivity. Our derived OMI risk score provided enhanced rule-in and rule-out accuracy relevant to routine care, and, when combined with the clinical judgment of trained emergency personnel, it helped correctly reclassify one in three patients with chest pain. ECG features driving our models were validated by clinical experts, providing plausible mechanistic links to myocardial injury.
Collapse
Affiliation(s)
- Salah S Al-Zaiti
- Department of Acute & Tertiary Care Nursing, University of Pittsburgh, Pittsburgh, PA, USA.
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, PA, USA.
- Department of Electrical & Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA.
- Division of Cardiology, University of Pittsburgh, Pittsburgh, PA, USA.
| | - Christian Martin-Gill
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- University of Pittsburgh Medical Center, Pittsburgh, PA, USA
| | | | - Zeineb Bouzid
- Department of Electrical & Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Ziad Faramand
- Department of Emergency Medicine, Northeast Georgia Health System, Gainesville, GA, USA
| | - Mohammad O Alrawashdeh
- School of Nursing, Jordan University of Science and Technology, Irbid, Jordan
- Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, MA, USA
| | - Richard E Gregg
- Advanced Algorithm Development Center, Philips Healthcare, Cambridge, MA, USA
| | - Stephanie Helman
- Department of Acute & Tertiary Care Nursing, University of Pittsburgh, Pittsburgh, PA, USA
| | - Nathan T Riek
- Department of Electrical & Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA
| | | | - Gilles Clermont
- Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - Murat Akcakaya
- Department of Electrical & Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Susan M Sereika
- Department of Acute & Tertiary Care Nursing, University of Pittsburgh, Pittsburgh, PA, USA
| | - Peter Van Dam
- Division of Cardiology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Stephen W Smith
- Department of Emergency Medicine, Hennepin Healthcare, Minneapolis, MN, USA
- Department of Emergency Medicine, University of Minnesota, Minneapolis, MN, USA
| | - Yochai Birnbaum
- Division of Cardiology, Baylor College of Medicine, Houston, TX, USA
| | - Samir Saba
- Division of Cardiology, University of Pittsburgh, Pittsburgh, PA, USA
- University of Pittsburgh Medical Center, Pittsburgh, PA, USA
| | - Ervin Sejdic
- Department of Electrical & Computer Engineering, University of Toronto, Toronto, ON, Canada
- Artificial Intelligence for Health Outcomes at Research & Innovation, North York General Hospital, Toronto, ON, Canada
| | - Clifton W Callaway
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- University of Pittsburgh Medical Center, Pittsburgh, PA, USA
| |
Collapse
|
4
|
Riek NT, Susam BT, Hudac CM, Conner CM, Akcakaya M, Yun J, White SW, Mazefsky CA, Gable PA. Feedback Related Negativity Amplitude is Greatest Following Deceptive Feedback in Autistic Adolescents. J Autism Dev Disord 2023:10.1007/s10803-023-06038-y. [PMID: 37393370 DOI: 10.1007/s10803-023-06038-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/01/2023] [Indexed: 07/03/2023]
Abstract
The purpose of this study is to investigate if feedback related negativity (FRN) can capture instantaneous elevated emotional reactivity in autistic adolescents. A measurement of elevated reactivity could allow clinicians to better support autistic individuals without the need for self-reporting or verbal conveyance. The study investigated reactivity in 46 autistic adolescents (ages 12-21 years) completing the Affective Posner Task which utilizes deceptive feedback to elicit distress presented as frustration. The FRN event-related potential (ERP) served as an instantaneous quantitative neural measurement of emotional reactivity. We compared deceptive and distressing feedback to both truthful but distressing feedback and truthful and non-distressing feedback using the FRN, response times in the successive trial, and Emotion Dysregulation Inventory (EDI) reactivity scores. Results revealed that FRN values were most negative to deceptive feedback as compared to truthful non-distressing feedback. Furthermore, distressing feedback led to faster response times in the successive trial on average. Lastly, participants with higher EDI reactivity scores had more negative FRN values for non-distressing truthful feedback compared to participants with lower reactivity scores. The FRN amplitude showed changes based on both frustration and reactivity. The findings of this investigation support using the FRN to better understand emotion regulation processes for autistic adolescents in future work. Furthermore, the change in FRN based on reactivity suggests the possible need to subgroup autistic adolescents based on reactivity and adjust interventions accordingly.
Collapse
Affiliation(s)
- Nathan T Riek
- Electrical and Computer Engineering Department, University of Pittsburgh, Pittsburgh, PA, USA.
| | - Busra T Susam
- Electrical and Computer Engineering Department, University of Pittsburgh, Pittsburgh, PA, USA
| | - Caitlin M Hudac
- Department of Psychology, University of Alabama, Tuscaloosa, AL, USA
- Department of Psychology and Carolina Autism and Neurodevelopment (CAN) Research Center, University of South Carolina, Colombia, SC, USA
| | - Caitlin M Conner
- Department of Psychiatry, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - Murat Akcakaya
- Electrical and Computer Engineering Department, University of Pittsburgh, Pittsburgh, PA, USA
| | - Jane Yun
- Chemical and Petroleum Engineering Department, University of Pittsburgh, Pittsburgh, PA, USA
| | - Susan W White
- Department of Psychology, University of Alabama, Tuscaloosa, AL, USA
| | - Carla A Mazefsky
- Department of Psychiatry, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - Philip A Gable
- Department of Psychological and Brain Sciences, University of Delaware, Newark, DE, USA
| |
Collapse
|
5
|
Hartman AG, McKendry S, Akcakaya M, Soehner A, Bodison SC, DeAlmeida D, Bendixen R. Characterizing rest-activity rhythms and sleep for children with and without tactile sensitivities: An observational study. Sleep Med 2023; 106:8-16. [PMID: 37030035 PMCID: PMC10159915 DOI: 10.1016/j.sleep.2023.03.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 03/01/2023] [Accepted: 03/23/2023] [Indexed: 03/30/2023]
Abstract
STUDY OBJECTIVES This cross-sectional, observational study aimed to characterize and compare movement-based rest-activity rhythms (RARs) and sleep period variables of children with tactile hypersensitivities (SS) and non-sensitive peers (NSS) to expand the understanding of experienced differences in sleep. METHODS Children (ages 6-10) wore Actigraph GT9X watches for 2 weeks and caregivers completed daily sleep diaries. RARs and sleep period variables (e.g., sleep efficiency, duration, wake after sleep onset) were analyzed and localized means were plotted to visualize average rhythms for each group. Groups were compared using Student's t tests, or non-parametric alternatives, and Hedge's g effect sizes. RESULTS Fifty-three children and their families participated in this study (nSS = 21 nNSS = 32). The groups had similar RARs and sleep period variables. In both groups, sleep efficiency was low (SESS = 78%, SENSS = 77%) and total sleep time was short (TSTSS = 7 hrs 26 mins, TSTNSS- 7 h, 33 min) compared to national recommendations. Despite these similarities, children with SS took noticeably longer to settle down and fall asleep (53 min) than children with NSS (26 min, p = .075, g = 0.95). CONCLUSION This study provides preliminary data describing RAR and sleep period variables in children with and without tactile hypersensitivities. While overall RAR and sleep variables were similar between groups, there is evidence that children with SS spend a longer time transitioning to sleep. Evidence is provided that wrist-worn actigraphy is tolerable and acceptable for children with tactile sensitivities. Actigraphy provides important, movement-based data that should be used in tandem with other measures of sleep health for future studies.
Collapse
Affiliation(s)
- Amy G Hartman
- University of Pittsburgh, Department of Psychiatry, United States.
| | - Sarah McKendry
- University of Pittsburgh, Department of Occupational Therapy, United States
| | - Murat Akcakaya
- University of Pittsburgh, Department of Engineering, United States
| | - Adriane Soehner
- University of Pittsburgh, Department of Psychiatry, United States
| | - Stefanie C Bodison
- University of Florida, Department of Occupational Therapy, United States
| | - Dilhari DeAlmeida
- University of Pittsburgh, Department of Health Information Management, United States
| | - Roxanna Bendixen
- Medical University of South Carolina, Division of Occupational Therapy, United States
| |
Collapse
|
6
|
Dong Z, Bain DJ, Akcakaya M, Ng CA. Evaluating the Thiessen polygon approach for efficient parameterization of urban stormwater models. Environ Sci Pollut Res Int 2023; 30:30295-30307. [PMID: 36434461 DOI: 10.1007/s11356-022-24162-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Accepted: 11/08/2022] [Indexed: 06/16/2023]
Abstract
Catchment discretization plays a key role in constructing stormwater models. Traditional methods usually require aerial or topographic data to manually partition the catchment, but this approach is challenging in areas with poor data access. Here, we propose an alternative approach, by drawing Thiessen polygons around sewer nodes to construct a sewershed model. The utility of this approach is evaluated using the EPA's Storm Water Management Model (SWMM) to simulate pipe flow in a sewershed in the City of Pittsburgh. Parameter sensitivities and model uncertainties were explored via Monte Carlo simulations and a simple algorithm applied to calibrate the model. The calibrated model could reliably simulate pipe flow, with a Nash-Sutcliffe efficiency (NSE) of 0.82 when compared to measured flow. The potential influence of sewer data availability on model performance was tested as a function of the number of nodes used to build the model. No statistical differences were observed in model performance when randomly reducing the number of nodes used to build the model (up to 40%). Based on our analyses, the Thiessen polygon approach can be used to construct urban stormwater models and generate good pipe flow simulations even for sewer data limited scenarios.
Collapse
Affiliation(s)
- Zhaokai Dong
- Department of Civil and Environmental Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA
| | - Daniel J Bain
- Department of Geology and Environmental Science, University of Pittsburgh, Pittsburgh, PA, 15261, USA
| | - Murat Akcakaya
- Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA
| | - Carla A Ng
- Department of Civil and Environmental Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA.
- Department of Environmental and Occupational Health, University of Pittsburgh, Pittsburgh, PA, 15261, USA.
| |
Collapse
|
7
|
Al-Zaiti S, Martin-Gill C, Zégre-Hemsey J, Bouzid Z, Faramand Z, Alrawashdeh M, Gregg R, Helman S, Riek N, Kraevsky-Phillips K, Clermont G, Akcakaya M, Sereika S, Van Dam P, Smith S, Birnbaum Y, Saba S, Sejdic E, Callaway C. Machine Learning for the ECG Diagnosis and Risk Stratification of Occlusion Myocardial Infarction at First Medical Contact. Res Sq 2023:rs.3.rs-2510930. [PMID: 36778371 PMCID: PMC9915770 DOI: 10.21203/rs.3.rs-2510930/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
Patients with occlusion myocardial infarction (OMI) and no ST-elevation on presenting ECG are increasing in numbers. These patients have a poor prognosis and would benefit from immediate reperfusion therapy, but we currently have no accurate tools to identify them during initial triage. Herein, we report the first observational cohort study to develop machine learning models for the ECG diagnosis of OMI. Using 7,313 consecutive patients from multiple clinical sites, we derived and externally validated an intelligent model that outperformed practicing clinicians and other widely used commercial interpretation systems, significantly boosting both precision and sensitivity. Our derived OMI risk score provided superior rule-in and rule-out accuracy compared to routine care, and when combined with the clinical judgment of trained emergency personnel, this score helped correctly reclassify one in three patients with chest pain. ECG features driving our models were validated by clinical experts, providing plausible mechanistic links to myocardial injury.
Collapse
|
8
|
Eldeeb S, Akcakaya M. EEG guided electrical stimulation parameters generation from texture force profiles. J Neural Eng 2022; 19:10.1088/1741-2552/aca82e. [PMID: 36537310 PMCID: PMC9986948 DOI: 10.1088/1741-2552/aca82e] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 12/01/2022] [Indexed: 12/05/2022]
Abstract
Objective.Our aim is to enhance sensory perception and spatial presence in artificial interfaces guided by EEG. This is done by developing a closed-loop electro-tactile system guided by EEG that adaptively update the electrical stimulation parameters to achieve EEG responses similar to the EEG responses generated from touching textured surface.Approach.In this work, we introduce a model that defines the relationship between the contact force profiles and the electrical stimulation parameters. This is done by using the EEG and force data collected from two experiments. The first was conducted by moving a set of textured surfaces against the subjects' fingertip, while collecting both EEG and force data. Whereas the second was carried out by applying a set of different pulse and amplitude modulated electrical stimuli to the subjects' index finger while recording EEG.Main results.We were able to develop a model which could generate electrical stimulation parameters corresponding to different textured surfaces. We showed by offline testing and validation analysis that the average error between the EEG generated from the estimated electrical stimulation parameters and the actual EEG generated from touching textured surfaces is around 7%.Significance.Haptic feedback plays a vital role in our daily life, as it allows us to become aware of our environment. Even though a number of methods have been developed to measure perception of spatial presence and provide sensory feedback in virtual reality environments, there is currently no closed-loop control of sensory stimulation. The proposed model provides an initial step towards developing a closed loop electro-tactile haptic feedback model that delivers more realistic touch sensation through electrical stimulation.
Collapse
Affiliation(s)
- Safaa Eldeeb
- Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, United States of America
| | - Murat Akcakaya
- Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, United States of America
| |
Collapse
|
9
|
Kocanaogullari A, Akcakaya M, Erdogmus D. Stopping Criterion Design for Recursive Bayesian Classification: Analysis and Decision Geometry. IEEE Trans Pattern Anal Mach Intell 2022; 44:5590-5601. [PMID: 33909559 DOI: 10.1109/tpami.2021.3075915] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Systems that are based on recursive Bayesian updates for classification limit the cost of evidence collection through certain stopping/termination criteria and accordingly enforce decision making. Conventionally, two termination criteria based on pre-defined thresholds over (i) the maximum of the state posterior distribution; and (ii) the state posterior uncertainty are commonly used. In this paper, we propose a geometric interpretation over the state posterior progression and accordingly we provide a point-by-point analysis over the disadvantages of using such conventional termination criteria. For example, through the proposed geometric interpretation we show that confidence thresholds defined over maximum of the state posteriors suffer from stiffness that results in unnecessary evidence collection whereas uncertainty based thresholding methods are fragile to number of categories and terminate prematurely if some state candidates are already discovered to be unfavorable. Moreover, both types of termination methods neglect the evolution of posterior updates. We then propose a new stopping/termination criterion with a geometrical insight to overcome the limitations of these conventional methods and provide a comparison in terms of decision accuracy and speed. We validate our claims using simulations and using real experimental data obtained through a brain computer interfaced typing system.
Collapse
|
10
|
Mak J, Kocanaogullari D, Huang X, Kersey J, Shih M, Grattan ES, Skidmore ER, Wittenberg GF, Ostadabbas S, Akcakaya M. Detection of Stroke-Induced Visual Neglect and Target Response Prediction Using Augmented Reality and Electroencephalography. IEEE Trans Neural Syst Rehabil Eng 2022; 30:1840-1850. [PMID: 35786558 DOI: 10.1109/tnsre.2022.3188184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
We aim to build a system incorporating electroencephalography (EEG) and augmented reality (AR) that is capable of identifying the presence of visual spatial neglect (SN) and mapping the estimated neglected visual field. An EEG-based brain-computer interface (BCI) was used to identify those spatiospectral features that best detect participants with SN among stroke survivors using their EEG responses to ipsilesional and contralesional visual stimuli. Frontal-central delta and alpha, frontal-parietal theta, Fp1 beta, and left frontal gamma were found to be important features for neglect detection. Additionally, temporal analysis of the responses shows that the proposed model is accurate in detecting potentially neglected targets. These targets were predicted using common spatial patterns as the feature extraction algorithm and regularized discriminant analysis combined with kernel density estimation for classification. With our preliminary results, our system shows promise for reliably detecting the presence of SN and predicting visual target responses in stroke patients with SN.
Collapse
|
11
|
Huang X, Mak J, Wears A, Price RB, Akcakaya M, Ostadabbas S, Woody ML. Using Neurofeedback from Steady-State Visual Evoked Potentials to Target Affect-Biased Attention in Augmented Reality. Annu Int Conf IEEE Eng Med Biol Soc 2022; 2022:2314-2318. [PMID: 36085716 PMCID: PMC9801955 DOI: 10.1109/embc48229.2022.9871982] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
Biases in attention to emotional stimuli (i.e., affect-biased attention) contribute to the development and mainte-nance of depression and anxiety and may be a promising target for intervention. Past attempts to therapeutically modify affect-biased attention have been unsatisfactory due to issues with reliability and precision. Electroencephalogram (EEG)-derived steady-state visual evoked potentials (SSVEPS) provide a temporally-sensitive biological index of attention to competing visual stimuli at the level of neuronal populations in the visual cortex. SSVEPS can potentially be used to quantify whether affective distractors vs. task-relevant stimuli have "won" the competition for attention at a trial-by-trial level during neuro-feedback sessions. This study piloted a protocol for a SSVEP-based neurofeedback training to modify affect-biased attention using a portable augmented-reality (AR) EEG interface. During neurofeedback sessions with five healthy participants, signifi-cantly greater attention was given to the task-relevant stimulus (a Gabor patch) than to affective distractors (negative emotional expressions) across SSVEP indices (p<0.000l). SSVEP indices exhibited excellent internal consistency as evidenced by a maximum Guttman split-half coefficient of 0.97 when comparing even to odd trials. Further testing is required, but findings suggest several SSVEP neurofeedback calculation methods most deserving of additional investigation and support ongoing efforts to develop and implement a SSVEP-guided AR-based neurofeedback training to modify affect-biased attention in adolescent girls at high risk for depression.
Collapse
Affiliation(s)
- Xiaofei Huang
- Department of Electrical and Computer Engineering, Northeastern University, 360 Huntington Ave, Boston, Massachusetts 02115, USA
| | - Jennifer Mak
- Department of Bioengineering, University of Pittsburgh, 3700 O’Hara St, Pittsburgh, PA 15213, USA
| | - Anna Wears
- University of Pittsburgh School of Medicine, 3550 Terrace Street, Pittsburgh, PA 15261, USA
| | - Rebecca B. Price
- University of Pittsburgh School of Medicine, 3550 Terrace Street, Pittsburgh, PA 15261, USA
| | - Murat Akcakaya
- Department of Electrical and Computer Engineering, University of Pittsburgh, 3700 O’Hara St, Pittsburgh, PA 15213, USA
| | - Sarah Ostadabbas
- Department of Electrical and Computer Engineering, Northeastern University, 360 Huntington Ave, Boston, Massachusetts 02115, USA,Corresponding author: Sarah Ostadabbas.
| | - Mary L. Woody
- University of Pittsburgh School of Medicine, 3550 Terrace Street, Pittsburgh, PA 15261, USA
| |
Collapse
|
12
|
Hartman AG, McKendry S, Soehner A, Bodison S, Akcakaya M, DeAlmeida D, Bendixen R. Characterizing Sleep Differences in Children With and Without Sensory Sensitivities. Front Psychol 2022; 13:875766. [PMID: 35814144 PMCID: PMC9257069 DOI: 10.3389/fpsyg.2022.875766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Accepted: 05/03/2022] [Indexed: 01/28/2023] Open
Abstract
Objectives Individuals register and react to daily sensory stimuli differently, which influences participation in occupations. Sleep is a foundational nightly occupation that impacts overall health and development in children. Emerging research suggests that certain sensory processing patterns, specifically sensory sensitivities, may have a negative impact on sleep health in children. In this study, we aimed to (i) characterize sleep in children with and without sensory sensitivities and (ii) examine the relationship between sensory processing patterns (using the Sensory Profile-2) and sleep using validated parent- and child-reported questionnaires. We hypothesized that children with sensory sensitivities will exhibit more difficulties with sleep. Methods We recruited 22 children (ages 6-10) with sensory sensitivities (SS) and 33 children without sensory sensitivities (NSS) to complete validated sleep and sensory processing questionnaires: the Children's Sleep Habits Questionnaire (CSHQ), Sleep Self-Report (SSR), and Sensory Profile-2. Results Children with SS had significantly more sleep behaviors reported by both parents (p < 0.001, g = 1.11) and children (p < 0.001, g = 1.17) compared to children with NSS. Specifically, children with SS had higher frequencies of sleep anxiety (p = 0.004, g = 0.79), bedtime resistance (p = 0.001, g = 0.83), and sleep onset delay (p = 0.003, g = 0.95). Spearman's ρ correlations indicated significant positive correlations between parent- and child-reported sleep. Children with SS showed a larger association and greater variability between sleep and sensory processing compared to their peers. Significant positive correlations between parent-reported sleep behaviors and sensory sensitive and avoiding patterns were identified for both children with SS and NSS. Child-reported sleep behaviors were most strongly associated with sensitive and avoiding patterns for children with NSS and seeking patterns for children with SS. Conclusion We present evidence that sleep is impacted for children with SS to a greater extent than children with NSS. We also identified that a child's sensory processing pattern may be an important contributor to sleep problems in children with and without sensory sensitivities. Sleep concerns should be addressed within routine care for children with sensory sensitivities. Future studies will inform specific sleep intervention targets most salient for children with SS and other sensory processing patterns.
Collapse
Affiliation(s)
- Amy G. Hartman
- Department of Occupational Therapy, University of Pittsburgh, Pittsburgh, PA, United States
| | - Sarah McKendry
- Department of Occupational Therapy, University of Pittsburgh, Pittsburgh, PA, United States
| | - Adriane Soehner
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, United States
| | - Stefanie Bodison
- Department of Occupational Therapy, University of Florida, Gainesville, FL, United States
| | - Murat Akcakaya
- Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, United States
| | - Dilhari DeAlmeida
- Department of Health Information Management, University of Pittsburgh, Pittsburgh, PA, United States
| | - Roxanna Bendixen
- Department of Occupational Therapy, University of Pittsburgh, Pittsburgh, PA, United States
| |
Collapse
|
13
|
Gonzalez-Navarro P, Celik B, Moghadamfalahi M, Akcakaya M, Fried-Oken M, Erdoğmuş D. Feedback Related Potentials for EEG-Based Typing Systems. Front Hum Neurosci 2022; 15:788258. [PMID: 35145386 PMCID: PMC8821166 DOI: 10.3389/fnhum.2021.788258] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 12/22/2021] [Indexed: 11/13/2022] Open
Abstract
Error related potentials (ErrP), which are elicited in the EEG in response to a perceived error, have been used for error correction and adaption in the event related potential (ERP)-based brain computer interfaces designed for typing. In these typing interfaces, ERP evidence is collected in response to a sequence of stimuli presented usually in the visual form and the intended user stimulus is probabilistically inferred (stimulus with highest probability) and presented to the user as the decision. If the inferred stimulus is incorrect, ErrP is expected to be elicited in the EEG. Early approaches to use ErrP in the design of typing interfaces attempt to make hard decisions on the perceived error such that the perceived error is corrected and either the sequence of stimuli are repeated to obtain further ERP evidence, or without further repetition the stimulus with the second highest probability is presented to the user as the decision of the system. Moreover, none of the existing approaches use a language model to increase the performance of typing. In this work, unlike the existing approaches, we study the potential benefits of fusing feedback related potentials (FRP), a form of ErrP, with ERP and context information (language model, LM) in a Bayesian fashion to detect the user intent. We present experimental results based on data from 12 healthy participants using RSVP Keyboard™ to complete a copy-phrase-task. Three paradigms are compared: [P1] uses only ERP/LM Bayesian fusion; [P2] each RSVP sequence is appended with the top candidate in the alphabet according to posterior after ERP evidence fusion; corresponding FRP is then incorporated; and [P3] the top candidate is shown as a prospect to generate FRP evidence only if its posterior exceeds a threshold. Analyses indicate that ERP/LM/FRP evidence fusion during decision making yields significant speed-accuracy benefits for the user.
Collapse
Affiliation(s)
- Paula Gonzalez-Navarro
- Cognitive Systems Laboratory, Northeastern University, Boston, MA, United States
- *Correspondence: Paula Gonzalez-Navarro
| | - Basak Celik
- Cognitive Systems Laboratory, Northeastern University, Boston, MA, United States
- CAMBI (Consortium for Accessible Multimodal Brain-Body Interfaces), Portland, OR, United States
- Basak Celik
| | | | - Murat Akcakaya
- Electrical and Computer Engineering Department, University of Pittsburgh, Pittsburgh, PI, United States
| | - Melanie Fried-Oken
- CAMBI (Consortium for Accessible Multimodal Brain-Body Interfaces), Portland, OR, United States
- Institute on Development and Disability, Oregon Health & Science University, Portland, OR, United States
| | - Deniz Erdoğmuş
- Cognitive Systems Laboratory, Northeastern University, Boston, MA, United States
- CAMBI (Consortium for Accessible Multimodal Brain-Body Interfaces), Portland, OR, United States
- Deniz Erdoğmuş
| |
Collapse
|
14
|
Susam BT, Riek NT, Beck K, Eldeeb S, Hudac CM, Gable PA, Conner C, Akcakaya M, White S, Mazefsky C. Quantitative EEG Changes in Youth With ASD Following Brief Mindfulness Meditation Exercise. IEEE Trans Neural Syst Rehabil Eng 2022; 30:2395-2405. [PMID: 35976834 PMCID: PMC9979338 DOI: 10.1109/tnsre.2022.3199151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Mindfulness has growing empirical support for improving emotion regulation in individuals with Autism Spectrum Disorder (ASD). Mindfulness is cultivated through meditation practices. Assessing the role of mindfulness in improving emotion regulation is challenging given the reliance on self-report tools. Electroencephalography (EEG) has successfully quantified neural responses to emotional arousal and meditation in other populations, making it ideal to objectively measure neural responses before and after mindfulness (MF) practice among individuals with ASD. We performed an EEG-based analysis during a resting state paradigm in 35 youth with ASD. Specifically, we developed a machine learning classifier and a feature and channel selection approach that separates resting states preceding (Pre-MF) and following (Post-MF) a mindfulness meditation exercise within participants. Across individuals, frontal and temporal channels were most informative. Total power in the beta band (16-30 Hz), Total power (4-30 Hz), relative power in alpha band (8-12 Hz) were the most informative EEG features. A classifier using a non-linear combination of selected EEG features from selected channel locations separated Pre-MF and Post-MF resting states with an average accuracy, sensitivity, and specificity of 80.76%, 78.24%, and 82.14% respectively. Finally, we validated that separation between Pre-MF and Post-MF is due to the MF prime rather than linear-temporal drift. This work underscores machine learning as a critical tool for separating distinct resting states within youth with ASD and will enable better classification of underlying neural responses following brief MF meditation.
Collapse
Affiliation(s)
- Busra T. Susam
- Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA 15261
| | - Nathan T. Riek
- Department of Electrical and Computer Engineering, University of Pittsburgh, PA 15261 USA
| | - Kelly Beck
- School of Health and Rehabilitation Sciences, University of Pittsburgh, Pittsburgh, PA 15260 USA
| | - Safaa Eldeeb
- Department of Electrical and Computer Engineering, University of Pittsburgh, PA 15261 USA
| | - Caitlin M. Hudac
- Department of Psychology, Carolina Autism and Neurodevelopment (CAN) Research Center, University of South Carolina, Columbia, SC 29208 USA
| | - Philip A. Gable
- Department of Psychological and Brain Sciences, University of Delaware, Newark, DE 19716 USA
| | - Caitlin Conner
- Department of Psychiatry, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15213 USA
| | - Murat Akcakaya
- Department of Electrical and Computer Engineering, University of Pittsburgh, PA 15261 USA
| | - Susan White
- Department of Psychology, The University of Alabama, Tuscaloosa, AL 35401 USA
| | - Carla Mazefsky
- Department of Psychiatry, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15213 USA
| |
Collapse
|
15
|
Kocanaogullari D, Huang X, Mak J, Shih M, Skidmore E, Wittenberg GF, Ostadabbas S, Akcakaya M. Fine-tuning and Personalization of EEG-based Neglect Detection in Stroke Patients. Annu Int Conf IEEE Eng Med Biol Soc 2021; 2021:1096-1099. [PMID: 34891478 DOI: 10.1109/embc46164.2021.9630794] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Spatial neglect (SN) is a neurological disorder that causes inattention to visual stimuli in the contralesional visual field, stemming from unilateral brain injury such as stroke. The current gold standard method of SN assessment, the conventional Behavioral Inattention Test (BIT-C), is highly variable and inconsistent in its results. In our previous work, we built an augmented reality (AR)-based BCI to overcome the limitations of the BIT-C and classified between neglected and non-neglected targets with high accuracy. Our previous approach included personalization of the neglect detection classifier but the process required rigorous retraining from scratch and time-consuming feature selection for each participant. Future steps of our work will require rapid personalization of the neglect classifier; therefore, in this paper, we investigate fine-tuning of a neural network model to hasten the personalization process.
Collapse
|
16
|
Susam B, Riek N, Akcakaya M, Xu X, de Sa V, Nezamfar H, Diaz D, Craig K, Goodwin M, Huang J. Automated Pain Assessment in Children using Electrodermal Activity and Video Data Fusion via Machine Learning. IEEE Trans Biomed Eng 2021; 69:422-431. [PMID: 34242161 DOI: 10.1109/tbme.2021.3096137] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Pain assessment in children continues to challenge clinicians and researchers, as subjective experiences of pain require inference through observable behaviors, both involuntary and deliberate. The presented approach supplements the subjective self-report-based method by fusing electrodermal activity (EDA) recordings with video facial expressions to develop an objective pain assessment metric. Such an approach is specifically important for assessing pain in children who are not capable of providing accurate self-pain reports, requiring nonverbal pain assessment. We demonstrate the performance of our approach using data recorded from children in post-operative recovery following laparoscopic appendectomy. We examined separately and combined the usefulness of EDA and video facial expression data as predictors of childrens self-reports of pain following surgery through recovery. Findings indicate that EDA and facial expression data independently provide above chance sensitivities and specificities, but their fusion for classifying clinically significant pain vs. clinically nonsignificant pain achieved substantial improvement, yielding 90.91% accuracy, with 100% sensitivity and 81.82% specificity. The multimodal measures capitalize upon different features of the complex pain response. Thus, this paper presents both evidence for the utility of a weighted maximum likelihood algorithm as a novel feature selection method for EDA and video facial expression data and an accurate and objective automated classification algorithm capable of discriminating clinically significant pain from clinically nonsignificant pain in children.
Collapse
|
17
|
Koçanaoğulları A, Smedemark-Margulies N, Akcakaya M, Erdoğmuş D. Geometric Analysis of Uncertainty Sampling for Dense Neural Network Layer. IEEE Signal Process Lett 2021; 28:867-871. [PMID: 34177215 PMCID: PMC8224399 DOI: 10.1109/lsp.2021.3072292] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
For model adaptation of fully connected neural network layers, we provide an information geometric and sample behavioral active learning uncertainty sampling objective analysis. We identify conditions under which several uncertainty-based methods have the same performance and show that such conditions are more likely to appear in the early stages of learning. We define riskier samples for adaptation, and demonstrate that, as the set of labeled samples increases, margin-based sampling outperforms other uncertainty sampling methods by preferentially selecting these risky samples. We support our derivations and illustrations with experiments using Meta-Dataset, a benchmark for few-shot learning. We compare uncertainty-based active learning objectives using features produced by SimpleCNAPS (a state-of-the-art few-shot classifier) as input for a fully-connected adaptation layer. Our results indicate that margin-based uncertainty sampling achieves similar performance as other uncertainty based sampling methods with fewer labelled samples as discussed in the novel geometric analysis.
Collapse
Affiliation(s)
- Aziz Koçanaoğulları
- Northeastern University Department of Electrical and Computer Engineering 409 Dana Research Center 360 Huntington Avenue Boston, MA 02115
| | | | - Murat Akcakaya
- Pittsburg University Department of Electrical and Computer Engineering 1238 Benedum Hall Pittsburgh, PA 15261
| | - Deniz Erdoğmuş
- Northeastern University Department of Electrical and Computer Engineering 409 Dana Research Center 360 Huntington Avenue Boston, MA 02115
| |
Collapse
|
18
|
So S, Khalaf A, Yi X, Herring C, Zhang Y, Simon MA, Akcakaya M, Lee S, Yun M. Induced bioresistance via BNP detection for machine learning-based risk assessment. Biosens Bioelectron 2021; 175:112903. [PMID: 33370705 DOI: 10.1016/j.bios.2020.112903] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2020] [Revised: 11/25/2020] [Accepted: 12/13/2020] [Indexed: 10/22/2022]
Abstract
Machine Learning (ML) is a powerful tool for big data analysis that shows substantial potential in the field of healthcare. Individual patient data can be inundative, but its value can be extracted by ML's predictive power and ability to find trends. A great area of interest is early diagnosis and disease management strategies for cardiovascular disease (CVD), the leading cause of death in the world. Treatment is often inhibited by analysis delays, but rapid testing and determination can help improve frequency for real time monitoring. In this research, an ML algorithm was developed in conjunction with a flexible BNP sensor to create a quick diagnostic tool. The sensor was fabricated as an ion-selective field effect transistor (ISFET) in order to be able to quickly gather large amounts of electrical data from a sample. Artifical samples were tested to characterize the sensors using linear sweep voltammetry, and the resulting data was utilized as the initial training set for the ML algorithm, an implementation of quadratic discriminant analysis (QDA) written in MATLAB. Human blood serum samples from 30 University of Pittsburgh Medical Center (UPMC) patients were tested to evaluate the effective sorting power of the algorithm, yielding 95% power in addition to ultra fast data collection and determination.
Collapse
Affiliation(s)
- Seth So
- Department of Electrical and Computer Engineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA.
| | - Aya Khalaf
- Department of Electrical and Computer Engineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA
| | - Xinruo Yi
- Department of Electrical and Computer Engineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA
| | - Connor Herring
- Department of Chemical Engineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA
| | - Yingze Zhang
- Departments of Medicine and Human Genetics, University of Pittsburgh, Pittsburgh, PA, 15213, USA
| | - Marc A Simon
- Departments of Medicine (Division of Cardiology), Bioengineering, and Clinical & Translational Science, University of Pittsburgh, Pittsburgh, PA, 15213, USA
| | - Murat Akcakaya
- Department of Electrical and Computer Engineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA
| | - SeungHee Lee
- Department of Nanoconvergence Engineering and Department of Polymer-Nano Science and Technology, Jeonbuk National University, Jeonju, Jeonbuk, 54896, Republic of Korea
| | - Minhee Yun
- Department of Electrical and Computer Engineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA.
| |
Collapse
|
19
|
Wheeler S, Elkhadrawi M, Stevens B, Wheeler B, Akcakaya M. Machine learning classification of false-positive human immunodeficiency virus screening results. J Pathol Inform 2021; 12:46. [PMID: 34934521 PMCID: PMC8652341 DOI: 10.4103/jpi.jpi_7_21] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Revised: 06/29/2021] [Accepted: 07/13/2021] [Indexed: 11/04/2022] Open
|
20
|
Kocanaogullari D, Mak J, Kersey J, Khalaf A, Ostadabbas S, Wittenberg G, Skidmore E, Akcakaya M. EEG-based Neglect Detection for Stroke Patients. Annu Int Conf IEEE Eng Med Biol Soc 2020; 2020:264-267. [PMID: 33017979 DOI: 10.1109/embc44109.2020.9176378] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Spatial neglect (SN) is a neurological syndrome in stroke patients, commonly due to unilateral brain injury. It results in inattention to stimuli in the contralesional visual field. The current gold standard for SN assessment is the behavioral inattention test (BIT). BIT includes a series of penand-paper tests. These tests can be unreliable due to high variablility in subtest performances; they are limited in their ability to measure the extent of neglect, and they do not assess the patients in a realistic and dynamic environment. In this paper, we present an electroencephalography (EEG)-based brain-computer interface (BCI) that utilizes the Starry Night Test to overcome the limitations of the traditional SN assessment tests. Our overall goal with the implementation of this EEG-based Starry Night neglect detection system is to provide a more detailed assessment of SN. Specifically, to detect the presence of SN and its severity. To achieve this goal, as an initial step, we utilize a convolutional neural network (CNN) based model to analyze EEG data and accordingly propose a neglect detection method to distinguish between stroke patients without neglect and stroke patients with neglect.Clinical relevance-The proposed EEG-based BCI can be used to detect neglect in stroke patients with high accuracy, specificity and sensitivity. Further research will additionally allow for an estimation of a patient's field of view (FOV) for more detailed assessment of neglect.
Collapse
|
21
|
Khalaf A, Akcakaya M. A probabilistic approach for calibration time reduction in hybrid EEG-fTCD brain-computer interfaces. Biomed Eng Online 2020; 19:23. [PMID: 32299441 PMCID: PMC7164278 DOI: 10.1186/s12938-020-00765-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2019] [Accepted: 04/04/2020] [Indexed: 11/17/2022] Open
Abstract
Background Generally, brain–computer interfaces (BCIs) require calibration before usage to ensure efficient performance. Therefore, each BCI user has to attend a certain number of calibration sessions to be able to use the system. However, such calibration requirements may be difficult to fulfill especially for patients with disabilities. In this paper, we introduce a probabilistic transfer learning approach to reduce the calibration requirements of our EEG–fTCD hybrid BCI designed using motor imagery (MI) and flickering mental rotation (MR)/word generation (WG) paradigms. The proposed approach identifies the top similar datasets from previous BCI users to a small training dataset collected from a current BCI user and uses these datasets to augment the training data of the current BCI user. To achieve such an aim, EEG and fTCD feature vectors of each trial were projected into scalar scores using support vector machines. EEG and fTCD class conditional distributions were learnt separately using the scores of each class. Bhattacharyya distance was used to identify similarities between class conditional distributions obtained using training trials of the current BCI user and those obtained using trials of previous users. Results Experimental results showed that the performance obtained using the proposed transfer learning approach outperforms the performance obtained without transfer learning for both MI and flickering MR/WG paradigms. In particular, it was found that the calibration requirements can be reduced by at least 60.43% for the MI paradigm, while at most a reduction of 17.31% can be achieved for the MR/WG paradigm. Conclusions Data collected using the MI paradigm show better generalization across subjects.
Collapse
Affiliation(s)
- Aya Khalaf
- Electrical and Computer Engineering Department, University of Pittsburgh, Pittsburgh, PA, USA.
| | - Murat Akcakaya
- Electrical and Computer Engineering Department, University of Pittsburgh, Pittsburgh, PA, USA
| |
Collapse
|
22
|
Susam BT, Akcakaya M, Nezamfar H, Diaz D, Xu X, de Sa VR, Craig KD, Huang JS, Goodwin MS. Automated Pain Assessment using Electrodermal Activity Data and Machine Learning. Annu Int Conf IEEE Eng Med Biol Soc 2019; 2018:372-375. [PMID: 30440413 DOI: 10.1109/embc.2018.8512389] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
Objective pain assessment is required for appropriate pain management in the clinical setting. However, clinical gold standard pain assessment is based on subjective methods. Automated pain detection from physiological data may provide important objective information to better standardize pain assessment. Specifically, electrodermal activity (EDA) can identify features of stress and anxiety induced by varying pain levels. However, notable variability in EDA measurement exists and research to date has demonstrated sensitivity but lack of specificity in pain assessment. In this paper, we use timescale decomposition (TSD) to extract salient features from EDA signals to identify an accurate and automated EDA pain detection algorithm to sensitively and specifically distinguish pain from no-pain conditions.
Collapse
|
23
|
Gonzalez-Navarro P, Marghi YM, Azari B, Akcakaya M, Erdogmus D. An Event-Driven AR-Process Model for EEG-Based BCIs With Rapid Trial Sequences. IEEE Trans Neural Syst Rehabil Eng 2019; 27:798-804. [PMID: 30869624 PMCID: PMC6629584 DOI: 10.1109/tnsre.2019.2903840] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Electroencephalography (EEG) is an effective non-invasive measurement method to infer user intent in brain-computer interface (BCI) systems for control and communication, however, these systems often lack sufficient accuracy and speed due to low separability of class-conditional EEG feature distributions. Many factors impact system performance, including inadequate training datasets and models' ignorance of the temporal dependency of brain responses to serial stimuli. Here, we propose a signal model for event-related responses in the EEG evoked with a rapid sequence of stimuli in BCI applications. The model describes the EEG as a superposition of impulse responses time-locked to stimuli corrupted with an autoregressive noise process. The performance of the signal model is assessed in the context of RSVP keyboard, a language-model-assisted EEG-based BCI for typing. EEG data obtained for model calibration from 10 healthy participants are used to fit and compare two models: the proposed sequence-based EEG model and the trial-based feature-class-conditional distribution model that ignores temporal dependencies, which has been used in the previous work. The simulation studies indicate that the earlier model that ignores temporal dependencies may be causing drastic reductions in achievable information transfer rate (ITR). Furthermore, the proposed model, with better regularization, may achieve improved accuracy with fewer calibration data samples, potentially helping to reduce calibration time. Specifically, results show an average 8.6% increase in (cross-validated) calibration AUC for a single channel of EEG, and 54% increase in the ITR in a typing task.
Collapse
|
24
|
Khalaf A, Sejdic E, Akcakaya M. Common spatial pattern and wavelet decomposition for motor imagery EEG- fTCD brain-computer interface. J Neurosci Methods 2019; 320:98-106. [PMID: 30946880 DOI: 10.1016/j.jneumeth.2019.03.018] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2019] [Revised: 03/28/2019] [Accepted: 03/29/2019] [Indexed: 11/29/2022]
Abstract
BACKGROUND Recently, hybrid brain-computer interfaces (BCIs) combining more than one modality have been investigated with the aim of boosting the performance of the existing single-modal BCIs in terms of accuracy and information transfer rate (ITR). Previously, we introduced a novel hybrid BCI in which EEG and fTCD modalities are used simultaneously to measure electrical brain activity and cerebral blood velocity during motor imagery (MI) tasks. NEW METHOD In this paper, we used multi-scale analysis and common spatial pattern algorithm to extract EEG and fTCD features. Moreover, we proposed probabilistic fusion of EEG and fTCD evidences instead of concatenating EEG and fTCD feature vectors corresponding to each trial. A Bayesian approach was proposed to fuse EEG and fTCD evidences under 3 different assumptions. RESULTS Experimental results showed that 93.85%, 93.71%, and 100% average accuracies and 19.89, 26.55, and 40.83 bits/min average ITRs were achieved for right MI vs baseline, left MI versus baseline, and right MI versus left MI respectively. COMPARISON WITH EXISTING METHODS These performance measures outperformed the results we obtained before in our preliminary study in which average accuracies of 88.33%, 89.48%, and 82.38% and average ITRs of 4.17, 5.45, and 10.57 bits/min were achieved for right MI versus baseline, left MI versus baseline, and right MI versus left MI respectively. Moreover, in terms of both accuracy and speed, the EEG- fTCD BCI with the proposed analysis techniques outperformed all EEG- fNIRS studies in comparison. CONCLUSIONS The proposed system is a more accurate and faster alternative to EEG-fNIRS systems.
Collapse
Affiliation(s)
- Aya Khalaf
- Electrical and Computer Engineering, University of Pittsburgh, 3700 O'Hara St, Pittsburgh, PA, 15213, USA.
| | - Ervin Sejdic
- Electrical and Computer Engineering, University of Pittsburgh, 3700 O'Hara St, Pittsburgh, PA, 15213, USA
| | - Murat Akcakaya
- Electrical and Computer Engineering, University of Pittsburgh, 3700 O'Hara St, Pittsburgh, PA, 15213, USA
| |
Collapse
|
25
|
Eldeeb S, Akcakaya M, Sybeldon M, Foldes S, Santarnecchi E, Pascual-Leone A, Sethi A. EEG-based functional connectivity to analyze motor recovery after stroke: A pilot study. Biomed Signal Process Control 2019. [DOI: 10.1016/j.bspc.2018.12.022] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
|
26
|
Abstract
OBJECTIVE We aim at developing a hybrid brain-computer interface that utilizes electroencephalography (EEG) and functional transcranial Doppler (fTCD). In this hybrid BCI, EEG and fTCD are used simultaneously to measure electrical brain activity and cerebral blood velocity respectively in response to flickering mental rotation (MR) and word generation (WG) tasks. In this paper, we improve both the accuracy and information transfer rate (ITR) of this novel hybrid brain computer interface (BCI) we designed in our previous work. APPROACH To achieve such aim, we extended our feature extraction approach through using template matching and multi-scale analysis to extract EEG and fTCD features, respectively. In particular, template matching was used to analyze EEG data whereas 5-level wavelet decomposition was applied to fTCD data. Significant EEG and fTCD features were selected using Wilcoxon signed rank test. Support vector machines classifier (SVM) was used to project EEG and fTCD selected features of each trial into scalar SVM scores. Moreover, instead of concatenating EEG and fTCD feature vectors corresponding to each trial, we proposed a Bayesian fusion approach of EEG and fTCD evidences. MAIN RESULTS Average accuracy and average ITR of 98.11% and 21.29 bits min-1 were achieved for WG versus MR classification while MR versus baseline yielded 86.27% average accuracy and 8.95 bit min-1 average ITR. In addition, average accuracy of 85.29% and average ITR of 8.34 bits min-1 were obtained for WG versus baseline. SIGNIFICANCE The proposed analysis techniques significantly improved the hybrid BCI performance. Specifically, for MR/WG versus baseline problems, we achieved twice of the ITRs obtained in our previous study. Moreover, the ITR of WG versus MR problem is 4-times the ITR we obtained before for the same problem. The current analysis methods boosted the performance of our EEG-fTCD BCI such that it outperformed the existing EEG-fNIRS BCIs in comparison.
Collapse
|
27
|
Xu X, Susam BT, Nezamfar H, Diaz D, Craig KD, Goodwin MS, Akcakaya M, Huang JS, de Sa VR. Towards Automated Pain Detection in Children Using Facial and Electrodermal Activity. Lecture Notes in Computer Science 2019. [DOI: 10.1007/978-3-030-12738-1_13] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
28
|
Sourati J, Akcakaya M, Erdogmus D, Leen TK, Dy JG. A Probabilistic Active Learning Algorithm Based on Fisher Information Ratio. IEEE Trans Pattern Anal Mach Intell 2018; 40:2023-2029. [PMID: 28858784 DOI: 10.1109/tpami.2017.2743707] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
The task of labeling samples is demanding and expensive. Active learning aims to generate the smallest possible training data set that results in a classifier with high performance in the test phase. It usually consists of two steps of selecting a set of queries and requesting their labels. Among the suggested objectives to score the query sets, information theoretic measures have become very popular. Yet among them, those based on Fisher information (FI) have the advantage of considering the diversity among the queries and tractable computations. In this work, we provide a practical algorithm based on Fisher information ratio to obtain query distribution for a general framework where, in contrast to the previous FI-based querying methods, we make no assumptions over the test distribution. The empirical results on synthetic and real-world data sets indicate that this algorithm gives competitive results.
Collapse
|
29
|
Abstract
OBJECTIVE In this paper, we introduce a novel hybrid brain-computer interface (BCI) system that measures electrical brain activity as well as cerebral blood velocity using electroencephalography (EEG) and functional transcranial Doppler ultrasound (fTCD) respectively in response to flickering mental rotation (MR) and flickering word generation (WG) cognitive tasks as well as a fixation cross that represents the baseline. This work extends our previous approach, in which we showed that motor imagery induces simultaneous changes in EEG and fTCD to enable task discrimination; and hence, provides a design approach for a hybrid BCI. Here, we show that instead of using motor imagery, the proposed visual stimulation technique enables the design of an EEG-fTCD based BCI with higher accuracy. APPROACH Features based on the power spectrum of EEG and fTCD signals were calculated. Mutual information and support vector machines were used for feature selection and classification purposes. MAIN RESULTS EEG-fTCD combination outperformed EEG by 4.05% accuracy for MR versus baseline problem and by 5.81% accuracy for WG versus baseline problem. An average accuracy of 92.38% was achieved for MR versus WG problem using the hybrid combination. Average transmission rates of 4.39, 3.92, and 5.60 bits min-1 were obtained for MR versus baseline, WG versus baseline, and MR versus WG problems respectively. SIGNIFICANCE In terms of accuracy, the current visual presentation outperforms the motor imagery visual presentation we designed before for the EEG-fTCD system by 10% accuracy for task versus task problem. Moreover, the proposed system outperforms the state of the art hybrid EEG-fNIRS BCIs in terms of accuracy and/or information transfer rate. Even though there are still limitations of the proposed system, such promising results show that the proposed hybrid system is a feasible candidate for real-time BCIs.
Collapse
|
30
|
Rothfuss MA, Franconi NG, Star A, Akcakaya M, Gimbel ML, Sejdic E. Automatic Early-Onset Free Flap Failure Detection for Implantable Biomedical Devices. IEEE Trans Biomed Eng 2018; 65:2290-2297. [PMID: 29993495 DOI: 10.1109/tbme.2018.2793763] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Up to 10% of free flap cases are compromised, and without prompt intervention, amputation and even death can occur. Hourly monitoring improves salvage rates, but the gold standard for monitoring requires experienced personnel to operate and suffers from high false-positive rates as high as 31% that result in costly and unnecessary surgeries. In this paper, we investigate free flap patency monitoring using automatic hardware-only classification systems that eliminate the need for experienced personnel. The expected flow ranges of the antegrade and retrograde veins for breast reconstruction are studied using a syringe pump to create the laminar flow seen in veins. METHODS Feature data extracted from the Doppler blood flow signals are analyzed for sensitivity, specificity, and false-positive rates. Hardware is built to perform the classification automatically in real-time and output a decision at the end of the observation period. RESULTS Experimental results using the hardware-only classifier for a 50 ms window size show high sensitivity (96.75%), specificity (90.20%), and low false-positive rate (9.803%). The experimental and theoretical classification results show close agreement. CONCLUSION This work indicates that automatic hardware-only classifiers can eliminate the need for experienced personnel to monitor free flap patency. SIGNIFICANCE The hardware-only classification is amenable to a monolithic implementation and future studies should study a totally implantable wirelessly-powered blood flow classifier. The high classifier performance in a short window period indicates that duty-cycled powering can be used to extend the safe operational depth of an implant. This is particularly relevant for the difficult buried free flap applications.
Collapse
|
31
|
Xu X, Susam BT, Nezamfar H, Diaz D, Craig KD, Goodwin MS, Akcakaya M, Huang JS, Virginia RDS. Towards Automated Pain Detection in Children using Facial and Electrodermal Activity. CEUR Workshop Proc 2018; 2142:208-211. [PMID: 30713486 PMCID: PMC6352962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Accurately determining pain levels in children is difficult, even for trained professionals and parents. Facial activity and electro- dermal activity (EDA) provide rich information about pain, and both have been used in automated pain detection. In this paper, we discuss preliminary steps towards fusing models trained on video and EDA features respectively. We compare fusion models using original video features and those using transferred video features which are less sensitive to environmental changes. We demonstrate the benefit of the fusion and the transferred video features with a special test case involving domain adaptation and improved performance relative to using EDA and video features alone.
Collapse
Affiliation(s)
- Xiaojing Xu
- Department of Electrical and Computer Engineering, UC San Diego, La Jolla, CA, USA,
| | - Büsra Tuğce Susam
- Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Hooman Nezamfar
- Department of Electrical and Computer Engineering, Northeastern University, Boston, MA, USA
| | - Damaris Diaz
- Rady Childrens Hospital and Department of Pediatrics, UC San Diego, CA, USA
| | - Kenneth D Craig
- Department of Psychology,University of British Columbia Vancouver, BC, Canada
| | - Matthew S Goodwin
- Department of Health Sciences, Northeastern University, Boston, MA, USA
| | - Murat Akcakaya
- Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Jeannie S Huang
- Rady Childrens Hospital and Department of Pediatrics, UC San Diego, CA, USA
| | - R de Sa Virginia
- Department of Cognitive Science, UC San Diego, La Jolla, CA, USA
| |
Collapse
|
32
|
Xu X, Craig KD, Diaz D, Goodwin MS, Akcakaya M, Susam BT, Huang JS, de Sa VR. Automated Pain Detection in Facial Videos of Children using Human-Assisted Transfer Learning. CEUR Workshop Proc 2018; 2142:10-21. [PMID: 30713485 PMCID: PMC6352979] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Accurately determining pain levels in children is difficult, even for trained professionals and parents. Facial activity provides sensitive and specific information about pain, and computer vision algorithms have been developed to automatically detect Facial Action Units (AUs) defined by the Facial Action Coding System (FACS). Our prior work utilized information from computer vision, i.e., automatically detected facial AUs, to develop classifiers to distinguish between pain and no-pain conditions. However, application of pain/no-pain classifiers based on automated AU codings across different environmental domains results in diminished performance. In contrast, classifiers based on manually coded AUs demonstrate reduced environmentally-based variability in performance. In this paper, we train a machine learning model to recognize pain using AUs coded by a computer vision system embedded in a software package called iMotions. We also study the relationship between iMotions (automatically) and human (manually) coded AUs. We find that AUs coded automatically are different from those coded by a human trained in the FACS system, and that the human coder is less sensitive to environmental changes. To improve classification performance in the current work, we applied transfer learning by training another machine learning model to map automated AU codings to a subspace of manual AU codings to enable more robust pain recognition performance when only automatically coded AUs are available for the test data. With this transfer learning method, we improved the Area Under the ROC Curve (AUC) on independent data from new participants in our target domain from 0.67 to 0.72.
Collapse
Affiliation(s)
- Xiaojing Xu
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, USA,
| | - Kenneth D Craig
- Department of Psychology, University of British Columbia Vancouver, BC, Canada,
| | - Damaris Diaz
- Rady Childrens Hospital and Department of Pediatrics, University of California San Diego, CA, USA, ,
| | - Matthew S Goodwin
- Department of Health Sciences, Northeastern University, Boston, MA, USA,
| | - Murat Akcakaya
- Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA, ,
| | - Büşra Tuğçe Susam
- Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA, ,
| | - Jeannie S Huang
- Rady Childrens Hospital and Department of Pediatrics, University of California San Diego, CA, USA, ,
| | - Virginia R de Sa
- Department of Cognitive Science, University of California San Diego, La Jolla, CA, USA,
| |
Collapse
|
33
|
Eldeeb S, Sybeldon M, Akcakaya M, Wozny T, Pan J, Richardson M, Bagić A, Antony A. F134. Automated seizure detection using statistical CUSUM detector. Clin Neurophysiol 2018. [DOI: 10.1016/j.clinph.2018.04.297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/16/2022]
|
34
|
Kelsey M, Akcakaya M, Kleckner IR, Palumbo RV, Barrett LF, Quigley KS, Goodwin MS. Applications of sparse recovery and dictionary learning to enhance analysis of ambulatory electrodermal activity data. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2017.08.024] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
35
|
Haghighi M, Moghadamfalahi M, Akcakaya M, Shinn-Cunningham BG, Erdogmus D. A Graphical Model for Online Auditory Scene Modulation Using EEG Evidence for Attention. IEEE Trans Neural Syst Rehabil Eng 2017; 25:1970-1977. [PMID: 28600256 PMCID: PMC5681401 DOI: 10.1109/tnsre.2017.2712419] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Recent findings indicate that brain interfaces have the potential to enable attention-guided auditory scene analysis and manipulation in applications, such as hearing aids and augmented/virtual environments. Specifically, noninvasively acquired electroencephalography (EEG) signals have been demonstrated to carry some evidence regarding, which of multiple synchronous speech waveforms the subject attends to. In this paper, we demonstrate that: 1) using data- and model-driven cross-correlation features yield competitive binary auditory attention classification results with at most 20 s of EEG from 16 channels or even a single well-positioned channel; 2) a model calibrated using equal-energy speech waveforms competing for attention could perform well on estimating attention in closed-loop unbalanced-energy speech waveform situations, where the speech amplitudes are modulated by the estimated attention posterior probability distribution; 3) such a model would perform even better if it is corrected (linearly, in this instance) based on EEG evidence dependence on speech weights in the mixture; and 4) calibrating a model based on population EEG could result in acceptable performance for new individuals/users; therefore, EEG-based auditory attention classifiers may generalize across individuals, leading to reduced or eliminated calibration time and effort.
Collapse
|
36
|
Moghadamfalahi M, Akcakaya M, Nezamfar H, Sourati J, Erdogmus D. An Active RBSE Framework to Generate Optimal Stimulus Sequences in a BCI for Spelling. IEEE Trans Signal Process 2017; 65:5381-5392. [PMID: 31871392 PMCID: PMC6927477 DOI: 10.1109/tsp.2017.2728500] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
A class of brain computer interfaces (BCIs) employs noninvasive recordings of electroencephalography (EEG) signals to enable users with severe speech and motor impairments to interact with their environment and social network. For example, EEG based BCIs for typing popularly utilize event related potentials (ERPs) for inference. Presentation paradigm design in current ERP-based letter by letter typing BCIs typically query the user with an arbitrary subset characters. However, the typing accuracy and also typing speed can potentially be enhanced with more informed subset selection and flash assignment. In this manuscript, we introduce the active recursive Bayesian state estimation (active-RBSE) framework for inference and sequence optimization. Prior to presentation in each iteration, rather than showing a subset of randomly selected characters, the developed framework optimally selects a subset based on a query function. Selected queries are made adaptively specialized for users during each intent detection. Through a simulation-based study, we assess the effect of active-RBSE on the performance of a language-model assisted typing BCI in terms of typing speed and accuracy. To provide a baseline for comparison, we also utilize standard presentation paradigms namely, row and column matrix presentation paradigm and also random rapid serial visual presentation paradigms. The results show that utilization of active-RBSE can enhance the online performance of the system, both in terms of typing accuracy and speed. Moreover, we conduct real time experiments with human participants to study the human-in-the-loop effect on the performance of the proposed active-RBSE framework and consistent with the simulation results, the results of these experiments show improvement both in typing speed and accuracy.
Collapse
|
37
|
Kleckner IR, Jones RM, Wilder-Smith O, Wormwood JB, Akcakaya M, Quigley KS, Lord C, Goodwin MS. Simple, Transparent, and Flexible Automated Quality Assessment Procedures for Ambulatory Electrodermal Activity Data. IEEE Trans Biomed Eng 2017; 65:1460-1467. [PMID: 28976309 DOI: 10.1109/tbme.2017.2758643] [Citation(s) in RCA: 38] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Electrodermal activity (EDA) is a noninvasive measure of sympathetic activation often used to study emotions, decision making, and health. The use of "ambulatory" EDA in everyday life presents novel challenges-frequent artifacts and long recordings-with inconsistent methods available for efficiently and accurately assessing data quality. We developed and validated a simple, transparent, flexible, and automated quality assessment procedure for ambulatory EDA data. METHODS A total of 20 individuals with autism (5 females, 5-13 years) provided a combined 181 h of EDA data in their home using the Affectiva Q Sensor across 8 weeks. Our procedure identified invalid data using four rules: First, EDA out of range; second, EDA changes too quickly; third, temperature suggests the sensor is not being worn; and fourth, transitional data surrounding segments identified as invalid via the preceding rules. We identified invalid portions of a pseudorandom subset of our data (32.8 h, 18%) using our automated procedure and independent visual inspection by five EDA experts. RESULTS Our automated procedure identified 420 min (21%) of invalid data. The five experts agreed strongly with each other (agreement: 98%, Cohen's κ: 0.87) and, thus, were averaged into a "consensus" rating. Our procedure exhibited excellent agreement with the consensus rating (sensitivity: 91%, specificity: 99%, accuracy: 92%, κ: 0.739 [95% CI = 0.738, 0.740]). CONCLUSION We developed a simple, transparent, flexible, and automated quality assessment procedure for ambulatory EDA data. SIGNIFICANCE Our procedure can be used beyond this study to enhance efficiency, transparency, and reproducibility of EDA analyses, with free software available at http://www.cbslab.org/EDAQA.
Collapse
|
38
|
Onuk E, Badger J, Wang YJ, Bardhan J, Chishti Y, Akcakaya M, Brooks DH, Erdogmus D, Minh DDL, Makowski L. Effects of Catalytic Action and Ligand Binding on Conformational Ensembles of Adenylate Kinase. Biochemistry 2017; 56:4559-4567. [PMID: 28767234 DOI: 10.1021/acs.biochem.7b00351] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Crystal structures of adenylate kinase (AdK) from Escherichia coli capture two states: an "open" conformation (apo) obtained in the absence of ligands and a "closed" conformation in which ligands are bound. Other AdK crystal structures suggest intermediate conformations that may lie on the transition pathway between these two states. To characterize the transition from open to closed states in solution, X-ray solution scattering data were collected from AdK in the apo form and with progressively increasing concentrations of five different ligands. Scattering data from apo AdK are consistent with scattering predicted from the crystal structure of AdK in the open conformation. In contrast, data from AdK samples saturated with Ap5A do not agree with that calculated from AdK in the closed conformation. Using cluster analysis of available structures, we selected representative structures in five conformational states: open, partially open, intermediate, partially closed, and closed. We used these structures to estimate the relative abundances of these states for each experimental condition. X-ray solution scattering data obtained from AdK with AMP are dominated by scattering from AdK in the open conformation. For AdK in the presence of high concentrations of ATP and ADP, the conformational ensemble shifts to a mixture of partially open and closed states. Even when AdK is saturated with Ap5A, a significant proportion of AdK remains in a partially open conformation. These results are consistent with an induced-fit model in which the transition of AdK from an open state to a closed state is initiated by ATP binding.
Collapse
Affiliation(s)
- Emre Onuk
- Radiation Oncology Department, University of California , Los Angeles, California 90095, United States
| | - John Badger
- DeltaG Technologies , San Diego, California 92122, United States
| | - Yu Jing Wang
- Department of Bioengineering, Northeastern University , Boston, Massachusetts 02115, United States
| | - Jaydeep Bardhan
- Department of Mechanical and Industrial Engineering, Northeastern University , Boston, Massachusetts 02115, United States
| | - Yasmin Chishti
- Department of Bioengineering, Northeastern University , Boston, Massachusetts 02115, United States
| | - Murat Akcakaya
- Department of Electrical and Computer Engineering, University of Pittsburgh , Pittsburgh, Pennsylvania 15261, United States
| | - Dana H Brooks
- Department of Electrical and Computer Engineering, Northeastern University , Boston, Massachusetts 02115, United States
| | - Deniz Erdogmus
- Department of Electrical and Computer Engineering, Northeastern University , Boston, Massachusetts 02115, United States
| | - David D L Minh
- Department of Chemistry, Illinois Institute of Technology , Chicago, Illinois 60616, United States
| | - Lee Makowski
- Department of Bioengineering, Northeastern University , Boston, Massachusetts 02115, United States.,Department of Chemistry and Chemical Biology, Northeastern University , Boston, Massachusetts 02115, United States
| |
Collapse
|
39
|
Abstract
Noninvasive EEG (electroencephalography) based auditory attention detection could be useful for improved hearing aids in the future. This work is a novel attempt to investigate the feasibility of online modulation of sound sources by probabilistic detection of auditory attention, using a noninvasive EEG-based brain computer interface. Proposed online system modulates the upcoming sound sources through gain adaptation which employs probabilistic decisions (soft decisions) from a classifier trained on offline calibration data. In this work, calibration EEG data were collected in sessions where the participants listened to two sound sources (one attended and one unattended). Cross-correlation coefficients between the EEG measurements and the attended and unattended sound source envelope (estimates) are used to show differences in sharpness and delays of neural responses for attended versus unattended sound source. Salient features to distinguish attended sources from the unattended ones in the correlation patterns have been identified, and later they have been used to train an auditory attention classifier. Using this classifier, we have shown high offline detection performance with single channel EEG measurements compared to the existing approaches in the literature which employ large number of channels. In addition, using the classifier trained offline in the calibration session, we have shown the performance of the online sound source modulation system. We observe that online sound source modulation system is able to keep the level of attended sound source higher than the unattended source.
Collapse
Affiliation(s)
| | | | - Murat Akcakaya
- University of Pittsburgh, 4200 Fifth Ave, Pittsburgh, PA 15260
| | - Deniz Erdogmus
- Northeastern University, 360 Huntington Ave, Boston, MA 02115
| |
Collapse
|
40
|
Sourati J, Kazmierczak SC, Akcakaya M, Dy JG, Leen TK, Erdogmus D. Assessing subsets of analytes in context of detecting laboratory errors. Annu Int Conf IEEE Eng Med Biol Soc 2017; 2016:5793-5796. [PMID: 28269571 DOI: 10.1109/embc.2016.7592044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Laboratory error detection is a hard task yet plays an important role in efficient care of the patients. Quality controls are inadequate in detecting pre-analytic errors and are not frequent enough. Hence population- and patient-based detectors are developed. However, it is not clear what set of analytes leads to the most efficient error detectors. Here, we use three different scoring functions that can be used in detecting errors, to rank a set of analytes in terms of their strength in distinguishing erroneous measurements. We also observe that using evaluations of larger subsets of analytes in our analysis does not necessarily lead to a more accurate error detector. In our data set obtained from renal kidney disease inpatients, calcium, potassium, and sodium, emerged as the top-3 indicators of an erroneous measurement. Using the joint likelihood of these three analytes, we obtain an estimated AUC of 0.73 in error detection.
Collapse
|
41
|
Abstract
Multichannel electroencephalography (EEG) is widely used in non-invasive brain computer interfaces (BCIs) for user intent inference. EEG can be assumed to be a Gaussian process with unknown mean and autocovariance, and the estimation of parameters is required for BCI inference. However, the relatively high dimensionality of the EEG feature vectors with respect to the number of labeled observations lead to rank deficient covariance matrix estimates. In this manuscript, to overcome ill-conditioned covariance estimation, we propose a structure for the covariance matrices of the multichannel EEG signals. Specifically, we assume that these covariances can be modeled as a Kronecker product of temporal and spatial covariances. Our results over the experimental data collected from the users of a letter-by-letter typing BCI show that with less number of parameter estimations, the system can achieve higher classification accuracies compared to a method that uses full unstructured covariance estimation. Moreover, in order to illustrate that the proposed Kronecker product structure could enable shortening the BCI calibration data collection sessions, using Cramer-Rao bound analysis on simulated data, we demonstrate that a model with structured covariance matrices will achieve the same estimation error as a model with no covariance structure using fewer labeled EEG observations.
Collapse
Affiliation(s)
| | | | - M Akcakaya
- University of Pittsburgh, Pittsburgh, PA
| | | |
Collapse
|
42
|
Higger M, Quivira F, Akcakaya M, Moghadamfalahi M, Nezamfar H, Cetin M, Erdogmus D. Recursive Bayesian Coding for BCIs. IEEE Trans Neural Syst Rehabil Eng 2016; 25:704-714. [PMID: 27416602 DOI: 10.1109/tnsre.2016.2590959] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Brain-Computer Interfaces (BCIs) seek to infer some task symbol, a task relevant instruction, from brain symbols, classifiable physiological states. For example, in a motor imagery robot control task a user would indicate their choice from a dictionary of task symbols (rotate arm left, grasp, etc.) by selecting from a smaller dictionary of brain symbols (imagined left or right hand movements). We examine how a BCI infers a task symbol using selections of brain symbols. We offer a recursive Bayesian decision framework which incorporates context prior distributions (e.g., language model priors in spelling applications), accounts for varying brain symbol accuracy and is robust to single brain symbol query errors. This framework is paired with Maximum Mutual Information (MMI) coding which maximizes a generalization of ITR. Both are applicable to any discrete task and brain phenomena (e.g., P300, SSVEP, MI). To demonstrate the efficacy of our approach we perform SSVEP "Shuffle" Speller experiments and compare our recursive coding scheme with traditional decision tree methods including Huffman coding. MMI coding leverages the asymmetry of the classifier's mistakes across a particular user's SSVEP responses; in doing so it offers a 33% increase in letter accuracy though it is 13% slower in our experiment.
Collapse
|
43
|
Orhan U, Nezamfar H, Akcakaya M, Erdogmus D, Higger M, Moghadamfalahi M, Fowler A, Roark B, Oken B, Fried-Oken M. Probabilistic Simulation Framework for EEG-Based BCI Design. Brain Comput Interfaces (Abingdon) 2016; 3:171-185. [PMID: 29250562 DOI: 10.1080/2326263x.2016.1252621] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
A simulation framework could decrease the burden of attending long and tiring experimental sessions on the potential users of brain computer interface (BCI) systems. Specifically during the initial design of a BCI, a simulation framework that could replicate the operational performance of the system would be a useful tool for designers to make design choices. In this manuscript, we develop a Monte Carlo based probabilistic simulation framework for electroencephalography (EEG) based BCI design. We employ one event related potential (ERP) based typing and one steady state evoked potential (SSVEP) based control interface as testbeds. We compare the results of simulations with real time experiments. Even though over and under estimation of the performance is possible, the statistical results over the Monte Carlo simulations show that the developed framework generally provides a good approximation of the real time system performance.
Collapse
|
44
|
Onuk AE, Akcakaya M, Bardhan JP, Erdogmus D, Brooks DH, Makowski L. Constrained Maximum Likelihood Estimation of Relative Abundances of Protein Conformation in a Heterogeneous Mixture from Small Angle X-Ray Scattering Intensity Measurements. IEEE Trans Signal Process 2015; 63:5383-5394. [PMID: 26924916 PMCID: PMC4767180 DOI: 10.1109/tsp.2015.2455515] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
In this paper, we describe a model for maximum likelihood estimation (MLE) of the relative abundances of different conformations of a protein in a heterogeneous mixture from small angle X-ray scattering (SAXS) intensities. To consider cases where the solution includes intermediate or unknown conformations, we develop a subset selection method based on k-means clustering and the Cramér-Rao bound on the mixture coefficient estimation error to find a sparse basis set that represents the space spanned by the measured SAXS intensities of the known conformations of a protein. Then, using the selected basis set and the assumptions on the model for the intensity measurements, we show that the MLE model can be expressed as a constrained convex optimization problem. Employing the adenylate kinase (ADK) protein and its known conformations as an example, and using Monte Carlo simulations, we demonstrate the performance of the proposed estimation scheme. Here, although we use 45 crystallographically determined experimental structures and we could generate many more using, for instance, molecular dynamics calculations, the clustering technique indicates that the data cannot support the determination of relative abundances for more than 5 conformations. The estimation of this maximum number of conformations is intrinsic to the methodology we have used here.
Collapse
Affiliation(s)
- A Emre Onuk
- Electrical and Computer Engineering Department, Northeastern University, Boston, MA
| | - Murat Akcakaya
- Electrical and Computer Engineering Department, University of Pittsburgh, Pittsburgh, PA
| | - Jaydeep P Bardhan
- Department of Mechanical and Industrial Engineering, Northeastern University, Boston, MA
| | - Deniz Erdogmus
- Electrical and Computer Engineering Department, Northeastern University, Boston, MA
| | - Dana H Brooks
- Electrical and Computer Engineering Department, Northeastern University, Boston, MA
| | - Lee Makowski
- Bioengineering Department, Northeastern University, Boston, MA; Department of Chemistry and Chemical Biology, Northeastern University, Boston, MA
| |
Collapse
|
45
|
Moghadamfalahi M, Orhan U, Akcakaya M, Nezamfar H, Fried-Oken M, Erdogmus D. Language-Model Assisted Brain Computer Interface for Typing: A Comparison of Matrix and Rapid Serial Visual Presentation. IEEE Trans Neural Syst Rehabil Eng 2015; 23:910-20. [DOI: 10.1109/tnsre.2015.2411574] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
46
|
Emre Onuk A, Akcakaya M, Bardhan J, Erdogmus D, Brooks DH, Makowski L. Constrained Maximum Likelihood Estimation of the Abundances of Protein Conformation in a Heterogeneous Structural Ensemble from Small Angle X-ray Scattering Intensity Measurements. Biophys J 2015. [DOI: 10.1016/j.bpj.2014.11.1163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022] Open
|
47
|
Ahani A, Wiegand K, Orhan U, Akcakaya M, Moghadamfalahi M, Nezamfar H, Patel R, Erdogmus D. RSVP IconMessenger: icon-based brain-interfaced alternative and augmentative communication. Brain-Computer Interfaces 2014. [DOI: 10.1080/2326263x.2014.996066] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
48
|
Akcakaya M, Peters B, Moghadamfalahi M, Mooney AR, Orhan U, Oken B, Erdogmus D, Fried-Oken M. Noninvasive brain-computer interfaces for augmentative and alternative communication. IEEE Rev Biomed Eng 2014; 7:31-49. [PMID: 24802700 DOI: 10.1109/rbme.2013.2295097] [Citation(s) in RCA: 66] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
Brain-computer interfaces (BCIs) promise to provide a novel access channel for assistive technologies, including augmentative and alternative communication (AAC) systems, to people with severe speech and physical impairments (SSPI). Research on the subject has been accelerating significantly in the last decade and the research community took great strides toward making BCI-AAC a practical reality to individuals with SSPI. Nevertheless, the end goal has still not been reached and there is much work to be done to produce real-world-worthy systems that can be comfortably, conveniently, and reliably used by individuals with SSPI with help from their families and care givers who will need to maintain, setup, and debug the systems at home. This paper reviews reports in the BCI field that aim at AAC as the application domain with a consideration on both technical and clinical aspects.
Collapse
|
49
|
Abstract
Nonlinear dimensionality reduction is essential for the analysis and the interpretation of high dimensional data sets. In this manuscript, we propose a distance order preserving manifold learning algorithm that extends the basic mean-squared error cost function used mainly in multidimensional scaling (MDS)-based methods. We develop a constrained optimization problem by assuming explicit constraints on the order of distances in the low-dimensional space. In this optimization problem, as a generalization of MDS, instead of forcing a linear relationship between the distances in the high-dimensional original and low-dimensional projection space, we learn a non-decreasing relation approximated by radial basis functions. We compare the proposed method with existing manifold learning algorithms using synthetic datasets based on the commonly used residual variance and proposed percentage of violated distance orders metrics. We also perform experiments on a retinal image dataset used in Retinopathy of Prematurity (ROP) diagnosis.
Collapse
Affiliation(s)
| | - Murat Akcakaya
- Cognitive Systems Laboratory, Northeastern University, Boston, MA
| | - Umut Orhan
- Cognitive Systems Laboratory, Northeastern University, Boston, MA
| | - Deniz Erdogmus
- Cognitive Systems Laboratory, Northeastern University, Boston, MA
| |
Collapse
|
50
|
Abstract
The Ormia ochracea is able to locate a cricket's mating call despite the small distance between its ears compared with the wavelength. This phenomenon has been explained by the mechanical coupling between the ears. In this paper, it is first shown that the coupling enhances the differences in times of arrival and frequency responses of the ears to the incoming source signals. Then, the accuracy of estimating directions of arrival (DOAs) by the O. ochracea is analyzed by computing the Cramér-Rao bound (CRB). The differential equations of the mechanical model are rewritten in state space and its frequency response is calculated. Using the spectral properties of the system, the CRB for multiple stochastic sources with unknown directions and spectra is asymptotically computed. Numerical examples compare the CRB for the coupled and the uncoupled cases, illustrating the effect of the coupling on reducing the errors in estimating the DOAs.
Collapse
Affiliation(s)
- Murat Akcakaya
- Department of Electrical and Systems Engineering, Washington University in St. Louis, St. Louis, Missouri 63130, USA.
| | | |
Collapse
|