26
|
Ohmer X, Franke M, König P. Mutual Exclusivity in Pragmatic Agents. Cogn Sci 2022; 46:e13069. [PMID: 34973036 DOI: 10.1111/cogs.13069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Revised: 10/11/2021] [Accepted: 10/30/2021] [Indexed: 11/28/2022]
Abstract
One of the great challenges in word learning is that words are typically uttered in a context with many potential referents. Children's tendency to associate novel words with novel referents, which is taken to reflect a mutual exclusivity (ME) bias, forms a useful disambiguation mechanism. We study semantic learning in pragmatic agents-combining the Rational Speech Act model with gradient-based learning-and explore the conditions under which such agents show an ME bias. This approach provides a framework for investigating a pragmatic account of the ME bias in humans but also for building artificial agents that display an ME bias. A series of analyses demonstrates striking parallels between our model and human word learning regarding several aspects relevant to the ME bias phenomenon: online inference, long-term learning, and developmental effects. By testing different implementations, we find that two components, pragmatic online inference and incremental collection of evidence for one-to-one correspondences between words and referents, play an important role in modeling the developmental trajectory of the ME bias. Finally, we outline an extension of our model to a deep neural network architecture that can process more naturalistic visual and linguistic input. Until now, in contrast to children, deep neural networks have needed indirect access to (supposed to be novel) test inputs during training to display an ME bias. Our model is the first one to do so without using this manipulation.
Collapse
|
27
|
Lukanov H, König P, Pipa G. Biologically Inspired Deep Learning Model for Efficient Foveal-Peripheral Vision. Front Comput Neurosci 2021; 15:746204. [PMID: 34880741 PMCID: PMC8645638 DOI: 10.3389/fncom.2021.746204] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2021] [Accepted: 10/27/2021] [Indexed: 11/13/2022] Open
Abstract
While abundant in biology, foveated vision is nearly absent from computational models and especially deep learning architectures. Despite considerable hardware improvements, training deep neural networks still presents a challenge and constraints complexity of models. Here we propose an end-to-end neural model for foveal-peripheral vision, inspired by retino-cortical mapping in primates and humans. Our model has an efficient sampling technique for compressing the visual signal such that a small portion of the scene is perceived in high resolution while a large field of view is maintained in low resolution. An attention mechanism for performing "eye-movements" assists the agent in collecting detailed information incrementally from the observed scene. Our model achieves comparable results to a similar neural architecture trained on full-resolution data for image classification and outperforms it at video classification tasks. At the same time, because of the smaller size of its input, it can reduce computational effort tenfold and uses several times less memory. Moreover, we present an easy to implement bottom-up and top-down attention mechanism which relies on task-relevant features and is therefore a convenient byproduct of the main architecture. Apart from its computational efficiency, the presented work provides means for exploring active vision for agent training in simulated environments and anthropomorphic robotics.
Collapse
|
28
|
Wenzel J, Lampe J, Müller-Fielitz H, Schuster R, Zille M, Müller K, Krohn M, Körbelin J, Zhang L, Özorhan Ü, Neve V, Wagner JUG, Bojkova D, Shumliakivska M, Jiang Y, Fähnrich A, Ott F, Sencio V, Robil C, Pfefferle S, Sauve F, Coêlho CFF, Franz J, Spiecker F, Lembrich B, Binder S, Feller N, König P, Busch H, Collin L, Villaseñor R, Jöhren O, Altmeppen HC, Pasparakis M, Dimmeler S, Cinatl J, Püschel K, Zelic M, Ofengeim D, Stadelmann C, Trottein F, Nogueiras R, Hilgenfeld R, Glatzel M, Prevot V, Schwaninger M. The SARS-CoV-2 main protease M pro causes microvascular brain pathology by cleaving NEMO in brain endothelial cells. Nat Neurosci 2021. [PMID: 34675436 DOI: 10.1038/s41593-02100926-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/13/2023]
Abstract
Coronavirus disease 2019 (COVID-19) can damage cerebral small vessels and cause neurological symptoms. Here we describe structural changes in cerebral small vessels of patients with COVID-19 and elucidate potential mechanisms underlying the vascular pathology. In brains of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2)-infected individuals and animal models, we found an increased number of empty basement membrane tubes, so-called string vessels representing remnants of lost capillaries. We obtained evidence that brain endothelial cells are infected and that the main protease of SARS-CoV-2 (Mpro) cleaves NEMO, the essential modulator of nuclear factor-κB. By ablating NEMO, Mpro induces the death of human brain endothelial cells and the occurrence of string vessels in mice. Deletion of receptor-interacting protein kinase (RIPK) 3, a mediator of regulated cell death, blocks the vessel rarefaction and disruption of the blood-brain barrier due to NEMO ablation. Importantly, a pharmacological inhibitor of RIPK signaling prevented the Mpro-induced microvascular pathology. Our data suggest RIPK as a potential therapeutic target to treat the neuropathology of COVID-19.
Collapse
|
29
|
Wahn B, König P, Kingstone A. Interpersonal coordination in joint multiple object tracking. J Exp Psychol Hum Percept Perform 2021; 47:1166-1181. [PMID: 34694847 DOI: 10.1037/xhp0000935] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
People often perform visual tasks together, for example, when looking for a misplaced key. When performing such tasks jointly, people coordinate their actions to divide the labor, for example, by looking for the misplaced key in different rooms. This way, they tend to perform better together than individually-they attain a group benefit. A crucial factor determining whether (and to what extent) individuals attain a group benefit is the amount of information they receive about each other's actions and performance. We systematically varied, across 8 conditions, the information participant pairs received while jointly performing a visual task. We find that participants can attain a group benefit without receiving any information (and thus cannot coordinate their actions). However, actions are coordinated and the group benefit is enhanced if participants receive information about each other's actions or performance. If both types of information are received, participants are faster in creating efficient labor divisions. To create divisions, participants used the screen center as a reference to divide the labor into a left and right side. When participants cannot coordinate actions, they exhibit a bias toward choosing the same side, but they forgo this bias once action coordination is possible, thereby boosting group performance. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
|
30
|
Münter M, Pieper M, Kohlfaerber T, Bodenstorfer E, Ahrens M, Winter C, Huber R, König P, Hüttmann G, Schulz-Hildebrandt H. Microscopic optical coherence tomography (mOCT) at 600 kHz for 4D volumetric imaging and dynamic contrast. BIOMEDICAL OPTICS EXPRESS 2021; 12:6024-6039. [PMID: 34745719 PMCID: PMC8547980 DOI: 10.1364/boe.425001] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/27/2021] [Revised: 08/03/2021] [Accepted: 08/06/2021] [Indexed: 05/11/2023]
Abstract
Volumetric imaging of dynamic processes with microscopic resolution holds a huge potential in biomedical research and clinical diagnosis. Using supercontinuum light sources and high numerical aperture (NA) objectives, optical coherence tomography (OCT) achieves microscopic resolution and is well suited for imaging cellular and subcellular structures of biological tissues. Currently, the imaging speed of microscopic OCT (mOCT) is limited by the line-scan rate of the spectrometer camera and ranges from 30 to 250 kHz. This is not fast enough for volumetric imaging of dynamic processes in vivo and limits endoscopic application. Using a novel CMOS camera, we demonstrate fast 3-dimensional OCT imaging with 600,000 A-scans/s at 1.8 µm axial and 1.1 µm lateral resolution. The improved speed is used for imaging of ciliary motion and particle transport in ex vivo mouse trachea. Furthermore, we demonstrate dynamic contrast OCT by evaluating the recorded volumes rather than en face planes or B-scans. High-speed volumetric mOCT will enable the correction of global tissue motion and is a prerequisite for applying dynamic contrast mOCT in vivo. With further increase in imaging speed and integration in flexible endoscopes, volumetric mOCT may be used to complement or partly replace biopsies.
Collapse
|
31
|
Czeszumski A, Gert AL, Keshava A, Ghadirzadeh A, Kalthoff T, Ehinger BV, Tiessen M, Björkman M, Kragic D, König P. Coordinating With a Robot Partner Affects Neural Processing Related to Action Monitoring. Front Neurorobot 2021; 15:686010. [PMID: 34456705 PMCID: PMC8386170 DOI: 10.3389/fnbot.2021.686010] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Accepted: 06/30/2021] [Indexed: 11/24/2022] Open
Abstract
Robots start to play a role in our social landscape, and they are progressively becoming responsive, both physically and socially. It begs the question of how humans react to and interact with robots in a coordinated manner and what the neural underpinnings of such behavior are. This exploratory study aims to understand the differences in human-human and human-robot interactions at a behavioral level and from a neurophysiological perspective. For this purpose, we adapted a collaborative dynamical paradigm from the literature. We asked 12 participants to hold two corners of a tablet while collaboratively guiding a ball around a circular track either with another participant or a robot. In irregular intervals, the ball was perturbed outward creating an artificial error in the behavior, which required corrective measures to return to the circular track again. Concurrently, we recorded electroencephalography (EEG). In the behavioral data, we found an increased velocity and positional error of the ball from the track in the human-human condition vs. human-robot condition. For the EEG data, we computed event-related potentials. We found a significant difference between human and robot partners driven by significant clusters at fronto-central electrodes. The amplitudes were stronger with a robot partner, suggesting a different neural processing. All in all, our exploratory study suggests that coordinating with robots affects action monitoring related processing. In the investigated paradigm, human participants treat errors during human-robot interaction differently from those made during interactions with other humans. These results can improve communication between humans and robot with the use of neural activity in real-time.
Collapse
|
32
|
Plotzky C, Lindwedel U, Sorber M, Loessl B, König P, Kunze C, Kugler C, Meng M. Virtual reality simulations in nurse education: A systematic mapping review. NURSE EDUCATION TODAY 2021; 101:104868. [PMID: 33798987 DOI: 10.1016/j.nedt.2021.104868] [Citation(s) in RCA: 79] [Impact Index Per Article: 26.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2020] [Revised: 03/02/2021] [Accepted: 03/09/2021] [Indexed: 05/14/2023]
Abstract
OBJECTIVES Simulation-based learning is widely used in nurse education, including virtual reality (VR) methods which have experienced a major growth lately. Virtual reality offers risk free and contactless learning. Currently, little is known about what topics of nursing are adopted for VR simulations and how their design meets various educational goals. This review aims to scope existing articles on educational VR nursing simulations, and to analyse approaches from didactic and technical perspectives. METHOD A systematic mapping review following the PRISMA-ScR guideline and PICo search strategy was conducted. Peer reviewed articles in English and German were searched across Scopus, CINAHL, PsycINFO, PSYNDEX, PsycARTICLES, PubMed, ERIC and The Cochrane Library. Studies had to include at least one immersive head-mounted display VR simulation in the field of nursing education. Data extraction and analysis was performed in a narrative, graphical and tabular way. RESULTS Twenty-two articles were identified. There is a large variety in the use and definition of VR simulation for educational purposes. Simulations were classified into four main educational objectives: procedural skills training to improve technical knowledge and proficiency; emergency response training that focusses on confidence; soft skills training that teaches empathy; and finally, psychomotor skills training. Various approaches and simulation designs were implemented to achieve these educational outcomes. A few of them were highly innovative in providing an immersive experience to learn complex tasks, e.g. auscultation, or foster empathy by mimicking life with dementia. CONCLUSIONS Despite an increase in the use of state-of-the-art VR nursing simulations, there is still a paucity of studies on immersive HMD based VR scenarios. Researchers designing educational VR packages need to be clear on terminology. In order to make full use of VR, designers should consider including haptic devices to practise psychomotor skills and include social interaction to teach soft skills.
Collapse
|
33
|
Schwab BC, König P, Engel AK. Spike-timing-dependent plasticity can account for connectivity aftereffects of dual-site transcranial alternating current stimulation. Neuroimage 2021; 237:118179. [PMID: 34015486 DOI: 10.1016/j.neuroimage.2021.118179] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2021] [Revised: 04/07/2021] [Accepted: 05/15/2021] [Indexed: 11/29/2022] Open
Abstract
Transcranial alternating current stimulation (tACS), applied to two brain sites with different phase lags, has been shown to modulate stimulation-outlasting functional EEG connectivity between the targeted regions. Given the lack of knowledge on mechanisms of tACS aftereffects, it is difficult to further enhance effect sizes and reduce variability in experiments. In this computational study, we tested if spike-timing-dependent plasticity (STDP) can explain stimulation-outlasting connectivity modulation by dual-site tACS and explored the effects of tACS parameter choices. Two populations of spiking neurons were coupled with synapses subject to STDP, and results were validated via a re-analysis of EEG data. Our simulations showed stimulation-outlasting connectivity changes between in- and anti-phase tACS, dependent on both tACS frequency and synaptic conduction delays. Importantly, both a simple network entraining to a wide range of tACS frequencies as well as a more realistic network that spontaneously oscillated at alpha frequency predicted that the largest effects would occur for short conduction delays between the stimulated regions. This finding agreed with experimental EEG connectivity modulation by 10Hz tACS, showing a clear negative correlation of tACS effects with estimated conduction delays between regions. In conclusion, STDP can explain connectivity aftereffects of dual-site tACS. However, not all combinations of tACS frequency and application sites are expected to effectively modulate connectivity via STDP. We therefore suggest using appropriate computational models and/or EEG analysis for planning and interpretation of dual-site tACS studies relying on aftereffects.
Collapse
|
34
|
Vox JP, Weber A, Wolf KI, Izdebski K, Schüler T, König P, Wallhoff F, Friemert D. An Evaluation of Motion Trackers with Virtual Reality Sensor Technology in Comparison to a Marker-Based Motion Capture System Based on Joint Angles for Ergonomic Risk Assessment. SENSORS 2021; 21:s21093145. [PMID: 34062827 PMCID: PMC8124554 DOI: 10.3390/s21093145] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Revised: 04/18/2021] [Accepted: 04/26/2021] [Indexed: 11/16/2022]
Abstract
The reproduction and simulation of workplaces, and the analysis of body postures during work processes, are parts of ergonomic risk assessments. A commercial virtual reality (VR) system offers the possibility to model complex work scenarios as virtual mock-ups and to evaluate their ergonomic designs by analyzing motion behavior while performing work processes. In this study a VR tracking sensor system (HTC Vive tracker) combined with an inverse kinematic model (Final IK) was compared with a marker-based optical motion capture system (Qualisys). Marker-based optical motion capture systems are considered the gold standard for motion analysis. Therefore, Qualisys was used as the ground truth in this study. The research question to be answered was how accurately the HTC Vive System combined with Final IK can measure joint angles used for ergonomic evaluation. Twenty-six subjects were observed simultaneously with both tracking systems while performing 20 defined movements. Sixteen joint angles were analyzed. Joint angle deviations between ±6∘ and ±42∘ were identified. These high deviations must be considered in ergonomic risk assessments when using a VR system. The results show that commercial low-budget tracking systems have the potential to map joint angles. Nevertheless, substantial weaknesses and inaccuracies in some body regions must be taken into account. Recommendations are provided to improve tracking accuracy and avoid systematic errors.
Collapse
|
35
|
Hänske GG, König P, Schuhmann B, Bertram CA, Müller K. Death in four RHDV2-vaccinated pet rabbits due to rabbit haemorrhagic disease virus 2 (RHDV2). J Small Anim Pract 2021; 62:700-703. [PMID: 33900627 DOI: 10.1111/jsap.13333] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Revised: 02/20/2021] [Accepted: 03/04/2021] [Indexed: 11/27/2022]
Abstract
OBJECTIVES To create awareness of single RHDV2 infections and cases of death despite immunisation with RHDV2-specific vaccine. MATERIALS AND METHODS Retrospective case series of four companion rabbits. Patient signalment, vaccination history, pathology and molecular examinations were obtained from the medical records. RESULTS The animals died peracutely or with nonspecific symptoms like apathy and inappetence. Pathological examination indicated and molecular biological findings confirmed RHDV2 infection in four animals. Several partner animals died at the same time under the same circumstances. CLINICAL SIGNIFICANCE This is the first report of fatalities in RHDV2-vaccinated companion rabbits due to rabbit haemorrhagic disease virus 2 infection with documented case and vaccination history. Veterinarians should be aware of possible single fatal RHDV2 infections despite vaccination, should initiate the clarification of suspected cases and inform vaccine manufacturers and competent authorities.
Collapse
|
36
|
Pavlov YG, Adamian N, Appelhoff S, Arvaneh M, Benwell CSY, Beste C, Bland AR, Bradford DE, Bublatzky F, Busch NA, Clayson PE, Cruse D, Czeszumski A, Dreber A, Dumas G, Ehinger B, Ganis G, He X, Hinojosa JA, Huber-Huber C, Inzlicht M, Jack BN, Johannesson M, Jones R, Kalenkovich E, Kaltwasser L, Karimi-Rouzbahani H, Keil A, König P, Kouara L, Kulke L, Ladouceur CD, Langer N, Liesefeld HR, Luque D, MacNamara A, Mudrik L, Muthuraman M, Neal LB, Nilsonne G, Niso G, Ocklenburg S, Oostenveld R, Pernet CR, Pourtois G, Ruzzoli M, Sass SM, Schaefer A, Senderecka M, Snyder JS, Tamnes CK, Tognoli E, van Vugt MK, Verona E, Vloeberghs R, Welke D, Wessel JR, Zakharov I, Mushtaq F. #EEGManyLabs: Investigating the replicability of influential EEG experiments. Cortex 2021; 144:213-229. [PMID: 33965167 DOI: 10.1016/j.cortex.2021.03.013] [Citation(s) in RCA: 45] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Revised: 03/02/2021] [Accepted: 03/09/2021] [Indexed: 12/29/2022]
Abstract
There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.
Collapse
|
37
|
Wagner C, Uliczka K, Bossen J, Niu X, Fink C, Thiedmann M, Knop M, Vock C, Abdelsadik A, Zissler UM, Isermann K, Garn H, Pieper M, Wegmann M, Koczulla AR, Vogelmeier CF, Schmidt-Weber CB, Fehrenbach H, König P, Silverman N, Renz H, Pfefferle P, Heine H, Roeder T. Constitutive immune activity promotes JNK- and FoxO-dependent remodeling of Drosophila airways. Cell Rep 2021; 35:108956. [PMID: 33826881 DOI: 10.1016/j.celrep.2021.108956] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2020] [Revised: 12/29/2020] [Accepted: 03/17/2021] [Indexed: 01/07/2023] Open
Abstract
Extensive remodeling of the airways is a major characteristic of chronic inflammatory lung diseases such as asthma or chronic obstructive pulmonary disease (COPD). To elucidate the importance of a deregulated immune response in the airways for remodeling processes, we established a matching Drosophila model. Here, triggering the Imd (immune deficiency) pathway in tracheal cells induced organ-wide remodeling. This structural remodeling comprises disorganization of epithelial structures and comprehensive epithelial thickening. We show that these structural changes do not depend on the Imd pathway's canonical branch terminating on nuclear factor κB (NF-κB) activation. Instead, activation of a different segment of the Imd pathway that branches off downstream of Tak1 and comprises activation of c-Jun N-terminal kinase (JNK) and forkhead transcription factor of the O subgroup (FoxO) signaling is necessary and sufficient to mediate the observed structural changes of the airways. Our findings imply that targeting JNK and FoxO signaling in the airways could be a promising strategy to interfere with disease-associated airway remodeling processes.
Collapse
|
38
|
Czeszumski A, Albers F, Walter S, König P. Let Me Make You Happy, and I'll Tell You How You Look Around: Using an Approach-Avoidance Task as an Embodied Emotion Prime in a Free-Viewing Task. Front Psychol 2021; 12:604393. [PMID: 33790829 PMCID: PMC8005526 DOI: 10.3389/fpsyg.2021.604393] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2020] [Accepted: 02/18/2021] [Indexed: 11/29/2022] Open
Abstract
The embodied approach of human cognition suggests that concepts are deeply dependent upon and constrained by an agent's physical body's characteristics, such as performed body movements. In this study, we attempted to broaden previous research on emotional priming, investigating the interaction of emotions and visual exploration. We used the joystick-based approach-avoidance task to influence the emotional states of participants, and subsequently, we presented pictures of news web pages on a computer screen and measured participant's eye movements. As a result, the number of fixations on images increased, the total dwell time increased, and the average saccade length from outside of the images toward the images decreased after the bodily congruent priming phase. The combination of these effects suggests increased attention to web pages' image content after the participants performed bodily congruent actions in the priming phase. Thus, congruent bodily interaction with images in the priming phase fosters visual interaction in the subsequent exploration phase.
Collapse
|
39
|
Nezami FN, Wächter MA, Maleki N, Spaniol P, Kühne LM, Haas A, Pingel JM, Tiemann L, Nienhaus F, Keller L, König SU, König P, Pipa G. Westdrive X LoopAR: An Open-Access Virtual Reality Project in Unity for Evaluating User Interaction Methods during Takeover Requests. SENSORS 2021; 21:s21051879. [PMID: 33800215 PMCID: PMC7962530 DOI: 10.3390/s21051879] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Revised: 02/21/2021] [Accepted: 02/25/2021] [Indexed: 12/03/2022]
Abstract
With the further development of highly automated vehicles, drivers will engage in non-related tasks while being driven. Still, drivers have to take over control when requested by the car. Here, the question arises, how potentially distracted drivers get back into the control-loop quickly and safely when the car requests a takeover. To investigate effective human–machine interactions, a mobile, versatile, and cost-efficient setup is needed. Here, we describe a virtual reality toolkit for the Unity 3D game engine containing all the necessary code and assets to enable fast adaptations to various human–machine interaction experiments, including closely monitoring the subject. The presented project contains all the needed functionalities for realistic traffic behavior, cars, pedestrians, and a large, open-source, scriptable, and modular VR environment. It covers roughly 25 km2, a package of 125 animated pedestrians, and numerous vehicles, including motorbikes, trucks, and cars. It also contains all the needed nature assets to make it both highly dynamic and realistic. The presented repository contains a C++ library made for LoopAR that enables force feedback for gaming steering wheels as a fully supported component. It also includes all necessary scripts for eye-tracking in the used devices. All the main functions are integrated into the graphical user interface of the Unity® editor or are available as prefab variants to ease the use of the embedded functionalities. This project’s primary purpose is to serve as an open-access, cost-efficient toolkit that enables interested researchers to conduct realistic virtual reality research studies without costly and immobile simulators. To ensure the accessibility and usability of the mentioned toolkit, we performed a user experience report, also included in this paper.
Collapse
|
40
|
König P, Jimenez K, Saletu-Zyhlarz G, Mittlböck M, Gasche C. Iron deficiency, depression, and fatigue in inflammatory bowel diseases. ZEITSCHRIFT FUR GASTROENTEROLOGIE 2020; 58:1191-1200. [DOI: 10.1055/a-1283-6832] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
Abstract
Background Iron deficiency and anemia are common findings in IBD. Treatment of anemia improves quality of life. Neurological symptoms like depression or anxiety are also common in IBD; however, their relationship with ID has not been studied in detail.
Methods Prospective, single center, non-interventional trial in an IBD cohort (n = 98), which is generally at risk for ID. Quality of sleep (using the Pittsburgh Sleep Quality Index, Epworth Sleepiness Scale, and Insomnia Severity Index) and the presence of fatigue (Piper fatigue scale), depression (Self-rating Depression Scale [SDS]) or anxiety (Self-rating Anxiety Scale [SAS]) were related to ID (ferritin, transferrin saturation), anemia (hemoglobin), and inflammatory disease activity (CRP).
Results ID was present in 35 %, anemia in 16 %, and inflammation in 30 %. The overall quality of sleep in this cohort was similar to that reported for the general population. ID, anemia, or inflammation had no influence on the PSQI (median 4.0 [CI 3.0–5.0]), the ESS 5.5 (5.0–7.0), and the ISI 4.00 (2.5–5.5). Fatigue (PFS; present in 30 %), anxiety (SAS; present in 24 %), and depression (SDS; present in 33 %) were more common than in the general population. Iron deficient and anemic patients were more likely to be depressed (p = 0.02 and p < 0.01) and showed a trend towards presence of fatigue (p = 0.06 and 0.07). Systemic inflammation as measured by CRP had no effect on any of these conditions.
Conclusion In this IBD cohort, ID and anemia affect depression and possibly fatigue independent of the presence of inflammation.
Collapse
|
41
|
Ossandón JP, König P, Heed T. No Evidence for a Role of Spatially Modulated α-Band Activity in Tactile Remapping and Short-Latency, Overt Orienting Behavior. J Neurosci 2020; 40:9088-9102. [PMID: 33087476 PMCID: PMC7672998 DOI: 10.1523/jneurosci.0581-19.2020] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2019] [Revised: 07/20/2020] [Accepted: 08/11/2020] [Indexed: 11/21/2022] Open
Abstract
Oscillatory α-band activity is commonly associated with spatial attention and multisensory prioritization. It has also been suggested to reflect the automatic transformation of tactile stimuli from a skin-based, somatotopic reference frame into an external one. Previous research has not convincingly separated these two possible roles of α-band activity. Previous experimental paradigms have used artificially long delays between tactile stimuli and behavioral responses to aid relating oscillatory activity to these different events. However, this strategy potentially blurs the temporal relationship of α-band activity relative to behavioral indicators of tactile-spatial transformations. Here, we assessed α-band modulation with massive univariate deconvolution, an analysis approach that disentangles brain signals overlapping in time and space. Thirty-one male and female human participants performed a delay-free, visual search task in which saccade behavior was unrestricted. A tactile cue to uncrossed or crossed hands was either informative or uninformative about visual target location. α-Band suppression following tactile stimulation was lateralized relative to the stimulated hand over central-parietal electrodes but relative to its external location over parieto-occipital electrodes. α-Band suppression reflected external touch location only after informative cues, suggesting that posterior α-band lateralization does not index automatic tactile transformation. Moreover, α-band suppression occurred at the time of, or after, the production of the saccades guided by tactile stimulation. These findings challenge the idea that α-band activity is directly involved in tactile-spatial transformation and suggest instead that it reflects delayed, supramodal processes related to attentional reorienting.SIGNIFICANCE STATEMENT Localizing a touch in space requires integrating somatosensory information about skin location and proprioceptive or visual information about posture. The automatic remapping between skin-based tactile information to a location in external space has been proposed to rely on the modulation of oscillatory brain activity in the α-band range, across the multiple cortical areas that are involved in tactile, multisensory, and spatial processing. We report two findings that are inconsistent with this view. First, α-band activity reflected the remapped stimulus location only when touch was task relevant. Second, α-band modulation occurred too late to account for spatially directed behavioral responses and, thus, only after remapping must have taken place. These characteristics contradict the idea that α-band directly reflects automatic tactile remapping processes.
Collapse
|
42
|
Quell KM, Dutta K, Korkmaz ÜR, Nogueira de Almeida L, Vollbrandt T, König P, Lewkowich I, Deepe GS, Verschoor A, Köhl J, Laumonnier Y. GM-CSF and IL-33 Orchestrate Polynucleation and Polyploidy of Resident Murine Alveolar Macrophages in a Murine Model of Allergic Asthma. Int J Mol Sci 2020; 21:ijms21207487. [PMID: 33050608 PMCID: PMC7589978 DOI: 10.3390/ijms21207487] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Revised: 10/01/2020] [Accepted: 10/07/2020] [Indexed: 02/07/2023] Open
Abstract
Allergic asthma is a chronical pulmonary disease with high prevalence. It manifests as a maladaptive immune response to common airborne allergens and is characterized by airway hyperresponsiveness, eosinophilia, type 2 cytokine-associated inflammation, and mucus overproduction. Alveolar macrophages (AMs), although contributing to lung homeostasis and tolerance to allergens at steady state, have attracted less attention compared to professional antigen-presenting and adaptive immune cells in their contributions. Using an acute model of house dust mite-driven allergic asthma in mice, we showed that a fraction of resident tissue-associated AMs, while polarizing to the alternatively activated M2 phenotype, exhibited signs of polynucleation and polyploidy. Mechanistically, in vitro assays showed that only Granulocyte-Macrophage Colony Stimulating Factor and interleukins IL-13 and IL-33, but not IL-4 or IL-5, participate in the establishment of this phenotype, which resulted from division defects and not cell-cell fusion as shown by microscopy. Intriguingly, mRNA analysis of AMs isolated from allergic asthmatic lungs failed to show changes in the expression of genes involved in DNA damage control except for MafB. Altogether, our data support the idea that upon allergic inflammation, AMs undergo DNA damage-induced stresses, which may provide new unconventional therapeutical approaches to treat allergic asthma.
Collapse
|
43
|
Münter M, Vom Endt M, Pieper M, Casper M, Ahrens M, Kohlfaerber T, Rahmanzadeh R, König P, Hüttmann G, Schulz-Hildebrandt H. Dynamic contrast in scanning microscopic OCT. OPTICS LETTERS 2020; 45:4766-4769. [PMID: 32870852 DOI: 10.1364/ol.396134] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/28/2020] [Accepted: 07/07/2020] [Indexed: 05/18/2023]
Abstract
While optical coherence tomography (OCT) provides a resolution down to 1 µm, it has difficulties in visualizing cellular structures due to a lack of scattering contrast. By evaluating signal fluctuations, a significant contrast enhancement was demonstrated using time-domain full-field OCT (FF-OCT), which makes cellular and subcellular structures visible. The putative cause of the dynamic OCT signal is the site-dependent active motion of cellular structures in a sub-micrometer range, which provides histology-like contrast. Here we demonstrate dynamic contrast with a scanning frequency-domain OCT (FD-OCT), which we believe has crucial advantages. Given the inherent sectional imaging geometry, scanning FD-OCT provides depth-resolved images across tissue layers, a perspective known from histopathology, much faster and more efficiently than FF-OCT. Both shorter acquisition times and tomographic depth-sectioning reduce the sensitivity of dynamic contrast for bulk tissue motion artifacts and simplify their correction in post-processing. Dynamic contrast makes microscopic FD-OCT a promising tool for the histological analysis of unstained tissues.
Collapse
|
44
|
Hernández-García A, Ramos Gameiro R, Grillini A, König P. Global visual salience of competing stimuli. J Vis 2020; 20:27. [PMID: 32720973 PMCID: PMC7424106 DOI: 10.1167/jov.20.7.27] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2019] [Accepted: 01/14/2020] [Indexed: 11/24/2022] Open
Abstract
Current computational models of visual salience accurately predict the distribution of fixations on isolated visual stimuli. It is not known, however, whether the global salience of a stimulus, that is, its effectiveness in the competition for attention with other stimuli, is a function of the local salience or an independent measure. Further, do task and familiarity with the competing images influence eye movements? Here, we investigated the direction of the first saccade to characterize and analyze the global visual salience of competing stimuli. Participants freely observed pairs of images while eye movements were recorded. The pairs balanced the combinations of new and already seen images, as well as task and task-free trials. Then, we trained a logistic regression model that accurately predicted the location-left or right image-of the first fixation for each stimulus pair, accounting too for the influence of task, familiarity, and lateral bias. The coefficients of the model provided a reliable measure of global salience, which we contrasted with two distinct local salience models, GBVS and Deep Gaze. The lack of correlation of the behavioral data with the former and the small correlation with the latter indicate that global salience cannot be explained by the feature-driven local salience of images. Further, the influence of task and familiarity was rather small, and we reproduced the previously reported left-sided bias. Summarized, we showed that natural stimuli have an intrinsic global salience related to the human initial gaze direction, independent of the local salience and little influenced by task and familiarity.
Collapse
|
45
|
Clay V, Schrumpf J, Tessenow Y, Leder H, Ansorge U, König P. A Quantitative Analysis of the Taxonomy of Artistic Styles. J Eye Mov Res 2020; 13:10.16910/jemr.13.2.5. [PMID: 33828791 PMCID: PMC7962801 DOI: 10.16910/jemr.13.2.5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022] Open
Abstract
Classifying artists and their work as distinct art styles has been an important task of scholars in the field of art history. Due to its subjectivity, scholars often contradict one another. Our project investigated differences in aesthetic qualities of seven art styles through quantitative means. This was achieved with state-of-the-art deep-learning paradigms to generate new images resembling the style of an artist or entire era. We conducted psychological experiments to measure the behavior of subjects when viewing these new art images. Two different experiments were used: In an eye-tracking study, subjects viewed art-stylespecific generated images. Eye movements were recorded and then compared between art styles. In a visual singleton search study, subjects had to locate a style-outlier image among three images of an alternative style. Reaction time and accuracy were measured and analyzed. These experiments show that there are measurable differences in behavior when viewing images of varying art styles. From these differences, we constructed hierarchical clusterings relating art styles based on the different behaviors of subjects viewing the samples. Our study reveals a novel perspective on the classification of artworks into stylistic eras and motivates future research in the domain of empirical aesthetics through quantitative means.
Collapse
|
46
|
Conca A, Hrubos W, Di Pauli J, König P, Hausmann A. ECT response after relapse during continuation repetitive transcranial magnetic stimulation. A case report. Eur Psychiatry 2020; 19:118-9. [PMID: 15051113 DOI: 10.1016/j.eurpsy.2003.07.012] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/10/2003] [Revised: 07/01/2003] [Accepted: 07/21/2003] [Indexed: 12/01/2022] Open
Abstract
AbstractResearch on repetitive transcranial magnetic stimulation (rTMS) indicates that the treatment of non-psychotic depression is comparable to electroconvulsive therapy (ECT) in terms of short-term outcome. We report on a woman who exerted a recurrent moderate major depressive episode, 6 months after discontinuation of maintenance ECT. She responded to acute rTMS treatment which was followed by the rTMS maintenance-protocol. Within 2 months of continuation rTMS she relapsed suffering from a severe non psychotic depressive episode and had to be switched to a successful ECT. In this patient rTMS had a good clinical impact as an acute treatment strategy, but failed to prevent relapse as the continuation ECT previously did in the same patient.
Collapse
|
47
|
Czeszumski A, Eustergerling S, Lang A, Menrath D, Gerstenberger M, Schuberth S, Schreiber F, Rendon ZZ, König P. Hyperscanning: A Valid Method to Study Neural Inter-brain Underpinnings of Social Interaction. Front Hum Neurosci 2020; 14:39. [PMID: 32180710 PMCID: PMC7059252 DOI: 10.3389/fnhum.2020.00039] [Citation(s) in RCA: 175] [Impact Index Per Article: 43.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2019] [Accepted: 01/27/2020] [Indexed: 01/11/2023] Open
Abstract
Social interactions are a crucial part of human life. Understanding the neural underpinnings of social interactions is a challenging task that the hyperscanning method has been trying to tackle over the last two decades. Here, we review the existing literature and evaluate the current state of the hyperscanning method. We review the type of methods (fMRI, M/EEG, and fNIRS) that are used to measure brain activity from more than one participant simultaneously and weigh their pros and cons for hyperscanning. Further, we discuss different types of analyses that are used to estimate brain networks and synchronization. Lastly, we present results of hyperscanning studies in the context of different cognitive functions and their relations to social interactions. All in all, we aim to comprehensively present methods, analyses, and results from the last 20 years of hyperscanning research.
Collapse
|
48
|
Pieper M, Schulz-Hildebrandt H, Mall MA, Hüttmann G, König P. Intravital microscopic optical coherence tomography imaging to assess mucus-mobilizing interventions for muco-obstructive lung disease in mice. Am J Physiol Lung Cell Mol Physiol 2020; 318:L518-L524. [PMID: 31994896 PMCID: PMC7093113 DOI: 10.1152/ajplung.00287.2019] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022] Open
Abstract
Airway mucus obstruction is a hallmark of chronic lung diseases such as cystic fibrosis, asthma, and COPD, and the development of more effective mucus-mobilizing therapies remains an important unmet need for patients with these muco-obstructive lung diseases. However, methods for sensitive visualization and quantitative assessment of immediate effects of therapeutic interventions on mucus clearance in vivo are lacking. In this study, we determined whether newly developed high-speed microscopic optical coherence tomography (mOCT) is sensitive to detect and compare in vivo effects of inhaled isotonic saline, hypertonic saline, and bicarbonate on mucus mobilization and clearance in Scnn1b-transgenic mice with muco-obstructive lung disease. In vivo mOCT imaging showed that inhaled isotonic saline-induced rapid mobilization of mucus that was mainly transported as chunks from the lower airways of Scnn1b-transgenic mice. Hypertonic saline mobilized a significantly greater amount of mucus that showed a more uniform distribution compared with isotonic saline. The addition of bicarbonate-to-isotonic saline had no effect on mucus mobilization, but also led to a more uniform mucus layer compared with treatment with isotonic saline alone. mOCT can detect differences in response to mucus-mobilizing interventions in vivo, and may thus support the development of more effective therapies for patients with muco-obstructive lung diseases.
Collapse
|
49
|
Finger H, Gast R, Gerloff C, Engel AK, König P. Probing neural networks for dynamic switches of communication pathways. PLoS Comput Biol 2019; 15:e1007551. [PMID: 31841504 PMCID: PMC6936858 DOI: 10.1371/journal.pcbi.1007551] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2019] [Revised: 12/30/2019] [Accepted: 11/18/2019] [Indexed: 12/12/2022] Open
Abstract
Dynamic communication and routing play important roles in the human brain in order to facilitate flexibility in task solving and thought processes. Here, we present a network perturbation methodology that allows investigating dynamic switching between different network pathways based on phase offsets between two external oscillatory drivers. We apply this method in a computational model of the human connectome with delay-coupled neural masses. To analyze dynamic switching of pathways, we define four new metrics that measure dynamic network response properties for pairs of stimulated nodes. Evaluating these metrics for all network pathways, we found a broad spectrum of pathways with distinct dynamic properties and switching behaviors. We show that network pathways can have characteristic timescales and thus specific preferences for the phase lag between the regions they connect. Specifically, we identified pairs of network nodes whose connecting paths can either be (1) insensitive to the phase relationship between the node pair, (2) turned on and off via changes in the phase relationship between the node pair, or (3) switched between via changes in the phase relationship between the node pair. Regarding the latter, we found that 33% of node pairs can switch their communication from one pathway to another depending on their phase offsets. This reveals a potential mechanistic role that phase offsets and coupling delays might play for the dynamic information routing via communication pathways in the brain. A big challenge in elucidating information processing in the brain is to understand the neural mechanisms that dynamically organize the communication between different brain regions in a flexible and task-dependent manner. In this theoretical study, we present an approach to investigate the routing and gating of information flow along different pathways from one region to another. We show that stimulation of the brain at two sites with different frequencies and oscillatory phases can reveal the underlying effective connectivity. This yields new insights into the underlying processes that govern dynamic switches in the communication pathways between remote sites of the brain.
Collapse
|
50
|
Kallioinen N, Pershina M, Zeiser J, Nosrat Nezami F, Pipa G, Stephan A, König P. Moral Judgements on the Actions of Self-Driving Cars and Human Drivers in Dilemma Situations From Different Perspectives. Front Psychol 2019; 10:2415. [PMID: 31749736 PMCID: PMC6844247 DOI: 10.3389/fpsyg.2019.02415] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2019] [Accepted: 10/10/2019] [Indexed: 11/25/2022] Open
Abstract
Self-driving cars have the potential to greatly improve public safety. However, their introduction onto public roads must overcome both ethical and technical challenges. To further understand the ethical issues of introducing self-driving cars, we conducted two moral judgement studies investigating potential differences in the moral norms applied to human drivers and self-driving cars. In the experiments, participants made judgements on a series of dilemma situations involving human drivers or self-driving cars. We manipulated which perspective situations were presented from in order to ascertain the effect of perspective on moral judgements. Two main findings were apparent from the results of the experiments. First, human drivers and self-driving cars were largely judged similarly. However, there was a stronger tendency to prefer self-driving cars to act in ways to minimize harm, compared to human drivers. Second, there was an indication that perspective influences judgements in some situations. Specifically, when considering situations from the perspective of a pedestrian, people preferred actions that would endanger car occupants instead of themselves. However, they did not show such a self-preservation tendency when the alternative was to endanger other pedestrians to save themselves. This effect was more prevalent for judgements on human drivers than self-driving cars. Overall, the results extend and agree with previous research, again contradicting existing ethical guidelines for self-driving car decision making and highlighting the difficulties with adapting public opinion to decision making algorithms.
Collapse
|