Over- and underweighting of extreme values in decisions from sequential samples

People routinely make decisions based on samples of numerical values. A common conclusion from the literature in psychophysics and behavioral economics is that observers subjectively compress magnitudes, such that extreme values have less sway over people's decisions than prescribed by a normative model (underweighting). However, recent studies have reported evidence for anti-compression, that is, the relative overweighting of extreme values. Here, we investigate potential reasons for this discrepancy in findings and propose that it might reflect adaptive responses to different task requirements. We performed a large-scale study (n = 586) of sequential numerical integration, manipulating (a) the task requirement (averaging a single stream or comparing two interleaved streams of numbers), (b) the distribution of sample values (uniform or Gaussian), and (c) their range (1-9 or 100-900). The data showed compression of subjective values in the averaging task, but anticompression in the comparison task. This pattern held for both distribution types and for both ranges. In model simulations, we show that either compression or anticompression can be beneficial for noisy observers, depending on the sample-level processing demands imposed by the task. This suggests that the empirically observed patterns of over- and underweighting might reflect adaptive responses. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

The Past, Present, and Future of the Brain Imaging Data Structure (BIDS)

The Brain Imaging Data Structure (BIDS) is a community-driven standard for the organization of data and metadata from a growing range of neuroscience modalities. This paper is meant as a history of how the standard has developed and grown over time. We outline the principles behind the project, the mechanisms by which it has been extended, and some of the challenges being addressed as it evolves. We also discuss the lessons learned through the project, with the aim of enabling researchers in other domains to learn from the success of BIDS.

Development and Sharing of Open Science Hardware: Lessons Learned from Wikimedia Fellowships

The promise of open hardware as a branch of open science is a sustainable change of research instrumentation towards more openly documented and licensed designs. Methods, code, and data are already valued by journal editors and peer-reviews to judge if a study's result can be replicated with the information provided in a manuscript. The open hardware movement seeks to include laboratory tools and research instrumentation into the same category. Availability of and access to open hardware equipment are set to democratize professional lab work and field studies as well as enhance the transferability of methods to civic science settings. Here, we report four case studies from the first five years of the Wikimedia Program "Free Knowledge", an open science fellowship funded by Wikimedia Germany and partners. The project developers discuss and evaluate the impact related to key aspects typically attributed with open hardware: costs, availability, adaptability, community and educational value. The open hardware projects covered in this review span from natural sciences to life sciences to education.

Open and reproducible neuroimaging: From study inception to publication

Empirical observations of how labs conduct research indicate that the adoption rate of open practices for transparent, reproducible, and collaborative science remains in its infancy. This is at odds with the overwhelming evidence for the necessity of these practices and their benefits for individual researchers, scientific progress, and society in general. To date, information required for implementing open science practices throughout the different steps of a research project is scattered among many different sources. Even experienced researchers in the topic find it hard to navigate the ecosystem of tools and to make sustainable choices. Here, we provide an integrated overview of community-developed resources that can support collaborative, open, reproducible, replicable, robust and generalizable neuroimaging throughout the entire research cycle from inception to publication and across different neuroimaging modalities. We review tools and practices supporting study inception and planning, data acquisition, research data management, data processing and analysis, and research dissemination. An online version of this resource can be found at https://oreoni.github.io. We believe it will prove helpful for researchers and institutions to make a successful and sustainable move towards open and reproducible science and to eventually take an active role in its future development.

qMRI-BIDS: An extension to the brain imaging data structure for quantitative magnetic resonance imaging data

The Brain Imaging Data Structure (BIDS) established community consensus on the organization of data and metadata for several neuroimaging modalities. Traditionally, BIDS had a strong focus on functional magnetic resonance imaging (MRI) datasets and lacked guidance on how to store multimodal structural MRI datasets. Here, we present and describe the BIDS Extension Proposal 001 (BEP001), which adds a range of quantitative MRI (qMRI) applications to the BIDS. In general, the aim of qMRI is to characterize brain microstructure by quantifying the physical MR parameters of the tissue via computational, biophysical models. By proposing this new standard, we envision standardization of qMRI through multicenter dissemination of interoperable datasets. This way, BIDS can act as a catalyst of convergence between qMRI methods development and application-driven neuroimaging studies that can help develop quantitative biomarkers for neural tissue characterization. In conclusion, this BIDS extension offers a common ground for developers to exchange novel imaging data and tools, reducing the entrance barrier for qMRI in the field of neuroimaging.

Control over sampling boosts numerical evidence processing in human decisions from experience

When acquiring information about choice alternatives, decision makers may have varying levels of control over which and how much information they sample before making a choice. How does control over information acquisition affect the quality of sample-based decisions? Here, combining variants of a numerical sampling task with neural recordings, we show that control over when to stop sampling can enhance (i) behavioral choice accuracy, (ii) the build-up of parietal decision signals, and (iii) the encoding of numerical sample information in multivariate electroencephalogram patterns. None of these effects were observed when participants could only control which alternatives to sample, but not when to stop sampling. Furthermore, levels of control had no effect on early sensory signals or on the extent to which sample information leaked from memory. The results indicate that freedom to stop sampling can amplify decisional evidence processing from the outset of information acquisition and lead to more accurate choices.

Capturing the nature of events and event context using hierarchical event descriptors (HED)

Event-related data analysis plays a central role in EEG and MEG (MEEG) and other neuroimaging modalities including fMRI. Choices about which events to report and how to annotate their full natures significantly influence the value, reliability, and reproducibility of neuroimaging datasets for further analysis and meta- or mega-analysis. A powerful annotation strategy using the new third-generation formulation of the Hierarchical Event Descriptors (HED) framework and tools (hedtags.org) combines robust event description with details of experiment design and metadata in a human-readable as well as machine-actionable form, making event annotation relevant to the full range of neuroimaging and other time series data. This paper considers the event design and annotation process using as a case study the well-known multi-subject, multimodal dataset of Wakeman and Henson made available by its authors as a Brain Imaging Data Structure (BIDS) dataset (bids.neuroimaging.io). We propose a set of best practices and guidelines for event annotation integrated in a natural way into the BIDS metadata file architecture, examine the impact of event design decisions, and provide a working example of organizing events in MEEG and other neuroimaging data. We demonstrate how annotations using HED can document events occurring during neuroimaging experiments as well as their interrelationships, providing machine-actionable annotation enabling automated within- and across-experiment analysis and comparisons. We discuss the evolution of HED software tools and have made available an accompanying HED-annotated BIDS-formated edition of the MEEG data of the Wakeman and Henson dataset (openneuro.org, ds003645).

Centering inclusivity in the design of online conferences-An OHBM-Open Science perspective

As the global health crisis unfolded, many academic conferences moved online in 2020. This move has been hailed as a positive step towards inclusivity in its attenuation of economic, physical, and legal barriers and effectively enabled many individuals from groups that have traditionally been underrepresented to join and participate. A number of studies have outlined how moving online made it possible to gather a more global community and has increased opportunities for individuals with various constraints, e.g., caregiving responsibilities. Yet, the mere existence of online conferences is no guarantee that everyone can attend and participate meaningfully. In fact, many elements of an online conference are still significant barriers to truly diverse participation: the tools used can be inaccessible for some individuals; the scheduling choices can favour some geographical locations; the set-up of the conference can provide more visibility to well-established researchers and reduce opportunities for early-career researchers. While acknowledging the benefits of an online setting, especially for individuals who have traditionally been underrepresented or excluded, we recognize that fostering social justice requires inclusivity to actively be centered in every aspect of online conference design. Here, we draw from the literature and from our own experiences to identify practices that purposefully encourage a diverse community to attend, participate in, and lead online conferences. Reflecting on how to design more inclusive online events is especially important as multiple scientific organizations have announced that they will continue offering an online version of their event when in-person conferences can resume.

#EEGManyLabs: Investigating the replicability of influential EEG experiments

There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.

Guidelines for the content and format of PET brain data in publications and archives: A consensus paper

It is a growing concern that outcomes of neuroimaging studies often cannot be replicated. To counteract this, the magnetic resonance (MR) neuroimaging community has promoted acquisition standards and created data sharing platforms, based on a consensus on how to organize and share MR neuroimaging data. Here, we take a similar approach to positron emission tomography (PET) data. To facilitate comparison of findings across studies, we first recommend publication standards for tracer characteristics, image acquisition, image preprocessing, and outcome estimation for PET neuroimaging data. The co-authors of this paper, representing more than 25 PET centers worldwide, voted to classify information as mandatory, recommended, or optional. Second, we describe a framework to facilitate data archiving and data sharing within and across centers. Because of the high cost of PET neuroimaging studies, sample sizes tend to be small and relatively few sites worldwide have the required multidisciplinary expertise to properly conduct and analyze PET studies. Data sharing will make it easier to combine datasets from different centers to achieve larger sample sizes and stronger statistical power to test hypotheses. The combining of datasets from different centers may be enhanced by adoption of a common set of best practices in data acquisition and analysis.

MNE-BIDS: Organizing electrophysiological data into the BIDS format and facilitating their analysis

The development of the Brain Imaging Data Structure (BIDS; Gorgolewski et al., 2016) gave the neuroscientific community a standard to organize and share data. BIDS prescribes file naming conventions and a folder structure to store data in a set of already existing file formats. Next to rules about organization of the data itself, BIDS provides standardized templates to store associated metadata in the form of Javascript Object Notation (JSON) and tab separated value (TSV) files. It thus facilitates data sharing, eases metadata querying, and enables automatic data analysis pipelines. BIDS is a rich system to curate, aggregate, and annotate neuroimaging databases.

iEEG-BIDS, extending the Brain Imaging Data Structure specification to human intracranial electrophysiology

The Brain Imaging Data Structure (BIDS) is a community-driven specification for organizing neuroscience data and metadata with the aim to make datasets more transparent, reusable, and reproducible. Intracranial electroencephalography (iEEG) data offer a unique combination of high spatial and temporal resolution measurements of the living human brain. To improve internal (re)use and external sharing of these unique data, we present a specification for storing and sharing iEEG data: iEEG-BIDS.

EEG-BIDS, an extension to the brain imaging data structure for electroencephalography

The Brain Imaging Data Structure (BIDS) project is a rapidly evolving effort in the human brain imaging research community to create standards allowing researchers to readily organize and share study data within and between laboratories. Here we present an extension to BIDS for electroencephalography (EEG) data, EEG-BIDS, along with tools and references to a series of public EEG datasets organized using this new standard.

Can short-wavelength depleted bright light during single simulated night shifts prevent circadian phase shifts?

In single night shifts, extending habitual wake episodes leads to sleep deprivation induced decrements of performance during the shift and re-adaptation effects the next day. We investigated whether short-wavelength depleted (=filtered) bright light (FBL) during a simulated night shift would counteract such effects. Twenty-four participants underwent a simulated night shift in dim light (DL) and in FBL. Reaction times, subjective sleepiness and salivary melatonin concentrations were assessed during both nights. Daytime sleep was recorded after both simulated night shifts. During FBL, we found no melatonin suppression compared to DL, but slightly faster reaction times in the second half of the night. Daytime sleep was not statistically different between both lighting conditions (n = 24) and there was no significant phase shift after FBL (n = 11). To conclude, our results showed positive effects from FBL during simulated single night shifts which need to be further tested with larger groups, in more applied studies and compared to standard lighting.