Tutorial: Small-N Power Analysis

Does increasing absolute conditioned reinforcement rate improve sensitivity to relative conditioned reinforcement rate?

Previous research has demonstrated several procedural modifications that improve the sensitivity of human behavior to relative rates of conditioned reinforcement or S+ production. Denser rates of reinforcement have proved useful in related human operant research, but the influence of denser rates of S+ production has yet to be evaluated. The purpose of the current study was to evaluate how the absolute S+ production rate influenced sensitivity to relative S+ production rate. Thirty undergraduate students were randomly assigned to three groups for which the absolute rate of S+ production varied but the programmed relative rate of S+ production was held constant across groups. Results similar to those of previous research were obtained with many participants; however, the absolute rate of S+ production exerted no systematic effect on sensitivity or the quality of fits of the generalized matching equation. Exploratory analyses suggest that methods ensuring steady-state responding and improving the predictive value of S+ are important directions for future research.

Role of the medial olivocochlear efferent auditory system in speech perception in noise: a systematic review and meta-analyses

OBJECTIVE

The study investigated the relationship between the strength of the medial olivocochlear reflex (measured via contralateral inhibition of otoacoustic emissions) and speech perception in noise (obtained from behavioural identification task) through meta-analyses.

DESIGN

A systematic review and random-effects meta-analysis of studies investigating the relationship in neurotypical adults was performed.

STUDY SAMPLE

The systematic search (in PubMed, Scopus, Science Direct and Google Scholar databases) revealed 21 eligible studies, which were critically appraised using the NIH tool for Observational Cohort and Cross-Sectional Studies. Meta-analysis was performed on 17 studies (374 participants) with fair to good quality.

RESULTS

The results revealed that the medial olivocochlear reflex accounts for less than 1% of the variations in speech perception in noise in neurotypical individuals. Sub-group analyses conducted to address a few methodological differences also revealed no discernible association between the two variables.

CONCLUSIONS

The results reveal no modulatory effect of the medial olivocochlear reflex assessed using contralateral inhibition of otoacoustic emission on the ability to perceive speech in noise. However, more data utilising alternative measures of medial olivocochlear reflex strength is necessary before drawing any conclusions about the role of the medial olivocochlear bundle in speech perception in noise.

The evolution of symptoms of nervous system dysfunction in a First Nation community with a history of mercury exposure: a longitudinal study

BACKGROUND

Since the 1960's, mercury (Hg) contamination of the aquatic environment of Asubpeeschoseewagong Anishinabek (Grassy Narrows First Nation) territories has impacted the community members' traditions, culture, livelihood, diet and health. Despite decreasing Hg exposure over time, a recent study suggested that long-term exposure contributed to later-life symptom clusters of nervous system dysfunction. Here, the objective was to evaluate, 5 years later, the prevalence and progression of these symptoms and examine the contribution of long-term, past Hg exposure.

METHODS

The symptom questionnaire, applied in the 2016/17 Grassy Narrows Community Health Assessment (GN-CHA) (Time 1), was re-administered in the 2021/22 Niibin study (Time 2). A total of 85 adults (median age: 47y; range: 29-75y) responded at both times. Paired statistics were used to test the differences (Time 2 - Time 1) in self-reported symptom frequencies. The symptom clustering algorithm, derived from the entire study group of the GN-CHA (n = 391), which had yielded 6 clusters, was applied at Time 1 and 2. Equivalent hair Hg measurements (HHg) between 1970 and 1997 were used in Longitudinal Mixed Effects Models (LMEM), with a sub-group with ≥ 10 repeated HHg mesurements (age > 40y), to examine its associations with symptom cluster scores and their progression.

RESULTS

For most symptoms, paired analyses (Time 2 - Time 1) showed a significant increase in persons reporting " very often" or "all the time", and in the mean Likert scores for younger and older participants (< and ≥ 50y). The increase in cluster scores was not associated with age or sex, except for sensory impairment where a greater increase in symptom frequency was observed for younger persons. LMEM showed that, for the sub-group, long-term past Hg exposure was associated with most cluster scores at both times, and importantly, for all clusters, with their rate of increase over time (Time 2 - Time 1).

CONCLUSIONS

The persistence of reported symptoms and their increase in frequency over the short 5-year period underline the need for adequate health care services. Results of the sub-group of persons > 40y, whose HHg reflects exposure over the 28-year sampling period, suggest that there may be a progressive impact of Hg on nervous system dysfunction.

Reflections on augmented reality codes for teaching fundamental defensive techniques to boxing beginners

AR technology allows users to interact with virtual objects in real-world settings. Immersive AR experiences can enhance creativity and possibilities. Learners can explore real-life situations in a safe, controlled environment, understand abstract concepts and solve problems. This study investigates whether AR-codes affect boxing beginners' performance in some fundamental defensive techniques. An experimental and control group were created to implement a quasi-experimental design. By using the ASSURE instructional design model, AR technology was incorporated into the educational program and delivered in flipped classroom method to the experimental group. Comparatively, the control group is taught a program using a teacher's command style. A post-measurement of defensive boxing skills was conducted for both groups. Participants were 60 boxing beginners aged 12 to 14 who had enrolled in Port Fouad Sports Club's 2023/2024 training season in Port Said, Egypt. Randomly, participants were divided into control and experimental groups. They were homogenized and equivalent in terms of age, height, weight, IQ, physical fitness, and skill level. According to the study results, the experimental group performed better in post-measurements than the control group. The AR Codes technology had a large effect size on the learning of boxing defensive skills under study. Consequently, it is necessary to use AR Codes technology as an educational resource to enhance the learning process, integrate it with active learning strategies, and use it to teach defensive boxing skills and apply them to offensive and counterattack skills, thereby improving the learning process.

Cultural adaptations of third-wave psychotherapies in Gulf Cooperation Council countries: A systematic review

The effectiveness of third-wave psychotherapies has been demonstrated in a range of mental and physical health conditions in Western cultures. However, little is known about the cultural appropriateness and effectiveness of third-wave psychotherapies for Gulf Cooperation Council (GCC) populations. This review aimed to critically evaluate cultural adaptations to third-wave psychotherapies and explored the effectiveness of these interventions on physical and mental health outcomes in GCC populations. Five bibliographic databases and grey literature were searched; both English and Arabic studies conducted in the GCC were included. Mental and physical health-related outcomes were included. Eleven studies were identified. The overall degree of cultural adaptation ranged from 2 to 5, based on Bernal et al.'s cultural adaptation framework. Language and assessment tools were most frequently adapted. Several studies incorporated goal, method, and context adaptations, whereas metaphor and content were least frequently adapted. None of the studies incorporated person or concept adaptations. Culturally adapted third-wave psychotherapies were associated with improvement in numerous mental health outcomes, including psychological distress, well-being, and psychological traits. No physical health outcomes were identified. Although findings are promising with respect to the effectiveness of third-wave psychotherapies for GCC populations, they should be interpreted with caution due to the small number of studies conducted, cultural adaptation evaluations relying on explicit reporting in studies, and the weak methodological quality of studies. Future rigorous research is needed in the evaluation of culturally adapted third-wave psychotherapies in GCC populations, with more comprehensive reporting of cultural considerations.

Quantification of behavioral data with effect sizes and statistical significance tests

This article describes the use of statistical significance tests and distance-based effect sizes with behavioral data from single case experimental designs (SCEDs). Such data often are interpreted only with visual analysis. However, a growing movement in the field is to quantify results to improve decision-making and communication across studies and sciences. The goal of the present study was to assess the agreement between visual analysis and various statistical tests. We recruited visual analysts to judge 160 pairwise data sets from published articles and compared these analyses to significance tests and effect sizes. One-tailed significance testing of Tau z and the percentage of pairwise differences in the predicted direction (PWD) generally agreed with each other, and complemented the effect sizes of Ratio of Distances (RD) and g. Visual analysis was somewhat unreliable and should be combined with statistical complements to maximize decision accuracy.

Past mercury exposure and current symptoms of nervous system dysfunction in adults of a First Nation community (Canada)

BACKGROUND

The watershed in Asubpeeschoseewagong Netum Anishinabek (Grassy Narrows First Nation) territory has been contaminated by mercury (Hg) since 1962, resulting in very high Hg concentrations in fish, central to the community's culture, traditions, economy and diet. Biomarkers of Hg exposure (umbilical cord blood and hair/blood samples), monitored between 1970 and 1997, decreased over time. A recent Grassy Narrows Community Health Assessment (GN-CHA) survey included current symptoms of nervous system dysfunction. The present study aimed to cluster self-reported symptoms and examine their associations with past Hg exposure.

METHODS

The GN-CHA included 391 adults. Symptom clustering used a two-step segmentation approach. Umbilical cord Hg and/or yearly measurements of equivalent hair Hg were available for 242 participants. Structural Equation Models (SEM) displayed the associations between Hg exposure and clusters, with Hg exposure modelled as a latent variable or in separate variables (prenatal, childhood and having had hair Hg ≥ 5 μg/g at least once over the sampling period). Longitudinal Mixed Effects Models (LMEM) served to examine past hair Hg with respect to clusters.

RESULTS

A total of 37 symptoms bonded into 6 clusters, representing Extrapyramidal impairment, Sensory impairment, Cranial nerve disturbances, Gross motor impairment, Neuro-cognitive deficits and Affect/Mood disorders. Median Hg concentrations were 5 μg/L (1-78.5) and 1.1 μg/g (0.2-16) for umbilical cord and childhood hair, respectively. More than one-third (36.6%) had hair Hg ≥ 5 μg/g at least once. In SEM, latent Hg was directly associated with Extrapyramidal and Sensory impairment, Cranial nerve disturbances and Affect/Mood disorders. Direct associations were observed for prenatal exposure with Affect/Mood disorders, for childhood exposure with Extrapyramidal impairment and Cranial nerve disturbances, and for hair Hg ≥ 5 μg/g with Extrapyramidal and Sensory impairment. For all clusters, a further association between past Hg exposure and symptom clusters was mediated by diagnosed nervous system disorders. LMEM showed higher past hair Hg among those with higher scores for all clusters, except Affect/Mood disorders.

CONCLUSION

Our findings provide evidence that in this First Nation community, past Hg exposure from fish consumption was associated with later-life clusters of coexisting symptoms of nervous system dysfunction.

Cochran's Q Test of Stimulus Overselectivity within the Verbal Repertoire of Children with Autism

Stimulus overselectivity remains an ill-defined concept within behavior analysis, because it can be difficult to distinguish truly restrictive stimulus control from random variation. Quantitative models of bias are useful, though perhaps limited in application. Over the last 50 years, research on stimulus overselectivity has developed a pattern of assessment and intervention repeatedly marred by methodological flaws. Here we argue that a molecular view of overselectivity, under which restricted stimulus control has heretofore been examined, is fundamentally insufficient for analyzing this phenomenon. Instead, we propose the use of the term "overselectivity" to define temporally extended patterns of restrictive stimulus control that have resulted in disproportionate populations of responding that cannot be attributed to chance alone, and highlight examples of overselectivity within the verbal behavior of children with autism spectrum disorder. Viewed as such, stimulus overselectivity lends itself to direct observation and measurement through the statistical analysis of single-subject data. In particular, we demonstrate the use of the Cochran Q test as a means of precisely quantifying stimulus overselectivity. We provide a tutorial on calculation, a model for interpretation, and a discussion of the implications for the use of Cochran's Q by clinicians and researchers.

Meta-analyses and effect sizes in applied behavior analysis: A review and discussion

For more than four decades, researchers have used meta-analyses to synthesize data from multiple experimental studies often to draw conclusions that are not supported by individual studies. More recently, single-case experimental design (SCED) researchers have adopted meta-analysis techniques to answer research questions with data gleaned from SCED experiments. Meta-analyses enable researchers to answer questions regarding intervention efficacy, generality, and condition boundaries. Here we discuss meta-analysis techniques, the rationale for their adaptation with SCED studies, and current indices used to quantify the effect of SCED data in applied behavior analysis.

Facial EMG Activity Is Associated with Hedonic Experiences but not Nutritional Values While Viewing Food Images

The physiological correlates of hedonic/emotional experiences to visual food stimuli are of theoretical and practical interest. Previous psychophysiological studies have shown that facial electromyography (EMG) signals were related to subjective hedonic ratings in response to food images. However, because other data showed positive correlations between hedonic ratings and objective nutritional values of food, whether the facial EMG reactions to food images could reflect the hedonic evaluation or nutritional assessment of food remains unknown. To address this issue, we measured subjective hedonic ratings (liking, wanting, valence, and arousal) and physiological signals (facial EMG of the corrugator supercilii, zygomatic major, masseter, and suprahyoid muscles, skin potential responses, and heart rates) while participants observed food images that had objective nutritional information (caloric, carbohydrate, fat, and protein contents). The results revealed that zygomatic major EMG activity was positively correlated with ratings of liking, wanting, and valence, but not with any objective nutritional value. These data indicate that facial EMG signals in response to food images reflect subjective hedonic experiences, but not objective nutritional values, associated with the food item.

Furthering Open Science in Behavior Analysis: An Introduction and Tutorial for Using GitHub in Research

Open and transparent practices in scholarly research are increasingly encouraged by academic journals and funding agencies. Various elements of behavior analytic research are communicated transparently, though it is not common practice to archive study materials to support future replications. This tutorial presents a review of the Transparent and Open Practices guidelines provided by the Open Science Foundation and provides instructions on how behavior analysts can use GitHub transparency in research across multiple levels. GitHub is presented as a service that can be used to publicly archive various elements of research and is uniquely suited to research that is technical, data driven, and collaborative. The GitHub platform is reviewed, and the steps necessary to create an account, initialize repositories, archive study files, and synchronize changes to remote repositories are described in several examples. Implications of increased calls for transparency and modern statistical methods are discussed with regard to behavior analysis, and archiving platforms such as GitHub are reviewed as one means of supporting transparent research.

Improving Psychological Science through Transparency and Openness: An Overview

The ability to independently verify and replicate observations made by other researchers is a hallmark of science. In this article, we provide an overview of recent discussions concerning replicability and best practices in mainstream psychology with an emphasis on the practical benefists to both researchers and the field as a whole. We first review challenges individual researchers face in producing research that is both publishable and reliable. We then suggest methods for producing more accurate research claims, such as transparently disclosing how results were obtained and analyzed, preregistering analysis plans, and publicly posting original data and materials. We also discuss ongoing changes at the institutional level to incentivize stronger research. These include officially recognizing open science practices at the journal level, disconnecting the publication decision from the results of a study, training students to conduct replications, and publishing replications. We conclude that these open science practices afford exciting low-cost opportunities to improve the quality of psychological science.

An Overview of Scientific Reproducibility: Consideration of Relevant Issues for Behavior Science/Analysis

For over a decade, the failure to reproduce findings in several disciplines, including the biomedical, behavioral, and social sciences, have led some authors to claim that there is a so-called "replication (or reproducibility) crisis" in those disciplines. The current article examines: (a) various aspects of the reproducibility of scientific studies, including definitions of reproducibility; (b) published concerns about reproducibility in the scientific literature and public press; (c) variables involved in assessing the success of attempts to reproduce a study; (d) suggested factors responsible for reproducibility failures; (e) types of validity of experimental studies and threats to validity as they relate to reproducibility; and (f) evidence for threats to reproducibility in the behavior science/analysis literature. Suggestions for improving the reproducibility of studies in behavior science and analysis are described throughout.

Predict, Control, and Replicate to Understand: How Statistics Can Foster the Fundamental Goals of Science

Scientists abstract hypotheses from observations of the world, which they then deploy to test their reliability. The best way to test reliability is to predict an effect before it occurs. If we can manipulate the independent variables (the efficient causes) that make it occur, then ability to predict makes it possible to control. Such control helps to isolate the relevant variables. Control also refers to a comparison condition, conducted to see what would have happened if we had not deployed the key ingredient of the hypothesis: scientific knowledge only accrues when we compare what happens in one condition against what happens in another. When the results of such comparisons are not definitive, metrics of the degree of efficacy of the manipulation are required. Many of those derive from statistical inference, and many of those poorly serve the purpose of the cumulation of knowledge. Without ability to replicate an effect, the utility of the principle used to predict or control is dubious. Traditional models of statistical inference are weak guides to replicability and utility of results. Several alternatives to null hypothesis testing are sketched: Bayesian, model comparison, and predictive inference (p rep). Predictive inference shows, for example, that the failure to replicate most results in the Open Science Project was predictable. Replicability is but one aspect of scientific understanding: it establishes the reliability of our data and the predictive ability of our formal models. It is a necessary aspect of scientific progress, even if not by itself sufficient for understanding.