Investigating the modality specificity of response selection using a temporal flanker task

Competition in context: response selection within the supervisory attentional system model

We examined the effects of context bias and target exposure duration on error rates (ERR) and response times (RTs) in letter choice task within context. Surface Electromyography (sEMG) was recorded in both hands during context presentation, as a measure of readiness to respond. The goal was to affect the outcome of the task by manipulating relative schemata activation levels prior to target onset, as per the Supervisory Attentional System model. At short exposures, context bias and sEMG activity affected ERR, whereas at longer durations, RTs were affected. Context bias mediated the effect of sEMG activity. Increasing activity in both hands led to higher ERR and RTs in incongruent context. Non-increasing activity in the non-responding lead to lack of relationship between sEMG activity and behavior, irrespective of context. sEMG activity in both hands was found to be interrelated and context-sensitive. These results conform to the predictions of the Supervisory Attentional Model.

Resisting Visual, Phonological, and Semantic Interference - Same or Different Processes? A Focused Mini-Review

The unitary nature of resistance to interference (RI) processes remains a strongly debated question: are they central cognitive processes or are they specific to the stimulus domains on which they operate? This focused mini-review examines behavioral, neuropsychological and neuroimaging evidence for and against domain-general RI processes, by distinguishing visual, verbal phonological and verbal semantic domains. Behavioral studies highlighted overall low associations between RI capacity across domains. Neuropsychological studies mainly report dissociations for RI abilities between the three domains. Neuroimaging studies highlight a left vs. right hemisphere distinction for verbal vs. visual RI, with furthermore distinct neural processes supporting phonological versus semantic RI in the left inferior frontal gyrus. While overall results appear to support the hypothesis of domain-specific RI processes, we discuss a number of methodological caveats that ask for caution in the interpretation of existing studies.

Given the option, people avoid incongruent responses in a dual-tasking situation

While past work on how people can optimize dual-tasking has focused on strategic timing (i.e., when to select responses), little is known about the extent to which people can optimize dual-tasking by taking care of which responses they select. Here we test whether spatial (in)congruency influences response selection in free-choice trials. In two experiments, we combined two visual-manual tasks with spatial stimulus- and response characteristics: Participants responded to the stimulus words "left" and "right" in a forced choice task and responded "up", "down", "left" or "right" with an arrow-key to either a free choice prompt or an X located at the respective position. In Experiment 1, participants reduced the proportion of incongruent pairs of responses (i.e., left in one and right in the other task). In Experiment 2, we found that such flexibility in response selection also holds in more constrained environments: Within runs of four trials the free-choice options were continuously reduced based on the responses already given. The combined results of Experiments 1 and 2 suggest that response selection in free choice trials is driven by performance optimization beyond response conflict.

Pupillary Response to Affective Voices: Physiological Responsivity and Posttraumatic Stress Disorder

Posttraumatic stress disorder (PTSD) is related to dysfunctional emotional processing, thus motivating the search for physiological indices that can elucidate this process. Toward this aim, we compared pupillary response patterns in response to angry and fearful auditory stimuli among 99 adults, some with PTSD (n = 14), some trauma-exposed without PTSD (TE; n = 53), and some with no history of trauma exposure (CON; n = 32). We hypothesized that individuals with PTSD would show more pupillary response to angry and fearful auditory stimuli compared to those in the TE and CON groups. Among participants who had experienced a traumatic event, we explored the association between PTSD symptoms and pupillary response; contrary to our prediction, individuals with PTSD displayed the least pupillary response to fearful auditory stimuli compared those in the TE, B = -0.022, p = .077, and CON, B = -0.042, p = .002, groups, but they did not differ on angry auditory stimuli, B = 0.019, p = .118 and B = 0.006, p = .634, respectively. It is important to note that within-group analyses revealed that participants with PTSD differed significantly in their response to angry versus fearful stimuli, B = -0.032, p = .015. We also found a positive association between PTSD symptoms and pupillary response to angry stimuli. Our findings suggest that differential pupil response to anger and fear stimuli may be a promising way to understand emotional processing in PTSD.

Task representation affects the boundaries of behavioral slowing following an error

Researchers have recognized the role that task representation plays in our behavior for many years. However, the specific influence that the structure of one's task representation has on executive functioning has only recently been investigated. Prior research suggests that adjustments of cognitive control are affected by subtle manipulations of aspects of the stimulus-response pairs within and across task sets. This work has focused on examples of cognitive control such as response preparation, dual-task performance, and the congruency sequence effect. The current study investigates the effect of task representation on another example of control, post-error slowing. To determine if factors that influence how people represent a task affect how behavior is adjusted after an error, an adaptive attention-shifting task was developed with multiple task delimiting features. Participants were randomly assigned to a separate task set (two task sets) or an integrated task set (one task set) group. For the separate set group, the task sets switched after each trial. Results showed that only the integrated set group exhibited post-error slowing. This suggests that task representation influences the boundaries of cognitive control adjustments and has implications for our understanding of how control is organized when adjusting to errors in performance.

Properties of context-driven control revealed through the analysis of sequential congruency effects

The context specific proportion congruent (CSPC) effect refers to the reduction in the size of the congruency effect at locations with a high proportion of incongruent trials compared to locations with a high proportion of congruent trials. The CSPC effect is commonly taken as evidence for context-driven modulation of cognitive control. Current models of context-driven control suggest that variations in the efficiency of control across locations are due to variations in the occurrence of conflict across locations (context). Moreover, these models predict that control settings are updated on a trial-to-trial basis. In Experiment 1, we investigated this prediction. If variations in conflict drive variations in the efficiency of control, and these location-based control settings are updated on each trial, then the occurrence of conflict at one location should lead to more efficient processing when the location repeats, but not when the location switches. Consistent with this prediction, we observed a sequential congruency effect when the location repeats, but not when the location switches. In Experiment 2, we looked for evidence of sequential congruency effects within and between locations in a manipulation in which an equal proportion of congruent and incongruent trials appear at each location. In contrast to the results of Experiment 1, we observed sequential congruency effects both when location repeated and when location switched. Thus, location appears to be a salient dimension on which to implement control settings when it is used in conjunction with variations in the proportion of congruent and incongruent trials.

Hierarchical Task Representation

Human behavior is remarkably complex—even during the performance of relatively simple tasks—yet it is often assumed that learned associations between stimuli and responses provide the representational substrate for action selection. Here, we introduce an alternative framework, called a task file, that includes hierarchical associations between stimulus features, response features, goals, and drives, which may overcome the limitations inherent in the conceptualization of response selection as being based solely on associations between stimuli and responses. We then review evidence from our own experimental research showing that even in the context of performing relatively easy tasks, the stimulus-response-association approach to response selection is inadequate to account for the interactions between discrete responses. Instead, response selection may emerge from competition between linked representations at multiple levels.

Analyzing distributional properties of interference effects across modalities: chances and challenges

In research investigating Stroop or Simon effects, data are typically analyzed at the level of mean response time (RT), with results showing faster responses for compatible than for incompatible trials. However, this analysis provides only limited information as it glosses over the shape of the RT distributions and how they may differ across tasks and experimental conditions. These limitations have encouraged the analysis of RT distributions using delta plots. In the present review, we aim to bring together research on distributional properties of auditory and visual interference effects. Extending previous reviews on distributional properties of the Simon effect, we additionally review studies reporting distributional analyses of Stroop effects. We show that distributional analyses of sequential effects (i.e., taking into account congruency of the previous trial) capture important similarities and differences of interference effects across tasks (Simon, Stroop) as well as across sensory modalities, despite some challenges associated to this approach.

Amodal processing in human prefrontal cortex

Information enters the cortex via modality-specific sensory regions, whereas actions are produced by modality-specific motor regions. Intervening central stages of information processing map sensation to behavior. Humans perform this central processing in a flexible, abstract manner such that sensory information in any modality can lead to response via any motor system. Cognitive theories account for such flexible behavior by positing amodal central information processing (e.g., "central executive," Baddeley and Hitch, 1974; "supervisory attentional system," Norman and Shallice, 1986; "response selection bottleneck," Pashler, 1994). However, the extent to which brain regions embodying central mechanisms of information processing are amodal remains unclear. Here we apply multivariate pattern analysis to functional magnetic resonance imaging (fMRI) data to compare response selection, a cognitive process widely believed to recruit an amodal central resource across sensory and motor modalities. We show that most frontal and parietal cortical areas known to activate across a wide variety of tasks code modality, casting doubt on the notion that these regions embody a central processor devoid of modality representation. Importantly, regions of anterior insula and dorsolateral prefrontal cortex consistently failed to code modality across four experiments. However, these areas code at least one other task dimension, process (instantiated as response selection vs response execution), ensuring that failure to find coding of modality is not driven by insensitivity of multivariate pattern analysis in these regions. We conclude that abstract encoding of information modality is primarily a property of subregions of the prefrontal cortex.

Vision dominates at the preresponse level and audition dominates at the response level in cross-modal interaction: behavioral and neural evidence

There are ongoing debates on the direction of sensory dominance in cross-modal interaction. In the present study, we demonstrate that the specific direction of sensory dominance depends on the level of processing: vision dominates at earlier stages, whereas audition dominates at later stages of cognitive processing. Moreover, these dominances are subserved by different neural networks. In three experiments, human participants were asked to attend to either visual or auditory modality while ignoring simultaneous stimulus inputs from the other modality. By manipulating three levels of congruency between the simultaneous visual and auditory inputs, congruent (C), incongruent at preresponse level (PRIC), and incongruent at response level (RIC), we differentiated the cross-modal conflict explicitly into preresponse (PRIC > C) and response (RIC > PRIC) levels. Behavioral data in the three experiments consistently suggested that visual distractors caused more interference to auditory processing than vice versa (i.e., the typical visual dominance) at the preresponse level, but auditory distractors caused more interference to visual processing than vice versa (i.e., the typical auditory dominance) at the response level regardless of experimental tasks, types of stimuli, or differential processing speeds in different modalities. Dissociable neural networks were revealed, with the default mode network being involved in the visual dominance at the preresponse level and the prefrontal executive areas being involved in the auditory dominance at the response level. The default mode network may be attracted selectively by irrelevant visual, rather than auditory, information via enhanced neural coupling with the ventral visual stream, resulting in visual dominance at the preresponse level.

The role of input-output modality compatibility in task switching

Input-output (I-O) modality compatibility refers to the similarity of stimulus modality and modality of response-related sensory consequences. A previous study found higher switch costs in task switching in I-O modality incompatible tasks (auditory-manual and visual-vocal) than in I-O modality compatible tasks (auditory-vocal and visual-manual). However, these tasks had spatially compatible S-R mappings, which implied dimensional overlap (DO). DO may have led to automatic activation of the corresponding compatible responses in the incorrect response modality, thus increasing interference effects. The present study was aimed to examine the influence of DO on I-O modality compatibility effects. In two experiments, we found that I-O modality compatibility affects task switching even in tasks without DO, which even tended to result in further increased modality influences. This finding suggests that I-O modality mappings affect response selection by affecting between-task cross-talk not on the level of specific response codes but on the level of modality-specific processing pathways.

Interference effects of stimulus-response modality pairings in dual tasks and their robustness

Recent evidence suggests that the degree of interference in dual-task situations depends crucially on the pairings of input- and output modalities of the two component tasks with increased dual-task costs for modality incompatible (i.e., visual-vocal and auditory-manual) compared to modality compatible (i.e., visual-manual and auditory-vocal) dual tasks. These effects of modality pairings in dual tasks have been related to the overlap of non-preferred processing pathways in modality incompatible tasks. Until now, modality compatibility has not yet been related to other sources of interference in a dual-task context, such as stimulus-response (S-R) compatibility or crosstalk. In the present study, we conducted two experiments using the paradigm of the psychological refractory period (PRP) to test the effects of S-R compatibility and crosstalk on the effects of modality compatibility in temporally overlapping task situations. Experiment 1 revealed an overadditive interaction between stimulus onset asynchrony and modality compatibility for tasks with S-R compatible mappings, indicating that modality compatibility effects are present in different task situations, even when S-R mappings are otherwise compatible. In Experiment 2, we aimed at pinpointing the boundaries of the effects of modality compatibility in dual-task situations. We showed that additional sources of dual-task interference in a modality compatible dual task could overwrite the pronounced PRP effect previously shown for modality incompatible tasks. Taken together, these data provide new evidence that the specific types of stimulus-response modality pairings are an additional factor that might interact with other sources of interference in dual-task situations.