A "Goldilocks zone" for mind-wandering reports? A secondary data analysis of how few thought probes are enough for reliable and valid measurement

Measuring mind wandering with experience sampling during task performance: An item response theory investigation

The tendency for individuals to mind wander is often measured using experience sampling methods in which probe questions embedded within computerized cognitive tasks attempt to catch episodes of off-task thought at random intervals during task performance. However, mind-wandering probe questions and response options are often chosen ad hoc and vary between studies with extant little guidance as to the psychometric consequences of these methodological decisions. In the present study, we examined the psychometric properties of several common approaches for assessing mind wandering using methods from item response theory (IRT). IRT latent modeling demonstrated that measurement information was generally distributed across the range of trait estimates according to when probes were presented in time. Probes presented earlier in time provided more information about individuals with greater tendency to mind wandering than probes presented later. Furthermore, mind-wandering ratings made on a continuous scale or using multiple categorical rating options provided more information about individuals' latent mind-wandering tendency - across a broader range of the trait continuum - than ratings dichotomized into on-task and off-task categories. In addition, IRT provided evidence that reports of "task-related thoughts" contribute to the task-focused dimension of the construct continuum, providing justification for studies conceptualizing these responses as a kind of task-related focus. Together, we hope these findings will help guide researchers hoping to maximize the measurement precision of their mind wandering assessment procedures.

Attention in hindsight: Using stimulated recall to capture dynamic fluctuations in attentional engagement

Attentional engagement is known to vary on a moment-to-moment basis. However, few self-report methods can effectively capture dynamic fluctuations in attentional engagement over time. In the current paper, we evaluated the utility of stimulated recall, a method wherein individuals are asked to remember their subjective states while using a mnemonic cue, for the measurement of temporal changes in attentional engagement. Participants were asked to watch a video lecture, during which we assessed their in-the-moment levels of attentional engagement using intermittent thought probes. Then, we used stimulated recall by cueing participants with short video clips from the lecture to retrospectively assess the levels of attentional engagement they had experienced when they first watched those clips within the lecture. Experiment 1 assessed the statistical overlap between in-the-moment and video-stimulated ratings. Experiment 2 assessed the generalizability of video-stimulated recall across different types of lectures. Experiment 3 assessed the impact of presenting video-stimulated probe clips in non-chronological order. Experiment 4 assessed the effect of video-stimulated recall on its own. Across all experiments, we found statistically robust correspondence between in-the-moment and video-stimulated ratings of attentional engagement, illustrating a strong convergence between these two methods of assessment. Taken together, our findings indicate that stimulated recall provides a new and practical methodological approach that can accurately capture dynamic fluctuations in subjective attentional states over time.

Further unpacking individual differences in mind wandering: The role of emotional valence and awareness

Previous work has established a link between executive attention ability and mind wandering propensity, these studies typically collapse thought reports into a single category of task-unrelated thoughts (TUTs). We have shown that these TUTs can be differentiated by the emotional valence of their content. Awareness of TUTs might also be an important to consider, yet little work has been done on this front. The current study conceptually replicated and extended previous work by investigating the relationship between individual differences in executive attention, emotional valence and awareness of TUTs. Latent variable models indicated that Executive Attention was differentially correlated with emotional valence TUTs. However, only Attention Control was related to frequency of mind wandering with awareness. Intra-individual analyses indicated that negatively valenced TUTs and TUTs that occurred without awareness were associated with worse performance. Considering different dimensions of TUTs can provide a more complete picture of individual differences in mind wandering.

How Do You Know If You Were Mind Wandering? Dissociating Explicit Memories of Off Task Thought From Subjective Feelings of Inattention

Mind wandering is a common experience in which your attention drifts away from the task at hand and toward task-unrelated thoughts. To measure mind wandering we typically use experience sampling and retrospective self-reports, which require participants to make metacognitive judgments about their immediately preceding attentional states. In the current study, we aimed to better understand how people come to make such judgments by introducing a novel distinction between explicit memories of off task thought and subjective feelings of inattention. Across two preregistered experiments, we found that participants often indicated they were "off task" and yet had no memory of the content of their thoughts-though, they were less common than remembered experiences. Critically, remembered experiences of mind wandering and subjective feelings of inattention differed in their behavioral correlates. In Experiment 1, we found that only the frequency of remembered mind wandering varied with task demands. In contrast, only subjective feelings of inattention were associated with poor performance (Experiments 1 and 2) and individual differences in executive functioning (Experiment 2). These results suggest that the phenomenology of mind wandering may differ depending on how the experiences are brought about (e.g., executive functioning errors versus excess attentional resources), and provide preliminary evidence of the importance of measuring subjective feelings of inattention when assessing mind wandering.

Listen up, kids! How mind wandering affects immediate and delayed memory in children

Mind wandering occurs when attention becomes disengaged from the here-and-now and directed toward internally generated thoughts; this is often associated with poorer performance on educationally significant tasks. In this study, 8- to 9-year-old children (N = 60) listened to audio stories embedded with intermittent thought probes that were used to determine if participants' thoughts were on or off task. The key objective was to explore the impact of probe-caught mind wandering on both immediate and delayed memory retention. Children reported being off task approximately 24% of the time. Most inattention episodes were classified as task-unrelated thoughts (i.e., 'pure' instances of mind wandering, 9%) or attentional failures due to distractions (9%). Higher frequency of mind wandering was strongly associated with poorer memory recall, and task-unrelated thoughts strongly predicted how well children could recall components of the audio story both immediately after the task and after a 1-week delay. This study is the first to demonstrate the impact of mind wandering on delayed memory retention in children. Results suggest that exploring mind wandering in the foundational years of schooling could provide the necessary empirical foundation for the development of practical interventions geared toward detecting and refocusing lapses of attention in educational contexts.

A Nomothetic Span Approach to the Construct Validation of Sustained Attention Consistency: Re-Analyzing Two Latent-Variable Studies of Performance Variability and Mind-Wandering Self-Reports

The ability to sustain attention consistency is frequently assessed using either objective behavioral measures, such as reaction time (RT) variability, or subjective self-report measures, such as rates of task-unrelated thought (TUT). The current studies examined whether the individual-difference covariation in these measures provides a more construct valid assessment of attention consistency than does either alone. We argue that performance and self-report measures mutually validate each other; each measurement approach has its own sources of error, so their shared variance should best reflect the attention consistency construct. We reanalyzed two latent-variable studies where RT variability and TUTs were measured in multiple tasks (Kane et al. in J Exp Psychol Gen 145:1017-1048, 2016; Unsworth et al. in J Exp Psychol Gen 150:1303-1331, 2021), along with several nomological network constructs to test the convergent and discriminant validity of a general attention consistency factor. Confirmatory factor analyses assessing bifactor (preregistered) and hierarchical (non-preregistered) models suggested that attention consistency can be modeled as the shared variance among objective and subjective measures. This attention consistency factor was related to working memory capacity, attention (interference) control, processing speed, state motivation and alertness, and self-reported cognitive failures and positive schizotypy. Although bifactor models of general attention consistency provide the most compelling construct validity evidence for a specific ability to sustain attention, multiverse analyses of outlier decisions suggested they are less robust than hierarchical models. The results provide evidence for the general ability to sustain attention consistency and suggestions for improving its measurement.

The Effects of Mind-Wandering, Cognitive Load, and Task Engagement on Working Memory Performance in Remote Online Experiments

Recent changes in environments from in-person to remote present several issues for work, education, and research, particularly related to cognitive performance. Increased distraction in remote environments may lead to increases in mind-wandering and disengagement with tasks at hand, whether virtual meetings, online lectures, or psychological experiments. The present study investigated mind-wandering and multitasking effects during working memory tasks in remote and in-person environments. In two experiments, participants completed a working memory task with varied cognitive load during a secondary task. After each working memory trial, participants reported their mind-wandering during that trial. Some participants completed the procedures in-person, while others completed the procedures remotely. Overall, remote participants reported significantly more mind-wandering and poorer secondary task performance than in-person participants, but this pattern was not reflected in working memory accuracy. Both groups exhibited similar multitasking effects on performance. Additional analyses found that for remote participants, task engagement better predicted working memory performance than either cognitive load or mind-wandering rates but did not indicate a tradeoff in resources between tasks. Together, these results demonstrate the importance of considering multiple metrics when assessing performance and illustrate that making assumptions about the equivalence of remote and in-person work is a risky proposition.

Insights into the time course of mind wandering during task execution

Our minds tend to wander, sometimes with little control. Despite this phenomenon, that can affect our ability to perform everyday tasks gaining much interest, relatively little is understood about the actual time course of MW across an experimental task. With this in mind, we collated data from two previously reported studies investigating the effect of auditory beat stimulation on MW. Taking experience sampling probes intermittently dispersed throughout a sustained-attention-to-response task (SART), we re-evaluated responses to theta monaural beat stimulation, as well as to two control conditions (silence (headphones only) and a sine wave control tone). The experience sampling probes were binned into shorter intervals of approximately five minutes duration, chronologically as they appeared within the paradigm. Experience sampling probes assayed whether MW had occurred, with or without meta-awareness, and lastly in which temporal orientation (past/present/future). By applying this somewhat temporally better resolved approach, we were able to examine the time course of attentional fluctuations related to MW during the execution of the SART, as well as interactions arising from the auditory beat stimulation. As anticipated, MW increased during task execution, most prominently at the beginning of the experiment. We also observed that levels of meta-awareness declined over time. Moreover, the temporal evolution of meta-awareness and past-orientation appeared to depend on the stimulation condition. These data demonstrate that time-on-task is a crucial factor in measuring MW, during the performance of an attentional task.