Eye movements and problem solving: guiding attention guides thought

A study on the effect of different channel cues on learning in immersive 360° videos

Immersive 360° videos are of interest to educators because of their ability to provide immersive sensory experience and other features. This study examined the effects of four cue conditions on 360° video learning performance, attention, cognitive load, and mood using eye-tracking devices, brainwave meters, and subjective questionnaires. The randomly assigned participants (n = 62) did go to the experimental group (visual cues only, auditory cues only, and audiovisual cues) or the control group (no cues). The results showed that visual and audiovisual cues effectively guide learners' attention to the related learning content, reduce cognitive load during learning, and improve retention performance but have no significant effect on knowledge transfer or long-term memory. Auditory cues increase the number of times learners look at the related learning content but do not affect gaze duration and distract their attention, hindering the acquisition of relevant learning content. The study also found that visual cues effectively increase the number of times learners looked at the content. However, they do not affect gaze duration. The study also revealed that visual cues effectively increase learners' relaxation when viewing 360° videos. The study's findings can provide a reference for the instructional processing of information related to 360° video design and its practical application in teaching.

Language systematizes attention: How relational language enhances relational representation by guiding attention

Language can affect cognition, but through what mechanism? Substantial past research has focused on how labeling can elicit categorical representation during online processing. We focus here on a particularly powerful type of language-relational language-and show that relational language can enhance relational representation in children through an embodied attention mechanism. Four-year-old children were given a color-location conjunction task, in which they were asked to encode a two-color square, split either vertically or horizontally (e.g., red on the left, blue on the right), and later recall the same configuration from its mirror reflection. During the encoding phase, children in the experimental condition heard relational language (e.g., "Red is on the left of blue"), while those in the control condition heard generic non-relational language (e.g., "Look at this one, look at it closely"). At recall, children in the experimental condition were more successful at choosing the correct relational representation between the two colors compared to the control group. Moreover, they exhibited different attention patterns as predicted by the attention shift account of relational representation (Franconeri et al., 2012). To test the sustained effect of language and the role of attention, during the second half of the study, the experimental condition was given generic non-relational language. There was a sustained advantage in the experimental condition for both behavioral accuracies and signature attention patterns. Overall, our findings suggest that relational language enhances relational representation by guiding learners' attention, and this facilitative effect persists over time even in the absence of language. Implications for the mechanism of how relational language can enhance the learning of relational systems (e.g., mathematics, spatial cognition) by guiding attention will be discussed.

Brain computed tomography reading of stroke patients by resident doctors from different medical specialities: An eye-tracking study

BACKGROUND

Using the eye-tracking technique, our work aimed to examine whether difference in clinical background may affect the training outcome of resident doctors' interpretation skills and reading behaviour related to brain computed tomography (CT).

METHODS

Twelve resident doctors in the neurology, radiology, and emergency departments were recruited. Each participant had to read CT images of the brain for two cases. We evaluated each participant's accuracy of lesion identification. We also used the eye-tracking technique to assess reading behaviour. We recorded dwell times, fixation counts, run counts, and first-run dwell times of target lesions to evaluate visual attention. Transition entropy was applied to assess the temporal relations and spatial dynamics of systematic image reading.

RESULTS

The eye-tracking results showed that the image reading sequence examined by transition entropy was comparable among resident doctors from different medical specialties (p = 0.82). However, the dwell time of the target lesions was shorter for the resident doctors from the neurology department (4828.63 ms, p = 0.01) than for those from the resident doctors from the radiology (6275.88 ms) and emergency (5305.00 ms) departments. The eye-tracking results in individual areas of interest only showed differences in the eye-tracking performance of the first-run dwell time (p = 0.05) in the anterior cerebral falx.

DISCUSSION

Our findings demonstrate that resident doctors from different medical specialties may achieve similar imaging reading patterns for brain CT. This may mitigate queries regarding the influence of different backgrounds on training outcomes.

Making a Bird AI Expert Work for You and Me

As powerful as fine-grained visual classification (FGVC) is, responding your query with a bird name of "Whip-poor-will" or "Mallard" probably does not make much sense. This however commonly accepted in the literature, underlines a fundamental question interfacing AI and human - what constitutes transferable knowledge for human to learn from AI? This paper sets out to answer this very question using FGVC as a test bed. Specifically, we envisage a scenario where a trained FGVC model (the AI expert) functions as a knowledge provider in enabling average people (you and me) to become better domain experts ourselves. Assuming an AI expert trained using expert human labels, we anchor our focus on asking and providing solutions for two questions: (i) what is the best transferable knowledge we can extract from AI, and (ii) what is the most practical means to measure the gains in expertise given that knowledge? We propose to represent knowledge as highly discriminative visual regions that are expert-exclusive and instantiate it via a novel multi-stage learning framework. A human study of 15,000 trials shows our method is able to consistently improve people of divergent bird expertise to recognise once unrecognisable birds. We further propose a crude but benchmarkable metric TEMI and therefore allow future efforts in this direction to be comparable to ours without the need of large-scale human studies.

Promoting spontaneous analogical transfer by idealizing target representations

Recent results demonstrate that inducing an abstract representation of target analogs at retrieval time aids access to analogous situations with mismatching surface features (i.e., the late abstraction principle). A limitation of current implementations of this principle is that they either require the external provision of target-specific information or demand very high intellectual effort. Experiment 1 demonstrated that constructing an idealized situation model of a target problem increases the rate of correct solutions compared with constructing either concrete simulations or no simulations. Experiment 2 confirmed that these results were based on an advantage for accessing the base analog, and not merely an advantage of idealized simulations for understanding the target problem in its own terms. This target idealization strategy has broader applicability than prior interventions based on the late abstraction principle because it can be achieved by a greater proportion of participants and without the need to receive target-specific information. We present a computational model, SampComp, that predicts successful retrieval of a stored situation to understand a target based on the overlap of a random, but potentially biased, sample of features from each. SampComp is able to account for the relative benefits of base and target idealization, and their interaction.

Insight and the selection of ideas

Perhaps it is no accident that insight moments accompany some of humanity's most important discoveries in science, medicine, and art. Here we propose that feelings of insight play a central role in (heuristically) selecting an idea from the stream of consciousness by capturing attention and eliciting a sense of intuitive confidence permitting fast action under uncertainty. The mechanisms underlying this Eureka heuristic are explained within an active inference framework. First, implicit restructuring via Bayesian reduction leads to a higher-order prediction error (i.e., the content of insight). Second, dopaminergic precision-weighting of the prediction error accounts for the intuitive confidence, pleasure, and attentional capture (i.e., the feeling of insight). This insight as precision account is consistent with the phenomenology, accuracy, and neural unfolding of insight, as well as its effects on belief and decision-making. We conclude by reflecting on dangers of the Eureka Heuristic, including the arising and entrenchment of false beliefs and the vulnerability of insights under psychoactive substances and misinformation.

Individuals with High Metacognitive Ability Are Better at Divergent and Convergent Thinking

Is metacognitive ability a predictor of creative performance? Previous studies have produced conflicting findings. To clarify whether this relationship exists, the current study used eye tracking techniques and vocal thinking reports to explore creativity differences in individuals with different levels of metacognitive ability. One hundred and twelve participants completed the Metacognitive Ability scale, and were divided into two groups (with thirty participants in each group) based on their metacognition scores (the highest and lowest 27% of metacognitive ability scores). Then, participants in both groups completed two creative thinking tasks (AUT and CCRAT) while their eye behaviors were recorded by eye tracking. The results showed that participants with high metacognitive ability were better at divergent thinking, as evidenced by greater fixation and saccade counts, as well as smaller saccade amplitudes in the AUT task. In addition, Bayesian analyses provide anecdotal evidence that participants with high metacognitive ability tended to be better at convergent thinking. Furthermore, eye tracking results demonstrated that they exhibited longer fixation duration and more fixation count on the materials in the CCRAT task. These findings reflect an important role of metacognition in creative thinking, especially in divergent thinking.

The Development of Flexible Problem Solving: An Integrative Approach

Flexible problem solving, the ability to deal with currently goal-irrelevant information that may have been goal-relevant in previous, similar situations, plays a prominent role in cognitive development and has been repeatedly investigated in developmental research. However, this research, spanning from infancy to the school years, lacks a unifying framework, obscuring the developmental timing of flexible problem solving. Therefore, in this review paper, previous findings are gathered, organized, and integrated under a common framework to unveil how and when flexible problem solving develops. It is showed that the development of flexible problem solving coincides with increases in executive functions, that is, inhibition, working memory and task switching. The analysis of previous findings shows that dealing with goal-irrelevant, non-salient information received far more attention than generalizing in the presence of goal-irrelevant, salient information. The developmental timing of the latter can only be inferred from few transfer studies, as well as executive functions, planning and theory of mind research, to highlight gaps in knowledge and sketch out future research directions. Understanding how transfer in the presence of seemingly relevant but truly irrelevant information develops has implications for well-balanced participation in information societies, early and lifespan education, and investigating the evolutionary trajectory of flexible problem solving.

Cognitive Science Progresses Toward Interactive Frameworks

Despite its many twists and turns, the arc of cognitive science generally bends toward progress, thanks to its interdisciplinary nature. By glancing at the last few decades of experimental and computational advances, it can be argued that-far from failing to converge on a shared set of conceptual assumptions-the field is indeed making steady consensual progress toward what can broadly be referred to as interactive frameworks. This inclination is apparent in the subfields of psycholinguistics, visual perception, embodied cognition, extended cognition, neural networks, dynamical systems theory, and more. This pictorial essay briefly documents this steady progress both from a bird's eye view and from the trenches. The conclusion is one of optimism that cognitive science is getting there, albeit slowly and arduously, like any good science should.

Restructuring insight: An integrative review of insight in problem-solving, meditation, psychotherapy, delusions and psychedelics

Occasionally, a solution or idea arrives as a sudden understanding - an insight. Insight has been considered an "extra" ingredient of creative thinking and problem-solving. Here we propose that insight is central in seemingly distinct areas of research. Drawing on literature from a variety of fields, we show that besides being commonly studied in problem-solving literature, insight is also a core component in psychotherapy and meditation, a key process underlying the emergence of delusions in schizophrenia, and a factor in the therapeutic effects of psychedelics. In each case, we discuss the event of insight and its prerequisites and consequences. We review evidence for the commonalities and differences between the fields and discuss their relevance for capturing the essence of the insight phenomenon. The goal of this integrative review is to bridge the gap between the different views and inspire interdisciplinary research efforts for understanding this central process of human cognition.

Search and insight processes in card sorting games

Insight problems are particularly interesting, because problems which require restructuring allow researchers to investigate the underpinnings of the Aha-experience, creativity and out of the box thinking. There is a need for new insight tasks to probe and extend the limits of existing theories and cognitive frameworks. To shed more light on this fascinating issue, we addressed the question: Is it possible to convey a well-known card sorting game into an insight task? We introduced different conditions and tested them via two online experiments (N = 546). Between the conditions we systematically varied the available perceptual features, and the existence of non-obvious rules. We found that our card sorting game elicited insight experience. In the first experiment, our data revealed that solution strategies and insight experience varied by the availability and saliency of perceptual features. The discovery of a non-obvious rule, which is not hinted at by perceptual features, was most difficult. With our new paradigm, we were able to construe ambiguous problems which allowed participants to find more than one solution strategy. Interestingly, we realized interindividual preferences for different strategies. The same problem drove strategies which either relied on feature integration or on more deliberate strategies. The second experiment varied the degree of independence of a sorting rule from the standard rules which were in accordance with prior knowledge. It was shown that the more independent the hidden rule was, the more difficult the task became. In sum, we demonstrated a new insight task which extended the available task domains and shed light on sequential and multi-step rule learning problems. Finally, we provided a first sketch of a cognitive model that should help to integrate the data within the existing literature on cognitive models and speculated about the generalizability of the interplay of prior knowledge modification and variation for problem solving.

Oral presentation assessment and image reading behaviour on brain computed tomography reading in novice clinical learners: an eye-tracking study

BACKGROUND

To study whether oral presentation (OP) assessment could reflect the novice learners' interpretation skills and reading behaviour on brain computed tomography (CT) reading.

METHODS

Eighty fifth-year medical students were recruited, received a 2-hour interactive workshop on how to read brain CT, and were assigned to read two brain CT images before and after instruction. We evaluated their image reading behaviour in terms of overall OP post-test rating, the lesion identification, and competency in systematic image reading after instruction. Students' reading behaviour in searching for the target lesions were recorded by the eye-tracking technique and were used to validate the accuracy of lesion reports. Statistical analyses, including lag sequential analysis (LSA), linear mixed models, and transition entropy (TE) were conducted to reveal temporal relations and spatial complexity of systematic image reading from the eye movement perspective.

RESULTS

The overall OP ratings [pre-test vs. post-test: 0 vs. 1 in case 1, 0 vs. 1 in case 2, p < 0.001] improved after instruction. Both the scores of systematic OP ratings [0 vs.1 in both cases, p < 0.001] and eye-tracking studies (Case 1: 3.42 ± 0.62 and 3.67 ± 0.37 in TE, p = 0.001; Case 2: 3.42 ± 0.76 and 3.75 ± 0.37 in TE, p = 0.002) showed that the image reading behaviour changed before and after instruction. The results of linear mixed models suggested a significant interaction between instruction and area of interests for case 1 (p < 0.001) and case 2 (p = 0.004). Visual attention to the target lesions in the case 1 assessed by dwell time were 506.50 ± 509.06 and 374.38 ± 464.68 milliseconds before and after instruction (p = 0.02). However, the dwell times in the case 2, the fixation counts and the frequencies of accurate lesion diagnoses in both cases did not change after instruction.

CONCLUSION

Our results showed OP performance may change concurrently with the medical students' reading behaviour on brain CT after a structured instruction.

Differences in the distribution of attention to trained procedure between finders and non-finders of the alternative better procedure

The human ability to flexibly discover alternatives without fixating on a known solution supports a variety of human creative activities. Previous research has shown that people who discover an alternative procedure relax their attentional bias to information regarding the known solutions just prior to the discovery. This study examined whether the difference in the distribution of attention between the finders and non-finders of the alternative procedure is observed from the phase of solving the problem using the trained procedure. We evaluated the characteristics of the finders' distribution of attention in situations where problem solving using a trained procedure was successful. This aspect has been little examined in previous research. Our study obtained empirical evidence for the fact that, compared to non-finders, finders pay more attention to information unrelated to the trained procedure acquired through knowledge and experience, even time when using a trained procedure. We also confirmed that this difference does not exist from the beginning of the task, but emerges during repeated use of familiar procedures. These findings indicate that in order to find an alternative procedure, one should not only divert attention from a familiar procedure just before the discovery but also pay a certain amount of attention to information unrelated to the familiar procedure even when the familiar procedure is functioning well.

Attention-Setting and Human Mental Function

This article provides an introduction to experimental research on top-down human attention in complex scenes, written for cognitive scientists in general. We emphasize the major effects of goals and intention on mental function, measured with behavioral experiments. We describe top-down attention as an open category of mental actions that initiates particular task sets, which are assembled from a wide range of mental processes. We call this attention-setting. Experiments on visual search, task switching, and temporal attention are described and extended to the important human time scale of seconds.

Irrelevant insights make worldviews ring true

Our basic beliefs about reality can be impossible to prove and yet we can feel a strong intuitive conviction about them, as exemplified by insights that imbue an idea with immediate certainty. Here we presented participants with worldview beliefs such as "people's core qualities are fixed" and simultaneously elicited an aha moment. In the first experiment (N = 3000, which included a direct replication), participants rated worldview beliefs as truer when they solved anagrams and also experienced aha moments. A second experiment (N = 1564) showed that the worldview statement and the aha moment must be perceived simultaneously for this 'insight misattribution' effect to occur. These results demonstrate that artificially induced aha moments can make worldview beliefs seem truer, possibly because humans partially rely on feelings of insight to appraise an idea's veracity. Feelings of insight are therefore not epiphenomenal and should be investigated for their effects on decisions, beliefs, and delusions.

Eliciting false insights with semantic priming

The insight experience (or ‘Aha moment’) generally evokes strong feelings of certainty and confidence. An ‘Aha’ experience for a false idea could underlie many false beliefs and delusions. However, for as long as insight experiences have been studied, false insights have remained difficult to elicit experimentally. That difficulty, in turn, highlights the fact that we know little about what causes people to experience a false insight. Across two experiments (total N = 300), we developed and tested a new paradigm to elicit false insights. In Experiment 1 we used a combination of semantic priming and visual similarity to elicit feelings of insight for incorrect solutions to anagrams. These false insights were relatively common but were experienced as weaker than correct ones. In Experiment 2 we replicated the findings of Experiment 1 and found that semantic priming and visual similarity interacted to produce false insights. These studies highlight the importance of misleading semantic processing and the feasibility of the solution in the generation of false insights.

The Science of Visual Data Communication: What Works

Effectively designed data visualizations allow viewers to use their powerful visual systems to understand patterns in data across science, education, health, and public policy. But ineffectively designed visualizations can cause confusion, misunderstanding, or even distrust-especially among viewers with low graphical literacy. We review research-backed guidelines for creating effective and intuitive visualizations oriented toward communicating data to students, coworkers, and the general public. We describe how the visual system can quickly extract broad statistics from a display, whereas poorly designed displays can lead to misperceptions and illusions. Extracting global statistics is fast, but comparing between subsets of values is slow. Effective graphics avoid taxing working memory, guide attention, and respect familiar conventions. Data visualizations can play a critical role in teaching and communication, provided that designers tailor those visualizations to their audience.

Aha! under pressure: The Aha! experience is not constrained by cognitive load

The Aha! moment- the sudden insight sometimes reached when solving a vexing problem- entails a different problem-solving experience than solution retrieval reached by an analytical, multistep strategy (i.e., non-insight). To date, the (un)conscious nature of insight remains debated. We addressed this by studying insight under cognitive load. If insight and non-insight problem solving rely on conscious, effortful processes, they should both be influenced by a concurrent cognitive load. However, if unconscious processes characterize insight, cognitive load might not affect it at all. Using a dual-task paradigm, young, healthy adults (N = 106) solved 70 word puzzles under different cognitive loads. We confirmed that insight solutions were more often correct and received higher solution confidence. Importantly, as cognitive load increased, non-insight solutions became less frequent and required more solution time, whereas insightful ones remained mostly unaffected. This implies that insight problem solving did not compete for limited cognitive resources.

New Approach to Intelligence Screening for Children With Global Development Delay Using Eye-Tracking Technology: A Pilot Study

Objective: There has become a consensus for detecting intellectual disability in its early stages and implementing effective intervention. However, there are many difficulties and limitations in the evaluation of intelligence-related scales in low-age children. Eye-tracking technology may effectively solve some of the pain points in the evaluation.

Method: We used an eye-tracking technology for cognitive assessment. The subjects looked at a series of task pictures and short videos, the fixation points of which were recorded by the eye-movement analyzer, and the data were statistically analyzed. A total of 120 children aged between 1.5 and 4 years participated in the study, including 60 typically developing children and 60 children with global development delay, all of whom were assessed via the Bayley scale, Peabody Picture Vocabulary Test (PPVT), and Gesell scale.

Results: Cognitive scores from eye-tracking technology are closely related to the scores of neuropsychological tests, which shows that the technique performs well as an early diagnostic test of children's intelligence.

Conclusions: The results show that children's cognitive development can be quickly screened using eye-tracking technology and that it can track quantitative intelligence scores and sensitively detect intellectual impairment.

Early is left and up: Saccadic responses reveal horizontal and vertical spatial associations of serial order in working memory

Maintaining serial order in working memory is crucial for cognition. Recent theories propose that serial information is achieved by positional coding of items on a spatial frame of reference. In line with this, an early-left and late-right spatial-positional association of response code (SPoARC) effect has been established. Various theoretical accounts have been put forward to explain the SPoARC effect (the mental whiteboard hypothesis, conceptual metaphor theory, polarity correspondence, or the indirect spatial-numerical association effect). Crucially, while all these accounts predict a left-to-right orientation of the SPoARC effect, they make different predictions regarding the direction of a possible vertical SPoARC effect. In this study, we therefore investigated SPoARC effects along the horizontal and vertical spatial dimension by means of saccadic responses. We replicated the left-to-right horizontal SPoARC effect and established for the first time an up-to-down vertical SPoARC effect. The direction of the vertical SPoARC effect was in contrast to that predicted by metaphor theory, polarity correspondence, or by the indirect spatial-numerical association effect. Rather, our results support the mental whiteboard-hypothesis, according to which positions can be flexibly coded on an internal space depending on the task demands. We also found that the strengths of the horizontal and vertical SPoARC effects were correlated, showing that some people are more prone than others to use spatial references for position coding. Our results therefore suggest that context templates used for position marking are not necessarily spatial in nature but depend on individual strategy preferences.

Is prediction nothing more than multi-scale pattern completion of the future?

While the notion of the brain as a prediction machine has been extremely influential and productive in cognitive science, there are competing accounts of how best to model and understand the predictive capabilities of brains. One prominent framework is of a "Bayesian brain" that explicitly generates predictions and uses resultant errors to guide adaptation. We suggest that the prediction-generation component of this framework may involve little more than a pattern completion process. We first describe pattern completion in the domain of visual perception, highlighting its temporal extension, and show how this can entail a form of prediction in time. Next, we describe the forward momentum of entrained dynamical systems as a model for the emergence of predictive processing in non-predictive systems. Then, we apply this reasoning to the domain of language, where explicitly predictive models are perhaps most popular. Here, we demonstrate how a connectionist model, TRACE, exhibits hallmarks of predictive processing without any representations of predictions or errors. Finally, we present a novel neural network model, inspired by reservoir computing models, that is entirely unsupervised and memoryless, but nonetheless exhibits prediction-like behavior in its pursuit of homeostasis. These explorations demonstrate that brain-like systems can get prediction "for free," without the need to posit formal logical representations with Bayesian probabilities or an inference machine that holds them in working memory.

Eye-tracking evidence for fixation asymmetries in verbal and numerical quantifier processing

When people are given quantified information (e.g., ‘there is a 60% chance of rain’), the format of quantifiers (i.e., numerical: ‘a 60% chance’ vs. verbal: ‘it is likely’) might affect their decisions. Previous studies with indirect cues of judgements and decisions (e.g., response times, decision outcomes) give inconsistent findings that could support either a more intuitive process for verbal than numerical quantifiers or a greater focus on the context (e.g., rain) for verbal than numerical quantifiers. We used two pre-registered eye-tracking experiments (n(1) = 148, n(2) = 133) to investigate decision-making processes with verbal and numerical quantifiers. Participants evaluated multiple verbally or numerically quantified nutrition labels (Experiment 1) and weather forecasts (Experiment 2) with different context valence (positive or negative), and quantities (‘low’, ‘medium’, or ‘high’ in Experiment 1 and ‘possible’, ‘likely’, or ‘very likely’ in Experiment 2) presented in a fully within-subjects design. Participants looked longer at verbal than numerical quantifiers, and longer at the contextual information with verbal quantifiers. Quantifier format also affected judgements and decisions: in Experiment 1, participants judged positive labels to be better in the verbal compared to the equivalent numerical condition (and to be worse for negative labels). In Experiment 2, participants decided on rain protection more for a verbal forecast of rain than the equivalent numerical forecast. The results fit the explanation that verbal quantifiers put more focus on the informational context than do numerical quantifiers, rather than prompting more intuitive decisions.

The Incomplete Tyranny of Dynamic Stimuli: Gaze Similarity Predicts Response Similarity in Screen-Captured Instructional Videos

Although eye tracking has been used extensively to assess cognitions for static stimuli, recent research suggests that the link between gaze and cognition may be more tenuous for dynamic stimuli such as videos. Part of the difficulty in convincingly linking gaze with cognition is that in dynamic stimuli, gaze position is strongly influenced by exogenous cues such as object motion. However, tests of the gaze-cognition link in dynamic stimuli have been done on only a limited range of stimuli often characterized by highly organized motion. Also, analyses of cognitive contrasts between participants have been mostly been limited to categorical contrasts among small numbers of participants that may have limited the power to observe more subtle influences. We, therefore, tested for cognitive influences on gaze for screen-captured instructional videos, the contents of which participants were tested on. Between-participant scanpath similarity predicted between-participant similarity in responses on test questions, but with imperfect consistency across videos. We also observed that basic gaze parameters and measures of attention to centers of interest only inconsistently predicted learning, and that correlations between gaze and centers of interest defined by other-participant gaze and cursor movement did not predict learning. It, therefore, appears that the search for eye movement indices of cognition during dynamic naturalistic stimuli may be fruitful, but we also agree that the tyranny of dynamic stimuli is real, and that links between eye movements and cognition are highly dependent on task and stimulus properties.

Efficient calculations of NSS-based gaze similarity for time-dependent stimuli

The degree of spatial similarity between the gaze of participants viewing dynamic stimuli such as videos has been previously measured using metrics which are based on the NSS (Normalized Scanpath Saliency). Methods currently used to calculate this metric rely upon a numerical grid, which can be computationally prohibitive for a variety of otherwise useful applications such as Monte Carlo analyses. In the present work we derive a new analytical calculation method for the same metric that yields equal or more accurate results, but with speeds than can be orders of magnitude faster (depending on parameters). Our analytical method scales well with dimensionality, and could also be of use for other applications. The drawback is that it can become very slow if the number of participants in the study is very large or if the gaze sampling rate is high. We provide performance benchmarks for a Fortran implementation of our method, and make available the source code developed.

Do our eyes mirror our thought patterns? A study on the influence of convergent and divergent thinking on eye movement

Research indicates that deliberate thinking and eye movements are related. However, how various thought processes influence eye movements is not explored well. The present research examined the role of convergent and divergent thinking in eye movement. Divergent thinking involves novel alternatives, multiple uses, and unconventional answers which may require scanning visual surroundings precisely and extensively. Hence, it was hypothesized that divergent thinking would involve more scattered and detailed visual scanning than convergent thinking. Two experiments were conducted using repeated measures design: both involved a visual remote association task for convergent thinking and an adapted visual task of the alternate uses task for divergent thinking. Experiment 1 tracked participants' eye movement while solving the task when images of objects were on the screen; whereas, in Experiment 2, the blank screen paradigm was used where the images of items were removed and the eyes were tracked while participants solved the task. Data analysis showed that the eye movements were more object focused during convergent thinking than divergent thinking. The results confirmed that participants in divergent thinking had more detailed and dispersed visual scanning than in convergent thinking.

Developing Expertise in 1H NMR Spectral Interpretation

Advancements in organic chemistry depend upon chemists' ability to interpret NMR spectra, though research demonstrates that cultivating such proficiency requires years of graduate-level study. The organic chemistry community thus needs insight into how this expertise develops to expedite learning among its newest members. This study investigated undergraduate and doctoral chemistry students' understanding and information processing during the interpretation of ¹H NMR spectra and complementary IR spectra. Eighteen undergraduate and seven doctoral chemistry students evaluated the outcome of a series of syntheses using spectra corresponding to the products. Eye movements were measured to identify differences in cognitive processes between undergraduate and doctoral participants, and interviews were conducted to elucidate the chemical assumptions that guided participants' reasoning. Results suggest five areas of understanding are necessary for interpreting spectra, and progress in understanding corresponds to increasing knowledge of experimental and implicit chemical variables. Undergraduate participants exhibited uninformed bidirectional processing of all information, whereas doctoral participants exhibited informed unidirectional processing of relevant information. These findings imply the community can support novices' development of expertise by cultivating relevant understanding and encouraging use of informed interpretation strategies, including preliminary evaluation of relevant variables, prediction of expected spectral features, and search for complementary data across spectra.

Cognitive Processing of Miscommunication in Interactive Listening: An Evaluation of Listener Indecision and Cognitive Effort

Purpose The purpose of the current study was to evaluate the social and cognitive underpinnings of miscommunication during an interactive listening task. Method An eye and computer mouse-tracking visual-world paradigm was used to investigate how a listener's cognitive effort (local and global) and decision-making processes were affected by a speaker's use of ambiguity that led to a miscommunication. Results Experiments 1 and 2 found that an environmental cue that made a miscommunication more or less salient impacted listener language processing effort (eye-tracking). Experiment 2 also indicated that listeners may develop different processing heuristics dependent upon the speaker's use of ambiguity that led to a miscommunication, exerting a significant impact on cognition and decision making. We also found that perspective-taking effort and decision-making complexity metrics (computer mouse tracking) predict language processing effort, indicating that instances of miscommunication produced cognitive consequences of indecision, thinking, and cognitive pull. Conclusion Together, these results indicate that listeners behave both reciprocally and adaptively when miscommunications occur, but the way they respond is largely dependent upon the type of ambiguity and how often it is produced by the speaker.

Internet-word compared with daily-word priming reduces attentional scope

This study tested whether one aspect of cognitive processing, namely visual attentional scope, was more narrow in an Internet environment compared to a daily-life environment. Words related to the Internet and words related to daily life were used as priming stimuli before participants had to respond to a Navon letter to assess attention to global vs. local targets. In Experiment 1, reaction time during the Navon task showed that global processing priority was greater after daily words than after Internet words. In Experiment 2, ERP data showed significantly larger P2 amplitudes induced by global letters than local letters in the two conditions. After Internet-word priming, a smaller N2 amplitude was induced by local letters than by global letters, but this difference was not observed after daily-word priming. The influence of priming on attentional scope might have occurred at the stage of cognitive control, indicating that it was easier to resist the interfering effect of global letters in the Internet-word condition than in the daily-word condition. The results of both experiments suggest that attentional scope is narrower in an Internet environment than in a daily-life environment.

How physical interaction with insight problems affects solution rates, hint use, and cognitive load

So-called insight problems are widely studied because they tap into the creative thinking that is crucial for solving real problems. However, insight problems are typically presented in static formats (on paper, computer) that allow no physical interaction with the problem elements, whereas such an interaction might in fact reduce the load on limited cognitive resources, such as working memory (WM) capacity, thereby facilitating solutions. To test this proposition, 124 young adults were allowed to interact physically with nine established insight problems, while another 124 people attempted to solve these problems using paper and pencil. Additionally, hints were provided for three problems that typically no-one solves. No general facilitating effect of physical interaction was found, with only one problem clearly benefitting from it. Furthermore, making use of hints was actually hindered by physical interaction. No difference in perceived task load and correlation with WM capacity was observed between the formats, and subjective ratings of insight were virtually unaffected by presentation format. Overall, physical interaction minimally affected insight problem-solving, which appears to rely strongly on internalized cognitive processing involving WM.

Effects of visual map complexity on the attentional processing of landmarks

In the era of smartphones, route-planning and navigation is supported by freely and globally available web mapping services, such as OpenStreetMap or Google Maps. These services provide digital maps, as well as route planning functions that visually highlight the suggested route in the map. Additionally, such digital maps contain landmark pictograms, i.e. representations of salient objects in the environment. These landmark representations are, amongst other reference points, relevant for orientation, route memory, and the formation of a cognitive map of the environment. The amount of visible landmarks in maps used for navigation and route planning depends on the width of the displayed margin areas around the route. The amount of further reference points is based on the visual complexity of the map. This raises the question how factors like the distance of landmark representations to the route and visual map complexity determine the relevance of specific landmarks for memorizing a route. In order to answer this question, two experiments that investigated the relation between eye fixation patterns on landmark representations, landmark positions, route memory and visual map complexity were carried out. The results indicate that the attentional processing of landmark representations gradually decreases with an increasing distance to the route, decision points and potential decision points. Furthermore, this relation was found to be affected by the visual complexity of the map. In maps with low visual complexity, landmark representations further away from the route are fixated. However, route memory was not found to be affected by visual complexity of the map. We argue that map users might require a certain amount of reference points to form spatial relations as a foundation for a mental representation of space. As maps with low visual complexity offer less reference points, people need to scan a wider area. Therefore, visual complexity of the area displayed in a map should be considered in navigation-oriented map design by increasing displayed margins around the route in maps with a low visual complexity. In order to verify our assumption that the amount of reference points not only affects visual attention processes, but also the formation of a mental representation of space, additional research is required.

Using eye-tracking to understand relations between visual attention and language in children's spatial skills

Relations between children's spatial language and spatial skills raise questions regarding whether the effects are unique to language or reflect non-linguistic processes. Different paradigms provided mixed evidence: experimenter-provided language supports spatial performance more than visual cues; however, children's non-verbal attention predicts their spatial performance more than their language production. The current study used eye-tracking during spatial recall to compare effects of language versus visual cues. Four- to five-year-old children completed two tasks requiring memory for the location of a toy under one of four cups in an array of cups and landmarks after a 5 s delay and array rotation. Children first completed the baseline task with non-specific cues, followed by the cue-manipulation task with either language, visual, or non-specific cues provided by the experimenter. As in prior studies, language cues were most effective in facilitating recall. Children's visual attention was directed by both language and visual cues to support their recall. However, visual attention only partially mediated the effects of language: language supported recall above and beyond directing visual attention. These results indicate that visual attention supports spatial recall, but language has additional unique influences. This may result from language providing a more coherent or redundant code to visual information, or due to the pragmatic nature of language cueing relevance in ways visual cues do not. Additionally, differences across conditions may reflect more benefit from endogenous versus exogenous attentional control. Through using eye-tracking, this research provided new insights into processes by which language and visual attention influence children's spatial cognition.

The speed of perception: the effects of over-speed video training on pitch recognition in collegiate softball players

During interceptive motor tasks, experts demonstrate distinct visual search behavior (from novices) that is reflective of information extraction from optimal environmental cues, which subsequently aids anticipatory movements. While some forms of visual training have been employed in sport, over-speed video training is rarely applied to perceptual-cognitive sport contexts. The purpose of the present study was to determine whether over-speed video training can enhance visual information processing and augment visual behavior for a pitch-recognition task. Twelve collegiate softball players were recruited for the study. A between-subjects, repeated measures design was implemented to assess changes in participants' pitch recognition on a video-based occlusion task after one of two training interventions: (A) over-speed video training (n = 6) or (B) regular video training (n = 6). Both training interventions required individuals to view 400 videos of different pitches over the span of 10 days. The over-speed group viewed the videos at gradually increasing video speeds (+ 0.05 × each day). Performance (i.e., identifying pitch type and location), quiet-eye duration (i.e., total QE, QE-early and QE-late) and cortical activation (i.e., alpha wave activity/asymmetry; F3/F4 and P7/P8) were measured during the pitch-recognition tasks. Results showed significant performance improvements across groups, but no differences between groups. Both interventions were associated with a reduction in alpha wave activity for P8, an increase in alpha activity for F3, and a significant increase in QE-late. An increase in QE-late was associated with a decrease in P7/P8 alpha asymmetry and improvements in pitch-type recognition. Consistent with the extant literature, our results support the importance of a later QE offset for successful performance on perceptual tasks, potentially extending to perceputal-motor tasks. Although participants in the over-speed condition did not experience significantly larger improvements in performance than controls, this study highlights the association between QE and brain activity reflective of expertise.

When the Solution Is on the Doorstep: Better Solving Performance, but Diminished Aha! Experience for Chess Experts on the Mutilated Checkerboard Problem

Insight problems are difficult because the initially activated knowledge hinders successful solving. The crucial information needed for a solution is often so far removed that gaining access to it through restructuring leads to the subjective experience of "Aha!". Although this assumption is shared by most insight theories, there is little empirical evidence for the connection between the necessity of restructuring an incorrect problem representation and the Aha! experience. Here, we demonstrate a rare case where previous knowledge facilitates the solving of insight problems but reduces the accompanying Aha! experience. Chess players were more successful than non-chess players at solving the mutilated checkerboard insight problem, which requires retrieval of chess-related information about the color of the squares. Their success came at a price, since they reported a diminished Aha! experience compared to controls. Chess players' problem-solving ability was confined to that particular problem, since they struggled to a similar degree to non-chess players to solve another insight problem (the eight-coin problem), which does not require chess-related information for a solution. Here, chess players and non-chess players experienced the same degree of insight.

Allocentric Versus Egocentric Neglect in Stroke Patients: A Pilot Study Investigating the Assessment of Neglect Subtypes and Their Impacts on Functional Outcome Using Eye Tracking

OBJECTIVE

Few studies have investigated the assessment and functional impact of egocentric and allocentric neglect among stroke patients. This pilot study aimed to determine (1) whether allocentric and egocentric neglect could be dissociated among a sample of stroke patients using eye tracking; (2) the specific patterns of attention associated with each subtype; and (3) the nature of the relationship between neglect subtype and functional outcome.

METHOD

Twenty acute stroke patients were administered neuropsychological assessment batteries, a pencil-and-paper Apples Test to measure neglect subtype, and an adaptation of the Apples Test with an eye tracking measure. To test clinical discriminability, twenty age- and education-matched control participants were administered the eye tracking measure of neglect.

RESULTS

The eye tracking measure identified a greater number of individuals as having egocentric and/or allocentric neglect than the pencil-and-paper Apples Test. Classification of neglect subtype based on eye tracking performance was a significant predictor of functional outcome beyond that accounted for by the neuropsychological test performance and Apples Test neglect classification. Preliminary evidence suggests that patients with no neglect symptoms had superior functional outcomes compared with patients with neglect. Patients with combined egocentric and allocentric neglect had poorer functional outcomes than those with either subtype. Functional outcomes of patients with either allocentric or egocentric neglect did not differ significantly. The applications of our findings, to improve neglect detection, are discussed.

CONCLUSION

Results highlight the potential clinical utility of eye tracking for the assessment and identification of neglect subtype among stroke patients to predict functional outcomes. (JINS, 2019, 25, 479-489).

The Effect of Working Memory Updating Ability on Spatial Insight Problem Solving: Evidence From Behavior and Eye Movement Studies

It still remains uncertain whether working memory updating ability influences spatial insight problem solving and whether working memory updating ability plays a role in the representation restructuring phase. The current study explored the correlation of working memory updating ability and spatial insight problem solving by behavior and eye movement experiments, and the results showed that high working memory updating ability individuals spend significant shorter time to solve spatial insight problem than low working memory updating ability individuals. For participants with high or low working memory updating ability, the underlying mechanism of spatial insight problem solving is sudden rather than incremental, which demonstrated that the working memory updating ability did not influence the representation restructuring phase. Working memory updating ability influences spatial problem solving, and it works critically in the problem space search phase, while the restructuring phase is sudden and immediate, which is not influenced by working memory updating ability. The representation restructuring tends to be spontaneous.

The Role of Motor Activity in Insight Problem Solving (the Case of the Nine-Dot Problem)

Attempts to estimate the contribution made by motor activity to insight problem solving is hindered by a lack of detailed description of motor behavior. The goal of this study was to develop and put to the test a novel method for studying the dynamics of insight problem solving based on a quantitative analysis of ongoing motor activity. As a proper problem model, we chose the nine-dot problem (Maier, 1930), in which solvers had to draw a sequence of connected line segments. Instead of using the traditional pen-and-paper way of solving the nine-dot problem we asked participants to use their index finger to draw line segments on the surface of a tablet computer. We are arguing that successful studying of the role of motor activity during problem solving requires the distinction between its instrumental and functional role. We considered the functional role on the motor activity as closely related to the on-line mode of motor planning. The goal of Experiment 1 was to explore the potential power of the method and, at the same time, to assay the patterns of motor activity related to on-line and off-line modes of motor planning. Experiments 2 and 3 were designed to uncover the potential impact of preliminary motor training on the motor output of successful and unsuccessful problem solvers. In these experiments, we tested hypotheses on how preliminary motor training, which presumably played a functional role in Experiment 2 and an instrumental role in Experiment 3, affects the motor activity of a problem solver and hence their effectiveness in solving the problem. The three experiments showed consistent results. They suggest that successful solving of the nine-dot problem relies upon the functional role of motor activity and requires both off-line and on-line modes of motor planning, with the latter helping to overcome the perceptual constraints imposed by a spatial arrangement of the nine dots. The method that we applied allows for systematic comparison between successful and unsuccessful problem solvers based on the quantitative parameters of their motor activity. Through it, we found new specific patterns of motor activity that differentiate successful and unsuccessful solvers.

Guiding Low Spatial Ability Individuals through Visual Cueing: The Dual Importance of Where and When to Look

Research suggests that spatial ability may predict success in complex disciplines including anatomy, where mastery requires a firm understanding of the intricate relationships occurring along the course of veins, arteries, and nerves, as they traverse through and around bones, muscles, and organs. Debate exists on the malleability of spatial ability, and some suggest that spatial ability can be enhanced through training. It is hypothesized that spatial ability can be trained in low-performing individuals through visual guidance. To address this, training was completed through a visual guidance protocol. This protocol was based on eye-movement patterns of high-performing individuals, collected via eye-tracking as they completed an Electronic Mental Rotations Test (EMRT). The effects of guidance were evaluated using 33 individuals with low mental rotation ability, in a counterbalanced crossover design. Individuals were placed in one of two treatment groups (late or early guidance) and completed both a guided, and an unguided EMRT. A third group (no guidance/control) completed two unguided EMRTs. All groups demonstrated an increase in EMRT scores on their second test (P < 0.001); however, an interaction was observed between treatment and test iteration (P = 0.024). The effect of guidance on scores was contingent on when the guidance was applied. When guidance was applied early, scores were significantly greater than expected (P = 0.028). These findings suggest that by guiding individuals with low mental rotation ability "where" to look early in training, better search approaches may be adopted, yielding improvements in spatial reasoning scores. It is proposed that visual guidance may be applied in spatial fields, such as STEMM (science, technology, engineering, mathematics and medicine), surgery, and anatomy to improve student's interpretation of visual content. Anat Sci Educ. © 2018 American Association of Anatomists.

The Effect of the Embodied Guidance in the Insight Problem Solving: An Eye Movement Study

Insight is an important cognitive process in creative thinking. The present research applied embodied cognitive perspective to explore the effect of embodied guidance on insight problem solving and its underlying mechanisms by two experiments. Experiment 1 used the matchstick arithmetic problem to explore the role of embodied gestures guidance in problem solving. The results showed that the embodied gestures facilitate the participants’ performance. Experiment 2 investigated how embodied attention guidance affects insight problem solving. The results showed that participants performed better in prototypical guidance condition. Experiment 2a adopted the Duncker’s radiation problem to explore how embodied behavior and prototypical guidance influence problem solving by attention tracing techniques. Experiment 2b aimed to further examine whether implicit attention transfer was the real cause which resulted in participants over-performing in prototypical guidance condition in Experiment 2a. The results demonstrated that overt physical motion was unnecessary for individuals to experience the benefits of embodied guidance in problem solving, which supported the reciprocal relation hypothesis of saccades and attention. In addition, the questionnaire completed after experiments showed that participants did not realize the relation between guidance and insight problem solving. Taken together, the current study provided further evidence for that embodied gesture and embodied attention both facilitated the insight problem solving and the facilitation is implicit.