1
|
Hsiao JHW. Understanding Human Cognition Through Computational Modeling. Top Cogn Sci 2024. [PMID: 38781432 DOI: 10.1111/tops.12737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Revised: 05/07/2024] [Accepted: 05/08/2024] [Indexed: 05/25/2024]
Abstract
One important goal of cognitive science is to understand the mind in terms of its representational and computational capacities, where computational modeling plays an essential role in providing theoretical explanations and predictions of human behavior and mental phenomena. In my research, I have been using computational modeling, together with behavioral experiments and cognitive neuroscience methods, to investigate the information processing mechanisms underlying learning and visual cognition in terms of perceptual representation and attention strategy. In perceptual representation, I have used neural network models to understand how the split architecture in the human visual system influences visual cognition, and to examine perceptual representation development as the results of expertise. In attention strategy, I have developed the Eye Movement analysis with Hidden Markov Models method for quantifying eye movement pattern and consistency using both spatial and temporal information, which has led to novel findings across disciplines not discoverable using traditional methods. By integrating it with deep neural networks (DNN), I have developed DNN+HMM to account for eye movement strategy learning in human visual cognition. The understanding of the human mind through computational modeling also facilitates research on artificial intelligence's (AI) comparability with human cognition, which can in turn help explainable AI systems infer humans' belief on AI's operations and provide human-centered explanations to enhance human-AI interaction and mutual understanding. Together, these demonstrate the essential role of computational modeling methods in providing theoretical accounts of the human mind as well as its interaction with its environment and AI systems.
Collapse
|
2
|
Pickup B, Sharpe L, Todd J. Interpretation bias in endometriosis-related pain. Pain 2023; 164:2352-2357. [PMID: 37326698 DOI: 10.1097/j.pain.0000000000002946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 04/03/2023] [Indexed: 06/17/2023]
Abstract
ABSTRACT Endometriosis-related pain has been predominantly medically managed, which has hindered understanding of psychological factors involved in these pain experiences. Models of chronic pain highlight the biased interpretation of ambiguous information as health threat related (interpretation bias) as an important process in the development and maintenance of chronic pain. Whether interpretation bias may also be similarly implicated in endometriosis-related pain is unclear. The current study aimed to address this gap in the literature by (1) comparing interpretation biases between a sample of participants with endometriosis and a control sample of participants without medical conditions and pain, (2) exploring relationships between interpretation bias and endometriosis-related pain outcomes, and (3) exploring whether interpretation bias moderated the relationship between endometriosis-related pain severity and pain interference. The endometriosis and healthy control samples comprised 873 and 197 participants, respectively. Participants completed online surveys assessing demographics, interpretation bias, and pain-related outcomes. Analyses revealed that interpretation bias was significantly stronger among individuals with endometriosis relative to controls, with a large effect size. Within the endometriosis sample, interpretation bias was significantly associated with increases in pain-related interference, however, interpretation bias was not associated with any other pain outcomes and did not moderate the relationship between pain severity and pain interference. This study is the first to evidence biased interpretation styles among individuals with endometriosis and to show this bias is associated with pain interference. Whether interpretation bias varies over time and whether this bias can be modified through scalable and accessible interventions to alleviate pain-related interference are avenues for future research.
Collapse
Affiliation(s)
- Brydee Pickup
- School of Psychology, The University of Sydney, Camperdown, Australia
| | | | | |
Collapse
|
3
|
Hsiao JH, An J, Hui VKS, Zheng Y, Chan AB. Understanding the role of eye movement consistency in face recognition and autism through integrating deep neural networks and hidden Markov models. NPJ SCIENCE OF LEARNING 2022; 7:28. [PMID: 36284113 PMCID: PMC9596700 DOI: 10.1038/s41539-022-00139-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Accepted: 08/31/2022] [Indexed: 06/16/2023]
Abstract
Greater eyes-focused eye movement pattern during face recognition is associated with better performance in adults but not in children. We test the hypothesis that higher eye movement consistency across trials, instead of a greater eyes-focused pattern, predicts better performance in children since it reflects capacity in developing visual routines. We first simulated visual routine development through combining deep neural network and hidden Markov model that jointly learn perceptual representations and eye movement strategies for face recognition. The model accounted for the advantage of eyes-focused pattern in adults, and predicted that in children (partially trained models) consistency but not pattern of eye movements predicted recognition performance. This result was then verified with data from typically developing children. In addition, lower eye movement consistency in children was associated with autism diagnosis, particularly autistic traits in social skills. Thus, children's face recognition involves visual routine development through social exposure, indexed by eye movement consistency.
Collapse
Affiliation(s)
- Janet H Hsiao
- Department of Psychology, University of Hong Kong, Hong Kong SAR, China.
- The State Key Laboratory of Brain and Cognitive Sciences, University of Hong Kong, Hong Kong SAR, China.
- The Institute of Data Science, University of Hong Kong, Hong Kong SAR, China.
| | - Jeehye An
- Department of Psychology, University of Hong Kong, Hong Kong SAR, China
| | | | - Yueyuan Zheng
- Department of Psychology, University of Hong Kong, Hong Kong SAR, China
| | - Antoni B Chan
- Department of Computer Science, City University of Hong Kong, Hong Kong SAR, China
| |
Collapse
|
4
|
Liao W, Li STK, Hsiao JHW. Music reading experience modulates eye movement pattern in English reading but not in Chinese reading. Sci Rep 2022; 12:9144. [PMID: 35650229 PMCID: PMC9397380 DOI: 10.1038/s41598-022-12978-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Accepted: 05/19/2022] [Indexed: 11/30/2022] Open
Abstract
Here we tested the hypothesis that in Chinese-English bilinguals,
music reading experience may modulate eye movement planning in reading English but
not Chinese sentences due to the similarity in perceptual demands on processing
sequential symbol strings separated by spaces between music notation and English
sentence reading. Chinese–English bilingual musicians and non-musicians read legal,
semantically incorrect, and syntactically (and semantically) incorrect sentences in
both English and Chinese. In English reading, musicians showed more dispersed eye
movement patterns in reading syntactically incorrect sentences than legal sentences,
whereas non-musicians did not. This effect was not observed in Chinese reading.
Musicians also had shorter saccade lengths when viewing syntactically incorrect than
correct musical notations and sentences in an unfamiliar alphabetic language
(Tibetan), whereas non-musicians did not. Thus, musicians’ eye movement planning was
disturbed by syntactic violations in both music and English reading but not in
Chinese reading, and this effect was generalized to an unfamiliar alphabetic
language. These results suggested that music reading experience may modulate
perceptual processes in reading differentially in bilinguals’ two languages,
depending on their processing similarities.
Collapse
Affiliation(s)
- Weiyan Liao
- Department of Psychology, University of Hong Kong, Hong Kong SAR, China
| | - Sara Tze Kwan Li
- Department of Psychology, University of Hong Kong, Hong Kong SAR, China.,Department of Social Sciences, School of Arts and Social Sciences, Hong Kong Metropolitan University, Hong Kong SAR, China
| | - Janet Hui-Wen Hsiao
- Department of Psychology, University of Hong Kong, Hong Kong SAR, China. .,The State Key Laboratory of Brain and Cognitive Sciences, University of Hong Kong, Hong Kong SAR, China. .,The Institute of Data Science, University of Hong Kong, Hong Kong SAR, China.
| |
Collapse
|
5
|
Cho VY, Hsiao JH, Chan AB, Ngo HC, King NM, Anthonappa RP. Eye movement analysis of children's attention for midline diastema. Sci Rep 2022; 12:7462. [PMID: 35523808 PMCID: PMC9076614 DOI: 10.1038/s41598-022-11174-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2021] [Accepted: 04/05/2022] [Indexed: 11/09/2022] Open
Abstract
No previous studies have investigated eye-movement patterns to show children's information processing while viewing clinical images. Therefore, this study aimed to explore children and their educators' perception of a midline diastema by applying eye-movement analysis using the hidden Markov models (EMHMM). A total of 155 children between 2.5 and 5.5 years of age and their educators (n = 34) viewed pictures with and without a midline diastema while Tobii Pro Nano eye-tracker followed their eye movements. Fixation data were analysed using data-driven, and fixed regions of interest (ROIs) approaches with EMHMM. Two different eye-movement patterns were identified: explorative pattern (76%), where the children's ROIs were predominantly around the nose and mouth, and focused pattern (26%), where children's ROIs were precise, locating on the teeth with and without a diastema, and fixations transited among the ROIs with similar frequencies. Females had a significantly higher eye-movement preference for without diastema image than males. Comparisons between the different age groups showed a statistically significant difference for overall entropies. The 3.6-4.5y age groups exhibited higher entropies, indicating lower eye-movement consistency. In addition, children and their educators exhibited two specific eye-movement patterns. Children in the explorative pattern saw the midline diastema more often while their educators focussed on the image without diastema. Thus, EMHMMs are valuable in analysing eye-movement patterns in children and adults.
Collapse
Affiliation(s)
- Vanessa Y Cho
- UWA Dental School, The University of Western Australia, 17 Monash Avenue, Nedlands, WA, 6009, Australia
| | - Janet H Hsiao
- Department of Psychology, University of Hong Kong, Pok Fu Lam, Hong Kong SAR
| | - Antoni B Chan
- Department of Computer Science, City University of Hong Kong, Kowloon Tong, Hong Kong SAR
| | - Hien C Ngo
- UWA Dental School, The University of Western Australia, 17 Monash Avenue, Nedlands, WA, 6009, Australia
| | - Nigel M King
- UWA Dental School, The University of Western Australia, 17 Monash Avenue, Nedlands, WA, 6009, Australia
| | - Robert P Anthonappa
- UWA Dental School, The University of Western Australia, 17 Monash Avenue, Nedlands, WA, 6009, Australia.
| |
Collapse
|
6
|
Hsiao JHW, Liao W, Tso RVY. Impact of mask use on face recognition: an eye-tracking study. Cogn Res Princ Implic 2022; 7:32. [PMID: 35394572 PMCID: PMC8990495 DOI: 10.1186/s41235-022-00382-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2021] [Accepted: 03/21/2022] [Indexed: 12/05/2022] Open
Abstract
We examined how mask use affects performance and eye movements in face recognition and whether strategy change reflected in eye movements is associated with performance change. Eighty-eight participants performed face recognition with masked faces either during learning only, during recognition only, or during both learning and recognition. As compared with the baseline condition where faces were unmasked during both learning and recognition, participants had impaired performance in all three scenarios, with larger impairment when mask conditions during learning and recognition did not match. When recognizing unmasked faces, whether the faces were learned with or without a mask on did not change eye movement behavior. Nevertheless, when recognizing unmasked faces that were learned with a mask on, participants who adopted more eyes-focused patterns had less performance impairment as compared with the baseline condition. When recognizing masked faces, participants had more eyes-focused patterns and more consistent gaze transition behavior than recognizing unmasked faces regardless of whether the faces were learned with or without a mask on. Nevertheless, when recognizing masked faces that were learned without a mask, participants whose gaze transition behavior was more consistent had less performance impairment as compared with the baseline condition. Thus, although eye movements during recognition were mainly driven by the mask condition during recognition but not that during learning, those who adjusted their strategy according to the mask condition difference between learning and recognition had better performance. This finding has important implications for identifying populations vulnerable to the impact of mask use and potential remedial strategies.
Collapse
Affiliation(s)
- Janet Hui-Wen Hsiao
- Department of Psychology, University of Hong Kong, Pokfulam Road, Hong Kong, Hong Kong SAR, China. .,The State Key Laboratory of Brain and Cognitive Sciences, University of Hong Kong, Hong Kong, Hong Kong SAR, China.
| | - Weiyan Liao
- Department of Psychology, University of Hong Kong, Pokfulam Road, Hong Kong, Hong Kong SAR, China
| | - Ricky Van Yip Tso
- Department of Psychology, The Education University of Hong Kong, Tai Po, New Territories, Hong Kong SAR, China.,Psychological Assessment and Clinical Research Unit, The Education University of Hong Kong, Tai Po, New Territories, Hong Kong SAR, China
| |
Collapse
|