1
|
de Meijer FO, Nyamu N, de Bruin ABH. Can written prompts help medical residents to accurately monitor their own communication skills and those of others? ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2024:10.1007/s10459-024-10364-w. [PMID: 39235519 DOI: 10.1007/s10459-024-10364-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 08/05/2024] [Indexed: 09/06/2024]
Abstract
In healthcare, effective communication in complex situations such as end of life conversations is critical for delivering high quality care. Whether residents learn from communication training with actors depends on whether they are able to select appropriate information or 'predictive cues' from that learning situation that accurately reflect their or their peers' performance and whether they use those cues for ensuing judgement. This study aimed to explore whether prompts can help medical residents improving use of predictive cues and judgement of communication skills. First and third year Kenyan residents (N = 41) from 8 different specialties were randomly assigned to one of two experimental groups during a mock OSCE assessing advanced communication skills. Residents in the intervention arm received paper predictive cue prompts while residents in the control arm received paper regular prompts for self-judgement. In a pre- and post- test, residents' use of predictive cues and the appropriateness of peer-judgements were evaluated against a pre-rated video of another resident. The intervention improved both the use of predictive cues in self-judgement and peer-judgement. Ensuing accuracy of peer-judgements in the pre- to post-test only partly improved: no effect from the intervention was found on overall appropriateness of judgements. However, when analyzing participants' completeness of judgements over the various themes within the consultation, a reduction in inappropriate judgments scores was seen in the intervention group. In conclusion, predictive cue prompts can help learners to concentrate on relevant cues when evaluating communication skills and partly improve monitoring accuracy. Future research should focus on offering prompts more frequently to evaluate whether this increases the effect on monitoring accuracy in communication skills.
Collapse
Affiliation(s)
- F O de Meijer
- Department of Postgraduate Medical Education, Aga Khan University, Nairobi, Kenya
- School of Health Professions Education, Maastricht University, Maastricht, The Netherlands
| | - N Nyamu
- Deparment of Family Medicine, Aga Khan University, Nairobi, Kenya
| | - A B H de Bruin
- Faculty of Health, Medicine and Life Sciences, Maastricht University, Maastricht, The Netherlands.
| |
Collapse
|
2
|
Sturman D, Bell EA, Auton JC, Breakey GR, Wiggins MW. The roles of phishing knowledge, cue utilization, and decision styles in phishing email detection. APPLIED ERGONOMICS 2024; 119:104309. [PMID: 38729025 DOI: 10.1016/j.apergo.2024.104309] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 04/22/2024] [Accepted: 05/04/2024] [Indexed: 05/12/2024]
Abstract
This study investigated the roles of phishing knowledge, cue utilization, and decision styles in contributing to phishing email detection. Participants (N = 145) completed an online email sorting task, and measures of phishing knowledge, email decision styles, cue utilization, and email security awareness. Cue utilization was the only factor that uniquely predicted the capacity to discriminate phishing from genuine emails. Phishing knowledge was associated with greater phishing detection and a bias towards classifying all emails as phishing. A preference for intuitive decision making predicted lower detection of phishing emails, driven by a greater tendency to classify emails as genuine. These findings support the proposition that cue utilization is a distinct cognitive process that enables expert performance. The outcomes indicate that, in addition to increasing phishing knowledge and developing safe behavioral patterns, anti-phishing training needs to provide opportunities for trainees to develop meaningful cue associations.
Collapse
|
3
|
Cooper D, Wiggins MW, Main LC, Wills JA, Doyle T. Cue utilisation is partially related to performance on an urban operations course but not experience. APPLIED ERGONOMICS 2023; 110:104024. [PMID: 37080083 DOI: 10.1016/j.apergo.2023.104024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Revised: 03/24/2023] [Accepted: 04/04/2023] [Indexed: 05/03/2023]
Abstract
INTRODUCTION Decision making in use of force relies on accurate cue identification to inform appropriate response. This research was designed to test the relationship between cue utilisation and performance prior to, and following participation in an urban operations course (UOC). METHODS A total of 37 participants were assessed on cue utilisation measures, course outcome and between group changes following course participation. RESULTS A significant main effect was evident for Cue utilisation and administration, (p = 0.005), but not training group, (p = 0.54), nor between groups and point of administration, (p = 0.410). No main effect was evident between groups and training outcome, (p = 0.11). However, there was a main effect for point of administration, (p = 0.02) and training outcome and point of administration (p = 0.02). CONCLUSION Although cue utilisation is an essential component of perception-action tasks, cues may be more specific to the relevant training environment with limited transfer to the operational context.
Collapse
Affiliation(s)
| | | | - Luana C Main
- Deakin University, Institute for Physical Activity & Nutrition (IPAN), Geelong, VIC, Australia
| | | | - Tim Doyle
- Macquarie University, Sydney, NSW, Australia.
| |
Collapse
|
4
|
Sturman D, Valenzuela C, Plate O, Tanvir T, Auton JC, Bayl-Smith P, Wiggins MW. The role of cue utilization in the detection of phishing emails. APPLIED ERGONOMICS 2023; 106:103887. [PMID: 36037654 DOI: 10.1016/j.apergo.2022.103887] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Revised: 08/17/2022] [Accepted: 08/18/2022] [Indexed: 06/15/2023]
Abstract
This study was designed to examine the roles of cue utilization, phishing features and time pressure in the detection of phishing emails. During two experiments, participants completed an email sorting task containing both phishing and genuine emails. Participants were allocated to either a high or low time pressure condition. Performance was assessed via detection sensitivity and response bias. Participants were classified with either higher or lower cue utilization and completed a measure of phishing knowledge. When participants were blind to the nature of the study (N = 191), participants with higher cue utilization were better able to discriminate phishing from genuine emails. However, they also recorded a stronger bias towards classifying emails as phishing, compared to participants with lower cue utilization. When notified of phishing base rates prior to the email sorting task (N = 191), participants with higher cue utilization were better able to discriminate phishing from genuine emails without recording an increase in rate of false alarms, compared to participants with lower cue utilization. Sensitivity increased with a reduction in time pressure, while response bias was influenced by the number of phishing-related features in each email. The outcomes support the proposition that cue-based processing of critical features is associated with an increase in the capacity of individuals to discriminate phishing from genuine emails, above and beyond phishing-related knowledge. From an applied perspective, these outcomes suggest that cue-based training may be beneficial for improving detection of phishing emails.
Collapse
Affiliation(s)
- Daniel Sturman
- School of Psychology, The University of Adelaide, Adelaide, SA, Australia.
| | - Chelsea Valenzuela
- School of Psychology, The University of Adelaide, Adelaide, SA, Australia
| | - Oliver Plate
- School of Psychology, The University of Adelaide, Adelaide, SA, Australia
| | - Tazin Tanvir
- School of Psychology, The University of Adelaide, Adelaide, SA, Australia
| | - Jaime C Auton
- School of Psychology, The University of Adelaide, Adelaide, SA, Australia
| | - Piers Bayl-Smith
- Department of Psychology, Macquarie University, Sydney, NSW, Australia
| | - Mark W Wiggins
- Department of Psychology, Macquarie University, Sydney, NSW, Australia
| |
Collapse
|
5
|
Carrigan AJ, Charlton A, Foucar E, Wiggins MW, Georgiou A, Palmeri TJ, Curby KM. The Role of Cue-Based Strategies in Skilled Diagnosis Among Pathologists. HUMAN FACTORS 2022; 64:1154-1167. [PMID: 33586457 DOI: 10.1177/0018720821990160] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
OBJECTIVE This research was designed to test whether behavioral indicators of pathology-related cue utilization were associated with performance on a diagnostic task. BACKGROUND Across many domains, including pathology, successful diagnosis depends on pattern recognition that is supported by associations in memory in the form of cues. Previous studies have focused on the specific information or knowledge on which medical image expertise relies. The target in this study is the more general ability to identify and interpret relevant information. METHOD Data were collected from 54 histopathologists in both conference and online settings. The participants completed a pathology edition of the Expert Intensive Skills Evaluation 2.0 (EXPERTise 2.0) to establish behavioral indicators of context-related cue utilization. They also completed a separate diagnostic task designed to examine related diagnostic skills. RESULTS Behavioral indicators of higher or lower cue utilization were based on the participants' performance across five tasks. Accounting for the number of cases reported per year, higher cue utilization was associated with greater accuracy on the diagnostic task. A post hoc analysis suggested that higher cue utilization may be associated with a greater capacity to recognize low prevalence cases. CONCLUSION This study provides support for the role of cue utilization in the development and maintenance of skilled diagnosis amongst pathologists. APPLICATION Pathologist training needs to be structured to ensure that learners have the opportunity to form cue-based strategies and associations in memory, especially for less commonly seen diseases.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Kim M Curby
- 7788 Macquarie University, Sydney, Australia
| |
Collapse
|
6
|
Falkland EC, Wiggins MW, Douglas H, Sturman D, Auton JC, Shieh L, Westbrook JI. Explaining emergency physicians' capacity to recover from interruptions. APPLIED ERGONOMICS 2022; 105:103857. [PMID: 35933839 DOI: 10.1016/j.apergo.2022.103857] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Revised: 06/18/2022] [Accepted: 07/19/2022] [Indexed: 06/15/2023]
Abstract
OBJECTIVE To assess whether the capacity to utilize cues amongst emergency physicians is associated with differences in the capacity to recover performance following an interruption. BACKGROUND Interruptions are implicated in errors in emergency medicine due to the cognitive load that they impose on working memory, resulting in a loss of performance on the primary task. The utilization of cues is associated with a reduction in cognitive load during the performance of a task, thereby enabling the allocation of residual resources that mitigates the loss of performance following interruptions. METHOD Thirty-nine emergency physicians, recruited at a medical conference, completed an assessment of cue utilization (EXPERTise 2.0) and an online simulation (Septris) that involved the management of patients presenting with sepsis. During the simulation, physicians were interrupted and asked to check a medication order. Task performance was assessed using scores on Septris, with points awarded for the accurate management of patients. RESULTS Emergency physicians with higher cue utilization recorded significantly higher scores on the simulation task following the interruption, compared to physicians with lower cue utilization (p = .028). CONCLUSION The results confirm a relationship between cue utilization and the recovery of performance following an interruption. This is likely due to the advantages afforded by associated reductions in cognitive load. APPLICATION Assessments of cue utilization may assist in the development of interventions to support clinicians in interruptive environments.
Collapse
Affiliation(s)
- Emma C Falkland
- Department of Psychology, Macquarie University, North Ryde, NSW, 2109, Australia.
| | - Mark W Wiggins
- Department of Psychology, Macquarie University, North Ryde, NSW, 2109, Australia
| | - Heather Douglas
- Department of Psychology, Newcastle University, Callaghan, NSW, 2308, Australia
| | - Daniel Sturman
- School of Psychology, University of Adelaide, North Terrace, SA, 5005, Australia
| | - Jaime C Auton
- School of Psychology, University of Adelaide, North Terrace, SA, 5005, Australia
| | - Lisa Shieh
- Department of Medicine, Stanford University, California, USA
| | - Johanna I Westbrook
- Australian Institute of Health Innovation, Macquarie University, North Ryde, NSW, 2109, Australia
| |
Collapse
|
7
|
Wiwatowska E, Czajeczny D, Michałowski JM. Decreased preparatory activation and inattention to cues suggest lower activation of proactive cognitive control among high procrastinating students. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2022; 22:171-186. [PMID: 34498229 PMCID: PMC8791900 DOI: 10.3758/s13415-021-00945-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 08/10/2021] [Indexed: 06/13/2023]
Abstract
Procrastination is a voluntary delay in completing an important task while being aware that this behavior may lead to negative outcomes. It has been shown that an increased tendency to procrastinate is associated with deficits in some aspects of cognitive control. However, none of the previous studies investigated these dysfunctions through the lenses of the Dual Mechanisms Framework, which differentiates proactive and reactive modes of control. The present study was designed to fill this gap, using behavioral and neurophysiological assessment during the completion of the AX-Continuous Performance Task (AX-CPT) by high (HP) and low (LP) procrastinating students (N = 139). Behavioral results indicated that HP (vs. LP) were characterized by increased attentional fluctuations (higher reaction time variability) and reduction in some indices of proactive cognitive control (lower d'-context and A-cue bias, but similar PBIs). Furthermore, the neurophysiological data showed that HP, compared with LP, allocated less attentional resources (lower P3b) to cues that help to predict the correct responses to upcoming probes. They also responded with reduced preparatory activity (smaller CNV) after cues presentation. The two groups did not differ in neural responses linked to conflict detection and inhibition (similar N2 and P3a). Obtained findings indicate that HP might present deficits in some cognitive functions that are essential for effective proactive control engagement, along with preserved levels of reactive cognitive control. In the present paper, we discuss the potential neural and cognitive mechanisms responsible for the observed effects.
Collapse
Affiliation(s)
- Ewa Wiwatowska
- Department of Psychology and Law, SWPS University of Social Sciences and Humanities, Kutrzeby 10 St, 61-719, Poznań, Poland.
| | - Dominik Czajeczny
- Department of Psychology and Law, SWPS University of Social Sciences and Humanities, Kutrzeby 10 St, 61-719, Poznań, Poland
- Department of Clinical Psychology, Poznań University of Medical Sciences, Poznań, Poland
| | - Jarosław M Michałowski
- Department of Psychology and Law, SWPS University of Social Sciences and Humanities, Kutrzeby 10 St, 61-719, Poznań, Poland
| |
Collapse
|
8
|
Greenwood CE, Carrigan AJ. The effect of cue utilization in driving on response inhibition. APPLIED COGNITIVE PSYCHOLOGY 2021. [DOI: 10.1002/acp.3878] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
| | - Ann J. Carrigan
- Department of Psychology Macquarie University Sydney New South Wales Australia
- Centre for Elite Performance, Expertise and Training Macquarie University Sydney New South Wales Australia
- Perception in Action Research Centre Macquarie University Sydney New South Wales Australia
| |
Collapse
|
9
|
Carrigan AJ, Stoodley P, Ng K, Moerel D, Wiggins MW. Static versus dynamic medical images: The role of cue utilization in diagnostic performance. APPLIED COGNITIVE PSYCHOLOGY 2021. [DOI: 10.1002/acp.3861] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Affiliation(s)
- Ann J. Carrigan
- Centre for Elite Performance, Expertise and Training Macquarie University Sydney New South Wales Australia
- Perception in Action Research Centre Macquarie University Sydney New South Wales Australia
- Department of Psychology Macquarie University Sydney New South Wales Australia
| | - Paul Stoodley
- School of Medicine Western Sydney University Sydney, New South Wales Australia
- Westmead Private Cardiology Westmead New South Wales Australia
| | - Kenny Ng
- Cardiology Department Royal North Shore Hospital Sydney New South Wales Australia
| | - Denise Moerel
- Perception in Action Research Centre Macquarie University Sydney New South Wales Australia
- Department of Cognitive Science Macquarie University Sydney New South Wales Australia
| | - Mark W. Wiggins
- Centre for Elite Performance, Expertise and Training Macquarie University Sydney New South Wales Australia
- Department of Psychology Macquarie University Sydney New South Wales Australia
| |
Collapse
|
10
|
Carrigan AJ, Magnussen J, Georgiou A, Curby KM, Palmeri TJ, Wiggins MW. Differentiating Experience From Cue Utilization in Radiological Assessments. HUMAN FACTORS 2021; 63:635-646. [PMID: 32150500 DOI: 10.1177/0018720820902576] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
OBJECTIVE This research was designed to examine the contribution of self-reported experience and cue utilization to diagnostic accuracy in the context of radiology. BACKGROUND Within radiology, it is unclear how task-related experience contributes to the acquisition of associations between features with events in memory, or cues, and how they contribute to diagnostic performance. METHOD Data were collected from 18 trainees and 41 radiologists. The participants completed a radiology edition of the established cue utilization assessment tool EXPERTise 2.0, which provides a measure of cue utilization based on performance on a number of domain-specific tasks. The participants also completed a separate image interpretation task as an independent measure of diagnostic performance. RESULTS Consistent with previous research, a k-means cluster analysis using the data from EXPERTise 2.0 delineated two groups, the pattern of centroids of which reflected higher and lower cue utilization. Controlling for years of experience, participants with higher cue utilization were more accurate on the image interpretation task compared to participants who demonstrated relatively lower cue utilization (p = .01). CONCLUSION This study provides support for the role of cue utilization in assessments of radiology images among qualified radiologists. Importantly, it also demonstrates that cue utilization and self-reported years of experience as a radiologist make independent contributions to performance on the radiological diagnostic task. APPLICATION Task-related experience, including training, needs to be structured to ensure that learners have the opportunity to acquire feature-event relationships and internalize these associations in the form of cues in memory.
Collapse
Affiliation(s)
| | | | | | - Kim M Curby
- 7788 Macquarie University, Sydney, Australia
| | | | | |
Collapse
|
11
|
Sturman D, Wiggins MW. Drivers' Cue Utilization Predicts Cognitive Resource Consumption During a Simulated Driving Scenario. HUMAN FACTORS 2021; 63:402-414. [PMID: 31721607 DOI: 10.1177/0018720819886765] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
OBJECTIVE This study was designed to examine whether cue utilization differentiates drivers' consumption of cognitive resources during a simulated driving task. BACKGROUND Outcomes from previous research have demonstrated that a general capacity for cue utilization differentiates cognitive load during novel process control tasks. However, it was previously unclear whether similar results would be demonstrated during familiar operational tasks. METHOD Based on an assessment of cue utilization within a driving context, participants were classified into higher or lower cue utilization typologies. During a simulated driving task, cognitive load was assessed through changes against baseline in cerebral oxygenation in the prefrontal cortex, through eye behavior metrics (fixation rates and fixation dispersion), and through driving performance (frequency of missed traffic signals and speed exceedances). RESULTS Drivers with higher cue utilization recorded smaller mean fixation dispersions, smaller increases in cerebral oxygenation, and fewer missed traffic signals compared with drivers with lower cue utilization. These results suggest that compared with drivers with lower cue utilization, drivers with higher cue utilization experienced lower cognitive load during the simulated driving task while maintaining a higher level of performance. CONCLUSION The results provide support for the assertion that, among qualified operators, a greater capacity for cue utilization is associated with lower cognitive load during operational tasks. APPLICATION Cue-based assessments of driving may be beneficial in predicting performance and assisting in targeted training for recently qualified and/or older drivers.
Collapse
Affiliation(s)
- Daniel Sturman
- 7788 Macquarie University, Sydney, New South Wales, Australia
| | - Mark W Wiggins
- 7788 Macquarie University, Sydney, New South Wales, Australia
| |
Collapse
|
12
|
Falkland EC, Wiggins MW, Westbrook JI. Interruptions versus breaks: The role of cue utilisation in a simulated process control task. APPLIED COGNITIVE PSYCHOLOGY 2020. [DOI: 10.1002/acp.3766] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Affiliation(s)
- Emma C. Falkland
- Department of Psychology Macquarie University North Ryde New South Wales Australia
| | - Mark W. Wiggins
- Department of Psychology Macquarie University North Ryde New South Wales Australia
| | - Johanna I. Westbrook
- Australian Institute of Health Innovation Macquarie University North Ryde New South Wales Australia
| |
Collapse
|
13
|
Joffe AD, Wiggins MW. Cross-task cue utilisation and situational awareness in learning to manage a simulated rail control task. APPLIED ERGONOMICS 2020; 89:103216. [PMID: 32660932 DOI: 10.1016/j.apergo.2020.103216] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/24/2019] [Revised: 06/19/2020] [Accepted: 06/30/2020] [Indexed: 06/11/2023]
Abstract
Cue utilisation and situational awareness share similar properties since both constructs are dependent upon the application of feature-event associations in memory. The aim of this study was to investigate the extent to which cue utilisation and situational awareness contribute to learning a simplified, simulated rail control task incorporating an implicit pattern of train movements. Fifty-five undergraduate students completed an assessment of cue utilisation prior to completing the rail control task during periods of lower and higher task demands. Situational awareness was assessed using Situation Awareness Global Assessment Technique (SAGAT) queries. The results indicated that, while both cue utilisation and situational awareness were related to the detection of the implicit pattern of train movements, they contributed separately to performance on the simulated rail control task. The outcomes suggest that cue utilisation and situational awareness may be separate constructs, where cue utilisation constitutes a capacity variable that is associated with changes in response to task demand and situational awareness constitutes an outcome variable that emerges through task exposure.
Collapse
Affiliation(s)
- Anthony D Joffe
- Department of Psychology, Macquarie University, North Ryde, NSW, 2109, Australia
| | - Mark W Wiggins
- Department of Psychology, Macquarie University, North Ryde, NSW, 2109, Australia.
| |
Collapse
|
14
|
Nasser G, Morrison BW, Bayl-Smith P, Taib R, Gayed M, Wiggins MW. The Role of Cue Utilization and Cognitive Load in the Recognition of Phishing Emails. Front Big Data 2020; 3:546860. [PMID: 33693413 PMCID: PMC7931973 DOI: 10.3389/fdata.2020.546860] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2020] [Accepted: 08/19/2020] [Indexed: 11/13/2022] Open
Abstract
Phishing emails represent a major threat to online information security. While the prevailing research is focused on users' susceptibility, few studies have considered the decision-making strategies that account for skilled detection. One relevant facet of decision-making is cue utilization, where users retrieve feature-event associations stored in long-term memory. High degrees of cue utilization help reduce the demands placed on working memory (i.e., cognitive load), and invariably improve decision performance (i.e., the information-reduction hypothesis in expert performance). The current study explored the effect of cue utilization and cognitive load when detecting phishing emails. A total of 50 undergraduate students completed: (1) a rail control task; (2) a phishing detection task; and (3) a survey of the cues used in detection. A cue utilization assessment battery (EXPERTise 2.0) then classified participants with either higher or lower cue utilization. As expected, higher cue utilization was associated with a greater likelihood of detecting phishing emails. However, variation in cognitive load had no effect on phishing detection, nor was there an interaction between cue utilization and cognitive load. Further, the findings revealed no significant difference in the types of cues used across cue utilization groups or performance levels. These findings have implications for our understanding of cognitive mechanisms that underpin the detection of phishing emails and the role of factors beyond the information-reduction hypothesis.
Collapse
Affiliation(s)
- George Nasser
- School of Psychology, Charles Sturt University, Bathurst, NSW, Australia
| | - Ben W. Morrison
- School of Psychology, Charles Sturt University, Bathurst, NSW, Australia
- Department of Psychology, Macquarie University, Sydney, NSW, Australia
| | - Piers Bayl-Smith
- Department of Psychology, Macquarie University, Sydney, NSW, Australia
| | - Ronnie Taib
- Data 61, Commonwealth Scientific and Industrial Research Organisation (CSIRO), Canberra, ACT, Australia
| | - Michael Gayed
- Department of Psychology, Macquarie University, Sydney, NSW, Australia
| | - Mark W. Wiggins
- Department of Psychology, Macquarie University, Sydney, NSW, Australia
| |
Collapse
|
15
|
Falkland EC, Wiggins MW, Westbrook JI. Cue Utilization Differentiates Performance in the Management of Interruptions. HUMAN FACTORS 2020; 62:751-769. [PMID: 31238005 DOI: 10.1177/0018720819855281] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
OBJECTIVE To examine the role of cue utilization in the management of interruptions during a high workload, rail control simulation. BACKGROUND High-risk, high-consequence environments are characterized by cognitively demanding, time-critical activities, in which operators are required to manage frequent interruptions under conditions of high workload. Interruptions are deleterious to performance as they impose excessive cognitive demand on limited working memory resources, thereby depleting residual resources for the primary task. Cue utilization may enable superior performance in managing interruptions through efficiencies gained by the application of implicit patterns stored in long-term memory. METHOD Two experiments were conducted. In Experiment 1, 46 university students undertook an assessment of cue utilization and subsequently engaged in a high workload, simulated rail control task while managing multiple interruptive tasks. Experiment 2 replicated and extended Experiment 1, wherein 52 university students completed a measure of cue utilization and engaged in a high workload, simulated rail control task while managing multiple interruptions and breaks. RESULTS The analyses revealed that participants who demonstrated a greater capacity for cue utilization also demonstrated a reduced loss of performance following interruptions. CONCLUSION The outcomes suggest a relationship between a greater capacity for cue utilization and superior performance in the management of interruptions in high workload conditions. APPLICATION Assessments of cue utilization may assist in the selection and training of operators in high-consequence, high-risk environments, to ensure efficient and accurate performance during the management of interruptions.
Collapse
Affiliation(s)
- Emma C Falkland
- 7788 Macquarie University, North Ryde, New South Wales, Australia
| | - Mark W Wiggins
- 7788 Macquarie University, North Ryde, New South Wales, Australia
| | - Johanna I Westbrook
- Australian Institute of Health Innovation, North Ryde, New South Wales, Australia
| |
Collapse
|
16
|
Carrigan AJ, Stoodley P, Fernandez F, Sunday MA, Wiggins MW. Individual differences in echocardiography: Visual object recognition ability predicts cue utilization. APPLIED COGNITIVE PSYCHOLOGY 2020. [DOI: 10.1002/acp.3711] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Affiliation(s)
- Ann J. Carrigan
- Centre for Elite Performance, Expertise and Training Macquarie University Sydney, NSW Australia
- Perception in Action Research Centre Macquarie University Sydney, NSW Australia
- Department of Psychology Macquarie University Sydney, NSW Australia
| | - Paul Stoodley
- School of Medicine Western Sydney University Sydney, NSW Australia
- Westmead Private Cardiology Westmead NSW Australia
| | | | | | - Mark W. Wiggins
- Centre for Elite Performance, Expertise and Training Macquarie University Sydney, NSW Australia
- Department of Psychology Macquarie University Sydney, NSW Australia
| |
Collapse
|
17
|
Wiggins MW. A behaviour-based approach to the assessment of cue utilisation: implications for situation assessment and performance. THEORETICAL ISSUES IN ERGONOMICS SCIENCE 2020. [DOI: 10.1080/1463922x.2020.1758828] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Affiliation(s)
- Mark W. Wiggins
- Centre for Elite Performance, Expertise, and Training, Macquarie University, North Ryde, NSW, Australia
| |
Collapse
|
18
|
Sturman D, Wiggins MW, Auton JC, Helton WS. Cue utilisation predicts control room operators' performance in a sustained visual search task. ERGONOMICS 2020; 63:48-60. [PMID: 31609682 DOI: 10.1080/00140139.2019.1680873] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/15/2019] [Accepted: 10/04/2019] [Indexed: 06/10/2023]
Abstract
This research was designed to determine whether qualified practitioners' cue utilisation is predictive of their performance during a sustained visual search task in an operational context. Australian Distribution Network Service Provider (DNSP) operators were recruited for two experiments, and were classified with either higher or lower cue utilisation based on an assessment of cue utilisation within the context of power distribution. Operators' performance was assessed using a domain-related sustained visual search task. In both experiments, power distribution operators with higher cue utilisation demonstrated shorter mean response latencies during the sustained visual search task, compared to operators with lower cue utilisation. Further, no differences in accuracy based on cue utilisation were observed during the sustained visual search task. The results are consistent with the proposition that power operators with higher cue utilisation have a greater capacity to sustain visual search during domain-related tasks, compared to operators with lower cue utilisation. Practitioner summary: Power distribution system operators' cue utilisation was used to predict performance during a domain-related sustained visual search task. Power distribution operators with higher cue utilisation demonstrated shorter mean response latencies during the sustained visual search task, but no differences in accuracy, compared to operators with lower cue utilisation. Abbreviations: DNSP: distribution network service provider; EXPERTise 2.0: EXPERT intensive skills evaluation; FAT: feature association task; FDT: feature discrimination task; FIT: feature identification task; fNIRS: functional near infrared spectroscopy; FPT: feature prioritisation task; FRT: feature recognition task; SCADA: supervisory control and data acquisition.
Collapse
Affiliation(s)
- Daniel Sturman
- Department of Psychology, Macquarie University, Sydney, Australia
| | - Mark W Wiggins
- Department of Psychology, Macquarie University, Sydney, Australia
| | - Jaime C Auton
- School of Psychology, The University of Adelaide, Adelaide, Australia
| | - William S Helton
- Department of Psychology, George Mason University, Fairfax, VA, USA
| |
Collapse
|
19
|
Yuris NC, Wiggins MW, Auton JC, Gaicon L, Sturman D. Higher cue utilization in driving supports improved driving performance and more effective visual search behaviors. JOURNAL OF SAFETY RESEARCH 2019; 71:59-66. [PMID: 31862045 DOI: 10.1016/j.jsr.2019.09.008] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/11/2019] [Revised: 05/16/2019] [Accepted: 09/10/2019] [Indexed: 06/10/2023]
Abstract
INTRODUCTION Once qualified, drivers rarely receive objective feedback concerning their performance. This is especially the case in the context of cognitive skills such as situation assessment. The aim of this study was to test the construct validity of an online assessment of motor-vehicle driver cue utilization that forms the foundation for situation assessment. METHOD Seventy-one undergraduate Psychology students with broadly comparable driving experience completed a motor-vehicle driving version of EXPERTise 2.0, an online tool that enables inferences concerning the utilization of cues based on responses to task-related stimuli. They also completed a simulated driving task while fitted with an eye tracking device, during which a range of hazards were presented with participants' responses recorded. RESULTS The results indicated that higher cue utilization was associated with fewer driving errors and collisions, fewer visual fixations, and fewer saccades in comparison to participants with lower cue utilization. CONCLUSION The results provide support for the construct validity of EXPERTise 2.0 as an effective measure of cue utilization in the context of driving. PRACTICAL APPLICATIONS Providing comparative feedback to drivers concerning their development of situation assessment skills may provide opportunities for further training and development, thereby reducing the likelihood of motor-vehicle accidents.
Collapse
Affiliation(s)
- Nadya C Yuris
- Macquarie University, 4 First Walk, Sydney, NSW 2109, Australia.
| | - Mark W Wiggins
- Macquarie University, 4 First Walk, Sydney, NSW 2109, Australia
| | - Jaime C Auton
- The University of Adelaide, Hughes, North Terrace, Adelaide, SA 5005, Australia
| | - Leia Gaicon
- Macquarie University, 4 First Walk, Sydney, NSW 2109, Australia
| | - Daniel Sturman
- Macquarie University, 4 First Walk, Sydney, NSW 2109, Australia
| |
Collapse
|
20
|
Sturman D, Wiggins MW, Auton JC, Loft S, Helton WS, Westbrook JI, Braithwaite J. Control Room Operators' Cue Utilization Predicts Cognitive Resource Consumption During Regular Operational Tasks. Front Psychol 2019; 10:1967. [PMID: 31507501 PMCID: PMC6718724 DOI: 10.3389/fpsyg.2019.01967] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2019] [Accepted: 08/12/2019] [Indexed: 11/13/2022] Open
Abstract
This study was designed to examine whether qualified practitioners’ cue utilization is predictive of their sustained attention performance during regular operational tasks. Simulated laboratory studies have demonstrated that cue utilization differentiates cognitive load during process control tasks. However, it was previously unclear whether similar results would be demonstrated with qualified practitioners during familiar operational tasks. Australian distribution network service provider (DNSP) operators were classified with either higher or lower cue utilization based on an assessment of cue utilization within the context of electrical power distribution. During two, 20-min periods of operators’ regular workdays, physiological measures of workload were assessed through changes in cerebral oxygenation in the prefrontal cortex compared to baseline, and through eye behavior metrics (fixation rates, saccade amplitude, and fixation dispersion). The results indicated that there were no statistically significant differences in eye behavior metrics, based on levels of cue utilization. However, as hypothesized, during both sessions, operators with higher cue utilization demonstrated smaller increases in cerebral oxygenation in the prefrontal cortex from baseline, compared to operators with lower cue utilization. The results are consistent with the proposition that operators with higher cue utilization experience lower cognitive load during periods of regular activity during their workday, compared to operators with lower cue utilization. Assessments of cue utilization could help identify operators who are better able to sustain attention during regular operational tasks, as well as those who may benefit from cue-based training interventions.
Collapse
Affiliation(s)
- Daniel Sturman
- Department of Psychology, Macquarie University, Sydney, NSW, Australia
| | - Mark W Wiggins
- Department of Psychology, Macquarie University, Sydney, NSW, Australia
| | - Jaime C Auton
- School of Psychology, The University of Adelaide, Adelaide, SA, Australia
| | - Shayne Loft
- School of Psychological Science, The University of Western Australia, Perth, WA, Australia
| | - William S Helton
- Department of Psychology, George Mason University, Fairfax, VA, United States
| | - Johanna I Westbrook
- Australian Institute of Health Innovation, Macquarie University, Sydney, NSW, Australia
| | - Jeffrey Braithwaite
- Australian Institute of Health Innovation, Macquarie University, Sydney, NSW, Australia
| |
Collapse
|
21
|
Wiggins MW, Griffin B, Brouwers S. The Potential Role of Context-Related Exposure in Explaining Differences in Water Safety Cue Utilization. HUMAN FACTORS 2019; 61:825-838. [PMID: 30601676 DOI: 10.1177/0018720818814299] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
OBJECTIVE To examine whether differences in water safety-related cue utilization might be associated with differences in exposure to water-related recreational contexts. BACKGROUND A disproportionate number of incidents of drowning were attributable to recent visitors to New South Wales in the 2016-2017 summer swimming season. This was due to their assumed lack of exposure to the water-related recreational settings in which Australians engage and therefore, the absence of cues that are associated with danger. METHOD In Study 1, the water safety cue utilization of 101 Australian residents and 328 recent visitors to the country was compared using the Expert Intensive Skills Evaluation (EXPERTise 2.0) program. Accounting for differences between the samples, Australian residents demonstrated significantly superior water safety cue utilization. In Study 2, the water safety cue utilization of a sample of 219 Australian residents was examined, the outcomes of which indicated that those participants who learned to swim before the age of 11 years demonstrated superior water safety cue utilization to participants who learned to swim at a later age. RESULTS Overall, the results suggest that there are individual differences in water safety cue utilization that are explained, in part, by differences in country of residence and the age at which participants first learned to swim. CONCLUSION Water safety cue utilization is likely to be dependent upon exposure to water-related activities. Identifying individual differences enables the development of more targeted, drowning-prevention strategies.
Collapse
|