1
|
Sun Y, Pang H, Järvilehto L, Zhang O, Shapiro D, Korkman J, Haginoya S, Santtila P. Comparing the performance of a large language model and naive human interviewers in interviewing children about a witnessed mock-event. PLoS One 2025; 20:e0316317. [PMID: 40019879 PMCID: PMC11870376 DOI: 10.1371/journal.pone.0316317] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Accepted: 12/10/2024] [Indexed: 03/03/2025] Open
Abstract
PURPOSE The present study compared the performance of a Large Language Model (LLM; ChatGPT) and human interviewers in interviewing children about a mock-event they witnessed. METHODS Children aged 6-8 (N = 78) were randomly assigned to the LLM (n = 40) or the human interviewer condition (n = 38). In the experiment, the children were asked to watch a video filmed by the researchers that depicted behavior including elements that could be misinterpreted as abusive in other contexts, and then answer questions posed by either an LLM (presented by a human researcher) or a human interviewer. RESULTS Irrespective of condition, recommended (vs. not recommended) questions elicited more correct information. The LLM posed fewer questions overall, but no difference in the proportion of the questions recommended by the literature. There were no differences between the LLM and human interviewers in unique correct information elicited but questions posed by LLM (vs. humans) elicited more unique correct information per question. LLM (vs. humans) also elicited less false information overall, but there was no difference in false information elicited per question. CONCLUSIONS The findings show that the LLM was competent in formulating questions that adhere to best practice guidelines while human interviewers asked more questions following up on the child responses in trying to find out what the children had witnessed. The results indicate LLMs could possibly be used to support child investigative interviewers. However, substantial further investigation is warranted to ascertain the utility of LLMs in more realistic investigative interview settings.
Collapse
Affiliation(s)
- Yongjie Sun
- The School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
- New York University Shanghai, Shanghai, China
| | - Haohai Pang
- New York University Shanghai, Shanghai, China
- Center for Data Science, New York University, New York, New York, United States of America
| | - Liisa Järvilehto
- Åbo Akademi University, Turku, Finland
- Forensic Psychology Center for Children and Adolescents, Helsinki University Hospital, Helsinki, Finland
| | | | - David Shapiro
- The School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | - Julia Korkman
- Åbo Akademi University, Turku, Finland
- European Institute for Crime Prevention and Control, affiliated with the United Nations (HEUNI), Helsinki, Finland
| | | | - Pekka Santtila
- New York University Shanghai, Shanghai, China
- Shanghai Frontiers Science Center of Artificial Intelligence and Deep Learning, New York University Shanghai, Shanghai, China
| |
Collapse
|
2
|
Fernandes D, Gomes JP, Albuquerque PB, Matos M. Forensic Interview Techniques in Child Sexual Abuse Cases: A Scoping Review. TRAUMA, VIOLENCE & ABUSE 2024; 25:1382-1396. [PMID: 37272340 PMCID: PMC10913353 DOI: 10.1177/15248380231177317] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Child sexual abuse (CSA) is widely recognized as a global public health problem with negative consequences for victims, their families, and society. The child's testimony is essential to the case outcome, given the frequent absence of physical or biological evidence of the abusive acts. Thus, the child forensic interview plays a decisive role in criminal investigation. The present scoping review aims to identify and describe the judicial procedures for collecting CSA victims' testimony using an evidence-based approach and a structured methodology. The review followed Preferred Reporting Items of Systematic Reviews and Meta-Analysis-Scoping Review guidelines. Studies were identified through manual reference checking and in four electronic databases: PsycARTICLES, PubMed, SCOPUS, and Web of Science. In all, 146 studies were identified according to the defined inclusion criteria, that is, empirical studies identifying judicial procedures to collect CSA victims' testimony, published in English or Portuguese. In total, 30 different forensic interview procedures to collect the child victim's testimony were found. The National Institute for Child Health and Human Development investigative interview protocol was the most frequently mentioned. Despite the variety of protocols, it was possible to conclude that they have a similar general structure. This review also identified gaps in interviewing practices with CSA victims. The scoping review corroborates the importance of forensic interviews with CSA victims, stating its implications for criminal investigation, the legal system, and the child's recovery process.
Collapse
Affiliation(s)
- Delfina Fernandes
- Psychology Research Centre (CIPsi), School of Psychology, University of Minho, Portugal
| | - João P. Gomes
- Psychology Research Centre (CIPsi), School of Psychology, University of Minho, Portugal
| | - Pedro B. Albuquerque
- Psychology Research Centre (CIPsi), School of Psychology, University of Minho, Portugal
| | - Marlene Matos
- Psychology Research Centre (CIPsi), School of Psychology, University of Minho, Portugal
| |
Collapse
|
3
|
Wyman J, Malloy L. Increasing disclosures of older adult maltreatment: a review of best practices for interviewing older adult eyewitnesses and victims. PSYCHIATRY, PSYCHOLOGY, AND LAW : AN INTERDISCIPLINARY JOURNAL OF THE AUSTRALIAN AND NEW ZEALAND ASSOCIATION OF PSYCHIATRY, PSYCHOLOGY AND LAW 2023; 31:274-292. [PMID: 38628254 PMCID: PMC11018022 DOI: 10.1080/13218719.2023.2192260] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Accepted: 02/28/2023] [Indexed: 04/19/2024]
Abstract
The current article provides a contemporary review of the best practices for interviewing older adults about crimes they witnessed or experienced. Specifically, we provide a detailed overview of how investigators can use a range of interviewing adaptations and procedures to acquire detailed and accurate maltreatment disclosures from older adults. In addition to discussing well-established investigative interviewing practices (e.g. rapport building, free-recall, cognitive instructions and prompts), this article also summarizes more recent literature on the benefits of multidisciplinary investigations, use of assistive technology and interview accommodations, along with effective practices for working with minority and marginalized older adults. Lastly, several research, professional and policy recommendations are provided for supporting older adults during investigative interviews.
Collapse
Affiliation(s)
- Joshua Wyman
- Department of Psychology, King’s University College at Western University, London, ON, Canada
| | - Lindsay Malloy
- Faculty of Social Sciences and Humanities, Ontario Tech University, Oshawa, ON, Canada
| |
Collapse
|
4
|
Kaya A, Yıldız G. "I think they do not know how to lie:" The perceptions of legal support staff about person with intellectual disabilities/autism in Turkish legal system. JOURNAL OF APPLIED RESEARCH IN INTELLECTUAL DISABILITIES 2023; 36:516-528. [PMID: 36750351 DOI: 10.1111/jar.13074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2022] [Revised: 12/11/2022] [Accepted: 01/03/2023] [Indexed: 02/09/2023]
Abstract
BACKGROUND Increased social integration of individuals with intellectual disabilities or autism could may raise their likelihood of interacting with justice system and legal staff. AIMS The present article aimed to determine the perceptions of the legal support staff about the individuals with intellectual disabilities or autism. MATERIALS AND METHODS In the study, conducted with the phenomenological method, the views of 15 legal support staff were obtained. The study reported what participants perceived and examined whether participants had an accurate understanding of the experiences/support needs of people with intellectual disabilities/autism. The data were analysed with content analysis. RESULTS Three themes were determined: (1) Experience of interview with an individual with intellectual disabilities/autism, (2) attitudes of judges, lawyers and other staff, and (3) abuse/trauma. DISCUSSION Findings are consistent with literature. Individuals with intellectual disabilities/autism have problems in expressing themselves, also staff do not know them, do not know their features. Studies show that staff often do not know what to do in these interviews. CONCLUSION Based on the participant perspectives, it was determined that individuals with intellectual disabilities/autism experienced self-expression problems, interviewees did not understand children/individuals with intellectual disabilities or autism and could exhibit negative attitudes, the children could be abused and traumatised during judicial processes, they were more prone to abuse when compared to their peers, they could be involved in certain events more frequently and could be pushed to crime.
Collapse
Affiliation(s)
- Ali Kaya
- Special Education, Faculty of Education, Nevşehir Hacı Bektaş Veli University, Nevşehir, Turkey
| | - Gizem Yıldız
- Special Education, Faculty of Education, Anadolu University, Eskişehir, Turkey
| |
Collapse
|
5
|
The dynamics of two-session interviews with suspected victims of abuse who are reluctant to make allegations. Dev Psychopathol 2021; 33:739-747. [PMID: 33436116 DOI: 10.1017/s0954579420001820] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Supportive forensic interviews conducted in accordance with the National Institute of Child Health and Human Development Revised Protocol (RP) help many alleged victims describe abusive experiences. When children remain reluctant to make allegations, the RP guides interviewers to (a) focus on rapport building and nonsuggestive support in a first interview, and (b) plan a second interview to allow continued rapport building before exploring for possible abuse. We explored the dynamics of such two-session RP interviews. Of 204 children who remained reluctant in an initial interview, we focused on 104 who made allegations when re-interviewed a few days later. A structural equation model revealed that interviewer support during the first session predicted children's cooperation during the rapport-building phase of the second session, which, in turn, predicted more spontaneous allegations, which were associated with the interviewers' enhanced use of open-ended questions. Together, these factors mediated the effects of support on children's free recall of forensically important information. This highlighted the importance of emphasizing rapport with reluctant children, confirming that some children may need more time to build rapport even with supportive interviewers.
Collapse
|
6
|
Szojka ZA, Nicol A, La Rooy D. Narrative coherence in multiple forensic interviews with child witnesses alleging physical and sexual abuse. APPLIED COGNITIVE PSYCHOLOGY 2020. [DOI: 10.1002/acp.3673] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
| | | | - David La Rooy
- School of Law, Royal HollowayUniversity of London London UK
| |
Collapse
|
7
|
Effects of Delay, Question Type, and Socioemotional Support on Episodic Memory Retrieval by Children with Autism Spectrum Disorder. J Autism Dev Disord 2019; 49:1111-1130. [PMID: 30406912 PMCID: PMC6394562 DOI: 10.1007/s10803-018-3815-3] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
Abstract
Twenty-seven autistic children and 32 typically developing (TD) peers were questioned about an experienced event after a two-week delay and again after a two-month delay, using the Revised National Institute of Child Health and Human Development (NICHD) Investigative Interview Protocol. Recall prompts elicited more detailed and more accurate responses from children than recognition prompts. Autistic children recalled fewer correct narrative details than TD peers when questioned using open invitations, cued invitations, and directive questions. Nonetheless, they were as accurate as TD peers when responding to all types of prompts. The informativeness and accuracy of children's reports remained unchanged over time. Social support was beneficial when children were interviewed for the first time but not after a longer delay.
Collapse
|
8
|
How children talk about events: Implications for eliciting and analyzing eyewitness reports. DEVELOPMENTAL REVIEW 2019. [DOI: 10.1016/j.dr.2018.12.003] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
9
|
Almeida TS, Lamb ME, Weisblatt EJ. Effects of delay on episodic memory retrieval by children with autism spectrum disorder. APPLIED COGNITIVE PSYCHOLOGY 2019. [DOI: 10.1002/acp.3524] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
| | - Michael E. Lamb
- Department of PsychologyUniversity of Cambridge Cambridge UK
| | | |
Collapse
|
10
|
Henry LA, Crane L, Nash G, Hobson Z, Kirke-Smith M, Wilcock R. Verbal, Visual, and Intermediary Support for Child Witnesses with Autism During Investigative Interviews. J Autism Dev Disord 2017; 47:2348-2362. [PMID: 28502038 PMCID: PMC5509826 DOI: 10.1007/s10803-017-3142-0] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
Three promising investigative interview interventions were assessed in 270 children (age 6-11 years): 71 with autism spectrum disorder (ASD) and 199 who were typically developing (TD). Children received 'Verbal Labels', 'Sketch Reinstatement of Context' or 'Registered Intermediary' interviews designed to improve interview performance without decreasing accuracy. Children with ASD showed no increases in the number of correct details recalled for any of the three interview types (compared to a Best-Practice police interview), whereas TD children showed significant improvements in the Registered Intermediary and Verbal Labels interviews. Findings suggested that children with ASD can perform as well as TD children in certain types of investigative interviews, but some expected benefits (e.g., of Registered Intermediaries) were not apparent in this study.
Collapse
Affiliation(s)
- Lucy A Henry
- Division and Language and Communication Science, City, University of London, 10 Northampton Square, London, EC1V 0HB, UK.
| | - Laura Crane
- Division and Language and Communication Science, City, University of London, 10 Northampton Square, London, EC1V 0HB, UK
- Department of Psychology, Goldsmiths, University of London, New Cross, London, SE14 6NW, UK
- Institute of Education, University College London, London, UK
| | - Gilly Nash
- Division and Language and Communication Science, City, University of London, 10 Northampton Square, London, EC1V 0HB, UK
| | - Zoe Hobson
- Division and Language and Communication Science, City, University of London, 10 Northampton Square, London, EC1V 0HB, UK
- Metropolitan Police Service, London, UK
| | - Mimi Kirke-Smith
- Division and Language and Communication Science, City, University of London, 10 Northampton Square, London, EC1V 0HB, UK
- West Heath School, Ashgrove Road, Sevenoaks, Kent, UK
| | - Rachel Wilcock
- Department of Psychology, University of Winchester, Winchester, SO22 4NR, UK
| |
Collapse
|