Automated analysis of free speech predicts psychosis onset in high-risk youths

A systematic review of artificial intelligence-powered (AI-powered) chatbot intervention for managing chronic illness

BACKGROUND

Utilizing artificial intelligence (AI) in chatbots, especially for chronic diseases, has become increasingly prevalent. These AI-powered chatbots serve as crucial tools for enhancing patient communication, addressing the rising prevalence of chronic conditions, and meeting the growing demand for supportive healthcare applications. However, there is a notable gap in comprehensive reviews evaluating the impact of AI-powered chatbot interventions in healthcare within academic literature. This study aimed to assess user satisfaction, intervention efficacy, and the specific characteristics and AI architectures of chatbot systems designed for chronic diseases.

METHOD

A thorough exploration of the existing literature was undertaken by employing diverse databases such as PubMed MEDLINE, CINAHL, EMBASE, PsycINFO, ACM Digital Library and Scopus. The studies incorporated in this analysis encompassed primary research that employed chatbots or other forms of AI architecture in the context of preventing, treating or rehabilitating chronic diseases. The assessment of bias risk was conducted using Risk of 2.0 Tools.

RESULTS

Seven hundred and eighty-four results were obtained, and subsequently, eight studies were found to align with the inclusion criteria. The intervention methods encompassed health education (n = 3), behaviour change theory (n = 1), stress and coping (n = 1), cognitive behavioural therapy (n = 2) and self-care behaviour (n = 1). The research provided valuable insights into the effectiveness and user-friendliness of AI-powered chatbots in handling various chronic conditions. Overall, users showed favourable acceptance of these chatbots for self-managing chronic illnesses.

CONCLUSIONS

The reviewed studies suggest promising acceptance of AI-powered chatbots for self-managing chronic conditions. However, limited evidence on their efficacy due to insufficient technical documentation calls for future studies to provide detailed descriptions and prioritize patient safety. These chatbots employ natural language processing and multimodal interaction. Subsequent research should focus on evidence-based evaluations, facilitating comparisons across diverse chronic health conditions.

Quantifying abnormal emotion processing: A novel computational assessment method and application in schizophrenia

Abnormal emotion processing is a core feature of schizophrenia spectrum disorders (SSDs) that encompasses multiple operations. While deficits in some areas have been well-characterized, we understand less about abnormalities in the emotion processing that happens through language, which is highly relevant for social life. Here, we introduce a novel method using deep learning to estimate emotion processing rapidly from spoken language, testing this approach in male-identified patients with SSDs (n = 37) and healthy controls (n = 51). Using free responses to evocative stimuli, we derived a measure of appropriateness, or "emotional alignment" (EA). We examined psychometric characteristics of EA and its sensitivity to a single-dose challenge of oxytocin, a neuropeptide shown to enhance the salience of socioemotional information in SSDs. Patients showed impaired EA relative to controls, and impairment correlated with poorer social cognitive skill and more severe motivation and pleasure deficits. Adding EA to a logistic regression model with language-based measures of formal thought disorder (FTD) improved classification of patients versus controls. Lastly, oxytocin administration improved EA but not FTD among patients. While additional validation work is needed, these initial results suggest that an automated assay using spoken language may be a promising approach to assess emotion processing in SSDs.

The contribution of prosody to machine classification of schizophrenia

We show how acoustic prosodic features, such as pitch and gaps, can be used computationally for detecting symptoms of schizophrenia from a single spoken response. We compare the individual contributions of acoustic and previously-employed text modalities to the algorithmic determination whether the speaker has schizophrenia. Our classification results clearly show that we can extract relevant acoustic features better than those textual ones. We find that, when combined with those acoustic features, textual features improve classification only slightly.

Automated linguistic analysis in speech samples of Turkish-speaking patients with schizophrenia-spectrum disorders

Modern natural language processing (NLP) methods provide ways to objectively quantify language disturbances for potential use in diagnostic classification. We performed computerized language analysis in speech samples of 82 Turkish-speaking subjects, including 44 patients with schizophrenia spectrum disorders (SSD) and 38 healthy controls (HC). Exploratory analysis of speech samples involved 16 sentence-level semantic similarity features using SBERT (Sentence Bidirectional Encoder Representation from Text) as well as 8 generic and 8 part-of-speech (POS) features. The random forest classifier using SBERT-derived semantic similarity features achieved a mean accuracy of 85.6 % for the classification of SSD and HC. When semantic similarity features were combined with generic and POS features, the classifier's mean accuracy reached to 86.8 %. Our analysis reflected increased sentence-level semantic similarity scores in SSD. Generic and POS analyses revealed an increase in the use of verbs, proper nouns and pronouns in SSD while our results showed a decrease in the utilization of conjunctions, determiners, and both average and maximum sentence length in SSD compared to HC. Quantitative language features were correlated with the expressive deficit domain of BNSS (Brief Negative Symptom Scale) as well as with the duration of illness. These findings from Turkish-speaking interviews contribute to the growing evidence-based NLP-derived assessments in non-English-speaking patients.

Accelerating Medicines Partnership® Schizophrenia (AMP® SCZ): Rationale and Study Design of the Largest Global Prospective Cohort Study of Clinical High Risk for Psychosis

This article describes the rationale, aims, and methodology of the Accelerating Medicines Partnership® Schizophrenia (AMP® SCZ). This is the largest international collaboration to date that will develop algorithms to predict trajectories and outcomes of individuals at clinical high risk (CHR) for psychosis and to advance the development and use of novel pharmacological interventions for CHR individuals. We present a description of the participating research networks and the data processing analysis and coordination center, their processes for data harmonization across 43 sites from 13 participating countries (recruitment across North America, Australia, Europe, Asia, and South America), data flow and quality assessment processes, data analyses, and the transfer of data to the National Institute of Mental Health (NIMH) Data Archive (NDA) for use by the research community. In an expected sample of approximately 2000 CHR individuals and 640 matched healthy controls, AMP SCZ will collect clinical, environmental, and cognitive data along with multimodal biomarkers, including neuroimaging, electrophysiology, fluid biospecimens, speech and facial expression samples, novel measures derived from digital health technologies including smartphone-based daily surveys, and passive sensing as well as actigraphy. The study will investigate a range of clinical outcomes over a 2-year period, including transition to psychosis, remission or persistence of CHR status, attenuated positive symptoms, persistent negative symptoms, mood and anxiety symptoms, and psychosocial functioning. The global reach of AMP SCZ and its harmonized innovative methods promise to catalyze the development of new treatments to address critical unmet clinical and public health needs in CHR individuals.

Speech based natural language profile before, during and after the onset of psychosis: A cluster analysis

BACKGROUND AND HYPOTHESIS

Speech markers are digitally acquired, computationally derived, quantifiable set of measures that reflect the state of neurocognitive processes relevant for social functioning. "Oddities" in language and communication have historically been seen as a core feature of schizophrenia. The application of natural language processing (NLP) to speech samples can elucidate even the most subtle deviations in language. We aim to determine if NLP based profiles that are distinctive of schizophrenia can be observed across the various clinical phases of psychosis.

DESIGN

Our sample consisted of 147 participants and included 39 healthy controls (HC), 72 with first-episode psychosis (FEP), 18 in a clinical high-risk state (CHR), 18 with schizophrenia (SZ). A structured task elicited 3 minutes of speech, which was then transformed into quantitative measures on 12 linguistic variables (lexical, syntactic, and semantic). Cluster analysis that leveraged healthy variations was then applied to determine language-based subgroups.

RESULTS

We observed a three-cluster solution. The largest cluster included most HC and the majority of patients, indicating a 'typical linguistic profile (TLP)'. One of the atypical clusters had notably high semantic similarity in word choices with less perceptual words, lower cohesion and analytical structure; this cluster was almost entirely composed of patients in early stages of psychosis (EPP - early phase profile). The second atypical cluster had more patients with established schizophrenia (SPP - stable phase profile), with more perceptual but less cognitive/emotional word classes, simpler syntactic structure, and a lack of sufficient reference to prior information (reduced givenness).

CONCLUSION

The patterns of speech deviations in early and established stages of schizophrenia are distinguishable from each other and detectable when lexical, semantic and syntactic aspects are assessed in the pursuit of 'formal thought disorder'.

A new schizophrenia screening instrument based on evaluating the patient's writing

Formal Thought Disorder (FTD) is a defining feature of schizophrenia, which is often assessed through patients' speech. Meanwhile, the written language is less studied. The aim of the present study is to establish and validate a comprehensive clinical screening scale, capturing the full variety of empirical characteristics of writing in patients with schizophrenia. The 16-item Screening Instrument for Schizophrenic Features in Writing (SISFiW) is derived from detailed literature review and a "brainstorming" discussion on 30 samples written by patients with schizophrenia. One hundred and fifty-seven participants (114 patients with an ICD-10 diagnoses of schizophrenia; 43 healthy control subjects) were interviewed and symptoms assessed with the Positive and Negative Syndrome Scale (PANSS) and the Scale for the Assessment of Thought, Language, and Communication (TLC). Article samples written by each participant were rated with the SISFiW. Results demonstrated significant difference of the SISFiW-total between the patient group and healthy controls [(3.61 ± 1.72) vs. (0.49 ± 0.63), t = 16.64, p<0.001]. The inter-rater reliability (weighted kappa = 0.72) and the internal consistency (Cronbach's alpha coefficient = 0.613) were acceptable, but correlations with the criterion (PANSS and TLC) were unremarkable. The ROC analysis indicated a cutoff point at 2 with the maximal sensitivity (93.0 %)/specificity (93.0 %). Discriminant analysis of the SISFiW items yielded 8 classifiers that discriminated between the diagnostic groups at a perfect overall performance (with 90.4 % of original and 88.5 % cross-validated grouped cases classified correctly). This instrument appears to be practicable and reliable, with relatively robust discriminatory power, and may serve as a complementary tool to existing FTD rating scales.

Speech markers to predict and prevent recurrent episodes of psychosis: A narrative overview and emerging opportunities

Preventing relapse in schizophrenia improves long-term health outcomes. Repeated episodes of psychotic symptoms shape the trajectory of this illness and can be a detriment to functional recovery. Despite early intervention programs, high relapse rates persist, calling for alternative approaches in relapse prevention. Predicting imminent relapse at an individual level is critical for effective intervention. While clinical profiles are often used to foresee relapse, they lack the specificity and sensitivity needed for timely prediction. Here, we review the use of speech through Natural Language Processing (NLP) to predict a recurrent psychotic episode. Recent advancements in NLP of speech have shown the ability to detect linguistic markers related to thought disorder and other language disruptions within 2-4 weeks preceding a relapse. This approach has shown to be able to capture individual speech patterns, showing promise in its use as a prediction tool. We outline current developments in remote monitoring for psychotic relapses, discuss the challenges and limitations and present the speech-NLP based approach as an alternative to detect relapses with sufficient accuracy, construct validity and lead time to generate clinical actions towards prevention.

Natural language processing for defining linguistic features in schizophrenia: A sample from Turkish speakers

Natural language processing (NLP) provides fast and accurate extraction of features related to the language of schizophrenia. We utilized NLP methods to test the hypothesis that schizophrenia is associated with altered linguistic features in Turkish, a non-Indo-European language, compared to controls. We also explored whether these possible altered linguistic features were language-dependent or -independent. We extracted and compared speech in schizophrenia (SZ, N = 38) and healthy well-matched control (HC, N = 38) participants using NLP. The analysis was conducted in two parts. In the first one, mean sentence length, total completed words, moving average type-token ratio to measure the lexical diversity, and first-person singular pronoun usage were calculated. In the second one, we used parts-of-speech tagging (POS) and Word2Vec in schizophrenia and control. We found that SZ had lower mean sentence length and moving average type-token ratio but higher use of first-person singular pronoun. All these significant results were correlated with the Thought and Language Disorder Scale score. The POS approach demonstrated that SZ used fewer coordinating conjunctions. Our methodology using Word2Vec detected that SZ had higher semantic similarity than HC and K-Means could differentiate between SZ and HC into two distinct groups with high accuracy, 86.84 %. Our findings showed that altered linguistic features in SZ are mostly language-independent. They are promising to describe language patterns in schizophrenia which proposes that NLP measurements may allow for rapid and objective measurements of linguistic features.

Towards a scalable approach to assess speech organization across the psychosis-spectrum -online assessment in conjunction with automated transcription and extraction of speech measures

Automatically extracted measures of speech constitute a promising marker of psychosis as disorganized speech is associated with psychotic symptoms and predictive of psychosis-onset. The potential of speech markers is, however, hampered by (i) lengthy assessments in laboratory settings and (ii) manual transcriptions. We investigated whether a short, scalable data collection (online) and processing (automated transcription) procedure would provide data of sufficient quality to extract previously validated speech measures. To evaluate the fit of our approach for purpose, we assessed speech in relation to psychotic-like experiences in the general population. Participants completed an 8-minute-long speech task online. Sample 1 included measures of psychometric schizotypy and delusional ideation (N = 446). Sample 2 included a low and high psychometric schizotypy group (N = 144). Recordings were transcribed both automatically and manually, and connectivity, semantic, and syntactic speech measures were extracted for both types of transcripts. 73%/86% participants in sample 1/2 completed the experiment. Nineteen out of 25 speech measures were strongly (r > 0.7) and significantly correlated between automated and manual transcripts in both samples. Amongst the 14 connectivity measures, 11 showed a significant relationship with delusional ideation. For the semantic and syntactic measures, On Topic score and the Frequency of personal pronouns were negatively correlated with both schizotypy and delusional ideation. Combined with demographic information, the speech markers could explain 11-14% of the variation of delusional ideation and schizotypy in Sample 1 and could discriminate between high-low schizotypy with high accuracy (0.72-0.70, AUC = 0.78-0.79) in Sample 2. The moderate to high retention rate, strong correlation of speech measures across manual and automated transcripts and sensitivity to psychotic-like experiences provides initial evidence that online collected speech in combination with automatic transcription is a feasible approach to increase accessibility and scalability of speech-based assessment of psychosis.

Artificial intelligence in positive mental health: a narrative review

The paper reviews the entire spectrum of Artificial Intelligence (AI) in mental health and its positive role in mental health. AI has a huge number of promises to offer mental health care and this paper looks at multiple facets of the same. The paper first defines AI and its scope in the area of mental health. It then looks at various facets of AI like machine learning, supervised machine learning and unsupervised machine learning and other facets of AI. The role of AI in various psychiatric disorders like neurodegenerative disorders, intellectual disability and seizures are discussed along with the role of AI in awareness, diagnosis and intervention in mental health disorders. The role of AI in positive emotional regulation and its impact in schizophrenia, autism spectrum disorders and mood disorders is also highlighted. The article also discusses the limitations of AI based approaches and the need for AI based approaches in mental health to be culturally aware, with structured flexible algorithms and an awareness of biases that can arise in AI. The ethical issues that may arise with the use of AI in mental health are also visited.

Overlapping and distinct phenotypic profiles in Alzheimer's disease and late onset epilepsy: a biologically-based approach

Due to shared hippocampal dysfunction, patients with Alzheimer's dementia and late-onset epilepsy (LOE) report memory decline. Multiple studies have described the epidemiological, pathological, neurophysiological, and behavioral overlap between Alzheimer's Disease and LOE, implying a bi-directional relationship. We describe the neurobiological decline occurring at different spatial in AD and LOE patients, which may explain why their phenotypes overlap and differ. We provide suggestions for clinical recognition of dual presentation and novel approaches for behavioral testing that reflect an "inside-out," or biologically-based approach to testing memory. New memory and language assessments could detect-and treat-memory impairment in AD and LOE at an earlier, actionable stage.

Artificial intelligence significantly facilitates development in the mental health of college students: a bibliometric analysis

Objective

College students are currently grappling with severe mental health challenges, and research on artificial intelligence (AI) related to college students mental health, as a crucial catalyst for promoting psychological well-being, is rapidly advancing. Employing bibliometric methods, this study aim to analyze and discuss the research on AI in college student mental health.

Methods

Publications pertaining to AI and college student mental health were retrieved from the Web of Science core database. The distribution of publications were analyzed to gage the predominant productivity. Data on countries, authors, journal, and keywords were analyzed using VOSViewer, exploring collaboration patterns, disciplinary composition, research hotspots and trends.

Results

Spanning 2003 to 2023, the study encompassed 1722 publications, revealing notable insights: (1) a gradual rise in annual publications, reaching its zenith in 2022; (2) Journal of Affective Disorders and Psychiatry Research emerged were the most productive and influential sources in this field, with significant contributions from China, the United States, and their affiliated higher education institutions; (3) the primary mental health issues were depression and anxiety, with machine learning and AI having the widest range of applications; (4) an imperative for enhanced international and interdisciplinary collaboration; (5) research hotspots exploring factors influencing college student mental health and AI applications.

Conclusion

This study provides a succinct yet comprehensive overview of this field, facilitating a nuanced understanding of prospective applications of AI in college student mental health. Professionals can leverage this research to discern the advantages, risks, and potential impacts of AI in this critical field.

Navigating the semantic space: Unraveling the structure of meaning in psychosis using different computational language models

Speech in psychosis has long been ascribed as involving 'loosening of associations'. We pursued the aim to elucidate its underlying cognitive mechanisms by analysing picture descriptions from 94 subjects (29 healthy controls, 18 participants at clinical high risk, 29 with first-episode psychosis, and 18 with chronic schizophrenia), using five language models with different computational architectures: FastText, which represents meaning non-contextually/statically; BERT, which represents contextual meaning sensitive to grammar and context; Infersent and SBERT, which provide sentential representations; and CLIP, which evaluates speech relative to a visual stimulus. These models were used to quantify semantic distances crossed between successive tokens/sentences, and semantic perplexity indicating unexpectedness in continuations. Results showed that, among patients, semantic similarity increased when measured with FastText, Infersent, and SBERT, while it decreased with CLIP and BERT. Higher perplexity was observed in first-episode psychosis. Static semantic measures were associated with clinically measured impoverishment of thought and referential semantic measures with disorganization. These patterns indicate a shrinking conceptual semantic space as represented by static language models, which co-occurs with a widening in the referential semantic space as represented by contextual models. This duality underlines the need to separate these two forms of meaning for understanding mechanisms involved in semantic change in psychosis.

Ethical and regulatory challenges of AI technologies in healthcare: A narrative review

Over the past decade, there has been a notable surge in AI-driven research, specifically geared toward enhancing crucial clinical processes and outcomes. The potential of AI-powered decision support systems to streamline clinical workflows, assist in diagnostics, and enable personalized treatment is increasingly evident. Nevertheless, the introduction of these cutting-edge solutions poses substantial challenges in clinical and care environments, necessitating a thorough exploration of ethical, legal, and regulatory considerations. A robust governance framework is imperative to foster the acceptance and successful implementation of AI in healthcare. This article delves deep into the critical ethical and regulatory concerns entangled with the deployment of AI systems in clinical practice. It not only provides a comprehensive overview of the role of AI technologies but also offers an insightful perspective on the ethical and regulatory challenges, making a pioneering contribution to the field. This research aims to address the current challenges in digital healthcare by presenting valuable recommendations for all stakeholders eager to advance the development and implementation of innovative AI systems.

Developmental perspectives on the origins of psychotic disorders: The need for a transdiagnostic approach

Research on serious mental disorders, particularly psychosis, has revealed highly variable symptom profiles and developmental trajectories prior to illness-onset. As Dante Cicchetti pointed out decades before the term "transdiagnostic" was widely used, the pathways to psychopathology emerge in a system involving equifinality and multifinality. Like most other psychological disorders, psychosis is associated with multiple domains of risk factors, both genetic and environmental, and there are many transdiagnostic developmental pathways that can lead to psychotic syndromes. In this article, we discuss our current understanding of heterogeneity in the etiology of psychosis and its implications for approaches to conceptualizing etiology and research. We highlight the need for examining risk factors at multiple levels and to increase the emphasis on transdiagnostic developmental trajectories as a key variable associated with etiologic subtypes. This will be increasingly feasible now that large, longitudinal datasets are becoming available and researchers have access to more sophisticated analytic tools, such as machine learning, which can identify more homogenous subtypes with the ultimate goal of enhancing options for treatment and preventive intervention.

Meta-analysis of the relationship between metacognition and disorganized symptoms in psychosis

OBJECTIVE

Disorganized symptoms show associations with metacognitive deficits in psychosis. However, the magnitude of this relationship is unclear. This meta-analysis aimed to 1) quantify relationships between metacognition and both disorganized symptoms and disorganized speech; and 2) examine moderators of these relationships (e.g., metacognition type, neurocognition).

METHOD

A literature search was conducted using PsycINFO, Web of Science, PubMed, and EMBASE databases. English-language studies measuring disorganized symptoms and metacognition (i.e., introspective accuracy, metacognitive beliefs, or metacognitive capacity) in psychosis were included. Random effects meta-analyses were conducted using Pearson's r.

RESULTS

Meta-analysis of 20 studies (n = 1490) resulted in a significant negative medium correlation between disorganized symptoms and metacognition (r = -0.332, 95 % CI [-0.423, -0.235]). Magnitude was moderated by metacognition type. A significant negative small correlation between disorganized speech and metacognition (r = -0.173, 95 % CI [-0.254, -0.089], n = 1470) was observed, with no significant moderators.

CONCLUSIONS

Results clarify the magnitude of the relationships between metacognition and both disorganized symptoms and disorganized speech. Significant relationships may indicate conceptual links, yet the different magnitudes may reflect a distinction between disorganized symptoms and speech. The moderator finding highlights that metacognitive capacity has an especially strong link to disorganized symptoms and underscores the need for careful distinction between types of metacognition in future work.

Automated analysis of speech as a marker of sub-clinical psychotic experiences

Automated speech analysis techniques, when combined with artificial intelligence and machine learning, show potential in capturing and predicting a wide range of psychosis symptoms, garnering attention from researchers. These techniques hold promise in predicting the transition to clinical psychosis from at-risk states, as well as relapse or treatment response in individuals with clinical-level psychosis. However, challenges in scientific validation hinder the translation of these techniques into practical applications. Although sub-clinical research could aid to tackle most of these challenges, there have been only few studies conducted in speech and psychosis research in non-clinical populations. This work aims to facilitate this work by summarizing automated speech analytical concepts and the intersection of this field with psychosis research. We review psychosis continuum and sub-clinical psychotic experiences, and the benefits of researching them. Then, we discuss the connection between speech and psychotic symptoms. Thirdly, we overview current and state-of-the art approaches to the automated analysis of speech both in terms of language use (text-based analysis) and vocal features (audio-based analysis). Then, we review techniques applied in subclinical population and findings in these samples. Finally, we discuss research challenges in the field, recommend future research endeavors and outline how research in subclinical populations can tackle the listed challenges.

Language and communication rehabilitation in patients with schizophrenia: A narrative review

Language impairments often appear in patients with schizophrenia and are potential targets for rehabilitation. Clinical practice and research should be intimately connected. The aim was to perform a narrative review of the assessment and intervention tools that have been used for the rehabilitation of schizophrenia patients with language and communication impairments. Two types of tools, general and specific, were developed for both purposes. General tools include the Positive and Negative Syndrome Scale for assessment, and the Integrated Psychological Therapy for intervention. The specific tools used to evaluate language and communication impairments include the Scale for the Assessment of Thought, Language and Communication, the Formal Thought Disorder scales (for caregivers and patients), and the Thought and Language Disorder scale. The most recent language-specific intervention tools include the Cognitive Pragmatic Treatment, Conecta-2, Let's talk! Multimodal Speech-Gesture training, Speech Therapy Intervention Group, and PragmaCom. These tools primarily involve psychopathology/psychiatry, psychology, linguistics, speech and language therapy, and nursing. In conclusion, a wide range of assessment and intervention tools are available for the rehabilitation of language and communication impairments associated with schizophrenia. An integrative and interdisciplinary approach should always be considered for rehabilitation of language and communication in patients with schizophrenia throughout their lifetime.

The Influence of Using Novel Predictive Technologies on Judgments of Stigma, Empathy, and Compassion among Healthcare Professionals

BACKGROUND

Our objective was to evaluate whether the description of a machine learning (ML) app or brain imaging technology to predict the onset of schizophrenia or alcohol use disorder (AUD) influences healthcare professionals' judgments of stigma, empathy, and compassion.

METHODS

We randomized healthcare professionals (N = 310) to one vignette about a person whose clinician seeks to predict schizophrenia or an AUD, using a ML app, brain imaging, or a psychosocial assessment. Participants used scales to measure their judgments of stigma, empathy, and compassion.

RESULTS

Participants randomized to the ML vignette endorsed less anger and more fear relative to the psychosocial vignette, and the brain imaging vignette elicited higher pity ratings. The brain imaging and ML vignettes evoked lower personal responsibility judgments compared to the psychosocial vignette. Physicians and nurses reported less empathy than clinical psychologists.

CONCLUSIONS

The use of predictive technologies may reinforce essentialist views about mental health and substance use that may increase specific aspects of stigma and reduce others.

The underuse of AI in the health sector: Opportunity costs, success stories, risks and recommendations

Purpose

This contribution explores the underuse of artificial intelligence (AI) in the health sector, what this means for practice, and how much the underuse can cost. Attention is drawn to the relevance of an issue that the European Parliament has outlined as a "major threat" in 2020. At its heart is the risk that research and development on trusted AI systems for medicine and digital health will pile up in lab centers without generating further practical relevance. Our analysis highlights why researchers, practitioners and especially policymakers, should pay attention to this phenomenon.

Methods

The paper examines the ways in which governments and public agencies are addressing the underuse of AI. As governments and international organizations often acknowledge the limitations of their own initiatives, the contribution explores the causes of the current issues and suggests ways to improve initiatives for digital health.

Results

Recommendations address the development of standards, models of regulatory governance, assessment of the opportunity costs of underuse of technology, and the urgency of the problem.

Conclusions

The exponential pace of AI advances and innovations makes the risks of underuse of AI increasingly threatening.

Graphical Abstract

How Can Digital Mental Health Enhance Psychiatry?

The use of digital technologies is constantly growing around the world. The wider-spread adoption of digital technologies and solutions in the daily clinical practice in psychiatry seems to be a question of when, not if. We propose a synthesis of the scientific literature on digital technologies in psychiatry and discuss the main aspects of its possible uses and interests in psychiatry according to three domains of influence that appeared to us: 1) assist and improve current care: digital psychiatry allows for more people to have access to care by simply being more accessible but also by being less stigmatized and more convenient; 2) develop new treatments: digital psychiatry allows for new treatments to be distributed via apps, and practical guidelines can reduce ethical challenges and increase the efficacy of digital tools; and 3) produce scientific and medical knowledge: digital technologies offer larger and more objective data collection, allowing for more detection and prevention of symptoms. Finally, ethical and efficacy issues remain, and some guidelines have been put forth on how to safely use these solutions and prepare for the future.

Healthcare students' knowledge, attitudes, and perspectives toward artificial intelligence in the southern Vietnam

The application of new technologies in medical education still lags behind the extraordinary advances of AI. This study examined the understanding, attitudes, and perspectives of Vietnamese medical students toward AI and its consequences, as well as their knowledge of existing AI operations in Vietnam. A cross-sectional online survey was administered to 1142 students enrolled in undergraduate medicine and pharmacy programs. Most of the participants had no understanding of AI in healthcare (1053 or 92.2 %). The majority believed that AI would benefit their careers (890 or 77.9 %) and that such innovation will be used to oversee public health and epidemic prevention on their behalf (882 or 77.2 %). The proportion of students with satisfactory knowledge significantly differed depending on gender (P < 0.001), major (P = 0.003), experience (P < 0.001), and income (P = 0.011). The percentage of respondents with positive attitudes significantly differed by year level (P = 0.008) and income (P = 0.003), and the proportion with favorable perspectives regarding AI varied considerably by age (P = 0.046) and major (P < 0.001). Most of the participants wanted to integrate AI into radiology and digital imaging training (P = 0.283), while the fifth-year students wished to learn about AI in medical genetics and genomics (P < 0.001, 4.0 ± 0.8). The male students had 1.898 times more adequate knowledge of AI than their female counterparts, and those who had attended webinars/lectures/courses on AI in healthcare had 4.864 times more adequate knowledge than those having no such experiences. The majority believed that the barrier to implementing AI in healthcare is the lack of financial resources (83.54 %) and appropriate training (81.00 %). Participants saw AI as a "partner" rather than a "competitor", but the majority of low knowledge was recorded. Future research should take into account the way to integrate AI into medical training programs for healthcare students.

Neurophysiological explorations across the spectrum of psychosis, autism, and depression, during wakefulness and sleep: protocol of a prospective case-control transdiagnostic multimodal study (DEMETER)

BACKGROUND

Quantitative electroencephalography (EEG) analysis offers the opportunity to study high-level cognitive processes across psychiatric disorders. In particular, EEG microstates translate the temporal dynamics of neuronal networks throughout the brain. Their alteration may reflect transdiagnostic anomalies in neurophysiological functions that are impaired in mood, psychosis, and autism spectrum disorders, such as sensorimotor integration, speech, sleep, and sense of self. The main questions this study aims to answer are as follows: 1) Are EEG microstate anomalies associated with clinical and functional prognosis, both in resting conditions and during sleep, across psychiatric disorders? 2) Are EEG microstate anomalies associated with differences in sensorimotor integration, speech, sense of self, and sleep? 3) Can the dynamic of EEG microstates be modulated by a non-drug intervention such as light hypnosis?

METHODS

This prospective cohort will include a population of adolescents and young adults, aged 15 to 30 years old, with ultra-high-risk of psychosis (UHR), first-episode psychosis (FEP), schizophrenia (SCZ), autism spectrum disorder (ASD), and major depressive disorder (MDD), as well as healthy controls (CTRL) (N = 21 × 6), who will be assessed at baseline and after one year of follow-up. Participants will undergo deep phenotyping based on psychopathology, neuropsychological assessments, 64-channel EEG recordings, and biological sampling at the two timepoints. At baseline, the EEG recording will also be coupled to a sensorimotor task and a recording of the characteristics of their speech (prosody and turn-taking), a one-night polysomnography, a self-reference effect task in virtual reality (only in UHR, FEP, and CTRL). An interventional ancillary study will involve only healthy controls, in order to assess whether light hypnosis can modify the EEG microstate architecture in a direction opposite to what is seen in disease.

DISCUSSION

This transdiagnostic longitudinal case-control study will provide a multimodal neurophysiological assessment of clinical dimensions (sensorimotor integration, speech, sleep, and sense of self) that are disrupted across mood, psychosis, and autism spectrum disorders. It will further test the relevance of EEG microstates as dimensional functional biomarkers.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier NCT06045897.

Trajectories through semantic spaces in schizophrenia and the relationship to ripple bursts

Human cognition is underpinned by structured internal representations that encode relationships between entities in the world (cognitive maps). Clinical features of schizophrenia-from thought disorder to delusions-are proposed to reflect disorganization in such conceptual representations. Schizophrenia is also linked to abnormalities in neural processes that support cognitive map representations, including hippocampal replay and high-frequency ripple oscillations. Here, we report a computational assay of semantically guided conceptual sampling and exploit this to test a hypothesis that people with schizophrenia (PScz) exhibit abnormalities in semantically guided cognition that relate to hippocampal replay and ripples. Fifty-two participants [26 PScz (13 unmedicated) and 26 age-, gender-, and intelligence quotient (IQ)-matched nonclinical controls] completed a category- and letter-verbal fluency task, followed by a magnetoencephalography (MEG) scan involving a separate sequence-learning task. We used a pretrained word embedding model of semantic similarity, coupled to a computational model of word selection, to quantify the degree to which each participant's verbal behavior was guided by semantic similarity. Using MEG, we indexed neural replay and ripple power in a post-task rest session. Across all participants, word selection was strongly influenced by semantic similarity. The strength of this influence showed sensitivity to task demands (category > letter fluency) and predicted performance. In line with our hypothesis, the influence of semantic similarity on behavior was reduced in schizophrenia relative to controls, predicted negative psychotic symptoms, and correlated with an MEG signature of hippocampal ripple power (but not replay). The findings bridge a gap between phenomenological and neurocomputational accounts of schizophrenia.

Digital Phenotyping: Data-Driven Psychiatry to Redefine Mental Health

The term "digital phenotype" refers to the digital footprint left by patient-environment interactions. It has potential for both research and clinical applications but challenges our conception of health care by opposing 2 distinct approaches to medicine: one centered on illness with the aim of classifying and curing disease, and the other centered on patients, their personal distress, and their lived experiences. In the context of mental health and psychiatry, the potential benefits of digital phenotyping include creating new avenues for treatment and enabling patients to take control of their own well-being. However, this comes at the cost of sacrificing the fundamental human element of psychotherapy, which is crucial to addressing patients' distress. In this viewpoint paper, we discuss the advances rendered possible by digital phenotyping and highlight the risk that this technology may pose by partially excluding health care professionals from the diagnosis and therapeutic process, thereby foregoing an essential dimension of care. We conclude by setting out concrete recommendations on how to improve current digital phenotyping technology so that it can be harnessed to redefine mental health by empowering patients without alienating them.

Speech as a Graph: Developmental Perspectives on the Organization of Spoken Language

Language has been used as a privileged window to investigate mental processes. More recently, descriptions of psychopathological symptoms have been analyzed with the help of natural language processing tools. An example is the study of speech organization using graph theoretical approaches that began approximately 10 years ago. After its application in different areas, there is a need to better characterize what aspects can be associated with typical and atypical behavior throughout the lifespan, given the variables related to aging as well as biological and social contexts. The precise quantification of mental processes assessed through language may allow us to disentangle biological/social markers by looking at naturalistic protocols in different contexts. In this review, we discuss 10 years of studies in which word recurrence graphs were adopted to characterize the chain of thoughts expressed by individuals while producing discourse. Initially developed to understand formal thought disorder in the context of psychotic syndromes, this line of research has been expanded to understand the atypical development in different stages of psychosis and differential diagnosis (such as dementia) as well as the typical development of thought organization in school-age children/teenagers in naturalistic and school-based protocols. We comment on the effects of environmental factors, such as education and reading habits (in monolingual and bilingual contexts), in clinical and nonclinical populations at different developmental stages (from childhood to older adulthood, considering aging effects on cognition). Looking toward the future, there is an opportunity to use word recurrence graphs to address complex questions that consider biological/social factors within a developmental perspective in typical and atypical contexts.

Theory-Driven Analysis of Natural Language Processing Measures of Thought Disorder Using Generative Language Modeling

BACKGROUND

Natural language processing (NLP) holds promise to transform psychiatric research and practice. A pertinent example is the success of NLP in the automatic detection of speech disorganization in formal thought disorder (FTD). However, we lack an understanding of precisely what common NLP metrics measure and how they relate to theoretical accounts of FTD. We propose tackling these questions by using deep generative language models to simulate FTD-like narratives by perturbing computational parameters instantiating theory-based mechanisms of FTD.

METHODS

We simulated FTD-like narratives using Generative-Pretrained-Transformer-2 by either increasing word selection stochasticity or limiting the model's memory span. We then examined the sensitivity of common NLP measures of derailment (semantic distance between consecutive words or sentences) and tangentiality (how quickly meaning drifts away from the topic) in detecting and dissociating the 2 underlying impairments.

RESULTS

Both parameters led to narratives characterized by greater semantic distance between consecutive sentences. Conversely, semantic distance between words was increased by increasing stochasticity, but decreased by limiting memory span. An NLP measure of tangentiality was uniquely predicted by limited memory span. The effects of limited memory span were nonmonotonic in that forgetting the global context resulted in sentences that were semantically closer to their local, intermediate context. Finally, different methods for encoding the meaning of sentences varied dramatically in performance.

CONCLUSIONS

This work validates a simulation-based approach as a valuable tool for hypothesis generation and mechanistic analysis of NLP markers in psychiatry. To facilitate dissemination of this approach, we accompany the paper with a hands-on Python tutorial.

Toolkit to Examine Lifelike Language (TELL): An app to capture speech and language markers of neurodegeneration

Automated speech and language analysis (ASLA) is a promising approach for capturing early markers of neurodegenerative diseases. However, its potential remains underexploited in research and translational settings, partly due to the lack of a unified tool for data collection, encryption, processing, download, and visualization. Here we introduce the Toolkit to Examine Lifelike Language (TELL) v.1.0.0, a web-based app designed to bridge such a gap. First, we outline general aspects of its development. Second, we list the steps to access and use the app. Third, we specify its data collection protocol, including a linguistic profile survey and 11 audio recording tasks. Fourth, we describe the outputs the app generates for researchers (downloadable files) and for clinicians (real-time metrics). Fifth, we survey published findings obtained through its tasks and metrics. Sixth, we refer to TELL's current limitations and prospects for expansion. Overall, with its current and planned features, TELL aims to facilitate ASLA for research and clinical aims in the neurodegeneration arena. A demo version can be accessed here:  https://demo.sci.tellapp.org/ .

Multimodal Assessment of Schizophrenia Symptom Severity From Linguistic, Acoustic and Visual Cues

Assessing the condition of every schizophrenia patient correctly normally requires lengthy and frequent interviews with professionally trained doctors. To alleviate the time and manual burden on those mental health professionals, this paper proposes a multimodal assessment model that predicts the severity level of each symptom defined in Scale for the Assessment of Thought, Language, and Communication (TLC) and Positive and Negative Syndrome Scale (PANSS) based on the patient's linguistic, acoustic, and visual behavior. The proposed deep-learning model consists of a multimodal fusion framework and four unimodal transformer-based backbone networks. The second-stage pre-training is introduced to make each off-the-shelf pre-trained model learn the pattern of schizophrenia data more effectively. It learns to extract the desired features from the view of its modality. Next, the pre-trained parameters are frozen, and the light-weight trainable unimodal modules are inserted and fine-tuned to keep the number of parameters low while maintaining the superb performance simultaneously. Finally, the four adapted unimodal modules are fused into a final multimodal assessment model through the proposed multimodal fusion framework. For the purpose of validation, we train and evaluate the proposed model on schizophrenia patients recruited from National Taiwan University Hospital, whose performance achieves 0.534/0.685 in MAE/MSE, outperforming the related works in the literature. Through the experimental results and ablation studies, as well as the comparison with other related multimodal assessment works, our approach not only demonstrates the superiority of our performance but also the effectiveness of our approach to extract and integrate information from multiple modalities.

Linguistic correlates of suicidal ideation in youth at clinical high-risk for psychosis

Suicidal ideation (SI) is prevalent among individuals at clinical high-risk for psychosis (CHR). Natural language processing (NLP) provides an efficient method to identify linguistic markers of suicidality. Prior work has demonstrated that an increased use of "I", as well as words with semantic similarity to "anger", "sadness", "stress" and "lonely", are correlated with SI in other cohorts. The current project analyzes data collected in an SI supplement to an NIH R01 study of thought disorder and social cognition in CHR. This study is the first to use NLP analyses of spoken language to identify linguistic correlates of recent suicidal ideation among CHR individuals. The sample included 43 CHR individuals, 10 with recent suicidal ideation and 33 without, as measured by the Columbia-Suicide Severity Rating Scale, as well as 14 healthy volunteers without SI. NLP methods include part-of-speech (POS) tagging, a GoEmotions-trained BERT Model, and Zero-Shot Learning. As hypothesized, individuals at CHR for psychosis who endorsed recent SI utilized more words with semantic similarity to "anger" compared to those who did not. Words with semantic similarity to "stress", "loneliness", and "sadness" were not significantly different between the two CHR groups. Contrary to our hypotheses, CHR individuals with recent SI did not use the word "I" more than those without recent SI. As anger is not characteristic of CHR, findings have implications for the consideration of subthreshold anger-related sentiment in suicidal risk assessment. As NLP is scalable, findings suggest that language markers may improve suicide screening and prediction in this population.

Assessing coherence through linguistic connectives: Analysis of speech in patients with schizophrenia-spectrum disorders

BACKGROUND

Incoherent speech is a core diagnostic symptom of schizophrenia-spectrum disorders (SSD) that can be studied using semantic space models. Since linguistic connectives signal relations between words, they and their surrounding words might represent linguistic loci to detect unusual coherence in speech. Therefore, we investigated whether connectives' measures are useful to assess incoherent speech in SSD.

METHODS

Connectives and their surrounding words were extracted from transcripts of spontaneous speech of 50 SSD-patients and 50 control participants. Using word2vec, two different cosine similarities were calculated: those of connectives and their surrounding words (connectives-related similarity), and those of free-of-connectives words-chunks (non-connectives similarity). Differences between groups in proportion of five types of connectives were assessed using generalized logistic models, and connectives-related similarity was analyzed through non-parametric multivariate analysis of variance. These features were evaluated in classification tasks to differentiate between groups.

RESULTS

SSD-patients used less contingency (e.g., because) (p = .008) and multiclass connectives (e.g., as) (p < .001) than control participants. SSD-patients had higher minimum similarity of multiclass (adj-p = .04) and temporality connectives (e.g., after) (adj-p < .001), narrower similarity-range of expansion (e.g., and) (adj-p = .002) and multiclass connectives (adj-p = .04), and lower maximum similarity of expansion connectives (adj-p = .005). Using connectives' features alone, SSD-patients and controls could be distinguished with 85 % accuracy.

DISCUSSION

Our results show that SSD-speech can be distinguished from speech of control participants with high accuracy, based solely on connectives' features. We conclude that including connectives could strengthen computational models to categorize SSD.

Towards a temporospatial framework for measurements of disorganization in speech using semantic vectors

Incoherent speech in schizophrenia has long been described as the mind making "leaps" of large distances between thoughts and ideas. Such a view seems intuitive, and for almost two decades, attempts to operationalize these conceptual "leaps" in spoken word meanings have used language-based embedding spaces. An embedding space represents meaning of words as numerical vectors where a greater proximity between word vectors represents more shared meaning. However, there are limitations with word vector-based operationalizations of coherence which can limit their appeal and utility in clinical practice. First, the use of esoteric word embeddings can be conceptually hard to grasp, and this is complicated by several different operationalizations of incoherent speech. This problem can be overcome by a better visualization of methods. Second, temporal information from the act of speaking has been largely neglected since models have been built using written text, yet speech is spoken in real time. This issue can be resolved by leveraging time stamped transcripts of speech. Third, contextual information - namely the situation of where something is spoken - has often only been inferred and never explicitly modeled. Addressing this situational issue opens up new possibilities for models with increased temporal resolution and contextual relevance. In this paper, direct visualizations of semantic distances are used to enable the inspection of examples of incoherent speech. Some common operationalizations of incoherence are illustrated, and suggestions are made for how temporal and spatial contextual information can be integrated in future implementations of measures of incoherence.

Reflections on the nature of measurement in language-based automated assessments of patients' mental state and cognitive function

Modern advances in computational language processing methods have enabled new approaches to the measurement of mental processes. However, the field has primarily focused on model accuracy in predicting performance on a task or a diagnostic category. Instead the field should be more focused on determining which computational analyses align best with the targeted neurocognitive/psychological functions that we want to assess. In this paper we reflect on two decades of experience with the application of language-based assessment to patients' mental state and cognitive function by addressing the questions of what we are measuring, how it should be measured and why we are measuring the phenomena. We address the questions by advocating for a principled framework for aligning computational models to the constructs being assessed and the tasks being used, as well as defining how those constructs relate to patient clinical states. We further examine the assumptions that go into the computational models and the effects that model design decisions may have on the accuracy, bias and generalizability of models for assessing clinical states. Finally, we describe how this principled approach can further the goal of transitioning language-based computational assessments to part of clinical practice while gaining the trust of critical stakeholders.

Referential noun phrases distribute differently in Turkish speakers with schizophrenia

In all human languages, noun phrases (NPs) (e.g., 'a field', 'the woman with a book') are used to identify entities in discourse. Previous evidence has shown that the spontaneous speech of patients with schizophrenia (Sz) shows differences in the distribution of grammatically different types of NPs, which are in part specific to patients with formal thought disorder (FTD). Here we sought to provide the first evidence of related grammatical effects in a non-Indo-European language. Results from a picture description task in a sample of 16 Turkish speakers with FTD (+FTD), 15 without FTD (-FTD), and 27 controls revealed that relative to controls, people with Sz over-produced NPs that are 'bare' (in the sense of lacking any grammatical items such as the or a in English). The +FTD group generally showed stronger effects than -FTD, and used more pronouns and less NPs co-referring with previously mentioned NPs. In addition, the dynamic distribution of NP types over narrative time showed an effect of increased mean distance between definite NPs in -FTD relative to controls. In +FTD but no other group there was an unexpected random distribution of indefinite DPs. Incidence rates of referential anomalies increased from controls to the -FTD and +FTD groups. These findings further confirm that Sz is manifest through specific linguistic effects in the referential structure of meaning as mediated by grammar. They provide a linguistic baseline for neurocognitive models of FTD and help to define appropriate targets for the automatic extraction of linguistic features to classify psychotic speech.

Syntactic complexity of spoken language in the diagnosis of schizophrenia: A probabilistic Bayes network model

In the clinical linguistics of schizophrenia, syntactic complexity has received much attention. In this study, we address whether syntactic complexity deteriorates within the six months following the first episode of psychosis in those who develop a diagnosis of schizophrenia. We collected data from a cohort of twenty-six first-episode psychosis and 12 healthy control subjects using the Thought and Language Index interview in response to three pictures from the Thematic Apperception Test at first assessment and after six months (the time of consensus diagnosis). An automated labeling (part-of-speech tagging) for specific syntactic elements calculated large and granular syntactic complexity indices with a focus on clause complexity as a particular case from this spoken language data. Probabilistic reasoning leveraging the conditional independence properties of Bayes networks revealed that consensus diagnosis of schizophrenia predicted a decrease in nominal subjects per clause among individuals with first episode psychosis. From the entire sample, we estimate a 95.4 % probability that a 50 % decrease in mean nominal subjects per clause after six months is explained by the presence of first episode psychosis. Among those with psychosis, a 30 % decrease in this clause-complexity index after six months of experiencing the first episode predicted with 95 % probability a consensus diagnosis of schizophrenia, representing a conditional relationship between a longitudinal decrease in syntactic complexity and a diagnosis of schizophrenia. We conclude that an early drift towards linguistic disorganization/impoverishment of clause complexity-at the granular level of nominal subject per clause-is a distinctive feature of schizophrenia that decreases longitudinally, thus differentiating schizophrenia from other psychotic illnesses with shared phenomenology.

Linguistic and non-linguistic markers of disorganization in psychotic illness

BACKGROUND

Disorganization, presenting as impairment in thought, language and goal-directed behavior, is a core multidimensional syndrome of psychotic disorders. This study examined whether scalable computational measures of spoken language, and smartphone usage pattern, could serve as digital biomarkers of clinical disorganization symptoms.

METHODS

We examined in a longitudinal cohort of adults with a psychotic disorder, the associations between clinical measures of disorganization and computational measures of 1) spoken language derived from monthly, semi-structured, recorded clinical interviews; and 2) smartphone usage pattern derived via passive sensing technologies over the month prior to the interview. The language features included speech quantity, rate, fluency, and semantic regularity. The smartphone features included data missingness and phone usage during sleep time. The clinical measures consisted of the Positive and Negative Symptom Scale (PANSS) conceptual disorganization, difficulty in abstract thinking, and poor attention, items. Mixed linear regression analyses were used to estimate both fixed and random effects.

RESULTS

Greater severity of clinical symptoms of conceptual disorganization was associated with greater verbosity and more disfluent speech. Greater severity of conceptual disorganization was also associated with greater missingness of smartphone data, and greater smartphone usage during sleep time. While the observed associations were significant across the group, there was also significant variation between individuals.

CONCLUSIONS

The findings suggest that digital measures of speech disfluency may serve as scalable markers of conceptual disorganization. The findings warrant further investigation into the use of recorded interviews and passive sensing technologies to assist in the characterization and tracking of psychotic illness.

The SPEAK study rationale and design: A linguistic corpus-based approach to understanding thought disorder

AIM

Psychotic symptoms are typically measured using clinical ratings, but more objective and sensitive metrics are needed. Hence, we will assess thought disorder using the Research Domain Criteria (RDoC) heuristic for language production, and its recommended paradigm of "linguistic corpus-based analyses of language output". Positive thought disorder (e.g., tangentiality and derailment) can be assessed using word-embedding approaches that assess semantic coherence, whereas negative thought disorder (e.g., concreteness, poverty of speech) can be assessed using part-of-speech (POS) tagging to assess syntactic complexity. We aim to establish convergent validity of automated linguistic metrics with clinical ratings, assess normative demographic variance, determine cognitive and functional correlates, and replicate their predictive power for psychosis transition among at-risk youths.

METHODS

This study will assess language production in 450 English-speaking individuals in Australia and Canada, who have recent onset psychosis, are at clinical high risk (CHR) for psychosis, or who are healthy volunteers, all well-characterized for cognition, function and symptoms. Speech will be elicited using open-ended interviews. Audio files will be transcribed and preprocessed for automated natural language processing (NLP) analyses of coherence and complexity. Data analyses include canonical correlation, multivariate linear regression with regularization, and machine-learning classification of group status and psychosis outcome.

CONCLUSIONS

This prospective study aims to characterize language disturbance across stages of psychosis using computational approaches, including psychometric properties, normative variance and clinical correlates, important for biomarker development. SPEAK will create a large archive of language data available to other investigators, a rich resource for the field.

Clinical and computational speech measures are associated with social cognition in schizophrenia spectrum disorders

In this study, we compared three domains of social cognition (emotion processing, mentalizing, and attribution bias) to clinical and computational language measures in 63 participants with schizophrenia spectrum disorders. Based on the active inference model for discourse, we hypothesized that emotion processing and mentalizing, but not attribution bias, would be related to language disturbances. Clinical ratings for speech disturbance assessed disorganized and underproductive dimensions. Computational features included speech graph metrics, use of modal verbs, use of first-person pronouns, cosine similarity of adjacent utterances, and measures of sentiment; these were represented by four principal components. We found that higher clinical ratings for disorganized speech were predicted by greater impairments in both emotion processing and mentalizing, and that these relationships remained significant when accounting for demographic variables, overall psychosis symptoms, and verbal ability. Similarly, a computational speech component reflecting insular speech was consistently predicted by impairment in emotion processing. There were notable trends for computational speech components reflecting underproductive speech and decreased content-rich speech predicting mentalizing ability. Exploratory longitudinal analyses in a small subset of participants (n = 17) found that improvements in both emotion processing and mentalizing predicted improvements in disorganized speech. Attribution bias did not demonstrate strong relationships with language measures. Altogether, our findings are consistent with the active inference model of discourse and suggest greater emphasis on treatments that target social cognitive and language systems.

Speech disturbances in schizophrenia: Assessing cross-linguistic generalizability of NLP automated measures of coherence

INTRODUCTION

Language disorders - disorganized and incoherent speech in particular - are distinctive features of schizophrenia. Natural language processing (NLP) offers automated measures of incoherent speech as promising markers for schizophrenia. However, the scientific and clinical impact of NLP markers depends on their generalizability across contexts, samples, and languages, which we systematically assessed in the present study relying on a large, novel, cross-linguistic corpus.

METHODS

We collected a Danish (DK), German (GE), and Chinese (CH) cross-linguistic dataset involving transcripts from 187 participants with schizophrenia (111DK, 25GE, 51CH) and 200 matched controls (129DK, 29GE, 42CH) performing the Animated Triangles Task. Fourteen previously published NLP coherence measures were calculated, and between-groups differences and association with symptoms were tested for cross-linguistic generalizability.

RESULTS

One coherence measure, i.e. second-order coherence, robustly generalized across samples and languages. We found several language-specific effects, some of which partially replicated previous findings (lower coherence in German and Chinese patients), while others did not (higher coherence in Danish patients). We found several associations between symptoms and measures of coherence, but the effects were generally inconsistent across languages and rating scales.

CONCLUSIONS

Using a cumulative approach, we have shown that NLP findings of reduced semantic coherence in schizophrenia have limited generalizability across different languages, samples, and measures. We argue that several factors such as sociodemographic and clinical heterogeneity, cross-linguistic variation, and the different NLP measures reflecting different clinical aspects may be responsible for this variability. Future studies should take this variability into account in order to develop effective clinical applications targeting different patient populations.

Lower cohesion and altered first-person pronoun usage in the spoken life narratives of individuals with schizophrenia

Usage of computational tools to quantify language disturbances among individuals with psychosis is increasing, improving measurement efficiency and access to fine-grained constructs. However, few studies apply automated linguistic analysis to life narratives in this population. Such research could facilitate the measurement of psychosis-relevant constructs such as sense of agency, capacity to organize one's personal history, narrative richness, and perceptions of the roles that others play in one's life. Furthermore, research is needed to understand how narrative linguistic features relate to cognitive and social functioning. In the present study, individuals with schizophrenia (n = 32) and individuals without a psychotic disorder (n = 15) produced personal life narratives within the Indiana Psychiatric Illness Interview. Narratives were analyzed using the Coh-Metrix computational tool. Linguistic variables analyzed were indices of connections within causal and goal-driven speech (deep cohesion), unique word usage (lexical diversity), and pronoun usage. Individuals with schizophrenia compared to control participants produced narratives that were lower in deep cohesion, contained more first-person singular pronouns, and contained fewer first-person plural pronouns. Narratives did not significantly differ between groups in lexical diversity, third-person pronoun usage, or total word count. Cognitive-linguistic relationships emerged in the full sample, including significant correlations between greater working memory capacity and greater deep cohesion and lexical diversity. In the schizophrenia group, social problem-solving abilities did not correlate with linguistic variables but were associated with cognition. Findings highlight the relevance of psychotherapies which aim to promote recovery among individuals with psychosis through the construction of coherent life narratives and increasing agency and social connectedness.

Detecting at-risk mental states for psychosis (ARMS) using machine learning ensembles and facial features

AIMS

Our study aimed to develop a machine learning ensemble to distinguish "at-risk mental states for psychosis" (ARMS) subjects from control individuals from the general population based on facial data extracted from video-recordings.

METHODS

58 non-help-seeking medication-naïve ARMS and 70 healthy subjects were screened from a general population sample. At-risk status was assessed with the Structured Interview for Prodromal Syndromes (SIPS), and "Subject's Overview" section was filmed (5-10 min). Several features were extracted, e.g., eye and mouth aspect ratio, Euler angles, coordinates from 51 facial landmarks. This elicited 649 facial features, which were further selected using Gradient Boosting Machines (AdaBoost combined with Random Forests). Data was split in 70/30 for training, and Monte Carlo cross validation was used.

RESULTS

Final model reached 83 % of mean F1-score, and balanced accuracy of 85 %. Mean area under the curve for the receiver operator curve classifier was 93 %. Convergent validity testing showed that two features included in the model were significantly correlated with Avolition (SIPS N2 item) and expression of emotion (SIPS N3 item).

CONCLUSION

Our model capitalized on short video-recordings from individuals recruited from the general population, effectively distinguishing between ARMS and controls. Results are encouraging for large-screening purposes in low-resource settings.

Validation of natural language processing methods capturing semantic incoherence in the speech of patients with non-affective psychosis

Background

Impairments in speech production are a core symptom of non-affective psychosis (NAP). While traditional clinical ratings of patients' speech involve a subjective human factor, modern methods of natural language processing (NLP) promise an automatic and objective way of analyzing patients' speech. This study aimed to validate NLP methods for analyzing speech production in NAP patients.

Methods

Speech samples from patients with a diagnosis of schizophrenia or schizoaffective disorder were obtained at two measurement points, 6 months apart. Out of N = 71 patients at T1, speech samples were also available for N = 54 patients at T2. Global and local models of semantic coherence as well as different word embeddings (word2vec vs. GloVe) were applied to the transcribed speech samples. They were tested and compared regarding their correlation with clinical ratings and external criteria from cross-sectional and longitudinal measurements.

Results

Results did not show differences for global vs. local coherence models and found more significant correlations between word2vec models and clinically relevant outcome variables than for GloVe models. Exploratory analysis of longitudinal data did not yield significant correlation with coherence scores.

Conclusion

These results indicate that natural language processing methods need to be critically validated in more studies and carefully selected before clinical application.

Psychometric evaluation of Persian version of medical artificial intelligence readiness scale for medical students

BACKGROUND

Artificial intelligence's advancement in medicine and its worldwide implementation will be one of the main elements of medical education in the coming years. This study aimed to translate and psychometric evaluation of the Persian version of the medical artificial intelligence readiness scale for medical students.

METHODS

The questionnaire was translated according to a backward-forward translation procedure. Reliability was assessed by calculating Cronbach's alpha coefficient. Confirmatory Factor Analysis was conducted on 302 medical students. Content validity was evaluated using the Content Validity Index and Content Validity Ratio.

RESULTS

The Cronbach's alpha coefficient for the whole scale was found to be 0.94. The Content Validity Index was 0.92 and the Content Validity Ratio was 0.75. Confirmatory factor analysis revealed a fair fit for four factors: cognition, ability, vision, and ethics.

CONCLUSION

The Persian version of the medical artificial intelligence readiness scale for medical students consisting of four factors including cognition, ability, vision, and ethics appears to be an almost valid and reliable instrument for the evaluation of medical artificial intelligence readiness.

A Review of the Role of Artificial Intelligence in Healthcare

Artificial intelligence (AI) applications have transformed healthcare. This study is based on a general literature review uncovering the role of AI in healthcare and focuses on the following key aspects: (i) medical imaging and diagnostics, (ii) virtual patient care, (iii) medical research and drug discovery, (iv) patient engagement and compliance, (v) rehabilitation, and (vi) other administrative applications. The impact of AI is observed in detecting clinical conditions in medical imaging and diagnostic services, controlling the outbreak of coronavirus disease 2019 (COVID-19) with early diagnosis, providing virtual patient care using AI-powered tools, managing electronic health records, augmenting patient engagement and compliance with the treatment plan, reducing the administrative workload of healthcare professionals (HCPs), discovering new drugs and vaccines, spotting medical prescription errors, extensive data storage and analysis, and technology-assisted rehabilitation. Nevertheless, this science pitch meets several technical, ethical, and social challenges, including privacy, safety, the right to decide and try, costs, information and consent, access, and efficacy, while integrating AI into healthcare. The governance of AI applications is crucial for patient safety and accountability and for raising HCPs' belief in enhancing acceptance and boosting significant health consequences. Effective governance is a prerequisite to precisely address regulatory, ethical, and trust issues while advancing the acceptance and implementation of AI. Since COVID-19 hit the global health system, the concept of AI has created a revolution in healthcare, and such an uprising could be another step forward to meet future healthcare needs.

Syntactic complexity and diversity of spontaneous speech production in schizophrenia spectrum and major depressive disorders

Syntax, the grammatical structure of sentences, is a fundamental aspect of language. It remains debated whether reduced syntactic complexity is unique to schizophrenia spectrum disorder (SSD) or whether it is also present in major depressive disorder (MDD). Furthermore, the association of syntax (including syntactic complexity and diversity) with language-related neuropsychology and psychopathological symptoms across disorders remains unclear. Thirty-four SSD patients and thirty-eight MDD patients diagnosed according to DSM-IV-TR as well as forty healthy controls (HC) were included and tasked with describing four pictures from the Thematic Apperception Test. We analyzed the produced speech regarding its syntax delineating measures for syntactic complexity (the total number of main clauses embedding subordinate clauses) and diversity (number of different types of complex sentences). We performed cluster analysis to identify clusters based on syntax and investigated associations of syntactic, to language-related neuropsychological (verbal fluency and verbal episodic memory), and psychopathological measures (positive and negative formal thought disorder) using network analyses. Syntax in SSD was significantly reduced in comparison to MDD and HC, whereas the comparison of HC and MDD revealed no significant differences. No associations were present between speech measures and current medication, duration and severity of illness, age or sex; the single association accounted for was education. A cluster analysis resulted in four clusters with different degrees of syntax across diagnoses. Subjects with less syntax exhibited pronounced positive and negative symptoms and displayed poorer performance in executive functioning, global functioning, and verbal episodic memory. All cluster-based networks indicated varying degrees of domain-specific and cross-domain connections. Measures of syntactic complexity were closely related while syntactic diversity appeared to be a separate node outside of the syntactic network. Cross-domain associations were more salient in more complex syntactic production.

Towards a Neurophenomenological Understanding of Self-Disorder in Schizophrenia Spectrum Disorders: A Systematic Review and Synthesis of Anatomical, Physiological, and Neurocognitive Findings

The concept of anomalous self-experience, also termed Self-Disorder, has attracted both clinical and research interest, as empirical studies suggest such experiences specifically aggregate in and are a core feature of schizophrenia spectrum disorders. A comprehensive neurophenomenological understanding of Self-Disorder may improve diagnostic and therapeutic practice. This systematic review aims to evaluate anatomical, physiological, and neurocognitive correlates of Self-Disorder (SD), considered a core feature of Schizophrenia Spectrum Disorders (SSDs), towards developing a neurophenomenological understanding. A search of the PubMed database retrieved 285 articles, which were evaluated for inclusion using PRISMA guidelines. Non-experimental studies, studies with no validated measure of Self-Disorder, or those with no physiological variable were excluded. In total, 21 articles were included in the review. Findings may be interpreted in the context of triple-network theory and support a core dysfunction of signal integration within two anatomical components of the Salience Network (SN), the anterior insula and dorsal anterior cingulate cortex, which may mediate connectivity across both the Default Mode Network (DMN) and Fronto-Parietal Network (FPN). We propose a theoretical Triple-Network Model of Self-Disorder characterized by increased connectivity between the Salience Network (SN) and the DMN, increased connectivity between the SN and FPN, decreased connectivity between the DMN and FPN, and increased connectivity within both the DMN and FPN. We go on to describe translational opportunities for clinical practice and provide suggestions for future research.

Linguistic markers of psychosis in Mandarin Chinese: Relations to theory of mind

Disorganized and impoverished language is a key feature of schizophrenia (Sz), but whether and which linguistic changes previously observed in Indo-European languages generalize to other languages remains unclear. Targeting Mandarin Chinese, we aimed to profile aspects of grammatical complexity that we hypothesized would be reduced in schizophrenia in a task of verbalizing social events. 51 individuals with Sz and 39 controls participated in the animated triangles task, a standardized measure of theory of mind (ToM), in which participants describe triangles moving in either a random or an 'intentional' condition. Results revealed that clauses embedded as arguments in other clauses were reduced in Sz, and that both groups produced such clauses and grammatical aspect more frequently in the intentional condition. ToM scores specifically correlated with production of embedded argument clauses. These results document grammatical impoverishment in Sz in Chinese across several structural domains, which in some of its specific aspects relate to mentalizing performance.

Exploring the Use of Natural Language Processing for Objective Assessment of Disorganized Speech in Schizophrenia

Objective

Measurement-based care tools in psychiatry are useful for symptom monitoring and detecting response to treatment, but methods for quick and objective measurement are lacking especially for acute psychosis. The aim of this study was to explore potential language markers, detected by natural language processing (NLP) methods, as a means to objectively measure the severity of psychotic symptoms of schizophrenia in an acute clinical setting.

Methods

Twenty-two speech samples were collected from seven participants who were hospitalized for schizophrenia, and their symptoms were evaluated over time with SAPS/SANS and TLC scales. Linguistic features were extracted from the speech data using machine learning techniques. Spearman's correlation was performed to examine the relationship between linguistic features and symptoms. Various machine learning models were evaluated by cross-validation methods for their ability to predict symptom severity using the linguistic markers.

Results

Reduced lexical richness and syntactic complexity were characteristic of negative symptoms, while lower content density and more repetitions in speech were predictors of positive symptoms. Machine learning models predicted severity of alogia, illogicality, poverty of speech, social inattentiveness, and TLC scores with up to 82% accuracy. Additionally, speech incoherence was quantifiable through language markers derived from NLP methods.

Conclusions

These preliminary findings suggest that NLP may be useful in identifying clinically relevant language markers of schizophrenia, which can enhance objectivity in symptom monitoring during hospitalization. Further work is needed to replicate these findings in a larger data set and explore methods for feasible implementation in practice.

A Narrative Review of Speech and EEG Features for Schizophrenia Detection: Progress and Challenges

Schizophrenia is a mental illness that affects an estimated 21 million people worldwide. The literature establishes that electroencephalography (EEG) is a well-implemented means of studying and diagnosing mental disorders. However, it is known that speech and language provide unique and essential information about human thought. Semantic and emotional content, semantic coherence, syntactic structure, and complexity can thus be combined in a machine learning process to detect schizophrenia. Several studies show that early identification is crucial to prevent the onset of illness or mitigate possible complications. Therefore, it is necessary to identify disease-specific biomarkers for an early diagnosis support system. This work contributes to improving our knowledge about schizophrenia and the features that can identify this mental illness via speech and EEG. The emotional state is a specific characteristic of schizophrenia that can be identified with speech emotion analysis. The most used features of speech found in the literature review are fundamental frequency (F0), intensity/loudness (I), frequency formants (F1, F2, and F3), Mel-frequency cepstral coefficients (MFCC's), the duration of pauses and sentences (SD), and the duration of silence between words. Combining at least two feature categories achieved high accuracy in the schizophrenia classification. Prosodic and spectral or temporal features achieved the highest accuracy. The work with higher accuracy used the prosodic and spectral features QEVA, SDVV, and SSDL, which were derived from the F0 and spectrogram. The emotional state can be identified with most of the features previously mentioned (F0, I, F1, F2, F3, MFCCs, and SD), linear prediction cepstral coefficients (LPCC), linear spectral features (LSF), and the pause rate. Using the event-related potentials (ERP), the most promissory features found in the literature are mismatch negativity (MMN), P2, P3, P50, N1, and N2. The EEG features with higher accuracy in schizophrenia classification subjects are the nonlinear features, such as Cx, HFD, and Lya.