1
|
López-Díaz Á, Palermo-Zeballos FJ, Gutierrez-Rojas L, Alameda L, Gotor-Sánchez-Luengo F, Garrido-Torres N, Métrailler J, Alerci L, Bonnarel V, Cano-Domínguez P, Avanesi-Molina E, Soto-Ontoso M, Torrecilla-Olavarrieta R, Muñoz-Manchado LI, Torres-Hernández P, González-Higueras F, Prados-Ojeda JL, Herrera-Cortés M, Meca-García JM, Gordillo-Urbano RM, Sánchez-Robles C, Delgado-Durán T, Soriano-Peña MF, Golay P, Conus P, Crespo-Facorro B, Ruiz-Veguilla M. Proxy measures for the assessment of psychotic and affective symptoms in studies using electronic health records. BJPsych Open 2024; 10:e22. [PMID: 38179604 PMCID: PMC10790217 DOI: 10.1192/bjo.2023.623] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 10/31/2023] [Accepted: 11/14/2023] [Indexed: 01/06/2024] Open
Abstract
BACKGROUND There is a lack of standardised psychometric data in electronic health record (EHR)-based research. Proxy measures of symptom severity based on patients' clinical records may be useful surrogates in mental health EHR research. AIMS This study aimed to validate proxy tools for the short versions of the Positive and Negative Syndrome Scale (PANSS-6), Young Mania Rating Scale (YMRS-6) and Montgomery-Åsberg Depression Rating Scale (MADRS-6). METHOD A cross-sectional, multicentre study was conducted in a sample of 116 patients with first-episode psychosis from 12 public hospitals in Spain. Concordance between PANSS-6, YMRS-6 and MADRS-6 scores and their respective proxies was evaluated based on information from EHR clinical notes, using a variety of statistical procedures, including multivariate tests to adjust for potential confounders. Bootstrapping techniques were used for internal validation, and an independent cohort from the Treatment and Early Intervention in Psychosis Program (TIPP-Lausanne, Switzerland) for external validation. RESULTS The proxy versions correlated strongly with their respective standardised scales (partial correlations ranged from 0.75 to 0.84) and had good accuracy and discriminatory power in distinguishing between patients in and not in remission (percentage of patients correctly classified ranged from 83.9 to 91.4% and bootstrapped optimism-corrected area under the receiver operating characteristic curve ranged from 0.76 to 0.89), with high interrater reliability (intraclass correlation coefficient of 0.81). The findings remained robust in the external validation data-set. CONCLUSIONS The proxy instruments proposed for assessing psychotic and affective symptoms by reviewing EHR provide a feasible and reliable alternative to traditional structured psychometric procedures, and a promising methodology for real-world practice settings.
Collapse
Affiliation(s)
- Álvaro López-Díaz
- Mental Health Clinical Management Unit, Virgen Macarena University Hospital, Seville, Spain; Translational Psychiatry Research Group (PsyNal), Seville Biomedical Research Centre (IBiS), Spain; Spanish Network for Research in Mental Health, Carlos III Institute (CIBERSAM, ISCIII), Seville, Spain; Department of Psychiatry, School of Medicine, University of Seville, Spain; and First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain
| | - Fernanda Jazmín Palermo-Zeballos
- Mental Health Clinical Management Unit, Virgen Macarena University Hospital, Seville, Spain; and First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain
| | - Luis Gutierrez-Rojas
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; Mental Health Clinical Management Unit, San Cecilio University Hospital, Granada, Spain; Psychiatry and Neurosciences Research Group (CTS-549), Institute of Neurosciences, University of Granada, Spain; and Department of Psychiatry, University of Granada, Spain
| | - Luis Alameda
- Service of General Psychiatry, Treatment and Early Intervention in Psychosis Program (TIPP), Lausanne University Hospital and University of Lausanne, Switzerland; and Department of Psychosis Studies, Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK
| | - Francisco Gotor-Sánchez-Luengo
- Department of Psychiatry, School of Medicine, University of Seville, Spain; First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Virgen del Rocío University Hospital, Seville, Spain
| | - Nathalia Garrido-Torres
- Translational Psychiatry Research Group (PsyNal), Seville Biomedical Research Centre (IBiS), Spain; Spanish Network for Research in Mental Health, Carlos III Institute (CIBERSAM, ISCIII), Seville, Spain; First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Virgen del Rocío University Hospital, Seville, Spain
| | - Johann Métrailler
- Service of General Psychiatry, Treatment and Early Intervention in Psychosis Program (TIPP), Lausanne University Hospital and University of Lausanne, Switzerland
| | - Livia Alerci
- Service of General Psychiatry, Treatment and Early Intervention in Psychosis Program (TIPP), Lausanne University Hospital and University of Lausanne, Switzerland
| | - Vincent Bonnarel
- Service of General Psychiatry, Treatment and Early Intervention in Psychosis Program (TIPP), Lausanne University Hospital and University of Lausanne, Switzerland
| | - Pablo Cano-Domínguez
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Virgen de la Victoria University Hospital, Málaga, Spain
| | - Elma Avanesi-Molina
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Virgen de la Victoria University Hospital, Málaga, Spain
| | - Miguel Soto-Ontoso
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Torrecárdenas University Hospital, Almería, Spain
| | - Rocio Torrecilla-Olavarrieta
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Jerez University Hospital, Cádiz, Spain
| | - Leticia Irene Muñoz-Manchado
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Jerez University Hospital, Cádiz, Spain
| | - Pedro Torres-Hernández
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Jaén University Hospital, Spain
| | - Fermín González-Higueras
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Jaén University Hospital, Spain
| | - Juan Luis Prados-Ojeda
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Reina Sofía University Hospital, Córdoba, Spain
| | - Mario Herrera-Cortés
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Reina Sofía University Hospital, Córdoba, Spain
| | - José Miguel Meca-García
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Poniente University Hospital, Almería, Spain
| | - Rafael Manuel Gordillo-Urbano
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Infanta Margarita Hospital, Córdoba, Spain
| | - Cristina Sánchez-Robles
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Juan Ramón Jiménez Hospital, Huelva, Spain
| | - Tomás Delgado-Durán
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Juan Ramón Jiménez Hospital, Huelva, Spain
| | - María Felipa Soriano-Peña
- First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, San Agustín University Hospital, Linares, Spain
| | - Philippe Golay
- Service of General Psychiatry, Treatment and Early Intervention in Psychosis Program (TIPP), Lausanne University Hospital and University of Lausanne, Switzerland
| | - Philippe Conus
- Service of General Psychiatry, Treatment and Early Intervention in Psychosis Program (TIPP), Lausanne University Hospital and University of Lausanne, Switzerland
| | - Benedicto Crespo-Facorro
- Translational Psychiatry Research Group (PsyNal), Seville Biomedical Research Centre (IBiS), Spain; Spanish Network for Research in Mental Health, Carlos III Institute (CIBERSAM, ISCIII), Seville, Spain; Department of Psychiatry, School of Medicine, University of Seville, Spain; First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Virgen del Rocío University Hospital, Seville, Spain
| | - Miguel Ruiz-Veguilla
- Translational Psychiatry Research Group (PsyNal), Seville Biomedical Research Centre (IBiS), Spain; Spanish Network for Research in Mental Health, Carlos III Institute (CIBERSAM, ISCIII), Seville, Spain; Department of Psychiatry, School of Medicine, University of Seville, Spain; First-Episode Psychosis Research Network of Andalusia (Red PEPSur), Spain; and Mental Health Clinical Management Unit, Virgen del Rocío University Hospital, Seville, Spain
| |
Collapse
|