Equivalency of the diagnostic accuracy of the PHQ-8 and PHQ-9: a systematic review and individual participant data meta-analysis

BACKGROUND

Item 9 of the Patient Health Questionnaire-9 (PHQ-9) queries about thoughts of death and self-harm, but not suicidality. Although it is sometimes used to assess suicide risk, most positive responses are not associated with suicidality. The PHQ-8, which omits Item 9, is thus increasingly used in research. We assessed equivalency of total score correlations and the diagnostic accuracy to detect major depression of the PHQ-8 and PHQ-9.

METHODS

We conducted an individual patient data meta-analysis. We fit bivariate random-effects models to assess diagnostic accuracy.

RESULTS

16 742 participants (2097 major depression cases) from 54 studies were included. The correlation between PHQ-8 and PHQ-9 scores was 0.996 (95% confidence interval 0.996 to 0.996). The standard cutoff score of 10 for the PHQ-9 maximized sensitivity + specificity for the PHQ-8 among studies that used a semi-structured diagnostic interview reference standard (N = 27). At cutoff 10, the PHQ-8 was less sensitive by 0.02 (-0.06 to 0.00) and more specific by 0.01 (0.00 to 0.01) among those studies (N = 27), with similar results for studies that used other types of interviews (N = 27). For all 54 primary studies combined, across all cutoffs, the PHQ-8 was less sensitive than the PHQ-9 by 0.00 to 0.05 (0.03 at cutoff 10), and specificity was within 0.01 for all cutoffs (0.00 to 0.01).

CONCLUSIONS

PHQ-8 and PHQ-9 total scores were similar. Sensitivity may be minimally reduced with the PHQ-8, but specificity is similar.

Probability of major depression diagnostic classification based on the SCID, CIDI and MINI diagnostic interviews controlling for Hospital Anxiety and Depression Scale - Depression subscale scores: An individual participant data meta-analysis of 73 primary studies

OBJECTIVE

Two previous individual participant data meta-analyses (IPDMAs) found that different diagnostic interviews classify different proportions of people as having major depression overall or by symptom levels. We compared the odds of major depression classification across diagnostic interviews among studies that administered the Depression subscale of the Hospital Anxiety and Depression Scale (HADS-D).

METHODS

Data accrued for an IPDMA on HADS-D diagnostic accuracy were analysed. We fit binomial generalized linear mixed models to compare odds of major depression classification for the Structured Clinical Interview for DSM (SCID), Composite International Diagnostic Interview (CIDI), and Mini International Neuropsychiatric Interview (MINI), controlling for HADS-D scores and participant characteristics with and without an interaction term between interview and HADS-D scores.

RESULTS

There were 15,856 participants (1942 [12%] with major depression) from 73 studies, including 15,335 (97%) non-psychiatric medical patients, 164 (1%) partners of medical patients, and 357 (2%) healthy adults. The MINI (27 studies, 7345 participants, 1066 major depression cases) classified participants as having major depression more often than the CIDI (10 studies, 3023 participants, 269 cases) (adjusted odds ratio [aOR] = 1.70 (0.84, 3.43)) and the semi-structured SCID (36 studies, 5488 participants, 607 cases) (aOR = 1.52 (1.01, 2.30)). The odds ratio for major depression classification with the CIDI was less likely to increase as HADS-D scores increased than for the SCID (interaction aOR = 0.92 (0.88, 0.96)).

CONCLUSION

Compared to the SCID, the MINI may diagnose more participants as having major depression, and the CIDI may be less responsive to symptom severity.

The Accuracy of the Patient Health Questionnaire-9 Algorithm for Screening to Detect Major Depression: An Individual Participant Data Meta-Analysis

BACKGROUND

Screening for major depression with the Patient Health Questionnaire-9 (PHQ-9) can be done using a cutoff or the PHQ-9 diagnostic algorithm. Many primary studies publish results for only one approach, and previous meta-analyses of the algorithm approach included only a subset of primary studies that collected data and could have published results.

OBJECTIVE

To use an individual participant data meta-analysis to evaluate the accuracy of two PHQ-9 diagnostic algorithms for detecting major depression and compare accuracy between the algorithms and the standard PHQ-9 cutoff score of ≥10.

METHODS

Medline, Medline In-Process and Other Non-Indexed Citations, PsycINFO, Web of Science (January 1, 2000, to February 7, 2015). Eligible studies that classified current major depression status using a validated diagnostic interview.

RESULTS

Data were included for 54 of 72 identified eligible studies (n participants = 16,688, n cases = 2,091). Among studies that used a semi-structured interview, pooled sensitivity and specificity (95% confidence interval) were 0.57 (0.49, 0.64) and 0.95 (0.94, 0.97) for the original algorithm and 0.61 (0.54, 0.68) and 0.95 (0.93, 0.96) for a modified algorithm. Algorithm sensitivity was 0.22-0.24 lower compared to fully structured interviews and 0.06-0.07 lower compared to the Mini International Neuropsychiatric Interview. Specificity was similar across reference standards. For PHQ-9 cutoff of ≥10 compared to semi-structured interviews, sensitivity and specificity (95% confidence interval) were 0.88 (0.82-0.92) and 0.86 (0.82-0.88).

CONCLUSIONS

The cutoff score approach appears to be a better option than a PHQ-9 algorithm for detecting major depression.

Effect of Second hand Smoke on Arterial Stiffness among Healthy Women

Introduction: Arterial stiffness is recognised as a significant cardiovascular risk factor and an independent predictor of all causes of cardiovascular death. Women are the largest population exposed to cigarette smoke either at work or from their partner. The objectives of this study are to compare the arterial stiffness (augmentation index and pulse wave velocity) between second hand smoke (SHS) and non second hand smoke (non-SHS). Designs and method: Comparative cross-sectional study was conducted among 118 healthy female subjects (64 SHS and 54 non- SHS). The women were in the SHS group if their spouse is a smoker and they had an exposure to cigarette smoke for at least three years, minimum of15 minutes two days a week. Pulse wave analysis and pulse wave velocity was used to study the arterial stiffness. Pulse wave analysis reported as percentage of augmentation index. Pulse wave velocity equal to carotid femoral distance (meter) divided by time (second) Results: The mean augmentation index (AIx) for SHS groups was 17.9 (SD7.06) and for non SHS groups was 20.7(SD6.11). The mean of Pulse wave velocity was 8.94 (SD1.36) in SHS groups and 9.02 (SD8.68) in non SHS groups. ANOVA and ANCOVA shown significance difference in crude mean (p = 0.047) and estimated marginal mean (p = 0.028) of augmentation index between SHS and non - SHS after controlling for age and BMI. However, there was no significant difference in crude mean (p = 0.795) and estimated marginal mean (p = 0.716) pulse wave velocity between SHS and non - SHS after controlling for age and BMI. Conclusion: An increase in augmentation index amongst non SHS in this study most probably due to exposure to environmental tobacco at work compared to exposure to spouse’s smoke Bangladesh Journal of Medical Science Vol.18(2) 2019 p.340-346

Knowledge, Decision-Making and Acceptance of Human Papilloma Virus Vaccination among Parents of Primary School Students in Kota Bharu, Kelantan, Malaysia

Background: The incidence of cervical cancer in younger women remains high. This is worrisome as it affects future generations. Therefore Malaysia implements human papilloma virus (HPV) vaccination as a national vaccination program. Parents play an important role in determining the success of this HPV vaccination program among schoolaged girls by their compliance. Objective: To assess parental knowledge, decision-making and acceptance of HPV vaccination. Methods: This cross sectional study was conducted among 280 randomly selected parents of primary school students aged 11 in Kota Bharu using a pre-validated self-administered questionnaire to assess knowledge and decision-making with regard to HPV vaccination. Results: Most parents (62%) were shown to have poor knowledge while most decision-making was shared. Age of respondents (adjusted odds ratio ‘AOR’= 1.09; 95% confidence interval ‘CI’= 1.04-1.14; p <0.001) and good knowledge of HPV vaccination (AOR= 16.32; 95% CI= 7.32-36.4; p <0.001) were significantly associated with HPV vaccine acceptance. Conclusion: The majority of parents exhibited poor knowledge which may affect their decision-making and uptake of HPV vaccination among their children. This highlights the need to better educate parents on HPV vaccination.

Probability of major depression diagnostic classification using semi-structured versus fully structured diagnostic interviews

BACKGROUND

Different diagnostic interviews are used as reference standards for major depression classification in research. Semi-structured interviews involve clinical judgement, whereas fully structured interviews are completely scripted. The Mini International Neuropsychiatric Interview (MINI), a brief fully structured interview, is also sometimes used. It is not known whether interview method is associated with probability of major depression classification.AimsTo evaluate the association between interview method and odds of major depression classification, controlling for depressive symptom scores and participant characteristics.

METHOD

Data collected for an individual participant data meta-analysis of Patient Health Questionnaire-9 (PHQ-9) diagnostic accuracy were analysed and binomial generalised linear mixed models were fit.

RESULTS

A total of 17 158 participants (2287 with major depression) from 57 primary studies were analysed. Among fully structured interviews, odds of major depression were higher for the MINI compared with the Composite International Diagnostic Interview (CIDI) (odds ratio (OR) = 2.10; 95% CI = 1.15-3.87). Compared with semi-structured interviews, fully structured interviews (MINI excluded) were non-significantly more likely to classify participants with low-level depressive symptoms (PHQ-9 scores ≤6) as having major depression (OR = 3.13; 95% CI = 0.98-10.00), similarly likely for moderate-level symptoms (PHQ-9 scores 7-15) (OR = 0.96; 95% CI = 0.56-1.66) and significantly less likely for high-level symptoms (PHQ-9 scores ≥16) (OR = 0.50; 95% CI = 0.26-0.97).

CONCLUSIONS

The MINI may identify more people as depressed than the CIDI, and semi-structured and fully structured interviews may not be interchangeable methods, but these results should be replicated.Declaration of interestDrs Jetté and Patten declare that they received a grant, outside the submitted work, from the Hotchkiss Brain Institute, which was jointly funded by the Institute and Pfizer. Pfizer was the original sponsor of the development of the PHQ-9, which is now in the public domain. Dr Chan is a steering committee member or consultant of Astra Zeneca, Bayer, Lilly, MSD and Pfizer. She has received sponsorships and honorarium for giving lectures and providing consultancy and her affiliated institution has received research grants from these companies. Dr Hegerl declares that within the past 3 years, he was an advisory board member for Lundbeck, Servier and Otsuka Pharma; a consultant for Bayer Pharma; and a speaker for Medice Arzneimittel, Novartis, and Roche Pharma, all outside the submitted work. Dr Inagaki declares that he has received grants from Novartis Pharma, lecture fees from Pfizer, Mochida, Shionogi, Sumitomo Dainippon Pharma, Daiichi-Sankyo, Meiji Seika and Takeda, and royalties from Nippon Hyoron Sha, Nanzando, Seiwa Shoten, Igaku-shoin and Technomics, all outside of the submitted work. Dr Yamada reports personal fees from Meiji Seika Pharma Co., Ltd., MSD K.K., Asahi Kasei Pharma Corporation, Seishin Shobo, Seiwa Shoten Co., Ltd., Igaku-shoin Ltd., Chugai Igakusha and Sentan Igakusha, all outside the submitted work. All other authors declare no competing interests. No funder had any role in the design and conduct of the study; collection, management, analysis and interpretation of the data; preparation, review or approval of the manuscript; and decision to submit the manuscript for publication.

A comparison of bivariate, multivariate random-effects, and Poisson correlated gamma-frailty models to meta-analyze individual patient data of ordinal scale diagnostic tests

Individual patient data (IPD) meta-analyses are increasingly common in the literature. In the context of estimating the diagnostic accuracy of ordinal or semi-continuous scale tests, sensitivity and specificity are often reported for a given threshold or a small set of thresholds, and a meta-analysis is conducted via a bivariate approach to account for their correlation. When IPD are available, sensitivity and specificity can be pooled for every possible threshold. Our objective was to compare the bivariate approach, which can be applied separately at every threshold, to two multivariate methods: the ordinal multivariate random-effects model and the Poisson correlated gamma-frailty model. Our comparison was empirical, using IPD from 13 studies that evaluated the diagnostic accuracy of the 9-item Patient Health Questionnaire depression screening tool, and included simulations. The empirical comparison showed that the implementation of the two multivariate methods is more laborious in terms of computational time and sensitivity to user-supplied values compared to the bivariate approach. Simulations showed that ignoring the within-study correlation of sensitivity and specificity across thresholds did not worsen inferences with the bivariate approach compared to the Poisson model. The ordinal approach was not suitable for simulations because the model was highly sensitive to user-supplied starting values. We tentatively recommend the bivariate approach rather than more complex multivariate methods for IPD diagnostic accuracy meta-analyses of ordinal scale tests, although the limited type of diagnostic data considered in the simulation study restricts the generalization of our findings.

Selective Cutoff Reporting in Studies of Diagnostic Test Accuracy: A Comparison of Conventional and Individual-Patient-Data Meta-Analyses of the Patient Health Questionnaire-9 Depression Screening Tool

In studies of diagnostic test accuracy, authors sometimes report results only for a range of cutoff points around data-driven "optimal" cutoffs. We assessed selective cutoff reporting in studies of the diagnostic accuracy of the Patient Health Questionnaire-9 (PHQ-9) depression screening tool. We compared conventional meta-analysis of published results only with individual-patient-data meta-analysis of results derived from all cutoff points, using data from 13 of 16 studies published during 2004-2009 that were included in a published conventional meta-analysis. For the "standard" PHQ-9 cutoff of 10, accuracy results had been published by 11 of the studies. For all other relevant cutoffs, 3-6 studies published accuracy results. For all cutoffs examined, specificity estimates in conventional and individual-patient-data meta-analyses were within 1% of each other. Sensitivity estimates were similar for the cutoff of 10 but differed by 5%-15% for other cutoffs. In samples where the PHQ-9 was poorly sensitive at the standard cutoff, authors tended to report results for lower cutoffs that yielded optimal results. When the PHQ-9 was highly sensitive, authors more often reported results for higher cutoffs. Consequently, in the conventional meta-analysis, sensitivity increased as cutoff severity increased across part of the cutoff range-an impossibility if all data are analyzed. In sum, selective reporting by primary study authors of only results from cutoffs that perform well in their study can bias accuracy estimates in meta-analyses of published results.

Erratum to: Methods for evaluating medical tests and biomarkers

[This corrects the article DOI: 10.1186/s41512-016-0001-y.].

Catamenial epilepsy: A missed cause of refractory seizure in young women

Catamenial epilepsy refers to changes in the frequency of seizures over the course of the menstrual cycle. A thorough history and detailed review of the patient's seizure diary are imperative to classify the seizures accurately and select the most appropriate antiepileptic treatment. As catamenial epilepsy rarely responds to antiepileptic medications, the physician should regularly revise the treatment plan of the women with epilepsy that is refractory to the current treatment. We describe the case of a 34-year-old single woman who presented with refractory seizures.

A Rome III survey of functional dyspepsia among the ethnic Malays in a primary care setting

Backgrounds

The study aimed to survey for FD in a primary care setting in a population known to have an extremely low prevalence of Helicobacter pylori (H. pylori) infection, with the hypothesis that in such a population, dyspepsia should have been relatively less common.

Methods

The Rome III FD Diagnostic Questionnaire was translated into the Malay language and later tested for reliability. A prospective cross-sectional survey was then performed involving 160 Malay patients attending primary care clinic after informed consent. Patients positive for symptoms of FD were subjected to upper endoscopy and exclusion of H. pylori infection. Univariable and multivariable analyses were used to test for associated risk factors.

Results

The back-translated questionnaire was similar to the original English version and was reliable (Cronbach Alpha-coefficient 0.85). Of the 160 surveyed subjects, 19 of them (11.9%) had symptoms of FD. With exclusion of erosive diseases (3/160 or 1.9%) from endoscopy, 16 subjects or 10% had FD. None of the 19 subjects were positive for H. pylori infection. Epigastric pain syndrome was present in 11/16 (68.8%) and the rest, overlap with postprandial distress syndrome. With multivariable analysis, a married status (OR = 8.1; 95% CI 1.0-36.5) and positive psychosocial alarm symptoms (OR = 3.8; 95% CI 1.0-14.0) were associated with FD. Of those married subjects, females were more likely to have FD and psychosocial symptoms than men (6.3% vs. 1.9%), P = 0.04.

Conclusions

FD was more common than one had expected among Malays attending primary care clinic in an area with low prevalence of H. pylori.