THE DEPRESSION INVENTORY DEVELOPMENT SCALE: Assessment of Psychometric Properties Using Classical and Modern Measurement Theory in a CAN-BIND Trial

Objective: The goal of the Depression Inventory Development (DID) project is to develop a comprehensive and psychometrically sound rating scale for major depressive disorder (MDD) that reflects current diagnostic criteria and conceptualizations of depression. We report here the evaluation of the current DID item bank using Classical Test Theory (CTT), Item Response Theory (IRT) and Rasch Measurement Theory (RMT). Methods: The present study was part of a larger multisite, open-label study conducted by the Canadian Biomarker Integration Network in Depression (ClinicalTrials.gov: NCT01655706). Trained raters administered the 32 DID items at each of two visits (MDD: baseline, n=211 and Week 8, n=177; healthy participants: baseline, n=112 and Week 8, n=104). The DID's "grid" structure operationalizes intensity and frequency of each item, with clear symptom definitions and a structured interview guide, with the current iteration assessing symptoms related to anhedonia, cognition, fatigue, general malaise, motivation, anxiety, negative thinking, pain, and appetite. Participants were also administered the Montgomery- Åsberg Depression Rating Scale (MADRS) and Quick Inventory of Depressive Symptomatology-Self-Report (QIDS-SR) that allowed DID items to be evaluated against existing "benchmark" items. CTT was used to assess data quality/reliability (i.e., missing data, skewness, scoring frequency, internal consistency), IRT to assess individual item performance by modelling an item's ability to discriminate levels of depressive severity (as assessed by the MADRS), and RMT to assess how the items perform together as a scale to capture a range of depressive severity (item targeting). These analyses together provided empirical evidence to base decisions on which DID items to remove, modify, or advance. Results: Of the 32 DID items evaluated, eight items were identified by CTT as problematic, displaying low variability in the range of responses, floor effects, and/or skewness; and four items were identified by IRT to show poor discriminative properties that would limit their clinical utility. Five additional items were deemed to be redundant. The remaining 15 DID items all fit the Rasch model, with person and item difficulty estimates indicating satisfactory item targeting, with lower precision in participants with mild levels of depression. These 15 DID items also showed good internal consistency (alpha=0.95 and inter-item correlations ranging from r=0.49 to r=0.84) and all items were sensitive to change following antidepressant treatment (baseline vs. Week 8). RMT revealed problematic item targeting for the MADRS and QIDSSR, including an absence of MADRS items targeting participants with mild/moderate depression and an absence of QIDS-SR items targeting participants with mild or severe depression. Conclusion: The present study applied CTT, IRT, and RMT to assess the measurement properties of the DID items and identify those that should be advanced, modified, or removed. Of the 32 items evaluated, 15 items showed good measurement properties. These items (along with previously evaluated items) will provide the basis for validation of a penultimate DID scale assessing anhedonia, cognitive slowing, concentration, executive function, recent memory, drive, emotional fatigue, guilt, self-esteem, hopelessness, tension, rumination, irritability, reduced appetite, insomnia, sadness, worry, suicidality, and depressed mood. The strategies adopted by the DID process provide a framework for rating scale development and validation.

Effects of a Thromboxane Synthetase Inhibitor and a cAMP Phosphodiesterase Inhibitor, Singly and in Combination, on Platelet Behaviour

The effects of dazoxiben, a thromboxane synthetase inhibitor, and AH-P 719, a cAMP phosphodiesterase inhibitor, on arachidonic acid (AA)-induced platelet behaviour were determined. The levels of cAMP present in platelet-rich plasma (PRP) after stimulating the platelets with AA in the absence and presence of the agents were also measured.

AH-P 719, as well as dazoxiben, was more effective as an inhibitor of AA-induced platelet behaviour in PRP from some individuals than in PRP from others, and the effectiveness with which it inhibited platelet behaviour paralleled that of dazoxiben. A combination of both agents was more effective than either agent alone.

Both AH-P 719 and dazoxiben increased the level of cAMP in AA-stimulated platelets but again they were more effective in PRP from some individuals than others. A combination of AH-P 719 and dazoxiben always resulted in higher levels of cAMP than either agent alone.

These results imply that cAMP is involved in determining the effects of thromboxane synthetase inhibitors on platelet behaviour, and indicate that the anti-thrombotic potential of a combination of a thromboxane synthetase inhibitor and a cAMP phosphodiesterase inhibitor may be greater than that of the individual agents.

The Depression Inventory Development Workgroup: A Collaborative, Empirically Driven Initiative to Develop a New Assessment Tool for Major Depressive Disorder

The Depression Inventory Development project is an initiative of the International Society for CNS Drug Development whose goal is to develop a comprehensive and psychometrically sound measurement tool to be utilized as a primary endpoint in clinical trials for major depressive disorder. Using an iterative process between field testing and psychometric analysis and drawing upon expertise of international researchers in depression, the Depression Inventory Development team has established an empirically driven and collaborative protocol for the creation of items to assess symptoms in major depressive disorder. Depression-relevant symptom clusters were identified based on expert clinical and patient input. In addition, as an aid for symptom identification and item construction, the psychometric properties of existing clinical scales (assessing depression and related indications) were evaluated using blinded datasets from pharmaceutical antidepressant drug trials. A series of field tests in patients with major depressive disorder provided the team with data to inform the iterative process of scale development. We report here an overview of the Depression Inventory Development initiative, including results of the third iteration of items assessing symptoms related to anhedonia, cognition, fatigue, general malaise, motivation, anxiety, negative thinking, pain and appetite. The strategies adopted from the Depression Inventory Development program, as an empirically driven and collaborative process for scale development, have provided the foundation to develop and validate measurement tools in other therapeutic areas as well.

Assessment of cognitive symptoms in prodromal and early huntington disease

The Functional Rating Scale Taskforce for pre-Huntington Disease (FuRST-pHD) is a multinational, multidisciplinary initiative with the goal of developing a data-driven, comprehensive, psychometrically sound, rating scale for assessing symptoms and functional ability in prodromal and early Huntington disease (HD) gene expansion carriers. The process involves input from numerous sources to identify relevant symptom domains, including HD individuals, caregivers, and experts from a variety of fields, as well as knowledge gained from the analysis of data from ongoing large-scale studies in HD using existing clinical scales. This is an iterative process in which an ongoing series of field tests in prodromal (prHD) and early HD individuals provides the team with data on which to make decisions regarding which questions should undergo further development or testing and which should be excluded. We report here the development and assessment of the first iteration of interview questions aimed to assess cognitive symptoms in prHD and early HD individuals.

Assessment of Day-to-Day Functioning in Prodromal and Early Huntington Disease

The Functional Rating Scale Taskforce for pre-Huntington Disease (FuRST-pHD) is a multinational, multidisciplinary initiative with the goal of developing a data-driven, comprehensive, psychometrically sound, rating scale for assessing symptoms and functional ability in prodromal and early Huntington disease (HD) gene expansion carriers. The process involves input from numerous sources to identify relevant symptom domains, including HD individuals, caregivers, and experts from a variety of fields, as well as knowledge gained from the analysis of data from ongoing large-scale studies in HD using existing clinical scales. This is an iterative process in which an ongoing series of field tests in prodromal (prHD) and early HD individuals provides the team with data on which to make decisions regarding which questions should undergo further development or testing and which should be excluded. We report here the development and assessment of the first iteration of interview questions aimed to assess functional impact in day-to-day activities in prHD and early HD individuals.

Assessment of depression, anxiety and apathy in prodromal and early huntington disease

The Functional Rating Scale Taskforce for pre-Huntington Disease (FuRST-pHD) is a multinational, multidisciplinary initiative with the goal of developing a data-driven, comprehensive, psychometrically sound, rating scale for assessing symptoms and functional ability in prodromal and early Huntington disease (HD) gene expansion carriers. The process involves input from numerous sources to identify relevant symptom domains, including HD individuals, caregivers, and experts from a variety of fields, as well as knowledge gained from the analysis of data from ongoing large-scale studies in HD using existing clinical scales. This is an iterative process in which an ongoing series of field tests in prodromal (prHD) and early HD individuals provides the team with data on which to make decisions regarding which questions should undergo further development or testing and which should be excluded. We report here the development and assessment of the first iteration of interview questions aimed to assess Depression, Anxiety and Apathy in prHD and early HD individuals.

Assessment of motor symptoms and functional impact in prodromal and early huntington disease

The Functional Rating Scale Taskforce for pre-Huntington Disease (FuRST-pHD) is a multinational, multidisciplinary initiative with the goal of developing a data-driven, comprehensive, psychometrically sound, rating scale for assessing symptoms and functional ability in prodromal and early Huntington disease (HD) gene expansion carriers. The process involves input from numerous sources to identify relevant symptom domains, including HD individuals, caregivers, and experts from a variety of fields, as well as knowledge gained from the analysis of data from ongoing large-scale studies in HD using existing clinical scales. This is an iterative process in which an ongoing series of field tests in prodromal (prHD) and early HD individuals provides the team with data on which to make decisions regarding which questions should undergo further development or testing and which should be excluded. We report here the development and assessment of the first iteration of interview questions aimed to assess functional impact of motor manifestations in prHD and early HD individuals.

An item response analysis of the motor and behavioral subscales of the unified Huntington's disease rating scale in huntington disease gene expansion carriers

Although the Unified Huntington's Disease Rating Scale (UHDRS) is widely used in the assessment of Huntington disease (HD), the ability of individual items to discriminate individual differences in motor or behavioral manifestations has not been extensively studied in HD gene expansion carriers without a motor-defined clinical diagnosis (ie, prodromal-HD or prHD). To elucidate the relationship between scores on individual motor and behavioral UHDRS items and total score for each subscale, a nonparametric item response analysis was performed on retrospective data from 2 multicenter longitudinal studies. Motor and behavioral assessments were supplied for 737 prHD individuals with data from 2114 visits (PREDICT-HD) and 686 HD individuals with data from 1482 visits (REGISTRY). Option characteristic curves were generated for UHDRS subscale items in relation to their subscale score. In prHD, overall severity of motor signs was low, and participants had scores of 2 or above on very few items. In HD, motor items that assessed ocular pursuit, saccade initiation, finger tapping, tandem walking, and to a lesser extent, saccade velocity, dysarthria, tongue protrusion, pronation/supination, Luria, bradykinesia, choreas, gait, and balance on the retropulsion test were found to discriminate individual differences across a broad range of motor severity. In prHD, depressed mood, anxiety, and irritable behavior demonstrated good discriminative properties. In HD, depressed mood demonstrated a good relationship with the overall behavioral score. These data suggest that at least some UHDRS items appear to have utility across a broad range of severity, although many items demonstrate problematic features.

ORIGINAL RESEARCH—WOMEN's SEXUAL DYSFUNCTIONS: The Sexual Interest and Desire Inventory—Female (SIDI‐F): Item Response Analyses of Data from Women Diagnosed with Hypoactive Sexual Desire Disorder

INTRODUCTION

Hypoactive sexual desire disorder (HSDD) is the most common sexual complaint in women. Currently there are no validated instruments for specifically assessing HSDD severity, or change in HSDD severity in response to treatment, in premenopausal women. The Sexual Interest and Desire Inventory-Female (SIDI-F) is a clinician-administered instrument that was developed to measure severity and change in response to treatment of HSDD. Seventeen items were included in a preliminary version of the SIDI-F, including 10 items related to desire, and seven items related to possible comorbid factors (e.g., other kinds of sexual dysfunction, general relationship satisfaction, mood, and fatigue).

AIM

The aim of the study was to use the outcome of item response analyses of blinded data from two randomized, placebo-controlled trials, to assist in the revision of the scale.

METHODS

A nonparametric item response (IRT) model was used to assess the relation between item functioning and HSDD severity on this preliminary version of the SIDI-F.

RESULTS

Results show that the majority of SIDI-F items demonstrated good sensitivity to differences in overall HSDD severity. That is, there was an orderly relation between differences in option selection for an item and differences in overall HSDD severity. The IRT analyses further indicated that revisions were warranted for a number of these items. Five items were not sensitive to differences in HSDD severity and were removed from the scale.

CONCLUSION

The SIDI-F is a brief, clinician-administered rating scale designed to assess severity of HSDD symptoms in women. IRT analyses show that majority of the items of the SIDI-F function well in discriminating individual differences in HSDD severity. A revised 13-item version of the SIDI-F is currently undergoing further validation.

An item response analysis of the international restless legs syndrome study group rating scale for restless legs syndrome

BACKGROUND AND PURPOSE

Restless legs syndrome (RLS) is a common central nervous system disorder; however, there is currently a lack of well-validated and easily-administered measures of RLS severity available. The International Restless Legs Syndrome Study Group has recently developed a 10-item scale to meet this need. The International Restless Legs Severity Scale (IRLS) has been shown to have a high degree of reliability, validity, and internal consistency. In order to further demonstrate the validity of the IRLS, the present study examined the relationship between scores on individual IRLS items and overall RLS severity.

PATIENTS AND METHODS

The 10-item IRLS was administered to 196 RLS patients. Option characteristic curves (the probability of scoring different options for a given item as a function of overall IRLS score) were generated in order to illustrate the scoring patterns for each item across the range of total RLS severity. Item characteristic curves (the expected score on an item as a function of overall IRLS score) were also generated to illustrate the relationship between scores on the individual items and total RLS severity.

RESULTS

The IRLS items demonstrated excellent item response properties, with option and item characteristic curves closely approximating those of an ideal item. Item 3 (relief of arm or leg discomfort from moving around) was the most problematic item in that a 'floor' effect was evident; however, the item response characteristics for this item were still acceptable.

CONCLUSIONS

Each IRLS item showed a good relationship between responses on that item and overall RLS severity, providing further evidence for the validity of the IRLS as a measure of RLS severity in RLS patients.

Worsening of depressive symptoms prior to randomization in clinical trials: a possible screen for placebo responders?

A common practice in depression trials is to exclude patients whose depressive symptoms improve between Screen and Baseline evaluations under the assumption that they are more likely to respond to placebo. The present study investigated this contention by examining the relationship between pre-randomization changes in Hamilton depression rating scale (HAMD) scores to post-randomization placebo response and drug-placebo separation. Four randomized, double-blind, placebo-controlled trials (active medication=fluoxetine or paroxetine) were conducted in outpatients with Major Depressive Disorder using a novel design in which a depressive severity inclusion criterion (HAMD >/= 22) was utilized only at Screen. Patients with no change or minimal (1 point) improvement on the HAMD between Screen and Baseline had the lowest placebo response and the best drug-placebo separation. Patients with pre-randomization improvement of 2 points or greater had moderately higher placebo response and poorer drug-placebo separation. Patients who worsened between Screen and Baseline showed the highest placebo response and the poorest drug-placebo separation. There were no obvious differences in demographic variables between the groups which could account for the findings. In our original analyses 3/4 studies failed to show significant drug-placebo separation. When only patients with no change or pre-randomization improvement of 1 point were used in the analyses, 3/4 studies showed significant drug-placebo separation while the other study approached significance, p < 0.07. These results suggest that pre-randomization changes in HAMD scores may predict post-randomization placebo response and drug-placebo separation. Further, pre-randomization increases in HAMD scores (i.e., worsening) may be the best predictor of heightened placebo responding and poor drug placebo separation.

An Item Response analysis of the Hamilton Depression Rating Scale using shared data from two pharmaceutical companies

Although the Hamilton Depression Rating Scale (HAMD) remains the most widely used outcome measure in clinical trials of Major Depressive Disorder, the psychometric properties of the individual HAMD items have not been extensively studied. In the present paper, data from four separate clinical trials conducted independently by two pharmaceutical companies were analyzed to determine the relationship between scores on the individual HAMD items and overall depressive severity in an outpatient population. Option characteristic curves (the probability of scoring a particular option in relation to overall HAMD scores) were generated in order to illustrate the relationship between scoring patterns for each item and the range of total HAMD scores. Results showed that Items 1 (Depressed Mood) and 7 (Work and Activities), and to a lesser degree, Items 2 (Guilt), 10 (Anxiety/Psychic), 11 (Anxiety/Somatic), and 13 (Somatic/General) demonstrated a good relationship between item responses and overall depressive severity. However, other items (e.g. Insight, Hypochondriasis) appeared to be more problematic with regard to their ability to discriminate over the full range of depression severity. The present results illustrate that co-operative data sharing between pharmaceutical companies can be a useful tool for improving clinical methods.

Effects of a thromboxane synthetase inhibitor and a cAMP phosphodiesterase inhibitor, singly and in combination, on platelet behaviour

The effects of dazoxiben, a thromboxane synthetase inhibitor, and AH-P 719, a cAMP phosphodiesterase inhibitor, on arachidonic acid (AA)-induced platelet behaviour were determined. The levels of cAMP present in platelet-rich plasma (PRP) after stimulating the platelets with AA in the absence and presence of the agents were also measured. AH-P 719, as well as dazoxiben, was more effective as an inhibitor of AA-induced platelet behaviour in PRP from some individuals than in PRP from others, and the effectiveness with which it inhibited platelet behaviour paralleled that of dazoxiben. A combination of both agents was more effective than either agent alone. Both AH-P 719 and dazoxiben increased the level of cAMP in AA-stimulated platelets but again they were more effective in PRP from some individuals than others. A combination of AH-P 719 and dazoxiben always resulted in higher levels of cAMP than either agent alone. These results imply that cAMP is involved in determining the effects of thromboxane synthetase inhibitors on platelet behaviour, and indicate that the anti-thrombotic potential of a combination of a thromboxane synthetase inhibitor and a cAMP phosphodiesterase inhibitor may be greater than that of the individual agents.

Aspirin and dazoxiben as inhibitors of platelet behaviour: modification of their effects by agents that alter cAMP production

The effects of aspirin and dazoxiben were determined on platelet behaviour in platelet-rich plasma (PRP) from 20 volunteers. Dazoxiben prevented aggregation and the release reaction induced by arachidonic acid (AA) in nine of the samples; in the other eleven aggregation and the release reaction still occurred. Aspirin always prevented aggregation and release but higher concentrations were needed in some of the samples of PRP than with others. When the platelets were sensitive to dazoxiben they were relatively sensitive to aspirin; when they were insensitive to dazoxiben they were relatively insensitive to aspirin. The effects of agents that alter production of cAMP on the sensitivity of platelets to aspirin and dazoxiben were determined. Increasing the intracellular level of cAMP rendered platelets more sensitive to the inhibitory effects of both aspirin and dazoxiben; lowering the level of cAMP made the platelets less sensitive to both agents.