Content Validity of the Hypogonadism Impact of Symptoms Questionnaire (HIS-Q): A Patient-Reported Outcome Measure to Evaluate Symptoms of Hypogonadism

Understanding data visualization techniques in qualitative studies used to develop and validate patient-reported outcome measures: a targeted literature review

PURPOSE

Qualitative data that reflects patients' experiences are the foundation of any patient-reported outcome measure (PROM) development and validation study; however, there is limited understanding of the type of data visualization techniques that facilitate communication of this data. The goal of this targeted literature review was to investigate data visualization methods that have been used in published PROM development and validation literature to report qualitative results.

METHODS

A literature search in OVID via MEDLINE was conducted among the top 10 non-disease-specific journals publishing PROM qualitative development and validation studies. Studies that reported qualitative methods to develop/validate a PROM and included data visualization in the form of tables or figures were included. Article characteristics and data visualization types were extracted.

RESULTS

A total of 185 articles were included in data extraction. Most articles (n = 109, 59.1%) included figures (n = 172, average 2 relevant figures per article) in the form of hierarchy/flowcharts (n = 124, 72.1%) and bar charts (n = 29, 16.9%). Information reported in figures included depiction of conceptual frameworks (n = 112, 65.1%) and concept frequency (n = 40, 24.4%). Most articles (n = 152, 81.7%) included tables (n = 307, average 2 relevant tables per article). Information reported in tables included concept frequency (n = 133, 43.3%) and cognitive debriefing and revisions (n = 91, 29.6%).

CONCLUSION

Data visualization techniques used to report qualitative results in the identified PROM qualitative development and validation studies were heterogeneous, and many studies did not utilize any data visualization techniques. This study will inform the development of guidance for using data visualizations to report qualitative PROM research.

The effects and safety of testosterone replacement therapy for men with hypogonadism: the TestES evidence synthesis and economic evaluation

Background

Low levels of testosterone cause male hypogonadism, which is associated with sexual dysfunction, tiredness and reduced muscle strength and quality of life. Testosterone replacement therapy is commonly used for ameliorating symptoms of male hypogonadism, but there is uncertainty about the magnitude of its effects and its cardiovascular and cerebrovascular safety.

Aims of the research

The primary aim was to evaluate the safety of testosterone replacement therapy. We also assessed the clinical and cost-effectiveness of testosterone replacement therapy for men with male hypogonadism, and the existing qualitative evidence on men's experience and acceptability of testosterone replacement therapy.

Design

Evidence synthesis and individual participant data meta-analysis of effectiveness and safety, qualitative evidence synthesis and model-based cost-utility analysis.

Data sources

Major electronic databases were searched from 1992 to February 2021 and were restricted to English-language publications.

Methods

We conducted a systematic review with meta-analysis of individual participant data according to current methodological standards. Evidence was considered from placebo-controlled randomised controlled trials assessing the effects of any formulation of testosterone replacement therapy in men with male hypogonadism. Primary outcomes were mortality and cardiovascular and cerebrovascular events. Data were extracted by one reviewer and cross-checked by a second reviewer. The risk of bias was assessed using the Cochrane Risk of Bias tool. We performed one-stage meta-analyses using the acquired individual participant data and two-stage meta-analyses to integrate the individual participant data with data extracted from eligible studies that did not provide individual participant data. A decision-analytic Markov model was developed to evaluate the cost per quality-adjusted life-years of the use of testosterone replacement therapy in cohorts of patients of different starting ages.

Results

We identified 35 trials (5601 randomised participants). Of these, 17 trials (3431 participants) provided individual participant data. There were too few deaths to assess mortality. There was no difference between the testosterone replacement therapy group (120/1601, 7.5%) and placebo group (110/1519, 7.2%) in the incidence of cardiovascular and/or cerebrovascular events (13 studies, odds ratio 1.07, 95% confidence interval 0.81 to 1.42; p = 0.62). Testosterone replacement therapy improved quality of life and sexual function in almost all patient subgroups. In the testosterone replacement therapy group, serum testosterone was higher while serum cholesterol, triglycerides, haemoglobin and haematocrit were all lower. We identified several themes from five qualitative studies showing how symptoms of low testosterone affect men's lives and their experience of treatment. The cost-effectiveness of testosterone replacement therapy was dependent on whether uncertain effects on all-cause mortality were included in the model, and on the approach used to estimate the health state utility increment associated with testosterone replacement therapy, which might have been driven by improvements in symptoms such as sexual dysfunction and low mood.

Limitations

A meaningful evaluation of mortality was hampered by the limited number of defined events. Definition and reporting of cardiovascular and cerebrovascular events and methods for testosterone measurement varied across trials.

Conclusions

Our findings do not support a relationship between testosterone replacement therapy and cardiovascular/cerebrovascular events in the short-to-medium term. Testosterone replacement therapy improves sexual function and quality of life without adverse effects on blood pressure, serum lipids or glycaemic markers.

Future work

Rigorous long-term evidence assessing the safety of testosterone replacement therapy and subgroups most benefiting from treatment is needed.

Study registration

The study is registered as PROSPERO CRD42018111005.

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: 17/68/01) and is published in full in Health Technology Assessment; Vol. 28, No. 43. See the NIHR Funding and Awards website for further award information.

Identifying the outcomes important to men with hypogonadism: A qualitative evidence synthesis

OBJECTIVE

Men with male hypogonadism (MH) experience sexual dysfunction, which improves with testosterone replacement therapy (TRT). However, randomised controlled trials provide little consensus on functional and behavioural symptoms in hypogonadal men; these are often better captured by qualitative information from individual patient experience.

METHODS

We systematically searched major electronic databases to identify qualitative data from men with hypogonadism, with or without TRT. Two independent authors performed the selection, extraction, and thematic analysis of data. Quality of eligible studies was assessed using the Critical Appraisals Skills Programme and Grading of Recommendations Assessment, Development and Evaluation-Confidence in the Evidence from Reviews of Qualitative research tools.

RESULTS

We analysed data from five studies published in nine reports that assessed a total of 284 participants. Published data were only available within North America, with no ethnic minority or other underserved groups included. In addition to sexual dysfunction, men with MH experienced adverse changes in physical strength, perceptions of masculinity, cognitive function, and quality of life. The experience of MH appeared dependent on the source(s) of educational material.

DISCUSSION

We propose a patient-centred approach to clinician interactions rather than focusing on discreet MH symptoms. Current evidence about the experience of MH is limited to North America and predominantly white ethnicity, which may not be broadly applicable to other geographic regions. Broadening our understanding of the MH experience may improve the targeting of information to patients. In addition, a multidisciplinary approach may better address symptoms neither attributable to MH nor alleviated by TRT.

The efficacy and adverse events of testosterone replacement therapy in hypogonadal men: A systematic review and meta-analysis of randomized, placebo-controlled trials

CONTEXT

The efficacy and safety of testosterone replacement therapy (TRT) in hypogonadal men remain incompletely understood.

OBJECTIVE

To conduct a systematic review and meta-analysis of randomized clinical trials (RCT) to determine the effects of TRT on patient-important outcomes and adverse events in hypogonadal men.

DATA SOURCES

We searched Ovid MEDLINE, Ovid EMBASE, Ovid Cochrane Database of Systematic Reviews, Ovid Cochrane Central Register of Controlled Trials, and Scopus from inception to March 2th, 2017.

STUDY SELECTION

RCTs that assessed the efficacy and adverse events of TRT of at least 12 weeks compared with placebo in adult men with hypogonadism, defined by morning testosterone ≤300 ng/dL and at least one symptom or sign of hypogonadism.

DATA EXTRACTION

Reviewers working independently and in duplicate assessed the quality of the trials and collected data on patient characteristics, interventions, and outcomes.

DATA SYNTHESIS

We found 11 publications, reporting on 4 eligible trials (including 1,779 patients) at low risk of bias. Compared to placebo, TRT was associated with a small but significant increase in sexual desire or libido [standardized mean difference (SMD): 0.17, 95% CI 0.01, 0.34] (n=1383), erectile function [SMD: 0.16, 95% CI 0.06, 0.27] (n=1344), and sexual satisfaction [SMD: 0.16, 95% CI 0.01, 0.31] (n=676), but had no effect on energy or mood. TRT was associated with an increased risk of developing erythrocytosis [relative risk: 8.14, 95% CI: 1.87, 35.40] (n=1579) compared to placebo, but had no significant effect on lower urinary tract symptoms (LUTS).

CONCLUSION

In hypogonadal men TRT improves sexual desire, erectile function, and sexual satisfaction, however it increases the risk of erythrocytosis.

Psychometric Evaluation of the Hypogonadism Impact of Symptoms Questionnaire Short Form (HIS-Q-SF)

BACKGROUND

The Hypogonadism Impact of Symptoms Questionnaire Short Form (HIS-Q-SF) is a patient-reported outcome measurement designed to evaluate the symptoms of hypogonadism. The HIS-Q-SF is an abbreviated version including17 items from the original 28-item HIS-Q.

AIM

To conduct item analyses and reduction, evaluate the psychometric properties of the HIS-Q-SF, and provide guidance on score interpretation.

METHODS

A 12-week observational longitudinal study of hypogonadal men was conducted as part of the original HIS-Q psychometric evaluation. Participants completed the original HIS-Q every 2 weeks. Blood samples were collected to evaluate testosterone levels. Participants completed the Aging Male's Symptoms Scale, the International Index of Erectile Function, the Short Form-12, and the PROMIS Sexual Activity, Satisfaction with Sex Life, Sleep Disturbance, and Applied Cognition Scales (baseline and weeks 6 and 12). Clinicians completed the Clinical Global Impression of Severity and Change scales and a clinical form.

MAIN OUTCOME MEASURES

Item performance was evaluated using descriptive statistics and Rasch analyses. Reliability (internal consistency and test-retest), validity (concurrent and know groups), and responsiveness were assessed.

RESULTS

One hundred seventy-seven men participated (mean age = 54.1 years, range = 23-83). Similar to the full HIS-Q, the final abbreviated HIS-Q-SF instrument includes five domains (sexual, energy, sleep, cognition, and mood) with two sexual subdomains (libido and sexual function). For key domains, test-retest reliability was very good, and construct validity was good for all domains. Known-groups validity was demonstrated for all domain scores, subdomain scores, and total score based on the Clinical Global Impression-Severity. All domains and subdomains were responsive to change based on patient-rated anchor questions.

CLINICAL IMPLICATIONS

The HIS-Q-SF could be a useful tool in clinical practice, epidemiologic studies, and other academic research settings.

STRENGTHS AND LIMITATIONS

Careful consideration was given to the selection of the final HIS-Q-SF items based on quantitative data and clinical expert feedback. Overall, the reduced set of items demonstrated strong psychometric properties. Testosterone levels for the participating men were not as low as anticipated, which could have limited the ability to examine the relations between the HIS-Q-SF and testosterone levels. Further, the analyses used data collected through administration of the full HIS-Q, and future studies should administer the standalone HIS-Q-SF to replicate the psychometric analyses reported in the present study.

CONCLUSION

Similar to the original HIS-Q, the HIS-Q-SF has evidence supporting reliability, validity, and responsiveness. The short form includes a smaller set of items that might be more suitable for use in clinical practice or academic research settings. Gelhorn HL, Roberts LJ, Khandelwal N, et al. Psychometric Evaluation of the Hypogonadism Impact of Symptoms Questionnaire Short Form (HIS-Q-SF). J Sex Med 2017;14:1046-1058.

Development of the Hypogonadism Impact of Symptoms Questionnaire Short Form: Qualitative Research

INTRODUCTION

Hypogonadism in men is often associated with poor libido, erectile dysfunction, irritability, fatigue, and psychological and relationship problems. Many of these symptoms can be best assessed through patient report. The 28-item Hypogonadism Impact of Symptoms Questionnaire (HIS-Q) was developed to evaluate hypogonadism symptoms in men with low testosterone in the context of clinical trials.

AIM

To develop a briefer version of the HIS-Q that could be practical for use in treatment settings.

METHODS

Participants with low testosterone levels and symptoms consistent with hypogonadism were recruited through clinical sites. Focus groups and interviews were conducted to elicit symptom concepts and identify those that were most relevant to patients, including changes as a consequence of treatment.

MAIN OUTCOME MEASURES

Systematic analysis of the qualitative data and expert clinician input were used to develop the HIS-Q short form (HIS-Q-SF). One-on-one cognitive interviews were conducted to confirm the content validity of the HIS-Q-SF.

RESULTS

Thirty-five men participated in this qualitative research. Concept elicitation was conducted through focus group discussions (n = 18) and telephone interviews (n = 2); then, the draft HIS-Q-SF was evaluated through cognitive interviews (n = 15). The mean age of total sample was 53.2 ± 6.8 years, and the mean serum total testosterone level was 184.9 ± 55.2 ng/dL. Results suggest that the HIS-Q-SF has demonstrated content validity, including the content coverage, comprehensibility, and the appropriateness of the response options and recall period. The final version of the HIS-Q-SF includes 17 items and is aligned with the original longer version of the instrument.

CONCLUSION

The HIS-Q-SF is a comprehensive measurement of hypogonadism symptom severity in men. Content coverage and content validity were confirmed. The instrument will be evaluated further to establish the psychometric characteristics and to assess the utility of the measurement in clinical treatment settings.