Rescuing Suboptimal Patient-Reported Outcome Instrument Data in Clinical Trials: A New Strategy

The MOHIP-14PW (Modified Oral Health Impact Profile 14-Item Version for Pregnant Women): A Real-World Study of Its Psychometric Properties and Relationship with Patient-Reported Oral Health

Background: The 14-item version of the Oral Health Impact Profile (OHIP-14) has been widely used as a measure for oral health-related quality of life (OHQoL) since its publication in 1997. However, few studies have examined its psychometric properties and relationship with patient-reported oral health in pregnant women. Aim: To offer empirical evidence for appropriate use of the OHIP-14 among pregnant women in research and clinical practice. Objectives: (1) to empirically investigate the psychometric properties of the OHIP-14, (2) to modify it into the MOHIP-14PW (modified OHIP-14 for pregnant women), and (3) to compare their relationships with patient-reported oral health in pregnant women. Methods: In this real-world study (RWS) from suburban New York clinics, we collected OHIP-14 data from 291 pregnant women and assessed its psychometric properties at the item-, dimension-, and measure-level, including confirmatory factor analysis (CFA) and exploratory factor analysis (EFA). Accordingly, we modified the OHIP-14 into the MOHIP-14PW. Finally, we compared their correlations with patient-reported oral health scores. Results: All OHIP-14 items had severely skewed distributions, and two had a correlation with the patient-reported oral health < 0.1. All seven pairs of items correlated well (0.47 to 0.62), but the Cronbach’s alphas indicated suboptimal reliability, with two below 0.70. CFA results offered suboptimal support to the original structure, and EFA found a three-dimensional structure best fitted the data. Therefore, we modified the OHIP-14 into the MOHIP-14PW. CFA on the MOHIP-14PW offered stronger supports, and the Cronbach’s alphas increased to 0.92, 0.72, and 0.71. The MOHIP-14PW’s dimensions were more meaningful to pregnant women and had stronger relationships with patient-reported oral health than the OHIP-14; the average correlation coefficients increased by 26% from 0.19 in OHIP-14 to 0.24 in the MOHIP-14PW. Conclusions: The original OHIP-14 required modifications at the item-, dimension-, and measure- level, and the MOHIP-14PW had better psychometric properties, easier interpretation, and stronger correlation with patient-reported oral health in low-income pregnant women. Through an interdisciplinary RWS on a large sample of pregnant women, this study offers concrete empirical evidence for the advantages of the MOHIP-14PW over the original OHIP-14.

Quality Appraisal of Child Oral Health-Related Quality of Life Measures: A Scoping Review

BACKGROUND

Children's oral health-related quality of life (COHQoL) measures are well known and widely used. However, rigorous systematic reviews of these measures and analyses of their quality are in absence.

OBJECTIVES

To systematically review and quantitatively assess the quality of COHQoL measures through a scoping review.

DATA SOURCES

Systematic literature search of PubMed, CINAHL (Cumulative Index to Nursing and Allied Health Literature), EMBASE (Excerpta Medica database), HaPI (Health and Psychosocial Instruments), and DOSS (Dentistry and Oral Sciences Source).

STUDY ELIGIBILITY

The measure's focus was COHQoL; the child age ranged from 5 to 14 years; the publication was either a research article or a systematic review and related to caries; and it was written in English or had an English abstract. Two authors independently selected the studies. Disagreements were reconciled by group discussions with a third author.

APPRAISAL

The International Society for Quality of Life Research minimum standards for patient-reported outcome measures were used for quality appraisal.

SYNTHESIS

Descriptive analysis.

RESULTS

We identified 18 measures. Their quality scores ranged from 9.5 to 15.0 on a scale of 16. The quality appeared to bear no relationship to the citation and use of these measures. However, elements of these measures might be more useful than others, depending on the age-specific use and primary quality concerns.

LIMITATIONS

Some of the information on the minimum standards of the 18 measures cannot be found in the existing literature. Measures published without English abstract were not searched.

CONCLUSIONS

The quality of these measures is suboptimal. Researchers and practitioners in this field should exercise caution when choosing and using these measures. Efforts at improving the quality of the COHQoL measures, such as refining existing ones or developing new measures, are warranted.

KNOWLEDGE TRANSFER STATEMENT

Researchers, clinician scientists, and clinicians can use the results of this study when deciding which oral health-related quality of life measure they wish to use in children.

Generalizing findings from a randomized controlled trial to a real-world study of the iLookOut, an online education program to improve early childhood care and education providers' knowledge and attitudes about reporting child maltreatment

In recent years, real-world studies (RWS) are gaining increasing interests, because they can generate more realistic and generalizable results than randomized controlled clinical trials (RCT). In 2017, we published a RCT in 741 early childhood care and education providers (CCPs). It is the Phase I of our iLookOut for Child Abuse project (iLookOut), an online, interactive learning module about reporting suspected child maltreatment. That study demonstrated that in a RCT setting, the iLookOut is efficient at improving CCPs’ knowledge of and attitudes towards child maltreatment reporting. However, the generalizability of that RCT’s results in a RWS setting remains unknown. To address this question, we design and conduct this large RWS in 11,065 CCPs, which is the Phase II of the iLookOut. We hypothesize replication of the earlier RCT findings, i.e., the iLookOut can improve CCPs’ knowledge of and attitudes toward child maltreatment reporting in a real world setting. In addition, this RWS also explores whether demographic factors affect CCPs’ performance. Results of this RWS confirmed the generalizability of the previous RCT’s results in a real world setting. It yielded similar effect sizes for knowledge and attitudes as were found in the earlier RCT. Cohen’s d for knowledge improvement was 0.95 in that RCT, 0.96 in this RWS; Cohen’s d for attitude improvement was 0.98 in that RCT, 0.80 in this RWS. Also, we found several significant differences in knowledge and attitude improvement with regard to age, race, education, and employment status. In conclusion, iLookOut improves knowledge and attitudes of CCPs about child maltreatment prevention and reporting in a real-world setting. The generalizability of the initial RCT findings to this RWS provides strong evidence that the iLookout will be effective in other real world settings. It can be a useful model for other interventions aimed at preventing child maltreatment.

Clinical trial registration for the original RCT: NCT02225301 (ClinicalTrials.gov Identifier)