Development and Evaluation of a High-Fidelity Rhinoplasty Simulator

SUMMARY

Rhinoplasty is a challenging procedure with a steep learning curve. Surgical simulators provide a safe platform to gain hands-on experience without compromising patient outcomes. Therefore, rhinoplasty is an ideal procedure to benefit from an effective surgical simulator. A high-fidelity rhinoplasty simulator was developed using three-dimensional computer modeling, three-dimensional printing, and polymer techniques. The simulator was tested by six surgeons with experience in rhinoplasty to assess realism, anatomic accuracy, and value as a training tool. The surgeons performed common rhinoplasty techniques and were provided a Likert-type questionnaire assessing the anatomic features of the simulator. A variety of surgical techniques were performed successfully using the simulator, including open and closed approaches. Bony techniques performed included endonasal osteotomies and rasping. Submucous resection with harvest of septal cartilage, cephalic trim, and tip suturing, as well as grafting techniques including alar rim, columellar strut, spreader, and shield grafts, were performed successfully. Overall, there was agreement on the simulator's anatomic accuracy of bony and soft-tissue features. There was strong agreement on the simulator's overall realism and value as a training tool. The simulator provides a high-fidelity, comprehensive training platform to learn rhinoplasty techniques to augment real operating experience without compromising patient outcomes.

Cleft lip and/or palate mortality trends in the USA: a retrospective population-based study

BACKGROUND

Cleft lip and/or palate (CL/P) is one of the most common congenital anomalies worldwide. Although CL/P management may require a series of interventions, mortality resulting from CL/P alone is rare. This study aims to examine recent trends of CL/P mortality rates in the USA.

METHODS

A retrospective population-based study was conducted using official US birth and death certificate data from the Centers for Disease Control and Prevention from 2000 to 2019. Annual mortality rates per 1000 births with CL/P were calculated across sex and racial groups. Multivariable logistic regression models estimated the effects of sex and race on the risk of mortality with CL/P, and linear regression models were used to examine temporal changes in mortality rate across sex and race.

RESULTS

From 2000 to 2019, 1119 deaths occurred in patients with documented CL/P, for an overall incidence of 20.3 deaths per 1000 births with CL/P (95% CI 18.9 to 22.8). Of these, Patau syndrome was the listed cause of death in 167 cases (14.9%). Black individuals (OR 1.93, 95% CI 1.85 to 2.01), Hispanic (1.54, 1.49 to 1.58) and American Indian individuals (1.28, 1.20 to 1.35) were at a greater risk of CL/P mortality compared with white individuals. Additionally, females were also at a greater risk (1.35, 1.21 to 1.49). A significant upward trend in CL/P mortality was observed in Hispanic (r2=0.70, p<0.01) and American Indian individuals (r2=0.81, p<0.01) from 2000 to 2019.

CONCLUSIONS

Cleft birth and mortality surveillance is essential in healthcare and prevention planning. Future studies are required to understand the differences in CL/P mortality rates across various sociodemographic groups.

Recursive Partitioning vs Computerized Adaptive Testing to Reduce the Burden of Health Assessments in Cleft Lip and/or Palate: Comparative Simulation Study

BACKGROUND

Computerized adaptive testing (CAT) has been shown to deliver short, accurate, and personalized versions of the CLEFT-Q patient-reported outcome measure for children and young adults born with a cleft lip and/or palate. Decision trees may integrate clinician-reported data (eg, age, gender, cleft type, and planned treatments) to make these assessments even shorter and more accurate.

OBJECTIVE

We aimed to create decision tree models incorporating clinician-reported data into adaptive CLEFT-Q assessments and compare their accuracy to traditional CAT models.

METHODS

We used relevant clinician-reported data and patient-reported item responses from the CLEFT-Q field test to train and test decision tree models using recursive partitioning. We compared the prediction accuracy of decision trees to CAT assessments of similar length. Participant scores from the full-length questionnaire were used as ground truth. Accuracy was assessed through Pearson's correlation coefficient of predicted and ground truth scores, mean absolute error, root mean squared error, and a two-tailed Wilcoxon signed-rank test comparing squared error.

RESULTS

Decision trees demonstrated poorer accuracy than CAT comparators and generally made data splits based on item responses rather than clinician-reported data.

CONCLUSIONS

When predicting CLEFT-Q scores, individual item responses are generally more informative than clinician-reported data. Decision trees that make binary splits are at risk of underfitting polytomous patient-reported outcome measure data and demonstrated poorer performance than CATs in this study.

Psychometric Validation of the FACE-Q Craniofacial Module for Facial Nerve Paralysis

Background: Systematic reviews have identified the need for a patient-reported outcome measure for facial nerve paralysis (FNP). The aim of this study was to determine the psychometric properties of FACE-Q Craniofacial module scales when used in a combined sample of children and older adults with FNP. Methods: Data were collected between December 2016 and December 2019. We conducted qualitative interviews with children and adults with FNP. FACE-Q data were collected from patients aged 8 years and older with FNP. Rasch measurement theory analysis was used to examine the reliability and validity of the relevant scales in the FNP sample. Results: Twenty-five patients provided 2052 qualitative codes related to appearance, physical, psychological, and social function. Many patient concerns were common across age. The field-test sample included 235 patients aged 8-81 years. Of the 13 scales examined, all 122 items had ordered thresholds and good item fit to the Rasch model. For 12 scales, person separation index values were ≥0.79 and Cronbach's alpha values were ≥0.82. The 13th scale's reliability values were ≥0.71. Conclusion: The FACE-Q Craniofacial module scales described in this study can be used to collect and compare evidence-based outcome data from children and adults with FNP.

Establishing content validity of an orthodontic subset of the FACE-Q Craniofacial Module in children and young adults with malocclusion

OBJECTIVE

The FACE-Q Craniofacial Module for children and young adults is a patient-reported outcome measure (PROM) designed to measure outcomes for patients aged 8 to 29 years with facial conditions. The aim of this study was to establish content validity of a relevant subset of the module for its use in orthodontic patients with malocclusion.

SETTING AND SAMPLE POPULATION

Experts in orthodontics were emailed and invited to provide feedback through a Research Electronic Data Capture survey. Patient feedback was obtained through cognitive interviews with patients aged 8 to 29 years recruited from a university-based orthodontic clinic in Canada.

MATERIALS AND METHODS

Expert opinion and patient interviews were used to obtain feedback on the content of 4 appearance (face, smile, teeth and jaws) and 1 function (eating and drinking) scales hypothesized to be relevant to orthodontic malocclusions, and to elicit new concepts. Interviews were audio-recorded, transcribed, and coded using a line-by-line approach.

RESULTS

Twenty-one experts and 15 patients participated. Expert feedback led us to drop 9, retain 40, revise 4 and add 16 new items. At the conclusion of cognitive interviews no items were dropped, 55 were retained, 5 were revised and 8 new items were added. The final set of 68 items demonstrated content validity for orthodontic patients.

CONCLUSION

Expert feedback and cognitive interviews enabled us to revise and refine 5 scales as part of the FACE-Q Craniofacial Module for use in orthodontic patients. These scales were included in the internationalfield-test of the FACE-Q Craniofacial Module.

Optimising the computerised adaptive test to reliably reduce the burden of administering the CLEFT-Q: A Monte Carlo simulation study

BACKGROUND

Computerised adaptive testing (CAT) has the potential to transform plastic surgery outcome measurement by making patient-reported outcome measures (PROMs) shorter, individualised and more accurate than pen-and-paper questionnaires.

OBJECTIVES

This paper reports the results of two optimisation studies for the CLEFT-Q CAT, a CAT intended for use in the field of cleft lip and/or palate. Specifically, we aimed to identify the optimal score estimation and item selection methods for using this CAT in clinical practice. These represent two major components of any CAT algorithm.

METHOD

Monte Carlo simulations were performed using simulated data in the R statistical computing environment and incorporated a range of score estimation and item selection techniques. The performance and accuracy of the CAT was assessed by mean items administered, correlation between CAT scores and paired linear assessment scores, and the root mean squared deviation (RMSD) of these score pairs.

RESULTS

The accuracy of the CLEFT-Q CAT was not significantly affected by the choice of score estimation or item selection method. Sub-scales which originally contain more items were amenable to greater item reduction with CAT.

CONCLUSION

This study shows that score estimation and item selection methods that need minimal processing power can be used in the CLEFT-Q CAT without compromising accuracy. This means that the CLEFT-Q CAT could be administered quickly and efficiently with basic hardware demands. We recommend the use of less computationally intensive techniques in future CLEFT-Q CAT studies.

Concepts Important to Patients With Facial Differences: A Qualitative Study Informing a New Module of the FACE-Q for Children and Young Adults

Objective:

The concepts important to children and young adults who undergo treatments for facial differences are not well-defined. Measurement of treatment outcomes from the patient’s perspective is necessary to ensure goals of treatment are met. We aimed to identify concepts important to children and young adults with facial differences through a qualitative study.

Design:

An interpretive description qualitative approach was followed. Semistructured interviews were conducted, transcribed verbatim, and coded using a line-by-line approach. Qualitative analysis led to the development of a conceptual framework of outcomes important to patients.

Setting:

Interviews were conducted in Canada and the United Kingdom at home, by telephone, or in the hospital.

Participants:

Participants (N = 72) were recruited between May and June 2014 from craniofacial clinics at the Hospital for Sick Children (Toronto) and Great Ormond Street Hospital (London). Participants included anyone with a visible and/or functional facial difference aged 8 to 29 years and fluent in English, excluding patients with a cleft. The sample included 38 females and 34 males, with a mean age of 13.9 years, and included 28 facial conditions (11 facial paralysis, 18 ear anomalies, 26 skeletal conditions, and 17 soft tissue conditions).

Results:

Analysis led to identification of important concepts within 4 overarching domains: facial appearance, facial function, adverse effects of treatment, and health-related quality of life (psychological, social, and school function).

Conclusions:

Our study provides an understanding of concepts important to children and young adults with facial differences.

Impact of Completing CLEFT-Q Scales That Ask About Appearance on Children and Young Adults: An International Study

OBJECTIVE

To describe the impact of completing the CLEFT-Q appearance scales on patients with cleft lip and/or palate and to identify demographic and clinical characteristics and CLEFT-Q scores associated with reporting a negative impact.

DESIGN

International cross-sectional survey.

SETTING

Recruitment took place between October 2014 and November 2016 at 30 craniofacial clinics located in 12 countries.

PATIENTS

Aged 8 to 29 years with cleft lip and/or palate.

MAIN OUTCOME MEASURE(S)

Participants were asked 4 questions to evaluate the impact of completing the field test version of a patient-reported outcome measure (the CLEFT-Q) that included 154 items, of which 79 (51%) asked about appearance (of the face, nose, nostrils, teeth, lips, jaws, and cleft lip scar).

RESULTS

The sample included 2056 participants. Most participants liked answering the CLEFT-Q (88%) and the appearance questions (82%). After completing the appearance scales, most participants (77%) did not feel upset or unhappy about how they look, and they felt the same (67%) or better (23%) about their appearance after completing the questionnaire. Demographic and clinical variables associated with feeling unhappy/upset or worse about how they look included country of residence, female gender, more severe cleft, anticipating future cleft-specific surgeries, and reporting lower (ie, worse) scores on CLEFT-Q appearance and health-related quality-of-life scales.

CONCLUSION

Most participants liked completing the CLEFT-Q, but a small minority reported a negative impact. When used in clinical practice, CLEFT-Q scale scores should be examined as soon as possible after completion in order that the clinical team might identify patients who might require additional support.

Further construct validation of the CLEFT-Q: Ability to detect differences in outcome for four cleft-specific surgeries

BACKGROUND

The CLEFT-Q is a patient-reported outcome measure developed for use in patients with cleft lip and/or palate. A significant indicator of the CLEFT-Q's validity relates to its ability to detect differences between the impact of specific aspects of clefting before and after surgery. This study compares relevant sub-scale scores of the CLEFT-Q for patients requiring four specific surgical treatments against those who either have had surgery or never needed surgery.

METHODS

CLEFT-Q scores and clinical information regarding the past and future need for jaw surgery, lip revision, rhinoplasty, and speech surgery were obtained from the CLEFT-Q field-test data. Eight one-way analysis of variance (ANOVA) models were developed to compare mean scores of relevant CLEFT-Q scales between those who needed surgery, those who have had surgery, and those who never needed surgery. Only patients from high-income countries were included to minimize the impact of any economic confounders that could result in treatment variation. In the rhinoplasly and lip revision models, patients without a cleft lip were excluded. In the jaw surgery and speech surgery models, patients without a cleft palate or alveolus were excluded.

RESULTS

The CLEFT-Q field test included 1938 participants from high-income countries. Participants who needed surgery scored significantly lower (worse) than those who have had surgery in each of the eight relevant CLEFT-Q scales (p < 0.001 in each ANOVA).

CONCLUSION

The ability of the CLEFT-Q to detect differences between groups based on surgical status further supports its validity.

What Matters to Patients With Cleft Lip and/or Palate

Objective:

The goal of treatment for individuals with cleft lip and/or palate (CL/P) is to improve physical, psychological, and social health. Outcomes of treatment are rarely measured from the patient’s perspective. The aim of the study was to develop a conceptual framework for a patient-reported outcome (PRO) instrument for individuals with clefts (CLEFT-Q) by developing an in-depth understanding of issues that individuals consider to be important.

Design:

The qualitative methodology of interpretive description was used. Setting, Participants, and Intervention: We performed 136 individual in-depth interviews with participants with clefts of any age, presenting for cleft care, across 6 countries. Parents were involved if the child was more comfortable. Interviews were audio-recorded, transcribed verbatim, and coded using constant comparison. The data were used to develop a refined conceptual framework.

Results:

Participants described concepts of interest in 3 top-level domains, each of which included subdomains: appearance (face, nose, nostrils, teeth, lips, jaw, cleft lip scar), health-related quality of life (psychological, social, school, speech-related distress), and facial function (speech, eating/drinking). Participants were able to describe changes over time with regard to the 3 domains.

Conclusions:

A conceptual framework of concepts of interest to individuals with CL/P formed the basis of the scales in the CLEFT-Q. Each subdomain represents an independently functioning scale. Understanding what matters to patients is essential in guiding PRO measurement.

Translation and cultural adaptation of the CLEFT-Q for use in Colombia, Chile, and Spain

BACKGROUND

Cleft lip and/or palate (CL/P) is a common congenital craniofacial anomaly that may negatively affect an individual's appearance, health-related quality of life, or speech. In Spain, Colombia, and Chile the overall prevalence of CL/P ranges from 0.53 to 1.59 cases per 1000 live births. Currently, there is no patient-reported outcome (PRO) instrument that is specific for patients with CL/P. The CLEFT-Q is a new PRO instrument developed to measure outcomes of treatment in patients 8 to 29 years of age with CL/P. The aim of this study was to translate and culturally adapt the CLEFT-Q for use in Colombia, Chile, and Spain.

METHODS

The CLEFT-Q was translated from English to 3 Spanish language varieties (Colombian, Chilean, and Spanish (Spain)) and Catalan. Translation and cultural adaptation guidelines set forth by the International Society for Pharmacoeconomics and Outcomes Research were followed.

RESULTS

The field- test version of the CLEFT-Q consisted of 13 scales (total 154 items) measuring appearance, health-related quality of life, and facial function. Forward translations revealed 10 (7%) items that were difficult to translate into Chilean, and back translations identified 34 (22%) and 21 (13%) items whose meaning differed from the English version in at least 1 of the 3 Spanish varieties and Catalan respectively. Twenty-one participants took part in cognitive debriefing interviews. Participants were recruited from plastic surgery centres in Bogotá, Colombia (n = 4), Santiago, Chile (n = 7), and Barcelona, Spain (n = 10). Most participants were males (n = 14, 67%) and were diagnosed with CL/P (n = 17, 81%). Participants reported difficulty understanding 1 item in the Colombian, 1 item in the Spanish (Spain), and 11 items from the Catalan version. Comparison of the 3 Spanish varieties revealed 61 (40%) of the 154 items whose wording differed across the 3 Spanish versions.

CONCLUSION

Translation and cultural adaptation processes provided evidence of transferability of the CLEFT-Q scales into 3 Spanish varieties and Catalan, as semantic, idiomatic, experiential, and conceptual equivalence of the items, instructions, and response options were achieved.

Development of a New Module of the FACE-Q for Children and Young Adults with Diverse Conditions Associated with Visible and/or Functional Facial Differences

Appearance and facial function are concepts not well addressed in current pediatric patient-reported outcome measures (PROM) for facial conditions. We aimed to develop a new module of the FACE-Q for children/young adults with facial conditions that include ear anomalies, facial paralysis, skeletal conditions, and soft tissue conditions. Semi-structured and cognitive interviews were conducted with patients aged 8–29 years recruited from craniofacial centers in Canada, USA, UK, and Australia. Interviews were used to elicit new concepts and to obtain feedback on CLEFT-Q scales hypothesized to be relevant to other facial conditions. Interview data were recorded, transcribed, and coded. Experts were emailed and invited to provide feedback via Research Electronic Data Capture (REDCap). Eighty-four participants and 43 experts contributed. Analysis led to the development of a conceptual framework and 14 new scales that measure appearance, facial function, health-related quality of life, and adverse effects of treatment. In addition, 12 CLEFT-Q scales were determined to have content validity for use with other facial conditions. Expert input led to minor changes to scales and items. This new FACE-Q module for children/young adults is being field-tested internationally. Once finalized, we anticipate this PROM will be used to inform clinical practice and research studies.

International multiphase mixed methods study protocol to develop a cross-cultural patient-reported outcome instrument for children and young adults with cleft lip and/or palate (CLEFT-Q)

INTRODUCTION

Patient-reported outcome (PRO) instruments should be developed according to rigorous guidelines in order to provide clinically meaningful, scientifically sound measurement. Understanding the methodology behind instrument development informs the selection of the most appropriate tool. This mixed methods protocol describes the development of an internationally applicable PRO instrument, the CLEFT-Q, for evaluating outcomes of treatment for cleft lip and/or palate (CL/P).

METHODS AND ANALYSIS

The study includes three main phases that occur iteratively and interactively. In phase I, we determine what concepts are important to patients regarding their outcome. A conceptual framework for the CLEFT-Q is formed through a systematic review and an extensive international qualitative study. The systematic review ascertains what concepts have previously been measured in patients with CL/P. The qualitative study employs interpretive description and involves in-depth interviews with patients in high-income and lower-middle income countries. Preliminary items are generated from the qualitative data. Preliminary scales are then created for each theme in the framework. Cognitive debriefing interviews and expert clinician input are used to refine the scales in an iterative process. In phase II, the preliminary scales are administered to a large international group of patients with CL/P. The modern psychometric method of Rasch Measurement Theory analysis is employed to define the measurement characteristics. The preliminary scales are shortened based on these results. In phase III, further tests assess reliability, validity and responsiveness of the instrument.

ETHICS AND DISSEMINATION

The study is approved by Research Ethics Boards for each participating site. Findings from this study will be published in open access peer-reviewed journals and presented at national and international conferences. Integrated knowledge translation is employed to engage stakeholders from the outset of the study. Successful execution of the CLEFT-Q will result in an internationally applicable PRO instrument for children and young adults with CL/P.