Prediction of an Imminent Fracture After an Index Fracture - Models Derived From the Frisbee Cohort

Patients who sustain a fracture are at greatest risk of recurrent fracture during the next 2 years. We propose three models to identify subjects most at risk of an imminent fracture, according to fracture site (any fracture, major osteoporotic fracture [MOF] or central). They were constructed using data of the prospective Frisbee cohort, which includes 3560 postmenopausal women aged 60 to 85 years who were followed for at least 5 years. A total of 881 subjects had a first incident validated fragility fracture before December 2018. Among these, we validated 130 imminent fractures occurring within the next 2 years; 79 were MOFs, and 88 were central fractures. Clinical risk factors were re-evaluated at the time of the index fracture. Fine and Gray proportional hazard models were derived separately for each group of fractures. The following risk factors were significantly associated with the risk of any imminent fracture: total hip bone mineral density (BMD) (p < 0.001), a fall history (p < 0.001), and comorbidities (p = 0.03). Age (p = 0.05 and p = 0.03, respectively) and a central fracture as the index fracture (p = 0.04 and p = 0.005, respectively) were additional predictors of MOFs and central fractures. The three prediction models are presented as nomograms. The calibration curves and the Brier scores based on bootstrap resampling showed calibration scores of 0.089 for MOF, 0.094 for central fractures, and 0.132 for any fractures. The predictive accuracy of the models expressed as area under the receiver operating characteristic (AUROC) curve (AUC) were 0.74 for central fractures, 0.72 for MOFs, and 0.66 for all fractures, respectively. These AUCs compare well with those of FRAX and Garvan to predict the 5- or 10-year fracture probability. In summary, five predictors (BMD, age, comorbidities, falls, and central fracture as the incident fracture) allow the calculation with a reasonable accuracy of the imminent risk of fracture at different sites (MOF, central fracture, and any fracture) after a recent sentinel fracture. © 2021 American Society for Bone and Mineral Research (ASBMR).

A Validated Risk Prediction Model for Bone Fragility in Children With Acute Lymphoblastic Leukemia

Although bone fragility may already be present at diagnosis of pediatric acute lymphoblastic leukemia (ALL), routine performance of dual-energy X-ray absorptiometry (DXA) in every child is not universally feasible. The aim of this study was to develop and validate a risk prediction model for low lumbar spine bone mineral density (LS BMD Z-score ≤ -2.0) at diagnosis, as an important indicator for fracture risk and further treatment-related BMD aggravation. Children with ALL (4-18 years), treated according to the Dutch Childhood Oncology Group protocol (DCOG-ALL9; model development; n = 249) and children from the Canadian Steroid-Associated Osteoporosis in the Pediatric Population cohort (STOPP; validation; n = 99) were included in this study. Multivariable logistic regression analyses were used to develop the prediction model and to confirm the association of low LS BMD at diagnosis with symptomatic fractures during and shortly after cessation of ALL treatment. The area under the receiver operating characteristic curve (AUC) was used to assess model performance. The prediction model for low LS BMD at diagnosis using weight (β = -0.70) and age (β = -0.10) at diagnosis revealed an AUC of 0.71 (95% CI, 0.63-0.78) in DCOG-ALL9 and 0.74 (95% CI, 0.63-0.84) in STOPP, and resulted in correct identification of 71% of the patients with low LS BMD. We confirmed that low LS BMD at diagnosis is associated with LS BMD at treatment cessation (OR 5.9; 95% CI, 3.2-10.9) and with symptomatic fractures (OR 1.7; 95% CI, 1.3-2.4) that occurred between diagnosis and 12 months following treatment cessation. In meta-analysis, LS BMD at diagnosis (OR 1.6; 95% CI, 1.1-2.4) and the 6-month cumulative glucocorticoid dose (OR 1.9; 95% CI, 1.1-3.2) were associated with fractures that occurred in the first year of treatment. In summary, a prediction model for identifying pediatric ALL patients with low LS BMD at diagnosis, as an important indicator for bone fragility, was successfully developed and validated. This can facilitate identification of future bone fragility in individual pediatric ALL patients. © 2021 American Society for Bone and Mineral Research (ASBMR).

Validation and development of models using clinical, biochemical and ultrasound markers for predicting pre-eclampsia: an individual participant data meta-analysis

BACKGROUND

Pre-eclampsia is a leading cause of maternal and perinatal mortality and morbidity. Early identification of women at risk is needed to plan management.

OBJECTIVES

To assess the performance of existing pre-eclampsia prediction models and to develop and validate models for pre-eclampsia using individual participant data meta-analysis. We also estimated the prognostic value of individual markers.

DESIGN

This was an individual participant data meta-analysis of cohort studies.

SETTING

Source data from secondary and tertiary care.

PREDICTORS

We identified predictors from systematic reviews, and prioritised for importance in an international survey.

PRIMARY OUTCOMES

Early-onset (delivery at < 34 weeks' gestation), late-onset (delivery at ≥ 34 weeks' gestation) and any-onset pre-eclampsia.

ANALYSIS

We externally validated existing prediction models in UK cohorts and reported their performance in terms of discrimination and calibration. We developed and validated 12 new models based on clinical characteristics, clinical characteristics and biochemical markers, and clinical characteristics and ultrasound markers in the first and second trimesters. We summarised the data set-specific performance of each model using a random-effects meta-analysis. Discrimination was considered promising for C-statistics of ≥ 0.7, and calibration was considered good if the slope was near 1 and calibration-in-the-large was near 0. Heterogeneity was quantified using I ² and τ². A decision curve analysis was undertaken to determine the clinical utility (net benefit) of the models. We reported the unadjusted prognostic value of individual predictors for pre-eclampsia as odds ratios with 95% confidence and prediction intervals.

RESULTS

The International Prediction of Pregnancy Complications network comprised 78 studies (3,570,993 singleton pregnancies) identified from systematic reviews of tests to predict pre-eclampsia. Twenty-four of the 131 published prediction models could be validated in 11 UK cohorts. Summary C-statistics were between 0.6 and 0.7 for most models, and calibration was generally poor owing to large between-study heterogeneity, suggesting model overfitting. The clinical utility of the models varied between showing net harm to showing minimal or no net benefit. The average discrimination for IPPIC models ranged between 0.68 and 0.83. This was highest for the second-trimester clinical characteristics and biochemical markers model to predict early-onset pre-eclampsia, and lowest for the first-trimester clinical characteristics models to predict any pre-eclampsia. Calibration performance was heterogeneous across studies. Net benefit was observed for International Prediction of Pregnancy Complications first and second-trimester clinical characteristics and clinical characteristics and biochemical markers models predicting any pre-eclampsia, when validated in singleton nulliparous women managed in the UK NHS. History of hypertension, parity, smoking, mode of conception, placental growth factor and uterine artery pulsatility index had the strongest unadjusted associations with pre-eclampsia.

LIMITATIONS

Variations in study population characteristics, type of predictors reported, too few events in some validation cohorts and the type of measurements contributed to heterogeneity in performance of the International Prediction of Pregnancy Complications models. Some published models were not validated because model predictors were unavailable in the individual participant data.

CONCLUSION

For models that could be validated, predictive performance was generally poor across data sets. Although the International Prediction of Pregnancy Complications models show good predictive performance on average, and in the singleton nulliparous population, heterogeneity in calibration performance is likely across settings.

FUTURE WORK

Recalibration of model parameters within populations may improve calibration performance. Additional strong predictors need to be identified to improve model performance and consistency. Validation, including examination of calibration heterogeneity, is required for the models we could not validate.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42015029349.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 72. See the NIHR Journals Library website for further project information.

A Novel Fracture Prediction Model Using Machine Learning in a Community-Based Cohort

The prediction of fracture risk in osteoporotic patients has been a topic of interest for decades, and models have been developed for the accurate prediction of fracture, including the fracture risk assessment tool (FRAX). As machine-learning methodologies have recently emerged as a potential model for medical prediction tools, we aimed to develop a novel fracture prediction model using machine-learning methods in a prospective community-based cohort. In this study, 2227 participants (1257 females) with a baseline bone mineral density (BMD) and trabecular bone score were enrolled from the Ansung cohort. The primary endpoint was the fragility fractures reported by patients or confirmed by X-rays. We used 3 different models: CatBoost, support vector machine (SVM), and logistic regression. During a mean 7.5-year follow-up (range, 2.5 to 10 years), fragility fractures occurred in 537 (25.6%) of participants. In predicting total fragility fractures, the area under the curve (AUC) values of the CatBoost, SVM, and logistic regression models were 0.688, 0.500, and 0.614, respectively. The AUC value of CatBoost was significantly better than that of FRAX (0.663; p < 0.001), whereas the the SVM and logistic regression models were not. Compared with the conventional models such as SVM and logistic regression, the CatBoost model had the best performance in predicting total fragility fractures (p < 0.001). According to feature importance in the CatBoost model, the top predicting factors (listed in order) were total hip, lumbar spine, and femur neck BMD, subjective arthralgia score, serum creatinine, and homocysteine. The latter three factors were listed higher than conventional predictors such as age or previous fracture history. In summary, we hereby report the development of a prediction model for fragility fractures using a machine-learning method, CatBoost, which outperforms the FRAX model as well as two conventional machine-learning models. The model was also able to propose novel high-ranking predictors. © 2020 The Authors. JBMR Plus published by Wiley Periodicals, Inc. on behalf of American Society for Bone and Mineral Research.