دورية أكاديمية

Propensity-based standardization to enhance the validation and interpretation of prediction model discrimination for a target population

التفاصيل البيبلوغرافية
العنوان: Propensity-based standardization to enhance the validation and interpretation of prediction model discrimination for a target population
المؤلفون: de Jong, Valentijn M.T., Hoogland, Jeroen, Moons, Karel G.M., Riley, Richard D., Nguyen, Tri Long, Debray, Thomas P.A.
المساهمون: Epi Methoden Team 2, Epi Methoden Team 4, Epi Methoden, Cancer, JC onderzoeksprogramma Methodologie, Circulatory Health
سنة النشر: 2023
مصطلحات موضوعية: concordance, external validation, prediction model, propensity score, standardization, Epidemiology, Statistics and Probability, Journal Article
الوصف: External validation of the discriminative ability of prediction models is of key importance. However, the interpretation of such evaluations is challenging, as the ability to discriminate depends on both the sample characteristics (ie, case-mix) and the generalizability of predictor coefficients, but most discrimination indices do not provide any insight into their respective contributions. To disentangle differences in discriminative ability across external validation samples due to a lack of model generalizability from differences in sample characteristics, we propose propensity-weighted measures of discrimination. These weighted metrics, which are derived from propensity scores for sample membership, are standardized for case-mix differences between the model development and validation samples, allowing for a fair comparison of discriminative ability in terms of model characteristics in a target population of interest. We illustrate our methods with the validation of eight prediction models for deep vein thrombosis in 12 external validation data sets and assess our methods in a simulation study. In the illustrative example, propensity score standardization reduced between-study heterogeneity of discrimination, indicating that between-study variability was partially attributable to case-mix. The simulation study showed that only flexible propensity-score methods (allowing for non-linear effects) produced unbiased estimates of model discrimination in the target population, and only when the positivity assumption was met. Propensity score-based standardization may facilitate the interpretation of (heterogeneity in) discriminative ability of a prediction model as observed across multiple studies, and may guide model updating strategies for a particular target population. Careful propensity score modeling with attention for non-linear relations is recommended.
نوع الوثيقة: article in journal/newspaper
وصف الملف: application/pdf
اللغة: English
تدمد: 0277-6715
العلاقة: https://dspace.library.uu.nl/handle/1874/449595Test
الإتاحة: https://dspace.library.uu.nl/handle/1874/449595Test
حقوق: info:eu-repo/semantics/OpenAccess
رقم الانضمام: edsbas.16A20805
قاعدة البيانات: BASE