scholarly journals Assessing the Predictive Validity of Simple Dementia Risk Models in Harmonized Stroke Cohorts

Stroke ◽  
2020 ◽  
Vol 51 (7) ◽  
pp. 2095-2102
Author(s):  
Eugene Y.H. Tang ◽  
Christopher I. Price ◽  
Louise Robinson ◽  
Catherine Exley ◽  
David W. Desmond ◽  
...  

Background and Purpose: Stroke is associated with an increased risk of dementia. To assist in the early identification of individuals at high risk of future dementia, numerous prediction models have been developed for use in the general population. However, it is not known whether such models also provide accurate predictions among stroke patients. Therefore, the aim of this study was to determine whether existing dementia risk prediction models that were developed for use in the general population can also be applied to individuals with a history of stroke to predict poststroke dementia with equivalent predictive validity. Methods: Data were harmonized from 4 stroke studies (follow-up range, ≈12–18 months poststroke) from Hong Kong, the United States, the Netherlands, and France. Regression analysis was used to test 3 risk prediction models: the Cardiovascular Risk Factors, Aging and Dementia score, the Australian National University Alzheimer Disease Risk Index, and the Brief Dementia Screening Indicator. Model performance or discrimination accuracy was assessed using the C statistic or area under the curve. Calibration was tested using the Grønnesby and Borgan and the goodness-of-fit tests. Results: The predictive accuracy of the models varied but was generally low compared with the original development cohorts, with the Australian National University Alzheimer Disease Risk Index (C-statistic, 0.66) and the Brief Dementia Screening Indicator (C-statistic, 0.61) both performing better than the Cardiovascular Risk Factors, Aging and Dementia score (area under the curve, 0.53). Conclusions: Dementia risk prediction models developed for the general population do not perform well in individuals with stroke. Their poor performance could have been due to the need for additional or different predictors related to stroke and vascular risk factors or methodological differences across studies (eg, length of follow-up, age distribution). Future work is needed to develop simple and cost-effective risk prediction models specific to poststroke dementia.

2021 ◽  
Vol 4 ◽  
Author(s):  
Samuel O. Danso ◽  
Zhanhang Zeng ◽  
Graciela Muniz-Terrera ◽  
Craig W. Ritchie

Alzheimer's disease (AD) has its onset many decades before dementia develops, and work is ongoing to characterise individuals at risk of decline on the basis of early detection through biomarker and cognitive testing as well as the presence/absence of identified risk factors. Risk prediction models for AD based on various computational approaches, including machine learning, are being developed with promising results. However, these approaches have been criticised as they are unable to generalise due to over-reliance on one data source, poor internal and external validations, and lack of understanding of prediction models, thereby limiting the clinical utility of these prediction models. We propose a framework that employs a transfer-learning paradigm with ensemble learning algorithms to develop explainable personalised risk prediction models for dementia. Our prediction models, known as source models, are initially trained and tested using a publicly available dataset (n = 84,856, mean age = 69 years) with 14 years of follow-up samples to predict the individual risk of developing dementia. The decision boundaries of the best source model are further updated by using an alternative dataset from a different and much younger population (n = 473, mean age = 52 years) to obtain an additional prediction model known as the target model. We further apply the SHapely Additive exPlanation (SHAP) algorithm to visualise the risk factors responsible for the prediction at both population and individual levels. The best source model achieves a geometric accuracy of 87%, specificity of 99%, and sensitivity of 76%. In comparison to a baseline model, our target model achieves better performance across several performance metrics, within an increase in geometric accuracy of 16.9%, specificity of 2.7%, and sensitivity of 19.1%, an area under the receiver operating curve (AUROC) of 11% and a transfer learning efficacy rate of 20.6%. The strength of our approach is the large sample size used in training the source model, transferring and applying the “knowledge” to another dataset from a different and undiagnosed population for the early detection and prediction of dementia risk, and the ability to visualise the interaction of the risk factors that drive the prediction. This approach has direct clinical utility.


BMC Cancer ◽  
2022 ◽  
Vol 22 (1) ◽  
Author(s):  
Michele Sassano ◽  
Marco Mariani ◽  
Gianluigi Quaranta ◽  
Roberta Pastorino ◽  
Stefania Boccia

Abstract Background Risk prediction models incorporating single nucleotide polymorphisms (SNPs) could lead to individualized prevention of colorectal cancer (CRC). However, the added value of incorporating SNPs into models with only traditional risk factors is still not clear. Hence, our primary aim was to summarize literature on risk prediction models including genetic variants for CRC, while our secondary aim was to evaluate the improvement of discriminatory accuracy when adding SNPs to a prediction model with only traditional risk factors. Methods We conducted a systematic review on prediction models incorporating multiple SNPs for CRC risk prediction. We tested whether a significant trend in the increase of Area Under Curve (AUC) according to the number of SNPs could be observed, and estimated the correlation between AUC improvement and number of SNPs. We estimated pooled AUC improvement for SNP-enhanced models compared with non-SNP-enhanced models using random effects meta-analysis, and conducted meta-regression to investigate the association of specific factors with AUC improvement. Results We included 33 studies, 78.79% using genetic risk scores to combine genetic data. We found no significant trend in AUC improvement according to the number of SNPs (p for trend = 0.774), and no correlation between the number of SNPs and AUC improvement (p = 0.695). Pooled AUC improvement was 0.040 (95% CI: 0.035, 0.045), and the number of cases in the study and the AUC of the starting model were inversely associated with AUC improvement obtained when adding SNPs to a prediction model. In addition, models constructed in Asian individuals achieved better AUC improvement with the incorporation of SNPs compared with those developed among individuals of European ancestry. Conclusions Though not conclusive, our results provide insights on factors influencing discriminatory accuracy of SNP-enhanced models. Genetic variants might be useful to inform stratified CRC screening in the future, but further research is needed.


Circulation ◽  
2008 ◽  
Vol 118 (2) ◽  
Author(s):  
Morris Schambelan ◽  
Peter W.F. Wilson ◽  
Kevin E. Yarasheski ◽  
W. Todd Cade ◽  
Victor G. Dávila-Román ◽  
...  

2020 ◽  
Vol 16 (S10) ◽  
Author(s):  
Jantje Goerdten ◽  
Iva Čukić ◽  
Samuel O Danso ◽  
Isabelle Carriere ◽  
Graciela Muniz Terrera

2015 ◽  
Vol 2015 ◽  
pp. 1-31 ◽  
Author(s):  
Wenda He ◽  
Arne Juette ◽  
Erika R. E. Denton ◽  
Arnau Oliver ◽  
Robert Martí ◽  
...  

Breast cancer is the most frequently diagnosed cancer in women. However, the exact cause(s) of breast cancer still remains unknown. Early detection, precise identification of women at risk, and application of appropriate disease prevention measures are by far the most effective way to tackle breast cancer. There are more than 70 common genetic susceptibility factors included in the current non-image-based risk prediction models (e.g., the Gail and the Tyrer-Cuzick models). Image-based risk factors, such as mammographic densities and parenchymal patterns, have been established as biomarkers but have not been fully incorporated in the risk prediction models used for risk stratification in screening and/or measuring responsiveness to preventive approaches. Within computer aided mammography, automatic mammographic tissue segmentation methods have been developed for estimation of breast tissue composition to facilitate mammographic risk assessment. This paper presents a comprehensive review of automatic mammographic tissue segmentation methodologies developed over the past two decades and the evidence for risk assessment/density classification using segmentation. The aim of this review is to analyse how engineering advances have progressed and the impact automatic mammographic tissue segmentation has in a clinical environment, as well as to understand the current research gaps with respect to the incorporation of image-based risk factors in non-image-based risk prediction models.


2021 ◽  
Author(s):  
Gabriella Gatt ◽  
Nikolai Attard

Abstract BackgroundDespite increasing prevalence, age specific risk predictive models for erosive tooth wear in preschool age children have not been developed. Identification of at risk groups and the timely introduction of behavioural change or treatment will stop the progression of erosive wear in the permanent dentition. The aim of this study was to identify age specific risk factors for erosive wear. Distinct risk prediction models for three year old and five year old children were developed.MethodsA prospective cohort study included clinical examinations and parent administered questionnaires for three and five-year-old children. Chi-square tests explored categorical demographic variables, Spearman Rank Order correlation tests examined changes in BEWE scores with changes in food frequencies while Wilcoxon signed rank tests evaluated the temporal effect of frequencies of consumption of dietary items. Mann-Whitney U tests compared changes in BEWE scores over time for the twenty-six bivariate categorical variables and Kruskall-Wallis tests compared changes in BEWE scores over time across the remaining 55 categorical variables representing demographic factors, oral hygiene habits and dietary habits. Change in BEWE scores for continuous variables was investigated using Spearman Rho correlation coefficient Test. Those variables showing significance with a difference in BEWE cumulative score over time were utilised to develop two risk prediction models. The models were evaluated by Receiver Operating Characteristics (ROC) analysis.ResultsRisk factors for the three-year-old cohort included the erosive wear (χ2 (1, 92) = 12.829, p < 0.001), district (χ2 (5, 92) = 17.032, p = 0.004) and family size (χ2 (1, 92) = 4.547, p = 0.033). Risk factors for the five-year-old cohort also included erosive wear (χ2 (1, 144) = 4.768, p = 0.029) gender (χ2 (1, 144) = 19.399, p <0.001), consumption of iced tea (χ2 (1, 144) = 8.872, p = 0.003) and dry mouth (χ2 (1, 144) = 9.598, p = 0.002).Conclusions: Predictive risk factors for three-year-old children are based on demographic factors and are distinct from those for the five-year-old cohort, which are based on biological and behavioural factors. The presence of erosive wear is a risk factor for further wear in both age cohorts.


2021 ◽  
Author(s):  
Jamie M Boyd ◽  
Matthew T James ◽  
Danny J Zuege ◽  
Henry Thomas Stelfox

Abstract Background Patients being discharged from the intensive care unit (ICU) have variable risks of subsequent readmission or death; however, there is limited understanding of how to predict individual patient risk. We sought to derive risk prediction models for ICU readmission or death after ICU discharge to guide clinician decision-making. Methods Systematic review and meta-analysis to identify risk factors. Development and validation of risk prediction models using two retrospective cohorts of patients discharged alive from medical-surgical ICUs (n = 3 ICUs, n = 11,291 patients; n = 14 ICUs, n = 11,400 patients). Models were developed using literature and data-derived weighted coefficients. Results Sixteen variables identified from the systematic review were used to develop four risk prediction models. In the validation cohort there were 795 (7%) patients who were re-admitted to ICU and 703 (7%) patients who died after ICU discharge. The area under the curve (AUROC) for ICU readmission for the literature (0.615 [95%CI: 0.593, 0.637]) and data (0.652 [95%CI: 0.631, 0.674]) weighted models showed poor discrimination. The AUROC for death after ICU discharge for the literature (0.708 [95%CI: 0.687, 0.728]) and local data weighted (0.752 [95%CI: 0.733, 0.770]) models showed good discrimination. The negative predictive values for ICU readmission and death after ICU discharge ranged from 94%-98%. Conclusions Identifying risk factors and weighting coefficients using systematic review and meta-analysis to develop prediction models is feasible and can identify patients at low risk of ICU readmission or death after ICU discharge.


Sign in / Sign up

Export Citation Format

Share Document