Background:In the ACTION (NCT02109666) study, multivariable Cox proportional hazards regression models showed that the predictors of 1-year retention to abatacept treatment were: patient global pain assessment, country, reason for stopping last biologic, number of prior biologic treatments, abatacept monotherapy, RF/anti-cyclic citrullinated peptide (CCP) status, previous neoplasms, psychiatric disorders and cardiac disorders.1 Machine learning techniques, using the gradient-boosting model, subsequently identified additional predictors of abatacept retention in patients with moderate-to-severe RA enrolled in ACTION; however, the analysis did not show the directionality of the predictors.2Objectives:To improve the clinical interpretability of the machine learning model in terms of directionality and the importance of each variable in predicting retention.Methods:Previous analyses using the gradient-boosting model to identify predictors of abatacept retention at 1 year in the ACTION study have been described.2 This analysis used SHapley Additive exPlanations (SHAP), a mathematical framework, to show how a particular predictor value influences prediction in the context of all other predictors. Higher SHAP values indicate a higher likelihood of retention. The contribution of every variable in the model’s prediction (with the exception of country variables) was computed for each data point to capture individual variable impact. This enabled interpretation for level of importance and directionality at a patient level.Results:Using data from 2350 patients enrolled in ACTION (May 2008 to December 2013), the mean retention rate at 1 year was 59.3% (n=1393). Overall variable importance is shown in Figure 1. After removal of country variables, the top five baseline predictors of retention were: no previous corticosteroid use, ACR functional class II, ≥2 prior biologic treatments prior to abatacept initiation, abatacept monotherapy and HAQ-DI. In terms of directionality, no previous corticosteroid use, ≥2 prior biologic treatments prior to abatacept initiation, abatacept monotherapy and a higher HAQ-DI score at baseline were associated with a lower likelihood of retention; ACR functional class II was associated with a higher likelihood of retention.Conclusion:The gradient-boosting model previously identified predictors of abatacept retention from ACTION;2 the addition of SHAP in this analysis has provided information on the importance and directionality of those predictors. The most important predictor of abatacept retention was no previous corticosteroid use, which was associated with lower retention. The models and predictors identified could be further refined by using additional datasets from clinical trials. Machine learning offers an innovative and complementary approach to biostatistics and could be used to identify treatment response predictors at an individual patient level, leading to a more personalised treatment approach.References:[1]Alten R, et al. RMD Open 2017;3:e000538.[2]Alten R, et al. Presented at the virtual ACR Convergence 2020; 5–9 November 2020. Poster number 1745.Acknowledgements:This study was supported by Bristol Myers Squibb. Professional medical writing and editorial assistance was provided by Claire Line, PhD, at Caudex and was funded by Bristol Myers Squibb.Disclosure of Interests:Rieke Alten Speakers bureau: AbbVie, Bristol Myers Squibb, Gilead, Janssen, Lilly, Pfizer, Consultant of: AbbVie, Bristol Myers Squibb, Gilead, Janssen, Lilly, Pfizer, Grant/research support from: AbbVie, Bristol Myers Squibb, Gilead, Janssen, Lilly, Pfizer, Claire Behar Shareholder of: I have not invested directly in pharmaceutical companies producing drugs/devices for use in rheumatology however I may have shares via the funds linked to my life insurance., Consultant of: Bristol Myers Squibb, Christine Boileau Consultant of: AstraZeneca, Bristol Myers Squibb, Nanobiotix, Pierre Merckaert Consultant of: Bristol Myers Squibb, Ebenezer Afari Consultant of: Bristol Myers Squibb, Virginie Vannier-Moreau Shareholder of: Bristol Myers Squibb, Employee of: Bristol Myers Squibb, Sean Connolly Shareholder of: Bristol Myers Squibb, Employee of: Bristol Myers Squibb, Aurelie Najm Speakers bureau: Bristol Myers Squibb, Consultant of: Bristol Myers Squibb, Pierre-Antoine Juge Consultant of: Bristol Myers Squibb, Angshu Rai Shareholder of: Amgen Inc, Consultant of: Amgen Inc, Employee of: Amgen Inc, Bristol Myers Squibb, Yedid Elbez Consultant of: Bristol Myers Squibb, Karissa Lozenski Shareholder of: Bristol Myers Squibb, Employee of: Bristol Myers Squibb
ROC curve, lift chart and calibration plot