Choice of alpha spending function and time points in clinical trials with one or two interim analyses

2004 ◽  
Vol 3 (3) ◽  
pp. 193-203 ◽  
Author(s):  
Murray R. Selwyn ◽  
Susan M. Fish
Author(s):  
Zhili Tian ◽  
Weidong Han ◽  
Warren B. Powell

Problem definition: Clinical trials are crucial to new drug development. This study investigates optimal patient enrollment in clinical trials with interim analyses, which are analyses of treatment responses from patients at intermediate points. Our model considers uncertainties in patient enrollment and drug treatment effectiveness. We consider the benefits of completing a trial early and the cost of accelerating a trial by maximizing the net present value of drug cumulative profit. Academic/practical relevance: Clinical trials frequently account for the largest cost in drug development, and patient enrollment is an important problem in trial management. Our study develops a dynamic program, accurately capturing the dynamics of the problem, to optimize patient enrollment while learning the treatment effectiveness of an investigated drug. Methodology: The model explicitly captures both the physical state (enrolled patients) and belief states about the effectiveness of the investigated drug and a standard treatment drug. Using Bayesian updates and dynamic programming, we establish monotonicity of the value function in state variables and characterize an optimal enrollment policy. We also introduce, for the first time, the use of backward approximate dynamic programming (ADP) for this problem class. We illustrate the findings using a clinical trial program from a leading firm. Our study performs sensitivity analyses of the input parameters on the optimal enrollment policy. Results: The value function is monotonic in cumulative patient enrollment and the average responses of treatment for the investigated drug and standard treatment drug. The optimal enrollment policy is nondecreasing in the average response from patients using the investigated drug and is nonincreasing in cumulative patient enrollment in periods between two successive interim analyses. The forward ADP algorithm (or backward ADP algorithm) exploiting the monotonicity of the value function reduced the run time from 1.5 months using the exact method to a day (or 20 minutes) within 4% of the exact method. Through an application to a leading firm’s clinical trial program, the study demonstrates that the firm can have a sizable gain of drug profit following the optimal policy that our model provides. Managerial implications: We developed a new model for improving the management of clinical trials. Our study provides insights of an optimal policy and insights into the sensitivity of value function to the dropout rate and prior probability distribution. A firm can have a sizable gain in the drug’s profit by managing its trials using the optimal policies and the properties of value function. We illustrated that firms can use the ADP algorithms to develop their patient enrollment strategies.


2009 ◽  
Vol 6 (1) ◽  
pp. 60-66 ◽  
Author(s):  
Tracy L Nolen ◽  
Bill F Dimmick ◽  
Luis Ostrosky-Zeichner ◽  
Amy S Kendrick ◽  
Carole Sable ◽  
...  

2008 ◽  
Vol 27 (10) ◽  
pp. 1646-1666 ◽  
Author(s):  
Anne Whitehead ◽  
Marina Roshini Sooriyarachchi ◽  
John Whitehead ◽  
Kim Bolland

2021 ◽  
Author(s):  
Kristine Broglio ◽  
William Meurer ◽  
Valerie Durkalski ◽  
Qi Pauls ◽  
Jason Connor ◽  
...  

Importance: Bayesian adaptive trial design has the potential to create more efficient clinical trials. However, one of the barriers to the uptake of Bayesian adaptive designs for confirmatory trials is limited experience with how they may perform compared to a frequentist design. Objective: Compare the performance of a Bayesian and a frequentist adaptive clinical trial design. Design: Prospective observational study comparing two trial designs using individual patient level data from a completed stroke trial, including the timing and order of enrollments and outcome ascertainment. The implemented frequentist design had group sequential boundaries for efficacy and futility interim analyses when 90-days post-randomization was met for 500, 700, 900, and 1,100 patients. The Bayesian alternative utilized predictive probability of trial success to govern early termination for efficacy and futility with a first interim analysis at 500 randomized patients, and subsequent interims after every 100 randomizations. Setting: Multi-center, acute stroke study conducted within a National Institutes of Health neurological emergencies clinical trials network. Participants: Patient level data from 1,151 patients randomized in a clinical trial comparing intensive insulin therapy to standard in acute stroke patients with hyperglycemia. Main Outcome(s) and Measure(s): Sample size at end of study. This was defined as the sample size at which each of the studies stopped accrual of patients. Results: As conducted, the frequentist design passed the futility boundary after 936 participants were randomized. Using the same sequence and timing of randomization and outcome data, the Bayesian alternative crossed the futility boundary about 3 months earlier after 800 participants were randomized. Conclusions and Relevance: Both trial designs stopped for futility prior to reaching the planned maximum sample size. In both cases, the clinical community and patients would benefit from learning the answer to the trial's primary question earlier. The common feature across the two designs was frequent interim analyses to stop early for efficacy or for futility. Differences between how this was implemented between the two trials resulted in the differences in early stopping.


2019 ◽  
Author(s):  
Elizabeth Ryan ◽  
Kristian Brock ◽  
Simon Gates ◽  
Daniel Slade

Abstract Background Bayesian adaptive methods are increasingly being used to design clinical trials and offer a number of advantages over traditional approaches. Decisions at analysis points are usually based on the posterior distribution of the parameter of interest. However, there is some confusion amongst statisticians and trialists as to whether control of type I error is required for Bayesian adaptive designs as this is a frequentist concept. Methods We discuss the arguments for and against adjusting for multiplicities in Bayesian trials with interim analyses. We present two case studies demonstrating the effect on type I/II error rates of including interim analyses in Bayesian clinical trials. We propose alternative approaches to adjusting stopping boundaries to control type I error, and also alternative methods for decision-making in Bayesian clinical trials. Results In both case studies we found that the type I error was inflated in the Bayesian adaptive designs through incorporation of interim analyses that allowed early stopping for efficacy and do not make adjustments to account for multiplicity. Incorporation of early stopping for efficacy also increased the power in some instances. An increase in the number of interim analyses that only allowed early stopping for futility decreased the type I error, but also decreased power. An increase in the number of interim analyses that allowed for either early stopping for efficacy or futility generally increased type I error and decreased power. Conclusions If one wishes to demonstrate control of type I error in Bayesian adaptive designs then adjustments to the stopping boundaries are usually required for designs that allow for early stopping for efficacy as the number of analyses increase. If the designs only allow for early stopping for futility then adjustments to the stopping boundaries are not needed to control type I error, but may be required to ensure adequate power. If one instead uses a strict Bayesian approach then type I errors could be ignored and the designs could instead focus on the posterior probabilities of treatment effects of particular values.


Sign in / Sign up

Export Citation Format

Share Document