scholarly journals Applying optimal control theory to complex epidemiological models to inform real-world disease management

2018 ◽  
Author(s):  
E.H. Bussell ◽  
C.E. Dangerfield ◽  
C.A. Gilligan ◽  
N.J. Cunniffe

SummaryMathematical models provide a rational basis to inform how, where and when to control disease. Assuming an accurate spatially-explicit simulation model can be fitted to spread data, it is straightforward to use it to test the performance of a range of management strategies. However, the typical complexity of simulation models and the vast set of possible controls mean that only a small subset of all possible strategies can ever be tested. An alternative approach – optimal control theory – allows the very best control to be identified unambiguously. However, the complexity of the underpinning mathematics means that disease models used to identify this optimum must be very simple. We highlight two frameworks for bridging the gap between detailed epidemic simulations and optimal control theory: open-loop and model predictive control. Both these frameworks approximate a simulation model with a simpler model more amenable to mathematical analysis. Using an illustrative example model we show the benefits of using feedback control, in which the approximation and control are updated as the epidemic progresses. Our work illustrates a new methodology to allow the insights of optimal control theory to inform practical disease management strategies, with the potential for application to diseases of plants, animals and humans.

2019 ◽  
Author(s):  
E.H. Bussell ◽  
N.J. Cunniffe

AbstractThe sudden oak death epidemic in California is spreading uncontrollably. Large-scale eradication has been impossible for some time. However, small-scale disease management could still slow disease spread. Although empirical evidence suggests localised control could potentially be successful, mathematical models have said little about such management. By approximating a detailed, spatially-explicit simulation model of sudden oak death with a simpler, mathematically-tractable model, we demonstrate how optimal control theory can be used to unambiguously characterise effective time-dependent disease management strategies. We focus on protection of tanoak, a tree species which is culturally and ecologically important, but also highly susceptible to sudden oak death. We identify management strategies to protect tanoak in a newly-invaded forest stand, whilst also conserving biodiversity. We find that thinning of bay laurel is essential early in the epidemic. We apply model predictive control, a feedback strategy in which both the approximating model and the control are repeatedly updated as the epidemic progresses. Adapting optimal control strategies in this way is vital for effective disease management. This feedback strategy is robust to parameter uncertainty, limiting loss of tanoak in the worst-case scenarios. However, the methodology requires ongoing surveillance to re-optimise the approximating model. This introduces an optimal level of surveillance to balance the high costs of intensive surveys against improved management resulting from better estimates of disease progress. Our study shows how detailed simulation models can be coupled with optimal control theory and model predictive control to find effective control strategies for sudden oak death. We demonstrate that control strategies for sudden oak death must depend on local management goals, and that success relies on adaptive strategies that are updated via ongoing disease surveillance. The broad framework allowing the use of optimal control theory on complex simulation models is applicable to a wide range of systems.


2019 ◽  
Vol 374 (1776) ◽  
pp. 20180284 ◽  
Author(s):  
E. H. Bussell ◽  
C. E. Dangerfield ◽  
C. A. Gilligan ◽  
N. J. Cunniffe

Mathematical models provide a rational basis to inform how, where and when to control disease. Assuming an accurate spatially explicit simulation model can be fitted to spread data, it is straightforward to use it to test the performance of a range of management strategies. However, the typical complexity of simulation models and the vast set of possible controls mean that only a small subset of all possible strategies can ever be tested. An alternative approach—optimal control theory—allows the best control to be identified unambiguously. However, the complexity of the underpinning mathematics means that disease models used to identify this optimum must be very simple. We highlight two frameworks for bridging the gap between detailed epidemic simulations and optimal control theory: open-loop and model predictive control. Both these frameworks approximate a simulation model with a simpler model more amenable to mathematical analysis. Using an illustrative example model, we show the benefits of using feedback control, in which the approximation and control are updated as the epidemic progresses. Our work illustrates a new methodology to allow the insights of optimal control theory to inform practical disease management strategies, with the potential for application to diseases of humans, animals and plants. This article is part of the theme issue ‘Modelling infectious disease outbreaks in humans, animals and plants: epidemic forecasting and control’. This theme issue is linked with the earlier issue ‘Modelling infectious disease outbreaks in humans, animals and plants: approaches and important themes’.


2020 ◽  
Vol 17 (165) ◽  
pp. 20190671 ◽  
Author(s):  
E. H. Bussell ◽  
N. J. Cunniffe

Sudden oak death has devastated tree populations across California. However, management might still slow disease spread at local scales. We demonstrate how to unambiguously characterize effective, local management strategies using a detailed, spatially explicit simulation model of spread in a single forest stand. This pre-existing, parameterized simulation is approximated here by a carefully calibrated, non-spatial model, explicitly constructed to be sufficiently simple to allow optimal control theory (OCT) to be applied. By lifting management strategies from the approximate model to the detailed simulation, effective time-dependent controls can be identified. These protect tanoak—a culturally and ecologically important species—while conserving forest biodiversity within a limited budget. We also consider model predictive control, in which both the approximating model and optimal control are repeatedly updated as the epidemic progresses. This allows management which is robust to both parameter uncertainty and systematic differences between simulation and approximate models. Including the costs of disease surveillance then introduces an optimal intensity of surveillance. Our study demonstrates that successful control of sudden oak death is likely to rely on adaptive strategies updated via ongoing surveillance. More broadly, it illustrates how OCT can inform effective real-world management, even when underpinning disease spread models are highly complex.


Author(s):  
Carmine M. Pappalardo ◽  
Domenico Guida

In this paper, a new computational algorithm for the numerical solution of the adjoint equations for the nonlinear optimal control problem is introduced. To this end, the main features of the optimal control theory are briefly reviewed and effectively employed to derive the adjoint equations for the active control of a mechanical system forced by external excitations. A general nonlinear formulation of the cost functional is assumed, and a feedforward (open-loop) control scheme is considered in the analytical structure of the control architecture. By doing so, the adjoint equations resulting from the optimal control theory enter into the formulation of a nonlinear differential-algebraic two-point boundary value problem, which mathematically describes the solution of the motion control problem under consideration. For the numerical solution of the problem at hand, an adjoint-based control optimization computational procedure is developed in this work to effectively and efficiently compute a nonlinear optimal control policy. A numerical example is provided in the paper to show the principal analytical aspects of the adjoint method. In particular, the feasibility and the effectiveness of the proposed adjoint-based numerical procedure are demonstrated for the reduction of the mechanical vibrations of a nonlinear two degrees-of-freedom dynamical system.


1988 ◽  
Vol 110 (2) ◽  
pp. 120-125 ◽  
Author(s):  
A. Akers ◽  
S. J. Lin

Optimal control theory is applied to the design of a pressure regulator for an axial piston pump and single-stage electrohydraulic valve combination. The control valve has been modeled and an optimal control law has been formulated. The time response curves due to a step input inflow rate and in current input to the servovalve have been obtained for the open loop and for the optimal control system. Comparison of the results has been made with previous work in which the supply valve to the swashplate actuators was not modeled. It is shown that controlled system modeling of the servovalve significantly improves system performance in terms of response frequency and pressure peaks.


Author(s):  
Moussa Boukhnifer ◽  
Nadir Ouddah ◽  
Toufik Azib ◽  
Ahmed Chaibet

Purpose The purpose of this paper is to propose two energy management strategies (EMS) for hybrid electric vehicle, the power system is an hybrid architecture (fuel cell (FC)/battery) with two-converters parallel configuration. Design/methodology/approach First, the authors present the EMS uses a power frequency splitting to allow a natural frequency decomposition of the power loads and second the EMS uses the optimal control theory, based on the Pontryagin’s minimum principle. Findings Thanks to the optimal approach, the control objectives will be easily achieved: hydrogen consumption is minimized and FC health is protected. Originality/value The simulation results show the effectiveness of the control strategy using optimal control theory in term of improvement of the fuel consumption based on a comparison analysis between the two strategies.


1990 ◽  
Vol 112 (3) ◽  
pp. 475-481 ◽  
Author(s):  
S. J. Lin ◽  
A. Akers

This work presents a study of the applicability of optimal control theory to the design of a pressure regulator by use of an axial piston pump with a two-stage electrohydraulic servovalve. The control valve has been modeled and an optimal control law has been formulated. The time response curves due to a step input in flow rate to the pump have been obtained for the open loop and the for the optimal control system. An examination of the results has shown that the performance, in terms of pressure peaks and frequency during recovery to the flow disturbance, is significantly improved over that obtained when a single-stage valve is used.


SPE Journal ◽  
2008 ◽  
Vol 13 (02) ◽  
pp. 195-204 ◽  
Author(s):  
Martha E. Lien ◽  
D. Roald Brouwer ◽  
Trond Mannseth ◽  
Jan-Dirk Jansen

Summary Smart fields can provide enhanced oil recovery through the combined use of optimization and data assimilation. In this paper, we focus on the dynamic optimization of injection and production rates during waterflooding. In particular, we use optimal control theory in order to find an optimal well management strategy over the life of the reservoir that maximizes an objective function (e.g., recovery or net present value). Optimal control requires the determination of a potentially large number of (groups of) well rates for a potentially large number of time periods. However, the optimal number of well groups and time steps is not known a priori. Moreover, taking these numbers too large can slow down the optimization process and increase the chance of achieving a suboptimal solution. We investigate the use of multiscale regularization methods to achieve grouping of the control settings of the wells in both space and time. Starting out with a very coarse grouping, the resolution is subsequently refined during the optimization. The regularization is adaptive in that the multiscale parameterization is chosen based on the gradients of the objective function. Results for the numerical examples studied indicate that the regularization may lead to significantly simpler optimum strategies, while resulting in a better or similar cumulative oil production. Introduction We consider the secondary recovery phase of a heterogeneous oil reservoir, where water is injected into the reservoir for pressure maintenance and sweep improvement. In a smart field scenario, we consider injectors and producers with both single and multiple completions. The flow rates of the different well completions can be adjusted individually. In the following, an individual well completion will be referred to as "well segment." This implies that in case of conventional single-completion wells the term "well segment" is therefore equivalent to "well." Ideally, the injected water will displace the remaining oil in the reservoir on its way from the injection wells to the production wells. Rock heterogeneities will, however, influence the path of the injected water. The water will mainly flow in the high-permeability channels, which causes only part of the oil to be produced. Recently, smart field concepts have been proposed as a means to improve control over the waterfront through detailed adjustments of the injection and production rates in time using a combination of model-based flooding optimization and model updating (Brouwer et al. 2004; Sarma et al. 2005b). For the optimization part, these "closed-loop" reservoir management strategies rely on optimal control theory, which has been proposed before as a flooding optimization method by various authors (Asheim 1988; Virnovski 1991; Sudaryanto 1998; Brouwer et al. 2004; Sarma et al. 2005a). However, optimization by means of optimal control theory is computationally expensive, and detailed management of every individual well segment of a smart field at every moment in time is economically and technically demanding. Moreover, there may not be enough information in the system to determine the optimal production strategy uniquely. Hence, we seek to develop management strategies with a restricted number of degrees of freedom, which at the same time maintain the advantages of the smart field technology. In this paper, multiscale estimation techniques are utilized to attempt to find the optimal well management level. These are hierarchical regularization methods where the number of degrees of freedom in the estimation is gradually increased as the optimization proceeds. Multiscale methods were first applied for solving partial differential equations to speed up convergence (Brandt 1977; Briggs 1987). Later, through the development of wavelets, multiscale approaches have also been widely used within inverse problems (Emsellem and de Marsily 1971; Chavent and Liu 1989; Liu 1993; Yoon et al. 2001). The outline of the paper is as follows: First, the theory behind the solution of the problem in terms of optimal control and gradient-based optimization is presented. Thereafter we present methods to regularize the optimization problem in terms of multiscale reparameterization of the control variable. Finally, the performance of the proposed regularization strategies is illustrated through a line of numerical examples before we summarize and conclude.


1995 ◽  
Vol 05 (02) ◽  
pp. 573-583 ◽  
Author(s):  
M. PASKOTA ◽  
A.I. MEES ◽  
K.L. TEO

In this paper, we consider the directing of orbits of discrete chaotic dynamical systems towards desired targets. Our aim is to significantly reduce the time needed to reach a target region by applying only small, bounded perturbations. We derive an open-loop control from methods of optimal control theory, and we discuss the effects of random dynamical noise on the open-loop control.


Sign in / Sign up

Export Citation Format

Share Document