A Continuous-Time Markov decision process-based resource allocation scheme in vehicular cloud for mobile video services

2018 ◽  
Vol 118 ◽  
pp. 140-147 ◽  
Author(s):  
Lu Hou ◽  
Kan Zheng ◽  
Periklis Chatzimisios ◽  
Yi Feng
Keyword(s):  
Resource Allocation ◽  
Markov Decision Process ◽  
Continuous Time ◽  
Decision Process ◽  
Mobile Video ◽  
Allocation Scheme ◽  
Vehicular Cloud ◽  
Markov Decision ◽  
Video Services ◽  
Resource Allocation Scheme

scholarly journals Explicit Solution of the Average-Cost Optimality Equation for a Pest-Control Problem

2011 ◽  
Vol 2011 ◽  
pp. 1-11
Author(s):  
Epaminondas G. Kyriakidis
Keyword(s):  
Optimal Control ◽  
Markov Decision Process ◽  
Pest Control ◽  
Continuous Time ◽  
Decision Process ◽  
Average Cost ◽  
Optimality Equation ◽  
Markov Decision ◽  
Average Cost Optimality Equation ◽  
Cost Optimality

We introduce a Markov decision process in continuous time for the optimal control of a simple symmetrical immigration-emigration process by the introduction of total catastrophes. It is proved that a particular control-limit policy is average cost optimal within the class of all stationary policies by verifying that the relative values of this policy are the solution of the corresponding optimality equation.

Sign in / Sign up

Export Citation Format

Share Document