scholarly journals Parametric inference for small variance and long time horizon McKean-Vlasov diffusion models

2021 ◽  
Vol 15 (2) ◽  
Author(s):  
Valentine Genon-Catalot ◽  
Catherine Larédo
Keyword(s):  
Time Horizon ◽  
Diffusion Models ◽  
Parametric Inference ◽  
Small Variance ◽  
Long Time

scholarly journals Towards High-Level Intrinsic Exploration in Reinforcement Learning

2020 ◽  
Author(s):  
Nicolas Bougie ◽  
Ryutaro Ichise
Keyword(s):  
Reinforcement Learning ◽  
Time Horizon ◽  
State Of The Art ◽  
Experimental Results ◽  
Prior Work ◽  
Extrinsic Rewards ◽  
Intrinsic Reward ◽  
Long Time ◽  
End To End ◽  
High Level

Deep reinforcement learning (DRL) methods traditionally struggle with tasks where environment rewards are sparse or delayed, which entails that exploration remains one of the key challenges of DRL. Instead of solely relying on extrinsic rewards, many state-of-the-art methods use intrinsic curiosity as exploration signal. While they hold promise of better local exploration, discovering global exploration strategies is beyond the reach of current methods. We propose a novel end-to-end intrinsic reward formulation that introduces high-level exploration in reinforcement learning. Our curiosity signal is driven by a fast reward that deals with local exploration and a slow reward that incentivizes long-time horizon exploration strategies. We formulate curiosity as the error in an agent’s ability to reconstruct the observations given their contexts. Experimental results show that this high-level exploration enables our agents to outperform prior work in several Atari games.

scholarly journals Long time horizon for adaptive management to reveal predation effects in a salmon fishery

2016 ◽  
Vol 26 (8) ◽  
pp. 2695-2707 ◽  
Author(s):  
Timothy E. Walsworth ◽  
Daniel E. Schindler
Keyword(s):  
Adaptive Management ◽  
Time Horizon ◽  
Long Time ◽  
Predation Effects ◽  
Salmon Fishery

Bipartite matching model with dynamic arrivals and departures

2018 ◽  
Vol 09 (04) ◽  
pp. 1850031 ◽  
Author(s):  
Weiwei Jiang
Keyword(s):  
Time Horizon ◽  
Strategic Behavior ◽  
Matching Markets ◽  
Matching Model ◽  
Bipartite Matching ◽  
Long Time ◽  
Classical Models ◽  
Matching Mechanism ◽  
Finite Time Horizon ◽  
Dynamic Arrivals

In this paper, we introduce a bipartite matching model for matching markets with dynamic arrivals and departures. Different from classical models with a finite-time horizon, our model has a long-time horizon with infinite vertices. In our model, the matching goal is to maximize the ratio of matched vertices, i.e., matched ratio. We define two types of online algorithms, i.e., Greedy and Patient, analyze their performance with evaluation metrics of both upper bounds and competitive ratios, and conduct extensive simulations to validate our analysis. To further simulate the real situation, we extend our model with the user’s strategic behavior and prove the existence of a specific Nash equilibrium under a differentiated matching mechanism.

Are There Types of Dictatorship?

2019 ◽  
pp. 285-310
Author(s):  
Ronald Wintrobe
Keyword(s):  
North Korea ◽  
Time Horizon ◽  
Long Time

The idea of different kinds of dictatorships can be traced back to Aristotle. In contemporary thinking, three classifications are common: tinpot vs. totalitarian, personal/military/single-party or civilian/military/monarchy, and short vs. long time horizon. This chapter argues that classification is useful if it can be theoretically grounded, the types can be distinguished empirically, and especially if they behave differently. It concludes with an analysis of seemingly “unclassifiable” regimes such as Chinese totalitarian capitalism, Putin’s Russia, and North Korea.

scholarly journals Output controllability in a long-time horizon

Automatica ◽  
2020 ◽  
Vol 113 ◽  
pp. 108762
Author(s):  
Martin Lazar ◽  
Jérôme Lohéac
Keyword(s):  
Time Horizon ◽  
Long Time ◽  
Output Controllability

The congruence of entrepreneurship and India’s excellence in information technology

2017 ◽  
Vol 10 (2) ◽  
pp. 159-184 ◽  
Author(s):  
Sankalpa Bhattacharjee ◽  
Debkumar Chakrabarti
Keyword(s):  
Information Technology ◽  
Time Horizon ◽  
Structural Changes ◽  
Close Association ◽  
Critical Role ◽  
Austrian Economics ◽  
It Industry ◽  
Content Type ◽  
Long Time ◽  
Historical Contextualisation

Purpose The paper aims to unravel the congruence of entrepreneurship and India’s excellence in information technology (IT). Considering the fact that entrepreneurship is a multifaceted concept encompassing a complex set of contiguous and overlapping constructs, the study takes into consideration interlinkages between the institutional environment, the nature of the industry and the responses and expectations that influenced entrepreneurship. The study complements these factors by analysing the sequential transformation of the Indian IT industry owing to the advent of outsourcing opportunities and concomitant ramifications on entrepreneurial activities. In effect, the study highlights the endogeneity in the system wherein entrepreneurs have continually adapted to the industry dynamics resulting in its significant expansion. Design/methodology/approach The methodology adopted is the historical research method. Fundamentally idiographic, it helps in understanding contemporary issues, how they arose and how their characteristics unfolded over time. To this end, historical contextualisation has been carried out as an interpretative or analytical activity to capture the dynamic process of entrepreneurship. The idea was to capture the broad consequences of entrepreneurial interactions and processes over a long-time horizon classified into six different phases since inception. The historical contextualisation enabled us not only to pinpoint the disequilibrium processes at each phase of development that ushered in structural changes in the industry but also to identify and examine the complex interactions between the various factors that led to the growth of entrepreneurship. Findings Findings reveal that the Indian IT industry has undergone a series of disruptive changes since inception. Disequilibrium in the market plays a critical role in the initiation of entrepreneurship. In the formative phases, disequilibrium is initiated by the “adaptive” responses of the entrepreneurs, whereas in the advanced phases, entrepreneurial process is augmented by the “creative” responses resulting in the perpetuation of disequilibrium. Such shifts in entrepreneurial responses indicate a gradual progression from “gradient” to more “heuristic” search efforts on the part of the entrepreneurs. This progression testifies the perpetuation of entrepreneurship in imparting sustainability to the growth momentum of the industry in the foreseeable future. Research limitations/implications The study attempts to fill three important gaps in the literature: First, enrich the Austrian economics with empirical findings. Second, integrate two different strands of literature on entrepreneurship and evolution of India’s IT sector using unique configuration. Third, extend the literature on entrepreneurship in the Indian context to capture entrepreneurial prudence in the Indian IT sector and thereby enrich the literature with newer findings and richer insights. Practical implications Analysis of factors that imparted entrepreneurial prudence in the Indian IT sector can endow policymakers with valuable information for enhancing growth in industries that are having a close association with the IT industry in the “product space”. Originality/value The study is original on account of the unique configuration that it has adopted to unravel the complexity embedded in the concept of entrepreneurship considering a long-time horizon of six decades since inception which includes the analysis of disequilibrium; the entrepreneurship-institution interlinkages; the nature of the industry; and the role of outsourcing.

Sign in / Sign up

Export Citation Format

Share Document