Performance guarantees for model-based approximate dynamic programming in continuous spaces

PN Beuchat, A Georghiou… - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
We study both the value function and Q-function formulation of the linear programming
approach to approximate dynamic programming. The approach is model based and …

Data-driven control of unknown systems: A linear programming approach

A Tanzanakis, J Lygeros - IFAC-PapersOnLine, 2020 - Elsevier
We consider the problem of discounted optimal state-feedback regulation for general
unknown deterministic discrete-time systems. It is well known that open-loop instability of …

Adaptive road configurations for improved autonomous vehicle-pedestrian interactions using reinforcement learning

Q Ye, Y Feng, JJE Macias, M Stettler… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
The deployment of Autonomous Vehicles (AVs) poses considerable challenges and unique
opportunities for the design and management of future urban road infrastructure. In light of …

Point-wise maximum approach to approximate dynamic programming

PN Beuchat, J Warrington… - 2017 IEEE 56th Annual …, 2017 - ieeexplore.ieee.org
In this paper we study value function approximation techniques that are based on the Linear
Programming formulation of Approximate Dynamic Programming. We propose a point-wise …

[PDF][PDF] Approximate dynamic programming: a Q-function approach

P Beuchat, A Georghiou, J Lygeros - ArXiv e-prints, 2016 - researchgate.net
In this paper we study both the value function and Q-function formulation of the Linear
Programming (LP) approach to ADP. The approach selects from a restricted function space …

Nonlinear control of quadcopters via approximate dynamic programming

A Romero, PN Beuchat, YR Stürz… - 2019 18th European …, 2019 - ieeexplore.ieee.org
While Approximate Dynamic Programming has successfully been used in many applications
involving discrete states and inputs such as playing the games of Tetris or chess, it has not …

Approximate dynamic programming via penalty functions

PN Beuchat, J Lygeros - IFAC-PapersOnLine, 2017 - Elsevier
In this paper, we propose a novel formulation for encoding state constraints into the Linear
Programming approach to Approximate Dynamic Programming via the use of penalty …