[HTML][HTML] DynaProg: Deterministic Dynamic Programming solver for finite horizon multi-stage decision problems

F Miretti, D Misul, E Spessa - SoftwareX, 2021 - Elsevier
DynaProg is an open-source MATLAB toolbox for solving multi-stage deterministic optimal
decision problems using Dynamic Programming. This class of optimal control problems can …

Transmission scheduling for multi-process multi-sensor remote estimation via approximate dynamic programming

A Forootani, R Iervolino, M Tipaldi, S Dey - Automatica, 2022 - Elsevier
In this paper, we consider a remote estimation problem where multiple dynamical systems
are observed by smart sensors, which transmit their local estimates to a remote estimator …

A stochastic dynamic programming approach for the machine replacement problem

A Forootani, MG Zarch, M Tipaldi, R Iervolino - Engineering Applications of …, 2023 - Elsevier
This paper addresses both the modeling and the resolution of the replacement problem for a
population of machines. The main objective is the computation of a minimum cost …

A benchmark generator for online dynamic single-objective and multi-objective optimization problems

X Xiang, Y Tian, R Cheng, X Zhang, S Yang, Y Jin - Information Sciences, 2022 - Elsevier
In the past years, a number of benchmarks have been developed to characterize dynamic
optimization problems (DOPs) consisting of a series of static problems over time. The …

An approximate dynamic programming approach to project scheduling with uncertain resource availabilities

F Xie, H Li, Z Xu - Applied Mathematical Modelling, 2021 - Elsevier
We study the stochastic resource-constrained project scheduling problem with uncertain
resource availability, called SRCPSP-URA, and model it as a sequential decision problem …

Dynamic pricing mechanism design for electric mobility-on-demand systems

L Ni, B Sun, S Wang, DHK Tsang - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
With the popularization of ride-sharing transportation and increasing penetration of electric
vehicles (EVs) in recent years, the electric mobility-on-demand (EMoD) system is emerging …

Multi-Agent Federated DRL Enabled Resource Allocation for Air-Ground Integrated IoV Network

N Li, X Song, K Li, R Jiang, J Li - IEEE Internet Computing, 2023 - ieeexplore.ieee.org
As an emerging architecture for the future 6G Internet of Vehicles (IoV), the air–ground-
integration network has become a paradigm to achieve reliable interconnection everywhere …

Rsm-based approximate dynamic programming for stochastic energy management of power systems

Y Zhuo, J Zhu, J Chen, Z Wang, H Ye… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
The stochastic energy management (SEM) of power systems is computationally intractable
due to its randomness, nonconvexity, and nonlinearity. To solve this problem, a response …

A RL-based Vertical Stabilization System for the EAST tokamak

G De Tommasi, S Dubbioso, Y Huang… - 2022 American …, 2022 - ieeexplore.ieee.org
The Vertical Stabilization (VS) is one of the most challenging control problems in tokamak
fusion reactors. Existing solutions are usually tailored for the specific device. In this work, a …

Age-driven spatially temporally correlative updating in the satellite-integrated Internet of Things via Markov decision process

Y Li, Y Xu, Q Zhang, Z Yang - IEEE Internet of Things Journal, 2022 - ieeexplore.ieee.org
In this article, we consider the data updating problem in the Satellite-integrated Internet of
Things network for the time-critical scenarios, ie, animal tracking and environmental …