An overview for Markov decision processes in queues and networks

QL Li, JY Ma, RN Fan, L Xia - … of Celebrating Professor Jinhua Cao's 80th …, 2019 - Springer
Markov decision processes (MDPs) in queues and networks have been an interesting topic
in many practical areas since the 1960s. This paper Provides a detailed overview on this …

Critical care capacity management: Understanding the role of a step down unit

M Armony, CW Chan, B Zhu - Production and Operations …, 2018 - journals.sagepub.com
In hospitals, Step Down Units (SDUs) provide an intermediate level of care between the
Intensive Care Units (ICUs) and the general medical‐surgical wards. Because SDUs are …

Integrated scheduling and capacity planning with considerations for patients' length‐of‐stays

N Liu, VA Truong, X Wang… - Production and …, 2019 - Wiley Online Library
Despite the fact that hospital care is often delivered in successive stages, current healthcare
scheduling and capacity planning methods usually treat different hospital units in isolation …

Control of a non-stationary tandem queue model of the airport surface

S Badrinath, H Balakrishnan - 2017 American Control …, 2017 - ieeexplore.ieee.org
Tandem queues have been used to model congestion in a wide variety of systems such as
communication networks, manufacturing systems, supply chains and traffic flows. This paper …

Admission control of double-sided queues with multiple customer types

Y Su, J Li - IEEE Transactions on Automatic Control, 2023 - ieeexplore.ieee.org
In this technical note, we study a finite double-sided queue with multiple customer types,
where two-sided arrivals follow independent Poisson processes. Customers arrive to one …

Design of Patient Visit Itineraries in Tandem Systems

N Liu, G Wan, S Wang - Manufacturing & Service Operations …, 2024 - pubsonline.informs.org
Problem definition: Multistage service is common in healthcare. One widely adopted
approach to manage patient visits in multistage service is to provide patients with visit …

Two-phase queueing system optimization in applications to data transmission control

NA Kuznetsov, DV Myasnikov, KV Semenikhin - Procedia engineering, 2017 - Elsevier
We consider the controlled tandem queuing network with two single-server finite-length
queues with non-stationary Poisson input flow of packets. The first station controls the …

[PDF][PDF] Critical care in hospitals: When to introduce a step down unit

M Armony, CW Chan, B Zhu - Product Oper Manag, 2013 - Citeseer
Step Down Units (SDUs) provide an intermediate level of care between the Intensive Care
Units (ICUs) and the general medical-surgical wards. Because SDUs are less richly staffed …

Optimization of two-phase queuing system and its application to the control of data transmission between two robotic agents

NA Kuznetsov, DV Myasnikov… - Journal of Communications …, 2017 - Springer
A tandem queuing system that contains two single-channel stations with finite buffers and
allows blocking of the first server is considered. The first station receives nonstationary …

An operational framework for the adoption and integration of new diagnostic tests

P Shi, JE Helm, HS Heese… - Production and …, 2021 - journals.sagepub.com
The gap between medical research on diagnostic testing and clinical workflow can lead to
rejection of valuable medical research in a busy clinical environment due to increased …