A Markov traffic model for signalized traffic networks based on Bayesian estimation

Reference:
S.Y. Liu, S. Lin, Y.B. Wang, B. De Schutter, and W.H.K. Lam, "A Markov traffic model for signalized traffic networks based on Bayesian estimation," Proceedings of the 21st IFAC World Congress, Virtual conference, pp. 15029-15034, July 2020.

Abstract:
In order to better understand the stochastic dynamic features of signalized traffic networks, we propose a Markov traffic model to simulate the dynamics of traffic link flow density for signalized urban traffic networks with demand uncertainty. In this model, we have four different state modes for the link according to different congestion levels of the link. Each link can only be in one of the four link state modes at any time, and the transition probability from one state to the other state is estimated by Bayesian estimation based on the distributions of the dynamic traffic flow densities, and the posterior probabilities. Therefore, we use a first-order Markov Chain Model to describe the dynamics of the traffic flow evolution process. We illustrate our approach for a small traffic network. Compared with the data from the microscopic traffic simulator SUMO, the proposed model can estimate the link traffic densities accurately and can give a reliable estimation of the uncertainties in the dynamic process of signalized traffic networks.