Recursive least-squares temporal difference learning for adaptive traffic signal control at intersection - École des Ponts ParisTech
Article Dans Une Revue Neural Computing and Applications Année : 2017

Recursive least-squares temporal difference learning for adaptive traffic signal control at intersection

Résumé

This paper presents a new method to solve the scheduling problem of adaptive traffic signal control at intersection. The method involves recursive least-squares temporal difference (RLS-TD(λ)) learning that is integrated into approximate dynamic programming. The learning mechanism of RLS-TD(λ) is to make an adaptation of linear function approximation by updating its parameters based on environmental feedback. This study investigates the method implementation after modelling a traffic dynamic system at intersection in discrete time. In the model, different traffic control schemes regarding signal phase sequence are considered, especially the defined adaptive phase sequence (APS). By simulating traffic scenarios, RLS-TD(λ) is superior to TD(λ) for updating functional parameters in the approximation, and APS outperforms other conventional control schemes on reducing traffic delay. By comparing with other traffic signal control algorithms, the proposed algorithm yields satisfying results in terms of traffic delay and computation time.
Fichier principal
Vignette du fichier
Yin_Recursive.pdf (1007.79 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-01763263 , version 1 (23-06-2022)

Identifiants

Citer

Biao Yin, Mahjoub Dridi, Abdellah El Moudni. Recursive least-squares temporal difference learning for adaptive traffic signal control at intersection. Neural Computing and Applications, 2017, 31, pp.1013 - 1028. ⟨10.1007/s00521-017-3066-9⟩. ⟨hal-01763263⟩
157 Consultations
85 Téléchargements

Altmetric

Partager

More