Navigation in Restricted Channels under Environmental Conditions: Fast-Time Simulation by Asynchronous Deep Reinforcement Learning

Jose Amendola, Lucas S. Miura, Anna H.Reali Costa, Fabio G. Cozman, Eduardo Aoun Tannuri

Resultado de la investigación: Contribución a una revistaArtículorevisión exhaustiva

Resumen

This paper proposes an efficient method, based on reinforcement learning, to be used as ship controller in fast-time simulators within restricted channels. The controller must operate the rudder in a realistic manner in both time and angle variation so as to approximate human piloting. The method is well suited to scenarios where no previous navigation data is available; it takes into account, during training, both the effect of environmental conditions and also curves in channels. We resort to an asynchronous distributed version of the reinforcement learning algorithm Deep Q Network (DQN), handling channel segments as separate episodes and including curvature information as context variables (thus moving away from most work in the literature). We tested our proposal in the channel of Porto Sudeste, in the southern Brazilian coast, with realistic environment scenarios where wind and current incidence varies along the channel. The method keeps a simple representation and can be applied to any port channel configuration that respects local technical regulations.

Idioma originalInglés
Número de artículo9163360
Páginas (desde-hasta)149199-149213
Número de páginas15
PublicaciónIEEE Access
Volumen8
DOI
EstadoPublicada - 2020
Publicado de forma externa

Huella

Profundice en los temas de investigación de 'Navigation in Restricted Channels under Environmental Conditions: Fast-Time Simulation by Asynchronous Deep Reinforcement Learning'. En conjunto forman una huella única.

Citar esto