A deep reinforcement learning framework for robust maritime collision avoidance under GPS spoofing

Research output: Chapter in Book/Report/Conference proceedingChapters

Abstract

With the increasing scale and complexity of global maritime traffic, ensuring the safety of autonomous vessel navigation has become a critical challenge. This paper presents a deep reinforcement learning (DRL) approach for autonomous maritime collision avoidance, with a focus on ensuring safety under both nominal and adversarial conditions. A policy is trained using local observations of surrounding vessels to generate COLREGs-compliant maneuvers in decentralized multi-agent scenarios. The method is evaluated in diverse encounter geometries inspired by the Imazu problem set, demonstrating the agent’s ability to generalize to unseen head-on, crossing, and overtaking situations. To enhance robustness against positioning interference, we introduce an anomaly detection mechanism based on Inertial Navigation System estimation. During GPS spoofing attacks, the system compares GPS and INS position estimates, and penalizes discrepancies in the reward function, enabling the agent to identify and mitigate spoofed signals without relying on external supervision. Experimental results across multiple scenarios confirm the agent’s ability to preserve safe trajectories and avoid collisions, even under sensor-level adversarial attacks. Copyright © 2026 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

Original languageEnglish
Title of host publicationProvable and practical security: 19th International Conference, ProvSec 2025, Yokohama, Japan, October 10–12, 2025, proceedings
EditorsGuomin YANG, Shengli LIU, Chunhua SU, Akira OTSUKA, Zhuotao LIAN
Place of PublicationSingapore
PublisherSpringer
Pages235-254
ISBN (Electronic)9789819529612
ISBN (Print)9789819529605
DOIs
Publication statusPublished - 2026

Citation

Ding, Y., Meng, W., He, S., & Li, W. (2026). A deep reinforcement learning framework for robust maritime collision avoidance under GPS spoofing. In G. Yang, S. Liu, C. Su, A. Otsuka, & Z. Lian (Eds.), Provable and practical security: 19th International Conference, ProvSec 2025, Yokohama, Japan, October 10–12, 2025, proceedings (pp. 235-254). Springer. https://doi.org/10.1007/978-981-95-2961-2_13

Keywords

  • Cyber ship
  • GPS spoofing
  • Reinforcement deep learning
  • Collision avoidance
  • Maritime safety
  • Inertial navigation system

Fingerprint

Dive into the research topics of 'A deep reinforcement learning framework for robust maritime collision avoidance under GPS spoofing'. Together they form a unique fingerprint.