Autonomous Robot Navigation Using Deep Reinforcement Learning for Obstacle Avoidance and Path Optimization

¹ Department of Computer Engineering, Shah & Anchor Kutchhi Engineering College, Mumbai, Maharashtra 400088, India
² Department of CSE-AIML, St. Ann's College of Engineering & Technology, Chirala, Andhra Pradesh 523187, India
³ Department of Computer Science Engineering, Koneru Lakshmaiah Education Foundation, Hyderabad, Telangana 500043, India
⁴ Department of Electronics and Communication Engineering, Vidyavardhaka College of Engineering, Mysuru, Karnataka 570002, India
⁵ Department of Artificial Intelligence and Data Science, Panimalar Engineering College, Chennai, Tamil Nadu 600123, India
⁶ Department of Mechanical Engineering, School of Engineering & I.T., MATS University, Raipur, Chhattisgarh 493441, India

^* Corresponding author: This email address is being protected from spambots. You need JavaScript enabled to view it.

Published online: 2 March 2026

Abstract

This paper compares the performance of a traditional approach for autonomous robot navigation and a new approach for the same problem, all within the framework of reinforcement learning. A new approach for the problem has been introduced and compared against the traditional approach, referred to as the value iteration approach for holonomic robots and the new approach for the same problem in relation to the traditional approach. These approaches include sampling-based policy estimation and interpolation and optimization-based filtering for obstacle avoidance. Actor critic methods for non-holonomic scenarios include Deep Deterministic Policy Gradient (DDPG) and Soft Actor-Critic (SAC) approaches. The simulation of various 2D and 3D scenarios, ranging from simple to complex, shows that value iteration method convergence occurs rapidly, while at the same time a success rate of over 95% can be attained within 31 minutes of virtual time. DRL techniques, however, succeed in attaining an average of 88.5% ± 4.2% in 300 scenarios, where in each case, 35% faster convergence of SAC compared to DDPG could be attained. The efficacy of reinforcement learning approaches to find practical solutions to robot navigation in various scenarios, while meeting constraints, has been proven.