Eye-in-Hand Robotic Manipulator Trajectory Planning with YOLO-Deep Reinforcement Learning

Open

Muslikhin, Suprapto, Dwi Sudarno Putra, Anggun Winursito, Febrianto Amri Ristadi, Iwan Nofi Yono Putro, Ming-Shyan Wang

2026 Journal of Robotics and Control (JRC) Vol. 7 Issue 2 Article Cited by 0 SDG 17SDG 4 Quartile

Abstract

Trajectory planning on an eye-in-hand robotic manipulator with a cluttered heterogeneous environment is crucial to grasping success. This study proposes a hybrid model that combines deep learning-based environment detection with reinforcement learning (RL) to determine the optimal route. You Only Look Once (YOLO) was proposed in this system to incorporate deep reinforcement learning by optimizing the environment assessment. Merging YOLO with deep reinforcement learning optimizes environmental assessment by inserting a reward subprocess. YOLO assesses the environment for detection and recognition; after identifying targets or obstacles, RL can then reward or punish the agent to achieve the highest score. The entire process is encapsulated within the environmental cycle, which incorporates a state reward that is analyzed by deep learning. On the agent side, it is also driven by reinforcement learning. In this order, each agent and environment reach their optimal values, resulting in a 11-17% decrease in episode convergence time. © 2026, Department of Agribusiness, Universitas Muhammadiyah Yogyakarta. All rights reserved.

Affiliations

Electronics and Informatics Engineering Education Department, Universitas Negeri Yogyakarta, Indonesia; Automotive Engineering Education Department, Universitas Negeri Padang, Indonesia; Mechanical Engineering Education Department, Universitas Negeri Yogyakarta, Indonesia; National Research and Innovation Agency, Indonesia; Electrical Engineering Department, Southern Taiwan University of Science and Technology, Taiwan

Research at a Glance

Premium content — register to unlock

Research at a Glance

Register to unlock

Topics & SDG Alignment

Premium content — register to unlock

Topics & SDG Alignment

Register to unlock

Collaboration

Premium content — register to unlock

Collaboration

Register to unlock

Author Profile (Selected)

Premium content — register to unlock

Author Profile (Selected)

Register to unlock

References Overview

Premium content — register to unlock

References Overview

Register to unlock

Journal & Source

Premium content — register to unlock

Journal & Source

Register to unlock

Metadata & Integrity

Premium content — register to unlock

Metadata & Integrity

Register to unlock