nach oben

Erschienen in:

2024 | OriginalPaper | Buchkapitel

Optimizing Mobile Robot Navigation Through Neuro-Symbolic Fusion of Deep Deterministic Policy Gradient (DDPG) and Fuzzy Logic

verfasst von : Muhammad Faqiihuddin Nasary, Azhar Mohd Ibrahim, Suaib Al Mahmud, Amir Akramin Shafie, Muhammad Imran Mardzuki

Erschienen in: Robotics, Computer Vision and Intelligent Systems

Verlag: Springer Nature Switzerland

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Mobile robot navigation has been a sector of great importance in the autonomous systems research arena for a while. For ensuring successful navigation in complex environments several rule-based traditional approaches have been employed previously which possess several drawbacks in terms of ensuring navigation and obstacle avoidance efficiency. Compared to them, reinforcement learning is a novel technique being assessed for this purpose lately. However, the constant reward values in reinforcement learning algorithms limits their performance capabilities. This study enhances the Deep Deterministic Policy Gradient (DDPG) algorithm by integrating fuzzy logic, creating a neuro-symbolic approach that imparts advanced reasoning capabilities to the mobile agents. The outcomes observed in the environment resembling real-world scenarios, highlighted remarkable performance improvements of the neuro-symbolic approach, displaying a success rate of 0.71% compared to 0.39%, an average path length of 35 m compared to 25 m, and an average execution time of 120 s compared to 97 s. The results suggest that the employed approach enhances the navigation performance in terms of obstacle avoidance success rate and path length, hence could be reliable for navigation purpose of mobile agents.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Utilizing Dataset Affinity Prediction in Object Detection to Assess Training Data

Nächstes Kapitel DAFDeTr: Deformable Attention Fusion Based 3D Detection Transformer

Lu, X., Woo, H., Faragasso, A., Yamashita, A., Asama, H.: Robot navigation in crowds via deep reinforcement learning with modeling of obstacle uni-action. Adv. Robot. 37(4), 257–269 (2023). https://doi.org/10.1080/01691864.2022.2142068CrossRef

Shyalika, C., Silva, T., Karunananda, A.: Reinforcement learning in dynamic task scheduling: a review. SN Comput. Sci. 1(6) (2020). https://doi.org/10.1007/s42979-020-00326-5

Gao, X., Yan, L., Li, Z., Wang, G., Chen, I.-M.: Improved deep deterministic policy gradient for dynamic obstacle avoidance of mobile robot. IEEE Trans. Syst. Man, Cybern. Syst. 53(6), 3675–3682 (2023). https://doi.org/10.1109/TSMC.2022.3230666

Bahamid, A., Ibrahim, A.M., Ibrahim, A., Zahurin, I.Z., Wahid, A.N.: Intelligent robot-assisted evacuation: a review. J. Phys. Conf. Ser. 1706(1) (2020). https://doi.org/10.1088/1742-6596/1706/1/012159

Chen, Y., Cheng, C., Zhang, Y., Li, X., Sun, L.: A neural network-based navigation approach for autonomous mobile robot systems. Appl. Sci. 12(15) (2022). https://doi.org/10.3390/app12157796

Romlay, M.R.M., Azhar, M.I., Toha, S.F., Rashid, M.M.: Two-wheel balancing robot; review on control methods and experiments. Int. J. Recent Technol. Eng. 7(6), 106–112 (2019)

Lillicrap, T.P., et al.: Continuous control with deep reinforcement learning. In: 4th International Conference on Learning Representations, ICLR 2016 - Conference Track Proceedings (2016)

Lashin, M.M.A., Saleh, W.S.E.S.: Road safety policies for Saudi females: a fuzzy logic analysis. Sustainability 14(7) (2022). https://doi.org/10.3390/su14074154

Çimen, M.E., Garip, Z., Emekli, M., Boz, A.F.: Fuzzy logic PID design using genetic algorithm under overshoot constrained conditions for heat exchanger control. Iğdır Üniversitesi Fen Bilim. Enstitüsü Derg. 12(1), 164–181 (2022). https://doi.org/10.21597/jist.980726

10.

Nguyen, L.A.: Fuzzy simulations and bisimulations between fuzzy automata. Int. J. Approx. Reason. 155, 113–131 (2023). https://doi.org/10.1016/j.ijar.2023.02.002MathSciNetCrossRef

11.

Wang, Y., Fang, Y., Lou, P., Yan, J., Liu, N.: Deep reinforcement learning based path planning for mobile robot in unknown environment. J. Phys. Conf. Ser. 1576(1) (2020). https://doi.org/10.1088/1742-6596/1576/1/012009

12.

Li, Y., et al.: Prediction model for geologically complicated fault structure based on artificial neural network and fuzzy logic. Sci. Program. 2022 (2022). https://doi.org/10.1155/2022/2630953

13.

Ni, J., Wu, L., Fan, X., Yang, S.X.: Bioinspired intelligent algorithm and its applications for mobile robot control: a survey. Comput. Intell. Neurosci. 2016 (2016). https://doi.org/10.1155/2016/3810903

14.

Takahashi, O., Schilling, R.J.: Motion planning in a plane using generalized voronoi diagrams. IEEE Trans. Robot. Autom. 5(2), 143–150 (1989). https://doi.org/10.1109/70.88035CrossRef

15.

Bhattacharya, P., Gavrilova, M.L.: Roadmap-based path planning - using the voronoi diagram for a clearance-based shortest path. IEEE Robot. Autom. Mag. 15(2), 58–66 (2008). https://doi.org/10.1109/MRA.2008.921540CrossRef

16.

Gómez, E.J., Santa, F.M.M., Sarmiento, F.H.M.: A comparative study of geometric path planning methods for a mobile robot: potential field and voronoi diagrams. In: 2013 II International Congress of Engineering Mechatronics and Automation (CIIMA), pp. 1–6 (2013). https://doi.org/10.1109/CIIMA.2013.6682776

17.

Abiyev, R., Ibrahim, D., Erin, B.: Navigation of mobile robots in the presence of obstacles. Adv. Eng. Softw. 41(10), 1179–1186 (2010). https://doi.org/10.1016/j.advengsoft.2010.08.001CrossRef

18.

Soltani, A.R., Tawfik, H., Goulermas, J.Y., Fernando, T.: Path planning in construction sites: performance evaluation of the Dijkstra, A*, and GA search algorithms. Adv. Eng. Inform. 16(4), 291–303 (2002). https://doi.org/10.1016/S1474-0346(03)00018-1CrossRef

19.

Masehian, E., Amin-Naseri, M.R.: A voronoi diagram-visibility graph-potencial field compound algorith for robot path planning. J. Robot. Syst. 21(6), 275–300 (2004). https://doi.org/10.1002/rob.20014CrossRef

20.

Weigl, M., Siemiȧatkowska, B., Sikorski, K.A., Borkowski, A.: Grid-based mapping for autonomous mobile robot. Rob. Auton. Syst. 11(1), 13–21 (1993). https://doi.org/10.1016/0921-8890(93)90004-VCrossRef

21.

Ghorbani, A., Shiry, S., Nodehi, A.: Using genetic algorithm for a mobile robot path planning. In: 2009 International Conference on Future Computer and Communication, pp. 164–166 (2009). https://doi.org/10.1109/ICFCC.2009.28

22.

Ahmadzadeh, S., Ghanavati, M.: Navigation of mobile robot using the PSO particle swarm optimization. J. Acad. Appl. Stud. 2 (2012). https://api.semanticscholar.org/CorpusID:18077178

23.

Zhu, K., Zhang, T.: Deep reinforcement learning based mobile robot navigation: a review. Tsinghua Sci. Technol. 26(5), 674–691 (2021). https://doi.org/10.26599/TST.2021.9010012CrossRef

24.

Hu, H., Zhang, K., Tan, A.H., Ruan, M., Agia, C., Nejat, G.: A sim-to-real pipeline for deep reinforcement learning for autonomous robot navigation in cluttered rough terrain. IEEE Robot. Autom. Lett. 6(4), 6569–6576 (2021). https://doi.org/10.1109/LRA.2021.3093551CrossRef

25.

Liu, B., Wang, L., Liu, M.: Lifelong federated reinforcement learning: a learning architecture for navigation in cloud robotic systems. IEEE Robot. Autom. Lett. 4(4), 4555–4562 (2019). https://doi.org/10.1109/LRA.2019.2931179CrossRef

26.

Algabri, M.: Self-learning Mobile Robot Navigation in Unknown Environment Using Evolutionary Learning, vol. 20, no. 10, pp. 1459–1468 (2014)

27.

Yusuf, S.H.: Mobile Robot Navigation Using Deep Reinforcement Learning (2022)

28.

Fathinezhad, F., Derhami, V., Rezaeian, M.: Supervised fuzzy reinforcement learning for robot navigation. Appl. Soft Comput. 40, 33–41 (2016). https://doi.org/10.1016/j.asoc.2015.11.030CrossRef

29.

Ciou, P.-H., Hsiao, Y.-T., Wu, Z.-Z., Tseng, S.-H., Fu, L.-C.: Composite reinforcement learning for social robot navigation. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2553–2558 (2018). https://doi.org/10.1109/IROS.2018.8593410

30.

Bernstein, A.V., Burnaev, E.V., Kachan, O.N.: Reinforcement learning for computer vision and robot navigation. In: Perner, P. (eds.) Machine Learning and Data Mining in Pattern Recognition. MLDM 2018. LNCS, vol. 10935, pp. 258–272. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-96133-0_20

31.

Hase, H., et al.: Ultrasound-guided robotic navigation with deep reinforcement learning. In: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5534–5541 (2020). https://doi.org/10.1109/IROS45743.2020.9340913

32.

Liu, L., Dugas, D., Cesari, G., Siegwart, R., Dubé, R.: Robot navigation in crowded environments using deep reinforcement learning. In: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5671–5677 (2020). https://doi.org/10.1109/IROS45743.2020.9341540

33.

Chen, G., et al.: Robot Navigation with Map-Based Deep Reinforcement Learning, February 2020. http://arxiv.org/abs/2002.04349

34.

Sun, S., Zhao, X., Li, Q., Tan, M.: Inverse reinforcement learning-based time-dependent A* planner for human-aware robot navigation with local vision. Adv. Robot. 34(13), 888–901 (2020). https://doi.org/10.1080/01691864.2020.1753569CrossRef

35.

Bruce, J., Sünderhauf, N., Mirowski, P.: One-Shot Reinforcement Learning for Robot Navigation with Interactive Replay, no. Nips, 2017

36.

Su, M.-C., Huang, D.-Y., Chou, C.-H., Hsieh, C.-C.: A reinforcement-learning approach to robot navigation. In: IEEE International Conference on Networking, Sensing and Control, 2004, vol. 1, pp. 665–669 (2004). https://doi.org/10.1109/ICNSC.2004.1297519

37.

Dong, Y., Zou, X.: Mobile robot path planning based on improved DDPG reinforcement learning algorithm. In: 2020 IEEE 11th International Conference on Software Engineering and Service Science (ICSESS), pp. 52–56 (2020). https://doi.org/10.1109/ICSESS49938.2020.9237641

38.

Chen, Y., Liang, L.: SLP-improved DDPG path-planning algorithm for mobile robot in large-scale dynamic environment. Sensors 23(7), 3521 (2023)CrossRef

Titel: Optimizing Mobile Robot Navigation Through Neuro-Symbolic Fusion of Deep Deterministic Policy Gradient (DDPG) and Fuzzy Logic
verfasst von: Muhammad Faqiihuddin Nasary
Azhar Mohd Ibrahim
Suaib Al Mahmud
Amir Akramin Shafie
Muhammad Imran Mardzuki
Verlag: Springer Nature Switzerland
Buch: Robotics, Computer Vision and Intelligent Systems
Print ISBN: 978-3-031-59056-6

Electronic ISBN: 978-3-031-59057-3

Copyright-Jahr: 2024
DOI: https://doi.org/10.1007/978-3-031-59057-3_18

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner