Deep Reinforcement Learning Multi-Agent Systems

Danial Karimzadeh

doi:10.63053/ijset.60

Authors

Danial Karimzadeh MA in Information Technology Management, Department of Information Technology Management, Faculty of Management, Islamic Azad University E-Campus, Tehran, Iran PhD Student in Computer Engineering - Artificial Intelligence and Robotics, Department of Computer Engineering, Faculty of Engineering, Islamic Azad University Of Central Tehran Branch, Tehran, Iran

DOI:

https://doi.org/10.63053/ijset.60

Keywords:

AI, MARL, DRL, Deep Reinforcement Learning, RL, Reinforcement Learning, Multi-Agent Systems.

Abstract

Deep Reinforcement Learning (DRL) is a subfield of artificial intelligence that combines reinforcement learning and deep neural networks to solve complex problems. In multi-agent systems, intelligent agents interact simultaneously within an environment, and their decisions affect each other's behaviour. This paper examines Multi-Agent Reinforcement Learning (MARL), a significant branch of DRL, which is applied in systems with multiple agents having either common or conflicting goals. Key algorithms such as MADDPG, QMIX, and Mean Field RL, along with popular frameworks like TensorFlow, PyTorch, and Keras, are introduced. The applications of MARL in various domains, including economic systems, robotics, intelligent transportation, and resource management, are explored, and its advantages and disadvantages are discussed. Despite challenges such as high computational costs and limited scalability, MARL has the potential to drive significant innovations in technology and industry. The status of MARL in Iran and globally is analyzed, emphasizing the importance of investment and collaboration between academia and industry for advancement in this field. In conclusion, the paper highlights MARL's capability to solve complex problems and improve interactions, pointing to its potential in robotics, financial systems, and artificial intelligence.

References

Busoniu, L., Babuska, R., & De Schutter, B. (2008). A comprehensive survey of multi-agent reinforcement learning. IEEE Transactions on Systems, Man, and Cybernetics.

Foerster, J., Nardelli, N., Farquhar, G., & Whiteson, S. (2018). Counterfactual multi-agent policy gradients. Proceedings of the AAAI Conference on Artificial Intelligence.

Lowe, R., Wu, Y., Tamar, A., & Abbeel, P. (2017). Multi-agent actor-critic for mixed cooperative-competitive environments. Advances in Neural Information Processing Systems.

OpenAI. (2019). Solving Rubik's Cube with a robot hand.

OpenAI Research Blog. (2023). Latest advancements in deep reinforcement learning.

Silver, D. (2015). Deep reinforcement learning: Mastering the game of Go. Nature.

Silver, D., Schrittwieser, J., Simonyan, K., & Hassabis, D. (2019). Mastering the game of Go with deep neural networks and tree search. Nature.

Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. MIT Press.

Vinyals, O., et al. (2019). Grandmaster level in StarCraft II using multi-agent reinforcement learning. Nature.

Yang, F., et al. (2021). Multi-agent reinforcement learning for AI applications