Sunday, December 3, 2023
SCIENMAG: Latest Science and Health News
No Result
View All Result
  • Login
  • HOME PAGE
  • BIOLOGY
  • CHEMISTRY AND PHYSICS
  • MEDICINE
    • Cancer
    • Infectious Emerging Diseases
  • SPACE
  • TECHNOLOGY
  • CONTACT US
  • HOME PAGE
  • BIOLOGY
  • CHEMISTRY AND PHYSICS
  • MEDICINE
    • Cancer
    • Infectious Emerging Diseases
  • SPACE
  • TECHNOLOGY
  • CONTACT US
No Result
View All Result
Scienmag - Latest science news from science magazine
No Result
View All Result
Home SCIENCE NEWS Mathematics

Using AI to train teams of robots to work together

July 25, 2022
in Mathematics
0
Share on FacebookShare on Twitter

When communication lines are open, individual agents such as robots or drones can work together to collaborate and complete a task. But what if they aren’t equipped with the right hardware or the signals are blocked, making communication impossible? University of Illinois Urbana-Champaign researchers started with this more difficult challenge. They developed a method to train multiple agents to work together using multi-agent reinforcement learning, a type of artificial intelligence.

Starcraft

Credit: The Grainger College of Engineering, University of Illinois Urbana-Champaign

When communication lines are open, individual agents such as robots or drones can work together to collaborate and complete a task. But what if they aren’t equipped with the right hardware or the signals are blocked, making communication impossible? University of Illinois Urbana-Champaign researchers started with this more difficult challenge. They developed a method to train multiple agents to work together using multi-agent reinforcement learning, a type of artificial intelligence.

“It’s easier when agents can talk to each other,” said Huy Tran, an aerospace engineer at Illinois. “But we wanted to do this in a way that’s decentralized, meaning that they don’t talk to each other. We also focused on situations where it’s not obvious what the different roles or jobs for the agents should be.”

Tran said this scenario is much more complex and a harder problem because it’s not clear what one agent should do versus another agent.

“The interesting question is how do we learn to accomplish a task together over time,” Tran said. 

Tran and his collaborators used machine learning to solve this problem by creating a utility function that tells the agent when it is doing something useful or good for the team.

“With team goals, it’s hard to know who contributed to the win,” he said. “We developed a machine learning technique that allows us to identify when an individual agent contributes to the global team objective. If you look at it in terms of sports, one soccer player may score, but we also want to know about actions by other teammates that led to the goal, like assists. It’s hard to understand these delayed effects.”

The algorithms the researchers developed can also identify when an agent or robot is doing something that doesn’t contribute to the goal. “It’s not so much the robot chose to do something wrong, just something that isn’t useful to the end goal.”

They tested their algorithms using simulated games like Capture the Flag and StarCraft, a popular computer game. 

You can watch a video of Huy Tran demonstrating related research using deep reinforcement learning to help robots evaluate their next move in Capture the Flag.

“StarCraft can be a little bit more unpredictable – we were excited to see our method work well in this environment too.”

Tran said this type of algorithm is applicable to many real-life situations, such as military surveillance, robots working together in a warehouse, traffic signal control, autonomous vehicles coordinating deliveries, or controlling an electric power grid. 

Tran said Seung Hyun Kim did most of the theory behind the idea when he was an undergraduate student studying mechanical engineering, with Neale Van Stralen, an aerospace student, helping with the implementation. Tran and Girish Chowdhary advised both students. The work was recently presented to the AI community at the Autonomous Agents and Multi-Agent Systems peer-reviewed conference.

The study, “Disentangling Successor Features for Coordination in Multi-agent Reinforcement Learning,” written by Seung Hyun Kim, Neale Van Stralen, Girish Chowdhary, and Huy Tran, appears in the Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems held in May 2022.



DOI

10.48550/arXiv.2202.07741

Article Title

Disentangling Successor Features for Coordination in Multi-agent Reinforcement Learning

Article Publication Date

9-May-2022

Tags: robotsteamstrainwork
Share26Tweet16Share4ShareSendShare
  • Tulostoma shaihuludii and a ‘Shai-Hulud’

    Fungus from Arrakis: New species named after Dune’s giant worms

    77 shares
    Share 31 Tweet 19
  • Null results research now published by major behavioral medicine journal

    1154 shares
    Share 462 Tweet 289
  • New chemistry can extract virgin-grade materials from wind turbine blades in one process

    70 shares
    Share 28 Tweet 18
  • Scientists discover rare 6-planet system that moves in strange synchrony

    70 shares
    Share 28 Tweet 18
  • Acer i-Seed: the first eco-friendly fluorescent artificial seed for monitoring soil temperature by using drones

    70 shares
    Share 28 Tweet 18
  • Durable plastic pollution easily, cleanly degrades with new catalyst

    66 shares
    Share 26 Tweet 17
ADVERTISEMENT

About us

We bring you the latest science news from best research centers and universities around the world. Check our website.

Latest NEWS

Fungus from Arrakis: New species named after Dune’s giant worms

Collaboration between women helps close the gender gap in ice core science

Null results research now published by major behavioral medicine journal

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 208 other subscribers

© 2023 Scienmag- Science Magazine: Latest Science News.

No Result
View All Result
  • HOME PAGE
  • BIOLOGY
  • CHEMISTRY AND PHYSICS
  • MEDICINE
    • Cancer
    • Infectious Emerging Diseases
  • SPACE
  • TECHNOLOGY
  • CONTACT US

© 2023 Scienmag- Science Magazine: Latest Science News.

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In