Uh oh, people are now using machine learning to cheat in Rocket League
this_was_a_bot_in_c3_doubles_for_sure_in_oce from r/RocketLeague
I was skeptical when I came across a Reddit poster claiming they “for sure” encountered a cheater in ranked Rocket League. Uh huh, just like how everyone who kills me in Rainbow Six Siege is “for sure” aimbotting, right? Then I watched the video.
Friends, I regret to inform you that people are cheating in Rocket League.
The alleged cheater was actually on the same team as ghost_snyped, the Reddit user who posted the clip (opens in new tab) embedded above, which shows the cheater’s perspective for part of a doubles match. I’ve been playing Rocket League for seven years and I have never seen a human being play like that at any rank. There are masterful Rocket League dribblers out there, but it’d be unusual for a skilled player to stay so rooted to the field—most throw in some aerial maneuvers here and there—and to carry and flick the ball that flawlessly.
Sure enough, this is a real problem: People have started using a machine learning-trained Rocket League bot in online matches.
The creators of RLGym (opens in new tab), an API which facilitates the training of Rocket League bots with machine learning algorithms, knew their project could be used by cheaters, but that wasn’t their intention. There’s actually a cool, non-cheaty Rocket League bot development scene centered around another API called RLBot (opens in new tab), which enables the creation and use of custom bots for offline play or to pit against each other in LAN tournaments.
RLGym changed the game by allowing bot developers to use Rocket League as an environment for reinforcement learning (opens in new tab) algorithms. The basic idea is that, rather than scripting your bot’s behavior by hand, you tell the system what outcomes are desirable—the ball moving closer to the opponent’s goal, for example—and then run hours and hours of simulated Rocket League games during which the bot gradually “learns” to achieve those desired outcomes.
Practically speaking, it’s not nearly that simple: “Engineering reward functions is an art all to itself,” according to one of RLGym’s authors, Aech, who ran a Q&A on Reddit (opens in new tab) about the cheating problem last week. The specific machine learning bot being used to cheat in Rocket League, Nexto, was “exceptionally hard to make,” Aech said, so it’s unlikely that tons of variants will start popping up. Now that cheaters have caught on, though, Aech does expect someone to try to train a bot that’s even more skilled than Nexto.
another_day_another_nexto_in_ranked from r/RocketLeague
So the bots themselves aren’t new. What’s new is that someone has implemented “their own tools for manipulating [Rocket League] that don’t have the same restrictions against playing online that RLGym and RLBot do,” according to Aech, and that’s why Nexto is appearing in ranked matches.
“RLGym is incredibly lucky to have found a super passionate and understanding community, and we won’t let these cheaters stop us,” Aech told PC Gamer. “We’re taking steps to ensure our bots can’t be abused in the future and we can’t wait to show everyone the exciting projects we’ve been working on.”
I’ve emailed Rocket League developer Psyonix for comment, and will update this story if I hear back. The studio hasn’t made a public statement about the cheating issue at this time.
It’s not clear right now whether we’re looking at a Nexto epidemic or just a handful of incidents, but I did spot a few other popular Reddit posts complaining about encounters with the bot in ranked matches. The other clips show alleged cheaters playing with the same ultra-exacting ball handling.
am_i_extremely_bad_or_is_this_a_bot_he_also_never from r/RocketLeague
For now, there’s nothing a player can do if they’re matched against a Nexto bot except report the cheater and do their best to defeat the machine. If you need a tip, apparently it isn’t very good at faceoffs due to some emergent flaw in the training.
“A fairly curious phenomenon that we’ve seen repeated by several [machine learning] projects now is that bots will typically learn how to be really good at the kickoff early on in training, but as they improve at the rest of the game they almost always seem to lose that ability to do the kickoff well,” wrote Aech.
It really feels like the sort of flaw a sci-fi movie protagonist would discover just before their final showdown with a rogue AI.
Late last year, I said that machine learning represents a genuine change in how we interact with and understand computers, and here’s another example. As a hobby research project, RLGym and Nexto are super cool. Along with experiments like Google’s StarCraft 2 AI, these Rocket League bots predict a future in which games will contain much more capable and potentially lifelike AI opponents (although Nexto’s playstyle is rather inhuman). At the same time, we now have to deal with the most advanced videogame cheating method ever known: Bots that theoretically can be trained to master any game, perhaps even mimicking occasional human errors so as to be hard to detect. It’s gonna be a wild decade.
