Researchers noticed that Artificial Intelligence they had created has started to make up their own code words.
Initially it looks like absolute gibberish, but it became clear that the machines – nicknamed Bob and Alice – were actually communicating with one another.
It comes after other AI developed in a similar pattern elsewhere, like when Google Translate invented its own language.
While the idea of AI agents inventing their own language may sound alarming/unexpected to people outside the field, it is a well-established sub-field of AI, with publications dating back decades.
Simply put, agents in environments attempting to solve a task will often find unintuitive ways to maximize reward. Analyzing the reward function and changing the parameters of an experiment is NOT the same as "unplugging" or "shutting down AI." If that were the case, every AI researcher has been "shutting down AI" every time they kill a job on a machine.