Context

Researchers at Google DeepMind have developed an AI, a Scalable Instructable Multiworld Agent, or SIMA, which can play nine different video games and virtual environments it hasn’t seen before using just the video feed from the game.

What is SIMA?

• SIMA, a versatile AI agent capable of following natural language instructions across a wide range of 3D virtual environments, from bespoke research settings to complex commercial video games.
• This research marks the first time an AI system has demonstrated the ability to ground language in perception and action at such a broad scale.