DeepMind Launches Genie 4 Real-Time World Model with Native Audio and Interactive Editing

Original title: > Genie 4 is Google DeepMind’s first real-time world model with native audio, generating ambient sou...
88AI Score

Google DeepMind has released Genie 4, its first real-time world model featuring native audio generation for ambient sounds, music, and character dialogue. The system allows users to dynamically rewrite simulations via text commands (e.g., changing weather or camera angles), coordinated by Gemini 3.8 Flash acting as an in-loop director. It has been validated in simulating humanoid robot tasks and is currently available only to trusted testers.

Full Report

Rohan Paul (@rohanpaul_ai) · 2026-10-27 17

Genie 4 is Google DeepMind’s first real-time world model with native audio, generating ambient sound, music and live dialogue from characters who react to users and in-world events.

Users can rewrite a running simulation by typing, changing weather, moving the camera or adding people, while Gemini fits each edit to the scene and keeps it coherent.

Gemini 3.8 Flash acts as an in-loop director, splitting goals into steps and checking incoming frames, and Gemini 4 Argon used that loop to simulate Apptronik’s Apollo humanoid playing checkers.

access starts with trusted testers before Google AI Ultra subscribers and early Gemini API partners.

推文配图