source: google deepmind: simulate real-world places with project genie and street view
level: technical
google deepmind is expanding project genie, an experimental tool that generates interactive 3d environments. a new feature lets users ground these worlds in real places using street view imagery. by selecting a location on a map and choosing a style like ocean world or black-and-white film, genie creates a virtual scene anchored to that spot. users can then add a character, such as an animal or hero, to explore the reimagined setting.
the street view grounding uses maps imagery grounding technology, the same system developers employ for ai visuals. examples include diving around the golden gate bridge in an ocean style or seeing a historic version of the fort worth stockyards. the feature is currently limited to places in the united states, with plans to expand. it is part of project genie, which is available to google ai ultra subscribers globally for $200 per month.
project genie remains a research prototype within google labs. the team is working to improve detail and accuracy. the tool builds on genie, a general-purpose world model that generates diverse interactive environments. it has been used for research, helping ai agents learn in complex settings and assisting waymo with realistic road simulations. the new street view capability aims to provide virtual environments where ai agents or robots can practice navigating real-world complexities.
why it matters: this tool can help train ai agents and robots in realistic virtual settings, improving their ability to handle real-world tasks.
source: google deepmind: simulate real-world places with project genie and street view