https://youtu.be/PDKhUknuQDg
google just invented the simulation.

they already showed this tech like 1 year ago, it's basically just a real time video generator, but instead of the screen being the memory, they probably store the memory into a cube map. So if you walked behind the wall, the paint should disappear.
The painting system is new, but it does not look like it's done through AI, it must be a tool that's directly manipulating the memory (the screen pixels / depth). And to get the high FPS I can only assume it's more like photogrammetry of a static AI cube map, than a real time AI video generation (I don't see any people walking around).
Actually looking at the video again, the artifacts on the floor looks like someone just took a photo of a real wall and then just generated the rest of it using world-gen. https://worldgen.github.io/
Overall cool tech, the problem is that there is like 10000x more 2D videos on the internet compared to 3D cubemap videos (youtube VR videos), and I assume that google is probably just converting a 2D video into a 3D video using something like worldgen so that you can look around, and that causes a lot of issues and artifacts, and they are just hiding it because it's so shitty (imagine if it ran at half speed as shown on video, you would need to lobotomize it or use expensive asic chips to make it run faster).

>>106157041
I think they're just using attention. There's no "cube map."

>>106156859 (OP)
>hl_paint

>>106157054
Eh, attention is O(n^2). If this is just an attention-based video model with input conditioning for interactivity then it's a total nothing burger. I agree with the anon you're replying to, it's probably caching the previous generations in some sort of data structure (hopefully something more clever / 3d than a cube map though)

>>106157041
You can see there's some confusion in depth where the roller will leave a streak on the wall, but then the avatar moves in much closer to make contact. You can see that sort of thing starting at 0:39, and it's really extreme by the end. What do you make of that kind of error? It seems like an odd error to make if the painting system is something hardcoded to track onto a stored map of surfaces.

Not that impressive, decals have been around in game engines for a long time, I hoped the guy would walk over to the glass and try to paint on it, but my expectations were too high.

the roller would not work on the wall IRL at the angle he was holding it at against the wall, it's shit, immersion broken.

>>106156859 (OP)
is this loss?

Interesting but it's going to be generic and boring like all other aislop has been so far.