This is game engine 2.0. Some day, all the complexity of UE5 will be absorbed by a data-driven blob of attention weights. Those weights take as input game controller commands and directly animate a spacetime chunk of pixels. Agrim and I were close friends and coauthors back at Stanford Vision Lab. So great to see him at the frontier of such cool research! Congrats!
Introducing Genie 3, our state-of-the-art world model that generates interactive worlds from text, enabling real-time interaction at 24 fps with minutes-long consistency at 720p. 🧵👇

Aug 5, 2025 · 3:03 PM UTC

80
209
18
2,242
Replying to @DrJimFan
The game development would be exactly prompt engineering then :)
4
1
1
37
That’s the end game ;)
10
1
43
Replying to @DrJimFan
Thanks @DrJimFan! It has been great having @agrimgupta92 in the team :D
3
10
Great work Jack!! I’ve been following Genie and it’s wonderful to see the quantum leap from 1.0 to 3.0!
9
10
Replying to @DrJimFan
Tesla has had this for a few years. Used for creating unusual training examples (eg near head-on collisions), where even 8 million vehicles in the field need supplemental data, especially as our cars get safer and dangerous situations become very rare.
69
130
22
1,612
Replying to @DrJimFan
This is the metaverse we were promised Hello Ready Player 1
9
Replying to @DrJimFan
The idea that all of UE5’s handcrafted complexity could dissolve into a dense block of learned weights is wild
4
Replying to @DrJimFan
A fascinating thought; however, artistry and intent might be lost if game development becomes purely data-driven, raising questions about authorship and creative control.
1
3
Replying to @DrJimFan
It looks like they combined the limited AI environment tools of something like Unity Engine with the limited 3d mesh generation AI tools of something like Meshy, and then applied an AI video filter on top.
Replying to @DrJimFan
Pretty good, eh? World models are well on their way to becoming practical to use! +1 neuralink == induced dream state where you control your dreams
Replying to @DrJimFan
it's stunning work
Replying to @DrJimFan
Can you use this for training data for robots?
Replying to @DrJimFan
I am really eager to know your deep thoughts about this … is this the Metaverse (Genie 7 with multiplayer interaction ) that will be used to train AI agents and also make people live in VR dreams in it (Matrix style ) where they learn and enjoy , while shareholders reap rewards
Replying to @DrJimFan
This is intended to be a joke, right?
79
Replying to @DrJimFan
Incredibly dumb take from someone who likely knows little about real-time rendering and game dev
13
Replying to @DrJimFan
i think a lot of other things will get abstracted away too. for eg apps, animations, videos, operating systems, complex nlp pipelines
11
Replying to @DrJimFan
As someone who lives flight simulators this gets me very excited for the future!
1
10
Replying to @DrJimFan
It would be interesting to know what you think about it, @TimSweeneyEpic ¿Will the future of Unreal Engine be this one in a decade?
9
Replying to @DrJimFan
How about generating an interactive world where you parents are proud of you and you have friends since that doesn't seem to be this one? 😘
1
8
Replying to @DrJimFan
You guys have a technology with legitimate use value but simply can’t resist larding up every sentence you say about it with as much bullshit as the NFT guys said about NFTs—probably because many of them became you. Don’t call this a game engine when that’s not what it is.
1
4
Replying to @DrJimFan
would love to see how genie 4 can generate a full mmo from prompts while synchronizing world states across multiple player viewports in real time.
2
5
Replying to @DrJimFan
AI world generation is cool and will have its place, but it is not game engine 2.0. Deterministic behaviours/outcomes are still needed for training applications, for example.
5
Replying to @DrJimFan
take your meds
1
5
Replying to @DrJimFan
"Game" "engine"
1
4
Replying to @DrJimFan
Any ideas of how such a model could be leveraged in the future except pure gaming? Would it have some used for robotics too?
1
3
Replying to @DrJimFan
can't wait to tell my grandkids I used to manually code physics engines while they're just whispering prompts to their neural game worlds
3
Replying to @DrJimFan
Soul-less crap
3
Replying to @DrJimFan
I was thinking X would be the first to achieve this breakthrough.
2
2
Replying to @DrJimFan
No it won't. All the complexity of UE is cheaper and more efficient as normal code. Why would $NVDA make up shit like this? What a mystery!
2
Replying to @DrJimFan
i love how you call it game engine rather than game
2
Replying to @DrJimFan
Midjourney awed the world 3 years ago because AI could generate barely recognizable images. Now we have this 🤯
1
Replying to @DrJimFan
Future version of this combined with future @neuralink i/o = another simulation layer
1
Replying to @DrJimFan
This stuff is super impressive. And I also think Ai will start playing a greater role in games. However I think it will be a mix of things. More like where you block out the levels but in low detail and possibly not even textured or very simple rough textures. Then perhaps add descriptions of how certain things should look. Like what style of a building it is or information about how it looks basically. And then have the Ai generate the rendered image. A bit more than just semantic maps to get more control. And all thr game logic will still be built with current tools I think, but made much easier by describing it, which generates the setup, similar to generating code. Or even generate thst in code. But still being able to tweak and modify it. Hopefully that will make creating games cheaper again as creating such high quality assets is very time consuming and expensive now. So expensive that it can probably bankrupt a studio if the game fails.
1
1
Replying to @DrJimFan
How can I participate and help in this AI research area? It's been one of the few goals that drive me, a self sustaining, persistent Virtual world.
1