In case it's not obvious, this isn't a model, this is python scripts that call out to models (code not available).
It's mostly "did you know you can attach an LLM to a PCG system?", but there is one idea here you don't see much of: an image model performs the composition (which image models are really good at), and then you extract the objects into 3d via things like SAM3D before placing them in the world, which is pretty interesting.
The rest is standard stuff you'll find in your favorite PCG system/game engine. Still, think most people don't realize how good LLMs are at 3D these days, especially Fable 5 (which this project predates).
cautiouscatyesterday at 10:36 PM
It looks impressive. However open worlds are at their best with hand placed details and environmental storytelling. Look at Skyrim/Cyberpunk vs. Starfield where most of the world is proc gen’d.
I get that you run this, and then edit it. But the generated villages just aren’t interesting in my opinion. It’s probably great for tencent’s market where you’re mass producing gacha style games, but I don’t think worlds made in this fashion will scratch the open world itch like the best open world games out there.
ablationtoday at 9:36 AM
Again, that Claude web design aesthetic is just seemingly everywhere right now. It takes me out of what I'm reading as soon as you see the tells.
cobertosyesterday at 11:22 PM
In both the Autumn and Winter examples in the hero images, the algo seemed to have placed buildings on the water in the foreground
In the summer example in the hero images, the building placement + small pockets of water on the left looks odd and low attention to detail. A similar poor quality result as if an uncaring human used a scatter brush...
Curious if the examples are cherry-picked and by how much, or if this is one-shoted
2001zhaozhaoyesterday at 11:39 PM
This kind of content generation can be quite cool to enable new game ideas for indie developers that were only possible with AAA before. But it also makes it hard to gauge the amount of human work that went into the game. When you see an elegantly designed building, environment or easter egg in the game, was that really made by a human (or even prompted by a human), or did the AI generate it autonomously as part of a much larger generation step?
gosolozeroyesterday at 10:54 PM
Interesting prompt to world pipeline. I wonder if there can be more style applied than just the "MMO cartoony" style? Like medieval Witcher or realistic Cyberpunk buildings?
thymine_dimertoday at 2:14 AM
The water levels don't change seasonally..So I'm guessing it's a very high rainfall area? In which case erosion and nutrient leaching are bound to be issues for the agentic farmers. I wonder if they've thought to build soil with perennial ground cover species..
But as I say this, I realise the tree species seem to change very dynamically from season to season. So I'll have to assume either the temporal rate of change is actually a lot slower than one would expect in a model like this (allowing large tree species to regenerate annually), or there are new coniferous flowering tree varieties in this universe.
deepmemtoday at 7:43 AM
Looking forward to hearing more updates from tencent 3D models. :)
andreypktoday at 6:59 AM
impressive, but as I understand the worlds were pre generated an there no way to reproduce it on my setup?
EagnaIonattoday at 6:06 AM
It looks cool. Shame the source isn't available.
But Claude can do this with little prompting.
[edit] Not sure why the downvote, but Claude Design can do this, its just a matter of knowing the exact prompt.
This was created with just the prompt on from their front page and nothing else.