A tiny world model running games on a Raspberry Pi Pico 2 W

205 points - yesterday at 8:32 PM

Source

Comments

boustrophedon yesterday at 10:46 PM
I might have missed it in the readme, but what hardware did the training take place on? This is really neat.
skrellm today at 8:40 AM
I honestly believe that these neat projects (smallest possible, locally run LLMs) are the real future of AI on the long run.
dannyw yesterday at 8:56 PM
This is incredibly cool! Fascinating to see looped transformers be necessary for mini-Doom, but not for simpler games.
xpct today at 1:05 AM
Is the actor trained on world model's mistakes as well? If so, it should learn to force hallucinations that force it into an easier state.
andai yesterday at 9:24 PM
Very cool. I didn't know NNs were capable of such determinism, that's very interesting. Is this a similar effect to overfitting? Also, it's the same model for all the games, right?
deleted yesterday at 8:32 PM
cchance today at 3:52 AM
If this runs on a PI... can it run on webgpu ?
nater5000 yesterday at 9:20 PM
Honestly fascinating. I almost feel like you'd be better off avoiding any discussion of the fact that this runs on a Raspberry Pi Pico 2 W because it takes away from the crazy world model capabilities (of course, the fact that this does run on a Pico 2 makes the whole thing much more impressive).

There's gotta be a good way to incorporate this logic into a larger, more "traditional" game in a meaningful way. Seems like an approach for procedural generation that could solve some of the issues usually found with actual procedural generation.

gaiya365 today at 2:04 AM
[flagged]
lanmu today at 2:10 AM
[dead]
rpsworld today at 1:10 AM
[flagged]
tty_bordel yesterday at 10:00 PM
[dead]
sophia96087 today at 1:49 AM
[dead]