This is something I'd do if I've had the disposable income lol
aftbittoday at 9:01 PM
Neat blog! I was intrigued by this bullet point mentioned in passing:
>my four hard drive USB 3.2 ZFS raidz2 array with four 24 TB drives
Can you speak more about this? Which USB array did you choose? How well does it work? I've been slowly planning a transition away from my power-hungry surplus enterprise gear in the 19" rack towards a smaller, quieter, lower power setup ... but storage is the real kicker right now. I have a 12x18TB array in raidz2 built into a 1U NAS case, and I just can't quite figure out a better way to package something like that. I would need three USB arrays if I want to reuse the existing drives, which I think I do given how expensive storage is today.
cogman10today at 8:14 PM
I strongly considered it, but the one thing that scares me away from wanting to do the spark is you basically have to use nvidia's linux (from what I've read) and it doesn't appear the nvidia is interested in upstreaming their kernel changes.
I'm avoiding where possible buying electronics where support is controlled by the manufacturer and not me.
bryanlarsentoday at 8:13 PM
It's interesting how many of these issues don't appear to be specific to the DGX Spark but to the standard "Nvidia GPUs suck on Linux" type of issues that afflict a lot of people.
midnightbobarunlast Sunday at 7:49 PM
Super-powerful (if rather pricy) Linux desktop that happens to play games while doing everything else... that man is living my dream :'D
trentortoday at 8:27 PM
I'm genuinely disappointed with my Spark. I don't know how anyone can claim it performs decently with LLMs or diffusion models. Back when I worked in VFX in the early 2000s, we had a saying: "Render time is coffee time" and if you try to run this thing with a usable context size, you'll be drinking a lot of coffee. Most of the optimizations it relies on for inference simply aren't available for training, so it crawls like a snail on almost every model. An RTX 6000 Blackwell would have been the better investment for an AI enthusiasts and for general computing there are cheaper offerings.
ramshankertoday at 8:38 PM
Yes. Waiting for the Windows Version myseflf. RTX Spark Desktop.
rvztoday at 9:01 PM
I would avoid the DGX Spark. For that price and its performance on running local models it is a complete scam. This tweet says it all [0]