Wtf. Are we actually seeing a push towards being 100percent dependent on the cloud?

Sovereign AI has never been more important.

Controlling AI is so much more powerful and impactful than controlling search or social algorithms.

Centralized AI a 10x on social control over everything we have seen before, and there is no way that a free and open society survives contact with centralised, high capability AI if the system is manipulated towards guiding outcomes. It’s essentially mind control, as people will offload an even greater share of their cognition to AI than they do with search and social.

Build and maintain sovereign AI while you still can.

Please read the article. Comments here are wildly misinformed.

This is a lack of linux driver support for firmware designed for windows laptops.

This is a problem on the MSI Prestige laptop using the RTX Spark platform. Lets assume it also applies to the Asus and Dell machines using RTX spark.

RTX Spark is a new platform and all of these laptops ship with Windows. You cant get Linux on any of these machines from the factory. There is also precedent for NVIDIA shipping linux support well after Windows (2 years in the case of Dynanmic Boost, a similar power sharing feature).

Nvidia doing what Nvidia has always done; proprietary closed drivers. Weird choice to cryptographically protect the power settings. Key problem is that we've allowed a company that's always been this way to form a monopoly. Other brands exist, perhaps it is now worth the effort to migrate and rebuild elsewhere.

> A hands-on look at dual-booting Linux on the Nvidia RTX Spark laptop, the GPU clock throttling bug found, and why WSL still wins.

Man it really is exhausting to read a title that sparks my interest, just to be greeted with the most basic Claude-isms in the subheading.

Unclear to me why the first attempt was to boot Omarchy, a brand new, vibecoded distro, as opposed to one of the much more reliable ones that have been around for decades

The article is about the RTX Spark, not the DGX Spark. The title should be changed.

Nvidia was already a bad choice for Linux because of closed drivers.

Why does the title say DGX spark when the link is the RTX Spark laptop?

Those are very different things as far as I understand, and the whole "doesn't work well with linux" really only makes sense on the RTX Spark laptop I think? Isn't the DGX spark linux by default?

It's not clear to me if this is just an egregious bug or intended malicious behavior? I like to generally give people the benefit of the doubt.

It should be possible to reverse engineer this, if it works on windows?

> The laptops also support unified memory configurations up to 128GB, shared between CPU and GPU, which is unusual for a laptop and central to why they’re being marketed at AI developers in the first place.

This isn't rare on laptops, pretty default on AMD with iGPU

I wonder if you could port the GB10's drivers over? They're extremely similar and the GPU itself identifies all the same specs.[1]

Also very curious if the NPU is visible in Linux, too.

https://www.xda-developers.com/nvidia-rtx-spark-laptops-same...

As an aside, I made the mistake of buying the Surface Laptop Ultra and it’s such a dud.

NVIDIA and Microsoft tried so hard to make a Mac clone with this and it’s just missing the mark everywhere.

It doesn’t do the dynamic memory split that a Mac does so out of the box it reserves 32GB (half) for the GPU and windows limits CPU processes to that. Getting more memory requires a reboot.

And because I want Unix tools (without Cygwin), WSL2 splits that even further in half.

Performance is way behind a similarly specced Mac. The GPU is thermally throttled near a 5060 laptop. The CPU out of the box came in a lower power state but windows power management makes it stuttery unless you change that, at which point it’s cooling is a hurricane compared to the Mac which outperforms it while being quieter.

The new MagSafe like connector is stupidly designed too. You can’t generically use it in any USB-C port, it’s super chonky and disconnects only on the horizontal axis. Worse, because it’s a right angle connector it can only be used in one orientation without blocking the other ports.

Windows input handling sucks too. There’s a lag before the trackpad responds based on moved distance. Some terrible take on palm rejection I’m sure. But even their display is mediocre because it gets very bright but they messed up local dimming. So if you select a bunch of text in the terminal it blinds you.

Idk I got this specifically to do windows dev with CUDA on arm. So I knew it was niche but anyone else buying this is making a mistake. It’s an unfinished product trying to be a competitor that nobody in Microsoft even understands.

This Linux support issue is just the icing because everyone keeps asking me why I don’t just put Linux on it and workaround my issues, but you can’t.

I’ve spoken to friends at NVIDIA who say it’s rushed out. So maybe software will get better but I urge folks to not buy this unless you’re into the same niche needs as me.

Fortunately that's just a matter of weeks until someone revengs and publishes the fix... even if we need to wait a while for a proper upstreamed solution.

This is unfortunately the normal release cycle for Linux, especially with Nvidia. If you buy the latest and greatest, some features just aren't available. Eventually, manufacturers work with Ubuntu to unlock some of those features and other distributions then adopt those drivers. Takes a few months though. If you're lucky, the drivers become part of the Kernel, and that process takes even more time. Some features never land at all (looking at you, AMD XDNA gen 1).

I remain puzzled why anyone would want to do inference on a laptop if they have a home internet connection and a phone.

If you really want to do DIY inference, plug it in at home and set up tailscale so you can access it on the go.

No huge battery drain or toasty hot laptop required. Lower cost laptop. Lighter laptop. Longer battery life laptop. Win win win win.

Assume I'm naive on this matter, but why wouldn't Nvidia allow its own DGX OS to be a first party OS on these devices? Some sort of MS subsidy? Ecosystem-wise, wouldn't it make sense for Nvidia to keep pushing its own OS on all the devices containing its hardware?

We can reverse engineer anything... why not start with Nvidia's drivers and so on?

> the GPU gets locked to roughly 780 MHz on Linux instead of the 2 GHz-plus it hits on Windows

This has been an issue on Linux since 2014, and the gtx980.

Is this really news? I thought the community has long ago conceded defeat to Nvidia on this issue since the Nouveau driver as well as the new Nova drivers will both utilize Nvidia's firmware blob.

Unrelated to this slowdown, I could imagine this sort of thing being the right application for things like Taalas, although I'm not quite sure whether it can actually offer what I imagine that it can (i.e. ability to make a cheap, physically small card that can run a large model).

A laptop can't run the latest big models, because memory is too expensive. This thing probably can't run models larger than Mistral Small 4. But it'd be a completely different thing to have a hardcoded Mistral Large 4, than a choice of tiny models.

Maybe they should try installing the same distro that is used on the DGX spark to see if that works.

You will never stop me. As I and everyone like me, before and after me, have shown, time and time again. And by me, I mean nature. And by nature I mean math and logic unchangeable in any possible universe. You cannot give me a thing without me having it. If a thing exists, I can copy it, know it, and bring it's equivalent into existence. Nothing can be created that is not indelibly written into the the intricate cause and effect chain of history. A perfectly encrypted thing is indistinguishable from the noise of the cosmos, but if I want I thing, it shall soon emerge, free from any control from that noise, which is the weight of all that has happened, just as surely as I can count to a number.

If you want to prosper with the current of nature, provide a thing easily for mutual benefit. The more you try to block a thing, the sooner your demise into uselessness.

>Oddly, the direction of the problem flips depending on power source. Unplugged, Linux hit around 61 to 67 tokens per second on LM Studio, comparable to Windows. Plugged in, that same test dropped to about 15 tokens per second.

Absolutely hilarious.

This is just incompetence. No reason Nvidia with its TRILLIONS of market cap couldn't of tested and fixed this on Linux before shipping.

Or a day one patch.

I have no doubt that'll it'll work right eventually. Long after RTX Spark laptops flop and can be purchased for half off.

Last night I pulled out my 5070TI laptop and installed CachyOS. I was running various models within about 20 minutes.

That 12GB of VRAM is a hard limitation, Unsloth can't split jobs between vram and system memory.

Remember when Apple was slowing down iPhones, the outrage!

But with Nvidia people just expect they nerf all the features.

We have antitrust laws on the books. They have barely been enforced since Reagan. But that good change if there was political will. How is Nvidia not a monopoly?

Have you tried lact to increase clock/power level? https://flathub.org/en/apps/io.github.ilya_zlobintsev.LACT

2 months old laptop has power management issues on Linux. What a suprise!

Still miles ahead compared to Apple, where linux does not even boot on newer macs!

hm. nvidia is garbage on linux again. just as the prophecy foretold. we are safe from the singularity, for now.

I am starting to wonder whether CEOs everywhere ( but especially in US ) are simply unable to read the room. I shrugged off nvidia when they did it to gaming and mining ( it annoyed me, but ultimately there were options to deal with it ), but here it is touching a much wider populace with repercussion well beyond crypto and gaming.

I do wonder how much it would cost to "clean room" engineer the firmware using AI.

Nvidia being the shittiest hardware vendor for GNU/Linux, as always.

Next GPU is going to be AMD

This reason alone is why I rather stay on Strix Halo

> the firmware’s power table is encrypted and only the Windows driver can decrypt it

Why the fuck is the power table encrypted?

So weird that everyone gives Microsoft a complete pass. They probably paid Nvidia to give them a head start so people would be forced into Windows and WSL for awhile.

This one is allegedly/hopefully a bug but just waiting for it to become a revenue stream / paywall. Uh oh, you want to run locally your dangerous illegal foreign open models, not licensed by Nvidia? Can’t work with you paying for a special security feature unlock on your GPU.

Or maybe just not at all - shell out for OAI tokens and send us all your data - your privacy is very valuable to us and we will make sure to be the only ones to monetize it.

You could say, Nvidia is selling pickaxes and has no business gatekeeping what rocks you hit with it, but I guess it depends on their relationships with major mining companies, and ultimately what pays more.

Maybe stop buying NVIDIA's crap now?

As a DGX Spark user, this article title gave me conniptions.

But, on the other hand, having my DGX Spark stack at hand, I know the solution:

    /btw reverse engineer the Nvidia Platform Controllers and Framework component and build a Linux version

"AI views proprietary components as damage and routes around them."

And anybody who watches proprietary APIs like CUDA saw this coming for, like, 15 years.

They've always played these sorts of games. Now, people are seeing the substandard solutions for what it is, and are angry.

Decompile time

As always, nothing has changed, Nvidia is always shit in supporting Linux.

just reverse engineer the firmware...

much ado about nothing, it'll probably come out in some time. Just microsoft trying to capture market/midnshare initially

Wtf is Nvidia doing?! I was considering buying one, but now?

It was only a question of time until enshittification would arrive on GPUs. This will continue and expand, since there are no consequences.

[flagged]

[flagged]

[flagged]

[flagged]

[flagged]

[dead]