Nvidia RTX Spark encrypted firmware slows inference speed to 35% on Linux

mindstudio.ai

615 points by novaRom 3 days ago


nonethewiser - 3 days ago

Please read the article. Comments here are wildly misinformed.

This is a lack of linux driver support for firmware designed for windows laptops.

This is a problem on the MSI Prestige laptop using the RTX Spark platform. Lets assume it also applies to the Asus and Dell machines using RTX spark.

RTX Spark is a new platform and all of these laptops ship with Windows. You cant get Linux on any of these machines from the factory. There is also precedent for NVIDIA shipping linux support well after Windows (2 years in the case of Dynanmic Boost, a similar power sharing feature).

jleask - 3 days ago

Nvidia doing what Nvidia has always done; proprietary closed drivers. Weird choice to cryptographically protect the power settings. Key problem is that we've allowed a company that's always been this way to form a monopoly. Other brands exist, perhaps it is now worth the effort to migrate and rebuild elsewhere.

K0balt - 3 days ago

Wtf. Are we actually seeing a push towards being 100percent dependent on the cloud?

Sovereign AI has never been more important.

Controlling AI is so much more powerful and impactful than controlling search or social algorithms.

Centralized AI a 10x on social control over everything we have seen before, and there is no way that a free and open society survives contact with centralised, high capability AI if the system is manipulated towards guiding outcomes. It’s essentially mind control, as people will offload an even greater share of their cognition to AI than they do with search and social.

Build and maintain sovereign AI while you still can.

schaefer - 3 days ago

The article is about the RTX Spark, not the DGX Spark. The title should be changed.

BalistaCRATZ - 3 days ago

Unclear to me why the first attempt was to boot Omarchy, a brand new, vibecoded distro, as opposed to one of the much more reliable ones that have been around for decades

laughing_man - 3 days ago

Nvidia was already a bad choice for Linux because of closed drivers.

hypfer - 3 days ago

Why does the title say DGX spark when the link is the RTX Spark laptop?

Those are very different things as far as I understand, and the whole "doesn't work well with linux" really only makes sense on the RTX Spark laptop I think? Isn't the DGX spark linux by default?

sva_ - 3 days ago

It should be possible to reverse engineer this, if it works on windows?

> The laptops also support unified memory configurations up to 128GB, shared between CPU and GPU, which is unusual for a laptop and central to why they’re being marketed at AI developers in the first place.

This isn't rare on laptops, pretty default on AMD with iGPU

viraptor - 3 days ago

Fortunately that's just a matter of weeks until someone revengs and publishes the fix... even if we need to wait a while for a proper upstreamed solution.

AdamConwayIE - 3 days ago

I wonder if you could port the GB10's drivers over? They're extremely similar and the GPU itself identifies all the same specs.[1]

Also very curious if the NPU is visible in Linux, too.

https://www.xda-developers.com/nvidia-rtx-spark-laptops-same...

aa-jv - 3 days ago

As a DGX Spark user, this article title gave me conniptions.

But, on the other hand, having my DGX Spark stack at hand, I know the solution:

    /btw reverse engineer the Nvidia Platform Controllers and Framework component and build a Linux version
"AI views proprietary components as damage and routes around them."
smlacy - 3 days ago

It's not clear to me if this is just an egregious bug or intended malicious behavior? I like to generally give people the benefit of the doubt.

juujian - 3 days ago

This is unfortunately the normal release cycle for Linux, especially with Nvidia. If you buy the latest and greatest, some features just aren't available. Eventually, manufacturers work with Ubuntu to unlock some of those features and other distributions then adopt those drivers. Takes a few months though. If you're lucky, the drivers become part of the Kernel, and that process takes even more time. Some features never land at all (looking at you, AMD XDNA gen 1).

prima-facie - 2 days ago

This reminds me of the BDProcHot throttling issue on some Intel laptops from a while ago.

I remember having a similar issue with an HP laptop running the first generation of Intel Alder Lake. The CPU would throttle heavily to something like 800Mhz on battery on Linux.

https://github.com/yyearth/turnoff-BD-PROCHOT

petercooper - 3 days ago

Assume I'm naive on this matter, but why wouldn't Nvidia allow its own DGX OS to be a first party OS on these devices? Some sort of MS subsidy? Ecosystem-wise, wouldn't it make sense for Nvidia to keep pushing its own OS on all the devices containing its hardware?

impossiblefork - 3 days ago

Unrelated to this slowdown, I could imagine this sort of thing being the right application for things like Taalas, although I'm not quite sure whether it can actually offer what I imagine that it can (i.e. ability to make a cheap, physically small card that can run a large model).

A laptop can't run the latest big models, because memory is too expensive. This thing probably can't run models larger than Mistral Small 4. But it'd be a completely different thing to have a hardcoded Mistral Large 4, than a choice of tiny models.

nubinetwork - 3 days ago

> the GPU gets locked to roughly 780 MHz on Linux instead of the 2 GHz-plus it hits on Windows

This has been an issue on Linux since 2014, and the gtx980.

khgihpipihkjdsg - 3 days ago

I am starting to wonder whether CEOs everywhere ( but especially in US ) are simply unable to read the room. I shrugged off nvidia when they did it to gaming and mining ( it annoyed me, but ultimately there were options to deal with it ), but here it is touching a much wider populace with repercussion well beyond crypto and gaming.

lolive - 3 days ago

Isn’t this RTX product targeted at the corporate market, proposing privacy and local AI for laptops, targeting an audience that is wealthy, massively uses Windows [and may be WSL], and is in dire need of that feature, so willing to pay.

barrkel - 3 days ago

I remain puzzled why anyone would want to do inference on a laptop if they have a home internet connection and a phone.

If you really want to do DIY inference, plug it in at home and set up tailscale so you can access it on the go.

No huge battery drain or toasty hot laptop required. Lower cost laptop. Lighter laptop. Longer battery life laptop. Win win win win.