GPT‑NL: a sovereign language model for the Netherlands
tno.nl247 points by root-parent a day ago
247 points by root-parent a day ago
I keep seeing these "sovereign" LMs time and time again. In Sweden we had GPT-SW3 (https://www.ai.se/en/project/gpt-sw3) and same story there. Instead of burning money on "sovereign" claims, national research labs should instead focus on building on top of solid baselines (like Qwen/Kimi) and finetuning frontier models with real agentic utility that can be applied across actual use cases and can be widely used by its people, basically for free. Nations should mirror what Cursor has done with Composer 2.5 for example.
Disagree, it’s in the country’s best interest to facilitate internal expertise on the full stack and own their “supply chain” so to speak and fight brain drain. The outcome isn’t just the model, it’s the expertise. Otherwise all their smartest folks will depart for countries where LLM development is strongest.
Got it, so every country should focus on having a mediocre-at-best AI strategy by refusing to work together? Surely this will create a better future instead of pooling resources.
This vaguely-nationalist world view around tech that’s emerging in Europe is dangerous, man.
On the brain drain problem in particular, one way to ensure talent sticks around is to create a good environment for people to do their best work. In much of Europe, getting bureaucracy out of the way and encouraging real investment would go a long way. People leave because they can make more money and they want to be surrounded by the best people. People would trade some of that off to stick around their home countries, however if you go to California and talk to folks from e.g. NL or DE working on this stuff, they have a lot to say about innovation and working culture back home.
This "vaguely nationalistic world view around tech" is a direct consequence of the US government weaponizing its leading tech firms reach into the EU for nationalistic purposes.
The EU was build on the principles of collaboration, to overcome the nationalistic impulses. Free trade and free movement of people, no need for everyone to replicate what everyone else is doing. Preventing individual nation states from favoring and supporting their home grown firms over other EU firms is a central legal principle.
But this only works if it is reciprocal. And ideally if the partners are roughly on the same level. When you force developing nations in trade deals to not protect local firms, you are also preventing them from moving up the value chain and locking them into the position of "raw material providers".
When trading with China we know that China has absolutely no qualms supporting its strategic industries with a truck load of subsidies. And it is preventing foreign firms from investing and selling on the domestic market.
For the longest time the US was considered a safe partner though. Sure, plenty of disagreements in the details, but in principle someone whom you can rely on. That idea has been decisevly dismantled over the last 10ish years. The US unilaterally cut of the EMails of EU courts. The US has unilaterally decided that EU partners cannot use Fable/Mythos.
The only reasonable reaction is to make sure that the EU can maintain and create its own critical infrastructure.
Let's not overstate the case. The EU was built to keep France and Germany from getting into another war, and it has been successful at that. All the other "principles" are just window dressing.
Isn't it up to Europeans to define the purpose of the EU? What's your claim to having the right to define it?
I'm not defining anything. I'm just explaining why the key decision makers actually created the EU. The statements made for public consumption shouldn't be taken too seriously.
You're vastly underestimating the economic importance of EU integration.
This "vaguely nationalistic world view around tech" is a direct consequence of the US government ... The EU was build on the principles of collaboration ... But this only works if it is reciprocal.
This sounds great but doesn't really make any sense. What skeptics are saying is there should be a pan-EU effort to build frontier models, rather than one-off toy models built by each country as a box-ticking exercise.
"We built the EU as a powerful supranational organization, so logically the EU's response to a great power challenge in the realm that may well define the 21st century is gonna be to shatter its efforts into 27 useless pieces, because Trump bad" is just absolutely ridiculous and will not lead to anything good. Be the change you want to see, etc.
Look I agree with all you said. The EU should do this but the EU is also structurally bad at large concerted efforts exactly because it is a collaboration mechanism, not a super state.
Whatever topic comes up on this board, if the EU is mentioned people go a bit cray-cray.
If an individual country trains a language model, it's not ambitious enough. If we try to do one for the whole EU they will say it takes too long (you need to get all countries on board, you see). If the EU announces it by executive decision it's a dictatorship and government driven economic intervention, if a EU company does it they'll say it's not good enough.
You can't win with these people. In my opinion, you shouldn't even try to convince them.
>This "vaguely nationalistic world view around tech" is a direct consequence of the US government weaponizing its leading tech firms reach into the EU for nationalistic purposes.
And in response NL should weaponize ASML for example. Then both sides would naturally back down. Specialization is the most efficient way of developing tech civilization.
Whereis everybody building their own mediocre versions would be repeating Russia in its attempt to make its own national messenger - a lot of government money sunk, yet people are still using Telegram/etc.
Of NL weaponizes ASML they will just take their IP and leave NL and then they have nothing. They have already pushed a lot of things out of NL and should invest in leveraging the position without weaponizing it.
If ASML is just IP then everyone would have already copied it. They have an extremely deep and high tech supply chain that is nearly impossible to copy.
ASML wiki for those like me who were confused https://en.wikipedia.org/wiki/ASML
(despite the name, i am not dutch)
I am quite interested to hear how you would pronounce your name, dike-ster-house (assuming you live in the US)?
> dike-ster-house
yep, basically. 3rd one down https://www.howtopronounce.com/dijksterhuis
the story behind it: i was looking for a name to write music under. and i was reading academic papers about subliminal messaging in music and stuff. i came across a paper where they seemed to be absolutely ripping into this "dijksterhuis" guy's previous paper. felt bad for him. felt like he was an underdog. so i ran with that name.
> (despite the name, i am not dutch)
Some close or far ancestor was though. :'-)
Why would it have to be mediocre?
Both Netherlands and Sweden produce highly competent researchers. Per capita on par with any other location on the planet, including California.
This will be good for Europe as a whole and also the planet.
>and also the planet.
What a glorious day for Canada and, therefore, the world.
I don’t think it’s good that the USA has so much influence due to their dominance in information technology.
It was only nominally democratic, now it’s a total shit show.
>total shit show
Are there people legitimately brain-rotted such that they believe stuff like this?
Outside of the constant flow of "hey guys, look at the latest dumb thing Trump did" coming from entertainment outfits posing as news, what are we even talking about? Life goes on as normal for the Americans. You are way too online.
Yes, the current administration has been in power for less than two years so obviously the “day to day life” hasn’t changed much for the average American (except everything has gotten more expensive).
The US is no longer looked at as a superpower, it just surrendered to a regional power and will pay $300B USD in tribute.
But for Trump and his cronies life certainly has improved.
But the damage is done and we are witnessing the decline and destruction of the worlds greatest Empire of all time.