UK sovereign LLM inference

76 points - today at 9:27 AM

Source

Comments

pjc50 today at 10:06 AM
Could we have a bit more "who and where" on this please? "Relax.ai by Civo", great, who are Civo? Where's the datacenter? What's the corporate structure? UK resident founders?
mrdw today at 11:15 AM
btw, you can claim "relax" name instead of "relaxai" on pypi

pypi.org/project/relax is abandoned library, which owner registered via email with expired custom domain, so you can claim this domain and reset owner's account by email.

yanis_t today at 10:31 AM
Just my curiosity. Is (insert country) sovereign X is an efficient marketing strategy these days?
00deadbeef today at 10:36 AM
5 minutes to load and it just dumps me to a documentation site with no useful information about that this is, who made it, what it can do, etc.
tomaytotomato today at 11:01 AM
Congrats, its a small step in the right direction.

The UK it seems has dropped the ball on the whole training and building models part, although we are punching up in other areas now.

We really need to get our own equivalent to Mistral, and fast!

Havoc today at 10:34 AM
Nice. All for seeing more geographically diverse options.

BTW don’t see opencode in the docs yet much less known tools are?

iLoveOncall today at 10:09 AM
Why would smaller and worse models not be 80% cheaper?

If I can run those models on my consumer hardware, I'd better believe they are 80% cheaper than the models that need 1 TB of RAM.

walthamstow today at 10:10 AM
> Civo isn’t just another cloud and AI platform, it’s a whole new way of thinking.

come on now

imdsm today at 10:26 AM
Personal take: terrible name. RelaxAI feels like you trawled for available .ai domains with dictionary words and landed on this. But it doesn't work, unless it's a relaxed AI. Is it slower, but cheaper, we'll process your requests when we get to them, so relax!

You could have bought languagemodels.co.uk off me and used that!

bflesch today at 10:36 AM
As The Crown is sovereign of the United Kingdom, is this running in Buckingham Palace or in City of London?

Can the user choose which sovereign is doing the computation?

I'd personally prefer not to have the weird uncle do the computation, maybe the younger ones living abroad can do it.

;)

amelius today at 10:03 AM
This looks very interesting.

I have no idea why you got downvoted so much.

benjamintnorris today at 9:27 AM
Hi HN, I'm Ben, founding engineer at relaxAI.

We built a UK sovereign inference provider for developers who are either paying too much for OpenAI/Claude tokens or can't use US hyperscalers due to data residency requirements.

The short version: drop-in OpenAI-compatible API, latest open source models (Kimi K2.6, DeepSeek V4 Pro, Nemotron 3 Super, GPT OSS 120b), running on NVIDIA Blackwell GPUs in the UK. Zero code changes to switch from OpenAI. Up to 80% cheaper per token cost saving!

We built it on fully UK sovereign cloud infrastructure, so data never leaves UK jurisdiction. For anyone building in regulated sectors — finance, legal, health, defence — that matters a lot. But honestly, most of our early users just came for the huge cost savings.

We're looking for developers to kick the tyres. Check out our API docs at relax.ai/docs. I'd love your feedback and happy to answer any questions.

panchtatvam today at 10:20 AM
[dead]
imdsm today at 10:23 AM
While I'm British, based in the UK, seeing prices in ÂŁ really throws me

Token prices should be in $ as that's how our brains work

Cakez0r today at 10:28 AM
UK sovereign data? Land of arrests for posts on social media? Member of five eyes, "you spy on our citizens and we'll spy on yours and call it intelligence sharing"? Land of the infamous Online Safety act? That UK? Why would anyone want their data in the UK?