Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia

18 points - today at 8:36 PM

Source

Comments

PcChip today at 9:19 PM

I didn't see any benchmarks against vllm, sglang, exllama, etc