Ask HN: What Makes Tokens Expensive?

3 points - yesterday at 4:50 PM


Are there really such architectural differences between for example sol and astra that makes astra twice more in token price? Or maybe token cost covers training expenses? For me it's hard to believe that astra need twice the computing power that sol needs...

Comments

yorwba yesterday at 6:23 PM
Willingness to pay. If people are willing to use Astra instead of Sol even if it costs twice as much, OpenAI has no need to make it cheaper. Prices only reflect costs in a competitive market where customers actively seek out cheaper alternatives.
verdverm yesterday at 5:02 PM
costs are in a large part tied to model parameter count, eg. a small model fits on one GPU, the biggest models require an entire rack

the primary difference you see through those prices is model size

that you don't seem much capability difference is why Big Ai is pushing for regulatory capture, because small models are nearly as good for many tasks at a fraction of the cost, undermining the business model they have used to justify the most expensive infra build out in human history