Introducing Toast 1
88 points - today at 3:07 PM
SourceComments
trjordan today at 3:53 PM
I deeply love this idea of specialized LLMs for search. It's also extremely confusing to me how rough Google's entrance here is.
When I, a human, need an answer to anything moderately complex, it's unlikely that I get it on the first (pre-AI) round of google searching. Simple stuff, sure, but more likely I'll need to go 2-5 rounds. Maybe click a few links. Double-check my assumptions.
An LLM that can do that quickly seems like a slam dunk. I wonder what other problems benefit from that 10x-100x increase in context + 2-5 rounds with the LLM.
tolugenius today at 3:54 PM
I guess someone who has used a search agent (or a dedicated subagent) can speak when I'd reach for a tool like this vs either just 1) a smaller general model or 2) a non-llm approach to the problem? Like it's interesting I'm just curious how a search agent compares to say a model with dedicated rag pipelines is that much different?
docheinestages today at 5:02 PM
Are the benchmarks comparing just the models while keeping the harness the same (the open-source Toast harness)?
moffkalast today at 4:42 PM
> performs best with Mixedbread Search, but it can work with any search backend
Bread-first search, is it?
GPerson today at 5:16 PM
Iβm disappointed this is some AI thing and not a breadboard company.
deleted today at 5:09 PM
andai today at 4:08 PM
Article should probably explain what "Mixedbread Search" is.
cryo32 today at 4:11 PM
Some days I have no idea what the fuck I am looking at.
amazingamazing today at 4:32 PM
I know everyone loves to hate on google but i find search overviews and asking gemini to search for things way faster than any alternative. I was curious about a development near me and asked literally that and gemini pulled court records in about 20 seconds
Anyway, back to this - it seems to be more like the AI equivalent of algolia than google
ChrisArchitect today at 3:55 PM
Dunno about this branding/naming scheme - every time it comes up we have to double-check that it isn't some spoof/joke page
hn2crljhhy today at 5:06 PM
[dead]
arm32 today at 3:37 PM
Damn, now I'm hungry. All this bread talk.