Perplexity Decider v1.3: Training, eval, and use cases
87 points - yesterday at 7:24 PM
SourceComments
Here are some thoughts not facts:
On AA Decision Index.
Decider v1.3 and Decider v.1.2 seem to have same benchmarks. However, V1.3 flash beats V1.2 flash by 4 points.
I am not particulary excited about this pattern/trend of having flash versions for decision models. The whole point of Decision models was to deliver faster ouput for high volume requests at much cheaper cost than Reasoning models. Since most reasoning models can and probably do outperform decision models already in accuracy but they are a lot slower and are pricier. Reasoning Models can already return structured ouput.
So your flagship model must be fastest and most accurate.
Unless it can handle some different form of input other than just image and text, I don't see the point of having both flagship and flash version for the same model.
https://www.perplexity.ai/hub/blog/pii-trace-detecting-perso...
https://www.perplexity.ai/hub/blog/a-local-first-agent-for-p...
Here's new product, which is just our shitty version of this easily reproducible technology
What is this?
Same for Google and their decisions api