Use of AI "decision models" that quickly pick one of a set of options instead of writing text surges, with custom training becoming the point of competition(techcrunch.com)
Writing language: KoreanRead in the original language
Plain summary
- A decision model is an AI that, instead of generating long text, quickly and cheaply picks one of several preset options and also reports how confident it is in that choice. It is used in service environments where a fast judgment matters more than the slow reasoning of a large model.
- According to TechCrunch, in October more than 4 in 1 requests on Vercel's AI model router (a service that splits requests among multiple models) went to decision models. On OpenRouter, the TypeSafe model received more than 1.5 billion requests last week.
- Microsoft said it will make Microsoft-Decision-1.1 widely available directly on Azure. The UK startup Sqwish received $3 million in pre-seed funding for its kettei fat model, and highlights as its strength a tool that keeps improving the model with customers' real operating data.
- Ranking comparisons are difficult, and many say developers can simply swap models in and test them directly on their own work. A Microsoft executive said by email that models tuned only to benchmarks quickly show their limits in real enterprise environments.
Found on
TechCrunch ↗ / Published by source
Have you run into something like this? Tell us in a line or two what you did. You do not need to know the product.