Launch Partner for Baseten’s Model Labs

We’re partnering with Baseten to bring agentic search to every dataset. Together we offer agentic search at 20x lower latency and 100x lower cost than a general frontier model, at equal or better accuracy. You can now use SID straight from the Baseten Model Library, on the inference platform you already run on.

Search modelsEnd customer 1End customer 2End customer 3End customer 4End customer 5BasetenDistribution platform

Try on Baseten Try on SID

People often misinterpret The Bitter Lesson, which is about using general methods, not about creating general models. One of Sutton’s examples of a Bitter-Lesson model is AlphaGo, which is the opposite of general1It only plays Go. but was trained using general methods. That the most general method to pretrain a text transformer happened to create a very general model is less a law of nature than a property of the data: the biggest dataset (the internet) also happens to be the most general.

But even the most general language models aren’t very good at playing Go. There is value to general models, but this generality comes at the cost of outright performance. What you really want to maximize is leverage on computation: capability per FLOP, whether spent in training or at inference. A better training objective gives you more leverage. A way to use less human data gives you leverage.2Albeit indirectly. For Go, AlphaZero training has orders of magnitude more leverage than retrofitting a language model.

At SID, we have found ways to get much more leverage for the task of search; incidentally, one of the two tasks Sutton believes scales arbitrarily.3Yes, he meant search as in MCTS, but we’ll take it. We don’t know the full extent of our leverage, but SID-1 gives a lower bound: it matches frontier models on retrieval accuracy at roughly 1/500th the inference compute, more than 2 OOMs.

Unlike Go, search is very useful. We’re thrilled to be a launch partner for Baseten’s Model Labs to bring this utility to everyone. Together we offer agentic search at 20x lower latency and 100x lower cost than a general frontier model, at equal or better accuracy.

We expect many other tasks to go this way. The future will be multi-model not as a compromise to save money, but because specialized models are simply better: faster, cheaper, and more accurate at the thing you actually need.

Footnotes

  1. It only plays Go. ↩

  2. Albeit indirectly. ↩

  3. Yes, he meant search as in MCTS, but we’ll take it. ↩

All research