Does your provider break your tool calls?

No
Bad
Actions

Tool calls that parse the first time.

Tool calls that parse, JSON that fits the schema.

  • Liquid AI
  • Hugging Face
  • Doubleword
  • NVIDIA
  • LMU Klinikum

Same weights. Different reliability.

Reliability comes from how a model is served. The same open weights, on different providers, break anywhere from 0.1% to 10% of tool calls. Across 46 models on OpenRouter, the worst provider typically fails 30 times as often as the best.

A grid of open-weight models by OpenRouter providers, each square coloured by the share of tool calls that come back invalid, from green under 0.1% to dark rust above 10%. Along each model's row the colours swing from green to rust: the same weights fail very differently depending on who serves them.

OpenRouter's published tool-call error rates, October 27 to November 2, 2026. The chart shows the 25 models with the most providers and the 42 providers serving at least three of them: 368 provider-model pairs with 1,000 or more tool calls a day.

Valid tool calls and JSON, as the model writes them.

.txt builds structured generation into the inference engine. At every step, the model can only write what your tools and schemas allow. We work with inference providers, model makers and teams that ship models on devices.

Models were taught to talk to people. We teach them to talk to software.

We started as two statisticians annoyed that a language model couldn’t reliably fill in a form. In 2023 we wrote a paper on making models follow a grammar without slowing them down, and put the code online as Outlines. People have downloaded it 73 million times since, and structured output has gone from a research idea to something every major model API offers.

Serving models in production takes more than an open-source library, so we built .lambda and .json. Building with models? Tell us what you’re working on.

From the Internet, with love.

Read the manifesto →
Meet the team →

Play it on your own model. 

The Z800 runs mock calls. Tell us your model and your tools, and we'll run the real ones.