Does your provider break your tool calls?

No
Bad
Actions

Tool calls that parse the first time.

Tool calls that parse, JSON that fits the schema.

Tool calls that parse, JSON that fits the schema.

  • Liquid AI
  • Hugging Face
  • Doubleword
  • NVIDIA
  • LMU Klinikum

Same weights. Different reliability.

Reliability comes from how a model is served. The same open weights, on different providers, break anywhere from 0.1% to 10% of tool calls. Across 46 models on OpenRouter, the worst provider typically fails 30 times as often as the best.

A grid of open-weight models by OpenRouter providers, each square coloured by the share of tool calls that come back invalid, from green under 0.1% to dark rust above 10%. Along each model's row the colours swing from green to rust: the same weights fail very differently depending on who serves them.

OpenRouter's published tool-call error rates, October 27 to November 2, 2026. The chart shows the 25 models with the most providers and the 42 providers serving at least three of them: 368 provider-model pairs with 1,000 or more tool calls a day.

Valid tool calls and JSON, as the model writes them.

.txt builds structured generation into the inference engine. At every step, the model can only write what your tools and schemas allow. We work with inference providers, model makers and teams that ship models on devices.

Play it on your own model. 

The Z800 runs mock calls. Tell us your model and your tools, and we'll run the real ones.