of Mistral Nemo's tool calls fail on io.net (fp16).
Not all models are served equally by all providers. On a typical model, the worst provider breaks tool calls 19× as often as the best. Find the best one for your agents.
| # | Provider | Broken tool calls | Tool calls a day | $ in / out per M | Tokens/s | Uptime |
|---|---|---|---|---|---|---|
| 1 | Mistral# | 0.62% | 1.0k | $0.15 / $0.15 | 92 | 100.0% |
| 2 | io.netfp16# | 1.38% | 11k | $0.02 / $0.02 | 36 | 100.0% |
Also ignored, under 1,000 tool calls a day: DeepInfra (fp8) 39.04%.
{
"provider": {
"order": [
"mistral/eu",
"io-net/fp16"
],
"ignore": [
"deepinfra/fp8"
]
}
}Point your agent at llms.txt
And which provider to use.
Releasing a model? Test it before launch.
of Mistral Nemo's tool calls fail on io.net (fp16).
as often on io.net (fp16) as on Mistral, its best provider.
broken tool calls a day across its 2 providers.