of gpt-oss-120b's tool calls fail on DekaLLM (bf16).
Not all models are served equally by all providers. On a typical model, the worst provider breaks tool calls 19× as often as the best. Find the best one for your agents.
| # | Model | Broken tool calls | Rank | Best on the model | Tool calls a day |
|---|---|---|---|---|---|
| 1 | Qwen3.8 27B | 0.40% | 5 of 21 | Darkbloom (fp4) 0.07% | 70k |
| 2 | GLM 5.3 | 0.90% | 25 of 42 | Amazon Bedrock 0.08% | 13k |
| 3 | DeepSeek V4 Pro 0813 | 1.77% | 17 of 21 | Ionstream 0.04% | 9.8k |
| 4 | Qwen3.6 35B A3B | 3.36% | 5 of 6 | AkashML (fp8) 1.63% | 12k |
| 5 | Gemma 4 26B A4Bbf16 | 3.79% | 8 of 11 | NextBit (bf16) 0.00% | 25k |
| 6 | gpt-oss-120bbf16 | 3.94% | 8 of 15 | Groq 0.04% | 48k |
And which provider to use.
The same provider can handle tool calls well on one model and struggle on the next.
of gpt-oss-120b's tool calls fail on DekaLLM (bf16).
on Qwen3.8 27B, its best model.
models, where the settings tell OpenRouter to skip DekaLLM.