of DeepSeek V4 Pro 0813's tool calls fail on Cloudflare.
Not all models are served equally by all providers. On a typical model, the worst provider breaks tool calls 19× as often as the best. Find the best one for your agents.
| # | Model | Broken tool calls | Rank | Best on the model | Tool calls a day |
|---|---|---|---|---|---|
| 1 | Qwen3.8 27B | 0.40% | 6 of 21 | Darkbloom (fp4) 0.07% | 1.4k |
| 2 | DeepSeek V4.1 Flash 1017 | 0.57% | 17 of 35 | Sail Research (fp4) 0.03% | 537k |
| 3 | GLM 5.2 | 0.68% | 8 of 27 | Friendli 0.15% | 4.4k |
| 4 | Kimi K2.7 Code | 0.71% | 6 of 11 | NovitaAI (int4) 0.03% | 1.3k |
| 5 | DeepSeek V4 Pro 0423 | 0.78% | 1 of 13 | — | 27k |
| 6 | DeepSeek V4 Flash 0423 | 0.97% | 6 of 16 | Crusoe (fp8) 0.46% | 117k |
| 7 | DeepSeek V4 Flash 0731 | 1.38% | 8 of 22 | Sail Research (fp4) 0.04% | 12k |
| 8 | GLM 5.3 | 2.70% | 35 of 42 | Amazon Bedrock 0.08% | 6.2k |
| 9 | Gemma 4 26B A4B | 7.74% | 10 of 11 | NextBit (bf16) 0.00% | 31k |
| 10 | DeepSeek V4 Pro 0813 | 7.93% | 21 of 21 | Ionstream 0.04% | 2.4k |
And which provider to use.
The same provider can handle tool calls well on one model and struggle on the next.
of DeepSeek V4 Pro 0813's tool calls fail on Cloudflare.
on Qwen3.8 27B, its best model.
models, where the settings tell OpenRouter to skip Cloudflare.