of Llama 3.1 8B Instruct's tool calls fail on CoreWeave (bf16).
Not all models are served equally by all providers. On a typical model, the worst provider breaks tool calls 19× as often as the best. Find the best one for your agents.
| # | Provider | Broken tool calls | Tool calls a day | $ in / out per M | Tokens/s | Uptime |
|---|---|---|---|---|---|---|
| 1 | Groq# | 1.00% | 15k | $0.05 / $0.08 | 333 | 100.0% |
| 2 | CoreWeavebf16# | 67.14% | 8.6k | $0.22 / $0.22 | 109 | 99.9% |
{
"provider": {
"order": [
"groq"
],
"ignore": [
"coreweave/bf16"
]
}
}Point your agent at llms.txt
And which provider to use.
Releasing a model? Test it before launch.
of Llama 3.1 8B Instruct's tool calls fail on CoreWeave (bf16).
as often on CoreWeave (bf16) as on Groq, its best provider.
broken tool calls a day across its 2 providers.