of MiMo-V2.6-Pro's structured outputs fail on Xiaomi (fp8).
The same model breaks your pipeline's structured outputs 15× more often on some inference providers than on others. Find the best one for your pipelines.
| # | Provider | Structured outputs a day | $ in / out per M | Tokens/s | Uptime | |
|---|---|---|---|---|---|---|
| 1 | DeepInfrafp8# | 2.59% | 88k | $0.39 / $0.78 | 28 | 99.8% |
| 2 | GMICloudbf16# | 3.20% | 47k | $0.37 / $0.74 | 26 | 95.3% |
| 3 | Xiaomifp8# | 3.55% | 69k | $0.43 / $0.87 | 27 | 99.9% |
{
"provider": {
"order": [
"deepinfra/fp8"
],
"ignore": [
"gmicloud/bf16",
"xiaomi/fp8"
]
}
}Give llms.txt to your agent
And which provider to use.
Your users don't see the provider. They see your model failing.
of MiMo-V2.6-Pro's structured outputs fail on Xiaomi (fp8).
as often on Xiaomi (fp8) as on DeepInfra (fp8), its best provider.
broken structured outputs a day across its 3 providers.
Releasing a model? Make your own API the one every provider is measured against.
Set the bar for your model↵