of MiMo-V2.6-Flash's structured outputs fail on io.net (fp8).
The same model breaks your pipeline's structured outputs 15× more often on some inference providers than on others. Find the best one for your pipelines.
| # | Provider | Structured outputs a day | $ in / out per M | Tokens/s | Uptime | |
|---|---|---|---|---|---|---|
| 1 | GMICloudbf16# | 0.21% | 177k | $0.12 / $0.24 | 25 | 96.5% |
| 2 | Makorafp8# | 0.81% | 182k | $0.11 / $0.28 | 163 | 99.7% |
| 3 | DeepInfrafp8# | 1.42% | 62k | $0.14 / $0.28 | 35 | 78.0% |
| 4 | Cohere# | 2.34% | 64k | $0.14 / $0.28 | 127 | 99.8% |
| 5 | Xiaomifp8# | 2.39% | 199k | $0.14 / $0.28 | 32 | 100.0% |
| 6 | Darkbloomfp4# | 3.16% | 2.1k | $0.10 / $0.28 | 10 | 97.7% |
| 7 | Venicefp8# | 3.31% | 1.3k | $0.17 / $0.35 | 26 | 61.4% |
| 8 | io.netfp8# | 10.13% | 28k | $0.10 / $0.28 | 48 | 99.4% |
{
"provider": {
"order": [
"gmicloud/bf16",
"makora/fp8",
"deepinfra/fp8"
],
"ignore": [
"darkbloom/fp4",
"venice/fp8",
"io-net/fp8"
]
}
}Give llms.txt to your agent
And which provider to use.
Your users don't see the provider. They see your model failing.
of MiMo-V2.6-Flash's structured outputs fail on io.net (fp8).
as often on io.net (fp8) as on GMICloud (bf16), its best provider.
broken structured outputs a day across its 8 providers.
Releasing a model? Make your own API the one every provider is measured against.
Set the bar for your model↵