of gpt-oss-120b's structured outputs fail on Google Vertex.
The same model breaks your pipeline's structured outputs 15× more often on some inference providers than on others. Find the best one for your pipelines.
| # | Provider | Structured outputs a day | $ in / out per M | Tokens/s | Uptime | |
|---|---|---|---|---|---|---|
| 1 | MARA# | 0.76% | 12k | $0.15 / $0.75 | 203 | 97.3% |
| 2 | AkashMLbf16# | 0.90% | 293k | $0.03 / $0.19 | 123 | 100.0% |
| 3 | Nebius Token Factoryfp4# | 1.05% | 57k | $0.15 / $0.60 | 303 | 99.7% |
| 4 | DeepInfrabf16# | 1.08% | 473k | $0.04 / $0.17 | 47 | 98.2% |
| 5 | Crusoebf16# | 1.13% | 377k | $0.05 / $0.25 | 332 | 99.6% |
| 6 | DekaLLMbf16# | 1.17% | 245k | $0.03 / $0.18 | 59 | 99.9% |
| 7 | Mancerfp8# | 1.23% | 78k | $0.05 / $0.25 | 64 | 99.6% |
| 8 | Basetenfp4# | 1.25% | 92k | $0.10 / $0.50 | 184 | 99.5% |
| 9 | Parasailfp4# | 1.41% | 23k | $0.10 / $0.75 | 127 | 100.0% |
| 10 | Cerebrasfp16# | 1.75% | 863k | $0.35 / $0.75 | 573 | 100.0% |
| 11 | Together# | 2.02% | 17k | $0.15 / $0.60 | 98 | 98.4% |
| 12 | Groq# | 2.12% | 831k | $0.15 / $0.60 | 355 | 100.0% |
| 13 | NEAR AIfp4# | 2.12% | 358k | $0.03 / $0.15 | 50 | 99.9% |
| 14 | Phala# | 2.47% | 8.7k | $0.15 / $0.60 | 60 | 98.8% |
| 15 | SiliconFlowfp8# | 5.81% | 6.7k | $0.15 / $0.60 | 42 | 92.4% |
| 16 | CoreWeavefp4# | 6.53% | 145k | $0.03 / $0.17 | 104 | 99.9% |
| 17 | Sail Researchfp4# | 6.95% | 41k | $0.06 / $0.40 | 153 | 100.0% |
| 18 | Google Vertex# | 10.21% | 6.9k | $0.09 / $0.36 | 34 | 2.9% |
{
"provider": {
"order": [
"mara",
"akashml/bf16",
"nebius/fp4"
],
"ignore": [
"siliconflow/fp8",
"coreweave/fp4",
"sail-research/fp4",
"google-vertex/global"
]
}
}Give llms.txt to your agent
And which provider to use.
Your users don't see the provider. They see your model failing.
of gpt-oss-120b's structured outputs fail on Google Vertex.
as often on Google Vertex as on MARA, its best provider.
broken structured outputs a day across its 18 providers.
Releasing a model? Make your own API the one every provider is measured against.
Set the bar for your model↵