of Hy3's structured outputs fail on NovitaAI.
The same model breaks your pipeline's structured outputs 15× more often on some inference providers than on others. Find the best one for your pipelines.
| # | Provider | Structured outputs a day | $ in / out per M | Tokens/s | Uptime | |
|---|---|---|---|---|---|---|
| 1 | AtlasCloudfp8# | 1.18% | 11k | $0.20 / $0.80 | 74 | 99.7% |
| 2 | Tencent Cloudfp8# | 1.73% | 15k | $0.08 / $0.33 | 71 | 100.0% |
| 3 | NovitaAI# | 6.05% | 3.9k | $0.14 / $0.58 | 66 | 100.0% |
Also ignored, under 1,000 structured outputs a day: Phala 9.62%.
{
"provider": {
"order": [
"atlas-cloud/fp8",
"tencent/fp8"
],
"ignore": [
"novita",
"phala"
]
}
}Give llms.txt to your agent
And which provider to use.
Your users don't see the provider. They see your model failing.
of Hy3's structured outputs fail on NovitaAI.
as often on NovitaAI as on AtlasCloud (fp8), its best provider.
broken structured outputs a day across its 3 providers.
Releasing a model? Make your own API the one every provider is measured against.
Set the bar for your model↵