.TXT Build pipelines?→Serve models?→Release models?↓
Updated October 31, 2026 · How we measure

Structured-output index

The same model breaks your pipeline's structured outputs 15× more often on some inference providers than on others. Find the best one for your pipelines.

Give this to your agent ↓
← All models
Qwen · 16 providers · 1.3M structured outputs a day
#ProviderStructured outputs
a day
$ in / out
per M
Tokens/sUptime
1NEAR AIfp8#0.25%560k$0.04 / $1.357199.9%
2Chutesfp8#0.57%88k$0.04 / $1.252999.9%
3AkashMLfp8#0.82%72k$0.23 / $1.985298.7%
4Phala#0.86%26k$0.20 / $2.504699.4%
5ModelRun [by Modular]fp4#0.92%139k$0.20 / $2.5017999.9%
6Venicefp8#1.14%5.8k$0.45 / $3.2059100.0%
7DeepInfrabf16#1.41%76k$0.15 / $1.884399.7%
8DekaLLM#1.56%45k$0.04 / $2.5010199.8%
9Parasailfp8#1.77%32k$0.24 / $2.205599.9%
10CoreWeavefp8#2.50%8.5k$0.40 / $3.0010499.7%
11Mancerfp8#2.82%4.7k$0.18 / $2.505094.8%
12Ionstreamfp8#3.19%18k$0.04 / $1.955498.9%
13Waferfp8#3.47%39k$0.06 / $2.309599.9%
15Darkbloomfp4#3.88%23k$0.04 / $1.507098.9%
16Reka AIfp8#5.82%44k$0.04 / $2.204899.8%

Also ignored, under 1,000 structured outputs a day: Cloudflare 9.33%.

Recommended OpenRouter settings for Qwen3.8 27B
{
  "provider": {
    "order": [
      "near-ai/fp8",
      "chutes/fp8",
      "akashml/fp8"
    ],
    "ignore": [
      "ionstream/fp8",
      "wafer/fp8",
      "modal",
      "darkbloom/fp4",
      "reka/fp8",
      "cloudflare"
    ]
  }
}

Give llms.txt to your agent

Using Qwen3.8 27B?

Get updates when its successor drops

And which provider to use.

For model makers

Broken structured outputs carry your model's name

Your users don't see the provider. They see your model failing.

Worst provider5.82%

of Qwen3.8 27B's structured outputs fail on Reka AI (fp8).

Best to worst23×

as often on Reka AI (fp8) as on NEAR AI (fp8), its best provider.

Every day15k

broken structured outputs a day across its 16 providers.

Releasing a model? Make your own API the one every provider is measured against.

Set the bar for your model↵