of GLM 5.3's structured outputs fail on DekaLLM.
Updated October 31, 2026 · How we measure
Structured-output index
The same model breaks your pipeline's structured outputs 15× more often on some inference providers than on others. Find the best one for your pipelines.
Give this to your agent ↓
| # | Model | Broken structured outputs | Rank | Best for this model | Structured outputs a day |
|---|---|---|---|---|---|
| 1 | Qwen3.6 35B A3B | 0.81% | 4 of 8 | Parasail (fp8) 0.09% | 51k |
| 2 | Gemma 4 31B | 1.14% | 9 of 13 | ModelRun [by Modular] (fp4) 0.21% | 10k |
| 3 | gpt-oss-120bbf16 | 1.17% | 6 of 18 | MARA 0.76% | 245k |
| 4 | Qwen3 30B A3B Instruct 2507 | 1.23% | 3 of 3 | Nebius Token Factory (fp8) 0.65% | 14k |
| 5 | DeepSeek V4 Pro 0813 | 1.43% | 6 of 13 | Cloudflare 0.39% | 2.1k |
| 6 | Qwen3.8 27B | 1.56% | 8 of 16 | NEAR AI (fp8) 0.25% | 45k |
| 7 | Mistral Nemofp8 | 2.24% | 3 of 3 | Parasail (fp8) 0.15% | 514k |
| 8 | gpt-oss-20bbf16 | 12.29% | 7 of 8 | CoreWeave (fp4) 1.17% | 29k |
| 9 | GLM 5.3 | 24.50% | 28 of 28 | Together 0.25% | 7.5k |
Get updates when a new model drops
And which provider to use.
For inference providers
Structured outputs don't have to break
The same provider can handle structured outputs well on one model and struggle on the next. Implementations diverge on strings, optionals, composition and conditionals (the April announcement): the schema one provider enforces, another ignores.
on Qwen3.6 35B A3B, its best model.
models, where the settings tell OpenRouter to skip DekaLLM.
dotjson plugs into your inference stack, so every model you serve gets perfect structured outputs from day 0.
Fix DekaLLM's structured outputs↵