# tau-bench-airline benchmark

| \# | model | tau-bench-airline | $/task | card | cheapest list | cheapest effective | unit | providers | tokens/week |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | `openai/gpt-5.1` | 80.0 | 0.3931 | 1.25 | 0.625 openai/flex | 0.2461 openai/flex |  | 2 | 1069002297 |
| 2 | `anthropic/claude-fable-5` | 79.4 | 0.8491 | 10.0 | 10.0 azure | 3.0734 anthropic |  | 5 | 1985247563 |
| 3 | `inclusionai/ling-3.1-flash` | 79.3 | 0.0315 |  | 0.045 deepinfra/fp4 | 0.0186 novita |  | 2 | 2619963466 |
| 4 | `anthropic/claude-fable-5.1` | 79.2 | 0.7162 | 10.0 | 10.0 amazon-bedrock | 2.1238 anthropic |  | 4 | 7992736422 |
| 5 | `anthropic/claude-sonnet-5.5` | 78.8 | 0.1593 | 2.0 | 2.0 amazon-bedrock | 0.4121 google-vertex/us |  | 5 | 98657295780 |
| 6 | `google/gemini-4-argon` | 78.7 | 0.4983 |  | 1.0 google-ai-studio/flex | 0.4915 google-ai-studio/flex |  | 2 | 36155717606 |
| 7 | `anthropic/claude-opus-5` | 78.7 | 0.473 | 5.0 | 5.0 amazon-bedrock | 1.1422 anthropic |  | 5 | 10866516566 |
| 8 | `qwen/qwen3.5-397b-a17b` | 78.5 | 0.201 |  | 0.39 alibaba | 0.3211 deepinfra/fp8 |  | 11 | 523261160 |
| 9 | `google/gemini-3.5-flash-lite` | 78.3 | 0.0744 |  | 0.15 google-vertex/global/flex | 0.0898 google-vertex/global/flex |  | 2 | 9561684016 |
| 10 | `google/gemini-3.7-flash` | 78.3 | 0.1499 |  | 0.375 google-vertex/global/flex | 0.1311 google-ai-studio/flex |  | 2 | 17644269641 |
| 11 | `xiaomi/mimo-v2.6-flash` | 77.9 | 0.0148 | 0.14 | 0.1 io-net/fp8 | 0.0109 gmicloud/bf16 |  | 9 | 203188495731 |
| 12 | `qwen/qwen3.5-122b-a10b` | 77.7 | 0.17 |  | 0.26 alibaba | 0.2597 siliconflow/fp8 |  | 5 | 466370471 |
| 13 | `qwen/qwen3.8-27b` | 77.5 | 0.0659 |  | 0.035 darkbloom/fp4 | 0.0104 chutes/fp8 |  | 26 | 40365538593 |
| 14 | `deepseek/deepseek-v4-pro-0813` | 77.5 | 0.101 | 1.32 | 0.0999 relace/fp4 | 0.0998 relace/fp4 |  | 24 | 40426961697 |
| 15 | `stepfun/step-3.7-flash` | 77.3 | 0.0201 | 0.2 | 0.16 deepinfra | 0.0456 deepinfra |  | 3 | 781961941 |
| 16 | `z-ai/glm-5.3` | 77.3 | 0.057 | 1.4 | 0.0699 wafer/us | 0.069 wafer/us |  | 39 | 274701189780 |
| 17 | `qwen/qwen3.6-27b` | 77.2 | 0.1446 |  | 0.25 chutes/fp8 | 0.0977 chutes/fp8 |  | 10 | 1073842171 |
| 18 | `deepseek/deepseek-v4-pro` | 77.2 | 0.0585 | 0.66 | 0.66 deepseek | 0.1878 streamlake/fp8 |  | 21 | 60197337029 |
| 19 | `google/gemini-3.1-pro-preview` | 77.0 | 0.3513 |  | 1.0 google-ai-studio/flex | 0.6695 google-ai-studio/flex |  | 2 | 4767179642 |
| 20 | `nvidia/nemotron-3-ultra-550b-a55b` | 76.9 | 0.1003 |  | 0.4 deepinfra/fp4/flex | 0.1239 deepinfra/fp4/flex |  | 5 | 3953055525 |
| 21 | `anthropic/claude-opus-4.8` | 76.8 | 0.4929 | 5.0 | 5.0 azure/global | 1.1838 amazon-bedrock |  | 5 | 8174729253 |
| 22 | `xiaomi/mimo-v2.6-pro` | 76.8 | 0.0684 | 0.435 | 0.3262 gmicloud/bf16 | 0.0282 gmicloud/bf16 |  | 5 | 35587797273 |
| 23 | `amazon/nova-micro-v1` | 76.7 | 1.275 |  | 0.035 amazon-bedrock | 0.0347 amazon-bedrock/eu-west-1 |  | 1 | 879158491 |
| 24 | `anthropic/claude-opus-4.7` | 76.4 | 0.4243 | 5.0 | 5.0 google-vertex/global | 1.4435 anthropic |  | 5 | 952286246 |
| 25 | `anthropic/claude-opus-4.5` | 76.3 | 0.5366 | 5.0 | 5.0 anthropic/2 | 3.6331 anthropic |  | 5 | 235725489 |
| 26 | `tencent/hy4-preview` | 76.0 | 0.1144 | 0.834 | 0.834 atlas-cloud/fp8 | 0.0647 tencent/fp8 |  | 6 | 7766597674 |
| 27 | `moonshotai/kimi-k3.1-pro` | 75.7 | 0.178 | 2.0 | 0.303 wafer/us | 0.2079 relace/fp4 |  | 17 | 133701237867 |
| 28 | `meta/muse-spark-open` | 75.7 | 0.0884 |  | 1.25 baseten/fp4 | 0.2765 makora/fp4 |  | 5 | 3524458656 |
| 29 | `qwen/qwen3.5-35b-a3b` | 75.6 | 0.0796 |  | 0.065 darkbloom/fp4 | 0.065 darkbloom/fp4 |  | 9 | 1741143898 |
| 30 | `z-ai/glm-5.3-flash` | 75.6 | 0.0087 | 0.15 | 0.0399 relace/fp4 | 0.0202 primeintellect |  | 40 | 873359587942 |
| 31 | `x-ai/grok-4.6` | 75.3 | 0.3309 | 2.0 | 2.0 xai/zdr | 0.7726 amazon-bedrock/us-west-2 |  | 2 | 2933970983 |
| 32 | `google/gemini-3.6-flash` | 75.3 | 0.1697 |  | 0.375 google-ai-studio/flex | 0.3228 google-vertex/global/flex |  | 2 | 3921969355 |
| 33 | `anthropic/claude-opus-5.5` | 75.3 | 0.3395 | 4.0 | 4.0 google-vertex/global | 0.3928 google-vertex/europe |  | 5 | 285560996859 |
| 34 | `google/gemma-4-31b-it` | 75.3 | 0.0298 |  | 0.08 open-inference/bf16 | 0.0798 open-inference/bf16 |  | 22 | 25864564273 |
| 35 | `x-ai/grok-4.7` | 75.3 | 0.2932 | 2.0 | 2.0 amazon-bedrock/global | 0.6806 xai/zdr |  | 2 | 22745463202 |
| 36 | `openai/gpt-5.3-codex` | 75.3 | 0.2997 | 1.75 | 1.75 azure | 0.3125 azure |  | 2 | 467889257 |
| 37 | `deepseek/deepseek-v4.1-flash` | 75.1 | 0.033 | 0.15 | 0.006 relace/fp4 | 0.0048 primeintellect |  | 32 | 876785419680 |
| 38 | `anthropic/claude-sonnet-5` | 75.1 | 0.2006 | 2.0 | 2.0 azure/global | 0.3083 google-vertex/us |  | 5 | 21124505126 |
| 39 | `openai/gpt-5.4` | 75.0 | 0.2913 | 2.5 | 1.25 openai/flex | 0.9128 openai |  | 3 | 1828271888 |
| 40 | `qwen/qwen3.8-2.4t-a95b` | 74.8 | 0.1909 |  | 2.0 alibaba | 0.3546 together |  | 9 | 3434917488 |
| 41 | `deepseek/deepseek-v4-flash-vision-exp` | 74.8 | 0.0302 | 0.44 | 0.2156 deepinfra/fp8 | 0.026 gmicloud/fp8 |  | 7 | 19334675894 |
| 42 | `meta/muse-glimmer-30b` | 74.7 | 0.0374 |  | 0.3 deepinfra/bf16 | 0.0604 phala |  | 5 | 1054845788 |
| 43 | `minimax/minimax-m3` | 74.5 | 0.026 | 0.3 | 0.224 deepinfra/fp8/flex | 0.0617 gmicloud/fp8 |  | 14 | 44263895441 |
| 44 | `anthropic/claude-opus-4.6` | 74.5 | 0.5068 | 5.0 | 5.0 google-vertex/global | 1.5031 anthropic |  | 5 | 4894139786 |
| 45 | `z-ai/glm-5` | 74.4 | 0.0447 | 1.0 | 0.6 streamlake/fp8 | 0.2835 z-ai/fp8 |  | 11 | 1729783371 |
| 46 | `deepseek/deepseek-v3.2` | 74.3 | 0.0416 |  | 0.2088 gmicloud/fp8 | 0.0921 gmicloud/fp8 |  | 15 | 30590709860 |
| 47 | `anthropic/claude-sonnet-4.6` | 74.1 | 0.3298 | 3.0 | 3.0 claude-on-aws | 1.103 amazon-bedrock/global |  | 5 | 9899031571 |
| 48 | `xiaomi/mimo-v2.5-pro` | 74.0 | 0.0293 | 0.435 | 0.3045 gmicloud/bf16 | 0.0612 xiaomi/fp8 |  | 7 | 17780584423 |
| 49 | `deepseek/deepseek-v4-flash-0731` | 73.9 | 0.0091 | 0.44 | 0.03 open-inference/fp4 | 0.0143 streamlake/fp8 |  | 37 | 328583524783 |
| 50 | `moonshotai/kimi-k2.7-code` | 73.8 | 0.0789 | 0.95 | 0.6 coreweave/int4 | 0.2417 coreweave/int4 |  | 18 | 1660619526 |
| 51 | `openai/gpt-5.5` | 73.7 | 0.477 | 5.0 | 2.5 openai/flex | 0.9646 openai/flex |  | 3 | 2597779081 |
| 52 | `moonshotai/kimi-k2.6` | 73.7 | 0.0638 | 0.95 | 0.39 chutes/int4 | 0.2278 chutes/int4 |  | 22 | 4493003118 |
| 53 | `moonshotai/kimi-k3` | 73.6 | 0.2603 | 3.0 | 0.153 wafer/fast | 0.1517 wafer/us |  | 22 | 64194553722 |
| 54 | `deepseek/deepseek-v4-flash` | 73.5 | 0.0114 | 0.22 | 0.05 relace/fp4 | 0.0203 open-inference/fp8 |  | 24 | 270400974317 |
| 55 | `openai/gpt-5.6-sol` | 73.3 | 0.1269 | 4.0 | 2.0 openai/flex | 1.2191 amazon-bedrock/global |  | 3 | 11355341561 |
| 56 | `google/gemini-3-flash-preview` | 73.3 | 0.1237 |  | 0.25 google-ai-studio/flex | 0.0933 google-ai-studio/flex |  | 2 | 24395165818 |
| 57 | `openai/gpt-5.2` | 73.3 | 0.2413 | 1.75 | 0.875 openai/flex | 0.6736 openai/flex |  | 2 | 1096529720 |
| 58 | `deepseek/deepseek-v3.1-terminus` | 73.0 | 0.0629 |  | 0.27 deepinfra/fp4 | 0.2037 atlas-cloud/fp8 |  | 5 | 856280682 |
| 59 | `xiaomi/mimo-v2.5` | 72.9 | 0.01 | 0.14 | 0.119 gmicloud/fp8 | 0.0126 xiaomi/fp8 |  | 7 | 490262194184 |
| 60 | `nvidia/nemotron-3.5-super-vl` | 72.9 | 0.0331 |  | 0.06 darkbloom/nvfp4 | 0.0342 primeintellect/nvfp4 |  | 10 | 20357642819 |
| 61 | `qwen/qwen3.5-9b` | 72.9 | 0.0333 |  | 0.071 primeintellect/bf16 | 0.0788 darkbloom/fp4 |  | 7 | 3885066827 |
| 62 | `anthropic/claude-haiku-5.5` | 72.8 | 0.0116 | 0.1 | 0.1 amazon-bedrock | 0.0426 azure/global |  | 5 | 153020340408 |
| 63 | `openai/gpt-6-astra-pro` | 72.7 | 2.9136 | 10.0 | 5.0 openai/flex | 1.5738 openai/flex |  | 2 | 1308944955 |
| 64 | `google/gemini-3.5-flash` | 72.7 | 0.4317 |  | 0.75 google-vertex/global/flex | 0.2535 google-ai-studio/flex |  | 2 | 1886001122 |
| 65 | `anthropic/claude-sonnet-4.5` | 72.5 | 0.3287 | 3.0 | 3.0 google-vertex/global | 0.6023 google-vertex/us-east5 |  | 5 | 2575991988 |
| 66 | `openai/gpt-5.6-terra` | 72.3 | 0.1113 | 2.0 | 1.0 openai/flex | 0.3776 azure/eu |  | 3 | 5010008874 |
| 67 | `deepseek/deepseek-v4.1-flash-1017` | 72.3 | 0.0292 | 0.3 | 0.006 relace/fp4 | 0.0044 deepinfra/fp8/flex |  | 41 | 2872627738444 |
| 68 | `qwen/qwen3.6-35b-a3b` | 72.3 | 0.0415 |  | 0.012 primeintellect/fp8 | 0.0129 primeintellect/fp8 |  | 12 | 9648264246 |
| 69 | `z-ai/glm-4.6` | 72.1 | 0.0527 | 0.6 | 0.4 deepinfra/fp4/flex | 0.1626 venice/fp4 |  | 5 | 917276179 |
| 70 | `qwen/qwen3.7-max` | 72.0 | 0.4029 |  | 1.475 alibaba | 0.6275 alibaba |  | 1 | 251246175 |
| 71 | `z-ai/glm-5.1` | 71.9 | 0.0973 | 1.4 | 0.9 chutes/fp8 | 0.3486 chutes/fp8 |  | 18 | 1735166411 |
| 72 | `z-ai/glm-4.7` | 71.8 | 0.0597 | 0.6 | 0.32 deepinfra/fp4/flex | 0.2182 deepinfra/fp4/flex |  | 9 | 1848884318 |
| 73 | `openai/gpt-5-mini` | 71.7 | 0.128 | 0.25 | 0.125 openai/flex | 0.0401 openai/flex |  | 2 | 3107895431 |
| 74 | `z-ai/glm-5.2` | 71.5 | 0.0469 | 1.4 | 0.0066 relace/fp4 | 0.0062 wafer/us |  | 34 | 69415166061 |
| 75 | `qwen/qwen3.8-flash` | 71.3 | 0.0167 |  | 0.15 alibaba | 0.0322 alibaba |  | 2 | 47280601403 |
| 76 | `google/gemini-3.1-flash-lite` | 71.3 | 0.0801 |  | 0.125 google-ai-studio/flex | 0.0684 google-vertex/eu |  | 2 | 18647237733 |
| 77 | `google/gemini-3.8-flash` | 71.3 | 0.2102 |  | 0.375 google-ai-studio/flex | 0.1774 google-ai-studio/flex |  | 2 | 72268436836 |
| 78 | `minimax/minimax-m2.7` | 70.9 | 0.027 | 0.3 | 0.21 gmicloud/fp8 | 0.0903 deepinfra/fp8 |  | 9 | 4085828990 |
| 79 | `z-ai/glm-4.5-air` | 70.9 | 0.0138 | 0.2 | 0.13 novita/bf16 | 0.0762 novita/bf16 |  | 3 | 110402353 |
| 80 | `inclusionai/ling-3.0-flash-fin` | 70.7 | 0.0048 |  | 0.06 deepinfra/fp4 | 0.0169 deepinfra/fp4 |  | 1 | 264897851 |
| 81 | `openai/gpt-5.6-sol-pro` | 70.7 | 0.7118 | 4.0 | 2.0 openai/flex | 1.3581 openai |  | 2 | 825297519 |
| 82 | `openai/gpt-5.6-luna-pro` | 70.3 | 0.0853 | 0.2 | 0.1 openai/flex | 0.0439 openai/flex |  | 2 | 3288205178 |
| 83 | `qwen/qwen3.7-plus` | 70.3 | 0.0543 |  | 0.32 alibaba | 0.1746 alibaba |  | 1 | 2661688770 |
| 84 | `anthropic/claude-sonnet-4` | 70.0 | 0.2977 |  | 3.0 amazon-bedrock/eu-west-1 | 1.4411 google-vertex/global |  | 2 | 1266922610 |
| 85 | `openai/gpt-6.1-sol` | 70.0 | 0.1013 | 2.0 | 1.0 openai/flex | 0.114 openai/flex |  | 3 | 130198477602 |
| 86 | `inclusionai/ling-3.0-flash-vl` | 70.0 | 0.003 |  | 0.06 deepinfra/fp16 | 0.0283 deepinfra/fp16 |  | 1 | 153265571 |
| 87 | `moonshotai/kimi-k2.5` | 69.8 | 0.0536 | 0.6 | 0.45 deepinfra/fp4 | 0.1505 moonshotai/int4 |  | 10 | 1568094766 |
| 88 | `openai/gpt-5.6-luna` | 69.7 | 0.0132 | 0.2 | 0.1 openai/flex | 0.0479 openai/flex |  | 3 | 70996018994 |
| 89 | `reflection/beam-1.0-501b-a23b` | 69.3 | 0.0275 |  | 0.25 nebius/fp4 | 0.0612 together |  | 5 | 2133248564 |
| 90 | `openai/gpt-6-sol` | 69.3 | 0.13 | 2.0 | 1.0 openai/flex | 0.4636 openai/flex |  | 3 | 9288116893 |
| 91 | `moonshotai/kimi-k2-thinking` | 68.7 | 0.0446 |  | 0.6 google-vertex | 0.3601 novita/bf16 |  | 2 | 102842060 |
| 92 | `inclusionai/ling-3.0-flash` | 68.7 | 0.0022 |  | 0.021 novita | 0.0123 novita |  | 2 | 5208174048 |
| 93 | `google/gemma-4-26b-a4b-it` | 68.7 | 0.015 |  | 0.011 primeintellect/bf16 | 0.0103 primeintellect/bf16 |  | 15 | 18851505875 |
| 94 | `openai/gpt-6.1-terra` | 68.4 | 0.0636 | 1.0 | 0.5 openai/flex | 0.0586 openai/flex |  | 3 | 49710781370 |
| 95 | `openai/gpt-6-astra` | 68.0 | 0.5802 | 10.0 | 5.0 openai/flex | 1.0297 openai/flex |  | 3 | 14992636976 |
| 96 | `deepseek/deepseek-v3.2-exp` | 67.8 | 0.0563 |  | 0.27 atlas-cloud/fp8 | 0.2699 atlas-cloud/fp8 |  | 3 | 1084828346 |
| 97 | `openai/gpt-5` | 67.3 | 0.6292 | 1.25 | 1.25 azure | 0.7405 openai/default |  | 2 | 334709076 |
| 98 | `z-ai/glm-4.7-flash` | 67.3 | 0.008 |  | 0.06 deepinfra/bf16 | 0.0279 deepinfra/bf16 |  | 4 | 517828300 |
| 99 | `openai/gpt-5.2-chat` | 67.3 | 0.1116 |  | 1.75 azure |  |  | 1 |  |
| 100 | `openai/gpt-6-luna` | 67.3 | 0.0093 | 0.1 | 0.05 openai/flex | 0.0304 azure |  | 3 | 332026376323 |
| 101 | `thinkingmachines/inkling` | 67.2 | 0.0796 |  | 0.95 deepinfra/fp8 | 0.6664 together |  | 3 | 4113949057 |
| 102 | `openai/gpt-6-luna-pro` | 66.7 | 0.0388 | 0.1 | 0.05 openai/flex | 0.0199 openai/flex |  | 2 | 22312743125 |
| 103 | `minimax/minimax-m3.1-flash` | 66.7 | 0.0132 | 0.15 | 0.1125 gmicloud/fp8 | 0.0188 gmicloud/fp8 |  | 12 | 167627073380 |
| 104 | `openai/gpt-5.4-mini` | 66.7 | 0.0889 | 0.75 | 0.375 openai/flex | 0.0616 openai/flex |  | 2 | 3872674407 |
| 105 | `minimax/minimax-m2.1` | 66.6 | 0.0147 | 0.3 | 0.3 minimax/highspeed | 0.0952 minimax/fp8 |  | 2 | 300923844 |
| 106 | `minimax/minimax-m2.5` | 66.4 | 0.0221 | 0.3 | 0.22 inceptron/fp8 | 0.0452 siliconflow/fp8 |  | 11 | 2036295785 |
| 107 | `anthropic/claude-haiku-4.5` | 66.2 | 0.116 | 1.0 | 1.0 azure/global | 0.2343 amazon-bedrock/eu-west-1 |  | 4 | 5892262965 |
| 108 | `nvidia/nemotron-3.5-lightning` | 65.6 | 0.0169 |  | 0.025 darkbloom/int4 | 0.0176 darkbloom/int4 |  | 8 | 980694613 |
| 109 | `openai/gpt-oss-120b` | 65.4 | 0.011 |  | 0.03 akashml/bf16 | 0.0204 near-ai/fp4 |  | 24 | 17933485366 |
| 110 | `openai/gpt-5.4-nano` | 64.7 | 0.0296 | 0.2 | 0.1 openai/flex | 0.0492 openai/flex |  | 2 | 2557538989 |
| 111 | `qwen/qwen3-235b-a22b-thinking-2507` | 61.3 | 0.1227 |  | 0.23 alibaba | 0.2299 alibaba |  | 4 | 251642422 |
| 112 | `z-ai/glm-4.6v` | 60.7 | 0.0321 | 0.3 | 0.3 novita/bf16 | 0.227 z-ai/fp8 |  | 2 | 89823542 |
| 113 | `thinkingmachines/inkling-small` | 60.7 | 0.0465 |  | 0.45 deepinfra/fp8 | 0.1244 baseten/fp8 |  | 3 | 678682468 |
| 114 | `qwen/qwen3-coder-next` | 60.5 | 0.047 |  | 0.12 parasail/bf16 | 0.0733 parasail/bf16 |  | 4 | 1333865408 |
| 115 | `ibm-granite/granite-4.2-8b` | 58.3 | 0.0153 |  | 0.06 coreweave/bf16 | 0.0212 coreweave/bf16 |  | 2 | 97973447 |
| 116 | `google/gemini-2.5-pro` | 58.0 | 0.2064 |  | 0.625 google-ai-studio/flex | 0.2856 google-ai-studio/flex |  | 2 | 4433828948 |
| 117 | `google/gemini-2.5-flash` | 56.7 | 0.0289 |  | 0.15 google-ai-studio/flex | 0.0888 google-ai-studio/flex |  | 2 | 40023796099 |
| 118 | `moonshotai/kimi-k2-0905` | 55.3 | 0.113 |  | 0.6 novita/fp8 | 0.5999 novita/fp8 |  | 1 | 230610689 |
| 119 | `openai/gpt-oss-20b` | 53.5 | 0.0164 |  | 0.018 darkbloom/fp8 | 0.0151 darkbloom/fp8 |  | 15 | 6275183458 |
| 120 | `google/gemini-2.5-flash-lite` | 53.4 | 0.0116 |  | 0.05 google-ai-studio/flex | 0.0371 google-ai-studio/flex |  | 2 | 56073810687 |
| 121 | `nvidia/nemotron-3-nano-30b-a3b` | 52.0 | 0.0284 |  | 0.05 crusoe/fp8 | 0.0298 nebius/fp8 |  | 4 | 804580247 |
| 122 | `deepseek/deepseek-r1-0528` | 50.2 | 0.1647 |  | 0.5 deepinfra/fp4 | 0.4378 deepinfra/fp4 |  | 4 | 453545994 |
| 123 | `openai/gpt-5-nano` | 48.3 | 0.0406 | 0.05 | 0.025 openai/flex | 0.0169 openai/flex |  | 2 | 2308456671 |
| 124 | `qwen/qwen3-coder` | 48.0 | 0.0524 |  | 0.22 google-vertex/us-south1 | 0.0788 venice/fp8 |  | 5 | 615757514 |
| 125 | `google/gemma-3-12b-it` | 48.0 | 0.011 |  | 0.04 deepinfra/bf16/flex | 0.0394 deepinfra/bf16/flex |  | 2 | 368254548 |
| 126 | `openai/gpt-4.1` | 47.7 | 0.1256 | 2.0 | 2.0 azure | 1.3113 azure/swedencentral |  | 2 | 1834859500 |
| 127 | `qwen/qwen3-32b` | 47.1 | 0.0212 |  | 0.08 deepinfra/fp8 | 0.0795 deepinfra/fp8 |  | 5 | 1205817583 |
| 128 | `qwen/qwen3-30b-a3b` | 47.0 | 0.0355 |  | 0.12 deepinfra/fp8 | 0.1198 deepinfra/fp8 |  | 2 | 238703579 |
| 129 | `qwen/qwen3-next-80b-a3b-instruct` | 46.7 | 0.0238 |  | 0.072 deepinfra/fp8/flex | 0.0719 deepinfra/fp8/flex |  | 5 | 198523593 |
| 130 | `mistralai/mistral-small-2603` | 46.0 | 0.0112 | 0.15 | 0.15 mistral | 0.0682 mistral/zdr |  | 2 | 1178140212 |
| 131 | `deepseek/deepseek-chat-v3.1` | 46.0 | 0.0724 |  | 0.25 deepinfra/fp4 | 0.1969 deepinfra/fp4 |  | 8 | 3585371637 |
| 132 | `openai/gpt-4.1-mini` | 44.3 | 0.0232 | 0.4 | 0.4 azure | 0.2392 azure |  | 2 | 4674097697 |
| 133 | `qwen/qwen3-14b` | 44.0 | 0.0313 |  | 0.1 nextbit/int4 | 0.0994 nextbit/int4 |  | 3 | 103920281 |
| 134 | `deepseek/deepseek-chat-v3-0324` | 43.3 | 0.0776 |  | 0.24 deepinfra/fp4 | 0.2182 deepinfra/fp4 |  | 5 | 1615201051 |
| 135 | `meta-llama/llama-4-maverick` | 42.9 | 0.0572 |  | 0.1875 digitalocean | 0.1872 digitalocean |  | 5 | 1191050987 |
| 136 | `qwen/qwen3-coder-30b-a3b-instruct` | 42.7 | 0.0211 |  | 0.07 novita/fp8 | 0.0699 siliconflow/fp8 |  | 5 | 288296977 |
| 137 | `openai/gpt-4o-2024-08-06` | 42.7 | 0.2122 | 2.5 | 2.5 azure | 2.2628 azure |  | 2 | 55146056 |
| 138 | `openai/gpt-4o` | 41.7 | 0.1965 | 2.5 | 2.5 azure | 2.2489 openai |  | 2 | 583706314 |
| 139 | `qwen/qwen3-vl-235b-a22b-instruct` | 40.8 | 0.0751 |  | 0.2 deepinfra/fp8 | 0.1444 parasail/fp8 |  | 5 | 1751130168 |
| 140 | `openai/gpt-4o-2024-05-13` | 40.0 | 1.1316 | 5.0 | 5.0 azure | 5.0 azure |  | 2 | 4562084 |
| 141 | `deepseek/deepseek-chat` | 39.8 | 0.069 |  | 0.256 deepinfra/fp4/flex | 0.2537 deepinfra/fp4/flex |  | 3 | 845190064 |
| 142 | `qwen/qwen3-235b-a22b-2507` | 39.2 | 0.0206 |  | 0.0875 gmicloud/fp8 | 0.0897 deepinfra/fp8 |  | 11 | 3172603246 |
| 143 | `qwen/qwen3-30b-a3b-instruct-2507` | 38.7 | 0.0252 |  | 0.0481 streamlake | 0.0479 streamlake |  | 6 | 2489641192 |
| 144 | `qwen/qwen3-vl-30b-a3b-instruct` | 35.3 | 0.0774 |  | 0.13 alibaba | 0.1291 alibaba |  | 4 | 476073088 |
| 145 | `meta-llama/llama-3.3-70b-instruct` | 33.0 | 0.0516 |  | 0.1 deepinfra/turbo | 0.0997 deepinfra/turbo |  | 12 | 2006140733 |
| 146 | `qwen/qwen3-vl-8b-instruct` | 32.7 | 0.0287 |  | 0.117 alibaba | 0.1167 alibaba |  | 2 | 534511939 |
| 147 | `openai/gpt-4o-mini` | 30.7 | 0.0178 | 0.15 | 0.15 azure | 0.1105 azure |  | 2 | 7914881368 |
| 148 | `qwen/qwen-2.5-72b-instruct` | 24.0 | 0.0733 |  | 0.36 deepinfra/fp8 | 0.3595 deepinfra/fp8 |  | 2 | 46692691 |
| 149 | `meta-llama/llama-3.1-8b-instruct` | 23.5 | 0.0046 |  | 0.02 deepinfra/fp8 | 0.0194 deepinfra/fp8 |  | 5 | 1963022426 |
| 150 | `mistralai/mistral-nemo` | 18.7 | 0.0197 | 0.15 | 0.0166 io-net/fp16 | 0.0122 io-net/fp16 |  | 6 | 16221100342 |
| 151 | `qwen/qwen-2.5-7b-instruct` | 16.7 | 0.017 |  | 0.1 phala | 0.0996 phala |  | 2 | 343255240 |
| 152 | `openai/gpt-4.1-nano` | 11.0 | 0.0068 | 0.1 | 0.1 azure | 0.0627 azure/swedencentral |  | 2 | 5787217212 |