# design-gamedev benchmark

| \# | model | design-gamedev | $/task | card | cheapest list | cheapest effective | unit | providers | tokens/week |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | `anthropic/claude-opus-5.5` | 1432.0 |  | 4.0 | 4.0 google-vertex/global | 0.3928 google-vertex/europe |  | 5 | 285560996859 |
| 2 | `openai/gpt-6.1-sol` | 1410.0 |  | 2.0 | 1.0 openai/flex | 0.114 openai/flex |  | 3 | 130198477602 |
| 3 | `meta/muse-wonder` | 1409.0 |  | 4.0 | 4.0 google-vertex/global | 0.6402 meta |  | 2 | 3133805225 |
| 4 | `moonshotai/kimi-k3.1-pro` | 1406.0 |  | 2.0 | 0.303 wafer/us | 0.2079 relace/fp4 |  | 17 | 133701237867 |
| 5 | `anthropic/claude-sonnet-5.5` | 1397.0 |  | 2.0 | 2.0 amazon-bedrock | 0.4121 google-vertex/us |  | 5 | 98657295780 |
| 6 | `anthropic/claude-fable-5.1` | 1371.0 |  | 10.0 | 10.0 amazon-bedrock | 2.1238 anthropic |  | 4 | 7992736422 |
| 7 | `google/gemini-4-argon` | 1363.0 |  |  | 1.0 google-ai-studio/flex | 0.4915 google-ai-studio/flex |  | 2 | 36155717606 |
| 8 | `moonshotai/kimi-k3` | 1349.0 |  | 3.0 | 0.153 wafer/fast | 0.1517 wafer/us |  | 22 | 64194553722 |
| 9 | `meta/muse-spark-1.3` | 1340.0 |  | 1.25 | 1.25 google-vertex/global | 0.346 meta |  | 2 | 3405256128 |
| 10 | `anthropic/claude-opus-5` | 1340.0 |  | 5.0 | 5.0 amazon-bedrock | 1.1422 anthropic |  | 5 | 10866516566 |
| 11 | `anthropic/claude-fable-5` | 1332.0 |  | 10.0 | 10.0 azure | 3.0734 anthropic |  | 5 | 1985247563 |
| 12 | `anthropic/claude-haiku-5.5` | 1316.0 |  | 0.1 | 0.1 amazon-bedrock | 0.0426 azure/global |  | 5 | 153020340408 |
| 13 | `google/gemini-3.7-flash` | 1315.0 |  |  | 0.375 google-vertex/global/flex | 0.1311 google-ai-studio/flex |  | 2 | 17644269641 |
| 14 | `x-ai/grok-4.7` | 1312.0 |  | 2.0 | 2.0 amazon-bedrock/global | 0.6806 xai/zdr |  | 2 | 22745463202 |
| 15 | `xiaomi/mimo-v2.6-pro` | 1311.0 |  | 0.435 | 0.3262 gmicloud/bf16 | 0.0282 gmicloud/bf16 |  | 5 | 35587797273 |
| 16 | `qwen/qwen3.8-max` | 1310.0 |  |  | 2.0 alibaba | 0.58 alibaba |  | 1 | 3118556904 |
| 17 | `google/gemini-3.8-flash` | 1.3e3 |  |  | 0.375 google-ai-studio/flex | 0.1774 google-ai-studio/flex |  | 2 | 72268436836 |
| 18 | `meta/muse-spark-1.2` | 1296.0 |  | 1.25 | 1.25 meta | 0.7188 meta |  | 1 | 87653776 |
| 19 | `z-ai/glm-5.3` | 1295.0 |  | 1.4 | 0.0699 wafer/us | 0.069 wafer/us |  | 39 | 274701189780 |
| 20 | `x-ai/grok-4.6` | 1291.0 |  | 2.0 | 2.0 xai/zdr | 0.7726 amazon-bedrock/us-west-2 |  | 2 | 2933970983 |
| 21 | `openai/gpt-5.5` | 1287.0 |  | 5.0 | 2.5 openai/flex | 0.9646 openai/flex |  | 3 | 2597779081 |
| 22 | `anthropic/claude-opus-4.6` | 1274.0 |  | 5.0 | 5.0 google-vertex/global | 1.5031 anthropic |  | 5 | 4894139786 |
| 23 | `anthropic/claude-sonnet-5` | 1273.0 |  | 2.0 | 2.0 azure/global | 0.3083 google-vertex/us |  | 5 | 21124505126 |
| 24 | `z-ai/glm-5.3-flash` | 1272.0 |  | 0.15 | 0.0399 relace/fp4 | 0.0202 primeintellect |  | 40 | 873359587942 |
| 25 | `xiaomi/mimo-v2.5-pro` | 1267.0 |  | 0.435 | 0.3045 gmicloud/bf16 | 0.0612 xiaomi/fp8 |  | 7 | 17780584423 |
| 26 | `meta/muse-spark-1.1` | 1265.0 |  | 1.25 | 1.25 meta | 0.7166 meta |  | 1 | 136778709 |
| 27 | `deepseek/deepseek-v4.1-flash-1017` | 1263.0 |  | 0.3 | 0.006 relace/fp4 | 0.0044 deepinfra/fp8/flex |  | 41 | 2872627738444 |
| 28 | `z-ai/glm-5.2` | 1262.0 |  | 1.4 | 0.0066 relace/fp4 | 0.0062 wafer/us |  | 34 | 69415166061 |
| 29 | `qwen/qwen3.7-max` | 1261.0 |  |  | 1.475 alibaba | 0.6275 alibaba |  | 1 | 251246175 |
| 30 | `z-ai/glm-5.1` | 1261.0 |  | 1.4 | 0.9 chutes/fp8 | 0.3486 chutes/fp8 |  | 18 | 1735166411 |
| 31 | `google/gemini-3.5-flash` | 1260.0 |  |  | 0.75 google-vertex/global/flex | 0.2535 google-ai-studio/flex |  | 2 | 1886001122 |
| 32 | `tencent/hy4` | 1259.0 |  | 0.417 | 0.417 tencent/fp4 | 0.0818 tencent/fp4 |  | 1 | 1310186705857 |
| 33 | `meta/muse-spark-open` | 1259.0 |  |  | 1.25 baseten/fp4 | 0.2765 makora/fp4 |  | 5 | 3524458656 |
| 34 | `google/gemini-3.6-flash` | 1259.0 |  |  | 0.375 google-ai-studio/flex | 0.3228 google-vertex/global/flex |  | 2 | 3921969355 |
| 35 | `anthropic/claude-opus-4.8` | 1259.0 |  | 5.0 | 5.0 azure/global | 1.1838 amazon-bedrock |  | 5 | 8174729253 |
| 36 | `x-ai/grok-4.5` | 1258.0 |  | 2.0 | 2.0 xai | 0.8113 xai/zdr |  | 1 | 2337764706 |
| 37 | `qwen/qwen3.7-plus` | 1257.0 |  |  | 0.32 alibaba | 0.1746 alibaba |  | 1 | 2661688770 |
| 38 | `anthropic/claude-sonnet-4.6` | 1254.0 |  | 3.0 | 3.0 claude-on-aws | 1.103 amazon-bedrock/global |  | 5 | 9899031571 |
| 39 | `xiaomi/mimo-v2.5` | 1249.0 |  | 0.14 | 0.119 gmicloud/fp8 | 0.0126 xiaomi/fp8 |  | 7 | 490262194184 |
| 40 | `moonshotai/kimi-k2.6` | 1247.0 |  | 0.95 | 0.39 chutes/int4 | 0.2278 chutes/int4 |  | 22 | 4493003118 |
| 41 | `z-ai/glm-5-turbo` | 1243.0 |  | 1.2 | 1.2 z-ai | 0.4682 z-ai |  | 1 | 80067387 |
| 42 | `openai/gpt-5.4` | 1235.0 |  | 2.5 | 1.25 openai/flex | 0.9128 openai |  | 3 | 1828271888 |
| 43 | `z-ai/glm-5` | 1231.0 |  | 1.0 | 0.6 streamlake/fp8 | 0.2835 z-ai/fp8 |  | 11 | 1729783371 |
| 44 | `deepseek/deepseek-v4-pro` | 1226.0 |  | 0.66 | 0.66 deepseek | 0.1878 streamlake/fp8 |  | 21 | 60197337029 |
| 45 | `anthropic/claude-opus-4.5` | 1224.0 |  | 5.0 | 5.0 anthropic/2 | 3.6331 anthropic |  | 5 | 235725489 |
| 46 | `nex-agi/nex-n2-pro` | 1222.0 |  | 0.25 | 0.25 nex-agi/fp8 | 0.0398 nex-agi/fp8 |  | 2 | 42940716 |
| 47 | `mistralai/mistral-large-4-0` | 1222.0 |  | 0.77 | 0.7 mistral/zdr | 0.1495 mistral/zdr |  | 1 | 2631206951 |
| 48 | `moonshotai/kimi-k2.7-code` | 1217.0 |  | 0.95 | 0.6 coreweave/int4 | 0.2417 coreweave/int4 |  | 18 | 1660619526 |
| 49 | `z-ai/glm-5v-turbo` | 1211.0 |  | 1.2 | 1.2 z-ai/fp8 | 0.3829 z-ai/fp8 |  | 1 | 71603081 |
| 50 | `qwen/qwen3.6-plus` | 1208.0 |  |  | 0.325 alibaba | 0.3089 alibaba |  | 1 | 238124546 |
| 51 | `minimax/minimax-m3` | 1205.0 |  | 0.3 | 0.224 deepinfra/fp8/flex | 0.0617 gmicloud/fp8 |  | 14 | 44263895441 |
| 52 | `deepseek/deepseek-v4-flash-0731` | 1204.0 |  | 0.44 | 0.03 open-inference/fp4 | 0.0143 streamlake/fp8 |  | 37 | 328583524783 |
| 53 | `minimax/minimax-m2.7` | 1204.0 |  | 0.3 | 0.21 gmicloud/fp8 | 0.0903 deepinfra/fp8 |  | 9 | 4085828990 |
| 54 | `moonshotai/kimi-k2.5` | 1203.0 |  | 0.6 | 0.45 deepinfra/fp4 | 0.1505 moonshotai/int4 |  | 10 | 1568094766 |
| 55 | `reflection/beam-1.0-501b-a23b` | 1.2e3 |  |  | 0.25 nebius/fp4 | 0.0612 together |  | 5 | 2133248564 |
| 56 | `google/gemini-3.1-pro-preview` | 1199.0 |  |  | 1.0 google-ai-studio/flex | 0.6695 google-ai-studio/flex |  | 2 | 4767179642 |
| 57 | `deepseek/deepseek-v4-flash` | 1192.0 |  | 0.22 | 0.05 relace/fp4 | 0.0203 open-inference/fp8 |  | 24 | 270400974317 |
| 58 | `openai/gpt-5.2` | 1191.0 |  | 1.75 | 0.875 openai/flex | 0.6736 openai/flex |  | 2 | 1096529720 |
| 59 | `x-ai/grok-4.20` | 1188.0 |  | 1.25 | 1.25 xai | 0.6023 xai |  | 1 | 1252493891 |
| 60 | `z-ai/glm-4.7` | 1185.0 |  | 0.6 | 0.32 deepinfra/fp4/flex | 0.2182 deepinfra/fp4/flex |  | 9 | 1848884318 |
| 61 | `openai/gpt-5` | 1182.0 |  | 1.25 | 1.25 azure | 0.7405 openai/default |  | 2 | 334709076 |
| 62 | `openai/gpt-5.1` | 1175.0 |  | 1.25 | 0.625 openai/flex | 0.2461 openai/flex |  | 2 | 1069002297 |
| 63 | `minimax/minimax-m2.5` | 1173.0 |  | 0.3 | 0.22 inceptron/fp8 | 0.0452 siliconflow/fp8 |  | 11 | 2036295785 |
| 64 | `anthropic/claude-opus-4.1` | 1168.0 |  |  | 15.0 amazon-bedrock | 8.2155 google-vertex/global |  | 2 | 23764080 |
| 65 | `anthropic/claude-opus-4` | 1167.0 |  |  | 15.0 google-vertex | 10.5411 google-vertex |  | 1 | 151107033 |
| 66 | `x-ai/grok-4.3` | 1167.0 |  | 1.25 | 1.25 xai/zdr | 0.8542 xai |  | 1 | 1834920557 |
| 67 | `upstage/solar-pro4` | 1166.0 |  | 0.15 | 0.15 upstage/zdr | 0.0893 upstage/zdr |  | 2 | 12956099104 |
| 68 | `thinkingmachines/inkling` | 1163.0 |  |  | 0.95 deepinfra/fp8 | 0.6664 together |  | 3 | 4113949057 |
| 69 | `google/gemini-3-flash-preview` | 1163.0 |  |  | 0.25 google-ai-studio/flex | 0.0933 google-ai-studio/flex |  | 2 | 24395165818 |
| 70 | `anthropic/claude-sonnet-4.5` | 1163.0 |  | 3.0 | 3.0 google-vertex/global | 0.6023 google-vertex/us-east5 |  | 5 | 2575991988 |
| 71 | `openai/gpt-5.3-codex` | 1158.0 |  | 1.75 | 1.75 azure | 0.3125 azure |  | 2 | 467889257 |
| 72 | `stepfun/step-3.7-flash` | 1153.0 |  | 0.2 | 0.16 deepinfra | 0.0456 deepinfra |  | 3 | 781961941 |
| 73 | `z-ai/glm-4.6` | 1147.0 |  | 0.6 | 0.4 deepinfra/fp4/flex | 0.1626 venice/fp4 |  | 5 | 917276179 |
| 74 | `deepseek/deepseek-v3.2-exp` | 1141.0 |  |  | 0.27 atlas-cloud/fp8 | 0.2699 atlas-cloud/fp8 |  | 3 | 1084828346 |
| 75 | `z-ai/glm-4.5` | 1140.0 |  | 0.6 | 0.6 z-ai/fp8 | 0.339 z-ai/fp8 |  | 1 | 42403862 |
| 76 | `qwen/qwen3.5-397b-a17b` | 1137.0 |  |  | 0.39 alibaba | 0.3211 deepinfra/fp8 |  | 11 | 523261160 |
| 77 | `nvidia/nemotron-3-ultra-550b-a55b` | 1136.0 |  |  | 0.4 deepinfra/fp4/flex | 0.1239 deepinfra/fp4/flex |  | 5 | 3953055525 |
| 78 | `anthropic/claude-sonnet-4` | 1135.0 |  |  | 3.0 amazon-bedrock/eu-west-1 | 1.4411 google-vertex/global |  | 2 | 1266922610 |
| 79 | `openai/gpt-5.1-codex` | 1133.0 |  |  | 1.25 azure | 0.3079 azure |  | 1 | 6434064 |
| 80 | `tencent/hy3` | 1132.0 |  | 0.132 | 0.105 deepinfra/fp4 | 0.0416 tencent/fp8 |  | 7 | 155752702991 |
| 81 | `minimax/minimax-m2.1` | 1131.0 |  | 0.3 | 0.3 minimax/highspeed | 0.0952 minimax/fp8 |  | 2 | 300923844 |
| 82 | `z-ai/glm-4.7-flash` | 1130.0 |  |  | 0.06 deepinfra/bf16 | 0.0279 deepinfra/bf16 |  | 4 | 517828300 |
| 83 | `deepseek/deepseek-v3.2` | 1128.0 |  |  | 0.2088 gmicloud/fp8 | 0.0921 gmicloud/fp8 |  | 15 | 30590709860 |
| 84 | `deepseek/deepseek-v3.1-terminus` | 1127.0 |  |  | 0.27 deepinfra/fp4 | 0.2037 atlas-cloud/fp8 |  | 5 | 856280682 |
| 85 | `openai/gpt-5-mini` | 1126.0 |  | 0.25 | 0.125 openai/flex | 0.0401 openai/flex |  | 2 | 3107895431 |
| 86 | `minimax/minimax-m2` | 1113.0 |  | 0.255 | 0.255 minimax/fp8 | 0.255 minimax/fp8 |  | 3 | 60934517 |
| 87 | `upstage/solar-mini4` | 1109.0 |  | 0.05 | 0.05 upstage | 0.0294 upstage/zdr |  | 1 | 58350986561 |
| 88 | `google/gemini-2.5-pro` | 1108.0 |  |  | 0.625 google-ai-studio/flex | 0.2856 google-ai-studio/flex |  | 2 | 4433828948 |
| 89 | `nvidia/nemotron-3.5-super-vl` | 1106.0 |  |  | 0.06 darkbloom/nvfp4 | 0.0342 primeintellect/nvfp4 |  | 10 | 20357642819 |
| 90 | `meta/muse-glimmer-30b` | 1106.0 |  |  | 0.3 deepinfra/bf16 | 0.0604 phala |  | 5 | 1054845788 |
| 91 | `qwen/qwen3.5-plus-02-15` | 1102.0 |  |  | 0.26 alibaba | 0.2599 alibaba |  | 1 | 71342505 |
| 92 | `qwen/qwen3-coder` | 1094.0 |  |  | 0.22 google-vertex/us-south1 | 0.0788 venice/fp8 |  | 5 | 615757514 |
| 93 | `deepseek/deepseek-r1-0528` | 1094.0 |  |  | 0.5 deepinfra/fp4 | 0.4378 deepinfra/fp4 |  | 4 | 453545994 |
| 94 | `anthropic/claude-haiku-4.5` | 1092.0 |  | 1.0 | 1.0 azure/global | 0.2343 amazon-bedrock/eu-west-1 |  | 4 | 5892262965 |
| 95 | `qwen/qwen3-max` | 1091.0 |  |  | 0.78 alibaba | 0.6362 alibaba |  | 1 | 45391519 |
| 96 | `z-ai/glm-4.5-air` | 1091.0 |  | 0.2 | 0.13 novita/bf16 | 0.0762 novita/bf16 |  | 3 | 110402353 |
| 97 | `openai/gpt-5.1-codex-mini` | 1089.0 |  |  | 0.25 azure | 0.0638 azure |  | 1 | 26682724 |
| 98 | `deepseek/deepseek-chat-v3.1` | 1079.0 |  |  | 0.25 deepinfra/fp4 | 0.1969 deepinfra/fp4 |  | 8 | 3585371637 |
| 99 | `mistralai/mistral-large-2512` | 1077.0 |  | 0.5 | 0.5 mistral | 0.2957 mistral/eu |  | 1 | 352277520 |
| 100 | `openai/gpt-4.1` | 1076.0 |  | 2.0 | 2.0 azure | 1.3113 azure/swedencentral |  | 2 | 1834859500 |
| 101 | `arcee-ai/trinity-large-thinking` | 1074.0 |  | 0.25 | 0.22 parasail/fp4 | 0.0515 arcee-ai |  | 2 | 121188704 |
| 102 | `mistralai/mistral-medium-3.1` | 1069.0 |  | 0.4 | 0.4 mistral/zdr | 0.1931 mistral/zdr |  | 1 | 252285205 |
| 103 | `openai/gpt-4.1-mini` | 1067.0 |  | 0.4 | 0.4 azure | 0.2392 azure |  | 2 | 4674097697 |
| 104 | `google/gemini-2.5-flash` | 1062.0 |  |  | 0.15 google-ai-studio/flex | 0.0888 google-ai-studio/flex |  | 2 | 40023796099 |
| 105 | `deepseek/deepseek-chat` | 1050.0 |  |  | 0.256 deepinfra/fp4/flex | 0.2537 deepinfra/fp4/flex |  | 3 | 845190064 |
| 106 | `openai/gpt-5-nano` | 1041.0 |  | 0.05 | 0.025 openai/flex | 0.0169 openai/flex |  | 2 | 2308456671 |
| 107 | `mistralai/ministral-14b-2512` | 1033.0 |  | 0.2 | 0.2 mistral/zdr | 0.1479 mistral/zdr |  | 1 | 326998825 |
| 108 | `openai/o3` | 1031.0 |  | 2.0 | 2.0 openai | 1.5478 openai |  | 1 | 24675429 |
| 109 | `google/gemini-3.1-flash-lite-preview` | 1026.0 |  |  | 0.125 google-ai-studio/flex | 0.1204 google-ai-studio/flex |  | 1 | 3284485566 |
| 110 | `mistralai/mistral-medium-3` | 1014.0 |  | 0.4 | 0.4 mistral/zdr | 0.2313 mistral/zdr |  | 1 | 16434365 |
| 111 | `openai/o4-mini` | 998.0 |  | 1.1 | 1.1 openai | 0.8597 openai |  | 1 | 206838992 |
| 112 | `mistralai/ministral-8b-2512` | 987.0 |  | 0.15 | 0.15 mistral | 0.1118 mistral/zdr |  | 1 | 334061910 |
| 113 | `openai/gpt-oss-120b` | 987.0 |  |  | 0.03 akashml/bf16 | 0.0204 near-ai/fp4 |  | 24 | 17933485366 |
| 114 | `inception/mercury-2` | 976.0 |  | 0.25 | 0.25 inception | 0.1713 inception |  | 1 | 146887169 |
| 115 | `moonshotai/kimi-k2` | 969.0 |  |  | 0.57 novita/fp8 | 0.5698 novita/fp8 |  | 1 | 90691275 |
| 116 | `openai/gpt-4.1-nano` | 967.0 |  | 0.1 | 0.1 azure | 0.0627 azure/swedencentral |  | 2 | 5787217212 |
| 117 | `mistralai/codestral-2508` | 964.0 |  | 0.3 | 0.3 mistral | 0.195 mistral |  | 1 | 8976417 |
| 118 | `qwen/qwen3-235b-a22b-thinking-2507` | 952.0 |  |  | 0.23 alibaba | 0.2299 alibaba |  | 4 | 251642422 |
| 119 | `qwen/qwen3-235b-a22b-2507` | 948.0 |  |  | 0.0875 gmicloud/fp8 | 0.0897 deepinfra/fp8 |  | 11 | 3172603246 |
| 120 | `mistralai/ministral-3b-2512` | 945.0 |  | 0.1 | 0.1 mistral | 0.06 mistral/zdr |  | 1 | 330618992 |
| 121 | `qwen/qwen3-235b-a22b` | 924.0 |  |  | 0.455 alibaba | 0.4547 alibaba |  | 1 | 454544037 |
| 122 | `openai/gpt-4o` | 903.0 |  | 2.5 | 2.5 azure | 2.2489 openai |  | 2 | 583706314 |
| 123 | `qwen/qwen3-30b-a3b` | 895.0 |  |  | 0.12 deepinfra/fp8 | 0.1198 deepinfra/fp8 |  | 2 | 238703579 |
| 124 | `mistralai/mistral-small-3.2-24b-instruct` | 885.0 |  | 0.1 | 0.075 deepinfra/fp8 | 0.0705 mistral/eu |  | 4 | 1131107220 |
| 125 | `meta-llama/llama-4-maverick` | 834.0 |  |  | 0.1875 digitalocean | 0.1872 digitalocean |  | 5 | 1191050987 |
| 126 | `meta-llama/llama-4-scout` | 768.0 |  |  | 0.08 deepinfra/fp8/flex | 0.0797 deepinfra/fp8/flex |  | 4 | 574737376 |