AA score/cost/time comparison

Snapshot #3460 fetched 2026-11-05 00:00:53 · 1.39 MB raw HTML · 95 models

Snapshot

Pick the stored fetch snapshot to compare.

Run

Scoring

Choose the quality benchmark and final score formula.

Mode Calc

Cost adjustment

Tune formulas that account for Cost per Task.

Cost weight Cost floor Cost power

Result set

Control table filtering, ordering, and row count.

Sort Pareto Pareto axis Limit

Top quality model in this view: Gemini 4 Carbon (High) (60.0 pts, $7.76/task, 30.2m/task) · sorted by score

Cost/task vs quality?

95 models · 17 on the Pareto frontier · intelligence quality vs Cost per Task

Historic #1 winner?

Top row for each successful snapshot using the current mode/calc/cost settings and score sort.

Latest #1 Gemini 4 Carbon (High) 60.0

Recent winner changes

Gemini 4 Carbon (High) 2026-10-28 18:00:53 · 59.4 Claude Opus 5.5 (Max, Default Fallback) 2026-10-13 23:00:28 · 57.6

Run?	Fetched?	Winner?	Score?	Qual?	Cost/task?	Time/task?
#3460	2026-11-05 00:00:53	Gemini 4 Carbon (High)	60.0	60.0	$7.76	30.2m
#3459	2026-11-04 23:00:53	Gemini 4 Carbon (High)	60.0	60.0	$7.76	30.2m
#3458	2026-11-04 22:00:54	Gemini 4 Carbon (High)	60.0	60.0	$7.76	30.2m
#3457	2026-11-04 21:00:54	Gemini 4 Carbon (High)	60.0	60.0	$7.76	30.5m
#3456	2026-11-04 20:00:53	Gemini 4 Carbon (High)	60.0	60.0	$7.76	30.5m
#3455	2026-11-04 19:00:53	Gemini 4 Carbon (High)	60.0	60.0	$7.76	30.5m
#3454	2026-11-04 18:00:58	Gemini 4 Carbon (High)	60.0	60.0	$7.76	30.5m
#3453	2026-11-04 17:00:56	Gemini 4 Carbon (High)	60.0	60.0	$7.76	29.6m

#?	Pareto?	Model?	Released?	Cost/task?	Time/task?	$/Q?	Qual?	ΔTop?	Intel?	Agent?	Pen?	Score?
1	✓	Gemini 4 Carbon (High) Google	2026-10-28	$7.76	30.2m	0.1292	60.0	0.0	60.0	-	28.9	60.0
2		Claude Opus 5.5 (Max, Default Fallback) Anthropic	2026-09-22	$10.0	25.9m	0.1698	59.1	-0.9	59.1	-	30.0	59.1
3	✓	Gemini 4 Carbon (Medium) Google	2026-10-28	$6.59	22.1m	0.1130	58.3	-1.8	58.3	-	28.2	58.3
4	✓	Claude Opus 5.5 (Xhigh, Default Fallback) Anthropic	2026-09-22	$6.05	16.1m	0.1053	57.4	-2.6	57.4	-	27.8	57.4
5		GPT-6 Astra (Max) OpenAI	2026-09-03	$6.24	18.1m	0.1098	56.9	-3.2	56.9	-	28.0	56.9
6	✓	GPT-6 Astra (Xhigh) OpenAI	2026-09-03	$3.66	9.00m	0.0662	55.3	-4.7	55.3	-	25.6	55.3
7	✓	GPT-6 Astra (High) OpenAI	2026-09-03	$3.24	7.78m	0.0590	54.8	-5.2	54.8	-	25.1	54.8
8	✓	GPT-6.1 Sol (Max) OpenAI	2026-09-29	$1.27	20.3m	0.0233	54.6	-5.4	54.6	-	21.0	54.6
9		Claude Sonnet 5.5 (Max, Default Fallback) Anthropic	2026-09-28	$10.0	30.6m	0.1837	54.5	-5.5	54.5	-	30.0	54.5
10		Gemini 4 Carbon (Low) Google	2026-10-28	$7.19	53.7m	0.1325	54.2	-5.8	54.2	-	28.6	54.2
11	✓	GPT-6.1 Sol (Xhigh) OpenAI	2026-09-29	$0.764	8.81m	0.0146	52.5	-7.6	52.5	-	18.8	52.5
12		Claude Opus 5.5 (High, Default Fallback) Anthropic	2026-09-22	$3.46	9.19m	0.0668	51.8	-8.2	51.8	-	25.4	51.8
13		GPT-6 Astra (Medium) OpenAI	2026-09-03	$2.73	5.80m	0.0530	51.6	-8.5	51.6	-	24.4	51.6
14		GPT-6.1 Terra (Max) OpenAI	2026-10-26	$0.961	12.7m	0.0187	51.3	-8.7	51.3	-	19.8	51.3
15		Gemini 4 Argon (High) Google	2026-09-30	$9.95	28.3m	0.1973	50.4	-9.6	50.4	-	30.0	50.4
16	✓	GPT-6.1 Sol (High) OpenAI	2026-09-29	$0.591	6.46m	0.0117	50.3	-9.7	50.3	-	17.7	50.3
17		Claude Fable 5.1 (Xhigh, Default Fallback) Anthropic	2026-09-01	$10.8	19.0m	0.2169	50.0	-10.0	50.0	-	30.4	50.0
18		Claude Sonnet 5.5 (Xhigh, Default Fallback) Anthropic	2026-09-28	$4.09	13.8m	0.0820	49.9	-10.1	49.9	-	26.1	49.9
19		Claude Fable 5.1 (Max, Default Fallback) Anthropic	2026-09-01	$13.0	22.3m	0.2643	49.2	-10.9	49.2	-	31.1	49.2
20		Claude Opus 5.5 (Medium, Default Fallback) Anthropic	2026-09-22	$2.45	6.68m	0.0508	48.2	-11.8	48.2	-	23.9	48.2
21		Claude Fable 5.1 (High, Default Fallback) Anthropic	2026-09-01	$7.54	12.6m	0.1598	47.2	-12.9	47.2	-	28.8	47.2
22		Kimi K3.1 Pro Kimi	2026-10-23	$3.68	36.9m	0.0792	46.5	-13.6	46.5	-	25.7	46.5
23	✓	GPT-6.1 Sol (Medium) OpenAI	2026-09-29	$0.359	3.77m	0.0078	46.3	-13.7	46.3	-	15.6	46.3
24		GPT-6.1 Terra (Xhigh) OpenAI	2026-10-26	$0.401	5.82m	0.0089	45.3	-14.8	45.3	-	16.0	45.3
25		GPT-6 Sol (Max) OpenAI	2026-09-22	$2.47	8.14m	0.0558	44.2	-15.9	44.2	-	23.9	44.2
26		Muse Wonder (Max) Meta	2026-10-12	$6.95	11.7m	0.1595	43.6	-16.5	43.6	-	28.4	43.6
27		GPT-6 Astra (Low) OpenAI	2026-09-03	$1.42	3.06m	0.0329	43.3	-16.7	43.3	-	21.5	43.3
28		Claude Fable 5.1 (Medium, Default Fallback) Anthropic	2026-09-01	$5.56	9.49m	0.1289	43.2	-16.9	43.2	-	27.5	43.2
29	✓	GPT-6.1 Terra (High) OpenAI	2026-10-26	$0.259	3.77m	0.0061	42.4	-17.6	42.4	-	14.1	42.4
30		Claude Sonnet 5.5 (High, Default Fallback) Anthropic	2026-09-28	$1.64	6.93m	0.0394	41.5	-18.5	41.5	-	22.1	41.5
31		Claude Fable 5.1 (Low, Default Fallback) Anthropic	2026-09-01	$4.47	7.42m	0.1156	38.7	-21.3	38.7	-	26.5	38.7
32	✓	GPT-6.1 Terra (Medium) OpenAI	2026-10-26	$0.169	2.55m	0.0044	38.2	-21.9	38.2	-	12.3	38.2
33		Muse Spark 1.3 (Max) Meta	2026-09-02	$2.39	12.0m	0.0652	36.6	-23.4	36.6	-	23.8	36.6
34		Claude Haiku 5.5 (Max) Anthropic	2026-10-07	$0.411	14.7m	0.0113	36.5	-23.5	36.5	-	16.1	36.5
35		Grok 4.7 (Xhigh) SpaceXAI	2026-09-21	$7.77	24.1m	0.2190	35.5	-24.5	35.5	-	28.9	35.5
36		Grok 4.7 (High) SpaceXAI	2026-09-21	$6.18	20.7m	0.1756	35.2	-24.8	35.2	-	27.9	35.2
37	✓	GPT-6.1 Sol (Low) OpenAI	2026-09-29	$0.161	1.64m	0.0046	34.8	-25.2	34.8	-	12.1	34.8
38		Claude Opus 5.5 (Low, Default Fallback) Anthropic	2026-09-22	$0.976	2.95m	0.0281	34.8	-25.3	34.8	-	19.9	34.8
39		Claude Haiku 5.5 (Xhigh) Anthropic	2026-10-07	$0.248	9.53m	0.0072	34.6	-25.4	34.6	-	14.0	34.6
40		Qwen3.8 Max (0902) Alibaba	2026-09-02	$10.0	1.03h	0.2978	33.7	-26.4	33.7	-	30.0	33.7
41		DeepSeek V4.1 Flash 1017 (Max) DeepSeek	2026-10-17	$0.602	13.4m	0.0185	32.6	-27.4	32.6	-	17.8	32.6
42		GPT-5.6 Terra (Max) OpenAI	2026-07-09	$3.73	11.0m	0.1155	32.3	-27.7	32.3	-	25.7	32.3
43		GLM-5.3 (Max) Z AI	2026-08-18	$5.01	28.9m	0.1583	31.7	-28.4	31.7	-	27.0	31.7
44		Grok 4.7 (Low) SpaceXAI	2026-09-21	$2.92	9.74m	0.0939	31.1	-28.9	31.1	-	24.7	31.1
45		Grok 4.6 (Xhigh) SpaceXAI	2026-08-12	$4.68	14.1m	0.1508	31.0	-29.0	31.0	-	26.7	31.0
46		Gemini 3.8 Flash (High) Google	2026-09-02	$7.77	14.6m	0.2518	30.8	-29.2	30.8	-	28.9	30.8
47		Claude Sonnet 5.5 (Medium, Default Fallback) Anthropic	2026-09-28	$0.781	3.66m	0.0253	30.8	-29.2	30.8	-	18.9	30.8
48		GPT-6.1 Terra (Non-reasoning) OpenAI	2026-10-26	$0.226	2.20m	0.0074	30.5	-29.5	30.5	-	13.5	30.5
49		Gemini 3.8 Flash (Medium) Google	2026-09-02	$6.26	-	0.2081	30.1	-29.9	30.1	-	28.0	30.1
50		MiMo-V2.6-Pro Xiaomi	2026-09-21	$0.257	47.6m	0.0086	29.9	-30.1	29.9	-	14.1	29.9
51	✓	Claude Haiku 5.5 (High) Anthropic	2026-10-07	$0.159	6.82m	0.0053	29.9	-30.2	29.9	-	12.0	29.9
52		Ling 3.1 Flash 1019 InclusionAI	2026-10-22	$3.19	-	0.1077	29.6	-30.5	29.6	-	25.0	29.6
53	✓	GPT-6.1 Terra (Low) OpenAI	2026-10-26	$0.0713	1.03m	0.0024	29.4	-30.6	29.4	-	8.5	29.4
54		MiniMax-M3.1-Flash MiniMax	2026-10-19	$0.491	19.9m	0.0169	29.1	-31.0	29.1	-	16.9	29.1
55		DeepSeek V4.1 Flash 1017 (High) DeepSeek	2026-10-17	$0.456	10.2m	0.0159	28.6	-31.4	28.6	-	16.6	28.6
56		Step 5 Preview StepFun	2026-09-18	$2.35	14.4m	0.0822	28.5	-31.5	28.5	-	23.7	28.5
57		GPT-6 Luna (Max) OpenAI	2026-09-22	$0.152	12.0m	0.0055	27.9	-32.2	27.9	-	11.8	27.9
58		GLM-5.3-Flash Z AI	2026-08-26	$0.583	37.0m	0.0210	27.8	-32.2	27.8	-	17.7	27.8
59		MiMo-V2.6-Flash Xiaomi	2026-09-21	$0.129	1.03h	0.0048	26.7	-33.3	26.7	-	11.1	26.7
60		Mistral Large 4 (High) Mistral	2026-10-29	$2.06	-	0.0789	26.1	-33.9	26.1	-	23.1	26.1
61		Claude Sonnet 5.5 (Low, Default Fallback) Anthropic	2026-09-28	$0.511	2.51m	0.0199	25.6	-34.4	25.6	-	17.1	25.6
62		Mistral Large 4 Preview Mistral	2026-10-06	$4.21	19.8m	0.1661	25.3	-34.7	25.3	-	26.2	25.3
63		Muse Spark Open (Xhigh) Meta	2026-10-15	$2.02	7.21m	0.0811	24.9	-35.1	24.9	-	23.0	24.9
64		Claude Haiku 5.5 (Medium) Anthropic	2026-10-07	$0.0918	3.94m	0.0037	24.6	-35.4	24.6	-	9.6	24.6
65		GPT-5.6 Luna (Max) OpenAI	2026-07-09	$0.331	9.55m	0.0139	23.8	-36.2	23.8	-	15.2	23.8
66		GPT-6 Luna (Xhigh) OpenAI	2026-09-22	$0.104	7.49m	0.0044	23.5	-36.6	23.5	-	10.2	23.5
67		Mistral Large 4 (Medium) Mistral	2026-10-29	$1.41	-	0.0610	23.1	-36.9	23.1	-	21.5	23.1
68		GLM-5.3 (Low) Z AI	2026-08-18	$1.57	14.4m	0.0682	23.1	-36.9	23.1	-	22.0	23.1
69		DeepSeek V4 Pro 0813 (Max) DeepSeek	2026-08-13	$1.77	20.2m	0.0767	23.1	-37.0	23.1	-	22.5	23.1
70		GPT-6 Luna (High) OpenAI	2026-09-22	$0.0729	5.68m	0.0034	21.4	-38.6	21.4	-	8.6	21.4
71		Qwen3.8 27B (Xhigh) Alibaba	2026-08-14	$3.53	38.5m	0.1755	20.1	-39.9	20.1	-	25.5	20.1
72		MiniMax-M3 MiniMax	2026-06-01	$1.29	12.4m	0.0681	18.9	-41.1	18.9	-	21.1	18.9
73	✓	Claude Haiku 5.5 (Low) Anthropic	2026-10-07	$0.0438	2.14m	0.0024	18.6	-41.4	18.6	-	6.4	18.6
74		DeepSeek V4.1 Flash 1017 (Non-reasoning) DeepSeek	2026-10-17	$0.425	7.06m	0.0230	18.5	-41.5	18.5	-	16.3	18.5
75	✓	GPT-6 Luna (Medium) OpenAI	2026-09-22	$0.0422	-	0.0023	18.5	-41.6	18.5	-	6.3	18.5
76		Beam 1.0 Reflection	2026-10-16	$0.284	2.17m	0.0160	17.7	-42.3	17.7	-	14.5	17.7
77		Qwen3.8 27B (Medium) Alibaba	2026-08-14	$2.16	28.2m	0.1235	17.5	-42.5	17.5	-	23.3	17.5
78		Kimi K3 (Low) Kimi	2026-07-16	$2.37	17.5m	0.1360	17.4	-42.6	17.4	-	23.7	17.4
79		Qwen3.8 27B (Low) Alibaba	2026-08-14	$1.91	26.3m	0.1215	15.7	-44.3	15.7	-	22.8	15.7
80		Nemotron 3.5 Super VL NVIDIA	2026-10-15	$0.538	4.17m	0.0395	13.6	-46.4	13.6	-	17.3	13.6
81		Inkling Small Thinking Machines	2026-07-30	$0.203	3.73m	0.0157	12.9	-47.1	12.9	-	13.1	12.9
82		DeepSeek V4 Pro 0813 (Non-reasoning) DeepSeek	2026-08-13	$0.977	13.7m	0.0777	12.6	-47.5	12.6	-	19.9	12.6
83		Inkling (Xhigh) Thinking Machines	2026-07-15	$1.35	7.96m	0.1083	12.5	-47.5	12.5	-	21.3	12.5
84		Nemotron 3 Ultra 550B A55B (Reasoning) NVIDIA	2026-06-04	$2.23	6.28m	0.1893	11.8	-48.3	11.8	-	23.5	11.8
85		Gemini 3.5 Flash-Lite Google	2026-07-21	$0.693	1.61m	0.0594	11.7	-48.4	11.7	-	18.4	11.7
86		Qwen3.8 27B (Non-reasoning) Alibaba	2026-08-14	$3.77	16.7m	0.3761	10.0	-50.0	10.0	-	25.8	10.0
87	✓	GPT-6 Luna (Low) OpenAI	2026-09-22	$0.00512	37s	0.0005	9.7	-50.4	9.7	-	0.0	9.7
88		GPT-6 Luna (Non-reasoning) OpenAI	2026-09-22	$0.0714	1.79m	0.0076	9.4	-50.6	9.4	-	8.5	9.4
89		Claude 4.5 Haiku (Reasoning) Anthropic	2025-10-15	$0.532	4.37m	0.0716	7.4	-52.6	7.4	-	17.3	7.4
90		Muse Glimmer (High) Meta	2026-08-10	$0.161	4.57m	0.0254	6.3	-53.7	6.3	-	12.1	6.3
91		Gemini 3.1 Flash-Lite Google	2026-03-03	$0.194	51s	0.0316	6.2	-53.9	6.2	-	12.9	6.2
92		Nemotron 3.5 Lightning NVIDIA	2026-08-11	$0.290	4.32m	0.0524	5.5	-54.5	5.5	-	14.6	5.5
93		Granite 4.2 8B IBM	2026-08-25	$0.0405	16.3m	0.0079	5.1	-54.9	5.1	-	6.1	5.1
94		Mistral Medium 3.5 Mistral	2026-04-29	$1.04	4.53m	0.2237	4.6	-55.4	4.6	-	20.2	4.6
95		Mistral Small 4 (Reasoning) Mistral	2026-03-16	$0.0399	1.69m	0.0093	4.3	-55.7	4.3	-	6.0	4.3