Metrics
| Country ↑↓ | Provider ↑↓ | Model ↑↓ | Voter | Elo ↑↓ | Seconds ↑↓ | Avg Strlen ↑↓ | Avg Lines ↑↓ | Input $ ↑↓ | Output $ ↑↓ | Release ↑↓ | Cutoff ↑↓ | Votes ↑↓ | Votings ↑↓ | Answers ↑↓ | Bar Chart |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| US | xAI | Grok-2 | 806 | 3.9 | 1,043 | 13 | 2.00 | 10.00 | 2024-11-04 | 2023-10-01 | 0 | 394 | 46 | ||
| FR | Mistral | codestral | 849 | 2.5 | 1,915 | 25 | 0.30 | 0.90 | 2024-05-29 | 2023-08-01 | 0 | 134 | 46 | ||
| US | Gemini-2.5-flash | 873 | 16.8 | 1,207 | 15 | 0.15 | 3.50 | 2025-04-17 | 2024-06-30 | 0 | 48 | 46 | |||
| US | OpenAI | GPT-4o | 901 | 8.3 | 1,753 | 17 | 2.50 | 10.00 | 2024-05-13 | 2023-10-01 | 0 | 234 | 46 | ||
| FR | Mistral | mistral-large | 930 | 6.6 | 1,186 | 16 | 2.00 | 6.00 | 2024-07-24 | 2023-08-01 | 0 | 156 | 46 | ||
| US | OpenAI | o1 | 944 | 11.7 | 1,081 | 8 | 15.00 | 60.00 | 2024-09-12 | 2024-12-05 | 0 | 249 | 46 | ||
| CN | DeepSeek | V3 | 969 | 16.9 | 1,197 | 14 | 0.27 | 1.10 | 2024-12-26 | 2024-12-27 | 0 | 275 | 46 | ||
| US | OpenAI | o3-mini | 1,029 | 7.5 | 1,486 | 14 | 1.10 | 4.40 | 2025-01-31 | 2023-10-01 | 216 | 246 | 46 | ||
| US | Anthropic | Claude-3-5-sonnet | 1,051 | 7.5 | 1,510 | 34 | 3.75 | 15.00 | 2024-10-22 | 2022-01-01 | 25 | 201 | 46 | ||
| US | xAI | Grok-3-fast | Yes | 1,057 | 5.9 | 1,568 | 12 | 5.00 | 25.00 | 2025-04-11 | 2023-10-01 | 167 | 104 | 46 | |
| US | Gemini-2.5-pro | Yes | 1,108 | 19.0 | 1,450 | 20 | 1.25 | 10.00 | 2025-03-25 | 2023-04-01 | 141 | 123 | 46 | ||
| US | Anthropic | Claude-3-7-sonnet-thinking | 1,127 | 24.7 | 1,527 | 27 | 3.00 | 15.00 | 2025-02-24 | 2024-10-31 | 17 | 100 | 46 | ||
| CN | DeepSeek | R1 | Yes | 1,199 | 29.4 | 1,529 | 15 | 0.55 | 2.19 | 2025-01-20 | 2023-12-01 | 524 | 519 | 46 | |
| US | OpenAI | o4-mini | Yes | 1,257 | 8.2 | 1,596 | 22 | 1.10 | 4.40 | 2025-04-16 | 2024-06-01 | 77 | 105 | 46 | |
| US | OpenAI | o3 | 1,377 | 13.4 | 1,927 | 26 | 10.00 | 40.00 | 2025-04-16 | 2023-10-01 | 20 | 81 | 46 |