Performance Benchmarks for devstral-medium-2507

Analyze how devstral-medium-2507 stacks up against other frontier models in terms of cost-to-performance and raw intelligence (LMArena Elo).

2026 Performance Summary

🚀 Intelligence (Elo): 1091
💰 API Cost (Input): $4e-7 / 1M tokens
⚡ API Cost (Output): $0.000002 / 1M tokens
⏱️ Real-world Throughput: 8 tokens/s

Analysis: While devstral-medium-2507 is a capable model, it is currently outperformed in efficiency by gpt-5.2-chat-latest-20260210. gpt-5.2-chat-latest-20260210 sits higher on the Pareto line, offering approximately 386 points more intelligence (Elo) for a comparable or lower API cost.

Highly Recommended Alternatives

Frontier Model	LMArena Elo	API Cost (1M)	Throughput
gpt-5.2-chat-latest-20260210	1477	$0.00000175	37
gemini-3-flash	1474	$5e-7	67
qwen3.6-plus-preview	1453	$3.25e-7	38
gemma-4-31b	1451	$1.4e-7	5
gemma-4-26b-a4b	1438	$1.2e-7	22

*These models represent the Pareto Frontier (optimal cost-to-performance).*