How long until one of Gemini, Claude, etc... match the capabilities of O1?
➕
Plus
21
Ṁ5129
2026
2%
Oct 12th 2024
9%
Dec 12th 2024
58%
April 12th 2025
20%
September 12th 2025
5%
April 12th 2026
5%
Other

OpenAI's O1 model represents a new paradigm of LLMs. How long until a competitor catches up?

"Catches up" / "matches capabilities" is defined as matching or exceeding the O1 pass@1 benchmarks on AIME, Codeforces, and GPQA at the time of publication:

  • 74.4-percentile on AIME

  • 89-percentile on Codeforces

  • 78% accuracy on GPQA

Get Ṁ1,000 play money
Sort by:

Option of Oct 12th2024 should be resolved.

@Adamacki I can’t seem to find a way to partially resolve the market

bought Ṁ50 April 12th 2025 YES

Apparently o1's AIME score was pass@10000, not pass@1. Criteria should be updates accordingly

@JaundicedBaboon I updated the benchmark to the pass@1 score