Will AI image generating models score >= 90% on Winoground by June 1, 2025?
โž•
Plus
24
แน€1066
Jun 2
76%
chance

Based on the recent discussions between Gary Marcus and @ScottAlexander, this market resolves as follows:

IF any AI image generating model (such as DALL-E, Imagen, Stable Diffusion, etc) scores 90% or more on the Winoground image composition test, this market resolves YES.

ELSE this market resolves NO.

Relevant Links:
Scott's post: https://astralcodexten.substack.com/p/i-won-my-three-year-ai-progress-bet
Gary's post: https://garymarcus.substack.com/p/did-googleai-just-snooker-one-of
Winoground: https://arxiv.org/pdf/2204.03162v2.pdf

Get แน€1,000 play money
Sort by:

This market's resolution seems pretty dependent on whether someone runs the benchmark with current frontier models

I like this question, thank you!