Will any open-source model rank in the top 3 on Chatbot Arena at the end of 2024?
22
Ṁ1026Dec 30
15%
chance
1D
1W
1M
ALL
I was browing Twitter and I saw a post by Karpathy postively talking about ChatBot Arena which is a platform for ranking LLMs based on human ratings. As expected OpenAI is holding positions 1, 2 and 3. I wonder if any opensource model will take any of these positions at the end of 2024. I will resolve as yes if this is the case ar the end of 2024
Get Ṁ1,000 play money
Sort by:
@HanchiSun good observation I already have 5 markets on ChatBot Arena and would hate to spam everyone on here. Check them out here and I will create another one where duplicates are not allowed but I just need to find a good definition of what constitues a duplicate.
https://manifold.markets/dashboard/chatbot-arena-battle-of-the-llms?r=U29saQ
Related questions
Related questions
Will there be a model with a 69%+ Chatbot Arena win rate against gpt-o1 before June 1st, 2025?
70% chance
Will there be an AI language model that strongly surpasses ChatGPT and other OpenAI models before the end of 2024?
23% chance
Will GPT-4-Turbo be ranked in the top 20 on the Chatbot Arena Leaderboard at the end of 2025?
24% chance
Which companies will rank in top 10 on Chatbot Arena at the end of 2024?
Will any open-source model rank in the top 3 on Chatbot Arena at any point in 2024? (resolves based on ELO rating)
15% chance
Which companies will outrank OpenAI on ChatBot Arena in 2024? (>= week)
Which companies will outrank or tie with OpenAI on ChatBot Arena in 2024? (>= week)
Who will ever rank #1 in LMSYS Chatbot Arena Leaderboard in 2025?
Will OpenAI launch a significantly better model for ChatGPT paying users in 2024? (>= 100 points diff on ChatBot Arena)
23% chance
Chatbot Arena - top 3 labs EOY 2024