Will Llama 4 use mixture of experts?
10
Ṁ7942025
61%
chance
1D
1W
1M
ALL
Resolves YES is any model in the Llama 4 (or potentially 4.1) series uses mixture of experts.
Get Ṁ1,000 play money
Related questions
Related questions
Will there exist a service for full-parameter fine-tuning of Llama 3.1 405B?
79% chance
Will Llama 4 be fully open-weight?
70% chance
Will Llama-4 be (open sourced and) as good as GPT-4?
73% chance
Will Llama 4 be the best LLM in the chatbot arena?
16% chance
Is GPT-5 a mixture of experts?
79% chance
How many active parameters will the largest Llama 3 have?
77% chance
Will Llama 3-multimodal be natively mixed-multimodal? (VQ-VAE+next token prediction)
50% chance
Will Reflection Llama 3.1 70B be proven to beat Llama 3.1 405B Instruct in GPQA by the end of September 2024?
2% chance