Will OpenAI release a tokenizer with more than 210000 tokens before 2026? | Manifold

Will OpenAI release a tokenizer with more than 210000 tokens before 2026?

Mini

1

Ṁ79

2026

24%

chance

1D

1W

1M

ALL

Resolves YES if OpenAI adds support for a tokenizer with more than 210000 tokens to tiktoken (or its successor) before 2026.

Get Ṁ1,000 play money

Related questions

What will OpenAI do in 2025?

Will a flagship (>60T training bytes) open-weights LLM from Meta which doesn't use a tokenizer be released in 2025?

Will OpenAI fold in 2025?

Will OpenAI disappear before 2034?

Will OpenAI have >$10 billion in revenue by 2027?

Will the next major LLM by OpenAI use a new tokenizer?

Will OpenAI have a new name by the end of 2025?

Will OpenAI exist in Jan 2027?

Will OpenAI become nothing by 2030?

Related questions

What will OpenAI do in 2025?

Will the next major LLM by OpenAI use a new tokenizer?

Will a flagship (>60T training bytes) open-weights LLM from Meta which doesn't use a tokenizer be released in 2025?

Will OpenAI have a new name by the end of 2025?

Will OpenAI fold in 2025?

Will OpenAI exist in Jan 2027?

Will OpenAI disappear before 2034?

Will OpenAI become nothing by 2030?

Will OpenAI have >$10 billion in revenue by 2027?