Open dataset · CC BY 4.0 · free to download and cite

AI Tokenizer Inflation Ledger 2026: The Same Text, Counted by Every Model Version We Can Reach

The same fixed corpus counted by the token counters of 13 Claude, 11 Gemini and 2 Cohere models plus offline OpenAI counts, with the ratio between versions. Claude Opus 4.6 to 4.7: English prose +33.3%, Russian, Chinese and Arabic 0%.

DOI (latest version)
10.5281/zenodo.23730116
Published by
Nesyona
Category
AI Tools & Productivity
Last updated
2026-10-28

Get the data

Download the file or read the study for its structure; both are linked above.

Cite this dataset

Released under CC BY 4.0. You may use it commercially and redistribute it. Attribution is the only condition.

Couey, V. W. (2026). AI Tokenizer Inflation Ledger 2026: The Same Text, Counted by Every Model Version We Can Reach. Deep Synthesis. https://doi.org/10.5281/zenodo.23730116

Found an error, need a different cut of this data, or citing it in something? vincent@deepsynthesis.org. Corrections are made against the published file and the DOI is versioned, so a fix is traceable rather than silent.

Other datasets in AI Tools & Productivity

All 29 open datasets