Open dataset · CC BY 4.0 · free to download and cite

The AI Helpful-Assistant Decay Index 2026: How Often Assistants Refuse, Hedge or Fail to Answer Legitimate Requests

A pre-registered measurement of 11 models on a frozen battery of 60 legitimate prompts. Published as pre-committed: the decay people describe is mostly not visible in refusal, hedging or completeness on this battery. Codes assigned by language-model judges, not validated by humans.

DOI (latest version)
10.5281/zenodo.23730212
Published by
Nesyona
Category
AI Tools & Productivity
Last updated
2026-10-28

Get the data

Download the file or read the study for its structure; both are linked above.

Cite this dataset

Released under CC BY 4.0. You may use it commercially and redistribute it. Attribution is the only condition.

Couey, V. W. (2026). The AI Helpful-Assistant Decay Index 2026: How Often Assistants Refuse, Hedge or Fail to Answer Legitimate Requests. Deep Synthesis. https://doi.org/10.5281/zenodo.23730212

Found an error, need a different cut of this data, or citing it in something? vincent@deepsynthesis.org. Corrections are made against the published file and the DOI is versioned, so a fix is traceable rather than silent.

Other datasets in AI Tools & Productivity

All 29 open datasets