Skip to content
    Flow-alerta.cab

    Context Rot

    AI fundamentals & modelsPerformance degradation in long contextsContext degradation
    Editorially reviewed on: 1 source
    Your reading view

    The short answer · 14 words

    In short

    Designation for decreasing reliability of a language model with increasing or disturbing context set.

    Flow-alerta.cab (2026): Context Rot. https://flow-alerta.cab/en/glossar/context-rot. Editorially reviewed on: 09 October 2026.

    How much detail would you like?

    Practical

    Relevant for long chats, document analyses and agents with growing history.

    Example scenario: An assistant misses a delivery period after many irrelevant messages have been attached.

    Test length and distractions with your own tasks; select relevant material and check important information when making cuts.

    At a glance

    Core
    A large context window does not mean that all information is used equally reliably. Length, distractions, position and task can affect performance. Context Rot refers to observed quality losses, no temporal perishability of files and no universal fixed token limit.
    Use
    Relevant for long chats, document analyses and agents with growing history.
    Example
    Example scenario: An assistant misses a delivery period after many irrelevant messages have been attached.
    Limits
    Equate window size with usage quality; generalize individual benchmarks; adopt summaries unchecked.

    In context

    Context Window

    The context window limits how much content a model can consider at the same time.

    Context Compression

    Context Compression condenses existing information for later model steps.

    Questions about this term

    Does it happen the same for every model?

    No.

    Are long contexts useless?

    No.

    Does RAG always help?

    Only with suitable retrieval.

    All details and background

    A large context window does not mean that all information is used equally reliably. Length, distractions, position and task can affect performance. Context Rot refers to observed quality losses, no temporal perishability of files and no universal fixed token limit.

    ELI5 – Explained simply

    In an overcrowded folder, the important note is more easily overlooked.

    Why it matters in practice

    Relevant for long chats, document analyses and agents with growing history.

    Example

    Example scenario: An assistant misses a delivery period after many irrelevant messages have been attached.

    Pitfalls and limits

    • Equate window size with usage quality; generalize individual benchmarks; adopt summaries unchecked.

    Origin & history

    In 2025, Chroma investigated the influence of growing inputs on 18 language models at that time.

    Use in mid-sized companies

    • Test length and distractions with your own tasks; select relevant material and check important information when making cuts.

    Related terms

    Matching Flow-alerta service

    AI opportunity analysis & roadmapAI consulting – examine contextual quality with practical evaluation cases.

    Matching tool / use case

    View use casesUse Case: comparison of short, long and targeted document contexts.

    Sources

    Quellenprüfung: 09.10.2026. Definition und dokumentierte Einordnung abgeglichen; Beispiele beschreiben mögliche Anwendungen.

    Editorially reviewed on:

    Next step

    Put knowledge into practice

    Discuss your projectView use cases