Prompt Budget
Definition
Plan the available space of a model input.
A prompt budget defines how many input tokens may be used for instructions, conversation history, and additional knowledge.
Simply explained
A limited suitcase must hold the essentials and leave room for the answer.
Why it matters in practice
Targeted limitation helps control context boundaries, costs, and response time.
Example from business
A hypothetical assistant reserves fixed portions for rules, question, and relevant manual excerpts.
Limits and pitfalls
- Too much shortening can remove crucial exceptions; tokens are not the same as words.
Origin & history
The term originates from practical handling of limited context windows.
Use in mid-sized companies
- Measure token requirements and prioritize content by relevance.
Frequently asked questions
Does the answer count toward the input budget?
No; both budgets must fit the model limit together.
Sources
Editorially reviewed on: