Query, Key and Value (QKV)
Definition
Query, Key, and Value control the comparison and merging in Attention.
Three projections of an attention mechanism: similarity scores are derived from query and key vectors, which weight and merge the value vectors.
Simply explained
A search description is matched with comparison features; matching associated information is thereby given more weight.
Why it matters in practice
The term helps to select, develop, evaluate AI systems in a well-founded manner and realistically assess their technical risks.
Example from business
A query vector is compared with key vectors; the normalized scores weight the associated value vectors.
Limits and pitfalls
- Interpret QKV as fixed semantic roles or ignore matrix dimensions and head splitting.
Origin & history
QKV became widely known through attention mechanisms and the Transformer.
Use in mid-sized companies
- Possible application: A query vector is compared with key vectors; the normalized scores weight the associated value vectors.
Frequently asked questions
What do Query, Key, and Value mean?
Three projections of an attention mechanism: similarity scores are derived from query and key vectors, which weight and merge the value vectors. What mistakes should be avoided? Interpreting QKV as fixed semantic roles or ignoring matrix dimensions and head splitting.
Sources
Source verified on 10.10.2026. Editorial application examples are hypothetical; no proof of real customer results.
Editorially reviewed on: