Stemming
Definition
Stemming reduces various word forms to a common stem using rule-based methods.
Stemming reduces word forms with heuristic rules to a common stem that is not necessarily a correct dictionary word.
Simply explained
A search truncates similar word forms to a common core. This core does not have to be a valid dictionary word itself.
Why it matters in practice
The term helps to select, develop, evaluate AI systems in a well-founded manner and realistically assess their technical risks.
Example from business
A search treats "arbeiten," "arbeitet," and related forms as similar term variants.
Limits and pitfalls
- Over- and understemming can mix meanings or miss hits; for some languages, lemmatization is more suitable.
Origin & history
The Porter Stemmer from 1980 shaped practical use in English-language information retrieval systems.
Use in mid-sized companies
- Possible application: A search treats "arbeiten," "arbeitet," and related forms as similar term variants.
Frequently asked questions
What does Word Stem Reduction (Stemming) mean?
Stemming reduces word forms with heuristic rules to a common stem that is not necessarily a correct dictionary word. What should you watch out for? Over- and understemming can mix meanings or miss hits; for some languages, lemmatization is more suitable.
Sources
- An algorithm for suffix stripping · Porter, An algorithm for suffix stripping
Source checked on 10.10.2026. Editorial application examples are hypothetical; no evidence of real customer results.
Editorially reviewed on: