Stopword Removal
Definition
Stop word removal omits frequent function words when they contribute little to a specific text analysis.
Stop word removal removes frequent function words from text representations when they offer little discriminative power for a specific analysis.
Simply explained
For a search, unhelpful small words are filtered out. The key is which words are dispensable for exactly this task.
Why it matters in practice
The term helps to select, develop, evaluate AI systems in a well-founded manner and realistically assess their technical risks.
Example from business
A classic search index removes selected, domain-irrelevant function words but retains negations.
Limits and pitfalls
- Generic lists can destroy meaning, for example with “not” or fixed product names; modern models often do not require this step.
Origin & history
Early information retrieval systems used fixed stop lists to reduce index size and computational effort.
Use in mid-sized companies
- Possible application: A classic search index removes selected, domain-irrelevant function words but retains negations.
Frequently asked questions
What does stop word removal mean?
Stop word removal removes frequent function words from text representations when they offer little discriminative power for a specific analysis. What should be considered? Generic lists can destroy meaning, for example with “not” or fixed product names; modern models often do not require this step.
Sources
- Introduction to Information Retrieval, Stop words · Manning et al., Introduction to Information Retrieval, Stop words
Source checked on 10.10.2026. Editorial application examples are hypothetical; no evidence of real customer results.
Editorially reviewed on: