XLNet
Definition
XLNet learns linguistic context with varying prediction orders within text sequences.
A transformer language model with a permutation objective that aims to learn bidirectional context without classic mask tokens.
Simply explained
During training, the order in which the model predicts text parts changes. This allows it to consider information from different directions.
Why it matters in practice
The term helps to select, develop, evaluate AI systems in a well-founded manner and realistically assess their technical risks.
Example from business
A research team compares XLNet with more modern encoders for long document classification.
Limits and pitfalls
- Permutation training is not a random word order of the input; computational cost and current baselines must be considered.
Origin & history
Yang and coauthors published XLNet in 2019, combining Transformer-XL with Permutation Language Modeling.
Use in mid-sized companies
- Possible example: A research team compares XLNet with more modern encoders for long document classification.
Frequently asked questions
What does XLNet mean?
A transformer language model with a permutation objective that aims to learn bidirectional context without classic mask tokens. What should be considered? Permutation training is not a random word order of the input; computational cost and current baselines must be considered.
Sources
- XLNet · Yang et al., XLNet
Source checked on 10.10.2026. Editorial application examples are hypothetical; no evidence of real customer results.
Editorially reviewed on: