Natural Questions
Definition
Natural Questions connects real search queries with annotated answer spans.
The Google dataset contains questions from search queries and Wikipedia documents with long and short answer annotations. It supports research on open question answering.
Simply explained
A question is linked to a long document in which the answer must be found.
Why it matters in practice
This tests retrieval and answer finding closer to real information needs.
Example from business
Hypothetical example: A team investigates whether a model finds appropriate text passages instead of only plausible answers.
Limits and pitfalls
- The data represent specific sources and languages. Annotations and document versions limit the significance.
Origin & history
Google introduced Natural Questions as a benchmark for question answering.
Use in mid-sized companies
- SMEs can transfer the task principle to their own internal documents.
Frequently asked questions
Does every question contain an answer?
No, missing answers are also relevant for evaluation.
Sources
- Natural Questions — · Google Research: Natural Questions —
Editorially reviewed on: