Memory Bandwidth
Definition
Memory bandwidth refers to the amount of data that can be transferred per unit time between memory and processing unit.
Memory bandwidth describes how much data can be transferred per unit time between memory and processing unit. It can limit processing even if sufficient computing power is available. The actually usable bandwidth may be below the theoretical peak value.
Simply explained
Like the width of a delivery conveyor: it limits how much material arrives per second, even if the machine could work faster.
Why it matters in practice
Helps realistically assess model quality, limits, and technical decisions.
Example from business
An inference is limited by loading model weights rather than by computational operations.
Limits and pitfalls
- Equating theoretical peak values with real usable bandwidth.
Origin & history
With data-intensive parallel computers, memory bandwidth became a central performance bottleneck.
Use in mid-sized companies
- Possible example: A development team measures data transfer and runtime of an inference process. It compares effective values with theoretical limits and evaluates optimizations on the same hardware.
Frequently asked questions
What does memory bandwidth mean?
The amount of data that can be transferred per unit time between memory and processing unit.
Which mistakes should be avoided?
Equating theoretical peak values with real usable bandwidth.
Sources
Sources checked on 12.10.2026. Editorial use cases are hypothetical; no proof of real customer results.
Editorially reviewed on: