Residual Connection
Definition
Residual connections forward inputs in addition to the processed output.
A connection that adds or forwards the input of a network block to its transformed output.
Simply explained
Part of the original signal takes a shortcut and is combined with the processed result.
Why it matters in practice
The term helps to select, develop, evaluate AI systems in a well-founded manner and realistically assess their technical risks.
Example from business
A transformer block adds its input to the output of the attention sublayer.
Limits and pitfalls
- Combining dimensions incorrectly or confusing residual connection with simple concatenation.
Origin & history
Residual connections became known with ResNet 2015 and were later adopted in many deep architectures.
Use in mid-sized companies
- Possible example: A transformer block adds its input to the output of the attention sublayer.
Frequently asked questions
What does residual connection mean?
A connection that adds or forwards the input of a network block to its transformed output. What mistakes should be avoided? Combining dimensions incorrectly or confusing residual connection with simple concatenation.
Sources
Source checked on 10.10.2026. Editorial application examples are hypothetical; no proof of real customer results.
Editorially reviewed on: