Multimodal AI
Definition
Multimodal AI connects information from different types of media.
The umbrella term covers systems that jointly use, for example, text, image, and audio. This can be done through a single multimodal model or multiple connected components.
Simply explained
Multiple senses together provide a more complete picture of a task.
Why it matters in practice
Applications can use information missing in a single medium.
Example from business
Hypothetical example: A maintenance assistant combines error description and machine photo.
Limits and pitfalls
- Different media can be contradictory. Data protection and quality concerns apply to every input type.
Origin & history
The field develops from image, speech, and text processing as well as their integration.
Use in mid-sized companies
- SMEs can reduce media discontinuities in document or service processes.
Frequently asked questions
Is this identical to a multimodal model?
No, the system concept also includes combinations of multiple models.
Sources
- Gemini, A Family of Highly Capable Multimodal Models — · Google: Gemini, A Family of Highly Capable Multimodal Models —
Editorially reviewed on: