Glossary
Multimodal — Glossary
AI systems that process or generate more than one data type—such as text, images, audio, or video—within a unified model or pipeline.
Full definition
Multimodal AI jointly handles multiple modalities. Examples include models that answer questions about images, generate captions, or accept voice and screenshots together. Shared or aligned embeddings help relate concepts across modalities.
Multimodal systems enable richer interfaces but complicate evaluation: failures may be visual, linguistic, or in the alignment between them. Data pairing quality (how text relates to images) strongly affects behavior, and privacy considerations expand when more sensor types are involved.