Glossary
Transformer architecture — Glossary
A neural architecture built around attention mechanisms, foundational to modern LLMs.
Full definition
Transformers process token sequences with multi-head self-attention and feed-forward blocks. They scale well on parallel hardware and dominate contemporary NLP and multimodal modeling.