Glossary
Hyperparameter — Glossary
A configuration choice set before learning parameters, such as learning rate or number of layers.
Full definition
Hyperparameters are tuned via validation performance, search methods, or heuristics. Decoding settings like temperature are inference hyperparameters for generative models.