Glossary

Deterministic decoding — Glossary

Decoding settings that make outputs repeatable for the same inputs, such as greedy decoding.

Reviewed:

Full definition

Determinism helps testing and extractive tasks. Some GPU kernels still introduce rare nondeterminism; pin seeds and versions when reproducibility matters.

Related encyclopedia topic

Temperature — Temperature is a decoding parameter that scales next-token probabilities, influencing how deterministic or varied a language model’s outputs are.

← Back to glossary · Learning hub