Glossary

Top-p sampling — Glossary

Nucleus sampling that limits token draws to a probability mass cutoff.

Also known as: nucleus sampling

Reviewed:

Full definition

Top-p truncates the long tail of unlikely tokens. It interacts with temperature; tune jointly and evaluate rather than copying defaults blindly.

Related encyclopedia topic

Temperature — Temperature is a decoding parameter that scales next-token probabilities, influencing how deterministic or varied a language model’s outputs are.

← Back to glossary · Learning hub