Word of the Day

Top-p (Nucleus Sampling)

Top-p limits the model to the smallest set of words whose combined probability reaches p, controlling output diversity.

Get it free

Top-p, or nucleus sampling, is a generation setting that restricts word choice to the smallest group of candidate words whose probabilities add up to p (e.g. 0.9). Lowering p makes output more focused; raising it toward 1.0 allows more variety.

It does a similar job to temperature and the two interact. Common guidance is to adjust one at a time rather than pushing both to extremes, which can make output incoherent.

Related: temperature · token

One of these every weekday

Three minutes. One prompt, one word, one skill. You're now better at AI than you were yesterday.

Free. All terms