Word of the Day
Top-p (Nucleus Sampling)
Top-p limits the model to the smallest set of words whose combined probability reaches p, controlling output diversity.
Get it freeTop-p, or nucleus sampling, is a generation setting that restricts word choice to the smallest group of candidate words whose probabilities add up to p (e.g. 0.9). Lowering p makes output more focused; raising it toward 1.0 allows more variety.
It does a similar job to temperature and the two interact. Common guidance is to adjust one at a time rather than pushing both to extremes, which can make output incoherent.
Related: temperature · token
One of these every weekday
Three minutes. One prompt, one word, one skill. You're now better at AI than you were yesterday.
Free. All terms