Top-P (Nucleus Sampling)

Top-p (Nucleus Sampling)

Top-p, or nucleus sampling, is a decoding method that limits generation to the smallest set of tokens whose cumulative probability is below a chosen …