top of page

top-k-top-p.py
Sample the next token from a probability distribution using top-k and/or nucleus (top-p) sampling.
0
Votes
Owner Profile
Vote Here
You must earn at least 1 vote on your snippets to be allowed to vote
bottom of page
Sample the next token from a probability distribution using top-k and/or nucleus (top-p) sampling.