LocalLLaMA
noneabove1182
•
12mo ago
•
100%
Min P sampler (an alternative to Top K/Top P) has been merged into llama.cpp
github.comVery interesting new sampler, does a better drop at filtering out extremely unlikely tokens when the most likely tokens are less confident, from the results it seems to pretty reliably improve quality with no noticeable downside
Comments 0