localllama
LocalLLaMA noneabove1182 12mo ago 100%

Min P sampler (an alternative to Top K/Top P) has been merged into llama.cpp

github.com

Very interesting new sampler, does a better drop at filtering out extremely unlikely tokens when the most likely tokens are less confident, from the results it seems to pretty reliably improve quality with no noticeable downside

10
0
Comments 0