ollama/runner/ollamarunner
Bruce MacDonald 0c1041ad85
runner: default to greedy sampler for performance (#9407)
As are adding support for weighted sampling we have seen some performance
regressions, bypassing the sampler logic for now and defaulting to greedy
until we can benchmark the new sampler logic.
2025-02-27 16:41:20 -08:00
..
cache.go Runner for Ollama engine 2025-02-13 17:09:26 -08:00
cache_test.go Runner for Ollama engine 2025-02-13 17:09:26 -08:00
runner.go runner: default to greedy sampler for performance (#9407) 2025-02-27 16:41:20 -08:00