pali112
/
ollama
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
ollama/ml
History
Jesse Gross bd6a7d5e64 ollamarunner: Pass runner performance parameters to backends 
Currently the following parameters are in the runner but not used:
 - numGPULayers
 - mainGPU
 - threads
 - tensorSplit

This passes them through to the backend, which is where they would
actually get used. However, the GGML backend does not yet do anything
with them.
 		2025-02-20 13:27:57 -08:00
..
backend ollamarunner: Pass runner performance parameters to backends 2025-02-20 13:27:57 -08:00
nn next ollama runner (#7913) 2025-02-13 16:31:21 -08:00
backend.go ollamarunner: Pass runner performance parameters to backends 2025-02-20 13:27:57 -08:00