ollama/model/models/mistral3
Daniel Hiltgen 31f64183dc perf: build graph for next batch in parallel to keep GPU busy
This refactors the main run loop of the ollama runner to perform the main GPU
intensive tasks (Compute+Floats) in a go routine so we can prepare the next
batch in parallel to reduce the amount of time the GPU stalls waiting for the
next batch of work.
2025-08-19 12:33:03 -07:00
..
imageproc.go model: support for mistral-small in the ollama runner 2025-04-03 16:57:36 -07:00
model.go perf: build graph for next batch in parallel to keep GPU busy 2025-08-19 12:33:03 -07:00
model_text.go ml: add more rope options (#10775) 2025-05-20 15:51:08 -07:00
model_vision.go ml: Panic rather than return error on tensor allocation failure 2025-05-22 14:38:09 -07:00