ollama/model/models/gemma3
Daniel Hiltgen 31f64183dc perf: build graph for next batch in parallel to keep GPU busy
This refactors the main run loop of the ollama runner to perform the main GPU
intensive tasks (Compute+Floats) in a go routine so we can prepare the next
batch in parallel to reduce the amount of time the GPU stalls waiting for the
next batch of work.
2025-08-19 12:33:03 -07:00
..
model.go perf: build graph for next batch in parallel to keep GPU busy 2025-08-19 12:33:03 -07:00
model_text.go ml: add more rope options (#10775) 2025-05-20 15:51:08 -07:00
model_vision.go arange 2025-04-18 11:45:44 -07:00
process_image.go fs: move ml.Config to fs package 2025-04-03 13:12:24 -07:00