ollama/runner/ollamarunner
Jesse Gross 73d6a82cce ollamarunner: Memory usage reporting
This provides granular information about the backend memory allocations
required by the runner:
 - Per backend
 - Per layer
 - Weights, cache and graph
 - Allocation status

This can be used for debugging and validating memory estimates.
2025-05-22 14:38:09 -07:00
..
cache.go ollamarunner: Base cached tokens on current prompt 2025-05-15 13:46:20 -07:00
cache_test.go ollamarunner: Separate text and multimodal graphs 2025-05-15 13:46:20 -07:00
multimodal.go ollamarunner: Memory usage reporting 2025-05-22 14:38:09 -07:00
runner.go ollamarunner: Memory usage reporting 2025-05-22 14:38:09 -07:00