ollama

Commit Graph

Author	SHA1	Message	Date
Daniel Hiltgen	39ca55a1ba	Move quantization to new backend (#10363 ) * Move quantization logic to GGML via new backend This moves the model aware logic to Go code and calls GGMLs quantization code for model creation. * Remove "add model quantizations" This is no longer needed now that quantization is implemented in Go+GGML code directly.	2025-12-29 06:37:52 -06:00
Daniel Hiltgen	93656e562d	Integration test improvements (#9654 ) Add some new test coverage for various model architectures, and switch from orca-mini to the small llama model.	2025-12-29 06:37:38 -06:00

Author

SHA1

Message

Date

Daniel Hiltgen

39ca55a1ba

Move quantization to new backend (#10363 )

* Move quantization logic to GGML via new backend

This moves the model aware logic to Go code and calls GGMLs quantization code for model creation.

* Remove "add model quantizations"

This is no longer needed now that quantization is implemented in Go+GGML code directly.

2025-12-29 06:37:52 -06:00

Daniel Hiltgen

93656e562d

Integration test improvements (#9654 )

Add some new test coverage for various model architectures,
and switch from orca-mini to the small llama model.

2025-12-29 06:37:38 -06:00

2 Commits