ollama/ml/backend
Jesse Gross 3d990dc451
ggml: No-alloc mode
Callers can set a backend buffer type to be no-alloc, meaning that
it does not allocate memory for tensors or operations. This can
be used for calculating memory requirements. Tensors and graphs
must be recreated with no-alloc set to false before loading data.

Defaults to false for newly created backend buffer types.
2025-12-29 06:39:51 -06:00
..
ggml ggml: No-alloc mode 2025-12-29 06:39:51 -06:00
backend.go next ollama runner (#7913) 2025-02-13 16:31:21 -08:00