3d990dc451
Callers can set a backend buffer type to be no-alloc, meaning that it does not allocate memory for tensors or operations. This can be used for calculating memory requirements. Tensors and graphs must be recreated with no-alloc set to false before loading data. Defaults to false for newly created backend buffer types. |
||
|---|---|---|
| .. | ||
| ggml | ||
| ggml.go | ||
| ggml_test.go | ||
| mxfp4_test.go | ||
| quantization.go | ||
| threads.go | ||
| threads_debug.go | ||