This enables matching up devices and information reported by the backend with system management libraries such as nvml to get accurate free memory reporting. |
||
|---|---|---|
| .. | ||
| ggml | ||
| ggml.go | ||
| quantization.go | ||
| threads.go | ||
| threads_debug.go | ||
This enables matching up devices and information reported by the backend with system management libraries such as nvml to get accurate free memory reporting. |
||
|---|---|---|
| .. | ||
| ggml | ||
| ggml.go | ||
| quantization.go | ||
| threads.go | ||
| threads_debug.go | ||