ollama/ml
Daniel Hiltgen 3258a89b6e
DRY out the runner lifecycle code (#12540)
* DRY out the runner lifecycle code

Now that discovery uses the runners as well, this unifies the runner spawning code
into a single place.  This also unifies GPU discovery types with the newer ml.DeviceInfo

* win: make incremental builds better

Place build artifacts in discrete directories so incremental builds don't have to start fresh

* Adjust sort order to consider iGPUs

* handle cpu inference oom scenarios

* review comments
2025-10-23 11:20:02 -07:00
..
backend cuda: get driver version after props (#12707) 2025-10-20 10:57:27 -07:00
nn Use runners for GPU discovery (#12090) 2025-10-01 15:12:32 -07:00
backend.go Use runners for GPU discovery (#12090) 2025-10-01 15:12:32 -07:00
device.go DRY out the runner lifecycle code (#12540) 2025-10-23 11:20:02 -07:00