pali112
/
ollama
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,656 Commits 315 Branches 369 Tags 262 MiB
Commit Graph

4 Commits

Author SHA1 Message Date
Daniel Hiltgen 7555ea44f8 Revamp the dynamic library shim 
This switches the default llama.cpp to be CPU based, and builds the GPU variants
as dynamically loaded libraries which we can select at runtime.

This also bumps the ROCm library to version 6 given 5.7 builds don't work
on the latest ROCm library that just shipped.
 2023-12-20 14:45:57 -08:00
Daniel Hiltgen 54dbfa4c4a Carry ggml-metal.metal as payload 2023-12-19 09:05:46 -08:00
Daniel Hiltgen 3269535a4c Refine handling of shim presence 
This allows the CPU only builds to work on systems with Radeon cards
 2023-12-19 09:05:46 -08:00
Daniel Hiltgen 35934b2e05 Adapted rocm support to cgo based llama.cpp 2023-12-19 09:05:46 -08:00