ollama

Commit Graph

Author	SHA1	Message	Date
Daniel Hiltgen	7555ea44f8	Revamp the dynamic library shim This switches the default llama.cpp to be CPU based, and builds the GPU variants as dynamically loaded libraries which we can select at runtime. This also bumps the ROCm library to version 6 given 5.7 builds don't work on the latest ROCm library that just shipped.	2023-12-20 14:45:57 -08:00
Daniel Hiltgen	35934b2e05	Adapted rocm support to cgo based llama.cpp	2023-12-19 09:05:46 -08:00

Author

SHA1

Message

Date

Daniel Hiltgen

7555ea44f8

Revamp the dynamic library shim

This switches the default llama.cpp to be CPU based, and builds the GPU variants
as dynamically loaded libraries which we can select at runtime.

This also bumps the ROCm library to version 6 given 5.7 builds don't work
on the latest ROCm library that just shipped.

2023-12-20 14:45:57 -08:00

Daniel Hiltgen

35934b2e05

Adapted rocm support to cgo based llama.cpp

2023-12-19 09:05:46 -08:00

2 Commits