ollama/server
Michael Yang d24b2a8c58 enable metal gpu acceleration
ggml-metal.metal must be in the same directory as the ollama binary
otherwise llama.cpp will not be able to find it and load it.

1. go generate llama/llama_metal.go
2. go build .
3. ./ollama serve
2023-07-06 10:37:05 -04:00
..
routes.go enable metal gpu acceleration 2023-07-06 10:37:05 -04:00