ollama

Commit Graph

Author	SHA1	Message	Date
Daniel Hiltgen	d4cd695759	Add cgo implementation for llama.cpp Run the server.cpp directly inside the Go runtime via cgo while retaining the LLM Go abstractions.	2023-12-19 09:05:46 -08:00
Jeffrey Morgan	7fa6e51686	generate binary dependencies based on GOARCH on macos (#459 )	2023-09-05 12:53:57 -04:00
Bruce MacDonald	42998d797d	subprocess llama.cpp server (#401 ) * remove c code * pack llama.cpp * use request context for llama_cpp * let llama_cpp decide the number of threads to use * stop llama runner when app stops * remove sample count and duration metrics * use go generate to get libraries * tmp dir for running llm	2023-08-30 16:35:03 -04:00

Author

SHA1

Message

Date

Daniel Hiltgen

d4cd695759

Add cgo implementation for llama.cpp

Run the server.cpp directly inside the Go runtime via cgo
while retaining the LLM Go abstractions.

2023-12-19 09:05:46 -08:00

Jeffrey Morgan

7fa6e51686

generate binary dependencies based on GOARCH on macos (#459 )

2023-09-05 12:53:57 -04:00

Bruce MacDonald

42998d797d

subprocess llama.cpp server (#401 )

* remove c code
* pack llama.cpp
* use request context for llama_cpp
* let llama_cpp decide the number of threads to use
* stop llama runner when app stops
* remove sample count and duration metrics
* use go generate to get libraries
* tmp dir for running llm

2023-08-30 16:35:03 -04:00

3 Commits