3 Commits

Author	SHA1	Message	Date
Jeffrey Morgan	c336693f07	calculate overhead based number of gpu devices (#1875)	2024-01-09 15:53:33 -05:00
Daniel Hiltgen	a2ad952440	Fix windows system memory lookup ... This refines the gpu package error handling and fixes a bug with the system memory lookup on windows.	2024-01-03 08:50:01 -08:00
Daniel Hiltgen	35934b2e05	Adapted rocm support to cgo based llama.cpp	2023-12-19 09:05:46 -08:00