ollama

Commit Graph

Author	SHA1	Message	Date
Jeffrey Morgan	c4cf8ad559	llm: avoid loading model if system memory is too small (#5637 ) * llm: avoid loading model if system memory is too small * update log * Instrument swap free space On linux and windows, expose how much swap space is available so we can take that into consideration when scheduling models * use `systemSwapFreeMemory` in check --------- Co-authored-by: Daniel Hiltgen <daniel@ollama.com>	2024-07-11 16:42:57 -07:00
Daniel Hiltgen	6f351bf586	review comments and coverage	2024-06-14 14:55:50 -07:00

Author

SHA1

Message

Date

Jeffrey Morgan

c4cf8ad559

llm: avoid loading model if system memory is too small (#5637 )

* llm: avoid loading model if system memory is too small

* update log

* Instrument swap free space

On linux and windows, expose how much swap space is available
so we can take that into consideration when scheduling models

* use `systemSwapFreeMemory` in check

---------

Co-authored-by: Daniel Hiltgen <daniel@ollama.com>

2024-07-11 16:42:57 -07:00

Daniel Hiltgen

6f351bf586

review comments and coverage

2024-06-14 14:55:50 -07:00

2 Commits