Jesse Gross f15ffc4320 llm: Make "POST predict" error message more informative ...

"POST predict" basically means that the runner has crashed, which
can have many reasons. However, many people think this is a specific
error and either report only this message or group together unrelated
bugs. This replaces it with a more friendly and helpful message.

2025-05-29 09:41:19 -07:00

..

llm_darwin.go

Optimize container images for startup (#6547)

2024-09-12 12:10:30 -07:00

llm_linux.go

Optimize container images for startup (#6547)

2024-09-12 12:10:30 -07:00

llm_windows.go

win: lint fix (#10571)

2025-05-05 11:08:12 -07:00

memory_test.go

Move quantization to new backend (#10363)

2025-05-06 11:20:48 -07:00

memory.go

llm: Use first layer as memory buffer in estimation

2025-05-19 14:03:34 -07:00

server_test.go

lint: enable usetesting, disable tenv (#10594)

2025-05-08 11:42:14 -07:00

server.go

llm: Make "POST predict" error message more informative

2025-05-29 09:41:19 -07:00

status.go

Improve crash reporting (#7728)

2024-11-19 16:26:57 -08:00