ollama

pali112/ollama

Fork 0

Commit Graph

Author	SHA1	Message	Date
Patrick Devine	2717dce6fe	convert: convert bf16 vision weights to fp16 (#12324 ) This change moves back to converting bf16 vision weights to fp16, specifically if they start with the name "v." (such as v.blk.0.attn_k.weight). This fixes a bug where converted images are failing because they are trying to call `im2col` which doesn't have a bf16 kernel in ggml.	2025-09-17 17:43:17 -07:00
Michael Yang	ef7d26ba2c	convert: skip reading into memory when possible (#11507 ) if there's no transformation to the tensor and the input and output types match, copy directly into the writer. also read from a bufio with a 32K buffer	2025-08-14 15:03:57 -07:00

Author

SHA1

Message

Date

Patrick Devine

2717dce6fe

convert: convert bf16 vision weights to fp16 (#12324 )

This change moves back to converting bf16 vision weights to fp16,
specifically if they start with the name "v." (such as v.blk.0.attn_k.weight).

This fixes a bug where converted images are failing because they are trying
to call `im2col` which doesn't have a bf16 kernel in ggml.

2025-09-17 17:43:17 -07:00

Michael Yang

ef7d26ba2c

convert: skip reading into memory when possible (#11507 )

if there's no transformation to the tensor and the input and output
types match, copy directly into the writer. also read from a bufio with
a 32K buffer

2025-08-14 15:03:57 -07:00

2 Commits