pali112
/
ollama
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
ollama/model
History
Jesse Gross b70fc4d51e model: Don't unconditionally add special tokens 
We sometimes tokenize partial strings. For example, with
multimodal inputs, we split the input string around the images
and then tokenize each piece. In these cases, we should only add
the special tokens on the first piece.
 		2025-03-06 16:54:16 -08:00
..
imageproc imageproc mllama refactor (#7537) 2024-12-14 19:50:15 -08:00
models New engine: vision models and auto-fallback (#9113) 2025-03-04 09:03:46 -08:00
testdata next ollama runner (#7913) 2025-02-13 16:31:21 -08:00
model.go New engine: vision models and auto-fallback (#9113) 2025-03-04 09:03:46 -08:00
model_test.go New engine: vision models and auto-fallback (#9113) 2025-03-04 09:03:46 -08:00
process_text.go model: Don't unconditionally add special tokens 2025-03-06 16:54:16 -08:00
process_text_test.go model: Don't unconditionally add special tokens 2025-03-06 16:54:16 -08:00