pali112
/
ollama
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
ollama/model
History
Michael Yang 333e360422
model: handle multiple eos tokens (#10577) 
* get eos_token_id from generation_config.json

* refactor

* include both ids and strings in trace

* comments

* remove special case for gemma3 special vocab (#10743)
 		2025-05-16 13:40:23 -07:00
..
imageproc imageproc mllama refactor (#7537) 2024-12-14 19:50:15 -08:00
input ollamarunner: Separate text and multimodal graphs 2025-05-15 13:46:20 -07:00
models model: handle multiple eos tokens (#10577) 2025-05-16 13:40:23 -07:00
testdata gemma2 impl 2025-03-11 14:35:08 -07:00
bytepairencoding.go model: handle multiple eos tokens (#10577) 2025-05-16 13:40:23 -07:00
bytepairencoding_test.go model: handle multiple eos tokens (#10577) 2025-05-16 13:40:23 -07:00
model.go ollamarunner: Separate text and multimodal graphs 2025-05-15 13:46:20 -07:00
model_test.go fs: move ml.Config to fs package 2025-04-03 13:12:24 -07:00
sentencepiece.go model: handle multiple eos tokens (#10577) 2025-05-16 13:40:23 -07:00
sentencepiece_test.go model: handle multiple eos tokens (#10577) 2025-05-16 13:40:23 -07:00
textprocessor.go model: handle multiple eos tokens (#10577) 2025-05-16 13:40:23 -07:00
vocabulary.go model: handle multiple eos tokens (#10577) 2025-05-16 13:40:23 -07:00