2 Commits

Author	SHA1	Message	Date
Michael Yang	440a3823a6	fix(tokenizer): add special tokens to empty inputs (#13091)	2025-11-18 11:16:56 -08:00
Jeffrey Morgan	9e125d884c	model: treat 'user defined' tokens as special tokens (#11077)	2025-06-16 16:03:16 -07:00