KoreanLM-3B / added_tokens.json
quantumaikr's picture
Upload tokenizer
3a43d5c
raw
history blame contribute delete
29 Bytes
{
"<|endoftext|>": 32000
}