GPT2vi_vi_cnn / added_tokens.json
tiennlu's picture
Upload tokenizer
fab46f7 verified
raw
history blame contribute delete
47 Bytes
{
"<|endoftext|>": 50257,
"[PAD]": 50258
}