RITA_xl / tokenizer_config.json

add tokenizer

d4ba49b almost 3 years ago

167 Bytes

{"special_tokens_map_file": "Seledorn/RITA_tokenizer/special_tokens_map.json", "name_or_path": "Seledorn/RITA_tokenizer", "tokenizer_class": "PreTrainedTokenizerFast"}