xmen-nl-ce-medmentions / added_tokens.json
phlobo's picture
add tokenizer
067e517
raw
history blame contribute delete
90 Bytes
{"[START]": 250002, "[END]": 250003, "[NIL]": 250005, "[TYPE]": 250006, "[TITLE]": 250004}