geniacllm
/

ja-en-tokenizer-unigram-v5

Model card Files Files and versions Community

ja-en-tokenizer-unigram-v5 / tokenizer_config.json

Commit History

Update tokenizer_config.json

699b37d
verified

miya-99999 commited on Apr 29, 2024

Upload 3 files

17a122a
verified

miya-99999 commited on Apr 27, 2024