Lucie-7B-Instruct / tokenizer.json

Fix BOS (should be added by the tokenizer). Fix EOS (in config.json -> must be <|eot_id|>). Remove spaces that were aded after special tags (so that round-trip tests can pass and some bugs avoided when inferring with the model). More complete generation_config.json

e7e496d 9 days ago

raw

history contribute delete

2.82 MB

File too large to display, you can check the raw version instead.