Fix BOS (should be added by the tokenizer). Fix EOS (in config.json -> must be <|eot_id|>). Remove spaces that were aded after special tags (so that round-trip tests can pass and some bugs avoided when inferring with the model). More complete generation_config.json
e7e496d
| { | |
| "bos_token_id": 0, | |
| "eos_token_id": 267, | |
| "pad_token_id": 3, | |
| "max_length": 32000, | |
| "do_sample": true, | |
| "temperature": 0.6, | |
| "transformers_version": "4.46.3" | |
| } |