This model is copied from https://huggingface.co/yuhuili/EAGLE-llama2-chat-7B with the following modifications to make it compatible with SGLang: | |
- Modify the architecture in config.json to LlamaForCausalLMEagle |
This model is copied from https://huggingface.co/yuhuili/EAGLE-llama2-chat-7B with the following modifications to make it compatible with SGLang: | |
- Modify the architecture in config.json to LlamaForCausalLMEagle |