How to create distil-opt/bloom
Any help to perform knowledge distillation on bloom model?The script available on huggingface doesn’t support bloom architecture.github.comtransformers/examples/research_projects/distillation at main ·...main/examples/research_projects/distillation🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX. - transformers/examples/research_projects/distillation at main · huggingface/transformers@ybelkada