Text Generation
PyTorch
English
llama
t1101675 commited on
Commit
7c6dfe4
·
verified ·
1 Parent(s): ff75ec7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -12,7 +12,7 @@ pipeline_tag: text-generation
12
 
13
  [paper](https://arxiv.org/abs/2306.08543) | [code](https://github.com/microsoft/LMOps/tree/main/minillm)
14
 
15
- **SeqKD-Llama-7B** is an Llama-7B model distilled from [Llama-13B](https://huggingface.co/MiniLLM/teacher-Llama-13B) on [databricks-dolly-15k](https://huggingface.co/datasets/aisquared/databricks-dolly-15k) with sequence-level forward KLD.
16
 
17
  It is used as a baseline for [MiniLLM](https://huggingface.co/MiniLLM/MiniLLM-Llama-7B).
18
 
 
12
 
13
  [paper](https://arxiv.org/abs/2306.08543) | [code](https://github.com/microsoft/LMOps/tree/main/minillm)
14
 
15
+ **SeqKD-Llama-7B** is a Llama-7B model distilled from [Llama-13B](https://huggingface.co/MiniLLM/teacher-Llama-13B) on [databricks-dolly-15k](https://huggingface.co/datasets/aisquared/databricks-dolly-15k) with sequence-level forward KLD.
16
 
17
  It is used as a baseline for [MiniLLM](https://huggingface.co/MiniLLM/MiniLLM-Llama-7B).
18