File size: 1,458 Bytes
dfe07f4 989fe16 dfe07f4 989fe16 dfe07f4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 |
---
datasets:
- HuggingFaceH4/ultrachat_200k
base_model:
- google/gemma-2-2b
library_name: transformers, deltazip
---
## google/gemma-2-2b - 2b_2n4m_128bs Compression
This is a compressed model using [deltazip](https://github.com/eth-easl/deltazip).
[Paper](https://arxiv.org/abs/2312.05215), [Compression Tool](https://github.com/eth-easl/deltazip), [Inference Engine (Soon)](https://github.com/eth-easl/deltazip).
## Compression Configuration
- Base Model: google/gemma-2-2b
- Compression Scheme: 2b_2n4m_128bs
- Dataset: HuggingFaceH4/ultrachat_200k
- Dataset Split: train_sft
- Max Sequence Length: 2048
- Number of Samples: 256
## Sample Output
#### Prompt:
```
[{'role': 'user', 'content': 'Who is Alan Turing?'}]
```
#### Output:
```
<bos><start_of_turn>user
Who is Alan Turing?<end_of_turn>
*This is a question about a historical figure, Alan Turing.*
Alan Turing (1912-1954) was a British mathematician and computer scientist who is considered one of the most important figures in the history of computing. He made significant contributions to theoretical computer science, artificial intelligence, and cryptography.
**Key Contributions:**
* **Turing Machine:** Turing developed the theoretical model of a universal machine, known as the Turing machine, which is a fundamental concept in computer science. This machine can simulate any other Turing machine, demonstrating the universality of computation.
```
## Evaluation
<TODO>
|