File size: 1,376 Bytes
e110e22 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 |
---
datasets:
- HuggingFaceH4/ultrachat_200k
base_model:
- google/gemma-2b-it
library_name: transformers
---
## google/gemma-2b-it - W4A16 Compression
This is a compressed model using [llmcompressor](https://github.com/vllm-project/llm-compressor).
## Compression Configuration
- Base Model: google/gemma-2b-it
- Compression Scheme: W4A16
- Dataset: HuggingFaceH4/ultrachat_200k
- Dataset Split: train_sft
- Number of Samples: 512
- Preprocessor: chat
- Maximum Sequence Length: 8192
## Sample Output
#### Prompt:
```
<bos><start_of_turn>user
Who is Alan Turing?<end_of_turn>
```
#### Output:
```
<bos><bos><start_of_turn>user
Who is Alan Turing?<end_of_turn>
Alan Turing was a British mathematician and computer scientist who made significant contributions to the fields of mathematics, computer science, and physics. He is considered one of the pioneers of computer science and a major figure in the history of artificial intelligence.
**Key Contributions:**
* **Coined the term "computer science"**: Turing was one of the first to use the term in a modern sense to refer to the study of the theoretical and practical principles of computation.
* **Developed the Turing machine**: This is a theoretical model of computation that is considered to be the most powerful known model of computation.
* **Pioneered research in artificial
```
## Evaluation
<TODO>
|