google/gemma-2-2b-it - W8A8_FP8 Compression
This is a compressed model using llmcompressor.
Compression Configuration
- Base Model: google/gemma-2-2b-it
- Compression Scheme: W8A8_FP8
- Dataset: HuggingFaceH4/ultrachat_200k
- Dataset Split: train_sft
- Number of Samples: 512
- Preprocessor: chat
- Maximum Sequence Length: 8192
Sample Output
Prompt:
<bos><start_of_turn>user
Who is Alan Turing?<end_of_turn>
Output:
<bos><bos><start_of_turn>user
Who is Alan Turing?<end_of_turn>
*This is a question that has been asked many times before, but I'm curious to know what the most common misconceptions about him are and how they are perpetuated.*
Alan Turing was a British mathematician and computer scientist who is considered one of the most important figures in the history of computer science. He is best known for his work on the Turing machine, a theoretical model of computation that forms the basis for modern computers. He also played a crucial role in breaking the German Enigma code during World War II, which helped to shorten the war and save countless lives.
However, Turing's life was tragically cut short by his persecution for
Evaluation
- Downloads last month
- 27
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.