metadata
base_model:
- ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16
tags:
- text-generation-inference
- transformers
- LLama-70B
license: llama3.1
language:
- en
pipeline_tag: text-generation
Uploaded model
- Developed by: NextG lab@ NC State
- License: llama3.1
Note: This only contains the LoRA adapter and the Tokenizer obtained by leveraging QLoRA with AQLM