File size: 387 Bytes
00458c4
cd37e4d
 
 
 
 
 
0579b6a
cd37e4d
 
 
00458c4
 
cd37e4d
00458c4
cd37e4d
1933ce8
00458c4
cd37e4d
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
---
base_model:
- ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16
tags:
- text-generation-inference
- transformers
- LLama-70B
license: llama3.1
language:
- en
pipeline_tag: text-generation
---

# Uploaded  model

- **Developed by:** NextG lab@ NC State
- **License:** llama3.1

Note: This only contains the LoRA adapter and the Tokenizer obtained by leveraging QLoRA with AQLM