|
--- |
|
license: llama3.2 |
|
tags: |
|
- llama3.2 |
|
- llama3.2-3B |
|
- rkllm |
|
- rockchip |
|
- rk3588 |
|
--- |
|
# Llama 3.2 3B for RK3588 |
|
This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-3B to the RKLLM format for Rockchip devices. |
|
Target conversion to be running on the RK3588 NPU. |
|
|
|
**RKLLM runtime 1.1.1** requires **NPU driver 0.9.6**: |
|
- [w8a8](https://huggingface.co/macrae/Llama-3-2-3B-rk3588/tree/w8a8-toolkitv1.1.1) |
|
- [w8a8_g512](https://huggingface.co/macrae/Llama-3-2-3B-rk3588/tree/w8a8_g512-toolkitv1.1.1) |
|
|
|
**RKLLM runtime 1.1.4** requires **NPU driver 0.9.8**: |
|
- [w8a8](https://huggingface.co/macrae/Llama-3-2-3B-rk3588/tree/w8a8-toolkitv1.1.4) |
|
- [w8a8_g512](https://huggingface.co/macrae/Llama-3-2-3B-rk3588//tree/w8a8_g512-toolkitv1.1.4) |
|
|
|
|
|
|
|
# License |
|
Same as the original LLM: |
|
|
|
https://huggingface.co/meta-llama/Meta-Llama-3.2-3B/blob/main/LICENSE.txt |
