Llama 3.2 3B for RK3588

This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-3B to the RKLLM format for Rockchip devices. Target conversion to be running on the RK3588 NPU.

RKLLM runtime 1.1.1 requires NPU driver 0.9.6:

RKLLM runtime 1.1.4 requires NPU driver 0.9.8:

License

Same as the original LLM:

https://huggingface.co/meta-llama/Meta-Llama-3.2-3B/blob/main/LICENSE.txt

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model's library. Check the docs .