nmerkle commited on
Commit
171e734
·
verified ·
1 Parent(s): 3872a85

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -1,4 +1,5 @@
1
  ---
2
  license: llama3
3
  ---
4
- The Meta-Llama-3-8B-Instruct model quantized with 4 Bits. Tested on Raspberry PI Model 4 with [llama.cpp](https://github.com/ggerganov/llama.cpp).
 
 
1
  ---
2
  license: llama3
3
  ---
4
+ ## Quantized Meta-Llama-3B-Instruct model
5
+ Tested inference on Raspberry PI Model 4 with [llama.cpp](https://github.com/ggerganov/llama.cpp). ~0.5 Tokens per second.