Update README.md
Browse files
README.md
CHANGED
@@ -1,4 +1,5 @@
|
|
1 |
---
|
2 |
license: llama3
|
3 |
---
|
4 |
-
|
|
|
|
1 |
---
|
2 |
license: llama3
|
3 |
---
|
4 |
+
## Quantized Meta-Llama-3B-Instruct model
|
5 |
+
Tested inference on Raspberry PI Model 4 with [llama.cpp](https://github.com/ggerganov/llama.cpp). ~0.5 Tokens per second.
|