text
New update to mlx-rag-gguf: 
New update to mlx-rag-gguf: 
new_line
text
- mlx supported phi-3-mini-4k gguf  weight.
- mlx supported phi-3-mini-4k gguf  weight.
new_line
text
- support for other gguf weights (llama arch) 4 & 8 bits quantized.
- support for other gguf weights (llama arch) 4 & 8 bits quantized.
new_line
text
repo: 
repo: 
link
https://github.com/Jaykef/mlx-rag-gguf
https://github.com/Jaykef/mlx-rag-gguf
new_line
text
model 
model 
resource
https://huggingface.co/Jaward/phi-3-mini-4k-instruct.Q4_0.gguf
model
Jaward/phi-3-mini-4k-instruct.Q4_0.gguf
https://huggingface.co/Jaward/phi-3-mini-4k-instruct.Q4_0.gguf
New update to mlx-rag-gguf: 
- mlx supported phi-3-mini-4k gguf  weight.
- support for other gguf weights (llama arch) 4 & 8 bits quantized.
repo: https://github.com/Jaykef/mlx-rag-gguf
model https://huggingface.co/Jaward/phi-3-mini-4k-instruct.Q4_0.gguf
🔥
lunarflu victor dillfrescott
https://cdn-avatars.huggingface.co/v1/production/uploads/6438a9027de34e8ea7e4b257/vib8QSd1AWMr_bR9ig_xJ.jpeg
Jaward Sesay
Jaward
user