text
Updated: Lumimaid and TheSpice-v0.8.3
Updated: Lumimaid and TheSpice-v0.8.3
new_line
new_line
text
I have uploaded version 2 (v2) files for the  Llama-3-Lumimaid-8B-v0.1-OAS GGUF Imatrix quants.
I have uploaded version 2 (v2) files for the  Llama-3-Lumimaid-8B-v0.1-OAS GGUF Imatrix quants.
new_line
new_line
text
[model] 
[model] 
resource
https://huggingface.co/Lewdiculous/Llama-3-Lumimaid-8B-v0.1-OAS-GGUF-IQ-Imatrix
model
Lewdiculous/Llama-3-Lumimaid-8B-v0.1-OAS-GGUF-IQ-Imatrix
https://huggingface.co/Lewdiculous/Llama-3-Lumimaid-8B-v0.1-OAS-GGUF-IQ-Imatrix
new_line
new_line
text
You can recognize the new files by their 
You can recognize the new files by their 
inline_code
`v2`
v2
text
 prefix.
 prefix.
new_line
new_line
text
Imatrix data was generated from the FP16 and conversions directly from the BF16.
Imatrix data was generated from the FP16 and conversions directly from the BF16.
new_line
text
Hopefully avoiding any losses in the model conversion, as has been the recently discussed topic on Llama-3 and GGUF lately.
Hopefully avoiding any losses in the model conversion, as has been the recently discussed topic on Llama-3 and GGUF lately.
new_line
new_line
text
This is more disk and compute intensive so lets hope we get GPU inference support for BF16 models in llama.cpp.
This is more disk and compute intensive so lets hope we get GPU inference support for BF16 models in llama.cpp.
new_line
new_line
text
If you are able to test them and noticed any issues compared to the original quants, let me know in the corresponding discussions.
If you are able to test them and noticed any issues compared to the original quants, let me know in the corresponding discussions.
new_line
new_line
text
---
---
new_line
new_line
text
Additionally, L3-TheSpice-8b-v0.8.3 GGUF Imatrix quants were also updated.
Additionally, L3-TheSpice-8b-v0.8.3 GGUF Imatrix quants were also updated.
new_line
new_line
text
[model] 
[model] 
resource
https://huggingface.co/Lewdiculous/L3-TheSpice-8b-v0.8.3-GGUF-IQ-Imatrix
model
Lewdiculous/L3-TheSpice-8b-v0.8.3-GGUF-IQ-Imatrix
https://huggingface.co/Lewdiculous/L3-TheSpice-8b-v0.8.3-GGUF-IQ-Imatrix
Updated: Lumimaid and TheSpice-v0.8.3

I have uploaded version 2 (v2) files for the  Llama-3-Lumimaid-8B-v0.1-OAS GGUF Imatrix quants.

[model] https://huggingface.co/Lewdiculous/Llama-3-Lumimaid-8B-v0.1-OAS-GGUF-IQ-Imatrix

You can recognize the new files by their `v2` prefix.

Imatrix data was generated from the FP16 and conversions directly from the BF16.
Hopefully avoiding any losses in the model conversion, as has been the recently discussed topic on Llama-3 and GGUF lately.

This is more disk and compute intensive so lets hope we get GPU inference support for BF16 models in llama.cpp.

If you are able to test them and noticed any issues compared to the original quants, let me know in the corresponding discussions.

---

Additionally, L3-TheSpice-8b-v0.8.3 GGUF Imatrix quants were also updated.

[model] https://huggingface.co/Lewdiculous/L3-TheSpice-8b-v0.8.3-GGUF-IQ-Imatrix
❤️
TravelingMan tasmani Herman555 FantasiaFoundry Ardvark123 Ramikan-BR Forgiwen
🚀
FantasiaFoundry TravelingMan tasmani Ardvark123 Ramikan-BR
👍
Herman555 Ardvark123 Ramikan-BR
🔥
AlekseiPravdin Ramikan-BR drt14
👀
Ramikan-BR
https://cdn-avatars.huggingface.co/v1/production/uploads/63e80664e02ee67e8e570ec4/rGfRhywmjd_lbqfYzOEdd.png
EsKa
SerialKicked
user
https://cdn-avatars.huggingface.co/v1/production/uploads/64c072297255ff868721c57f/pyKz4cz5WM4Z6mfRBG08z.jpeg
Yamam
Herman555
user
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/HOCJv7WE2C4eqqqppDFpA.png
Lewdiculous (AetherArchitectural)
Lewdiculous
user
https://cdn-avatars.huggingface.co/v1/production/uploads/65f115216c162dbd552fb41d/-hfb5OFTL5Ex4lJziSgxg.png
Ardvark-san
Ardvark123
user