text
In regards to the latest mistral model and GGUFs for it:
In regards to the latest mistral model and GGUFs for it:
new_line
new_line
text
Yes, they may be subpar and may require changes to llama.cpp to support the interleaved sliding window
Yes, they may be subpar and may require changes to llama.cpp to support the interleaved sliding window
new_line
new_line
text
Yes, I got excited when a conversion worked and released them ASAP
Yes, I got excited when a conversion worked and released them ASAP
new_line
new_line
text
That said, generation seems to work right now and seems to mimic the output from spaces that are running the original model
That said, generation seems to work right now and seems to mimic the output from spaces that are running the original model
new_line
new_line
text
I have appended -TEST to the model names in an attempt to indicate that they are not final or perfect, but if people still feel mislead and that it's not the right thing to do, please post (civilly) below your thoughts, I will highly consider pulling the conversions if that's what people think is best. After all, that's what I'm here for, in service to you all !
I have appended -TEST to the model names in an attempt to indicate that they are not final or perfect, but if people still feel mislead and that it's not the right thing to do, please post (civilly) below your thoughts, I will highly consider pulling the conversions if that's what people think is best. After all, that's what I'm here for, in service to you all !
In regards to the latest mistral model and GGUFs for it:

Yes, they may be subpar and may require changes to llama.cpp to support the interleaved sliding window

Yes, I got excited when a conversion worked and released them ASAP

That said, generation seems to work right now and seems to mimic the output from spaces that are running the original model

I have appended -TEST to the model names in an attempt to indicate that they are not final or perfect, but if people still feel mislead and that it's not the right thing to do, please post (civilly) below your thoughts, I will highly consider pulling the conversions if that's what people think is best. After all, that's what I'm here for, in service to you all !
❤️
YaTharThShaRma999 johnnyc3p John6666 SporkySporkness Delta-Vector Firepal3D vonjack driib vsenn G30 bruceunx victor aziztbz Maxxim69 pierpaolo
🔥
awacke1 John6666 Delta-Vector GoDjMike G30
👍
Yuma42
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/fOsPIFqHjBq3gsx3_6lHd.png
Chad Canning
fusi0n
user
https://cdn-avatars.huggingface.co/v1/production/uploads/66c26b6fb01b19d8c3c2467b/HIcQYcU6rOilwbuRCRStm.jpeg
DV
Delta-Vector
user
https://cdn-avatars.huggingface.co/v1/production/uploads/6435718aaaef013d1aec3b8b/XKf-8MA47tjVAM6SCX0MP.jpeg
Bartowski
bartowski
user
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/iB4Kdg31amSkGhSik6fv2.jpeg
Jörmungandr
Midgardsormr
user
/avatars/c53d7b7ee7bf757dea5f847e62ea96b9.svg
Ding Dong
xxx31dingdong
user
/avatars/c7e4979f04fda14b73a43c398ce7da27.svg
Nurb4000
Nurb4000
user