unsloth

/

DeepSeek-V3-GGUF

like 84

Follow

Unsloth AI 1.41k

I used command llama-gguf-split --merge DeepSeek-V3-Q2_K_XS-00001-of-00005.gguf DeepSeek-V3-Q2_K_XS.gguf to merge 5 gguf models in DeepSeek-V3-Q2_K_XS and I finally got this error:

gguf_merge: writing tensors DeepSeek-V3-Q2_K_XS-00001-of-00005.gguf ...terminate called after throwing an instance of 'std::__ios_failure'
  what():  basic_ios::clear: iostream error
Aborted (core dumped)

Is there any solution to this? Thx :D