gpustack

/

jina-reranker-v2-base-multilingual-GGUF

like 3

I am getting the following error when trying to load this model using llama.cpp:

llama_model_load: error loading model: missing tensor 'blk.0.attn_q.weight'
llama_model_load_from_file: failed to load model
[ERROR] [llama.cpp:Llama:53] Unable to load model
common_init_from_params: failed to load model '/home/miguel/.cache/huggingface/hub/models--gpustack--jina-reranker-v2-base-multilingual-GGUF/snapshots/2862667d76c1191b5177d5fc387c63e75b3b2fd2/jina-reranker-v2-base-multilingual-FP16.gguf'