orel lavie

orel12's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in answerdotai/ModernBERT-base about 1 month ago

How to see which version of Transformers library is needed to get access to this model

16

#3 opened about 1 month ago by

aero-artem

New activity in jarrelscy/Mixtral-8x22B-Instruct-v0.1-GPTQ-4bit 9 months ago

I am running in vllm 0.4.1 with 4 x gpus 24gb (A10G 24gb) = 96gb and eager mode and I am still out of memory, how? it should fit (like 87gb vram)

1

#3 opened 9 months ago by

orel12

KeyError: 'model.layers.45.block_sparse_moe.gate.g_idx'

5

#2 opened 9 months ago by

tutu329

updated a model over 1 year ago

orel12/ggml-gpt4all-j-v1.3-groovy

Updated May 10, 2023 • 16