The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Paper
•
2402.17764
•
Published
•
605
•
142
ct2
ct-2
AI & ML interests
None yet
Organizations
None yet
ct-2's activity
add example for 4bit inference?
4
#11 opened 4 months ago
by
ct-2
commented
a
paper
6 months ago
llama.cpp support?
1
#6 opened 9 months ago
by
ct-2
layer combinations in gguf
#3 opened 11 months ago
by
ct-2
Adding `safetensors` variant of this model
#4 opened over 1 year ago
by
ct-2
Adding `safetensors` variant of this model
2
#4 opened over 1 year ago
by
ct-2
I have much trouble converting 70B models
#1 opened over 1 year ago
by
ct-2
Adding `safetensors` variant of this model
1
#1 opened over 1 year ago
by
ct-2
additional non k-quants req
#7 opened over 1 year ago
by
ct-2
How to use splits, 7z needed?
2
#1 opened over 1 year ago
by
ct-2
How to use splits, 7z needed?
2
#1 opened over 1 year ago
by
ct-2