PenutChen's picture

PenutChen

penut85420

·

penut85420

AI & ML interests

LLM, Quantization

Recent Activity

commented a paper 5 days ago

Low-Bit Quantization Favors Undertrained LLMs: Scaling Laws for Quantized LLMs with 100T Training Tokens

upvoted a paper 8 days ago

Low-Bit Quantization Favors Undertrained LLMs: Scaling Laws for Quantized LLMs with 100T Training Tokens

liked a model 12 days ago

IamCreateAI/Ruyi-Mini-7B

View all activity

Organizations

penut85420's activity

commented a paper 5 days ago

Low-Bit Quantization Favors Undertrained LLMs: Scaling Laws for Quantized LLMs with 100T Training Tokens

Paper • 2411.17691 • Published Nov 26, 2024 • 10 •

commented a paper about 2 months ago

Balancing Continuous Pre-Training and Instruction Fine-Tuning: Optimizing Instruction-Following in LLMs

Paper • 2410.10739 • Published Oct 14, 2024 • 2 •

New activity in yentinglin/Llama-3-Taiwan-8B-Instruct 3 months ago

請問是有重新訓練過tokenizer嗎?

#9 opened 6 months ago by

commented 2 papers 3 months ago

Instruction Following without Instruction Tuning

Paper • 2409.14254 • Published Sep 21, 2024 • 27 •

A Comprehensive Evaluation of Quantized Instruction-Tuned Large Language Models: An Experimental Analysis up to 405B

Paper • 2409.11055 • Published Sep 17, 2024 • 16 •

commented 2 papers 5 months ago

Transforming LLMs into Cross-modal and Cross-lingual Retrieval Systems

Paper • 2404.01616 • Published Apr 2, 2024 •

LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference

Paper • 2407.14057 • Published Jul 19, 2024 • 45 •

commented 2 papers 6 months ago

In-Context Editing: Learning Knowledge from Self-Induced Distributions

Paper • 2406.11194 • Published Jun 17, 2024 • 15 •

SpreadsheetLLM: Encoding Spreadsheets for Large Language Models

Paper • 2407.09025 • Published Jul 12, 2024 • 130 •

commented 2 papers 7 months ago

In-Context Editing: Learning Knowledge from Self-Induced Distributions

Paper • 2406.11194 • Published Jun 17, 2024 • 15 •

Let's Fuse Step by Step: A Generative Fusion Decoding Algorithm with LLMs for Multi-modal Text Recognition

Paper • 2405.14259 • Published May 23, 2024 • 1 •

New activity in microsoft/Phi-3-vision-128k-instruct 8 months ago

sdpa supported?

#7 opened 8 months ago by

New activity in BUAADreamer/Yi-VL-6B-hf 8 months ago

ValueError: Trying to set a tensor of shape torch.Size([4096]) in "weight" (which has shape torch.Size([4096, 4096])), this look incorrect.

#4 opened 8 months ago by

New activity in HPLT/hplt_monolingual_v1_2 10 months ago

`streaming=True` cause error

#1 opened 10 months ago by

commented a paper 11 months ago

Fast Vocabulary Transfer for Language Model Compression

Paper • 2402.09977 • Published Feb 15, 2024 • 2 •

New activity in princeton-nlp/Sheared-LLaMA-2.7B-ShareGPT about 1 year ago

num_key_value_heads

#1 opened about 1 year ago by

New activity in TheBloke/Falcon-180B-Chat-GPTQ over 1 year ago

Brilliant!

#1 opened over 1 year ago by

New activity in yentinglin/Taiwan-LLaMa2 over 1 year ago

拿鐵跟摩鐵的差別

#2 opened over 1 year ago by