EoRA: Training-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation
Paper
•
2410.21271
•
Published
•
6
•
2
Min-Hung Chen
cmhungsteve
AI & ML interests
Multimodal AI, Transfer Learning, Unsupervised Learning, Video Understanding, Vision Transformer, Computer Vision, Deep Learning
Recent Activity
upvoted
a
paper
about 1 month ago
Hymba: A Hybrid-head Architecture for Small Language Models
authored
a paper
about 1 month ago
Hymba: A Hybrid-head Architecture for Small Language Models
liked
a model
about 2 months ago
sliuau/DoRA-weights
Organizations
cmhungsteve's activity
commented
a
paper
2 months ago
commented
a
paper
8 months ago