Grass: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients
Paper
•
2406.17660
•
Published
•
5
Artem
kabachuha
AI & ML interests
deep learning, natural language processing, text2image, text2video, computer vision, fusion power
Recent Activity
liked
a model
14 days ago
FoundationVision/Infinity
Organizations
kabachuha's activity
upvoted
a
paper
6 months ago
upvoted
4
papers
7 months ago
An Image is Worth 32 Tokens for Reconstruction and Generation
Paper
•
2406.07550
•
Published
•
57
Make It Count: Text-to-Image Generation with an Accurate Number of Objects
Paper
•
2406.10210
•
Published
•
77
Reducing Transformer Key-Value Cache Size with Cross-Layer Attention
Paper
•
2405.12981
•
Published
•
28
Autoregressive Model Beats Diffusion: Llama for Scalable Image Generation
Paper
•
2406.06525
•
Published
•
66