Yucheng

liyucheng

AI & ML interests

Robust LLMs Evaluation and Efficient LLMs Inference.

Articles

Organizations

University of Surrey NLP Group's profile picture Creative Language ToolKit's profile picture RealTimeData's profile picture LatestEval's profile picture Social Post Explorers's profile picture MInference's profile picture Story's profile picture

liyucheng's activity

upvoted an article 6 months ago
view article
Article

MInference 1.0: 10x Faster Million Context Inference with a Single GPU

By liyucheng
12
upvoted an article 6 months ago
view article
Article

Unlocking Longer Generation with Key-Value Cache Quantization

37
upvoted 2 articles 8 months ago
view article
Article

Mixture of Experts Explained

240