Pere Martra

oopere's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

updated a collection 8 days ago

Llama 3.2 mlp pruned

Collection

Created by pruning the MLP (feedforward) layers, reducing the size of Llama models while improving their performance. • 7 items • Updated 8 days ago

updated 7 models 8 days ago

oopere/pruned10-llama-3.2-3B

Text Generation • Updated 8 days ago • 15

oopere/pruned60-llama-3.2-3b

Text Generation • Updated 8 days ago • 40

oopere/pruned20-llama-3.2-3b

Text Generation • Updated 8 days ago • 27

oopere/pruned40-llama-3.2-3b

Text Generation • Updated 8 days ago • 35

oopere/pruned60-llama-3.2-1B

Text Generation • Updated 8 days ago • 33

oopere/pruned40-llama-3.2-1B

Text Generation • Updated 8 days ago • 36

oopere/pruned20-llama-3.2-1B

Text Generation • Updated 8 days ago • 49

updated a collection 13 days ago

Llama 3.2 mlp pruned

Collection

Created by pruning the MLP (feedforward) layers, reducing the size of Llama models while improving their performance. • 7 items • Updated 8 days ago

liked a Space 20 days ago

Running on CPU Upgrade

12.1k

🏆

Open LLM Leaderboard

Track, rank and evaluate open LLMs and chatbots

updated a collection 22 days ago

Llama 3.2 mlp pruned

Collection

Created by pruning the MLP (feedforward) layers, reducing the size of Llama models while improving their performance. • 7 items • Updated 8 days ago

upvoted an article 26 days ago

view article

Article

Making LLMs Smaller Without Breaking Them: A GLU-Aware Pruning Approach

By •

Nov 24, 2024

• 1

updated a collection about 1 month ago

Llama 3.2 mlp pruned

Collection

Created by pruning the MLP (feedforward) layers, reducing the size of Llama models while improving their performance. • 7 items • Updated 8 days ago

updated a model about 2 months ago

oopere/pruned40-gemma-2-2b

Text Generation • Updated Nov 17, 2024 • 18

liked a model 2 months ago

nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Text Generation • Updated Oct 25, 2024 • 258k • 1.95k

upvoted a paper 2 months ago

Shortened LLaMA: A Simple Depth Pruning for Large Language Models

Paper • 2402.02834 • Published Feb 5, 2024 • 14

liked a dataset 3 months ago

oopere/knowledge_transfer_1500_base

Viewer • Updated Sep 21, 2024 • 1.27k • 38 • 1

updated a dataset 3 months ago

oopere/knowledge_transfer_1500_base

Viewer • Updated Sep 21, 2024 • 1.27k • 38 • 1