Junxiong Wang

JunxiongWang's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

updated a dataset 4 days ago

JunxiongWang/model_revision_max_4_closest_and_random

Viewer • Updated 4 days ago • 170k • 20

updated a collection 11 days ago

Mamba-In-Zephyr

Collection

Mamba distilled from Zephyr. The Mamba in the Llama: Distilling and Accelerating Hybrid Models (https://arxiv.org/abs/2408.15237). • 7 items • Updated 11 days ago

updated a model 12 days ago

JunxiongWang/mamba_0_5_distill

Updated 12 days ago • 10

updated 3 models about 2 months ago

JunxiongWang/Llama3.2-Mamba-3B-dpo

Updated Nov 17, 2024 • 9

JunxiongWang/Llama3.2-Mamba-3B-distill

Updated Nov 17, 2024 • 56

JunxiongWang/Llama3.2-Mamba2-3B-distill

Updated Nov 17, 2024 • 156

updated a collection about 2 months ago

Mamba2InLlama3.2-3B

Collection

Mamba distilled from Llama3.2 3B Instruct. The Mamba in the Llama: Distilling and Accelerating Hybrid Models (https://arxiv.org/abs/2408.15237). • 4 items • Updated Nov 17, 2024

updated a model about 2 months ago

JunxiongWang/Llama3.2-Mamba2-3B-dpo

Updated Nov 17, 2024 • 16

updated 2 collections about 2 months ago

MambaInLlama-dpo

Collection

Directly distill from Llama, the finetune in DPO • 4 items • Updated Nov 17, 2024

MambaInLlama-distill

Collection

Directly distill from Llama without doing SFT and DPO • 4 items • Updated Nov 17, 2024

updated 4 models about 2 months ago

JunxiongWang/Llama3.1-Mamba2-8B-dpo

Updated Nov 17, 2024 • 2

JunxiongWang/Llama3.1-Mamba-8B-dpo

Updated Nov 17, 2024 • 5

JunxiongWang/Llama3.1-Mamba2-8B-distill

Updated Nov 17, 2024 • 12

JunxiongWang/Llama3.1-Mamba-8B-distill

Updated Nov 17, 2024 • 10

updated a collection about 2 months ago

MambaInLlama-distill

Collection

Directly distill from Llama without doing SFT and DPO • 4 items • Updated Nov 17, 2024