text
Repo with scripts to create your own moe models using Apple mlx is constantly updated by 
Repo with scripts to create your own moe models using Apple mlx is constantly updated by 
mention
@mzbac
mzbac
text
 here: 
 here: 
link
https://github.com/mzbac/mlx-moe
https://github.com/mzbac/mlx-moe
new_line
new_line
text
It's an amazing resource to learn inner workings of lora on moe with mlx. 
It's an amazing resource to learn inner workings of lora on moe with mlx. 
new_line
text
It uses 
It uses 
link
https://huggingface.co/datasets/WizardLM/WizardLM_evol_instruct_70k
https://huggingface.co/datasets/WizardLM/WizardLM_evol_instruct_70k
text
 as default dataset, but can be easily tweak to use any model or dataset fro HF
 as default dataset, but can be easily tweak to use any model or dataset fro HF
new_line
new_line
text
Have fun with it!
Have fun with it!
Repo with scripts to create your own moe models using Apple mlx is constantly updated by @mzbac here: https://github.com/mzbac/mlx-moe

It's an amazing resource to learn inner workings of lora on moe with mlx. 
It uses https://huggingface.co/datasets/WizardLM/WizardLM_evol_instruct_70k as default dataset, but can be easily tweak to use any model or dataset fro HF

Have fun with it!
👍
Pavarissy osanseviero awni NeuralNovel clem merve sugatoray
🤝
samusenps osanseviero awni merve
https://cdn-avatars.huggingface.co/v1/production/uploads/1648113222875-6141a88b3a0ec78603c9e784.png
Merve Noyan
merve
user