text
You can now use DoRA for your embedding layers!
You can now use DoRA for your embedding layers!
new_line
new_line
text
PR: 
PR: 
link
https://github.com/huggingface/peft/pull/2006
https://github.com/huggingface/peft/pull/2006
new_line
new_line
text
I have documented my journey of this specific PR in a blog post for everyone to read. The highlight of the PR was when the first author of DoRA reviewed my code.
I have documented my journey of this specific PR in a blog post for everyone to read. The highlight of the PR was when the first author of DoRA reviewed my code.
new_line
new_line
text
Blog Post: 
Blog Post: 
link
https://huggingface.co/blog/ariG23498/peft-dora
https://huggingface.co/blog/ariG23498/peft-dora
new_line
new_line
text
Huge thanks to 
Huge thanks to 
mention
@BenjaminB
BenjaminB
text
 for all the help I needed.
 for all the help I needed.
You can now use DoRA for your embedding layers!

PR: https://github.com/huggingface/peft/pull/2006

I have documented my journey of this specific PR in a blog post for everyone to read. The highlight of the PR was when the first author of DoRA reviewed my code.

Blog Post: https://huggingface.co/blog/ariG23498/peft-dora

Huge thanks to @BenjaminB for all the help I needed.
🔥
YaTharThShaRma999 John6666 OzzyGT OxxoCodes khanhduong241218 osanseviero misba-code