text
A while ago, I presented this Phi2 DPO fine-tune notebook with LoRa. Got some input from 
A while ago, I presented this Phi2 DPO fine-tune notebook with LoRa. Got some input from 
mention
@ybelkada
ybelkada
text
  about not needing a 
  about not needing a 
inline_code
`ref_model`
ref_model
text
 because we can just swap out the LoRa adapters during training. Cool feature 🤓
 because we can just swap out the LoRa adapters during training. Cool feature 🤓
new_line
new_line
link
https://colab.research.google.com/drive/1PGMj7jlkJaCiSNNihA2NtpILsRgkRXrJ#scrollTo=wXqoH2TMnjjp
https://colab.research.google.com/drive/1PGMj7jlkJaCiSNNihA2NtpILsRgkRXrJ#scrollTo=wXqoH2TMnjjp
new_line
new_line
A while ago, I presented this Phi2 DPO fine-tune notebook with LoRa. Got some input from @ybelkada  about not needing a `ref_model` because we can just swap out the LoRa adapters during training. Cool feature 🤓

https://colab.research.google.com/drive/1PGMj7jlkJaCiSNNihA2NtpILsRgkRXrJ#scrollTo=wXqoH2TMnjjp


❤️
merve samusenps ybelkada alielfilali01 sumandas compressionsavant wise-east
🤝
ybelkada Stopwolf
https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png
Younes Belkada
ybelkada
user
https://cdn-avatars.huggingface.co/v1/production/uploads/626237d9bbcbd1c34f1bb231/EJrOjvAL-68qMCYdnvOrq.png
Ali El Filali
alielfilali01
user
https://cdn-avatars.huggingface.co/v1/production/uploads/1677141720071-634ff41ff32062e9eb7b06a3.jpeg
David Berenstein
davidberenstein1957
user
/avatars/33ce42f3e6fef18ecbf29ef2dde8d457.svg
Justin Cho
wise-east
user