text
Did some little experimentation to resize pre-trained LoRAs on Flux. I explored two themes:
Did some little experimentation to resize pre-trained LoRAs on Flux. I explored two themes:
new_line
new_line
text
* Decrease the rank of a LoRA
* Decrease the rank of a LoRA
new_line
text
* Increase the rank of a LoRA
* Increase the rank of a LoRA
new_line
new_line
text
The first one is helpful in reducing memory requirements if the LoRA is of a high rank, while the second one is merely an experiment. Another implication of this study is in the unification of LoRA ranks when you would like to 
The first one is helpful in reducing memory requirements if the LoRA is of a high rank, while the second one is merely an experiment. Another implication of this study is in the unification of LoRA ranks when you would like to 
inline_code
`torch.compile()`
torch.compile()
text
 them. 
 them. 
new_line
new_line
text
Check it out here: 
Check it out here: 
new_line
resource
https://huggingface.co/sayakpaul/flux-lora-resizing
model
sayakpaul/flux-lora-resizing
https://huggingface.co/sayakpaul/flux-lora-resizing
Did some little experimentation to resize pre-trained LoRAs on Flux. I explored two themes:

* Decrease the rank of a LoRA
* Increase the rank of a LoRA

The first one is helpful in reducing memory requirements if the LoRA is of a high rank, while the second one is merely an experiment. Another implication of this study is in the unification of LoRA ranks when you would like to `torch.compile()` them. 

Check it out here: 
https://huggingface.co/sayakpaul/flux-lora-resizing
🚀
John6666 YaTharThShaRma999 AtAndDev Joseph717171 Svngoku
🔥
John6666 YaTharThShaRma999 AtAndDev Joseph717171
👍
John6666 AtAndDev Joseph717171 louisbrulenaudet
❤️
John6666 AtAndDev Joseph717171
https://cdn-avatars.huggingface.co/v1/production/uploads/6640bbd0220cfa8cbfdce080/wiAHUu5ewawyipNs0YFBR.png
John Smith
John6666
user