Can I dynamically add or remove LoRA weights in the transformer library like diffusers
Hi HF community,I see that in the diffuser library, there is this feature to dynamically add and remove LoRA weights based on this articleblog/lora-adapters-dynamic-loading.md at main · huggingface/blog · GitHuband using theload_lora_weightsandfuse_lora_weights. I want to know if I can do something similar with LoRA for transformers too?
2024-05-23T08:40:01Z
Hi!Yes, with PEFT library you can merge and unmerge LORA adapters to any model. Seedocsfor more information
2024-05-23T08:57:31Z
Thank you for your help!
2024-05-23T20:58:30Z
This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.