Is it possible to add L1-regularization in Huggingface Trainer?
I want to add L1-regularization on some weights in the transformer using theTrainer.Is it possible to do so ? Or would I have to mess with deeper layers of the api call ?
2024-09-11T06:46:18Z
Yes, you can overwrite the Trainer:Finetuning BART using custom loss - #2 by lewtun
2024-09-24T19:45:00Z
This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.