How to freeze parts of T5 model
I know that T5 has K, Q and V vectors in each layer. It also has a feedforward network. I would like to freeze only feedforward layers on each layer of T5. Could you please guide me how can I do this?
2022-02-12T05:33:40Z
I asked the question on StackOverflow and it had an easy answer. It seems people there are more helpful.stackoverflow.comHow to freeze parts of T5 transformer modelhuggingface-transformers, t5-transformeranswered bydennlingeron03:51PM - 10 Feb 22 UTC