How to reinit attention head
hi , i would like to reinit some specified head like L=10, H=3, how can i do that?thx
2020-07-15T21:09:41Z
It depends on your model for the exact code, and the framework you want to use (PyTorch or TensorFlow) so more details would help us help youIn general, you can access the layers as attributes of your model, so by picking the right layer through them, you should be able to reinit it.