[Nov 16th Event] Lewis Tunstall: Simple Training with the 🤗 Transformers Trainer
Use this topic to ask your questions to Lewis Tunstall during his talk:Simple Training with theTransformers TrainerYou can watch it onYouTubeor onTwitchat 8am PSTLink to Notebook
2021-11-16T16:15:05Z
Is it possible to share the link to the notebook Lewis is working on here?
2021-11-16T16:18:38Z
You suggest changing bert-base for MiniLM as baseline pre-trained model. Is there an analogous recommendation for multilingual models? Which checkpoint should be the go-to?
2021-11-16T16:20:49Z
MoritzLaurer:Is it possible to share the link to the notebook Lewis is working on here?I added it on the first post
2021-11-16T16:26:25Z
During the technical glitch Lewis explained the weighted lossCan he show it again?
2021-11-16T16:26:55Z
Is there a page in the docs / chapter in the course / an external resource with an overview of different loss functions and their advantages/disadvantages?
2021-11-16T16:27:17Z
How can you use the dataset/trainer/pipeline approach with your own data?
2021-11-16T16:27:42Z
Does the way the initialized model was made (as in made using tensorflow or pytorch) affect its performance or cause any issue?
2021-11-16T16:28:39Z
JaviBJ:You suggest changing bert-base for MiniLM as baseline pre-trained model. Is there an analogous recommendation for multilingual models? Which checkpoint should be the go-to?This is answered at 25:00 in the main stream.
2021-11-16T16:33:59Z
Like Sylvain and Lewis mentioned, this would be a great resource to have. I’d love to collaborate on this
2021-11-16T16:34:17Z
gerardo:During the technical glitch Lewis explained the weighted lossCan he show it again?This is shown at 27:05 in the main stream.
2021-11-16T16:34:50Z
MoritzLaurer:Is there a page in the docs / chapter in the course / an external resource with an overview of different loss functions and their advantages/disadvantages?This is answered at 28:37 in the main stream.
2021-11-16T16:35:29Z
NDugar:Does the way the initialized model was made (as in made using tensorflow or pytorch) affect its performance or cause any issue?This is answered at 29:37 on the main stream.