[Nov 15th Event] Matthew Watson - Chen Qian: NLP workflows with Keras
Use this topic to ask your questions to Matthew Watson and Chen Qian during their talk:NLP workflows with Keras.You can watch it onYouTubeor onTwitchat 10:15am PSTColab notebooks:part 1,part 2.
2021-11-15T18:15:57Z
Since a lot of people use both keras and pytorch especially while using HuggingFace. Have you guys considered making the code torch code transferrable to keras (to some extent at least) and vice versa so as to ease it for everyone?
2021-11-15T18:23:36Z
Hi, TF maintainer here! We’ve been working on trying to add some helper functions for this. For example, therecent notebooksuse ato_tf_dataset()method that can be used to convert HuggingFace datasets to TF Dataset objects, which allows you to pass them straight to Keras methods likemodel.fit(). This avoids the need for separate TF data handling code in a lot of cases.
2021-11-15T18:26:57Z
wow, thank you for your efforts and for replying.
2021-11-15T18:34:39Z
Can you please tell how to develop pipeline for a language?
2021-11-15T18:37:49Z
Hey@sugandhi, thanks for your question! Could you clarify a bit what you mean by “pipeline”? What type of NLP task do you have in mind?
2021-11-15T18:42:00Z
Can you develop more on the idea of training loss and validation loss? If the validation loss starts increasing, it means that it’s already overfitting?
2021-11-15T18:43:53Z
Hi, thanks for this great session. My question is can layer-wise learning rate help in the fine-tuning when it comes to bert models.
2021-11-15T18:45:53Z
anas:My question is can layer-wise learning rate help in the fine-tuning when it comes to bert models.This is answered at 2:45:20 in the main stream.
2021-11-15T18:46:32Z
tceron:Can you develop more on the idea of training loss and validation loss? If the validation loss starts increasing, it means that it’s already overfittingThis is answered at 2:46:10 on the main stream.
2021-11-15T21:02:21Z
Hi,I was exploring Neuralcoref for english language. I want the same model for “Hindi” language but for this SpaCy parser doesn’t have pipeline developed for Hindi language. So Can you please guide, how to develop NeuralCoref for Hindi language?https://spacy.io/universe/project/neuralcoref
2021-11-15T21:48:31Z
Hey@sugandhi, this is an interesting question! I think it would be best to ask it as a general forum topic so that others in the community can share their expertise