BartForConditionalGeneration with PubMedBERT/Bio_ClinicalBERT tokenizer
Hello,I am usingBartForConditionalGeneration architecturefrom@sguggerto train the model to summarize medical reports. The model achieves good results when the tokenizer is the same as the model. However, I tried to replace the tokenizer with a PubMedBERT/Bio_ClinicalBERT tokenizer, but the model doesn’t learn well.Do you have any idea why the model doesn’t work well with any of these medical tokenizers? Or what will be a good way to use PubMedBERT/Bio_ClinicalBERT tokenizer in the BartForConditionalGeneration model?Thank you very much! I appreciate your help!Tamara