Slow inference while performing translation
Hi,I’m using thembartmodel to perform the translation of1000 sentencesand I see that the inference is very slow. Each sentence takes about a minute to infer. How do I speed up the inference ( I do have access to GPU).Any help appreciated,Prashanth