Is there a way to use mean_pooling with Roberta?
Looking at the code in roberta modeling it appears thatRobertaForSequenceClassificationcan only use the “< s>” token as “pooler” is this true or am I looking at the wrong code?Thanks to anybody who can answer!