How is the "Auto Model For Sequence Classification" architecture?
How is the architecture ofAutoModelForSequenceClassification? I suppose it’s some pre-trained transformer with some dense layer for classification, however where could I see the forward details of this model?
2021-07-17T08:04:23Z
The auto classes are just abstractions that work for every architecture. You can see the actual forward passes in each modeling files. For instance, if you are using a BERT checkpoint, you will get aBertForSequenceClassificationmodel, which forward pass is defined in`transformers.models.bert.modeling_bert
2021-07-18T00:58:02Z
Thank you@sgugger.