

TITLE
Make classifier backbone dynamic maskformer, mask2former

COMMENTS
3

REACTIONS
+1: 0
-1: 0
laugh: 0
hooray: 0
heart: 0
rocket: 0
eyes: 0

BODY
### Feature request

Make classifier backbone dynamic maskformer, mask2former. Currently it only supports swin transformer. 

link example:  https://github.com/huggingface/transformers/blob/main/src/transformers/models/mask2former/modeling_mask2former.py#L1393


### Motivation

If this feature request successful, it will help to benchmark for new clasifier easily.