EfficientFormer Training
I’m interested in fine-tuningEfficientFormerfor an image classification task. However, I see in the model docs under theEfficientFormerForImageClassificationWithTeacherclass that “This model supports inference-only. Fine-tuning with distillation (i.e. with a teacher) is not yet supported.” Does this mean that fine-tuning is not supported for theteachermodel or that fine-tuning is just not yet possible for this model in entirety?I attempted to fine-tune with the Trainer, but I did get an error aboutEfficientFormerForImageClassificationWithTeacher.forward()not taking the param “labels” which makes me think it’s the latter. If this is the case and if no one internally is working on additional training capability, I’d be happy to take a swing at it if I could be pointed to some references/guidance documentation.Thanks in advance!