Validation Loss for VITMAE
I’ve started using VITMAE, adapting code from the scriptrun_mae.py.I’m unable to get any validation loss - in spite of setting evaluation_strategy=epoch and providing an evaluation set to the trainer. I get Validation Loss: “No log” for all epochs. Specifying compute_metrics() results in an exception related to tensorsI’m wondering if this is because the trainer expects labels for evaluation, and the model doesn’t provide them during pre-training. Is there a workaround other than a custom training loop?Thanks!
2022-12-30T21:12:49Z
When you construct your TrainingArguments, you need to add the field as:training_args = TrainingArguments(     ....     label_names=["pixel_values"],     .... )I’m also assuming you are settingeval_dataset=<your_eval_dataset>in yourTrainer, right?During validation some “label” is required to compute the metric.  In this case, the input is the label, so when you specify this it should work.