Logging_steps=1 => ValueError
I have assembledthiscolab notebook to finetune LLaMA 7B adapter weights. WithinTrainingArguments, in line 62, I would like to uselogging_steps=1so I can see the logs at every step. However, I getValueError: expected sequence of length 24 at dim 1 (got 58)when I do uselogging_steps=1and as a consequence, the model won’t be trained.Why is that? And how can I avoid that error but still log the loss?Side note:Aftertrainer.train(), I save the model and the tokenizer. Apparently, this uses the GPU and may causeOutOfMemoryError: CUDA out of memory.You can just comment out these lines (or pay Colab for more GPU memory).