Additional loss logging
Hi there,I’ve overridden thecompute_lossmethod in order to add additionalkl_divloss for distillation. Now, I want to log the cross-entropy and KL divergence along with the total loss. I’m wondering if there’s an easy way to do this without overriding about half of theTrainerclass?Thank you in advance!
2024-01-04T06:25:37Z
I created a way to do that without modifying too much of the trainer class.You can find my workaround here:https://github.com/naba89/custom_REDACTED_TOKEN