Output effective batch size and GPU memory usage in logs when using auto_find_batch_size
Is there a metric definition inevaluatethat usespynvmlto monitor the GPU RAM usage while we runtrainer.train()?Is there a logging function that will automatically output the effective batch size by computing the the accumulations + batch size when usingauto_find_batch_sizewithtrainer.train()?
2023-03-13T10:25:15Z
Seems related toauto_find_batch_size should say what batch size it is using · Issue #21950 · huggingface/transformers · GitHub