Monitoring GPU usage & utilization (nvidia-smi)
Hello,I’m running training on SM with HuggingFace estimator.How can I run ‘nvidia-smi’ every ~1minute to monitor GPU usage and utilization?Thanks!
2023-08-31T07:24:06Z
watch -n60 'nvidia-smi'
2023-08-31T10:51:37Z
Where do I insert this command?