SageMaker Debugger Hugging Face Training Report
Hi Team,Good day!!We are using Hugging Face estimator to train a BERT model on SageMaker, would like to build a training report likeSageMaker Debugger XGBoost Training Reportand analyse the Loss vs Step graph, Loss vs Epochs graph and Accuracy vs Epochs graph etc.image1370×1234 50.7 KBThanks@philschmidfor sharing this example -training with custom metricsand we see timestamp vs metric graph but we are interested in above graphs.image937×317 30.6 KBCould you please help?Thanks & Regards,Vinayak
2022-07-07T07:12:03Z
Hey@Vinayaks117,If your training script is logging the metrics you want to capture you can add the “regex” pattern to your estimator to capture and then visualize them.
2022-07-07T08:57:06Z
Hello@philschmidYeah, we followed your exampletraining with custom metricsand able to plot timestamp vs metric graphs but we want to create following graphs.Loss vs Step graphLoss vs Epochs graphAccuracy vs Epochs graphAs documented inAWS docs, SageMaker debugger does not support the Hugging Face.I believe we can create above graphs likeSageMaker Debugger XGBoost Training Reportif SageMaker debugger supports Hugging Face.Thanks
2022-07-07T12:03:39Z
The SageMaker debugger should be support for HF as well since we are building on top of PyTorch or TensorFlow