[Nov 16th Event] Sylvain Gugger: Supercharge your PyTorch training loop with 🤗 Accelerate
Use this topic to ask your questions to Sylvain Gugger during his talk:Supercharge your PyTorch training loop withAccelerateYou can watch it onYouTubeor onTwitchat 9:50am PST
2021-11-16T18:25:56Z
Can Accelarate help with hyperparameter optimization, same way Ray Tune does?
2021-11-16T18:27:13Z
Can we do gradient accumulation with Accelerate
2021-11-16T18:28:46Z
alivahdat:Can Accelarate help with hyperparameter optimization, same way Ray Tune does?This is not provided out of the box right now, but it might be a future development.
2021-11-16T18:29:07Z
anindabitm:Can we do gradient accumulation with AccelerateYes, you can use anything you usually do in your training loop
2021-11-16T18:35:50Z
Hi,Thanks for the talk. It’s really a great tool. My question is:Is Accelerate supported on Window platform? or just currently on Linux?Thanks