`accelerate config` alternative for multi-node training
For multi-node training, theacceleratelibrary requires manually runningaccelerate configon each machine. It is inconvenient if the node number exceeds 10+ (manually setting the configuration for 10+ times).  Is there a solution that we can automatically generate the config file on each machine?
2022-09-05T21:29:47Z
cyk1337:Is there a solution that we can automatically generate the config file on each machine?You can just use the same single yaml and tweak it for the node number, and copy/paste onto each machine.huggingface.coLaunching your 🤗 Accelerate scriptsWe’re on a journey to advance and democratize artificial intelligence through open source and open science.
2022-09-06T02:04:40Z
Hi@muellerzr, I was wondering whether there is such a tool. If not, I would develop one. Thank you very much for your answers.