Getting mpi4py Error When Trying to Integrate Accelerate
Hi, I’m running into a strange error when I try adding accelerate to my finetuning notebook. I get the errorModuleNotFoundError: No module named ‘mpi4py’under accelerator.prepare(model, trainer).Here’s a linkto a Colab notebook in which this error is shown. For context, the service I’m experiencing this error on is RunPod.Thanks in advance.
2023-12-10T22:03:52Z
You need to install mpi4py as mentioned. I recommend doing so viacondaas the pip install version can have some issues
2023-12-12T14:44:16Z
Thank you for your response. It turned out that I needed to install a dependency for mpi4py for the pip installation (pip install mpi4py) to succeed! The dependency I installed was libopenmpi-dev.