Issues with diffusers and deepspeed's init_inference() in latest version
I need everyone’s help, I had started an issue but so far I haven’t found out how to make the fix:github.com/microsoft/DeepSpeed[BUG]init_inference() fails for diffusersopened07:48AM - 28 Nov 23 UTCdyeddbuginference**Describe the bug**
Code source: https://github.com/microsoft/DeepSpeedExample…s/blob/master/inference/huggingface/stable-diffusion/test-stable-diffusion.py

**To Reproduce**
I've tried both the latest version, and the requirements.txt version as supplied with the code. Running it through a single gpu this is no problem, however when running it with multiple gpus, it reports an error.

**Expected behavior**
Supports multi-gpu


**Screenshots**

![20231127084144](https://github.com/microsoft/DeepSpeed/assets/38277217/256375c6-834a-4c65-865f-d44a36496817)