Accelerate device_map for 🧨.from_pretrained
I seeDiffusers#772was included with today’s diffusers release, which means I should be able to pass some kind ofdevice_mapwhen I construct the pipeline and direct which device each submodel is loaded on, right?But I’ve gotdevice_map=dict(unet='cuda')and am running in to errors that indicate it’s trying to run the unet on CPU.It may be thatunetis not the right key? I’ve seen some indication that the text encoder might betext_model, and nottext_encoderas I expected from the way the submodels are named in model_index.json.How do I see what names it knows things by?