ZeRO3 with int8 training
Hi,I am trying to run mixed int8 training along with DeepSpeed ZeRO3 across GPUs and run into a problem which I hope someone could help clarify.It seems like mixed int8 requires specifyingdevice_mapduring model loading (from_pretrained()) which will setlow_cpu_mem_usage=Trueautomatically. However, ZeRO3 requireslow_cpu_mem_usage=False. What would be a reasonable solution here?Appreciate any pointers in advance!