Trainer attribute, n_gpu
In a ddp training with multiple gpus, what should the value ofn_gpube?In my setting, then_gpuis always 1 no matter how many gpus are used. I am worried about whether this indicates a bug.framework: pytorch, GPU type: nvidia-a100