How does Huggingface Trainer handle Iterable dataset on TPU?
Can anyone tell me about how iterable datasets are handled in this type of multi-device scenario? How is it made sure that the same data is not duplicated across multiple devices?