Using both packing and group_by_length in SFTTrainer
Can someone explain how batches are created when bothpackingandgroup_by_lengthare enabled? As far as I understand,packinginvolves combining examples to create a sequence of maximum length, whilegroup_by_lengthworks to minimize the use of padding tokens by combining shorter sequences. It seems to me that enablingpackingmight interfere with howgroup_by_lengthfunctions. I’m not sure about the actual behaviour when both settings are active. Does anyone have insights on this?