Batched generation_config/kwargs for the `transformers.generation.utils.generate` function
Hello everyone. First, I’d like to confirm if, as of now, there’s indeed no support for batched configs for the aforementioned function (e.g. pass different temperatures for each row of the batch). If that’s indeed the case, does anyone know ways to bypass this limitation? I guess not all configs may be configurable element-wise, but the temperature example should be a possible one.Thanks!