code: def token_generator(self, texts, **kwargs):
          
          for text_idx, text in enumerate(texts):
              if self.lower:
                  text = text.lower()
              for char in text:
                  yield text_idx, char
docs: Yields tokens from texts as `(text_idx, character)`