code: def read_content(path: str, limit: Optional[int] = None) -> Iterator[List[str]]:
      
      with smart_open(path) as indata:
          for i, line in enumerate(indata):
              if limit is not None and i == limit:
                  break
              yield list(get_tokens(line))
docs: Returns a list of tokens for each line in path up to a limit.
  
      :param path: Path to files containing sentences.
      :param limit: How many lines to read from path.
      :return: Iterator over lists of words.