code: def words(self: object, fileids: str):
          
          for sent in self.sents(fileids):
              for token in word_tokenize(sent):
                  yield token
docs: Tokenizes documents in the corpus by word