code: def _normalize(self, tokens):
          
          if self.case_sensitive:
              return ' '.join(self.lexicon[t].normalized for t in tokens)
          else:
              return ' '.join(self.lexicon[t].lower for t in tokens)
docs: Normalization transform to apply to both dictionary words and input tokens.