code: protected AbstractTokenizer generateTokenizer() {
          Class<? extends AbstractTokenizer> tokenizer = parameters.getTokenizer();
          if(tokenizer==null) {
              return null;
          }
  
          try {
              return tokenizer.newInstance();
          } 
          catch (InstantiationException | IllegalAccessException ex) {
              throw new RuntimeException(ex);
          }
      }
docs: Generates a new AbstractTokenizer object by using the provided tokenizer class.
  
  @return