code: @Override
    public List<String> tokenize(String text) {
      List<String> l = new ArrayList<>();
      boolean hasException = false;
      for (int idx = 0; idx < EXCEPTIONS.length; idx++) {
        if(text.contains(EXCEPTIONS[idx])) {
        	hasException = true;
          text = text.replace(EXCEPTIONS[idx], EXCEPTION_REPLACEMENT[idx]);
        }
      }
      StringTokenizer st = new StringTokenizer(text, getTokenizingCharacters(), true);
      while (st.hasMoreElements()) {
        String token = st.nextToken();
        for (int idx = 0; hasException && idx < EXCEPTIONS.length; idx++) {
          if (token.equals(EXCEPTION_REPLACEMENT[idx])) {
        	  token = EXCEPTIONS[idx];
        	}
        }
        if (token.length() > 1 && token.endsWith("-")) {
          l.add(token.substring(0, token.length() - 1));
          l.add("-");
        } else {
          l.add(token);
        }
      }
      return joinEMailsAndUrls(l);
    }
docs: Tokenizes text.
  The English tokenizer differs from the standard one
  in two respects:
  <ol>
  <li> it does not treat the hyphen as part of the
  word if the hyphen is at the end of the word;</li>
  <li> it includes n-dash as a tokenizing character,
  as it is used without a whitespace in English.
  </ol>
  @param text String of words to tokenize.