code: public static FileStatus[] getListFilesToProcess(long maxFileSize, boolean recurse,
        FileSystem hdfs, Path inputPath, JobFileModifiedRangePathFilter pathFilter)
        throws IOException {
  
      LOG.info(" in getListFilesToProcess maxFileSize=" + maxFileSize
          + " inputPath= " + inputPath.toUri());
      FileStatus[] origList = listFiles(recurse, hdfs, inputPath, pathFilter);
      if (origList == null) {
        LOG.info(" No files found, orig list returning 0");
        return new FileStatus[0];
      }
      return pruneFileListBySize(maxFileSize, origList, hdfs, inputPath);
     }
docs: looks at the src path and fetches the list of files to process
  confirms that the size of files
  is less than the maxFileSize
  hbase cell can't store files bigger than maxFileSize,
  hence no need to consider them for rawloading
  Reference: {@link https://github.com/twitter/hraven/issues/59}
  @param maxFileSize - max #bytes to be stored in an hbase cell
  @param recurse - whether to recurse or not
  @param hdfs - filesystem to be looked at
  @param inputPath - root dir of the path containing history files
  @param jobFileModifiedRangePathFilter - to filter out files
  @return - array of FileStatus of files to be processed
  @throws IOException