code: def is_parseable (self):
          
          if self.is_directory():
              return True
          if self.content_type in self.ContentMimetypes:
              return True
          log.debug(LOG_CHECK, "URL with content type %r is not parseable.", self.content_type)
          return False
docs: See if URL target is parseable for recursion.