code: def getPageContent(url, session, max_content_bytes=MaxContentBytes):
      
      check_robotstxt(url, session)
      # read page data
      try:
          page = urlopen(url, session, max_content_bytes=max_content_bytes)
      except IOError:
          page = urlopen(url, session, max_content_bytes=max_content_bytes)
      data = page.text
      tries = MaxRetries
      while not isValidPageContent(data) and tries > 0:
          time.sleep(RetryPauseSeconds)
          page = urlopen(url, session, max_content_bytes=max_content_bytes)
          data = page.text
          tries -= 1
      if not isValidPageContent(data):
          raise ValueError("Got invalid page content from %s: %r" % (url, data))
      out.debug(u"Got page content %r" % data, level=3)
      return data
docs: Get text content of given URL.