code: def monitor(i):
      
      count = 0
      for x in i:
          count+=1
          if count % 10000 == 0:
              logger.info("%d records so far, current record is %s",
                  count, x["idx"])
          yield x
docs: Given an iterator, yields data from it
      but prints progress every 10,000 records