code: def _list_paths(self, bucket, prefix):
          
          s3 = self.s3
          kwargs = {"Bucket": bucket, "Prefix": prefix}
          if self.list_objects:
              list_objects_api = "list_objects"
          else:
              list_objects_api = "list_objects_v2"
          paginator = s3.get_paginator(list_objects_api)
          for page in paginator.paginate(**kwargs):
              contents = page.get("Contents", None)
              if not contents:
                  continue
              for item in contents:
                  yield item["Key"]
docs: Read config for list object api, paginate through list objects.