code: def on_episode_begin(self, episode, logs):
          
          assert episode not in self.metrics
          assert episode not in self.starts
          self.metrics[episode] = []
          self.starts[episode] = timeit.default_timer()
docs: Initialize metrics at the beginning of each episode