code: def initialize(self, training_info, model, environment, device):
          
          if self.trust_region:
              self.average_model = self.model_factory.instantiate(action_space=environment.action_space).to(device)
              self.average_model.load_state_dict(model.state_dict())
docs: Initialize policy gradient from reinforcer settings