code: def value(self, observation):
          
          policy_params, q = self(observation)
  
          # Expectation of Q value with respect to action
          return (torch.exp(policy_params) * q).sum(dim=1)
docs: Calculate only value head for given state