The energy of the total system would be lowered if the dipoles flipped orientation to come closer to one or the other of the ground energy states.
It is possible for the dipoles to change their orientation.