I am testing deep learning models on spatiotemporal data where I have 12 timesteps in the past as input and predict 12 time steps ahead. However, I notice that the CNN based methods I use such as UNets show spatiotemporal averaging where all the future forecasts look the same. 