I pre-train an autoencoder(AE1) on dataset A to reconstruct the input time signals. I follow the same way to train AE2 on dataset B. On dataset B, AE1 generates similar reconstruction MSE as AE2. However, when freezing the encoder part and concatenate it with an MLP for downstream classification tasks on dataset B, encoder from AE1 generates much worse results than AE2. Why?