After his marriage, Rabbi Epstein moved to his wife's hometown, in Kovno, and was joined there two years later by Rabbi Meltzer, following his marriage to Rabbi Epstein's sister-in-law, Baila Hinda Frank.