Rubuta ci gaba don wannan sakin layi - Gidan ya zama mara kyau a ƙarshen karni na 16. Gobarar shekara ta 1616 da kuma ɓarnar da aka yi a lokacin Rigyawa
a 1657 ya haifar da ƙarin lalacewa. An gyara kagara a lokaci-lokaci, amma saboda sauye-sauye a cikin shimfidar iyakoki da alaƙar da ke tsakanin Poland da maƙwabta, ya rasa mahimmancinsa. Bayan rabuwa na Poland, Będzin ya fada cikin ikon Prussian kuma fadar ta zama mallakar dangin Hohenzollern. A cikin 1807, an canja ƙasashen da ke kusa da Duchy na Warsaw, kuma a cikin 1815, zuwa Poland Congress. A shekara ta 1825 fadar ta kusan rushewa, kuma lokacin da wani dutse ya murkushe mai wucewa, an ba da umarnin rushe fadar, amma kafin a fara, an ayyana fadar a matsayin abin tunawa. A cikin shekarun 1830, Count Edward Raczyński ya sayi fadar kuma an sake gina ta, tare da cocin Furotesta na ɗan lokaci a ciki, amma bayan rasuwar Raczyński a 1845 an yi watsi da shirin buɗe makarantar ko asibiti a can, kuma fadar ta sake lalacewa.