At this time , the ruins of the castle were still there .
Ruins were carried away piece by piece for building houses .
At this time , the ruins of the castle were still there but they were carried away piece by piece for building houses .