Some of the houses built near the castle were made from stone stolen from the castle ruins.