The Butler Palace was in a pitiful state: the marble ripped out, and the garden, where the family would gather for tea in the evening, waist-high in weeds and rubbish.