Remove stored element attrs data on destroy