Remove stuff done by cloud-init now.