Remove stuff done by the 'application' cookbook