Don't get rid of a button if it's turned off