Remove button when not in state when it's valid