Adjust layer number always.