Improve efficiency of layering by not retracting when it isn't necessary