Remove layers from the selected layer cache on layerremove event