Proper cleanup of layer objects on unspawn