Properly destroy cache objects of vanished folders