Remove items from local cache on cache remove.