Remove items from active_item_cache based on whether they are in the cache, not whether they are marked active.