Remove removed file from the cache hash table.