core: Fix caching not considering torrent add/remove as updates