Remove from cache too, when removing subs.