Try to remove cache only if it is present