Remove the patch from the cache after applying it