Maybe we can hook into purge_bundler_cache?