Unset GIT_DIR.
Remove $bundler_tmp as it may be in our pwd.

We can also stop removing the erroneous bundler gem since it's within
$bundler_tmp.
Standardize errors/warnings.