Don't throw an exception when already handling an exception..

It's entirely possible to end up with a tree of files still here, thus do an rmtree rather than a plain unlink.