Free file when we fail due to directory not being empty.