Fix a race condition in t/file-permission.t by using temp directories