Properly delete socket file in benchmark