Retry failed removal of persistence dir once