Make sure the folder for PID file exist