TRQ-2616. Jobs don't wait for epilogue when job is canceled

Modified scan_for_exiting to now wait for all sister nodes
to check in when exiting before start the preobit_preparation.
This is where the epilogue is run. This makes it so the epilogue
will run only one time.