Tests in progress jobs on shutdown

Verifies that a job in progress is properly failed with the "Shutdown" error
message.