Revert "Print diagnostics inside the Windows build [to be reverted]"

This reverts commit f7c09f6cc7d111b9b97d0ea51eac851ce5a1307a.
Remove rethrowing of exceptions at shutdown