Outputers cleanup

Allow for cleanup phase when `yalp-outputers` is stopped