Properly kill any push_block() tasks on shutdown