Fix shutdown of delayed executor

Signed-off-by: Adam C. Emerson <aemerson@linuxbox.com>