Re-add delayed job clearing.

I don't like this, and I think I'll shift it out properly once I can think through how.