See comment below.  The core doesn't seem to be getting notified on a failure.  If this is OK for some reason, then we should add a comment explaining why.