Fail outstanding RPCs as well