[BUGFIX] Avoid a spec race on JRuby by delivering some messages async

I'm not sure why this helps, and if we ever have problems with the spec latch mysteriously failing to open, we should probably investigate this.