Avoid unnecessarily ignoring asynchronous messages

I missed this in commit 7454a9817b0f148ab5b1.