Fix a race on 'searching' flag

We have to be sure someone else has not already
allocated us before trying late join.

Spotted by Joona