LPS-16393 Remove the harsh testing, this could break on a heavy loaded machine.

The assert was trying to say a synchronized exchange is slower than a direct taken, which is true in normal case.

But apparently the jenkins server does not agree. If some random load kicks in while the code is doing direct taken, it could be even slower than a synchronized exchange.

It is not necessary to this point, so just simply remove the assert.