Remove another weird hard-coded sleep

If this is an issue we need something other than sleeps ;)

similar to #14223