Don't call usleep if it's not necessary