No need to check for descent direction when we have actual descent