Or how long is the locked state so the computation of grad->add(param, gradient); take?