speed up --l2 with sparse annot matrices