SparseLDAInferencer: cache 1/den, multiplication is faster