Remove the extra check for all-zero-case.