fix before cikm work