make CI build faster

Yeah, but I think it depends on the workflow, if everything need to pass the build locally or by a PR, then no this problem. 10 is a safe number.