I think it is fine to clear the gem paths once at the end.