Remove binary dependence only in gitlib itself