Remove the dependancy of grit from class Network::Graph

This PR is dependent on https://github.com/gitlabhq/gitlab_git/pull/9