Followed the guides below to set it up
http://fixbyproximity.com/2013/01/git-unity-3d-source-control/
http://www.dannygoodayle.com/2013/02/14/using-unity-with-git/