gitlabhq/gitlabhq — pull request #6341 by Cynddl (2014-02-17 10:40:03+00:00)
Title: Fix issue with robots constantly asking for projects archives

This pull request tells robots to not follow archive links. GoogleBot always triggers the creation of archive files (zip, tar…) at each new commit, overloading the disk.