D-Programming-Language/dlang.org — pull request #524 by CyberShadow (2014-03-16 06:17:46+00:00)
Title: Add DDox preview to robots.txt blacklist

I noticed a search result today linking to the DDox preview. Since it's not quite ready for general use, I think it makes sense to forbid search engines from indexing the preview pages.