claudehohl/Stikked — pull request #151 by glensc (2014-07-10 06:39:10+00:00)
Title: add default robots.txt

add default robots.txt to drive spammers away from public pastebin installations.

this is just in hope that the won't spam you because your site is not indexed, and they may stop spamming you.

currently i don't see stikked having any robots.txt file nor using any html meta tags to control pastebin indexing