added logic to check target's robots.txt. If the target is blocking PermaBot, we'll put archived material in the darchive. still need to update the template.
added note to faq instructing folks about PermaBot