Add mirror mode.
closes #375
Merge branch 'dev.mirror3' of https://github.com/jcushman/perma into jcushman-dev.mirror3
bug fix: We were truncating the wrong link. we were shortening the
one in the href= and not the value to display. fixes #470
Perma isn't a bot. When looking for meta archive tags in the markup
and in robots.txt, let's look for "Perma" instead of "Permabot"

fixes #462
We would sometimes fail indexing a page that served up a cert that
didn't match the domain. We now don't verify the SSL. This seems to
generally be the expected behavior. Fixes #456
closes #410
Merge branch 'develop' of github.com:harvard-lil/perma into develop
Moved "do we put this new archive in the darchive?" logic to the
warcprox task. This will help us archive the robots.txt file and
provides a better way for us to check on the noarchive tag in
the markup.

TODO: We'll want to refactor this robots stuff a bit. We should
clearly be getting the title of the page in the same way we look
for the noarchive tag in the markup. This is part of the larger
"run as much through phantomjs as possible" task.

fixes #461
fixes #469
Merge branch 'develop' of github.com:harvard-lil/perma into develop
Removed old, crufty contact us link. fixes #476
Removed another crufty link to the contact us page. Now users
are directed to our feedback form. Also removed the old
lorem ipsum contact form.
Removed Shailin's name as the email contact since we have other
folks fielding the info@perma.cc address now.
Made he robots.txt darchive message generic. fixes #468
Cleaned up JS just the tiniest amount to fix the appending
screenshot on the create page. Now strictly comparing string
results.

fixes #475
Added a setting, CELERYD_TASK_TIME_LIMIT, to cap the running time
of our Celery tasks. This should control the PhantomJS zombies.
Updated the ticks on the x-axis of our graphts to display as
months instead of weeks. The weeks were writing on top of each
other.
updated hits.
Add requirements.txt to quickstart.
closes #482