Add concept of mirroring.

This allows us to mark a project as a mirror,
and it will auto-update the docs every 30 minutes.
Paginate by 500 on mirror task
Merge pull request #626 from rtfd/mirroring

Add concept of mirroring.