Miscellaneous improvements

- Upgrade to BS3 final.
- Improve crawling.
- Protect GitHub API quota from unfriendly robots.
- Other small fixes.