Added a few more scope checks + fixed bugs found by pylint + fixed a bug in the robots.txt plugin