Merge pull request #70 from yeukhon/master

Fixed #2 completed functional tests for apis.
Adding minion-backend-api to the list of scripts to install
Adding a minion-create-user script to setup initial users
Merge branch 'master' of https://github.com/st3fan/minion-backend
Added the minion-scan-worker script to setup.py
Update setup.py to use robots_scanneer==0.1.2

0.1.2 added support for Allow directive.
Quick fix for target url validation regex