Adds a option for robots.txt

If enabled the the bot should ignore everything

if not it should ignore:
/restart
/shutdown
/logout
/update

Closes: https://github.com/styxit/HTPC-Manager/issues/304

@madclicker you can use this as a example, i didnt get it working with the config