Added Crawler/Bots ignore config
Updated Readme: ignore exception and bot

- Strip exception and bot name in config