Add some documentation and change updatecrawl interface