added basic crawler with shutdown