a crawler based configuration files