moved domain and customer to crawler configs