Super configurable async web spider