add .ignore list; implement functions in Spider Class