traverses url trees using specified css selectors to generate end points