removed unused functions
add urls we are going to fetch to seen structure