cant find the results html file for some reason. will probably switch to something I can pass js anyway such as jade. then I can send the user back with the relevant data, which will be easier.
added pseudocode now that I have been working on this for an hour and understand the problem a little better. also added jade. need to convert the html to jade.
basic structure of the app is fleshed out. need to add the logic to make it happen, along with changing the view to jade so I can display the results dynamically
calls to the url are returning the page html and I am able to reassemble it into a single string
getting close. I am getting the correct result for 50% of the sites. By adding a loop to iterate throught the urls I get from the first page I will be able to get enough links for the 3rd site. The workshop site will be really hard as that is all query strings.
added comments before I move on to the next step
I am satisfied with what I am gettinf for the restful sites. having a problem with asynch due to the for loop now. Need to solve that in order to return the data collection on the redirect. also need to write a solution for sites using querystrings instead of REST
now getting results for all 4 test sites. sfmoma is not returning 10, but they are clsed for renovation and therefore dont have a lot going on. workshopssf is also light, but getting any events out of that site makes me happy
Merge pull request #1 from cdelauder/query

now getting results for all 4 test sites. sfmoma is not returning 10, bu...
opted not to use Jade after all. Instead just building a standard html response. It works for 2 of the 4, once I figure out why the other 2 arent displaying I can ship this code.
SO CLOSE! The workshop regex is not returning nearly as many links as it should be. I suspect I have written a slow regex, and that I just need to find a way to speed it up. I think the amount of time it takes to check the links is why I am getting fewer than I should
I thought I was closer than I was. When I realized I had duplicates and tried to account for that sfmoma fell below 10 links, and Im still fighting witht the workshop site
this is as close as I am going to get. I think its pretty good for sticking to base node modules and not introducing dependencies. If I had more time I would build it using cheetoh and require and benchmark the 2 to see which is faster.
Merge pull request #2 from cdelauder/results

Results
Merge pull request #3 from cdelauder/route

Route