changed location of clusteredPoints file
creating a web mining app like the example
adding a url filter to fetcher
created a miner based on DemoCrawlTool--miner2
miner2 works to get all outlinks from 'following' pages, now need to add outlink filter to mine only other user outlinks
now miner2 saves url of foloowing person, url of followed person, person name. the urls endcode unique ids for the people so we have all the data we need for collaborative filtering of Pinterest, just need Javascript to go deeper per person
created a tool for exporting pinterest preferences to a single dir ready for mahout recommender input
added a GroupBy pipe so can control the number of output files (1) for input into mahout recommender
just in case
added some reporting around url import
added some reporting around url import
built the jar, had to comment out a test
built the jar, had to comment out a test
added an option for changing crawl policy