initial commit
Merging in origin
modify crawl script
cleaning data with regex
add issues log
more payground stuff.
simple pipeline in place. additional error checking.