updated gitignore and config
moved python crawler to py folder
moved old crawler to py/twisted.
python crawler using celery.
a new read me for the whole project added
javascript and coffee script versions added.
go crawler get a url and paring out other urls.