Initial commit.
Threaded searching. Should be faster.
First attempt at feeds with celery.
Now catches exceptions for mendeley search scraper. was getting 503 service not available error
New journal scrpers
Added celery configuration.
Merge branch 'master' of ssh://akorn.org/~/git/akorn_search
Merge.
Made scrapers into a python module.
Changed reference from libs to lib.
fixed bug.
Resolve url before giving to recognise_journal.
Slight massacre of scrape_journal code. Need to rethink merging. Added journal scraper lookup in couch
Add script to add scrapers to couchdb
Fixing up physical review scraper. Added error handling and rescraping routines
Should've committed earlier. Architectural changes. Adding scraping triggered by a search. Trying to work out how to handle DOIs and other junk provided by the search APIs in a nice way.
More fixing. Each document now has multiple source_urls in case it is redirected
Wondering why NPG scraper is now giving a 401 error. Oh dear. Updated scrapers to new source_urls field
Added database docs to the search output. Added basic doc display
More changes to the front end. Added basic 960 grid