refactoring of crawler to put config into its own file, support for sciencedirect pdf crawls and
a fake useragent (for sciencedirect)