springer_crawler: adds new module

* to crawl from Springer web pages.

Signed-off by: Georgios Papoutsakis <georgios.papoutsakis@cern.ch>
ftp_utils: adds a module to handle ftp downloads.

Signed-off by: Georgios Papoutsakis<georgios.papoutsakis@cern.ch>
Merge pull request #24 from GiorgosPa/ftp_utils

ftp_utils: adds a module to handle ftp downloads.
Merge pull request #22 from GiorgosPa/springer

springer_crawler: adds new module
elsevier_package: affiliation warning improvement

* Improves the warning of multiple implicit affiliations to
  not generate an error on concatenation.

Signed-off-by: Jan Aage Lavik <jan.age.lavik@cern.ch>
aps_package: XML format detection

* Adds support for simple XML detection in the APS converter. Raises
  new ApsPackageXMLError should the given XML be of a non-JATS format.

* For performance, ApsPackage allows client to pass pre-defined
  journal mappings.

Signed-off-by: Jan Aage Lavik <jan.age.lavik@cern.ch>
utils: new module for frequently used functions

* Moves function fix_journal_names to utils.

* Fixes function fix_journal_names.

* Adds function collapse_initials.

Signed-off by: Georgios Papoutsakis<georgios.papoutsakis@cern.ch>
aps_package: book references fix

* Adds publisher location information.

* Adds editors.

* Adds volume and page information.

Signed-off-by: Georgios Papoutsakis<georgios.papoutsakis@cern.ch>
Merge pull request #31 from GiorgosPa/aps

aps_package: book references fix
elsevier_package: various fixes for CONSYN

* Uses stdout for logging if log file is unaccesible.

* Removes duplicated code.

* Adds missing articleid on journal references.

* Fixes Convertion of Journal names to Inspire's short form.

* Adds 'Erratum', 'Publisher Note' and 'Addentum'
  in 773__m field for 'err', 'pub' and 'add' doctypes.

* Adds 980__a:'Review' for 'rev' doctype.

* Detects multiple references with the same label
  and handles them separately.

Signed-off-by: Georgios Papoutsakis<georgios.papoutsakis@cern.ch>
Merge pull request #29 from GiorgosPa/elsevier

elsevier_package: various fixes.
global: PEP8 fixes and import refactoring.

Singed-off-by: Georgios Papoutsakis<georgios.papoutsakis@cern.ch>
minidom: Moves format_arxiv_id into utils module

* Removes arXiv prefix from the old formated arXiv ids.

Signed-off-by: Georgios Papoutsakis <georgios.papoutsakis@cern.ch>
aps_package: various fixes

* Fixes 999C5s field to always has the form of journal,volume,page.

* Adds basic metadata (pagecount, pacscode, author email,
  260__t:published, subjects)

Signed-off-by: Georgios Papoutsakis <georgios.papoutsakis@cern.ch>
elsevier_package: CONSYN fixes

* Adds 710__g field for collaborations.

* Adds pagecount and article topics.

* Adds 260__t:published field.

* Removes 773__n field.
Signed-off-by:Georgios Papoutsakis<georgios.papoutsakis@cern.ch>
Merge pull request #32 from GiorgosPa/aps

Pep8/Aps harvest fixes.
Merge pull request #33 from GiorgosPa/elsevier

elsevier_package: CONSYN fixes
global: use new FTP utility

* Updates several modules to use new ftp_utils module

* Consolidates some functions into ftp_utils, such as
  get_filesize and check_pkgs_integrity.

* Adds new functions to fto_utils such as mkdir,
  rm, rmdir, upload.

* Adds support in ftp_utils for login with netrc files.

Reviewed-by: Jan Age Lavik <jan.age.lavik@cern.ch>
Signed-off by: Georgios Papoutsakis<georgios.papoutsakis@cern.ch>
global: PEP8/Spelling/Docstring fixes

Signed-off-by: Georgios Papoutsakis <georgios.papoutsakis@cern.ch>
elsevier_package: fix dashes in report numbers

Signed-off-by: Georgios Papoutsakis<georgios.papoutsakis@cern.ch>