ftp_utils: download directory fix

* moving to the corresponding ftp directory before downloading
  the files gets rid of the need to manage two different file
  names.

Signed-off-by: Martin Vesper <martin.vesper@cern.ch>
Merge pull request #56 from mvesper/fix_download_directory

ftp_utils: download directory fix
springer_crawler: fix bad print statement
springer_crawler: nested content support

* Adds support for content spread over several pages.

Signed-off-by: fschwenn <florian.schwennsen@desy.de>
edpsciences_package: adds new module

* Adds new module for EDP Sciences, converting the metadata to
  MARCXML.

Signed-off-by: Georgios Papoutsakis <georgios.papoutsakis@cern.ch>
tests: unit test suite added

* Adds unit tests for PoS, APS, CONSYN and EDP Sciences.

* Unifies the harvesting of EDP Sciences and APS.

* Amends setup.py to include test data to the installation.

Signed-off-by: Georgios Papoutsakis <georgios.papoutsakis@cern.ch>
jats_package: new module for JATS parsing

* Adds a common module for JATS XML parsing.

* APS and EDP Sciences now use the common JATS module.

Tested-by: Jan Aage Lavik <jan.age.lavik@cern.ch>
Signed-off-by: Georgios Papoutsakis <georgios.papoutsakis@cern.ch>
edpsciences_package: conversion fixes

* Adds 980__a:ConferencePaper.

* Adds reference numbers.

* Adds license harvesting.

* Removes footnotes from title and places
  them to 500__a field. Adds subtitle harvesting.

* Adds subject harvesting.

* Adds keywords harvesting.

* Adds harvesting of article type and only converts articles
  with types 'research-article', 'introduction', 'letter'.

Acked-by: Jan Aage Lavik <jan.age.lavik@cern.ch>
Signed-off-by: Georgios Papoutsakis <georgios.papoutsakis@cern.ch>
edpsciences_package: attach fulltext

* Attaches fulltext for open access articles of EDP Sciences.

Acked-by: Jan Aage Lavik <jan.age.lavik@cern.ch>
Signed-off-by: Georgios Papoutsakis <georgios.papoutsakis@cer.ch>
Merge pull request #57 from fschwenn/springer2

springer_crawler: nested content support
FTP: Redirect error to higher layer.

* Changes behavior of download function in ftp_utils.py. It was
  silencing the download error, now it is redirected to a higher
  layer.

Contrast_out: Change printed messages.
edpsciences_package: Astrophysics subject added

Signed-off-by: Georgios Papoutsakis <georgios.papoutsakis@cern.ch>
global: refextract indentifier added

* Adds the subfield 9995C9:refextract for
  references extracted with refextract.

Signed-off-by: Georgios Papoutsakis <georgios.papoutsakis@cern.ch>
Merge branch 'master' of github.com:inspirehep/harvesting-kit

Conflicts:
	harvestingkit/ftp_utils.py
Merge pull request #58 from Dziolas/master

FTP: Redirect error to higher layer.
pos_matching: script to match fulltexts from POS with Inspire records