BibIndex: move helper functions to utils file

* Moves some of the helper functions from bibindex_engine
  to bibindex_engine_utils file.

Signed-off-by: <grzegorz.szpura@cern.ch>
Tested-by: Tibor Simko <tibor.simko@cern.ch>
BibIndex: WordTable API changes

* Removes 'fields_to_index' argument from WordTable's argument
  list.

Signed-off-by: <grzegorz.szpura@cern.ch>
Tested-by: Tibor Simko <tibor.simko@cern.ch>
BibIndex: abstraction layer for terms retrieval

* Introduces new TermCollector class which
  handles terms retrieval from different
  part of the system.

Signed-off-by: Grzegorz Szpura <grzegorz.szpura@cern.ch>
Tested-by: Tibor Simko <tibor.simko@cern.ch>
BibIndex: indexing non-MARC standards

* Introduces NonMarcTermCollector for acquiring data
  from non-MARC records.

* Adds new column to tag table and inserts
  corresponding RecJson fields as another
  non-MARC value for 'tag'.

* Enhances test suite acordingly.

Signed-off-by: Grzegorz Szpura <grzegorz.szpura@cern.ch>
Tested-by: Tibor Simko <tibor.simko@cern.ch>
BibIndex: recjson fields in admin interface

* Admin interface shows recjson fields
  in logical fields overview.

* Fields and tags are shown directly in index
  overview.

* Edition of tag enhanced with option to
  change value for recjson field.

Signed-off-by: Grzegorz Szpura <grzegorz.szpura@cern.ch>
Tested-by: Tibor Simko <tibor.simko@cern.ch>
Merge branch 'master' into next

* master:
  BibIndex: recjson fields in admin interface
  BibIndex: indexing non-MARC standards
  BibIndex: abstraction layer for terms retrieval
  BibIndex: WordTable API changes
  BibIndex: move helper functions to utils file

* Merge note: creation of fixtures and  movement of new files will be
  done in the next commits.

Conflicts:
	invenio/legacy/bibindex/adminlib.py
	invenio/legacy/bibindex/engine.py
	invenio/legacy/bibindex/engine_utils.py
	invenio/legacy/search_engine/__init__.py
	invenio/modules/indexer/testsuite/test_indexer_engine.py
	invenio/modules/indexer/tokenizers/BibIndexAuthorCountTokenizer.py
	invenio/modules/indexer/tokenizers/BibIndexDOITokenizer.py
	invenio/modules/indexer/tokenizers/BibIndexJournalTokenizer.py
	invenio/modules/records/testsuite/fields/atlantis.cfg
	invenio/modules/upgrader/upgrades/invenio_2013_03_20_idxINDEX_synonym_kb.py
	modules/bibindex/lib/Makefile.am
	modules/bibindex/lib/bibindex_regression_tests.py
	modules/bibupload/lib/bibupload_regression_tests.py
	modules/websearch/lib/websearch_regression_tests.py

Signed-off-by: Esteban J. G. Gabancho <esteban.gabancho@gmail.com>
bibindex: move new files to legacy and fix imports

Signed-off-by: Esteban J. G. Gabancho <esteban.gabancho@gmail.com>
records: move new recordext function to records

Signed-off-by: Esteban J. G. Gabancho <esteban.gabancho@gmail.com>
search: update of fixtures and models

* Updates `Tag` fixtures and models accordingly to the new indexer
  capabilities to index non-marc records.

Signed-off-by: Esteban J. G. Gabancho <esteban.gabancho@gmail.com>
BibField: fix copyright field names

* Fixes a typo for one of the copyright fields and also changes its name
  to `copyright_status` to avoid duplicate names.  (closes #1933)

Signed-off-by: Esteban J. G. Gabancho <esteban.gabancho@gmail.com>
Reviewed-by: Tibor Simko <tibor.simko@cern.ch>
Merge branch 'master' into next

* master:
  BibField: fix copyright field names
installation: setuptools-bower to development

* Moves the setuptools-bower dependency to the development
  extra_require.

Signed-off-by: Yoan Blanc <yoan.blanc@cern.ch>
Reviewed-by: Lars Holm Nielsen <lars.holm.nielsen@cern.ch>
deposit: addition of holding pen

* Adds the deposition to the Holding Pen so it gets approved
  or rejected by an administrator.

Signed-off-by: Pedro Gaudêncio <pedro.gaudencio@cern.ch>
Reviewed-by: Javier Martin Montull <javier.martin.montull@cern.ch>
global: old bundle names

* Fixes the old bundle names that have been left over.

Signed-off-by: Yoan Blanc <yoan.blanc@cern.ch>
Reviewed-by: Lars Holm Nielsen <lars.holm.nielsen@cern.ch>
search: inline script as a separate file

* Moves the inline code into a separate javascript.

* Refactors the module to use AMD syntax.

* Fixes the search_list to position itself according to its parent
  and not some element that may not exist.

Signed-off-by: Yoan Blanc <yoan.blanc@cern.ch>
Reviewed-by: Charalampos Tzovanakis <charalampos.tzovanakis@cern.ch>
Reviewed-by: Kamil Neczaj <kamil.neczaj@cern.ch>
search: mustache templates via hgn

* Adds the hogan plugin to require.js (hgn.js).

* Uses some mustache templates from JavaScript code.

Signed-off-by: Yoan Blanc <yoan.blanc@cern.ch>
Reviewed-by: Charalampos Tzovanakis <charalampos.tzovanakis@cern.ch>
Reviewed-by: Kamil Neczaj <kamil.neczaj@cern.ch>
deposit: field messages fix

* Fixes field info/warning/error/success messages, according to
  Bootstrap's newest documentation; also, adds a variable that prepares
  for future changes on the 'error' field name.

Signed-off-by: Pedro Gaudêncio <pedro.gaudencio@cern.ch>
Reviewed-by: Javier Martin Montull <javier.martin.montull@cern.ch>
deposit: string fix in templates

* Fixes all strings in templates to be translatable.  (addresses #1915)

Signed-off-by: Eirini Psallida <eirini.psallida@cern.ch>
Reviewed-by: Lars Holm Nielsen <lars.holm.nielsen@cern.ch>
utils: arXiv persistent identifier fix

* Allows 'arXiv:' prefix not to be included in the arXiv ID.

Signed-off-by: Pedro Gaudêncio <pmgaudencio@gmail.com>
Reviewed-by: Javier Martin Montull <javier.martin.montull@cern.ch>
installation: jellyfish to 0.3

Signed-off-by: Yoan Blanc <yoan.blanc@cern.ch>
Reviewed-by: Lars Holm Nielsen <lars.holm.nielsen@cern.ch>