BibIndex: improve virtual index queue tests

* Refactors the regression test `BibIndexVirtualIndexQueueTableTest`,
  in order to keep the queue table clean even if a test fails.

Signed-off-by: Federico Poli <federico.poli@cern.ch>
BibUpload: factor out step 6

* Move out the job end dates updating in a separate function
  to be able to call it in tests.
BibIndex: test concurrent bibupload and bibindex
BibIndex: do not use hstRECORD

* Disables the filtering step that uses `hstRECORD` table:
  set always `force_all_indexes=True` when calling
  `find_affected_records_for_index`

* Fixes `find_affected_records_for_index` when called with `recIDs=[]`

* Fixes some regression test that relied on the utilization of
  `hstRECORD` in BibIndex

Signed-off-by: Federico Poli <federico.poli@cern.ch>
BibFormat: HTML validation fixes for citation tab

Signed-off-by: Jan Aage Lavik <jan.age.lavik@cern.ch>
sequtils: robust cnum generation

* Implements more robust cnum generation by not assuming that, if only
  1 cnum is found in the seqSTORE with a given base, it doesn't already
  have version as a suffix.

Signed-off-by: Samuele Kaplun <samuele.kaplun@cern.ch>
Merge pull request #62 from kaplun/fix-cnum-in-prod

sequtils: robust cnum generation
sequtils: amend previous commit
Merge pull request #63 from kaplun/fix-cnum-in-prod

sequtils: amend previous commit
sequtils: amend previous fix
Merge pull request #64 from kaplun/fix-cnum-in-prod

sequtils: amend previous fix
Merge pull request #57 from fpoli/prod-bibindex-disable-hstrecord

BibIndex: do not use hstRECORD
BibAuthorID: Fixed handling of timeouts when fetching titles.

 Signed-off-by: Artem Tsikiridis <artem.tsikiridis@cern.ch>
OAIHarvest: error reporting fix

* Adapts reporting to new repo format.  (closes #1804) (PR #1812)

Reviewed-by: Tibor Simko <tibor.simko@cern.ch>
Merge pull request #37 from fpoli/prod-websearch-journal-hint-service

WebSearch: service JournalHintService
BibDocFile: memory leak in bibdocfiles.BibDoc fix

* Fixes a memory leak in BibDocFile module where BibDoc instances were
  referring to BibDocFiles and viceversa, by using weakref.ref().
  (closes #2082)

Signed-off-by: Samuele Kaplun <samuele.kaplun@cern.ch>
Reported-by: Thorsten Schwander <thorsten.schwander@gmail.com>
WebSearch: journal hint service utf8 fix

* Fixes journal hint service: decodes utf8 before passing the query
  to `search_from_reference`

* Adds regression test to journak hint service for the utf8 query

* Adds two unit tests to `search_from_reference`, just to be sure that
  it accepts unicode

Signed-off-by: Federico Poli <feedrico.poli@cern.ch>
Merge pull request #67 from fpoli/prod_websearch_journal_hint_utf8

WebSearch: journal hint service utf8 fix
OPS: BibDocFile: bibdocfile.BibDoc memory fix

* Fixes a memory leak in BibDocFile module where BibDoc instances were
  referring to BibDocFiles and viceversa, by using weakref.ref().
  (closes #2082) (PR #2136)

Signed-off-by: Samuele Kaplun <samuele.kaplun@cern.ch>
Reported-by: Thorsten Schwander <thorsten.schwander@gmail.com>
Tested-by: Tibor Simko <tibor.simko@cern.ch>

Conflicts:
	modules/bibdocfile/lib/bibdocfile.py
	modules/bibdocfile/lib/bibdocfile_regression_tests.py
WebLinkback: reliable linkback sorting

* Order linkbacks by id when they have the same insert date in
  test_get_approved_latest_added_linkback so that tests pass reliably.