branch dump
only used by live, doesn't belong here. Will crash with a ClassCastException if used anywhere else. Several other bugs/problems.
Only used by live, doesn't belong here. Used wrong dataset and too many magic strings.
Renamed dataset 'revisions' to 'revision_ids'. Added dataset 'revision_uris'. Added RevisionUriExtractor. Minor cleanup in RevisionIdExtractor, which generates silly triples anyway...
Renamed dataset 'revisions' to 'revision_ids'.
removed modules live and wiktionary
removed modules live and wiktionary
removed openrdf dependency & classes and some other classes.
comment: "FIXME: does this make sense? We should probably use the DBpedia resource URI as subject"; use QuadBuilder
cosmetics
removed LiveWikiPage / LivePageNode
bugfix: don't use WikiTitle.toString(), and properly encode the title. Luckily, the title is rarely used, so this messed up probably only a few thousand abstracts in 3.8.
.bz2 -> .gz, using pigz
27 bits per title, 10 bits per language, one link array per language
comment: TODO: only extract triple if IRI is different from URI
renamed MapSubjectUris to CanonicalizeUris and extended functionality: map all URIs, not just subjects; introduce DateFinder to get better separation of concerns;
bugfix: return value
comments
find out if all pairs of files have almost the same number of bytes
finding out if all pairs of files have almost the same number of bytes works better with relative comparison