Merge pull request #1 from renepickhardt/ngrambuilder

Ngrambuilder
using theris
improved eval framework using inheritence especially changed the format of result log since there was a bug also fixed this in the eval script
removing of old tests
mavenized project not completly done yet
added a bzip2 lib to pom
changed bzip2 lib
fixed bug in Config.txt please check google ngram builder which caused it
slight bugfixes to get wikingrambuilder running. look at data splitter
cleaned up config.txt and config.java more can be done here but we need ideas for this
Merge branch 'mavenize' into develop
merged mavenize branch project is now mavenized. there is a need for bugfix and controll of data flow but in principle the following tasks work: parse text and split it to training learning and test data. create ngrams and typology edges from training data. put ngrams and typology edges in indices. run evaluation on typology and ngrams (language models) already some preperation for learning weights. logfiles from evaluation are created and scripts for analyzing exist. as mentioned we need bugfixing and dataflow controll
config.txt is anoying... about to merge develop to master
resolved conflicts in Config.java
added a preliminare version of the TestSamplingEffects Evaluationframework and commented more code
updated pomxml set heapsapce there now. also changed the evaluater to english wiki
added CopyDirectory (copy&paste from
git://github.com/renepickhardt/graphity-evaluation.git)
implemented part2runTests()
changes at GoogleNGramBuilder to normalize and filter ngrams
build new class for normalizing and filtering google ngrams