initial commit
- bug fix: SentenceSplitter fixed - now it reads input correctly
- bug fix: time tagging with sutime fixed (was error in output collecting)
- input format of both: ReutersNewsAccess and LuceneIndexAccess adjusted to new data model
- bug-fix: errors in ReutersNewsAccessTest fixed
- code structure changed (more classes moved to model submodule)
- bug fixes: error (when reading input of sutime) in JsonArrayReader fixed
- meta data in event extractor now set correctly
- conll output file will not be created
- the input format for reuters news is now working correctly with data
from HDFS
- the input format for reuters news can read now full directories (both:
HDFS and local)
- junit tests extended
- stanford models file changed (this works better with event extractor)
- small bugfixes & improvements
- modify .gitignore and add library required for executing operators...
- additional tests + small improvements
- small correction to previous push...
- new maven submodule pawel-dist
- tests corrected
- reuters news input format extended (now it can also load many news
from single file)
- "big" property corrected (on ReutersNewsAccess)
- JsonConverterTest fixed
- compile 1.7 changed to 1.6 (some changes in code because of this had
to be done)
- optimizing
- mate-tools library and models upgraded (2.0 -> 3.3)
- ReutersNewsAccess can now skip news containing tables
- SentenceSplitterSopremoOperator can filter texts according to amount
of sentecnes/tokens
- new operator for annotation counting
- some bugfixes (path to reuters-news directory; reuters-news with
line-breaks; ...)
- a lot of new tests
- Reuters News Access operator - read from HDFS corrected (no hadoop
home needed)
- Time Tagger operator - language and input type now really optional...
- small bugfixes in implementation of summarization algorithms
- new tests
- timespan annotations corrected
- cosine similarity calculation improved