fozziethebeat/S-Space — pull request #55 by shulhi (2014-07-10 14:41:06+00:00)
Title: Setting `inputFormat` to TEXT or SPARSE_TEXT doesn't write to file (Hadoop RI)

There are two bugs when running the Hadoop RI.

1. Whenever the supplied `--inputFormat` is either `TEXT` or `SPARSE_TEXT`. Somehow, the buffer didn't get flushed even on `close()`. So, I manually flush the buffer everytime it is calling the write method. It is also not flushing the buffer when writing the header of file (called during `writeEmptyHeader()`)

2. There is logic error when iterating each occurrences of word. It caused the last occurrence of word to not be printed. i.e. If my document is `you know nothing Jon Snow`, it writes the vector for all except the last word `Snow`. Not necessarily the last word in the sentence though, depends how it got sorted during mapper-reducer phase, but one of the words will definitely be missing when writing to file.

Anyway, thanks for the great package!