chrismattmann/etllib — pull request #16 by zichuanwang (2014-09-26 23:32:16+00:00)
Title: Speed up encoding and decoding

By providing a file containing suggested encoding symbols, the tsvtojson function can now guess encoding before perform the expensive magic.from_buffer operation.

Tested on 1000 rows of employment data, the old version takes about 60 seconds while the new version only takes 846ms.