tminglei/slick-pg — pull request #17 by hsyed (2013-12-02 18:41:01+00:00)
Title: Slick1

Here are the tokenizer - and token merging function implementations. Certain guard scenarios I have chosen not to implement as the data always comes from Postgres. I have only tested the code against various shapes of Row/Array data generated by just doing selects in psql with strings and ints.

```
select Array[Row(1,Array[Row('tw o',Array[Row('thre e',Array[Row('fou r')])])])];
```

I am sure there will be kinks with real data. I suggest you put failing data in a txt file newline separated and we can use those to drive unit tests. If you find something that fails I'll pull and fix :D