tenderlove/rexical — pull request #3 by jtoman (2012-02-25 00:34:54+00:00)
Title: Allow matching against the end of string

In a parser we wrote using Rex we needed to generate and EOF token. Rexical does not allow matching against the end of the string by default. This commit allows matching against the end of string with the matcheos option. If the end of string is not matched, then by default next_token returns nil as if matcheos was not enabled.