added a bunch of tests for both regex and tokenized field-types + added enableRegex flag to ln_ctx which enables/disables use of regex based fields (such a flag is required because regex is perf-sensitive and it will allow us to warn the users when they look at documentation for enableRegex flag, it is kept disabled by default because of perf-sensitivity)