set token delimiters configurable and changed defaults to $