Modified DelimitersExtractor interface
Modified tokenize interface
Now using boost::split_regex instead of boost::split so it'd work with delimiters with more than one character
I can extract delimiters with more than one character
It can use delimiters with several characters as long as they are legal in regular expressions
It uses additional delimiters of any longitude even if they are used in regular expressions