patch to allows us to set the charset if supplied with the mimetype
added static const and put charset in comment for now
made changes based on mathieus recommendation to check the delimiter
removed boost/tokenizer since its not used, and refactored code to make it more obvious
Merge pull request #139 from rtbkit/id_provider

patch to allows us to set the charset if supplied with the mimetype