Refactor to use TokenDrain class to encapsulate token processing

git-svn-id: https://bigdata.svn.sourceforge.net/svnroot/bigdata/branches/PIPELINE_RESYNC@7633 8f7bc0f5-282e-0410-95e3-8d296e9bb460