skeleton for token handling code
finished rough draft of compressor