Move token processing into another file, add to build. Add pkt_reader.