more work on re-uzing tokenization from preprocessor, nonbuildable, working from elsewhere