added test files
should support directories
token flag now works for directories
fixed bug in removing comments
removed debugging prints