before changeing arguments
including all token types feature
modify os.listdir, createfolder, & clustering