mapping to token and pos combined format