Skeleton of HmtTokenizer.