Improve smode in language model