remove language model from a module that doesn't use it anymore