Fit a language model, then train a supervised model using lm initialized weights and bias