Possible limitations of language models are sensitivity to input phrasing and potential bias from training data. Sometimes LLMs are unable to fully understand context, nonsensical outputs, and challenges with handling rare or complex language constructs.