Text Generation
Transformers
PyTorch
mpt
Composer
MosaicML
llm-foundry
conversational
custom_code
text-generation-inference

Left padding is not supported in mpt-30b, explicitly set the padding side to right.

sam-mosaic changed pull request status to merged

Sign up or log in to comment