mosaicml
/

mpt-30b-chat

Text Generation

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (13)

Adding `safetensors` variant of this model

#29 opened about 1 month ago by

Response

#20 opened 8 months ago by

How to use all gpu?

#19 opened 9 months ago by

How to only get the model answer as output

#18 opened 9 months ago by

Why inference is very slow?

#17 opened 9 months ago by

mosaicml/mpt-30b-chat on sagemaker ml.p3.8xlarge

#16 opened 9 months ago by

How to Finetune mpt-30b-chat?

#15 opened 10 months ago by

Decreased performance with recent updated model?

#14 opened 10 months ago by

The model keeps generating up to the maximum length but no EOS token.

#13 opened 10 months ago by

could yo provide a prompt template

#11 opened 10 months ago by

DIfferent results here in the chat and locally

#10 opened 10 months ago by

how to load the model with multiple GPUs

#9 opened 10 months ago by

How many GPUs for this model to run this fast?

#8 opened 11 months ago by

The model is extremelly slow in 4bit, is my code for loading ok?

#7 opened 11 months ago by

How to run on Colab's CPU?

#4 opened 11 months ago by

Sagemaker endpoint inference script help?

#3 opened 11 months ago by