Endpoint encountered an error
2
#5 opened about 1 year ago
by
vanokio

You are using a model of type mixtral_aqlm to instantiate a model of type mixtral. This is not supported for all configurations of models and can yield errors.
3
#3 opened about 1 year ago
by
Tejasram
Loading Model on AWS G5.4xlarge Instance Results in 'killed' Message
1
#2 opened about 1 year ago
by
Tejasram