Lorenzo Cevolani's picture

10

Lorenzo Cevolani

LorenzoCevolaniAXA

·

AI & ML interests

NLP, Transformers, GNN and many more!

Organizations

LorenzoCevolaniAXA's activity

New activity in neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 3 days ago

weights does not exist when trying to deploy in sagemaker endpoint

#1 opened 3 days ago by

LorenzoCevolaniAXA

New activity in mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit 4 months ago

error in sagemaker deployement

#2 opened 4 months ago by

LorenzoCevolaniAXA

New activity in text-generation-inference/Mixtral-8x7B-Instruct-v0.1-medusa 4 months ago

What about latencies

#3 opened 4 months ago by

LorenzoCevolaniAXA

New activity in ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ 4 months ago

latency is slower than standard model, is it normal?

#5 opened 4 months ago by

LorenzoCevolaniAXA

New activity in text-generation-inference/Mixtral-8x7B-Instruct-v0.1-medusa 4 months ago

how to use this model on sagemaker endpoints

#1 opened 6 months ago by

LorenzoCevolaniAXA

New activity in CohereForAI/c4ai-command-r-v01 5 months ago

Error "sharded is not supported for AutoModel" when deploying on sagemaker endpoint

#22 opened 5 months ago by

LorenzoCevolaniAXA

New activity in CohereForAI/aya-101 6 months ago

Correct machine to deploy the model on AWS Sagemaker

#11 opened 6 months ago by

LorenzoCevolaniAXA

New activity in mistralai/Mixtral-8x7B-Instruct-v0.1 8 months ago

SageMaker Deployment Error

#53 opened 8 months ago by

New activity in intfloat/multilingual-e5-large 10 months ago

Sagemaker Instance suggestion for Inference

#18 opened 10 months ago by

LorenzoCevolaniAXA

New activity in DAMO-NLP-MT/polylm-chat-13b about 1 year ago

protoc error while deploying the model into SM instance

#1 opened about 1 year ago by

LorenzoCevolaniAXA