mistralai

/

Mistral-7B-Instruct-v0.2

like 2.29k

I want to prune layers in mistral and see the results . But I am unable to do it .
What I have tried ..
I tried to create a new modulelist for model.model.layers by removing some layers it ...
But while I try to Inference from the model now .. it is breaking. Any suggestions on how to do it correctly