mistralai

/

Mamba-Codestral-7B-v0.1

like 481

Have you tried the example here https://github.com/mistralai/mistral-inference?tab=readme-ov-file#python
FWIW, the example uses codestral.

Hi there, Mamba Codestral does not support FIM, only Instruct

@pandora-s Can you please elaborate on this? The example shows an FIM scenario, but is it not recommended to use OOB Mamba Codestral in an FIM setting?

@Kartik305 The example uses Codestral 22B that has FIM support, Mamba Codestral 7B only has Instruct support and not FIM. I hope this answers!

@pandora-s Thanks for answering. I was inspecting using it as a code completion assistant, but without having FIM, might have to switch to the larger 22B model.