defog

/

sqlcoder

like 302

(edit) Hi @alfgo , you should be able to use vllm with our model out of the box as it is a GPTBigCodeForCausalLM model, which VLLM supports out of the box: https://vllm.readthedocs.io/en/latest/models/supported_models.html