Are there any plans to integrate it into vanna.ai?
#7
by
cds1993
- opened
I realize that this is a very powerful NL2SQL model. Does anyone have support for integrating it into Vanna, or integrating it into ollama and then integrating it into vanna for use?
Currently I have deployed it in ollama but it seems that it cannot be used directly in vannna
Hi
@cds1993
, you can use my notebook here. If you run the defog/llama-3-sqlcoder-8b (no GGUF), you must have at least 17GB VRAM of GPU.
Link: https://drive.google.com/file/d/16Lsml9xhhViiNFTj7J-MigYpdh2jGAVl/view?usp=sharing