|
--- |
|
license: cc-by-sa-4.0 |
|
metrics: |
|
- accuracy |
|
pipeline_tag: text-generation |
|
tags: |
|
- code |
|
--- |
|
|
|
A capable language model for text to SQL generation for Postgres, Redshift and Snowflake that is on-par with the most capable generalist frontier models. |
|
|
|
 |
|
|
|
## Model Description |
|
|
|
Developed by: Defog, Inc |
|
Model type: [Text to SQL] |
|
License: [CC-by-SA-4.0] |
|
Finetuned from model: [Meta-Llama-3-8B-Instruct] |
|
|
|
## Demo Page |
|
[https://defog.ai/sqlcoder-demo/](https://defog.ai/sqlcoder-demo/) |
|
|
|
## Ideal prompt and inference parameters |
|
Set temperature to 0, and do not do sampling. |
|
|
|
### Prompt |
|
``` |
|
<|begin_of_text|><|start_header_id|>user<|end_header_id|> |
|
|
|
Generate a SQL query to answer this question: `{user_question}` |
|
{instructions} |
|
|
|
DDL statements: |
|
{create_table_statements}<|eot_id|><|start_header_id|>assistant<|end_header_id|> |
|
|
|
The following SQL query best answers the question `{user_question}`: |
|
```sql |
|
|
|
``` |
|
|
|
## Evaluation |
|
This model was evaluated on SQL-Eval, a PostgreSQL based evaluation framework developed by Defog for testing and alignment of model capabilities. |
|
|
|
You can read more about the methodology behind SQLEval [here](https://defog.ai/blog/open-sourcing-sqleval/). |
|
|
|
## Contact |
|
Contact us on X at [@defogdata](https://twitter.com/defogdata), or on email at founders@defog.ai |
