shailja commited on
Commit
f4e84b6
1 Parent(s): 65ad462

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -50,7 +50,7 @@ extra_gated_fields:
50
 
51
  ## Model Summary
52
 
53
- The CodeGen models are 15.5B parameter models trained on 80+ programming languages from [The Stack (v1.2)](https://huggingface.co/datasets/bigcode/the-stack), with opt-out requests excluded. The model uses [Multi Query Attention](https://arxiv.org/abs/1911.02150), [a context window of 8192 tokens](https://arxiv.org/abs/2205.14135), and was trained using the [Fill-in-the-Middle objective](https://arxiv.org/abs/2207.14255) on 1 trillion tokens.
54
 
55
  - **Repository:** [shailja-thakur/VGen](https://github.com/shailja-thakur/VGen)
56
  - **Baseline LLM** [SalesForce/CodeGen](https://github.com/salesforce/CodeGen)
 
50
 
51
  ## Model Summary
52
 
53
+ The VeriGen model is 2B parameter model is a fine-tuned version of [CodeGen-multi-2B](https://github.com/salesforce/codegen), trained on [Verilog Dataset](https://huggingface.co/datasets/shailja/Verilog_GitHub), with a context length of 2048.
54
 
55
  - **Repository:** [shailja-thakur/VGen](https://github.com/shailja-thakur/VGen)
56
  - **Baseline LLM** [SalesForce/CodeGen](https://github.com/salesforce/CodeGen)