infosys
/

NT-Java-1.1B

Text Generation

NarrowTransformer

text-generation-inference

Inference Endpoints

Model card Files Files and versions

rajabmondal commited on Jul 8, 2024

Commit

3a41458

·

verified ·

1 Parent(s): 57607a0

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -45,7 +45,7 @@ duplicated_from: bigcode-data/starcoderbase-1b
 The Narrow Transformer (NT) model **NT-Java-1.1B** is an open-source specialized code model built by extending pre-training on StarCoderBase-1B, designed for coding tasks in Java programming. The model is a decoder-only transformer with Multi-Query Attention and with a context length of 8192 tokens. The model was trained with Java subset of the StarCoderData dataset, which is ~22B tokens.
 - **Repository:** [Infosys/Megatron-LM](https://github.com/Infosys/Megatron-LM)
-- **Paper:**
 - **Language(s):** Java
   <br>

 The Narrow Transformer (NT) model **NT-Java-1.1B** is an open-source specialized code model built by extending pre-training on StarCoderBase-1B, designed for coding tasks in Java programming. The model is a decoder-only transformer with Multi-Query Attention and with a context length of 8192 tokens. The model was trained with Java subset of the StarCoderData dataset, which is ~22B tokens.
 - **Repository:** [Infosys/Megatron-LM](https://github.com/Infosys/Megatron-LM)
+- **Paper:** [Narrow Transformer: Starcoder-Based Java-LM For Desktop](https://arxiv.org/abs/2407.03941)
 - **Language(s):** Java
   <br>