File size: 288 Bytes
d97087d |
1 2 3 4 5 |
[InCoder](https://huggingface.co/facebook/incoder-6B) uses a decoder-only Transformer with [Causal Masking objective](https://arxiv.org/abs/2201.07520), to train a left-to-right language model to fill in masked token segments. |Model | # parameters | | - | - | | Decoder |6.7B | |