---
language:
- es
tags:
- ConvBERT
license: mit
datasets:
- large_spanish_corpus
---

# ConvBERT 

## Model Description

ConvBERT base pre-trained on large_spanish_corpus. The ConvBERT architecture has been presented in the ["ConvBERT: Improving BERT with Span-based Dynamic Convolution"](https://arxiv.org/abs/2008.02496) paper.

## Original implementation

Follow [this link](https://huggingface.co/mrm8488/convbert-base-spanish) to see the original implementation.

# How to use

Download the model by cloning the repository via:

```bash
git clone https://huggingface.co/OWG/gpt-j-6B
```

Then you can use the model. 

Because it's a `base` model you need to fine-tune it on your specific task, depending on your needs, before using it.