---
license: apache-2.0
datasets:
- vietgpt/wikipedia_vi
- oscar-corpus/OSCAR-2301
language:
- vi
- en
pipeline_tag: text-generation
---

# Concept of open-llama-7b-vi

This is a OpenLLama model finetuned on texts in the Vietnamese language.

## Model architecture

The model architecture is the same as the original OpenLLama model

## Training Data

The models are trained on the Vietnamese version of Wikipedia.
The generated corpus files are 1.5GB in total, containing approximately 1.3M sentences.