README.md

metadata

license: apache-2.0
datasets:
  - ecastera/wiki_fisica
  - ecastera/filosofia-es
  - bertin-project/alpaca-spanish
language:
  - es
  - en
tags:
  - mistral
  - spanish
  - español
  - lora
  - int4
  - multilingual

ecastera-eva-westlake-7b-spanish

Mistral 7b-based model fine-tuned in Spanish to add high quality Spanish text generation.

• Exported in GGUF format, INT4 quantization
• Refined version of my previous models, with new training data and methodology. This should produce more natural reponses in Spanish.
• Base model Mistral-7b
• Based on the excelent job of senseable/WestLake-7B-v2 and Eric Hartford's cognitivecomputations/WestLake-7B-v2-laser
• Fine-tuned in Spanish with a collection of poetry, books, wikipedia articles, phylosophy texts and alpaca-es datasets.
• Trained using Lora and PEFT and INT8 quantization on 2 GPUs for several days.

Usage:

Use in llamacpp or other framework that supports GGUF format.