metadata

language:
  - en
  - da
tags:
  - text-generation-inference
  - transformers
  - unsloth
  - mistral
  - trl
base_model: mistralai/Mistral-7B-v0.1
datasets:
  - oscar

Model description

Heidrun-Mistral-7B-base is a generative text model based on Mistral-7B. It has been further pretrained on a subset of the Danish corpus from Oscar.

The dataset was first cleaned to remove most inappropriate texts. Please note that Oscar contains explicit content, and not all may have been removed. The model was mainly trained on shorter sentences (<3000 words).

For inference or chatting please check out Heidrun-Mistral-7B-chat.

Uploaded model

Developed by: Mabeck
Finetuned from model : mistralai/Mistral-7B-v0.1

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.