---
library_name: peft
license: apache-2.0
language:
- en
pipeline_tag: text-generation
tags:
- fine-tuned
inference:
  parameters:
    temperature: 0.7
---
## Training procedure
The TSOTSALLM-beta Large Language Model (LLM) is a fine-tuned generative text model based on LLama-2 with 7 billions parameters. 

## Model Architecture
TSOTSALLM-beta is a transformer model, with the following architecture choices:
- Grouped-Query Attention
- Sliding-Window Attention
- Byte-fallback BPE tokenizer
## The TSOTSALLM AI Team
- Jean Petit BIKIM
- Fidel Jiomekong
- Martins Folefack
- Brice