Hugging Face model: nicholasKluge/Aira-2-124M-DPO
Author: nicholasKluge
Created: 2023-12-03 17:47:39
Last modified: 2025-06-09 12:11:03
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 14
Tags: transformers, pytorch, safetensors, gpt2, text-generation, alignment, instruction tuned, text generation, conversation, assistant, dpo, en, dataset:nicholasKluge/instruct-aira-dataset, dataset:nicholasKluge/reward-aira-dataset, arxiv:1803.05457, arxiv:2109.07958, arxiv:2203.09509, base_model:nicholasKluge/Aira-2-124M, base_model:finetune:nicholasKluge/Aira-2-124M, license:apache-2.0, co2_eq_emissions, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: nicholasKluge/Aira-2-124M
Card metadata:
license: apache-2.0
datasets: nicholasKluge/instruct-aira-dataset, nicholasKluge/reward-aira-dataset
language: en
metrics: accuracy
library_name: transformers
tags: alignment, instruction tuned, text generation, conversation, assistant, dpo
pipeline_tag: text-generation
inference: parameters: repetition_penalty: 1.2
temperature: 0.1
top_k: 50
top_p: 1
max_new_tokens: 200
early_stopping: yes
co2_eq_emissions: emissions: 150
source: CodeCarbon
training_type: fine-tuning
geographical_location: United States of America
hardware_used: NVIDIA A100-SXM4-40GB
base_model: nicholasKluge/Aira-2-124M