Hugging Face's logo

SungJoo
/
llama2-7b-sft-detox

Text Generation
Transformers
Safetensors
English
llama
causal-lm
Large Language Model
LLM
detoxification
unbias
bias
instruction
finetuned
llama2
text-generation-inference
Inference Endpoints
Model card Files Community
llama2-7b-sft-detox / README.md
SungJoo's picture
SungJoo
Update README.md
7ac31ac verified
preview code
|
raw
history blame
No virus
3.19 kB
metadata
library_name: transformers
license: apache-2.0
language:
  - en
tags:
  - causal-lm
  - Large Language Model
  - LLM
  - detoxification
  - unbias
  - bias
  - instruction
  - finetuned
  - llama2

Model Card for Model ID

This model is an instruction-tuned version of meta-llama/Llama-2-7b-hf.

We construct a comprehensive instruction dataset for detoxification of LLMs, and fine-tuned this model.

Model Details

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: [More Information Needed]
  • Funded by [optional]: [More Information Needed]
  • Shared by [optional]: [More Information Needed]
  • Model type: [More Information Needed]
  • Language(s) (NLP): [More Information Needed]
  • License: [More Information Needed]
  • Finetuned from model [optional]: [More Information Needed]

Model Sources [optional]

  • Repository: [More Information Needed]
  • Paper [optional]: [More Information Needed]
  • Demo [optional]: [More Information Needed]

Uses

Direct Use 

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("SungJoo/llama2-7b-sft-detox")
model = AutoModelForCausalLM.from_pretrained("SungJoo/llama2-7b-sft-detox")


### Out-of-Scope Use

<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->

[More Information Needed]

## Bias, Risks, and Limitations

<!-- This section is meant to convey both technical and sociotechnical limitations. -->

[More Information Needed]

### Recommendations

<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

## How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]

## Training Details

### Training Data

<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->

[More Information Needed]

### Training Procedure

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->


#### Training Hyperparameters

- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->


## Model Card Contact

byunsj@snu.ac.kr