Hugging Face model: mitch7w/falcon-7b-midjourney-example
Author: mitch7w
Created: 2023-09-20 07:26:15
Last modified: 2023-09-20 09:41:16
Pipeline: text-generation
Library: peft
Likes: 0 | Downloads: 0
Tags: peft, text-generation, dataset:tiiuae/falcon-refinedweb, license:openrail, region:us
Card metadata:
license: openrail
library_name: peft
pipeline_tag: text-generation
datasets: tiiuae/falcon-refinedweb
model_parameters: base_model_name_or_path: vilsonrodrigues/falcon-7b-instruct-sharded
bias: none
fan_in_fan_out: no
inference_mode: yes
init_lora_weights: yes
lora_alpha: 32
lora_dropout: 0.05
peft_type: LORA
r: 16
target_modules: query_key_value
task_type: CAUSAL_LM