Hugging Face model: TurkiYasuda/llm-jp-3-13b-it-31_lora
Author: TurkiYasuda
Created: 2024-12-15 14:56:35
Last modified: 2024-12-16 01:40:09
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, safetensors, text-generation-inference, unsloth, llama, trl, en, base_model:llm-jp/llm-jp-3-13b, base_model:finetune:llm-jp/llm-jp-3-13b, license:apache-2.0, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: llm-jp/llm-jp-3-13b
Card metadata:
base_model: llm-jp/llm-jp-3-13b
tags: text-generation-inference, transformers, unsloth, llama, trl
license: apache-2.0
language: en
dataset: ichikara-instruction-003-001-1.json　(n=1729), https://huggingface.co/datasets/DeL-TaiseiOzaki/news_summary_2024secondhalf (n=39998) total n=41,727, sample_size was reduced to 10,000 for about 1 hour learning by A100 on Colab Notebooks
How to use: Fine-tuning code "LoRA_template_unsloth_20241127-31.ipynb" and two datasets above and "elyza-tasks-100-TV_0.jsonl" should be installed. "llm-jp-3-13b-it-31_lora_4Y27output-31.jsonl" is created by "Model_Inference_Template_unsloth_20241127.ipynb", offered by the lecturer, and "elyza-tasks-100-TV_0.jsonl."