Hugging Face model: Ayush-1722/Mistral-7B-Instruct-v0.1-Summarize-64K-LoRANET-Merged
Author: Ayush-1722
Created: 2024-05-14 00:54:48
Last modified: 2024-06-19 12:46:50
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 11
Tags: transformers, safetensors, mistral, text-generation, finetuned, summarize, instruct, 200K+ Context Length, question answering, LoRA, Theta Scaling, Norm & Embed Trained,  Big Patents, chat, 7B, research, science, RoPE , Long Context, conversational, dataset:RMT-team/babilong, dataset:RMT-team/babilong-1k-samples, dataset:Trelis/big_patent_100k_characters, dataset:facebook/babi_qa, arxiv:2310.06825, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata:
license: apache-2.0
pipeline_tag: text-generation
tags: finetuned, summarize, instruct, 200K+ Context Length, question answering, LoRA, Theta Scaling, Norm & Embed Trained,  Big Patents, chat, 7B, research, science, RoPE , Long Context, conversational
inference: yes
datasets: RMT-team/babilong, RMT-team/babilong-1k-samples, Trelis/big_patent_100k_characters, facebook/babi_qa
metrics: accuracy, perplexity