Hugging Face model: jshuadvd/LongRoPE
Author: jshuadvd
Created: 2024-04-05 03:19:34
Last modified: 2024-07-20 04:45:11
Pipeline: text-generation
Likes: 6 | Downloads: 0
Tags: large-language-models, text-generation, context-extension, transformer-models, fine-tuning, long-contexts, natural-language-processing, context-window, context-length, nlp, llm, llm-context-window, llm-context-length, dataset:pg19, dataset:wikitext, dataset:custom-dataset, arxiv:2402.13753, region:us
Card metadata:
tags: large-language-models, text-generation, context-extension, transformer-models, fine-tuning, long-contexts, natural-language-processing, context-window, context-length, nlp, llm, llm-context-window, llm-context-length
datasets: pg19, wikitext, custom-dataset
metrics: perplexity, accuracy