dmarx/dmarx-github-stars huggingface dataset:
Repository: BlinkDL/RWKV-LM
Description: RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
Language: Python
Topics: attention-mechanism, chatgpt, deep-learning, gpt, gpt-2, gpt-3, language-model, linear-attention, lstm, pytorch, rnn, rwkv, transformer, transformers
Repository: OFA-Sys/OFA
Description: Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
Language: Python
Topics: chinese, image-captioning, multimodal, pretrained-models, pretraining, prompt, prompt-tuning, referring-expression-comprehension, text-to-image-synthesis, vision-language, visual-question-answering