mohammedbriman (Mohammed Brıman)

upvoted a paper about 13 hours ago

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning

Paper • 2405.12130 • Published 1 day ago • 30

upvoted a paper 2 days ago

LoRA Learns Less and Forgets Less

Paper • 2405.09673 • Published 6 days ago • 61

upvoted 2 papers 6 days ago

SUTRA: Scalable Multilingual Language Model Architecture

Paper • 2405.06694 • Published 14 days ago • 34

What matters when building vision-language models?

Paper • 2405.02246 • Published 18 days ago • 81

upvoted a paper 13 days ago

You Only Cache Once: Decoder-Decoder Architectures for Language Models

Paper • 2405.05254 • Published 13 days ago • 5

upvoted an article 15 days ago

Article

SeeMoE: Implementing a MoE Vision Language Model from Scratch

By

•

15 days ago

• 24

upvoted 3 papers 16 days ago

upvoted 2 papers 19 days ago

Make Your LLM Fully Utilize the Context

Paper • 2404.16811 • Published 26 days ago • 51

Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models

Paper • 2405.01535 • Published 19 days ago • 94

upvoted a paper 23 days ago

Question Aware Vision Transformer for Multimodal Reasoning

Paper • 2402.05472 • Published Feb 8 • 6

upvoted a paper 27 days ago

FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores

Paper • 2311.05908 • Published Nov 10, 2023 • 11

upvoted 4 papers 28 days ago

Multi-Head Mixture-of-Experts

Paper • 2404.15045 • Published 28 days ago • 53

Transformers Can Represent n-gram Language Models

Paper • 2404.14994 • Published 29 days ago • 17

Pegasus-v1 Technical Report

Paper • 2404.14687 • Published 29 days ago • 29

OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework

Paper • 2404.14619 • Published 29 days ago • 120

upvoted 3 papers 29 days ago

How Good Are Low-bit Quantized LLaMA3 Models? An Empirical Study

Paper • 2404.14047 • Published 30 days ago • 37

The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions

Paper • 2404.13208 • Published Apr 19 • 37

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published 29 days ago • 230

upvoted an article 29 days ago

Article

Fine-tune Llama 3 with ORPO

By

•

29 days ago

• 180

upvoted 2 collections 29 days ago

fuck quadratic attention

Collection

11 items • Updated 27 days ago • 19

Idefics2 🐶

Collection

Idefics2-8B is a foundation vision-language model. In this collection, you will find the models, datasets and demo related to its creation. • 11 items • Updated 15 days ago • 77

upvoted a paper 29 days ago

Video as the New Language for Real-World Decision Making

Paper • 2402.17139 • Published Feb 27 • 17

upvoted 2 collections 29 days ago

Computer Vision Backbones 🧩

Collection

Collection of useful computer vision backbones to fine-tune. It also includes large image classification models, that can be used as backbone. • 22 items • Updated Sep 19, 2023 • 12

Awesome Document AI

Collection

A collection of open-source document AI 📄 📝 📈 • 27 items • Updated Mar 11 • 38

upvoted a collection 30 days ago

Vision Language Models Papers 🖼️💬📝

Collection

Papers about vision-language models, most important ones are on top of the list. • 27 items • Updated 21 days ago • 26

upvoted 2 papers 30 days ago

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

Paper • 2305.13245 • Published May 22, 2023 • 5

FABLES: Evaluating faithfulness and content selection in book-length summarization

Paper • 2404.01261 • Published Apr 1 • 3

upvoted 2 papers about 1 month ago

TransformerFAM: Feedback attention is working memory

Paper • 2404.09173 • Published Apr 14 • 42

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Paper • 2404.07143 • Published Apr 10 • 92

upvoted 2 articles about 1 month ago

Article

MTEB: Massive Text Embedding Benchmark

Oct 19, 2022

• 9

Article

Vision Language Models Explained

Apr 11

• 84

upvoted 6 papers about 2 months ago

Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models

Paper • 2403.20331 • Published Mar 29 • 14

ReALM: Reference Resolution As Language Modeling

Paper • 2403.20329 • Published Mar 29 • 20

Jamba: A Hybrid Transformer-Mamba Language Model

Paper • 2403.19887 • Published Mar 28 • 99

LLM Agent Operating System

Paper • 2403.16971 • Published Mar 25 • 62

MobileVLM V2: Faster and Stronger Baseline for Vision Language Model

Paper • 2402.03766 • Published Feb 6 • 9

Evolutionary Optimization of Model Merging Recipes

Paper • 2403.13187 • Published Mar 19 • 44

upvoted a paper 2 months ago

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

Paper • 2403.09611 • Published Mar 14 • 119

upvoted 3 papers 3 months ago

A Touch, Vision, and Language Dataset for Multimodal Alignment

Paper • 2402.13232 • Published Feb 20 • 11

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

Paper • 2402.13064 • Published Feb 20 • 45

Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model

Paper • 2402.07827 • Published Feb 12 • 43

upvoted 2 papers 4 months ago

OLMo: Accelerating the Science of Language Models

Paper • 2402.00838 • Published Feb 1 • 74

TURNA: A Turkish Encoder-Decoder Language Model for Enhanced Understanding and Generation

Paper • 2401.14373 • Published Jan 25 • 11

upvoted a collection 4 months ago

Multilingual

Collection

117 items • Updated 1 day ago • 8

upvoted 14 papers 4 months ago

LLaMA Beyond English: An Empirical Study on Language Capability Transfer

Paper • 2401.01055 • Published Jan 2 • 50

PersianMind: A Cross-Lingual Persian-English Large Language Model

Paper • 2401.06466 • Published Jan 12 • 2

A Simple Framework to Accelerate Multilingual Language Model for Monolingual Text Generation

Paper • 2401.10660 • Published Jan 19 • 2

MaLA-500: Massive Language Adaptation of Large Language Models

Paper • 2401.13303 • Published Jan 24 • 11

Orion-14B: Open-source Multilingual Large Language Models

Paper • 2401.12246 • Published Jan 20 • 10

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Paper • 2312.00752 • Published Dec 1, 2023 • 131

VMamba: Visual State Space Model

Paper • 2401.10166 • Published Jan 18 • 36

DSPy Assertions: Computational Constraints for Self-Refining Language Model Pipelines

Paper • 2312.13382 • Published Dec 20, 2023 • 2

Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws

Paper • 2401.00448 • Published Dec 31, 2023 • 25

Improving Text Embeddings with Large Language Models

Paper • 2401.00368 • Published Dec 31, 2023 • 72

Understanding LLMs: A Comprehensive Overview from Training to Inference

Paper • 2401.02038 • Published Jan 4 • 59

TinyLlama: An Open-Source Small Language Model

Paper • 2401.02385 • Published Jan 4 • 81

DocGraphLM: Documental Graph Language Model for Information Extraction

Paper • 2401.02823 • Published Jan 5 • 32

Mixtral of Experts

Paper • 2401.04088 • Published Jan 8 • 152

Mohammed Brıman

AI & ML interests

Organizations

mohammedbriman's activity

SeeMoE: Implementing a MoE Vision Language Model from Scratch

Fine-tune Llama 3 with ORPO

MTEB: Massive Text Embedding Benchmark

Vision Language Models Explained