SivilTaram (Qian Liu)

upvoted an article about 16 hours ago

Article

ZebraLogic: Benchmarking the Logical Reasoning Ability of Language Models

By

•

1 day ago

• 11

upvoted a collection 3 days ago

📈 Scaling Laws with Vocabulary

Collection

Increase your vocabulary size when you scale up your language model • 3 items • Updated 3 days ago • 2

upvoted a paper 3 days ago

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Paper • 2407.13623 • Published 4 days ago • 37

upvoted an article 4 days ago

Article

Announcing BigCodeBench-Hard, and More

By

•

4 days ago

• 6

upvoted a paper 6 days ago

Qwen2 Technical Report

Paper • 2407.10671 • Published 7 days ago • 142

upvoted 2 articles 11 days ago

Article

RegMix: Data Mixture as Regression for Language Model Pre-training

By

•

11 days ago

• 8

Article

MInference 1.0: 10x Faster Million Context Inference with a Single GPU

By

•

11 days ago

• 9

upvoted a collection 19 days ago

DICE

Collection

Self-alignment with DPO Implicit Rewards • 5 items • Updated 3 days ago • 6

upvoted a paper 20 days ago

RegMix: Data Mixture as Regression for Language Model Pre-training

Paper • 2407.01492 • Published 20 days ago • 30

upvoted a collection 21 days ago

🧬 RegMix: Data Mixture as Regression

Collection

Automatic data mixture method for large language model pre-training • 10 items • Updated 3 days ago • 4

upvoted a paper 27 days ago

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Paper • 2406.15877 • Published 30 days ago • 43

upvoted a collection 27 days ago

🌸BigCodeBench

Collection

Benchmarking Code Generation with Diverse Function Calls and Complex Instructions https://bigcode-bench.github.io/ • 7 items • Updated 4 days ago • 2

upvoted an article 29 days ago

Article

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Apr 29

• 70

upvoted 3 papers about 1 month ago

DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning

Paper • 2406.11896 • Published Jun 14 • 18

DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

Paper • 2406.11931 • Published Jun 17 • 54

Bootstrapping Language Models with DPO Implicit Rewards

Paper • 2406.09760 • Published Jun 14 • 37

upvoted an article about 1 month ago

Article

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Jun 18

• 32

upvoted 2 papers about 1 month ago

DataComp-LM: In search of the next generation of training sets for language models

Paper • 2406.11794 • Published Jun 17 • 45

Pipeline Parallelism with Controllable Memory

Paper • 2405.15362 • Published May 24 • 3

upvoted a paper about 2 months ago

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

Paper • 2405.18392 • Published May 28 • 12

upvoted a paper 3 months ago

Make Your LLM Fully Utilize the Context

Paper • 2404.16811 • Published Apr 25 • 52

upvoted a collection 3 months ago

Deita

Collection

14 items • Updated May 20 • 8

upvoted an article 3 months ago

Article

Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

Apr 16

• 11

upvoted a paper 3 months ago

Compression Represents Intelligence Linearly

Paper • 2404.09937 • Published Apr 15 • 27

upvoted a collection 3 months ago

Pile-T5

Collection

T5 trained on the Pile with Llama Tokenizer • 4 items • Updated 16 days ago • 16

upvoted an article 3 months ago

Article

StarCoder2 and The Stack v2

Feb 28

• 3

upvoted a collection 4 months ago

Chinese Tiny LLM

Collection

9 items • Updated Apr 5 • 7

upvoted an article 4 months ago

Article

Efficient Table Pre-training without Real Data: An Introduction to TAPEX

May 23, 2022

• 1

upvoted a paper 4 months ago

Sailor: Open Language Models for South-East Asia

Paper • 2404.03608 • Published Apr 4 • 17

upvoted a collection 4 months ago

DBRX

Collection

DBRX is a mixture-of-experts (MoE) large language model trained from scratch by Databricks. • 3 items • Updated Mar 27 • 90

upvoted 2 papers 4 months ago

LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models

Paper • 2403.13372 • Published Mar 20 • 58

Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset

Paper • 2403.09029 • Published Mar 14 • 54

upvoted 2 papers 5 months ago

MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing

Paper • 2212.13492 • Published Dec 27, 2022 • 2

StructLM: Towards Building Generalist Models for Structured Knowledge Grounding

Paper • 2402.16671 • Published Feb 26 • 26

upvoted a collection 5 months ago

⚓️ Sailor Language Models

Collection

Sailor: Open Language Models tailored for South-East Asia (SEA) released by Sea AI Lab. • 18 items • Updated 3 days ago • 15

upvoted 2 papers 5 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 126

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 581

upvoted a collection 5 months ago

💫 StarCoder2

Collection

StarCoder2 models and datasets! • 8 items • Updated Mar 1 • 78

upvoted 3 papers 5 months ago

upvoted 2 papers 6 months ago

Weak-to-Strong Jailbreaking on Large Language Models

Paper • 2401.17256 • Published Jan 30 • 14

Zero Bubble Pipeline Parallelism

Paper • 2401.10241 • Published Nov 30, 2023 • 22

upvoted a collection 6 months ago

TAPEX

Collection

TAPEX is the state-of-the-art table pre-training models which can be used for table-based question answering and table-based fact verification. • 10 items • Updated 11 days ago • 6

upvoted 6 papers 7 months ago

TinyLlama: An Open-Source Small Language Model

Paper • 2401.02385 • Published Jan 4 • 84

LLaMA Pro: Progressive LLaMA with Block Expansion

Paper • 2401.02415 • Published Jan 4 • 50

Active Retrieval Augmented Generation

Paper • 2305.06983 • Published May 11, 2023 • 3

From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning

Paper • 2304.07995 • Published Apr 17, 2023 • 3

S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Models

Paper • 2310.15147 • Published Oct 23, 2023 • 2

Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models

Paper • 2401.00788 • Published Jan 1 • 21

upvoted a paper 8 months ago

StarCoder: may the source be with you!

Paper • 2305.06161 • Published May 9, 2023 • 29

upvoted a paper 9 months ago

TAPEX: Table Pre-training via Learning a Neural SQL Executor

Paper • 2107.07653 • Published Jul 16, 2021 • 2

upvoted a collection 9 months ago

FLAN-T5-Large LoRA Modules

Collection

83 items • Updated Oct 19, 2023 • 2

upvoted 2 papers 9 months ago

OpenAgents: An Open Platform for Language Agents in the Wild

Paper • 2310.10634 • Published Oct 16, 2023 • 8

Lemur: Harmonizing Natural Language and Code for Language Agents

Paper • 2310.06830 • Published Oct 10, 2023 • 29

upvoted a collection 10 months ago

Model Merging

Collection

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 30 items • Updated Jun 12 • 196

upvoted 2 papers 10 months ago

Small-scale proxies for large-scale Transformer training instabilities

Paper • 2309.14322 • Published Sep 25, 2023 • 18

CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages

Paper • 2309.09400 • Published Sep 17, 2023 • 78

upvoted a paper 11 months ago

OctoPack: Instruction Tuning Code Large Language Models

Paper • 2308.07124 • Published Aug 14, 2023 • 28

upvoted a paper 12 months ago

WebArena: A Realistic Web Environment for Building Autonomous Agents

Paper • 2307.13854 • Published Jul 25, 2023 • 21

Qian Liu

AI & ML interests

Articles

RegMix: Data Mixture as Regression for Language Model Pre-training

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Efficient Table Pre-training without Real Data: An Introduction to TAPEX

Organizations

SivilTaram's activity

ZebraLogic: Benchmarking the Logical Reasoning Ability of Language Models

Announcing BigCodeBench-Hard, and More

RegMix: Data Mixture as Regression for Language Model Pre-training

MInference 1.0: 10x Faster Million Context Inference with a Single GPU

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

StarCoder2 and The Stack v2

Efficient Table Pre-training without Real Data: An Introduction to TAPEX