Qian Liu's picture

Qian Liu

SivilTaram

·

http://siviltaram.github.io/

AI & ML interests

Cooking cool things

Articles

Efficient Table Pre-training without Real Data: An Introduction to TAPEX

Organizations

SivilTaram's activity

upvoted a paper 1 day ago

Make Your LLM Fully Utilize the Context

Paper • 2404.16811 • Published 2 days ago • 25

upvoted a collection 9 days ago

Deita

12 items • Updated Dec 20, 2023 • 7

upvoted an article 11 days ago

Article

Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

12 days ago

• 9

upvoted a paper 12 days ago

Compression Represents Intelligence Linearly

Paper • 2404.09937 • Published 12 days ago • 27

upvoted a collection 12 days ago

Pile-T5

T5 trained on the Pile with Llama Tokenizer • 4 items • Updated 13 days ago • 15

upvoted an article 18 days ago

Article

StarCoder2 and The Stack v2

Feb 28

• 2

upvoted a collection 20 days ago

Chinese Tiny LLM

9 items • Updated 23 days ago • 6

upvoted an article 21 days ago

Article

Efficient Table Pre-training without Real Data: An Introduction to TAPEX

May 23, 2022

• 1

upvoted a paper 23 days ago

Sailor: Open Language Models for South-East Asia

Paper • 2404.03608 • Published 23 days ago • 17

upvoted a collection about 1 month ago

DBRX

DBRX is a mixture-of-experts (MoE) large language model trained from scratch by Databricks. • 3 items • Updated Mar 27 • 84

upvoted 2 papers about 1 month ago

LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models

Paper • 2403.13372 • Published Mar 20 • 50

Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset

Paper • 2403.09029 • Published Mar 14 • 51

upvoted 2 papers about 2 months ago

MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing

Paper • 2212.13492 • Published Dec 27, 2022 • 2

StructLM: Towards Building Generalist Models for Structured Knowledge Grounding

Paper • 2402.16671 • Published Feb 26 • 26

upvoted a collection about 2 months ago

⚓️ Sailor Language Models

Sailor: Open Language Models tailored for South-East Asia (SEA) released by Sea AI Lab. • 14 items • Updated 23 days ago • 14

upvoted 2 papers about 2 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 120

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 560

upvoted a collection about 2 months ago

💫 StarCoder2

StarCoder2 models and datasets! • 8 items • Updated Mar 1 • 72

upvoted 3 papers 2 months ago

Multi-LoRA Composition for Image Generation

Paper • 2402.16843 • Published Feb 26 • 28

Generative Representational Instruction Tuning

Paper • 2402.09906 • Published Feb 15 • 50

Data Engineering for Scaling Language Models to 128K Context

Paper • 2402.10171 • Published Feb 15 • 18

upvoted 2 papers 3 months ago

Weak-to-Strong Jailbreaking on Large Language Models

Paper • 2401.17256 • Published Jan 30 • 14

Zero Bubble Pipeline Parallelism

Paper • 2401.10241 • Published Nov 30, 2023 • 19

upvoted a collection 3 months ago

TAPEX

TAPEX is the state-of-the-art table pre-training models which can be used for table-based question answering and table-based fact verification. • 10 items • Updated Oct 24, 2023 • 3

upvoted 6 papers 4 months ago

TinyLlama: An Open-Source Small Language Model

Paper • 2401.02385 • Published Jan 4 • 80

LLaMA Pro: Progressive LLaMA with Block Expansion

Paper • 2401.02415 • Published Jan 4 • 49

Active Retrieval Augmented Generation

Paper • 2305.06983 • Published May 11, 2023 • 3

From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning

Paper • 2304.07995 • Published Apr 17, 2023 • 3

S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Models

Paper • 2310.15147 • Published Oct 23, 2023 • 2

Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models

Paper • 2401.00788 • Published Jan 1 • 21

upvoted a paper 5 months ago

StarCoder: may the source be with you!

Paper • 2305.06161 • Published May 9, 2023 • 26

upvoted a paper 6 months ago

TAPEX: Table Pre-training via Learning a Neural SQL Executor

Paper • 2107.07653 • Published Jul 16, 2021 • 2

upvoted a collection 6 months ago

FLAN-T5-Large LoRA Modules

83 items • Updated Oct 19, 2023 • 2

upvoted a paper 6 months ago

OpenAgents: An Open Platform for Language Agents in the Wild

Paper • 2310.10634 • Published Oct 16, 2023 • 8

upvoted a paper 7 months ago

Lemur: Harmonizing Natural Language and Code for Language Agents

Paper • 2310.06830 • Published Oct 10, 2023 • 29

upvoted a collection 7 months ago

Model Merging

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 28 items • Updated Mar 23 • 168

upvoted 2 papers 7 months ago

Small-scale proxies for large-scale Transformer training instabilities

Paper • 2309.14322 • Published Sep 25, 2023 • 17

CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages

Paper • 2309.09400 • Published Sep 17, 2023 • 77

upvoted 5 papers 9 months ago

OctoPack: Instruction Tuning Code Large Language Models

Paper • 2308.07124 • Published Aug 14, 2023 • 27

WebArena: A Realistic Web Environment for Building Autonomous Agents

Paper • 2307.13854 • Published Jul 25, 2023 • 20

LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition

Paper • 2307.13269 • Published Jul 25, 2023 • 29

Bag of Tricks for Training Data Extraction from Language Models

Paper • 2302.04460 • Published Feb 9, 2023 • 2

Llama 2: Open Foundation and Fine-Tuned Chat Models

Paper • 2307.09288 • Published Jul 18, 2023 • 232

upvoted 2 papers 10 months ago

Copy Is All You Need

Paper • 2307.06962 • Published Jul 13, 2023 • 31

PolyLM: An Open Source Polyglot Large Language Model

Paper • 2307.06018 • Published Jul 12, 2023 • 24