Xiangpeng Wei

pemywei

https://pemywei.github.io/

AI & ML interests

My research interests include Machine Translation and Natural Language Generation. Currently, I focus on semantic-augmentation and learning deep models for NMT as well as learning universal representations across languages.

Organizations

pemywei's activity

upvoted a paper 5 months ago

Cached Transformers: Improving Transformers with Differentiable Memory Cache

Paper • 2312.12742 • Published Dec 20, 2023 • 11

upvoted 2 papers 6 months ago

Weight subcloning: direct initialization of transformers using larger pretrained ones

Paper • 2312.09299 • Published Dec 14, 2023 • 16

Self-Evaluation Improves Selective Generation in Large Language Models

Paper • 2312.09300 • Published Dec 14, 2023 • 13

upvoted 2 collections 6 months ago

LLM

Collection

Multimodal LLM • 153 items • Updated Apr 22 • 7

Instruct

Collection

125 items • Updated 3 days ago • 5

upvoted a paper 7 months ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 116

upvoted a paper 8 months ago

Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference Using Sorted Fine-Tuning (SoFT)

Paper • 2309.08968 • Published Sep 16, 2023 • 22

upvoted 5 papers 9 months ago

Optimized Network Architectures for Large Language Model Training with Billions of Parameters

Paper • 2307.12169 • Published Jul 22, 2023 • 9

Challenges and Applications of Large Language Models

Paper • 2307.10169 • Published Jul 19, 2023 • 46

upvoted a paper 11 months ago

PolyLM: An Open Source Polyglot Large Language Model

Paper • 2307.06018 • Published Jul 12, 2023 • 24