Junlin Zhou

jlzhou

AI & ML interests

None yet

Recent Activity

Organizations

TableGPT's profile picture

jlzhou's activity

reacted to schuler's post with πŸ‘ 6 days ago
view post
Post
7169
πŸ“’ New Research Alert: Making Language Models Smaller & Smarter!

Thrilled to share the latest technical report demonstrating how to reduce language model parameters by 77% while maintaining performance.

The secret? Grouped pointwise convolutions. Yes. We brought a method from computer vision to the transformers arena.

πŸ”‘ Key Findings:
β€’ 77% parameter reduction.
β€’ Maintained model capabilities.
β€’ Improved generalization.

Paper: https://www.researchgate.net/publication/388835829_SAVING_77_OF_THE_PARAMETERS_IN_LARGE_LANGUAGE_MODELS_TECHNICAL_REPORT
Code: https://github.com/joaopauloschuler/less-parameters-llm
  • 2 replies
Β·
upvoted an article 6 days ago
view article
Article

DeepSeek-R1 Dissection: Understanding PPO & GRPO Without Any Prior Reinforcement Learning Knowledge

By NormalUhr β€’
β€’ 30
New activity in jlzhou/Qwen2.5-3B-Infinity-Instruct-0625 9 days ago

Adding Evaluation Results

#1 opened 9 days ago by
jlzhou
published an article 10 days ago
view article
Article

Distributed SFT with trl and DeepSpeed Part 2: Scaling Locally

By jlzhou β€’
β€’ 1