Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models
Paper
•
2501.13629
•
Published
•
44
Shuai Lu
shuailu
·
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 2 months ago
Sigma: Differential Rescaling of Query, Key and Value for Efficient
Language Models
authored
a paper
5 months ago
Alchemy: Amplifying Theorem-Proving Capability through Symbolic Mutation
upvoted
a
paper
5 months ago
Alchemy: Amplifying Theorem-Proving Capability through Symbolic Mutation
Organizations
None yet