HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization
Paper
•
2503.04598
•
Published
•
16
Xiaoqing Li
LLIXQ
AI & ML interests
None yet
Recent Activity
authored
a paper
3 days ago
HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid
Normalization
authored
a paper
12 days ago
Scale-Distribution Decoupling: Enabling Stable and Effective Training of
Large Language Models
Organizations
None yet
LLIXQ's activity
authored
a
paper
3 days ago