SampleMix: A Sample-wise Pre-training Data Mixing Strategey by Coordinating Data Quality and Diversity
Paper
•
2503.01506
•
Published
•
8
DeyangKong
DeyangKong
AI & ML interests
Natural Language Processing
Recent Activity
commented on
a paper
6 days ago
SampleMix: A Sample-wise Pre-training Data Mixing Strategey by
Coordinating Data Quality and Diversity
authored
a paper
6 days ago
SampleMix: A Sample-wise Pre-training Data Mixing Strategey by
Coordinating Data Quality and Diversity
Organizations
None yet
DeyangKong's activity
upvoted
a
paper
6 days ago
upvoted
a
paper
10 days ago
upvoted
a
paper
6 months ago
upvoted
a
collection
6 months ago
upvoted
a
paper
7 months ago
upvoted
a
paper
8 months ago
upvoted
3
papers
9 months ago
Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
Paper
•
2406.07522
•
Published
•
38
The Power of Scale for Parameter-Efficient Prompt Tuning
Paper
•
2104.08691
•
Published
•
10
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
Paper
•
2405.21060
•
Published
•
66
upvoted
4
papers
10 months ago
LoRA Learns Less and Forgets Less
Paper
•
2405.09673
•
Published
•
88
ORPO: Monolithic Preference Optimization without Reference Model
Paper
•
2403.07691
•
Published
•
65
Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation
Paper
•
2401.08417
•
Published
•
35
Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models
Paper
•
2404.18796
•
Published
•
69
upvoted
an
article
10 months ago
Article
Introducing the Open Leaderboard for Hebrew LLMs!
•
34
upvoted
a
paper
12 months ago