-
FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative Sampling
Paper • 2502.14856 • Published • 7 -
From Hours to Minutes: Lossless Acceleration of Ultra Long Sequence Generation up to 100K Tokens
Paper • 2502.18890 • Published • 23 -
DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting
Paper • 2503.00784 • Published • 9
Zhiyuan Tan
BHbean
AI & ML interests
None yet
Recent Activity
updated
a collection
1 day ago
Speculative Decoding
updated
a collection
1 day ago
Speculative Decoding
upvoted
a
paper
5 months ago
PokéLLMon: A Human-Parity Agent for Pokémon Battles with Large
Language Models
Organizations
None yet
Collections
3
models
None public yet
datasets
None public yet