LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding Paper • 2404.16710 • Published Apr 25, 2024 • 75
Phi-3 Collection Phi-3 family of small language and multi-modal models. Language models are available in short- and long-context lengths. • 26 items • Updated 5 days ago • 546
mistralai/Mixtral-8x7B-Instruct-v0.1 Text Generation • Updated Aug 19, 2024 • 4.38M • • 4.26k
view article Article Fine-tuning LLMs to 1.58bit: extreme quantization made easy Sep 18, 2024 • 216