MHA2MLA
Collection
The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"
•
17 items
•
Updated
- Downloads last month
- 11
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for fnlp/SmolLM-1B7-MLA-d_kv_16
Base model
HuggingFaceTB/SmolLM-1.7B