MHA2MLA
Collection
The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"
•
17 items
•
Updated
- Downloads last month
- 14
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for fnlp/SmolLM-135M-GQA-d_kv_128
Base model
HuggingFaceTB/SmolLM-135M