Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

arxiv: 2502.14837

Misc with no match

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

15

Full-text search

Active filters: 2502.14837

fnlp/Llama-2-7B-MLA-d_kv_16

Text Generation • Updated 7 days ago • 26

fnlp/Llama-2-7B-MLA-d_kv_32

Text Generation • Updated 7 days ago • 11

fnlp/Llama-2-7B-MLA-d_kv_64

Text Generation • Updated 7 days ago • 12

fnlp/SmolLM-135M-MLA-d_kv_8

Text Generation • Updated 6 days ago • 11

fnlp/SmolLM-135M-MLA-d_kv_16

Text Generation • Updated 5 days ago

fnlp/SmolLM-135M-MLA-d_kv_32

Text Generation • Updated 5 days ago • 12

fnlp/SmolLM-135M-GQA-d_kv_128

Text Generation • Updated 5 days ago • 14

fnlp/SmolLM-360M-MLA-d_kv_8

Text Generation • Updated 5 days ago • 12

fnlp/SmolLM-360M-MLA-d_kv_16

Text Generation • Updated 5 days ago • 13

fnlp/SmolLM-360M-MLA-d_kv_32

Text Generation • Updated 5 days ago • 10

fnlp/SmolLM-360M-GQA-d_kv_128

Text Generation • Updated 5 days ago • 11

fnlp/SmolLM-1B7-MLA-d_kv_8

Text Generation • Updated 5 days ago • 12

fnlp/SmolLM-1B7-MLA-d_kv_16

Text Generation • Updated 5 days ago • 11

fnlp/SmolLM-1B7-MLA-d_kv_32

Text Generation • Updated 5 days ago • 13

fnlp/SmolLM-1B7-MHA-d_kv_128

Text Generation • Updated 5 days ago • 11