Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

125

Full-text search

Active filters: auto-gptq

fbaldassarri/HuggingFaceTB_SmolLM2-360M-Instruct-auto_gptq-int4-gs128-sym

Text Generation • Updated 23 days ago • 75

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-auto_gptq-int4-gs128-asym

Text Generation • Updated 23 days ago • 83

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-auto_gptq-int4-gs128-sym

Text Generation • Updated 23 days ago • 78

fbaldassarri/EleutherAI_pythia-12b-deduped-autogptq-int4-gs128-sym

Text Generation • Updated Dec 19, 2024 • 3

fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_gptq-int4-gs128-asym

Text Generation • Updated 23 days ago • 79

fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_gptq-int4-gs128-sym

Text Generation • Updated 23 days ago • 77

fbaldassarri/allenai_OLMo-2-1124-7B-Instruct-autogptq-int4-gs128-asym

Text Generation • Updated Dec 22, 2024 • 3

fbaldassarri/allenai_OLMo-2-1124-7B-Instruct-autogptq-int4-gs128-sym

Text Generation • Updated Dec 22, 2024 • 9

fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autogptq-int4-gs128-asym

Text Generation • Updated about 1 month ago • 8

fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autogptq-int4-gs128-sym

Text Generation • Updated about 1 month ago • 7

fbaldassarri/sapienzanlp_Minerva-7B-base-v1.0-autogptq-int4-gs128-asym

Text Generation • Updated about 1 month ago • 11

fbaldassarri/sapienzanlp_Minerva-7B-base-v1.0-autogptq-int4-gs128-sym

Text Generation • Updated about 1 month ago • 7

fbaldassarri/sapienzanlp_Minerva-7B-instruct-v1.0-autogptq-int4-gs128-asym

Text Generation • Updated 30 days ago • 11

kaitchup/QwQ-32B-Preview-AutoRound-GPTQ-2bit

Text Generation • Updated 28 days ago • 26 • 1

fbaldassarri/sapienzanlp_Minerva-7B-instruct-v1.0-autogptq-int4-gs128-sym

Text Generation • Updated 29 days ago • 5

fbaldassarri/sapienzanlp_Minerva-1B-base-v1.0-autogptq-int4-gs128-asym

Text Generation • Updated 29 days ago • 7

fbaldassarri/sapienzanlp_Minerva-3B-base-v1.0-autogptq-int4-gs128-asym

Text Generation • Updated 28 days ago • 9

fbaldassarri/sapienzanlp_Minerva-1B-base-v1.0-autogptq-int4-gs128-sym

Text Generation • Updated 28 days ago • 5

fbaldassarri/sapienzanlp_Minerva-3B-base-v1.0-autogptq-int4-gs128-sym

Text Generation • Updated 28 days ago • 8

fbaldassarri/iGeniusAI_Italia-9B-Instruct-v0.1-autogptq-int4-gs128-asym

Text Generation • Updated 20 days ago • 10

fbaldassarri/iGeniusAI_Italia-9B-Instruct-v0.1-autogptq-int4-gs128-sym

Text Generation • Updated 20 days ago • 17

fbaldassarri/meta-llama_Llama-3.2-1B-auto_gptq-int8-gs128-sym

Text Generation • Updated 18 days ago • 10

fbaldassarri/meta-llama_Llama-3.2-1B-auto_gptq-int8-gs128-asym

Text Generation • Updated 17 days ago • 11

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int8-gs128-asym

Text Generation • Updated 18 days ago • 6

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int8-gs128-sym

Text Generation • Updated 18 days ago • 7

fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs128-asym

Text Generation • Updated 17 days ago • 8

fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs128-sym

Text Generation • Updated 17 days ago • 9

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs128-asym

Text Generation • Updated 17 days ago • 6

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs128-sym

Text Generation • Updated 17 days ago • 16

fbaldassarri/allenai_OLMo-2-1124-13B-autogptq-int4-gs128-asym

Text Generation • Updated 15 days ago • 9