neuralmagic
/

pixtral-12b-FP8-dynamic

Text Generation

compressed-tensors

Model card Files Files and versions Community

mgoin commited on 20 days ago

Commit

345853e

·

verified ·

1 Parent(s): af766c9

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -258,7 +258,7 @@
     },
     "length_penalty": 1.0,
     "max_length": 20,
-    "max_position_embeddings": 1024000,
     "min_length": 0,
     "model_type": "mistral",
     "no_repeat_ngram_size": 0,

     },
     "length_penalty": 1.0,
     "max_length": 20,
+    "max_position_embeddings": 131072,
     "min_length": 0,
     "model_type": "mistral",
     "no_repeat_ngram_size": 0,