Kevin June

FightLLM's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cognitivecomputations/DeepSeek-R1-AWQ 7 days ago

why "MLA is not supported with awq_marlin quantization. Disabling MLA." with 4090 * 32 (4 node / vllm 0.7.2)

3

#14 opened 7 days ago by

FightLLM

why "MLA is not supported with awq_marlin quantization. Disabling MLA." with 4090 * 32 (4 node / vllm 0.7.2)

3

#14 opened 7 days ago by

FightLLM