Minzhi Huang's picture

2 1 1

Minzhi Huang

ChloeHuang1

·

https://github.com/MinzhiHuang?tab=repositories

AI & ML interests

None yet

Recent Activity

new activity about 1 month ago

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit:VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

new activity about 1 month ago

Valdemardi/DeepSeek-R1-Distill-Qwen-32B-AWQ:Can this model use with VLLM?

new activity about 1 month ago

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit:VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

View all activity

Organizations

None yet

ChloeHuang1's activity

New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit about 1 month ago

VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

#3 opened about 1 month ago by

New activity in Valdemardi/DeepSeek-R1-Distill-Qwen-32B-AWQ about 1 month ago

Can this model use with VLLM?

#2 opened about 1 month ago by

New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit about 1 month ago

VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

#3 opened about 1 month ago by

VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

#3 opened about 1 month ago by