How to fix ERROR:olmocr.check:Sglang
#10
by
binzhango
- opened
Hi team,
Testing this model in M4 MacOS, but Sglang dose not support MLX backend yet, can I bypass Sglang check and use CPU only?
command:
python -m olmocr.pipeline ./workdir --pdfs /data/Q4FY24-CFO-Commentary.pdf --model /models/olmOCR-7B-0225-preview
@binzhango There are MLX and LMStudio versions available now. I am using this model on lmstudio on my m4 now.
@binzhango There are MLX and LMStudio versions available now. I am using this model on lmstudio on my m4 now.
@iamrobotbear Thanks
binzhango
changed discussion status to
closed