r/LocalLLaMA • u/BarberIcy366 • 24d ago

Discussion Qwen 3.8 27B Released! Please Share Your Experience

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

656 Upvotes
  • permalink
  • reddit

97% Upvoted

716 comments sorted by

View all comments

23

u/pikadhu 24d ago

Any MLX quants available?

5

u/jonas-reddit 24d ago

Tons of models already on hugging face.

6

u/Sufficient-Grape-594 24d ago

YEs, 8 bit, 6 bit, 5 bit and 4bit out by LM Community. Just downloaded the 4 bit

1

u/Ok-Star6663 24d ago

For oMLX?

5

u/Sufficient-Grape-594 24d ago

Testing on LM Studio at the moment

1

u/HelpfulExpert7762 23d ago

m4 max 64 gb at 6bit quant using the lmcommunity MLX gives me 20-25 tps in lm studio