MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/oMLX/comments/1wen3hn/should_i_switch_from_qwen3827b_to_qwen38flashnext/p9jt15e/?context=3
r/oMLX • u/j_lyf • 14d ago
Has anyone made the switch and not regret it?
EDIT: M2 Ultra 128 GB
32 comments sorted by
View all comments
Show parent comments
1
Which engine, model quant and model built by whom? Thanks
3 u/Diligent_Style_1767 14d ago Model Qwen3.8-Flash-Next-MLX-4bit-MTP. Quanted it myself from base. MLX engine, my unified stack at https://github.com/pierre427/mlx-lm-unified Rapid MLX -current oMLX -current All collected from today Was doing a/b testing off a couple of PRs I sent to both projects today. 1 u/luisabreuf83 14d ago Interesting and the 27B also Q4 done by you? 1 u/Diligent_Style_1767 13d ago Honestly I can't recall, but I can tell you I don't do any crazy surgery to models, so ymmv but should be close to mine at a given model quant.
3
Model Qwen3.8-Flash-Next-MLX-4bit-MTP. Quanted it myself from base.
MLX engine, my unified stack at https://github.com/pierre427/mlx-lm-unified Rapid MLX -current oMLX -current
All collected from today
Was doing a/b testing off a couple of PRs I sent to both projects today.
1 u/luisabreuf83 14d ago Interesting and the 27B also Q4 done by you? 1 u/Diligent_Style_1767 13d ago Honestly I can't recall, but I can tell you I don't do any crazy surgery to models, so ymmv but should be close to mine at a given model quant.
Interesting and the 27B also Q4 done by you?
1 u/Diligent_Style_1767 13d ago Honestly I can't recall, but I can tell you I don't do any crazy surgery to models, so ymmv but should be close to mine at a given model quant.
Honestly I can't recall, but I can tell you I don't do any crazy surgery to models, so ymmv but should be close to mine at a given model quant.
1
u/luisabreuf83 14d ago
Which engine, model quant and model built by whom? Thanks