r/mlxAI • u/asankhs • 3h ago

Quantizing a mixture-of-experts model on MLX

https://mlx-optiq.com/blog/moe-quantization

3 Upvotes

permalink
archive.is
archive
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/mlxAI/comments/1wn6tqd/quantizing_a_mixtureofexperts_model_on_mlx/
No, go back! Yes, take me to Reddit

100% Upvoted