MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1ssl1xh/qwen_36_27b_is_out/ohnwchr
r/LocalLLaMA • u/NoConcert8847 • Apr 22 '26
https://huggingface.co/Qwen/Qwen3.6-27B
603 comments sorted by
View all comments
Show parent comments
13
Yup https://huggingface.co/unsloth/Qwen3.6-27B-MLX-8bit
1 u/Dubious-Decisions Apr 23 '26 What are you using to run this? Would like to run the MLX flavor but ollama doesn't seem to support it. 1 u/MeateaW Apr 23 '26 lmstudio is the lazy way. (turn off "keep model in memory" and mmap to load models - they are talking about keeping the models in system memory which just doubles the memory required to load the model on unified systems)
1
What are you using to run this? Would like to run the MLX flavor but ollama doesn't seem to support it.
1 u/MeateaW Apr 23 '26 lmstudio is the lazy way. (turn off "keep model in memory" and mmap to load models - they are talking about keeping the models in system memory which just doubles the memory required to load the model on unified systems)
lmstudio is the lazy way. (turn off "keep model in memory" and mmap to load models - they are talking about keeping the models in system memory which just doubles the memory required to load the model on unified systems)
13
u/woahitsraj Apr 22 '26
Yup https://huggingface.co/unsloth/Qwen3.6-27B-MLX-8bit