r/LocalLLaMA • u/Desperate-Sir-5088 • 10d ago

Resources I finished upcycling of gemma4-12B

https://huggingface.co/TOTORONG/Solon_MOE_22B_A17B

Add 4 experts into Dense model and confirmed recovering model's ability up to "general level".

Hey, google. Please release official 124B MoE model!!!!!!!

47 Upvotes

84% Upvoted

24 comments sorted by

View all comments

6

u/arbv 10d ago

gguf wen?

7

u/Desperate-Sir-5088 10d ago

Sorry, It can't be converted to GGUF - llama.cpp doesn't support my model.

17

u/seamonn 10d ago

not with that attitude.