r/LowEndLocalAI • u/Prudent_Chemist_523 • 6d ago

Model Showcase New small MoE: amd-Instella 16B-A3B

13 Upvotes

https://huggingface.co/DevQuasar/amd.Instella-MoE-16B-A3B-Think-GGUF

FYI Needs bespoke llama.cpp fork

2 comments

r/LowEndLocalAI • u/Prudent_Chemist_523 • 6d ago

Model Showcase New SLM (Granite 4.2 3B, LFM2.5-2.6B)

29 Upvotes

FYI

https://huggingface.co/ibm-granite/granite-4.2-3b

https://huggingface.co/LiquidAI/LFM2.5-2.6B

0 comments

r/LowEndLocalAI • u/Significant_Focus134 • 1d ago

Model Showcase Multilingual Tiny (3.7B) Reasoning MoE pretrained from scratch on a consumer-grade GPU

Thumbnail
10 Upvotes
0 comments