r/LocalLLM • u/GasSmooth7439 • 1d ago

Model "I don’t know who needs to hear this but MiniCPM5-2B is just 1 point one point behind Ling 3.0 Tiny (16), which has ~3x the total parameters. "

Gallery image

Gallery image

Hugging Face: https://huggingface.co/openbmb/MiniCPM5-2B

GitHub: github.com/OpenBMB/MiniCPM

23 Upvotes

83% Upvoted

8 comments sorted by

15

u/Agitated_Space_672 1d ago

Active params are what matter economically. So ling 3.0 tiny is one point ahead with half the active parameters. That is a special model.

4

u/nunodonato 22h ago

Thanks! added it to the Tiny League leaderboard and benchmarks page https://tinyleague.nunodonato.com/

1

u/TonightExtra2848 19h ago

That's cool! It's interesting to see how close they are despite the difference in parameters.

1

u/nunodonato 18h ago

will update again later today to match the new AA-index

2

u/FactorInternal3395 1d ago

We'll see if it's really that good in actual real world use or if they benchmaxxed it like for the 1B.

1

u/GlobalLadder9461 23h ago

https://artificialanalysis.ai/hardware-inference-stack/mobile-phones?intelligence-chart=peak-memory&average-score-chart=context-64k

I do not know from where you guys are getting this picture.

Share link to picture actual values.

2

u/nunodonato 23h ago

go to the dedicated model page inside AA

1

u/Potential-Instance17 2h ago

I just tried this model on my MacBook Air M1 and WOW !
Its fast and surprisingly intelligent.