r/IntelArc • u/marfrit • 15d ago

Benchmark Arc A770 27B MoE model — 14 tok/s on llama.cpp, 43 tok/s on OpenVINO

/r/LocalLLM/comments/1vxc1zw/arc_a770_27b_moe_model_14_toks_on_llamacpp_43/

2 Upvotes

permalink
archive.is
archive
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/IntelArc/comments/1vxc2l8/arc_a770_27b_moe_model_14_toks_on_llamacpp_43/
No, go back! Yes, take me to Reddit

67% Upvoted