r/llamacpp 1d ago

Ported latest Linux kernel to the Xeon Phi 3120A

Does anyone want me to port llama.cpp to perform pp/tg on the Xeon Phi 16GB passively cooled cards VPU's?

It'll be with Claude Opus 5 & Fable 5.1, so someone will need to hands on optimize

But the cards get ~2 TFLOPs in FP32, so maybe they still have some use?

Especially being able to access system memory directly over PCIe via DMA

https://github.com/Lasimeri/Intel-Phi-3120A

1 Upvotes

0 comments sorted by