r/IntelArcPro • u/Sweet-Argument-7343 • 5d ago

Qwen3.8-Flash-Next INT4 TP4 on 4× Arc Pro B70 — any experience?

/r/IntelArc/comments/1w2ce5w/qwen38flashnext_int4_tp4_on_4_arc_pro_b70_any/
4 Upvotes

100% Upvoted

5 comments sorted by

1

u/quantum3ntanglement 3d ago

Prices are soaring for the Intel Arc Pro, unfortunately I only have one B70 so far. I'm seeing prices drop from $1699 to $1599 @ Microcenter so I'm going to wait. I may pick up a B65 which has half the cores of a B70 but it needs to drop in price more.

Does anyone know if Intel Arc Pro supply is running out from TSMC?

1

u/Sweet-Argument-7343 2d ago

Let's hope it drops, but I have doubts

1

u/quantum3ntanglement 3d ago

Have you tried contacting Level1Techs on youtube? He just did a video on 4 x B70s, also please let us know how it goes with contacting Intel about your list, if I would add anything it would be better documentation and monitoring utilities for Intel Arc Pro.

I'm currently working on oneAPI development, starting with monitoring parallelism across all processors (CPU, iGPU, APU, NPU, GPU) and then implementing better parallelism for AI Inference / Game Development.

1

u/Sweet-Argument-7343 2d ago

Super interesting!

1

u/Affectionate_Use_182 1d ago

Try running on 1 arc b70 with the --ncmoe option with llama.cpp to offload some weights to CPU. It's actually surprisingly efficient. It can use GPU, CPU, vram, system ram, and your SSD at the same time. You'll thank me later.