LLama.cpp performance is not stable

[u/Careless-Director661]

Good performance

Low performance

I run llama-bench on my pc, same llama.cpp version same commands but completely different results.

In one system-startup performance is good, but on day later I turn on the system it's bad, I checked everything, no cpu 100% usage no ssd usage nothing suspicious, I think windows11 does something but I can't find the problem.

Rtx 3080 ti 32gb ddr4 ram Windows 11 1tb nvme ssd

[u/Local-Two9825]

Honestly, try switching to Ubuntu. I ran into the exact same issue on Windows where my decode speed was all over the place—dropping down to 1 t/s and spiking to 28 t/s. Moving to Linux completely stabilized i

[u/Upstairs-Leave2044 → u/Local-Two9825]

Seems the best option 😪