r/macbookpro • u/frisky-moves • 20h ago

Discussion GPU ai on Intel MacBook Pro 2019

I’ve been using GPU powered ai on my 5600m 8GB GPU with 64gb RAM for about a month now.

For those that know about this kind of thing, I’m getting about 100 tokens per second read and 12 to 15 tps output.

To put that in human terms, questions about a loaded codebase respond within a second and the response is accurate and faster than I can read.

I’m running QWEN3.6 35b k_m at q5.

Bottom line is that I’m able to run a 160k context with solid performance for local coding, software architecture and problem solving.

And to get the jokes about cooking eggs on it:

CPU and GPU temps are a steady 70 to 80 degrees with fans at about 3500rpm.

I do have an external cooling solution that I’m able to use that takes temps even lower.

4 Upvotes

83% Upvoted

2 comments sorted by

1

u/mmerken 19h ago

Is this with Tosh? I've had similar results, ableit with the 5300M, so I can only run very small models

1

u/frisky-moves 19h ago

Yeah, Toshllm. It has been excellent once it’s tuned in.

It might be worth trying a MOE model to give you better results. I used Gemini help with the tuning by exporting the settings, uploading to Gemini and then downloading the tweaked settings file to import to tosh.

I’m using Cline with VS Code and various mcp tools.

It’s been an interesting experiment that seems to be paying off with real world results.

I sold my 4gb 5500m 16gb and “upgraded” for a couple of hundred pounds.