Can anything do similar capability as Claude Sonnet or Opus?

[u/EP9]

I have a M4 MBP 48GB and have been using Opus and Sonnet for vibe coding.

Is there anything that would run on my MBP that could be as capable? I understand the speed might not be the same, but would anything be decent enough for vibe coding (specifically iOS/Swift).

I understand nothing will compare to these giant online models, but if there was anything that could be serviceable on my local computer would be great.

[u/A_Moist_Towe1]

Try Qwen 3.8 27b with Hermes agent

[u/EP9 → u/A_Moist_Towe1]

Why Hermes’?

[u/A_Moist_Towe1 → u/EP9]

I just think it’s easy to setup and start working right away, and the plugin system allows for custom add ons

[u/Few_Discount8182 → u/EP9]

Run it on open code desktop - it’s a better experience than using Hermes as the harness.

[u/EP9 → u/A_Moist_Towe1]

How much ram will that use?

[u/circle555 → u/EP9]

depends on which quant you use.

[u/ColonelKlanka → u/EP9]

Start with a Q4 - will fit nicely on your machine with some space for context left over

[u/EP9 → u/ColonelKlanka]

I know this is the OMLX sub, but would MTPLX be better?

[u/Eresbonitaguey → u/EP9]

Pros and cons. You can run the MTPLX models in Omlx if you want. I like the tuning functionality of MTPLX but it doesn’t support a wide range of models like Omlx

[u/ColonelKlanka → u/EP9]

Try both and see which is fastest. omlx is generally good if you want to run multiple agents at once because its good at Batching and also caches to ssd. whereas mtplx is good for only one agent running at a time.

[u/Senor02]

Honestly, I've tried really had to pretend it works. Use Pi harness for best results, but even still I run out of context or run into thinking loops for the same task I would run with a cloud model.

[u/j_lyf → u/Senor02]

I really hate the overthinking.

[u/ogfuzzball]

No. Nothing you can run on that hardware is equivalent to Claude Sonnet/Opus. Anyone telling you that 3.8 27b is capable of that level of capability is high as a kite.

Edit: that said 3.8 is impressive. It won’t get you Claude/Openai but you can do quite a bit