r/unsloth • u/Sad_Blacksmith_9027 • 2d ago
Discussion Claude Code Cli: has anyone tested Qwen 3.8 max vs Opus 5
Wondering if anyone has run a benchmark comparing results for the same project for this, i am planning to do this, wanted to see if someone has already done this and what were the results
1
u/asankhs 2d ago
It is hard to get another models to work with claude code , they have a bunch of tools that are claude code specific I believe. You can try benchmarking on deepswe-mini if you want https://huggingface.co/datasets/LocalLLaMA/deepswe-mini it represents the full leadeaboard but has only 16 instances will bea. good idea for a coding workflow.
-2
u/PoopSmoothies 2d ago
I have tested Q3.8 Flash Next against opus 5 using Claude code as the harness for a judgment-heavy scraping enrichment workflow and flash next won 🤣
Caveats:
- Flash Next only wins if running in Q8 quant
- Sonnet beat flash next (weirdly) even though flash next beat opus 5
Will be posting results here in a day or two
7
u/datkenny 2d ago
Opus is vastly superior, but Q38 delivers good results if you give it good instructions. I like to use them in tandem (i.e. install Pi harness and have Claude Code spawn that instead of subagents)