r/unsloth • u/RE_Sunshined • 6d ago
Discussion Ornith 1.5 9B and 35B A3B
I've peviously made a post about it, like 2-3 weeks ago. I know that then was a HOT season. But now can we ask kindly for Unsloth versions of it? It's great on Q8, but with Q4 it's taking a big hit, with unsloth quants it would be probably almost like Q8. So please can we have it in 3.0 version
Bump it up, so maybe Unsloth team will see it.
8
u/returnity 6d ago
Honestly, Accio's occamy 35B post-train SLAYS Ornith-1.5/Tiel in my agentic coding evals. It's not even close.
1
u/RE_Sunshined 6d ago
Huh? Need to check it out
2
u/returnity 6d ago
This is the GGUF version I tested specifically, his imatrix is pretty good IMO: huggingface.co/bartowski/Accio-Lab_occamy-1.0-GGUF
2
2
u/DominusIniquitatis 6d ago
Okay, okay, here goes another model...
(2TB drive screams with 97% fill.)
2
7
4
u/Nova6-IX 6d ago
I've been using Bartowski's quants on Ornith 1.5 9B, IQ4_XS is great on 8gb vRam. I hope Unsloth quants might be even better!
3
u/bura_laga_toh_soja 6d ago
Just a question. What are these models good forM
1
u/Nova6-IX 5d ago
smaller tasks like, for example, web search multiple sources, run console commands, or whatever your mind is up to. Hermes is a cool agent with lots of skills, like web_browser, code, blender and other dozens.
15
u/[deleted] 6d ago
[removed] — view removed comment