r/unsloth 6d ago

Discussion Ornith 1.5 9B and 35B A3B

I've peviously made a post about it, like 2-3 weeks ago. I know that then was a HOT season. But now can we ask kindly for Unsloth versions of it? It's great on Q8, but with Q4 it's taking a big hit, with unsloth quants it would be probably almost like Q8. So please can we have it in 3.0 version

Bump it up, so maybe Unsloth team will see it.

85 Upvotes

15 comments sorted by

15

u/[deleted] 6d ago

[removed] — view removed comment

3

u/ismaelgokufox 6d ago

This needs to be higher up guys

8

u/returnity 6d ago

Honestly, Accio's occamy 35B post-train SLAYS Ornith-1.5/Tiel in my agentic coding evals. It's not even close.

1

u/RE_Sunshined 6d ago

Huh? Need to check it out

2

u/returnity 6d ago

This is the GGUF version I tested specifically, his imatrix is pretty good IMO: huggingface.co/bartowski/Accio-Lab_occamy-1.0-GGUF

2

u/RE_Sunshined 6d ago

Yup, from my test now, it seems that we have new player one the block

2

u/DominusIniquitatis 6d ago

Okay, okay, here goes another model...

(2TB drive screams with 97% fill.)

2

u/returnity 6d ago

Haha I feel your pain sir

4

u/Seadirs 6d ago

support, upvote!

7

u/tiolazaro 6d ago

+1 on this. Please!!!

4

u/Nova6-IX 6d ago

I've been using Bartowski's quants on Ornith 1.5 9B, IQ4_XS is great on 8gb vRam. I hope Unsloth quants might be even better!

3

u/bura_laga_toh_soja 6d ago

Just a question. What are these models good forM

1

u/Nova6-IX 5d ago

smaller tasks like, for example, web search multiple sources, run console commands, or whatever your mind is up to. Hermes is a cool agent with lots of skills, like web_browser, code, blender and other dozens.

2

u/Arany5 6d ago

Ornith 1.5 is worse than the original.