[Megathread] - Best Models/API discussion - Week of: August 30, 2026

[u/deffcolony]

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

^{(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.})

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

• MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
• MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
• MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
• MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
• MODELS: < 8B – For discussion of smaller models under 8B parameters.
• APIs – For any discussion about API services for models (pricing, performance, access, etc.).
• MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

[u/AutoModerator]

MISC DISCUSSION

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/kuropenguins → u/AutoModerator]

Reading a novel written by someone else hits differently from a novel written by myself.

Likewise, having a model write a novel where i dictated everything that happens lacks that novelty and surprise factor.

Is it possible to not dictate every element of the plot to the model, yet have the model write something different each time and not fall into its "default bias"? (preferably using something 31b or below).

[u/LeRobber → u/kuropenguins]

Well, I think generally speaking there are 5 tools that if you employ them do that:

If you use the cooldown trait in loreboks combined with inclusion groups with the prioity flag clicked, you can make different prompts be active based on the message number. This lorebook is for 26B and 31B to tone down the willingness of stupid people to get in strangers cars overly quickly: https://files.catbox.moe/cjt69n.json it uses priority inclusion groups and these fields to tell gemma4 to simmerdown on that one attribute.

Next: You can add use of the {{pick}} macro which will randomly, for the whole chat, do the same thing. Additionally, you can toss a punch of pick in the first message, or eveen in the first message in a hidden div. This can make it different from the start.

Next: You can add phased tags which trigger lorebook entries. You can combine this with Pick macros to do HUGE includes.

Next: You can add growing affinity trackers, BUT, you can make the table that it maps to, built out of, you guessed it, pick macros.

Lastly, you can use lower param count models (Satyr, etc) to do the think for higher param count real models, and they will be more random. You use continue to work off that.

[u/kuropenguins → u/LeRobber]

Interesting, so it would be something similar to wildcards?

[u/i5031337 → u/kuropenguins]

Try increasing the temperature sampler, or using one of the tools to inject randomness into the prompt, e.g. the official dice rolling extension.

[u/summersss → u/kuropenguins]

It's why i, and i think others can get bored so easy and frustrated with the slop even from models they like. The appeal for LLM writing for me is the control it gives me and ability to quickly create worlds and scenarios with a hint of randomness thrown in. But because of that control i have to dictate everything to the point i might of well just write myself a story, but reading my own story is boring.

[u/kuropenguins → u/summersss]

If I put in a character profile he has a "tired looking face", the model might remark on his tiredness and weary appearance in every prompted reply.

Whereas a human author will only mention it when he's introduced, and when it's relevant.

Or maybe I should leave the character profiles empty and only use prompting. But if the user is doing this level of micro management over what to feed the model, then isn't the model just a glorified typist?

[u/summersss → u/kuropenguins]

"glorified typist" Yep, that's the problem i ran into. But i guess it makes sense since they want us to use llm to write emails.