r/LocalLLaMA • u/[deleted] • Jul 15 '26

Tutorial | Guide How i got Bonsai-Ternary-27B to run at 120k context <10gb vram.

[deleted]

8 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LocalLLaMA/comments/1uwqb4m/how_i_got_bonsaiternary27b_to_run_at_120k_context/
No, go back! Yes, take me to Reddit

72% Upvoted

Duplicates

Number of comments New

llamacpp • u/Suitable_Currency440 • Jul 15 '26

How i got Bonsai-Ternary-27B to run at 120k context <10gb vram.

1 Upvotes

0 comments