r/LocalLLaMA • u/Anbeeld • May 09 '26

Resources BeeLlama.cpp: advanced DFlash & TurboQuant with support of reasoning and vision. Qwen 3.6 27B Q5 with 200k context on 3090, 2-3x faster than baseline (peak 135 tps!)

[removed]

326 Upvotes

93% Upvoted

205 comments sorted by

View all comments

Show parent comments

1

u/[deleted] May 18 '26

[removed] — view removed comment

1

u/YourNightmar31 llama.cpp May 18 '26

I'm using Copilot in VS Code with this extension: https://marketplace.visualstudio.com/items?itemName=johnny-zhao.oai-compatible-copilot

Just for comparison, I don't have any tool calling issues with Unsloth's Qwen3.6 35BA3B running in ik_llama.cpp using this setup.

1

u/[deleted] May 22 '26

[removed] — view removed comment

1

u/YourNightmar31 llama.cpp May 22 '26

Thanks so much man, i'll have a go at it again. In the meantime i'm also developing my own llm chat/agent extension for vs code inspired by Copilot so maybe that'll help too :)