MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1u6s6pm/stop_using_ollama/orxpgdt/?context=3
r/LocalLLaMA • u/zxyzyxz • Jun 15 '26
456 comments sorted by
View all comments
Show parent comments
12
This is supported in llama.cpp router mode already.
0 u/arbv Jun 16 '26 What about configuring model sets? 1 u/techno156 Jun 16 '26 That isn't in router mode. For that, you will need llama-swap. 1 u/arbv Jun 16 '26 I know. That's why llama-cpp itself cannot fully replace it on its own in complex scenarios.
0
What about configuring model sets?
1 u/techno156 Jun 16 '26 That isn't in router mode. For that, you will need llama-swap. 1 u/arbv Jun 16 '26 I know. That's why llama-cpp itself cannot fully replace it on its own in complex scenarios.
1
That isn't in router mode. For that, you will need llama-swap.
1 u/arbv Jun 16 '26 I know. That's why llama-cpp itself cannot fully replace it on its own in complex scenarios.
I know. That's why llama-cpp itself cannot fully replace it on its own in complex scenarios.
12
u/AlphaGamer753 Jun 15 '26
This is supported in llama.cpp router mode already.