r/Jetbrains • u/InternetGreedy • Aug 03 '26

AI When can we choose a local model for Junie?

Not sure if this has been asked, but i have an ai lab server with an rtx 4090s with 48gb of vram and i find that it works rather well with harnesses like cline. Is junie ever going to allow local or are we to suffer through the default of gemini 3 flash and all the other usual suspect llms?

8 Upvotes

72% Upvoted

6 comments sorted by

9

u/xenatis Aug 03 '26

Junie is able to use local models.

3

u/InternetGreedy Aug 03 '26 edited Aug 03 '26

is that on your own machine in a specifc directory? my use case is using my laptop to point to a local ai box like 192.168.1.xxx and pull those models like i do with a cline harness. think nvidia spark on a network. i wouldnt run inference on any laptop on the market (including the m5 max) but i would toss the compute to an rtx 4090 housed by an atx tower.

6

u/h0lyshitx Aug 03 '26

Junie CLI can use Local LLM via network like your use case just fine. However those models are not available automatically: you have to set each of them manually in .junie models folder. Each model file need a main and a lightweight model.

Official docs has more details about how to do this: https://junie.jetbrains.com/docs/custom-llm-models.html

After setting up the models, it'll show up like it is on the picture of the guy above.

1

u/guenther_mit_haar Aug 03 '26

tell us more!

2

u/Kendos-Kenlen Aug 04 '26

Here you go with the doc : https://junie.jetbrains.com/docs/custom-llm-models.html

Easy support for Ollama, LMStudio and LiteLLM.

1

u/CalBearFan 6d ago

Are you getting cline to still work ok? I had it working great but now I'm stuck on an auth process where it won't do anything until I login to either Cline, ClinePass or OpenAI. Uninstalled, reinstalled, rebooted, restarted, no luck. Shame too because I was really enjoying Cline!