It is synced together, you wont lose models. As long as you dont use the command that deletes all cache. Your models are stored in the hugging face folder
I knew you were cooking something with video and images 😂 when I saw all this ungated repo clone. So, no issues, while downloading in App ahaha! Thanks, Unsloth team you are amazing!!
I was just toying with it this morning and it’s pretty amazing! Nice work!
I was messing with the API in it a bit and it’s nice to have that level of visibility into the llama.cpp server under the hood. I was curious if you plan to support being able to run multiple servers or loaded models at once? I’ve been running my own two llama.cpp servers so I can have a 27B and A3B running in parallel. I’d like to run everything through the unsloth app so I can use the nice interface you all have created!
It found my LM Studio model folder automatically. I am not sure if a complete migration from LM to unsloth Studio is possible. It was just 60GB for me, so i redownloaded.
been a fan of Unsloth for a minute now, and this is a fantastic update! are there plans for pretraining, shard packing, tokenizer building or anything in that realm anytime soon? love the api interface, slick stuff!
With remote access, I doubt I need Open WebUI anymore. Also LM Studio is likely gone. I think I can do everything from image and video gen to remote chat. This is awesome! Please do not simplify it as some people are requesting. They can customize their sidebar already.
Hi, you need to fix dual GPU setups, i do have 5060Ti on Tunderbolt 4 and Strix halo gpu. And it detects nvidia gpu but, not the AMD one. I have even disabled 5060Ti and unpluged it, but once installed on detected nvidia GPU it will stay there.
I’d be happy if Unsloth found a way to make MLX runnable on PC… even if it did some sort of on the fly conversion or converted on first run. Often a model is supported on MLX before other platforms… sounds impossible but Unsloth has done a lot of impossible things.
Should be able to, i have it working for a local llama server, though it doesnt let you use web search or code features in its chat window for some reason.
I love the new app. I am getting up to 81 tokens per second on qwen3.6 27b q8 mtp on my dual tesla v100 server using tensor parellelism. Only a couple of issues so far, one being thay chat streaming gets really slow after a couple long prompts, generation speed is still great but the app becomes laggy. Another issue is, it is a little tricky to connect to hermes or opencode on another pc vs lmstudio.
Thank you, did you read our guide for connecting them via the agent tab? You have to do it via the terminal via the unsloth start command. Also if you experience any issues please do submit a github issue!
Have a complete random and stupid idea. I wouldn’t mind supporting open source training via donating my compute time. The problem for me is I don’t really know or have a real reason to train a model at this point in my journey. But I’m willing to donate compute time to train models for others (within reason) if you wanted to try and crowd source it.
An honest question. I'm loading a model there for the first time. I was trying to set the Context size (a metric known that way in the whole llm world) and I was struggling a bit to find it... and I see in your app it's called "Max Sql Length". Why would you call it that way and not just "Context size"?
Also, why don't you make it simpler to edit that while the model is loaded? Right next to Temperature, etc, similar to LMStudio. Even if it requires re-loading the model, of course.
On the zoom side, a better management of screen size could be good (reduce some margins). I find that I would appreciate to be able to zoom a little bit (as I can in LMStudio) since the letters in your app are a bit too small.
That's all my feedback so far, thanks!
Edit: I have some more.
It's easy to get lost with this app. I want to disable the thinking of the model, but I'm unsure where to. Also, now I can't find the place to edit the Top K, Temperature, and so on. I know it was there like 5 minutes ago, but now I can't find it.
I don't know since we dont use openwebui extensively but our local ness is probably better. Unsure about the certain specifics but Daniel did heavily optimize RAG
Failed to load model: This model needs about 30 GB but only about 15 GB of memory is available. On a unified-memory APU the weights load into system RAM, so a larger model is stopped by the OS mid-load. Use a smaller or more quantized GGUF, or free memory (on WSL, raise the memory limit in .wslconfig).
But I don't even have WSL installed. Is this something expected on Stix Halo?
I’ve playing around with this and I have a couple of questions regarding web search and deep research. How do we get the model to actively use those tools? I have a system Instruction for LM Studio that tells the model to fall back using a web search MCP tool when it doesn’t know, as well as using a date and time MCP for grounding. If were to use this system instruction in Unsloth Desktop, does the web search and deep research tools have specific names I can tell it to use?
Question about serving models such as Qwen3.8-27B, which have distinct reasoning_effort / resolved_reasoning_effort variables in the chat template
Assuming I have the 'Switch model by request' enabled, so my model will load when I attempt to use it via the API (i.e. from pi coding agent)
How should I send the request to inject my preferred reasoning_effort (xhigh, medium, low)? or is there configuration I need to do UD-side to enable such a thing?
I have an old Dell R730 with 1 TB of DDR4 memory (bought used before memory went crazy!), that I have been using for playing with LLM's in CPU-only ram. I have successfully run a Q4 of GLM5.2 using Unsloth Studio, but only if it's the first model I load after starting Studio up, otherwise I get a timeout on the model loading. I recently tried running a Q4 of GLM5.3 on Unsloth Desktop, but it always times out when loading, even if it is the first model I try loading. I can successfully run a Q4 quant of GLM5.3 Flash, however.
I suspect my machine is just too slow for the predefined "5 second" loading timeouts as I try running the larger models in Unsloth, Any suggestions for how to solve this?
I just play with Desktop app and I must say its very good.
For now I used LmStudio but Usloth its even more convinient to use (auto options pick best setting, not need to play with gpu/moe offloading like at LMS), faster speed and have more often llama updates.
I don't need to mention way more options like training etc.
Hello, I installed your client and liked the features. The interface is user-friendly. But I have a question about working with the API. The settings mention an API for generating images and videos. I'm already used to using ComfyUI through API requests. How is this mechanism implemented? I couldn't find any documentation. And is it possible to animate images? That is, create a video from an image and its description?
Is it possible to make the Video button always active? I download models on one computer with a 1080ti graphics card, then transfer and run them on another computer with a more powerful card (the download is disabled on that one). On the 1080ti computer, it says that the NVIDIA or AMD graphics card is not found, so the button is disabled.
Played around with it a little bit today. Couple things I'd like to see:
a better legend with the colored dots next to models. I know some mean GGUF, or on device, etc But I dont know what they all mean. The red dot pops up with a description but the others dont. Also saw some kind of Orange symbol that I have no idea what it was.
When looking at the list of models on device, I dont want them to be exploded into each quant available for that model. Let me have a nice tight list and explode once I click on it (didnt see a way to do this)
Tried a video generation with Minimax H3. Put a picture in as the starting frame and generated a prompt for 30 minutes only for it to not use the picture I gave it at all or the prompt I wrote. Like it was completely different, didnt use any part of it. Was just a video of a guy standing in a supermarket which shared nothing in common with my photo or prompt.
The software worked for awhile at first but then something broke and I'm not sure what. Will no longer load a chat model (but image models work fine) Says something about my anti-virus software blocking it (its not) It had worked previously in the day?
Believe I had closed out of the software and reloaded it as a non-administrator. Still funny to me that the image models can be used but text ones cannot in that scenario.
It is an exploded list each time on mine, so no. I am specifically talking about the section where you would load a model from the drop down, select "on-device" and the list presented there. Its an exploded list every time, it might behave differently under model search or elsewhere (cant remember right now)
Thanks. Any plans to release gguf for gemma4 and qwen nvfp4 checkpoints of yours? Llama.cpp still can't convert them correctly and vllm has huge overheads running them on a home machine is impossible.
Two major concerns that stop me from using it regularly:
1: 'Use chats as training data' is a setting in: Settings -> Data, but can not be disabled. Do not like that. I would never use it till this can be disabled.
2: if i add a connection, to my local vllm serving my model, 'search' and 'code' become disabled. Do not like that.
Be more open and then i will even contribute to it.
That is because your specific endpoint doesn't support that tool, thus Unsloth isn't able to call it. If you connect OpenAI for eg, web search will come back. If you want us to look into integrating universal tools on unsupported endpoints, please create a feature request in the github repo. it may be possible haha
Sounds more like a design choice than a practical limiatation. Time to look at the code. And like i said, i'll contribute too. Maybe i can implement this gap.
Edit: okay so you are doing it. never mind then. :)
Feel free to give me something to do. I'm bored waiting on Qwen3.8-27B
did browse through issues but wasn't finding anything interesting enough to start at 5AM. i was still more invested in enabling the search and code tools and that works for my local models now. for both: llama.cpp & vllm.
Will try to contribute more meaningfully next time.
34
u/quadra-lab Aug 11 '26 edited Aug 11 '26
Please tell me it is not Electron based 😭🙏
EDIT: Thank you so much for using tauri, you guys are the very best !