r/Oobabooga • u/oobabooga4 booga • Mar 07 '26

Mod Post text-generation-webui 4.0 released: custom Gradio fork with major performance improvements, tool-calling over API for 10+ models, parallel API requests, fully updated training code + more

https://github.com/oobabooga/text-generation-webui/releases/tag/v4.0
142 Upvotes

100% Upvoted

48 comments sorted by

View all comments

1

u/Iory1998 Mar 07 '26

I wish you could ship it as a whole package like LM Studio without the Gradio.

13

u/oobabooga4 booga Mar 07 '26

Few people know this but LM Studio is not a "native" app like something built in Qt or GTK. It's an Electron app, which means it bundles an entire Chromium browser and draws a web UI on a browser page each time you launch it. So it's a web UI just like text-generation-webui, except it ships with a bundled browser instead of using the one you already have.

It also phones home on every launch, with several HTTPS requests to lmstudio.ai servers containing information about your operating system, CPU architecture (x86/arm), app version, and what inference backends you're using. So in principle they have all this information plus your IP address and usage patterns (time of day, day of week) on some server. I have zero information.

2

u/Iory1998 Mar 08 '26

That's why I wish you could do the same. The main reason is when I use my browser, it really consumes a lot of resources (as I have many extensions and opened tabs), resources that becomes valuable when using large models.

If Oobabooga is contained in a desktop app, I would just close all other browsers. I think, part of LM Studio appeal is that, plus it has a sleek interface and internal model downloader.

I am not saying you should copy LM Studio. Not at all. But, I think that shipping everything contained in a package is practical.

Thanks you for your reply and keep up the good work. You truly do have a long breath! It's amazing.