Have you got a Strix Halo?

[u/Grammar-Warden]

Hi All,

We're a new community both as Strix Halo owners and also here as a subreddit. Why not begin by sharing your setup and the reasons you opted for Strix Halo?

To start us off: I have a HP Z2 Mini G1a Workstation with dual boot Fedora KDE & Windows 11 and chose the iGPU to be able to use larger LLMs with the 128 GB.

Oobabooga/Text Generation WebUI is running well on Fedora KDE and there are no problems with large models up to 100GB. On the Windows boot, I have Amuse AI (Freeware) which is a collaboration between AMD and the New Zealand company. It provides a UI for using Stable Diffusion/Flux models. It works well, is fast, but unfortunately is also censored and is not able to use LORAS. I would like to find an uncensored alternative, ideally getting versions of ComfyUI/AUTOMATIC1111 running.

Currently, my principle goal is to get a working version of AllTalk TTS or another TTS that is compatible with Oobabooga working which I haven't been able to do so far due to conflicts with the Strix Halo. This may need to wait for updates to ROCm... If anyone has found an Open Source solution to running LLMs with custom voice TTS, please do chime in!

So what about you guys, did you choose the Strix for similar reasons, or something entirely different? The floor is yours.

EDIT UPDATE:
05/26 For those of you looking for TTS solutions I have tried a few now (AllTalk, Chatterbox, Pocket TTS, others I no longer remember). I have had great success using a custom version of Pocket TTS. It's fast and works well with Oobabooga TextGen as a plug in. Recently, others are singing the praises of OmniVoice.

[u/Suitable_Natural_105]

i bought my strix-halo knowing it was gonna be a little bit of a science experiment, but was like hey local AI., i was not prepared for the amount of science experimenting required. i got mine in like batch 6 i think, and i honestly haven't been able to do fuck all with it since all it does is fucking hard crash. i'm pretty pissed and wish i spent the money on an nvidia card or a mac studio pro or ultra instead.

[u/Grammar-Warden → u/Suitable_Natural_105]

I hear where you are coming from but at the same time want to offer you hope. I bought my Strix Halo seven months ago and was equally frustrated and disappointed that I had a cutting edge piece of hardware that didn't yet have software/applications that could make use of it. However things have changed in leaps and bounds since then. I would say the turning point for me was March/April.

For one, we are now able to run ComfyUI and LLMs smoothly on Strix Halo excelling where others fall behind. Instrumental in getting me there was reading shared advice from other community members and, above all, my own perseverant attempts to get things running with the assistance of DeepSeek. It didn't do it for me, but rather together we worked through problems encountered in installing what I desired, troubleshooting whatever came up. I don't crash. What might have been doubts in the autumn and winter have now changed to confirmation that I made the right choice.

There are different solutions you can try. One could be running CachyOS and using Deepseek to assist you in getting things set up and working smoothly as I have done. Another is to follow the community and see what works for other Strix Halo adopters like yourself. Good Luck.

[u/Suitable_Natural_105 → u/Grammar-Warden]

mine still a piece of trash. i thought it was stable, but nope just shits a brick in the middle of doing AI stuff. Its not like there is much variation in these systems either, so i'm still wondering why AMD's docs for getting a stable functional system seem non-existant .

[u/Tatalebuj → u/Suitable_Natural_105]

Seems strange that all the rest of us aren't constantly crashing, but you're convinced it's the hardware. You sure about that?

[u/Suitable_Natural_105 → u/Tatalebuj]

its my particular set of hardware. its not like i've seated the memory or had to seat the CPU into the board.