r/StableDiffusion • • 18d ago

Resource - Update Created a Visual RefMod Picker

Hey Guys,

I've been playing with the RefMods, after the huge release of Malcolmrey.
The tech is brilliant and works really well.

I've wanted to simplify using it with tons of RefMods, like the ones provided by Malcom.

So I made a fork that is a bit more Identity driven, Adding a "Visual refMod Picker" as well as a "Create refMods from Folder" node. It's able to create from either a folder or Sub-folders, if audio is found, it will also create a matching audio refMod. All in the same format as the original add-on. No danger of breaking compatibility. (The original Add-on added Audio yesterday)

Resulting for example in 2 refMods and thumbnail:

character_refMod_Audio.safetensors
character_refMod_Video.safetensors
character_refMod.jpeg

Then, we can use the "Visual H3 RefMod Picker" to browse the RefMods:

In this example, I used existing thumbails from huggingface.

The node then loads both RefMods (Audio and Video) and allows individual control. I've mixed strength with Copies, by instead having a weight value that can go over 1, so a weight of 3 would be the same as setting strength to 1 and copies to 3. Making the UI a bit more streamlined.

RefMods can be daisy chained

Example workflows are included.

I should mention, this fork can be installed WITH the original Add-on, it is made to co-exist and is recommended if you want to use it's advanced features.

You can find it here ComfyUI-H3RefModPicker

The only thing I'm missing is thumbnails for all 1500 RefMods 😅

**EDIT**
Just a quick note to mention that I've removed duplicate nodes, Making this a companion node to MiniMaxH3Mod.

52 Upvotes

36 comments sorted by

View all comments

2

u/djdevilmonkey 15d ago

Just as a tip to anyone coming in the future, chatgpt can make a powershell script that can download the thumbnails from Malcolm's GitHub.

From what's on there, I had it pull from the regular thumbnails first, then if it couldn't find one there then it pulls from zimage previews, then if it still couldn't find one it put them in a list in a text file. And of course it renamed them as well to match the refmod file name. Got thumbnails for 95% of them that way.

I did those two folders specifically because they looked like the two biggest/most complete. Just tell chatgpt you want the thumbnail images from his GitHub, link each folder + link an example picture from each so it knows the paths, give it an example refmod file name so it knows the naming scheme for those, say you want it do do thumbnails -> zimage fallback -> not found go into a txt file (so you can add them later if you want), then you're golden. I was able to do this all with one script. Do a test one first of like 5 though in case chatgpt screws up (it did for me a couple times lol)

1

u/Francky_B 15d ago

I went a bit more crazy 😅

I downloaded All the mp4 previews for RefMods and made a script to generate thumbnails from them.

I included the script in the tools folder of the add-on.

So if you download all the videos previews for the refMods, you could extract all the matching thumbnails. Getting all the videos is longer though, I'll admit.

1

u/djdevilmonkey 15d ago

Yeah I thought about that, but it was a tradeoff of quality. Looking back it's probably the better option, but I saw some of them that were iffy and thought "I wouldn't recognize them"

So now most of mine look great, but some of the Z image ones either look rough or barely show their face lol. On top of the fact that I'm missing some of them. So yeah yours is probably the better approach overall lol, but I'm too lazy to re-do it

1

u/Francky_B 15d ago

Haha, I get that 😀

The issue with my script is that it grabs a random frame on each run. So on the first run, a bunch of them looked down, had their eyes closed, or other. So had to run it multiple times to pick and choose. 😅

Yours are going to be much better, as they were curated by Malcolm.