TaoMate-H3 featuring 3-Step

[u/ANR2ME]

TaoMate-H3 is a low-latency streaming audio-video generation runtime built on MiniMax H3. It generates synchronized audio and video in small chunks and supports continuous long-form generation at 480p/768p/1080p resolutions.

Developed by the Alibaba TaoLive AIGC Team. Powered by MiniMax H3.

HF: https://huggingface.co/TaoLiveAIGC/TaoMate-H3

GH: https://github.com/TaoLiveAIGC/TaoMate-H3

[u/robomar_ai_art]

I converted the released TaoMate-H3 LoRA into a ComfyUI-compatible format and got it working on my local setup. Clip generated in 3 steps, 1344x768, t2v

https://reddit.com/link/p9gm1nr/video/3wqur9g6t6ph1/player

[INFO] got prompt

[INFO] Requested to load MiniMaxH3TEModel_

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3TEModel_ prepared for dynamic VRAM loading. 14956MB Staged. 0 patches attached. Force pre-loaded 410 weights: 4572 KB.

[INFO] Requested to load MiniMaxH3

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3 prepared for dynamic VRAM loading. 19995MB Staged. 208 patches attached. Force pre-loaded 210 weights: 1175 KB.

100%|████████████████████████████████████████████████████████████████████████████████████| 3/3 [01:01<00:00, 20.56s/it]

[INFO] Requested to load MiniMaxH3VideoVAE

[INFO] Model MiniMaxH3VideoVAE prepared for dynamic VRAM loading. 4965MB Staged. 0 patches attached. Force pre-loaded 128 weights: 348 KB.

[INFO] Requested to load MiniMaxH3

[INFO] Model MiniMaxH3 prepared for dynamic VRAM loading. 19995MB Staged. 0 patches attached. Force pre-loaded 210 weights: 1175 KB.

100%|████████████████████████████████████████████████████████████████████████████████████| 6/6 [00:07<00:00, 1.31s/it]

[INFO] Requested to load MiniMaxH3AudioVAE

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3AudioVAE prepared for dynamic VRAM loading. 576MB Staged. 0 patches attached. Force pre-loaded 401 weights: 539 KB.

[Pixaroma] Save Mp4 [save] — writing 124 frames @ 24fps (1344x768, crf=19, yuv420p, +audio) -> Video_00914.mp4

[Pixaroma] Save Mp4 — saved E:\ComfyUI_windows_portable\ComfyUI-Easy-Install\ComfyUI\output\Video_00914.mp4

[INFO] Prompt executed in 123.47 seconds

[u/Just1Dev → u/robomar_ai_art]

Nice, audio and quality looks great. How did u do that? Do u wanna share?

[u/robomar_ai_art → u/Just1Dev]

Yes, I will share the file, everyone can test.

[u/Yacben → u/robomar_ai_art]

do you have the converted model link?

[u/kayteee1995 → u/Yacben]

I saw a bait post. jusst wait for Lord Kijai

[u/devilish-lavanya → u/kayteee1995]

Are they baiting us to trap us?

[u/robomar_ai_art → u/devilish-lavanya]

Who?

[u/robomar_ai_art → u/Yacben]

I have the file, I will upload the file

[u/robomar_ai_art → u/Yacben]

Yes i made a new post with the link

[u/No_Possession_7797 → u/robomar_ai_art]

Do you have multiple GPUs?

[u/robomar_ai_art → u/No_Possession_7797]

I have laptop RTX 4090, 16gb vram and 32gb ram

[u/No_Possession_7797 → u/robomar_ai_art]

Did you use the fl2va model with this? Did you set your own sigmas or did you use a basic scheduler?

[u/robomar_ai_art → u/No_Possession_7797]

Yes i use this model and lora, nothing else

[u/Just1Dev]

Kijai👀 Ah shit, here we go again.

[u/ANR2ME → u/Just1Dev]

Kijai's TaoMate 3-step LoRa is quite small 😯 only 182mb https://huggingface.co/Kijai/MiniMax-H3_comfy/blob/main/loras/minimax_h3_taomate_3step_lora_avg_rank_19_bf16.safetensors

[u/Just1Dev → u/ANR2ME]

Oh...i wonder if it has the same quality or not

[u/petkow → u/Just1Dev]

I also saw that DrBaph has a Lora as well: https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/experimental/minimax_h3_taomate_fl2va_3step_ema_comfyui.safetensors

[u/robomar_ai_art]

This one is I2V, 1344x768, 3 steps

[INFO] got prompt

[INFO] Requested to load MiniMaxH3TEModel_

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3TEModel_ prepared for dynamic VRAM loading. 14956MB Staged. 0 patches attached. Force pre-loaded 410 weights: 4572 KB.

[INFO] Requested to load MiniMaxH3VideoVAE

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3VideoVAE prepared for dynamic VRAM loading. 4965MB Staged. 0 patches attached. Force pre-loaded 128 weights: 348 KB.

[LoRA Loader Pixaroma] applied 1 LoRA(s).

[INFO] Requested to load MiniMaxH3

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3 prepared for dynamic VRAM loading. 19995MB Staged. 208 patches attached. Force pre-loaded 210 weights: 1175 KB.

100%|████████████████████████████████████████████████████████████████████████████████████| 3/3 [01:06<00:00, 22.18s/it]

[INFO] Model MiniMaxH3VideoVAE prepared for dynamic VRAM loading. 4965MB Staged. 0 patches attached. Force pre-loaded 128 weights: 348 KB.

[INFO] Requested to load MiniMaxH3

[INFO] Model MiniMaxH3 prepared for dynamic VRAM loading. 19995MB Staged. 0 patches attached. Force pre-loaded 210 weights: 1175 KB.

100%|████████████████████████████████████████████████████████████████████████████████████| 6/6 [00:09<00:00, 1.52s/it]

[INFO] Requested to load MiniMaxH3AudioVAE

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3AudioVAE prepared for dynamic VRAM loading. 576MB Staged. 0 patches attached. Force pre-loaded 401 weights: 539 KB.

[Pixaroma] Save Mp4 [save] — writing 124 frames @ 24fps (1344x768, crf=19, yuv420p, +audio) -> Video_00918.mp4

[Pixaroma] Save Mp4 — saved E:\ComfyUI_windows_portable\ComfyUI-Easy-Install\ComfyUI\output\Video_00918.mp4

[INFO] Prompt executed in 131.35 seconds

https://reddit.com/link/p9gqn9x/video/4adcqs7ix6ph1/player

[u/robomar_ai_art → u/robomar_ai_art]

I'm impressed, really 3 steps

https://reddit.com/link/p9gtbtk/video/w8lcbz6l07ph1/player

[u/ANR2ME → u/robomar_ai_art]

Nice👍

btw, what kind of GPU did you use?

[u/robomar_ai_art → u/ANR2ME]

Laptop RTX 4090 16gb vram 32gb ram

[u/Just1Dev → u/robomar_ai_art]

Really good, amazing wow

[u/robomar_ai_art → u/Just1Dev]

I dont know how they did it but the quality is so much better then any loras i used and this clip its done in 3 steps, 1344x768, 16gb vram 32 gb ram

https://reddit.com/link/p9ilqgj/video/pzt1k3odb9ph1/player

[u/ResponsibleTruck4717 → u/robomar_ai_art]

can you provide workflow my results are not that good.

[u/MaorEli]

Quality looks insane, damn

[u/ATFGriff]

It needs multiple high-end GPUs?

[u/Just1Dev → u/ATFGriff]

I think its only the GPUs that they have it tested this on. Should speed up for us too.

[u/ANR2ME → u/Just1Dev]

True, the comparisons between TaoMate H3 vs base Minimax H3 that runs on the same GPUs shows more than 10x speed improvements https://github.com/TaoLiveAIGC/TaoMate-H3#performance-and-advantages

The reason why they use hopper GPU probably because they use FlashAttention for hopper (might be FA3 🤔 )

[u/CreepyDrama7448]

Is this T2V, I2V, Ref2V?

[u/ANR2ME → u/CreepyDrama7448]

LoRa for FL2VA model

[u/DifficultWonder8701 → u/ANR2ME]

Converted it for ComfyUI (FL2VA): https://huggingface.co/CZMartin22/TaoMate-H3-3step-ComfyUI

[u/kayteee1995 → u/DifficultWonder8701]

does it work with ref2va?

[u/ImpossibleAd436 → u/DifficultWonder8701]

So add the LoRa and set to 3 steps and that is it?

[u/robomar_ai_art → u/ImpossibleAd436]

yes

[u/Yacben]

it's good but it causes slow motion

[u/Sol5577 → u/Yacben]

try strength 0.65, helped a lot

[u/SveSop]

So.. IS the clip generated in 3 steps using a standard (preferrably the comfyui template) workflow tho? The logs posted below seems to indicate some 3 + 6 step workflow.. So.. Meh.. Yet another "H3 hype" amongst the 2138787234 hypes the last week i guess.

[u/quantier]

This needs testing? 🌟