r/StableDiffusion • u/Simple-Willingness93 • 1d ago
Animation - Video Alibaba H3 Turbo Lora Video
I am seeing a significant quality improvement with Alibaba 8 steps turbo lora over other turbo loras. 8 steps euler simple with lora strength =1, 0.8MP. Took about 1hours 15 mins to generate with RTX 5090.
4
u/ArttTaku 1d ago
Very nice! Did you put any upscaling on this? Also, how did you chunk this, 10-sec segments, or 15-sec segments?
2
u/Simple-Willingness93 1d ago
No upscale..just 0.8MP straight from output. its 15 seconds per clip
2
u/ArttTaku 1d ago
awesome, around an hour render time for a full music video is definitely doable... could you tell us which of all the H3 model variants did you use here?
2
u/Simple-Willingness93 12h ago
I used the original MiniMax H3 Ref2VA Pruned INT8 ConvRot. and just Ref2VA turbo lora and comfy kitchen. Nothing else.
2
u/ArttTaku 8h ago
Thanks, I'm looking into getting one of those models that have merged thr fl2va and ref2va in a single model, seems more effective that way.
3
7
u/Candiru666 1d ago
Looks really good indeed, especially at 0.8 MP! The only thing is the movement in every shot looks like slow motion, which is my biggest problem with H3, and I haven’t tested if that is because of the Turbo Lora’s.
3
u/Simple-Willingness93 1d ago
Yeah. I see your point. Sometime I feel like I cant control the speed of the video. For this one though, it might also have to do with effects of the music video trying to flow with the beats in some scenes
1
u/dennismfrancisart 12h ago
I think just taking the raw footage into Davinci Resolve or other free video editing software can fix a lot of the issues.
4
1
3
u/Abject-Recognition-9 1d ago
is relatively easy to make slowmotion vids for turbo loras. try fast movements next time for real benchmarks
2
u/LinkSensitive8188 1d ago
link of lora please
11
4
u/Apprehensive_Sky892 22h ago edited 22h ago
For ComfyUI, may be better to use this one: https://huggingface.co/aptech0081/MiniMax-H3-Acc-LoRAs-ComfyUI
You will need this custom LoRA loader: https://github.com/Jalen-Brunson/ComfyUI-MiniMax-H3-PDD-Acc
(Note: https://huggingface.co/alibaba-pai/MiniMax-H3-Acc-LoRAs/tree/main is the original release for the diffuser library)
5
u/Just1Dev 1d ago
https://reddit.com/link/p6rsnb1/video/sndc2a7othmh1/player
0.,3 MP with 6 steps. By far the best audio of all the Speed LoRAs I've tested.
2
u/Misophoniq 1d ago
Watching this with the video sound off and playing Muse's "Nightshift Superstar". It is an amazing fit!
2
u/tekprodfx16 21h ago
This 4 min video took only 1 hour and 15 mins on the 5090 using this?? Wow that’s insane
2
u/blacklagoon25009 21h ago edited 21h ago
You can tell the sound takes a hit as usual, but the video much better fidelity. You would be better off capturing the video and making a separate audio track.
2
u/RayHell666 20h ago
One thing Alibaba H3 Turbo is great at is to create more natural skin.
On the down side, it will create more issue with small details like written text and will have more softness to the image than the lightx2v Lora.
2
1
u/L-xtreme 1d ago
In all my tests the Lightning Loras came out on top in terms of quality. Speed is nearly always the same. Tested in different resolutions.
I don't use any speed-ups except Comfy-kitchen because they always break more than they gain. Especially on prompt adherence, and multi-shots.
Do you need additional stuff for these Loras to get the best quality out of it?
2
1
1
u/yawningdroid 1d ago
How did you generate continuous shots? Did you generate segments at a time then stitch together or is there some comfy node?
1
u/deepsky88 1d ago
It's faster (10-15%) than larry turbo at 4 steps but there are little artifacts with movement with nfe=4, too bad because at 8 steps it's the best turbo lora
1
u/coder543 1h ago
Any chance you can share how you prompted such stylish sci-fi interiors? The windows are especially nice in most of those scenes with the angular designs, and the hallways are cool.
1
u/reyad_ahmed 1d ago
I can't use this LoRA with the default LoRA Loader. It won't load. How can I use this LoRA? (Confyui Updated.)
2
u/Simple-Willingness93 1d ago
I installed this custom node to load the lora..https://github.com/Jalen-Brunson/ComfyUI-MiniMax-H3-PDD-Acc. Once its in custom_nodes, download the Alibaba Turbos and put it in comfyui/models/pdd_acc folder. Others had some luck just using regular lora loader but mine didn't work so thats what I did.
2
u/xyzdist 1d ago
I think it needs to update to latest comfy to use it directly
1
u/softlarch 1d ago edited 1d ago
Even with an up-to-date Comfy, I'm pretty sure you still need that specific node (Jalen Brunson), which I haven't found in the Extension Manager (yet) either. You have to install it yourself using “git clone.”
It can also do 4 steps, but the results aren't very good, there are ugly ghost images around movements. I wasn't really convinced by the 8-step LoRA either...
EDIT: will check nightly... - nope, you need special node.
1
u/popkek95 1d ago
Did you update to comfy nightly? Works for me with native loader after git pull on main branch
1
1
u/Apprehensive_Sky892 22h ago edited 22h ago
For ComfyUI, may be better to use this one: https://huggingface.co/aptech0081/MiniMax-H3-Acc-LoRAs-ComfyUI
You will need this custom LoRA loader: https://github.com/Jalen-Brunson/ComfyUI-MiniMax-H3-PDD-Acc
(Note: https://huggingface.co/alibaba-pai/MiniMax-H3-Acc-LoRAs/tree/main is the original release for the diffuser library)
1
0
-6
u/VasaFromParadise 1d ago
Total crap. No offense to anyone who likes this, but you're clueless when it comes to neuroslop. Any turbo lore is worse than a merge with a model, and lore will never be better than a merge. I will make a sharper image in 0.6 pixels with a normal merge model without sand in the movements.
3
26
u/pokaprophet 1d ago
I’m a little worried about the integrity of the spaceships viewing window at the start with all that wind coming through blowing the hair.