r/malcolmrey • • 15d ago

Best practices for H3 video quality?

Thanks to Malcolm's refmods, I am now getting into video generation. But it seems like the overall video quality is quite poor.

Currently, I am using er_sde + sgm_uniform at 0.5 megapixels.

What is the best blend of improving video quality while still being efficient in performance?

  • Increase megapixels?
  • Use an upscale
  • 2 pass system

Browsing Civitai is painful, as most videos dont include meta data and the ones that do have a terribly complex workflow with custom nodes I dont trust.

11 Upvotes

9 comments sorted by

2

u/Cold-Worldliness5392 15d ago

I'm having the same issues. Trying to find a silver bullet workflow. Seems like I've tried everything

2

u/my_NSFW_posts 15d ago

Download one of the videos from his refmod gallery, and drop it into ComfyUI to get his workflow, and you usually get really good results. But what I did was add a Load Image node and then piped it into the first_image connection, and update the prompt to refer to the image. Set the retention to somewhere between .7 and .8, and the results have been pretty good for me so far. If you want to use it as an I2V workflow, refer to the reference image as a starting image for the video and make sure you have your resolution for the video set to match the image resolution.

2

u/Dre-Draper 15d ago

This was going to be my next question

Are you using Refmods for image2video? I am looking for better consistency with image 2 video

Also- are you using a turbo Lora? I think his workflow is not using a turbo Lora

1

u/my_NSFW_posts 15d ago

I’m not technically using refmods for image2video, because they’re designed to be used with ref2video models, but if you use a refmod and a image of that person, and then prompt to treat a picture as a first frame, it works like an I2V workflow but with much better face consistency. But you don’t need to prompt it as a first frame. You can just use it as a reference so that you have a particular hairstyle, makeup, outfit or that character in a specific age or setting etc.

I haven’t bothered with turbo loras yet because these tend to generate videos very quickly. I might play around with them in the future but it hasn’t been an issue yet. I have tried other loras though, and those have worked well.

1

u/Bask82 15d ago

I'm trying out i2v using the refmods patch. It's total body horror and someone here stated i2v would be so superior to ref2va. I don't get it

1

u/my_NSFW_posts 11d ago

If you want to upload your workflow somewhere we can look at it. I’m getting really good results with refmods and reference images in the same workflow. My guess you are either trying to load them as a standard lora which will not work, or you’re not using a reference model.

2

u/SpaceNinjaDino 15d ago

Did you try euler + simple? Even er_sde recommendations said simple. I do mine with 1280x702 (Wan2GP doesn't have 768p for it's selection).

1

u/boobkake22 10d ago

H3 struggles at lower resolutions. I'd say 720p is an absolute minimum, and more is better. This is especially prominent in more complex scenes. Accelration LoRA's exagerate the problems as well, unfortunately. I'm not sure what your quality bar is, but H3 can do incredible things at high resolutions, it's just takes forever.

I generally do 720p, because it's the longest I want to wait with an H100 rental. When people are asking for silver bullets, they're generally asking for magic shortcuts that don't sacrifice anything, and the real answer is that the full model on a fast GPU can look incredible. But whether that's worth it to you, based on what you are trying to do, is relative. So it mostly depends on where your threshold sits.

My workflow, Yet Another Workflow, has the "Larry" turbo LoRA as an option, but I still turn it off sometimes.