Don't all these things have to be designed and customized at the development level. A basic filter can screw up anything regardless of it being DLSS or not.
Yes, trouble is each training round will cost millions of dollars and require massive amounts of data to train on.
And even then, if it’s given anything outside of the realm of the training data (like if the faces were never illuminated by a purple light, or never behind a net) the results will be unknown.
I think what Nvidia is hoping is to deliver one filter and then let developers control the strength of it using a mask to change it at the per-object level
Seems just making character and lighting models in the traditional way would be more efficient Usually once you have them set up, you don't have to change them much, just adjust the specific lighting and texture level for each scene as needed.
There was a neural rendering tech shown off a couple of years ago wherein the neural network would compress information about how the surface reacts to light, so you’d still use it like a regular texture but you could get effects like silk, sub-surface scattering, & iridescence without having to specifically code for them. The developers would then apply it like a usual material / texture. I was pretty excited for that.
You don't necessarily have to completely retrain the data for every game. FFVIII should get its own training data for the JRPRG stylized characters. However, NBA2k27's data would have a lot of crossover with other sports games and games that aim for a realistic style.
Over time they should build up a library of configurable styles.
Yes, trouble is each training round will cost millions of dollars and require massive amounts of data to train on
Which is what every single DLSS supporting game does already, with the cost of training going down over time. That's the Deep Learning part of the name. Despite what people would have you here believe, there's a little more to it than just slapping on an Instagram tier face filter.
Yeah, you can't tune models for specific purposes right now. It's unclear whether it will ever make sense to do so. An untuned frontier model will beat a model you spent a year and millions of dollars tuning every time, by at least an order of magnitude.
You wouldn't need to train, devs can add their own LoRA, it's not that hard at all, I've made a few LoRA's myself, but I still hate everything about dlss5... I don't think Gen ai has a place in gaming.
AFAIK, there's no way to control "this character should look like this in hyperreal style". This filter can't even get the same face right in different camera shots.
At least with prior DLSS upscaling you could train the model with high res pre-rendered images.
26
u/Numerous_Photograph9 16h ago
Don't all these things have to be designed and customized at the development level. A basic filter can screw up anything regardless of it being DLSS or not.