Corona Renderer Forum

General Category => Feature requests => Resolved feature requests => Topic started by: Eddoron on 2018-01-22, 18:31:32

Title: AI Denoiser
Post by: Eddoron on 2018-01-22, 18:31:32
We describe a machine learning technique for reconstructing image sequences rendered using Monte Carlo methods. Our primary focus is on reconstruction of global illumination with extremely low sampling budgets at interactive rates. Motivated by recent advances in image restoration with deep convolutional networks, we propose a variant of these networks better suited to the class of noise present in Monte Carlo rendering. We allow for much larger pixel neighborhoods to be taken into account, while also improving execution speed by an order of magnitude. Our primary contribution is the addition of recurrent connections to the network in order to drastically improve temporal stability for sequences of sparsely sampled input images. Our method also has the desirable property of automatically modeling relationships based on auxiliary per-pixel input channels, such as depth and normals. We show significantly higher quality results compared to existing methods that run at comparable speeds, and furthermore argue a clear path for making our method run at realtime rates in the near future

Octane & Redshift are already implementing it into their experimental builds.

I think it would be an excellent addition to Corona. The Denoiser seems to be a very favorized feature and it could be greatly enhanced through this.
You say that it might become a CPU/GPU hybrid and I think this could be the gpu part.

Title: Re: AI Denoiser
Post by: lacilaci on 2018-01-22, 19:33:59
I saw this... I love that channel. Wonder if this is something that could be (in the future) implemented in corona.
Title: Re: AI Denoiser
Post by: Luis.Goncalves on 2018-01-23, 11:07:37
I would also love to see this in corona.
Exiting tech
Title: Re: AI Denoiser
Post by: Ondra on 2018-01-23, 15:45:44
Looks nice for interactive. CPU doing the rendering as usual, GPU at the same time free to run the denoiser many times per second, to get fast, noise-free respone. Will look into that. But the core team will have to do it first, then Cinema build will get it "for free" next time the core is updated (happens several times per release)
Title: Re: AI Denoiser
Post by: burnin on 2018-01-23, 16:10:10
Note, it's only usable for previews.
Title: Re: AI Denoiser
Post by: romullus on 2018-01-23, 16:15:20
Well, if it would work with interactive rendering, then that would improve experience greatly. Imagine working with materials, lighting and having relatively noise free preview from first few passes...
Title: Re: AI Denoiser
Post by: burnin on 2018-01-23, 16:26:12
Yup, would also vastly improve animation workflow, especially for previz. Add to IPR the ability to keep 'stuff' in memory & save out 'frames'... mind blown :o
Title: Re: AI Denoiser
Post by: Eddoron on 2018-01-31, 21:47:16
That's how it could look like for previews:

Title: Re: AI Denoiser
Post by: artofcharly on 2018-04-06, 12:22:27
So, any news about AI Denoiser in Corona? =)

Here is the new video from Octane Forum =)

Title: Re: AI Denoiser
Post by: OccultMonk on 2018-05-30, 14:13:36
Vray has implemented NVidia AI Denoiser too.