3D Gaussian Splatting

[n.merazzi]

Hey TomG,

Glad to see you here.

My idea is to use Gaussian as an environment for animations and stills. If we could use (not sure if possible) the geometry + textures from 3DGP, that would be great. So, basically, all we need is to take videos on overcast days (not hard in London) and then use them as our environment. This way, we will have the real world inside our software as the background and can add our project in the middle of it. Of course, all 3DGP elements need to receive Corona sun + sky light, and even simple Corona lights, receive and cast shadows, etc. Essentially, replace the context of the project.

I would be more than happy to help.

[Stéphane Agullo]

Hi everyone!

Apparently things are moving ahead with Vray, it's a very important subject, because this capture technology is incredible, Meta has just made some great announcements, Varjo too, and even if it will never replace traditional polygonal techniques, it's fantastic for environment management for example! Today, we're obliged to integrate it into After Effect, with its 3D mode, but with Corona's 2D flat rendering .. and lot of animated masks, whereas it would be much simpler just to put it into Corona! We might as well be mixing 3Ds, rather than using 2Ds in the middle! Here's an example of a simplified drone scan for web display, and an example of an integrated model with Corona rendering. I hope this will be compatible with Corona soon, we can already do it with Blender, Houdini, UE5, Unity, .. and soon Vray!!!!

VRAY INTEGRATION

DRONE GAUSSIAN SPLATTING
https://adnfamily.com/studio/rd/ia/gs/dunkerque.html

CORONA & AFTER EFFECT INTEGRATION
https://adnfamily.com/studio/sovi/caldera/maquette.html

I already made a post in [Max] Feature Requests, but I can't answer it.

Already BRAVO for your work on Corona,
Thank you & nice continuation!

Best regards.
_

[TomG]

With the work completed on integrated it into V-Ray, we will be considering this for next year in Corona, as in theory all the hard lessons have been learned by the V-Ray team ;) Naturally not possible to do it this year, as our release this year has been mapped out for some time.

[zaar]

Wow, this is VERY good news, Tom! Speaking of what's been mapped out, the trello board is a bit empty, and I've been wondering if it's a sign of people being too busy working on stuff, or that there's nothing planned?


Nice examples of your work SA3D46. And thanks for sharing that video, it slipped by me.

[TomG]

Trello just got updated on Friday, with the things we have some level of confidence in for the next release :) Others to be added if we hit a level of confidence in them being ready. The update is purely on the next release, longer term plans are not updated (and won't be until after the 12 Update 1 release in November, as that is when we'll have a clearer picture for next year).

[Stéphane Agullo]

This is fantastic!!! Great to be able to integrate this into our workflows, game changer for capturing environments!
Lots of new advances every day, here are some useful links for those who want to discover a little more about this new approach!

https://radiancefields.com/
https://linktr.ee/gaussian_splatting
https://gaussiantracer.github.io/
https://www.jawset.com/
https://playcanvas.com/supersplat/editor
https://github.com/mkkellogg/GaussianSplats3D
https://docs.nerf.studio/
https://volinga.ai/

Nice continuation to all!
Thank you!
_

[Stéphane Agullo]

Can't wait !! :D

[Stéphane Agullo]

Hi!

Any news on the integration of Splats in Corona?
That would be really handy! Today we have to transform the Corona renderings into Splats, mix it with the drone's Splats, and do the render / animation in After Effect! Not so easy!

Here are some examples optimized for the web,

CORONA
https://adnfamily.com/studio/rd/ia/gs/nhood/experience/index.html


CORONA + DRONE
https://adnfamily.com/studio/nhood/counord/experience/index.html


Thanks a lot!
_