Chaos Corona Forum

General Category => General CG Discussion => Topic started by: n.merazzi on 2023-09-25, 11:40:21

Title: 3D Gaussian Splatting
Post by: n.merazzi on 2023-09-25, 11:40:21
I'm sure you guys have seen this, but please take a few minutes and type it on Google for anyone who hasn't seen it.

- for Archviz Artists.

for all 3D Artists.

Ondra and Corona team, do you guys think this kind of training can be applied to a 3D rendering engine?

with a single video, you can transform everything in 3D - with incredibly high quality and high-speed frame.

Well... the discussion is open. =)
Title: Re: 3D Gaussian Splatting
Post by: zaar on 2023-11-13, 13:40:33
I think it's shocking that this has no replies. I have no interest in turning my 3d scenes into 3DGS, but I have a huge interest in going out and capturing a location and turning it into a 3DGS. This is something fantastic for arch viz, which is Coronas main audience, right?
It's been oddly quiet on the autodesk, v-ray and corona front about this tech. The UE, Blender and Unity scene is all over it. Alteast from my biased internet bubble.
This is what's going to push me into doing an actual project in UE soon.

If any developer sees this, I would be really interested to hear if the ability to read and render 3DGS would be best implemented on the autodesk/Max side of things, or in the actual renderer. So I know who to nag ;)
Title: Re: 3D Gaussian Splatting
Post by: pokoy on 2023-11-13, 14:06:45
Yeah, was wondering this too, especially since setting this up from actual 3d data might be more accurate, I guess it could help to some degree with slight changes in animations without the need to re-render everything.

FWIW, here's a thread over at Chaos forums asking basically the same question, but don't expect too much:
https://forums.chaos.com/forum/v-ray-for-3ds-max-forums/v-ray-for-3ds-max-wishlist/1193659-3d-gaussian-splatting-in-v-ray (https://forums.chaos.com/forum/v-ray-for-3ds-max-forums/v-ray-for-3ds-max-wishlist/1193659-3d-gaussian-splatting-in-v-ray)

I wouldn't wait for Autodesk, their 'evangelists' are probably trying to come up with a way on how to get rid of expensive 3d dev and somehow utilize AI and be done. Their approach seems to be adding 1-2 modifiers per release cycle, adding stuff no one asked for and fixing bugs introduced while doing so... or not.
Title: Re: 3D Gaussian Splatting
Post by: Juraj on 2023-11-13, 15:04:14
Absolutely amazing tech. I want to use this for some construction help in family garden as quick sort of visualizing scanned pointcloud of environment :- ) As I've seen Unreal will be able to read/use this
Title: Re: 3D Gaussian Splatting
Post by: zaar on 2023-11-13, 15:14:14
Absolutely amazing tech. I want to use this for some construction help in family garden as quick sort of visualizing scanned pointcloud of environment :- ) As I've seen Unreal will be able to read/use this

Here's some inspiration in case you need to put smoke monsters in your family garden:





Title: Re: 3D Gaussian Splatting
Post by: zaar on 2023-11-15, 08:12:53
In a browser:

https://www.reddit.com/r/Spline3D/comments/17v8ii1/update_we_are_adding_gaussian_splatting_to_spline/

Live demo: https://my.spline.design/girlstudio-8b6211e0b6ab456c8764297c6ff3ed45/

If a developer, or any one else who's knowledgeable enough, sees this: is combining splats with a pure ray/pathtracer a difficult scenario?
Title: Re: 3D Gaussian Splatting
Post by: n.merazzi on 2023-11-16, 11:50:19
When I saw that, the first thing that came in mind was to record the context buildings, so We don't need to spend time on it and we will have the most realistic results, but at some point I start to see we have a lot of gaussian splats over the scene that makes it unuseful. Also, It is working on UE, and perhaps Vantage can import the file as Polycam allow you to export the GS as .ply.

That's one of the reasons that I start to study even more UE. If they could make the materials system more friendly would be amazing. hehe.

Juraj, send your results please =)
Title: Re: 3D Gaussian Splatting
Post by: Juraj on 2023-11-16, 11:59:26
Hah that will be some time until I get to it :- )
Title: Re: 3D Gaussian Splatting
Post by: TomG on 2023-11-16, 14:46:38
Some initial tests here at Chaos were somewhat disappointing, though those are but early tests so we can't speak to what may or may not happen long term. For interest, can you share how you see this being used when it comes to integration with path tracing? Lighting, reflections, etc. would already be baked in if adding them into the scene - so maybe as an environment? Or are you picturing creating Gaussian splats from the 3D scene as a new kind of output vs. a still or animation?
Title: Re: 3D Gaussian Splatting
Post by: Juraj on 2023-11-16, 14:55:31
For me for example, I don't expect any modification much on the Splatted object, but I would like the regular geometry to take it into account (reflect the Splatted object, occluded light,...)
So yes, basically environment.
Title: Re: 3D Gaussian Splatting
Post by: zaar on 2023-11-16, 14:59:54
TomG:
In the near term, my interest is on the input side of things. To get locations, and possibly objects, that are difficult to scan or model with traditional methods. It would replace photogrammetry. And I do a lot of photo matched architectural work, so I'm thinking this would allow me to not only nudge the camera after the fact, but also crop and cull unwanted things in the volume. A 3D photograph, that's what I want! :D

Output seems like not a problem already? Just time consuming to render a bazzilions views and process it, just as you would with photographs from the real world. Maybe its' possible to think of some more effective method. But I think input is more interesting.

Juraj: You sell high quality hdris of locations right? Imagine 3DGS with hdri support *drool*
Title: Re: 3D Gaussian Splatting
Post by: TomG on 2023-11-16, 15:07:37
On "replace photogrammetry", thing is photogrammetry aims to remove the effect of lighting so that the scene can be relit in 3D and used in any situation, but splatting is more about capturing the lighting, reflections and baking those in, meaning you'd have to make the scene around it (and all such "splatted objects" would also need the same lighting and reflections, which would seem very unlikely). Is there a way you visualized splatting working differently than that, so that it would replace photogrammetry? Locations maybe, as then it would surround anything you add into it (ie "environments" as mentioned earlier).
Title: Re: 3D Gaussian Splatting
Post by: Juraj on 2023-11-16, 15:17:13
I am sure some smart people are already thinking how to de-light these to create "PBR" Point-Clouds/Nerfs/Splats :- ).

But even photogrammetry is useful in many way with baked light into it, just not as flexible.
And lighting already lit object while fully incorrect from accuracy point, can still be useful and is often used trick in VFX.

So I wouldn't discount something because it doesn't adhere to common workflow.
Title: Re: 3D Gaussian Splatting
Post by: zaar on 2023-11-16, 15:36:38
I am sure some smart people are already thinking how to de-light these to create "PBR" Point-Clouds/Nerfs/Splats :- ).

Exactly, "how many papers down the line?" ;D


TomG:
I understand the difference between 3DGS and traditional photogrammetry that generates a mesh and textures (that one probably de-lights in some way).

With 3DGS I would have some of the same problems that I do with my regular workflow of matching a rendered building into a photograph of a location. I would have to match the lighting on the model to fit the environment in both cases. But there would be more interaction. The model could reflect and possibly be shadowed by the 3DGS surrounding. Preferably also cast shadows on it, even if that might cause non-physical effects of something being shadowed twice by the sun.


Why 3DGS? It seems easier and more lightweight than photogrammetry. Also 3DGS capures view dependant effects in a way that traditional photogrammetry does not. And not to mention handles thin objects such as vegatation and eyelashes (look at the spline demo!). It all seems very nice.
Title: Re: 3D Gaussian Splatting
Post by: TomG on 2023-11-16, 16:22:34
Great info ty! We were wanting to see how people would put this to use, I'll pass it along for any future testing we do with this technology.
Title: Re: 3D Gaussian Splatting
Post by: n.merazzi on 2023-11-16, 17:53:20
Hey TomG,

Glad to see you here.

My idea is to use Gaussian as an environment for animations and stills. If we could use (not sure if possible) the geometry + textures from 3DGP, that would be great. So, basically, all we need is to take videos on overcast days (not hard in London) and then use them as our environment. This way, we will have the real world inside our software as the background and can add our project in the middle of it. Of course, all 3DGP elements need to receive Corona sun + sky light, and even simple Corona lights, receive and cast shadows, etc. Essentially, replace the context of the project.

I would be more than happy to help.

Title: Re: 3D Gaussian Splatting
Post by: Stéphane Agullo on 2024-09-30, 14:05:48
Hi everyone!

Apparently things are moving ahead with Vray, it's a very important subject, because this capture technology is incredible, Meta has just made some great announcements, Varjo too, and even if it will never replace traditional polygonal techniques, it's fantastic for environment management for example! Today, we're obliged to integrate it into After Effect, with its 3D mode, but with Corona's 2D flat rendering .. and lot of animated masks, whereas it would be much simpler just to put it into Corona! We might as well be mixing 3Ds, rather than using 2Ds in the middle! Here's an example of a simplified drone scan for web display, and an example of an integrated model with Corona rendering. I hope this will be compatible with Corona soon, we can already do it with Blender, Houdini, UE5, Unity, .. and soon Vray!!!!

VRAY INTEGRATION

DRONE GAUSSIAN SPLATTING
https://adnfamily.com/studio/rd/ia/gs/dunkerque.html

CORONA & AFTER EFFECT INTEGRATION
https://adnfamily.com/studio/sovi/caldera/maquette.html

I already made a post in [Max] Feature Requests, but I can't answer it.

Already BRAVO for your work on Corona,
Thank you & nice continuation!

Best regards.
_
Title: Re: 3D Gaussian Splatting
Post by: TomG on 2024-09-30, 14:19:57
With the work completed on integrated it into V-Ray, we will be considering this for next year in Corona, as in theory all the hard lessons have been learned by the V-Ray team ;) Naturally not possible to do it this year, as our release this year has been mapped out for some time.
Title: Re: 3D Gaussian Splatting
Post by: zaar on 2024-09-30, 14:25:06
Wow, this is VERY good news, Tom! Speaking of what's been mapped out, the trello board is a bit empty, and I've been wondering if it's a sign of people being too busy working on stuff, or that there's nothing planned?


Nice examples of your work SA3D46. And thanks for sharing that video, it slipped by me.
Title: Re: 3D Gaussian Splatting
Post by: TomG on 2024-09-30, 14:57:41
Trello just got updated on Friday, with the things we have some level of confidence in for the next release :) Others to be added if we hit a level of confidence in them being ready. The update is purely on the next release, longer term plans are not updated (and won't be until after the 12 Update 1 release in November, as that is when we'll have a clearer picture for next year).
Title: Re: 3D Gaussian Splatting
Post by: Stéphane Agullo on 2024-09-30, 15:34:39
This is fantastic!!! Great to be able to integrate this into our workflows, game changer for capturing environments!
Lots of new advances every day, here are some useful links for those who want to discover a little more about this new approach!

https://radiancefields.com/
https://linktr.ee/gaussian_splatting
https://gaussiantracer.github.io/
https://www.jawset.com/
https://playcanvas.com/supersplat/editor
https://github.com/mkkellogg/GaussianSplats3D
https://docs.nerf.studio/
https://volinga.ai/

Nice continuation to all!
Thank you!
_
Title: Re: 3D Gaussian Splatting
Post by: Stéphane Agullo on 2024-10-01, 18:52:25
Can't wait !! :D

Title: Re: 3D Gaussian Splatting
Post by: Stéphane Agullo on 2024-12-22, 04:22:31
Hi!

Any news on the integration of Splats in Corona?
That would be really handy! Today we have to transform the Corona renderings into Splats, mix it with the drone's Splats, and do the render / animation in After Effect! Not so easy!

Here are some examples optimized for the web,

CORONA
https://adnfamily.com/studio/rd/ia/gs/nhood/experience/index.html (https://adnfamily.com/studio/rd/ia/gs/nhood/experience/index.html)
(https://adnfamily.com/studio/rd/ia/gs/nhood/experience/vignette.jpg)

CORONA + DRONE
https://adnfamily.com/studio/nhood/counord/experience/index.html (https://adnfamily.com/studio/nhood/counord/experience/index.html)
(https://adnfamily.com/studio/nhood/counord/experience/vignette.png)

Thanks a lot!
_
Title: Re: 3D Gaussian Splatting
Post by: TomG on 2025-01-06, 14:04:01
No news yet as the planning is yet to take place, as several of us were on quite long holiday season time off (e.g. me, as I hadn't taken much time off during the year so caught up at the year end!). We'll update Trello once we have some plans (though as always that reminder - development being what it is, Trello is a plan and not a promise, once we do get around to updating it :) ).
Title: Re: 3D Gaussian Splatting
Post by: Darawork on 2025-03-07, 13:07:39
Just spotted this yesterday:

Title: Re: 3D Gaussian Splatting
Post by: leo_surrealismo on 2025-05-21, 02:12:18
Wow! 
Impressive result! would you mind explaining your workflow?


Hi!

Any news on the integration of Splats in Corona?
That would be really handy! Today we have to transform the Corona renderings into Splats, mix it with the drone's Splats, and do the render / animation in After Effect! Not so easy!

Here are some examples optimized for the web,

CORONA
https://adnfamily.com/studio/rd/ia/gs/nhood/experience/index.html (https://adnfamily.com/studio/rd/ia/gs/nhood/experience/index.html)
(https://adnfamily.com/studio/rd/ia/gs/nhood/experience/vignette.jpg)

CORONA + DRONE
https://adnfamily.com/studio/nhood/counord/experience/index.html (https://adnfamily.com/studio/nhood/counord/experience/index.html)
(https://adnfamily.com/studio/nhood/counord/experience/vignette.png)

Thanks a lot!
_
Title: Re: 3D Gaussian Splatting
Post by: Stéphane Agullo on 2025-05-30, 14:17:35
Hi!

I hope it's still on the roadmap? It would be great for drone environments! Today we have to digitize 3D in splat, for integration.
After that, it's still interesting for digitizing Corona projects, as it's like a bake of geometry, material & lighting. It's always fun to walk through a Corona rendering, even in VR!

https://superspl.at/view?id=e011f7ab
https://adnfamily.com/studio/mj/domaine_aura/experience/index.html

Off topic, but since we're talking about RT, Corona & Datasmith compatibility really isn't that great! Materials, triplanar, and especially scatters don't really work.
ForestPack only? Really a shame for doing UE5 projects! Disappointing from Chaos & Epic ..

Thanks & nice continuation!
_
Title: Re: 3D Gaussian Splatting
Post by: TomG on 2025-05-30, 15:31:37
Generating splats from a 3D scene was never on the road map really; the one thing that was being considered was the ability to render a Gaussian in Corona (ie incorporate it into your 3D scene). The second one is still up for consideration but not sure when, whether that might be 14 or perhaps 15 instead (as we also want to check into new innovations that don't happen anywhere, vs. "Aha V-Ray has this we should add it too"). We (Chaos) have other thoughts on the concept of walking through a Chaos scene, so we'll see what comes of that :)

As for UE, well it's a game engine, and it's approach and UI and needs are not at all geared up toward the archviz folks. This is where Vantage comes in (and Project Arena when it comes to movies and the like), where everything is much more integrated and designed for specific (non-gaming) purposes. Epic did have a phase some 5 years ago where they seemed to want to take over in archviz (and I'd phrase it that way rather than that they "cared" about archviz), but that ended 3 or 4 years ago when they shifted their focus back onto their core business of making an engine for making games.
Title: Re: 3D Gaussian Splatting
Post by: Stéphane Agullo on 2025-05-30, 20:19:34
Yes!

That's what I meant, being able to import splats into Corona would be really practical for environments. Drone scanning is very simple, the quality is perfect, and the rendering is much better than with photogrammetry or Google Earth. And once the environment is in the scene, there's no need for tracking or post-production. It's a real game changer! For generation, it's another story, today we have automated the workflow from Corona, it's a really particular approach, but it's interesting, but it's the best way to mix with drone scanning.

Otherwise, it's a shame for UE5, because it remains a very good real-time 3D engine, and in my opinion, Vantage is more of a rendering engine. Doesn't it offer the creation of a real-time 3D experience? Corona conversion is still possible, but not very user-friendly. Curious to know if other solutions are in the pipeline!

Thanks!
_
Title: Re: 3D Gaussian Splatting
Post by: tolgahan on 2025-06-03, 10:26:22

Title: Why Corona Needs Gaussian Splat Support — Now

As someone who works daily in architectural visualization, I was excited to see Octane 2026.1 Alpha introducing native Gaussian Splat support. With just a 15-second iPhone video, you can create rich, light-reactive spatial data — and use it directly in your scenes.

Meanwhile, Corona Render — which prides itself on photorealism and lighting precision — still has zero implementation or roadmap communication regarding radiance fields or Gaussian splats.

This is not just a missing feature anymore. It's a strategic blind spot.

With tools like Luma AI, Polycam, and Gaussian Splatting libraries becoming mainstream, artists now expect to combine capture-based workflows with physically accurate rendering.

Corona’s lack of support here creates a growing gap for visual artists who want to move fast, iterate interactively, and integrate real-world detail into their work.

Dear Chaos team, if Corona wants to remain relevant in the future of rendering, neural data like Gaussian Splats shouldn't be ignored.

The tech is there. The use case is clear. What are we waiting for?
Title: Re: 3D Gaussian Splatting
Post by: TomG on 2025-06-03, 10:39:25
Umm, it's not ignored - we've mentioned repeatedly it is going to come to Corona, and that the decision is whether that's 14 later this year, or 15, depending on what we map out once we sit down after the release of 13. All that is said in this very thread, in fact! So it is right there at the top of the chain of things we are considering :)

Do use the AHA portal to vote, of course. In particular there is a bit of a contradictory message - "Stop just adding what V-Ray just added, and innovate!" vs "V-Ray just added Gaussian Splat rendering, add it!". So the voting on the portal will sort out which of those takes real priority for the users :)
Title: Re: 3D Gaussian Splatting
Post by: TomG on 2025-06-03, 10:41:40
It's 5th on the list so far, if you remove clusters and toon shading which are due in 13:
https://chaoscorona.ideas.aha.io/?sort=popular

Title: Re: 3D Gaussian Splatting
Post by: tolgahan on 2025-06-03, 11:01:16
Thanks for the reply Tom — fully respect that you and the team are tracking this, and that it’s in the AHA roadmap.

That said, I want to clarify one key thing:
This isn’t about “adding what V-Ray added.”
It’s about not missing what real-time, capture-based workflows are becoming for us in 2025.

Gaussian Splats aren't just another rendering trend — they're a new layer of creative input.
For many of us working in architectural and environmental visualization, the ability to bring scanned or AI-generated splats into a physically-based renderer like Corona would be a gamechanger.

Octane and others have already opened this door. Corona has a chance to do it with better lighting realism and artistic control.

So yes, we want innovation — and in this case, innovation also means adapting to how the craft is changing.

Appreciate all the work the team’s doing. Looking forward to seeing how you approach it!


As a fanatic corona user, I can sometimes overreact a little. :))))))))  Thank you for your understanding.

Title: Re: 3D Gaussian Splatting
Post by: TomG on 2025-06-03, 12:27:12
Keep up the enthusiasm and passion!

I personally agree about the rendering of Gaussian Splats, and see it as useful regardless of whether V-Ray has recently done it or not. But we do get that criticism leveled at us, which makes it tricky, how will users interpret it - as a fantastically useful new feature and who cares if someone else did it first it's about time Corona had it regardless, or as another err... reason? to just complain that we don't innovate any more.

It is still high in the user votes, I do think it is incredibly useful for archviz, so it is very high in the running either way :) I do encourage folks to vote over the next week or two, as it won't be long before we sit down and decide what is happening next, and we'll be pulling up those votes during that process. So if you want Gaussian Splats, go vote! Or indeed vote for whatever other features you'd like to see given priority. Influence what 14 will be :)
Title: Re: 3D Gaussian Splatting
Post by: tolgahan on 2025-06-03, 15:08:02
Keep up the enthusiasm and passion!

I personally agree about the rendering of Gaussian Splats, and see it as useful regardless of whether V-Ray has recently done it or not. But we do get that criticism leveled at us, which makes it tricky, how will users interpret it - as a fantastically useful new feature and who cares if someone else did it first it's about time Corona had it regardless, or as another err... reason? to just complain that we don't innovate any more.

It is still high in the user votes, I do think it is incredibly useful for archviz, so it is very high in the running either way :) I do encourage folks to vote over the next week or two, as it won't be long before we sit down and decide what is happening next, and we'll be pulling up those votes during that process. So if you want Gaussian Splats, go vote! Or indeed vote for whatever other features you'd like to see given priority. Influence what 14 will be :)


Totally agree Tom — and appreciate your transparency here.

I get that the "innovation vs following V-Ray" narrative can create friction, but to me, Gaussian Splats are not about competitive feature matching — they’re about embracing where visual workflows are going.

For architectural visualization especially, this isn’t just a new toy — it’s a tool for speed, iteration, and storytelling. The ability to scan a context or object on-site with a mobile phone and light it in Corona's beautiful renderer? That’s not a gimmick. That’s power.

I’ll definitely encourage my team and peers to vote on AHA. Because if this is a matter of priority, I believe the future of context-aware, capture-driven rendering deserves to be high on that list.

Thanks again for being open to the feedback — it’s this kind of conversation that keeps us all excited about Corona’s potential. 🙌
Title: Re: 3D Gaussian Splatting
Post by: TomG on 2025-06-03, 15:27:22
Being able to capture the surroundings, in 3D, with just a regular phone or drone, and have it process quickly to give a relatively light and easy to work with model, is pretty astounding really. No more reliance of specialist tech, or on software that produces billions of polys and takes hours to do so, or just relying on flat 2D imagery of a surrounding area - all that kind of thing is the bread and butter of many 3D projects :)