Chaos Corona Forum

Chaos Corona for 3ds Max => [Max] Feature Requests => Topic started by: peterguthrie on 2019-02-22, 11:14:09

Title: tiled exr tx textures
Post by: peterguthrie on 2019-02-22, 11:14:09
Hello All,

Couldn't find a topic about this so thought I would start one. Just wondering if coronabitmap supports tiled exr or tx formats?

I'm been testing a few scenes where I convert the large bitmaps (over 4k) to tiled exr or tx. Max loads a hell of a lot quicker and it can save a lot of RAM when rendering as well.

Pixamoon's bitmap relinking script can convert automatically, although it currently doesnt support coronabitmap.

any thoughts or experience in doing this?

Peter
Title: Re: tiled exr tx textures
Post by: agentdark45 on 2019-02-25, 21:50:23
Had a quick read on tiled exr's - very interesting, I did not know this was a thing. If I understand correctly, Max will only load parts of the exr texture visible in the render to RAM? Any downsides to this workflow?

I wonder if this could be implemented within corona using regular jpg's?
Title: Re: tiled exr tx textures
Post by: peterguthrie on 2019-03-17, 13:12:16
yes definitely has a lot of potential as everyone moves towards bigger and bigger textures.
Title: Re: tiled exr tx textures
Post by: maru on 2019-04-04, 15:14:38
Is it similar to UDIM?
https://forum.corona-renderer.com/index.php?topic=15635.0
Title: Re: tiled exr tx textures
Post by: Njen on 2019-04-04, 22:55:23
No, what peterguthrie is referring to is basically mipmapping in a texture format. Multiple resolutions of the texture are stored in a container (exr or tif), and the renderer then uses smarts to choose the correct resolution inside the tiled image based on distance to camera, and thus is able to efficiently use RAM resources. The user is also able to bias the resolution chosen by the renderer by changing the blur value if they want to.

In a perfect world, I'd love for Corona to be able to load in tiled UDIM's for the most efficiency in memory usage and shader setup.
Title: Re: tiled exr tx textures
Post by: agentdark45 on 2019-04-05, 15:49:49
No, what peterguthrie is referring to is basically mipmapping in a texture format. Multiple resolutions of the texture are stored in a container (exr or tif), and the renderer then uses smarts to choose the correct resolution inside the tiled image based on distance to camera, and thus is able to efficiently use RAM resources. The user is also able to bias the resolution chosen by the renderer by changing the blur value if they want to.

In a perfect world, I'd love for Corona to be able to load in tiled UDIM's for the most efficiency in memory usage and shader setup.

Could this not be done on the fly with regular jpg's? For example: rays are cast from the camera to scene objects to determine the optimal resolution of the texture, the render engine then downsamples a copy of the jpg into RAM, dumping the original large texture. Sure this might take some additional processing time - but could be invaluable on heavy/static scenes.
Title: Re: tiled exr tx textures
Post by: Njen on 2019-04-05, 23:50:05
The whole point for tiled textures is that the renderer doesn't have to load in the largest size to 'down sample' anything. It's way more efficient for time and memory to simply select a lower res tile (or 'mipmap') from a container than to load in the largest resolution, decompress it, then generate a lower res version of that map all on the fly.
Title: Re: tiled exr tx textures
Post by: romullus on 2019-04-06, 10:52:47
I remember Ondra once said that something similar is planned for Corona bitmap.
Title: Re: tiled exr tx textures
Post by: peterguthrie on 2019-04-06, 18:22:23
exciting news!
Title: Re: tiled exr tx textures
Post by: Benjamin_F on 2019-06-05, 11:21:56
A big thumbs up for this!

With a lot of 100-300Mb textures, life is getting really hard.
Would be great to directly support .tx files.
Title: Re: tiled exr tx textures
Post by: SamL on 2020-03-17, 12:43:29
Have there been any developments on this?

We're looking at converting our library to use .tx files but we want to maintain compatibility across VRay and Corona.
Title: Re: tiled exr tx textures
Post by: Mohammadreza Mohseni on 2020-03-17, 14:57:16
i waited for this feature for years.... that would huge time save... thumbs up for this one!
Title: Re: tiled exr tx textures
Post by: maru on 2020-03-17, 17:02:14
I have just reported this directly to the dev/qa team and will be sure to notify you once any specific plans regarding this feature are know.
If you have some examples showing this feature in action, or if you have any experience using it, please share.

(Internal ID=479358382)
Title: Re: tiled exr tx textures
Post by: maru on 2020-03-26, 10:41:36
We are investigating, but if anyone could provide a very simple scene featuring a tiled EXR and/or TX texture that works in some other renderer (e.g. V-Ray), but not in Corona, that would be greatly appreciated.

Update: ok so it seems .tx format cannot be loaded into a Corona Bitmap at all. It can be loaded into VrayHDRI loader and then plugged into a Corona Mtl, but I have no idea if this works fine and whether it brings any benefit.

Question: is "TX" and "Tiled EXR" the same thing? Or are these two separate formats?

Title: Re: tiled exr tx textures
Post by: burnin on 2020-03-27, 02:28:25
I believe .tx is basically a "container"... Usually, creation process is automated. But can also be made manually.
- https://github.com/OpenImageIO (look in the "images" repo)
- https://sites.google.com/site/openimageio/home
- https://rmanwiki.pixar.com/display/REN/txmake- https://docs.arnoldrenderer.com/display/A5AFMUG/Tx+Manager
- https://knowledge.autodesk.com/support/3ds-max/troubleshooting/caas/sfdcarticles/sfdcarticles/How-to-convert-bitmap-textures-to-TX-format-for-rendering-with-Arnold-in-3ds-Max.html

Title: Re: tiled exr tx textures
Post by: maru on 2020-03-30, 16:10:02
Thanks a lot!
Title: Re: tiled exr tx textures
Post by: peterguthrie on 2021-02-14, 15:44:45
BUMP!

still very interested in tx files. Can coronabitmap load them now? (as vrayhdri does)
Title: Re: tiled exr tx textures
Post by: peterguthrie on 2021-02-14, 15:48:15
or has this happened and I missed it?

Hi,
we will have automatic on-demand load of images in the future, so every image will be loaded in exactly the resolution needed - no need to do this manually
Title: Re: tiled exr tx textures
Post by: SamL on 2021-02-22, 11:16:28
I'd also like to bump this!

One of our teams in another office were using this on a large VRay project and saw some crazy reductions in RAM usage.
Title: Re: tiled exr tx textures
Post by: kino_unico on 2021-05-13, 18:06:58
is there any news on this issue, it is quite a long time old and it would be a breakthrough.
Title: Re: tiled exr tx textures
Post by: Avi on 2021-06-24, 12:40:39
Hi,

We have already logged this as a feature request and looking forward to implementing it soon.

Regards,
Avi

(Report ID=CRMAX-555)