Denoiser Freezing Random frames at the end of the process

[Curtis Walker]

Hi all,

Hoping for some pointers on an annoying issue i'm having and trying to narrow down the cause. I'm getting random freezes at the end of the denoiser process on final renders which i have to end task and restart the frame. It seems to be sporadic and doesn't happen to any particular file and happens across the board randomly whether rendering 1080 animation frames or hi res stills. It happens on both detailed interiors and exterior scenes with HDRI or Sun&Sky. I can't reproduce the issue at will, it either happens or doesn't which is causing me no end of frustration especially when leaving sequences unattended over the weekend on the "farm". The crash can happen when rendering local or using the farm. The only common thing is that its gets to the last of the denoiser passes and hangs without saving. The PC is still responsive, Its just max that sits there doing nothing. It doesn't flag as an error on the render manager either as it just says "working" because as far as its aware it chugging away on the frame. I'm at a bit of a loss and hope someone can give me a push in the right direction.

I'm running:
- Corona 7
- 3DS Max 2021.1 (I'm going to update to 2021.2 to see if that helps. I usually wait until patch one is applied to max before updating to the new one)
- TR 3990x
- 128gb RAM
- Pulze.io scene manager and render manager

Thanks for any help anyone can offer. Any further questions or info needed just ask away.

Curtis

[TomG]

You mention "last of the denoiser passes" so it sounds like Render Elements are involved - if so, might be best if you can share a scene where this happens (even if it only happens sometimes) with us, so we can take a look into things like how much memory that scene is using etc. Private uploader link is in the pages in my signature :)

[Curtis Walker]

Thanks for getting back to me so fast TomG

I cant as the archive is of any file that's doing it is just too large and unless. I will try stripping one but in doing so could lose the error.

I've created a minidump of one that happened to have produced the error as i was sitting here. however its 66GB! I'm reading in to it now to see if i can find the error sticking point.

yes i had 25 denoised elements through light mix, although I certainly don't need this many if any, so may resend the file without them to see if it makes a difference. It doesn't solve the issue entirely as there are scenes where light mix elements are needed and the fact that it doesn't always error out on them.

Just watched a frame render and denoise there successfully and max ram was 66GB.

[Curtis Walker]

Analysed the minidump. Exception pasted below if that helps....

EXCEPTION_RECORD:  (.exr -1)
ExceptionAddress: 0000000000000000
   ExceptionCode: 80000003 (Break instruction exception)
  ExceptionFlags: 00000000
NumberParameters: 0

FAULTING_THREAD:  000089dc

PROCESS_NAME:  3dsmax.exe

ERROR_CODE: (NTSTATUS) 0x80000003 - {EXCEPTION}  Breakpoint  A breakpoint has been reached.

EXCEPTION_CODE_STR:  80000003

STACK_TEXT: 
00000013`b7ef8828 00007ff8`a7ed4021     : 00000000`00000000 0000017c`740f1980 00000000`03a904a5 0000017c`740f0000 : ntdll!NtWaitForAlertByThreadId+0x14
00000013`b7ef8830 00007ff8`a573ce29     : 0000017f`0eaa7428 0000017f`0eaa7420 0000017f`0eaa7470 00000000`00000000 : ntdll!RtlSleepConditionVariableSRW+0x131
00000013`b7ef88b0 00007ff8`89792549     : 00000000`00000000 00000000`000001b0 00000000`000001a0 00000000`00000008 : KERNELBASE!SleepConditionVariableSRW+0x29
00000013`b7ef88f0 00007ff8`897927da     : 000064a4`eaadc8ba 00007ff8`a7e9b3c7 0000017d`34952640 00000000`00000000 : msvcp140!Concurrency::details::stl_condition_variable_win7::wait+0x19
00000013`b7ef8920 00007fff`e85fe9ac     : 0000017f`0eaa7420 0000017d`34952640 0000017f`0eaa7420 00007ff8`23d87377 : msvcp140!_Cnd_wait+0x3a
00000013`b7ef8950 00007fff`e4050ac6     : 00000000`00000000 00000000`00000000 00000013`b7ef8b30 0000017c`40cc0960 : LegionLib_Release!Legion::ReaderWriterLock::~ReaderWriterLock+0x6c
00000013`b7ef8980 00007fff`e404c5a9     : 00000000`00000000 0000017d`349527b0 00000000`00000027 00000000`00000000 : Corona_Release!Legion::Corona::FrameBuffer::setSizeChangedNotifier+0x1a6
00000013`b7ef8a80 00007fff`e403019e     : 00000000`00000000 00000000`00000027 00000000`00000000 00000000`00000027 : Corona_Release!Legion::Corona::FrameBuffer::~FrameBuffer+0xeb9
00000013`b7ef8c00 00007fff`e4033c60     : 00000185`5291be01 00000013`b7ef8ea0 0000b819`00000000 00000000`00000001 : Corona_Release!Legion::Corona::getSubBitmap+0x4c9e
00000013`b7ef8e00 00007fff`e7acef8a     : 0000017c`7400bf90 0000017c`73ff0000 00000000`00000000 00007ff8`a5b79363 : Corona_Release!Legion::Corona::FrameBuffer::getRegionPreview+0x30
00000013`b7ef8e50 00007fff`e7ad2a41     : ffffffff`9705356c 00000013`b7ef8f90 00000013`b7ef9048 00000013`b7ef9048 : CoronaUi_Release!Legion::Corona::VfbApertureController::getDialog+0x2a7a
00000013`b7ef8ed0 00007fff`e7ad1f13     : 00000013`b7ef8fb8 00000013`b7ef9048 00000000`00000001 00000180`d8ab0bd0 : CoronaUi_Release!Legion::Corona::VfbApertureController::getDialog+0x6531
00000013`b7ef8f30 00007fff`e7ad4bc4     : 00000000`00000001 00000000`00000000 00000000`00000000 00000000`00000438 : CoronaUi_Release!Legion::Corona::VfbApertureController::getDialog+0x5a03
00000013`b7ef8fb0 00007fff`e7ad40f3     : 00000181`9de0aaf0 00000013`b7ef92c0 00000438`00000000 00000438`00000438 : CoronaUi_Release!Legion::Corona::VfbApertureController::getDialog+0x86b4
00000013`b7ef92a0 00007fff`e5684344     : 0000017c`9ddd26d0 00000000`00000000 00000438`00000780 00000000`00000000 : CoronaUi_Release!Legion::Corona::VfbApertureController::getDialog+0x7be3
00000013`b7ef9320 00007fff`e576ff24     : 00000013`b7ef9550 0000017c`9ddd1d70 00000000`00000003 00000000`00000000 : LegionWxWidgets_3_1_3_v142_Release!wxAppConsoleBase::CallEventHandler+0x54
00000013`b7ef9360 00007fff`e5770b02     : 00000181`20da71c0 00000000`00000388 00007fff`e5f0daf0 00000000`0000ffff : LegionWxWidgets_3_1_3_v142_Release!wxEvtHandler::ProcessEventIfMatchesId+0x64
00000013`b7ef9390 00007fff`e5770e52     : 00000013`b7ef9550 00000000`ffffffff 00000181`9de0aaf0 00007ff8`a72e0000 : LegionWxWidgets_3_1_3_v142_Release!wxEvtHandler::SearchDynamicEventTable+0x82
00000013`b7ef93e0 00007fff`e576fe7e     : 00000000`00000000 00000181`9de0aaf0 00000000`fe043d96 00007ff8`a5c7fde6 : LegionWxWidgets_3_1_3_v142_Release!wxEvtHandler::TryHereOnly+0x22
00000013`b7ef9410 00007fff`e5937e00     : 00000000`00002776 00000013`b7ef95d0 00000181`1b0cffd0 0000017c`74b580b0 : LegionWxWidgets_3_1_3_v142_Release!wxEvtHandler::ProcessEvent+0xde
00000013`b7ef9450 00007fff`e5770a73     : 0000017c`76c00948 ffffffff`fffe3d96 00000181`9de0ac38 0000017c`76c00948 : LegionWxWidgets_3_1_3_v142_Release!wxScrollHelperEvtHandler::ProcessEvent+0x20
00000013`b7ef9490 00007fff`e5a92b0b     : 00000181`9de0ac38 00000181`9de0aa00 00000181`9de0aaf0 00000013`b7ef95d0 : LegionWxWidgets_3_1_3_v142_Release!wxEvtHandler::SafelyProcessEvent+0x13
00000013`b7ef94d0 00007fff`e5a96bc6     : 00000000`000c0000 00000181`9de0aa00 00000181`9de0aaf0 00000000`00000000 : LegionWxWidgets_3_1_3_v142_Release!wxWindow::HandlePaint+0xb9b
00000013`b7ef9700 00007fff`e5a9a688     : 00000013`b7c84000 00000000`00000000 00000000`00000000 0000166c`0000166c : LegionWxWidgets_3_1_3_v142_Release!wxWindow::MSWHandleMessage+0x206
00000013`b7ef9990 00007fff`e567066d     : 00000000`00000000 00000000`0000000f 00000013`b7ef9e20 00000000`00000000 : LegionWxWidgets_3_1_3_v142_Release!wxWindow::MSWWindowProc+0x38
00000013`b7ef99d0 00007fff`e5aa091c     : 00007ff8`a2eb9f10 00000000`00000000 00000000`00000001 00000000`00000000 : LegionWxWidgets_3_1_3_v142_Release!wxScrolled<wxPanel>::MSWWindowProc+0xd
00000013`b7ef9a00 00007ff8`a725e858     : 00000000`00000001 00000000`00000000 00000000`80006011 00000000`00000000 : LegionWxWidgets_3_1_3_v142_Release!wxWndProc+0xac
00000013`b7ef9a40 00007ff8`a725e3dc     : 00000000`00dc05b6 00007fff`e5aa0870 00000000`00dc05b6 00007126`0000000f : user32!UserCallWinProcCheckWow+0x2f8
00000013`b7ef9bd0 00007ff8`a7270bc3     : 00000000`00000000 00000000`00000000 00000000`00000000 00007ff8`a7e947b1 : user32!DispatchClientMessage+0x9c
00000013`b7ef9c30 00007ff8`a7f10c54     : 00000000`00000001 00000000`00000200 00000000`00000000 0000017c`740f1b00 : user32!_fnDWORD+0x33
00000013`b7ef9c90 00007ff8`a56a1464     : 00007fff`e5a9ce43 00000000`00000006 00007ff8`a7e9b3c7 0000017c`740f0000 : ntdll!KiUserCallbackDispatcherContinue
00000013`b7ef9d18 00007fff`e5a9ce43     : 00000000`00000006 00007ff8`a7e9b3c7 0000017c`740f0000 000003a5`00000000 : win32u!NtUserCallHwndLock+0x14
00000013`b7ef9d20 00007fff`e85f82a2     : 00000000`00000050 00000000`00000000 0000017c`5d70fc00 00000000`00000000 : LegionWxWidgets_3_1_3_v142_Release!wxWindow::Update+0x53
00000013`b7ef9eb0 00007fff`e7a9874d     : 00000000`ffffffff 00000013`b7efa080 0000017c`5d70fc00 00000000`00000000 : LegionLib_Release!Legion::executeInMainThread+0x52
00000013`b7ef9f10 00007fff`e40151b6     : 00000184`6239c700 000003a5`000003a5 0000017c`5d70f9cc 00000000`00000001 : CoronaUi_Release!Legion::Corona::MaterialLibraryQt::BrowserDialog::tr+0x40bd
00000013`b7ef9f80 00007fff`e4068463     : 00000013`b7efa370 00000000`00000000 00000000`00000001 0000017c`00000001 : Corona_Release!Legion::Corona::calculateLensEffectsAperture+0x68e6
00000013`b7efa200 00007fff`e4067de3     : 00000000`00000001 00000438`00000780 00000013`b7efa2e1 0000017c`5d70fc34 : Corona_Release!Legion::Corona::computeBloomAndGlare+0xa63
00000013`b7efa270 00007fff`e4068a2a     : 00000000`00000000 0000017c`5d70f9c0 00000000`00000130 00000000`00000018 : Corona_Release!Legion::Corona::computeBloomAndGlare+0x3e3
00000013`b7efa340 00007fff`e40688cd     : 00000000`00000000 0000017c`5d70fab0 0000017c`5d70f9c0 00007ff8`23d87811 : Corona_Release!Legion::Corona::getBloomGlareTotalSteps+0x48a
00000013`b7efa3b0 00007fff`e4035175     : 00000000`00000000 00000000`00000000 00000000`00000000 0000017d`00000001 : Corona_Release!Legion::Corona::getBloomGlareTotalSteps+0x32d
00000013`b7efa5a0 00007fff`e402fe83     : ffffffff`00000000 00000000`0000017f 00000013`b7efa720 00000000`ffffff01 : Corona_Release!Legion::Corona::FrameBuffer::getRegionPreviewInt+0x1505
00000013`b7efa620 00007fff`e4033aec     : 00000184`eb716a01 00000013`b7efa900 00000000`ffffffff 0000017c`740f0000 : Corona_Release!Legion::Corona::getSubBitmap+0x4983
00000013`b7efa820 00007fff`dfbb1469     : 00000000`00000001 0000017d`34952640 00000013`b7efa990 0000017d`34952640 : Corona_Release!Legion::Corona::FrameBuffer::getRegion+0x3c
00000013`b7efa890 00007fff`dfbe2d1b     : 00000000`00000000 00000181`475d90d0 00000184`eb716f30 00007ff8`897932bf : CoronaMax_Release_2021!NURBSTextureChannel::GetTextureSurface+0x769
00000013`b7efaa20 00007fff`dfc09cc6     : 7fffffff`00000001 0000017c`9e46fe90 00000000`00000000 00000438`00000780 : CoronaMax_Release_2021!CanAutoDefer+0x2b8db
00000013`b7efaaa0 00007fff`dfc1147c     : 00000000`00000000 0000017c`00000000 00000000`00000001 00000000`00000000 : CoronaMax_Release_2021!CanAutoDefer+0x52886
00000013`b7efab10 00007fff`dfc09a4d     : 0000017c`9e46fe90 00007ff6`53591a80 00000000`000003e8 00000000`000003e8 : CoronaMax_Release_2021!CanAutoDefer+0x5a03c
00000013`b7efabd0 00007ff6`52f385ed     : 00007ff6`53591a80 00000013`b7efb370 00000000`00000000 00007ff6`53591810 : CoronaMax_Release_2021!CanAutoDefer+0x5260d
00000013`b7efac30 00007ff6`52f28478     : 00000013`b7efb2f8 00007ff6`53591810 00000013`b7efb370 00000000`00000000 : 3dsmax!Frustum::operator=+0x7c99d
00000013`b7efb270 00007ff6`52f34cdc     : 68956852`66c54932 0000017c`76cd9210 00000000`00000001 00000000`00000000 : 3dsmax!Frustum::operator=+0x6c828
00000013`b7efb810 00007ff6`52e0fa6d     : 0000017c`7402d740 0000017c`7402d740 00000000`00000000 00000000`00000000 : 3dsmax!Frustum::operator=+0x7908c
00000013`b7efb8f0 00007ff7`f89843c3     : 00000000`00000000 00000013`00000001 00000000`00000000 00000000`00000000 : 3dsmax!MaxSDK::PointCloud::UBytePoint4::operator=+0x68cfd
00000013`b7efb970 00007ff7`f8983d93     : 0000017c`01e03ad8 00000000`00000000 00000000`00000000 00000000`00000000 : 0x00007ff7`f89843c3
00000013`b7efba20 00007ff7`f896e4f0     : 0000017c`03fca1d0 00000000`00000001 0000017c`001e6fa4 00000013`b7efb630 : 0x00007ff7`f8983d93
00000013`b7efbc80 00007ff7`f894c9aa     : 0000017c`02c9e650 0000017c`03fca1d0 0000017c`001e6918 0000017c`001e6918 : 0x00007ff7`f896e4f0
00000013`b7efbd20 00007ff8`5475a93d     : 0000017c`02c11530 0000017c`00002db8 00000013`b7efbe30 00000000`00000000 : 0x00007ff7`f894c9aa
00000013`b7efbe00 00007ff7`f894c689     : 0000017c`031f57e8 0000017c`031f5818 00000013`b7efbff0 00000000`00000000 : mscorlib_ni!System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[System.__Canon](System.__Canon ByRef)$##6005CF9+0x7d
00000013`b7efbeb0 00007ff7`f894c47d     : 0000017c`031f57a8 0000017c`00002db8 00000013`b7efbff0 00000000`00000000 : 0x00007ff7`f894c689
00000013`b7efbf30 00007ff8`54759c6d     : 0000017c`02c114f0 0000017c`00002db8 00000013`b7efbff0 00000000`00000000 : 0x00007ff7`f894c47d
00000013`b7efbfc0 00007ff7`f894c3ae     : 0000017c`031f57a8 0000017c`031f57e8 00000013`b7efbe34 00000000`00000000 : mscorlib_ni!System.Runtime.CompilerServices.AsyncVoidMethodBuilder.Start[System.__Canon](System.__Canon ByRef)$##6005CEF+0x7d
00000013`b7efc070 00007ff7`f894b979     : da83109b`f56f0000 00000013`b7efe480 00000013`b7efbe34 00000000`00000000 : 0x00007ff7`f894c3ae
00000013`b7efc0f0 00007ff7`f75049b0     : 00000000`00000000 0000017c`01f30de8 0000017c`031f3110 0000017c`76c98d58 : 0x00007ff7`f894b979
00000013`b7efc150 00007ff8`54e6224e     : 00007fff`d3001c90 00000013`b7efc2b8 ffffffff`fffffffe 00007ff8`7e7df84b : 0x00007ff7`f75049b0
00000013`b7efc1e0 00007ff8`225387d9     : 00000000`00000015 00000000`00000000 00000000`00000001 00000000`00000000 : clr!UMThunkStub+0x6e
00000013`b7efc270 00007ff6`531c3953     : 00000000`00000001 00000000`00000001 00000000`00000001 00000000`00000001 : core!NotifyManager::BroadcastNotificationToProc+0x1f9
00000013`b7efc320 00007ff6`52e0ddd8     : 0000017c`970637a0 00007ff6`535849d0 00007ff6`535849d0 00000000`0000000f : 3dsmax!UtilGfx::InitRectIPoint3+0x1435f3
00000013`b7efc7d0 00007ff6`52cc0671     : 0000017c`8b29d650 00000000`00000001 00000000`00000001 00007ff6`535849d0 : 3dsmax!MaxSDK::PointCloud::UBytePoint4::operator=+0x67068
00000013`b7efc850 00007ff6`52c893d6     : 00000000`00000000 00000000`0000169a 00000013`b7efdf60 00000000`00000000 : 3dsmax!Osnap::NumCandidates+0xd61
00000013`b7efc920 00007ff6`52f0b998     : 00000000`00000001 00007ff8`2035d909 0000017c`7409f0e0 00000000`00000629 : 3dsmax!VertexNormalsControl::VertexNormalsControl+0xb4e6
00000013`b7efde50 00007ff6`52f0be74     : 00000000`00000000 00007ff8`204f25c0 00000000`00000000 00000000`00000001 : 3dsmax!Frustum::operator=+0x4fd48
00000013`b7efde90 00007ff8`256b304d     : 0000017c`74089140 00000000`02841b2c 00000013`b7efe000 00000000`00000000 : 3dsmax!Frustum::operator=+0x50224
00000013`b7efdf00 00007ff8`256b4602     : 00007ff8`a7f0ccd0 00000000`02841b2c 00000000`0000169a 00000000`00000000 : qwindows+0x1304d
00000013`b7efe060 00007ff8`a725e858     : 00000013`b7efe2e8 00000000`00000000 00000000`00000001 00000000`00000000 : qwindows+0x14602

STACK_COMMAND:  ~0s; .ecxr ; kb

FAULTING_SOURCE_LINE:  D:\a01\_work\9\s\src\vctools\crt\github\stl\src\primitives.hpp

FAULTING_SOURCE_FILE:  D:\a01\_work\9\s\src\vctools\crt\github\stl\src\primitives.hpp

FAULTING_SOURCE_LINE_NUMBER:  161

FAULTING_SOURCE_CODE: 
No source found for 'D:\a01\_work\9\s\src\vctools\crt\github\stl\src\primitives.hpp'


SYMBOL_NAME:  msvcp140!Concurrency::details::stl_condition_variable_win7::wait+19

MODULE_NAME: msvcp140

IMAGE_NAME:  msvcp140.dll

FAILURE_BUCKET_ID:  BREAKPOINT_80000003_msvcp140.dll!Concurrency::details::stl_condition_variable_win7::wait

OS_VERSION:  10.0.19041.1

BUILDLAB_STR:  vb_release

OSPLATFORM_TYPE:  x64

OSNAME:  Windows 10

IMAGE_VERSION:  14.28.29910.0

FAILURE_ID_HASH:  {4d46cb53-6a4b-827b-85e1-1bbce49de586}

Followup:     MachineOwner

[rowmanns]

Hi,

Which denoiser are you using here? Would you be able to provide the scene in question and we will try to investigate.

Thanks,

Rowan

[Curtis Walker]

I'm using the Corona high quality denoiser. I would be happy to send one of them over but they are just too large to send as they wont fit the 256mb limit for the uploader.

I cant seem to get it to happen locally, which is strange as i thought it was happening locally too. Its leading me to think there is something happening with Pulze render manager. I've been invited to try the Beta to see if that helps at all. Will investigate with that and report back my findings.

Thanks

[TomG]

There's the dropbox uploader, with something like a 10GB limit :) The how to report issues page (in signatures) has info on both uploaders.

[Curtis Walker]

I must have missed that in my scan through. Apologies, always trying to do a million things at once. I'll upload it it tomorrow. Thanks TomG for pointing out my blunder. :D

[TomG]

Most welcome, and no worries! We know how that can go :)