Chaos Corona Forum

Chaos Corona for 3ds Max => [Max] General Discussion => Topic started by: j_man on 2015-12-18, 11:09:08

Title: Deadline task time outs.
Post by: j_man on 2015-12-18, 11:09:08

Hello all,

We're rendering over Deadline and Corona tasks sometimes timeout. By default deadline kills tasks that don't talk for over 8000 seconds (133 minutes) however Corona seems to render a pass every six or seven minutes and the task runs for four hours quite happily before being stopped. Simple fix is to increase the task time-out but what is causing this and what is the correct way to fix it?

Thanks,

J.

Title: Re: Deadline task time outs.
Post by: maru on 2015-12-18, 11:22:26

Maybe there is something interesting in the logs? Could you:


    On any of the faulty nodes: go to DrData folder (it can be found in the directory where DrServer is installed on the node)
    Remove the whole content of DrData
    Run the unsuccessful rendering again
    Go to DrData folder again on that node
    Gather the whole content of DrData (you can just pack the DrData folder)
    Send it over

Title: Re: Deadline task time outs.
Post by: j_man on 2015-12-18, 12:24:31

We're not using DR this time though?

J.

Title: Re: Deadline task time outs.
Post by: racoonart on 2015-12-18, 12:49:10

Which version of Deadline are you using?
Corona is officially supported by Deadline now so it should properly update it's status and thus prevent a task timeout to happen. Normally, the render engine communicates with deadline and sends messages to the repository about it's current progress - if this doesn't happen, like with FumeFx simulations (where you have to write a script yourself to do the updating) , Deadline will hit the time out at some point and re-queue the task.
I haven't tested it myself recently and I don't know if it's implemented this way but it should be. You may also have a look at the Thinkbox deadline forum.

Title: Re: Deadline task time outs.
Post by: maru on 2015-12-18, 12:51:17

Oh, sorry, I thought it is Corona's DR managed by Deadline. Sorry, I am not familiar with the software.

Title: Re: Deadline task time outs.
Post by: j_man on 2015-12-18, 14:06:45

Version 7.0.2.3 R. We will upgrade at some point and try again. Mike from Thinkbox has suggested disabling this for now.

Many thanks for your replies.

J.

Title: Re: Deadline task time outs.
Post by: Ondra on 2015-12-18, 15:38:14

I'd like to quote maru's signature: which corona version are you using?

Title: Re: Deadline task time outs.
Post by: j_man on 2015-12-18, 16:44:55

Hi Ondra,

We're using 1.3, the one with the smiley face < ;



J.

Title: Re: Deadline task time outs.
Post by: Ondra on 2016-01-11, 11:29:38

I had a talk with guys from deadline, and it seems the problem was in too frequent logging in corona. I fixed it, and I would be glad if you would test it in the next daily build

Title: Re: Deadline task time outs.
Post by: j_man on 2016-01-13, 12:05:10

Hi Ondra,

Thanks for looking into it. I have upgraded Deadline to 7.2, which Mike from Thinkbox tells me has a lot of improvements for Corona. I have also disabled the Progress Update Timeout in Deadline and this has fixed the issue.
If I can spare a bit of time I will test the daily build for you.


Many thanks,


Josh.