AWS Thinkbox Discussion Forums

Autoreque frames that hangs.

Hi!

We are struggeling with when rendering with mantra in Deadline 8. This is a mantra issue and not Deadline related. The render hangs on 0% and renders forever. If we reque the frame it works on the same node and starts instantly.

So what i was hoping is that Deadline could auto reque jobs that useses more than x minutes on 0% of a frame.

Is this possible with deadline using python?

Not quite yet. There is an option to have Deadline re-queue a task if the program hasnā€™t written output for the last X seconds. You can find that API setting here:

docs.thinkboxsoftware.com/produc ā€¦ dc7fbf6c84

You can use that in ā€œ[repo]/plugins/Mantra/Mantra.pyā€ like so:

    def InitializeProcess(self):
        self.SingleFramesOnly=True
        self.StdoutHandling=True
        self.PopupHandling=True
        self.SetUpdateTimeout(45 * 60) # Wait 45 minutes for output and requeue if none is seen

Thanks for the fast reply! :slight_smile:

Will see if this helps. But i guess if the frame already exists this wont work.

It does not look at the output image, but the stdout of the application:

Yes! We noticed that now :slight_smile:

Doesnt seem to work atm but we will try some more.

Does this look right?
Mantra.rar (2.24 KB)

Yup. Looks good to me.

Hmm strange. Nodes that isnt outputting any stdout info for 10mins wont fail/reque.

Is there anything that needs to be enabled in the reposetory setting for this to work?

Not that Iā€™m aware of. Testing this over here right now.

Hmm. No luck on my side here so far. Iā€™ll ask around to see if thereā€™s some magic Iā€™m unaware of.

Ah, it looks like my problems were because I forgot it needs to be in the InitializeProcess function. I didnā€™t follow my own advice from earlier :slight_smile:

What youā€™re looking for to make sure the setting was applied correctly is this:

2017-02-21 16:18:49:  0: INFO: Update timeout has been set to 2700 seconds

I have to head out in a bit, so Iā€™ll put my interval down to five minutes and see if I can get some results here before I have to run out the door.

Well, itā€™s been ten minutes and it hasnā€™t timed out. Iā€™ll raise this with the development team and see what we can do.

Thanks for looking into this!

No luck here either so i realy hope you figure it out.
This would solve alot of problems we are currently having on our renderfarm.

Well, the good news is that itā€™s been added to the current development sprint. Iā€™m hoping weā€™ll get it done in under two weeks. Iā€™ll update here when I see that itā€™s resolved.

Thank you! :smiley:

Any news/progress on this?

The underlying API function was fixed and released yesterday in 8.0.17.0:
docs.thinkboxsoftware.com/produc ā€¦ provements

Fantastic!

Thanks so much for the fix!

This works perfectly now!

Cool. Thanks for the feedback.

Privacy | Site terms | Cookie preferences