Nuke job fails on some random frame ranges repeatedly. Unsure how to fix

Deadline
1

2018-11-16 14:08:12: 0: WARNING: Monitored managed process Nuke is no longer running
2018-11-16 14:08:12: 0: Done executing plugin command of type ‘Render Task’
2018-11-16 14:08:12: 0: Executing plugin command of type ‘End Job’
2018-11-16 14:08:12: 0: INFO: Ending Nuke Job
2018-11-16 14:08:12: 0: Done executing plugin command of type ‘End Job’
2018-11-16 14:08:14: Scheduler Thread - Render Thread 0 threw a major error:
2018-11-16 14:08:14: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2018-11-16 14:08:14: Exception Details
2018-11-16 14:08:14: RenderPluginException – Error: Monitored managed process “Nuke” has exited or been terminated.
2018-11-16 14:08:14: at Deadline.Plugins.PluginWrapper.RenderTasks (System.String taskId, System.Int32 startFrame, System.Int32 endFrame, System.String& outMessage, FranticX.Processes.ManagedProcess+AbortLevel& abortLevel) [0x002c8] in <4d5805fcbe23433d88636fd217affccf>:0
2018-11-16 14:08:14: RenderPluginException.Cause: JobError (2)
2018-11-16 14:08:14: RenderPluginException.Level: Major (1)
2018-11-16 14:08:14: RenderPluginException.HasSlaveLog: True
2018-11-16 14:08:14: RenderPluginException.SlaveLogFileName: /var/log/Thinkbox/Deadline10/deadlineslave_renderthread_0-tatoo30-0000.log
2018-11-16 14:08:14: Exception.Data: ( )
2018-11-16 14:08:14: Exception.TargetSite: Deadline.Slaves.Messaging.PluginResponseMemento d(Deadline.Net.DeadlineMessage)
2018-11-16 14:08:14: Exception.Source: deadline
2018-11-16 14:08:14: Exception.HResult: -2146233088
2018-11-16 14:08:14: Exception.StackTrace:
2018-11-16 14:08:14: at Deadline.Plugins.SandboxedPlugin.d (Deadline.Net.DeadlineMessage anm) [0x00242] in <4d5805fcbe23433d88636fd217affccf>:0
2018-11-16 14:08:14: at Deadline.Plugins.SandboxedPlugin.RenderTask (System.String taskId, System.Int32 startFrame, System.Int32 endFrame) [0x000df] in <4d5805fcbe23433d88636fd217affccf>:0
2018-11-16 14:08:14: at Deadline.Slaves.SlaveRenderThread.c (Deadline.IO.TaskLogWriter aeg) [0x00718] in <4d5805fcbe23433d88636fd217affccf>:0
2018-11-16 14:08:14: <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

2

Hi Harvey,

can you include some lines above (* obfuscate the log, if there are paths you dont want us to see) :

2018-11-16 14:08:12: 0: WARNING: Monitored managed process Nuke is no longer running

Suspect there is probably a error in nuke, when its loading the comp file.

3

=======================================================
Error

Error: Monitored managed process “Nuke” has exited or been terminated.
at Deadline.Plugins.PluginWrapper.RenderTasks (System.String taskId, System.Int32 startFrame, System.Int32 endFrame, System.String& outMessage, FranticX.Processes.ManagedProcess+AbortLevel& abortLevel) [0x002c8] in <4d5805fcbe23433d88636fd217affccf>:0

=======================================================
Type

RenderPluginException

=======================================================
Stack Trace

at Deadline.Plugins.SandboxedPlugin.d (Deadline.Net.DeadlineMessage anm) [0x00242] in <4d5805fcbe23433d88636fd217affccf>:0
at Deadline.Plugins.SandboxedPlugin.RenderTask (System.String taskId, System.Int32 startFrame, System.Int32 endFrame) [0x000df] in <4d5805fcbe23433d88636fd217affccf>:0
at Deadline.Slaves.SlaveRenderThread.c (Deadline.IO.TaskLogWriter aeg) [0x00718] in <4d5805fcbe23433d88636fd217affccf>:0

=======================================================
Log

2018-11-16 14:19:27: 0: Loading Job’s Plugin timeout is Disabled
2018-11-16 …
.
.
.
.

2018-11-16 14:19:33: 0: STDOUT: [14:19:32 GMT] Read nuke script: /###.nk
2018-11-16 14:19:37: 0: STDOUT: Writing /###.1105.dpx
2018-11-16 14:20:43: 0: STDOUT: RotoPaint_aLARMS .9
2018-11-16 14:20:43: 0: STDOUT: RotoPaint9
2018-11-16 14:20:47: 0: STDOUT: RotoPaint10 .6
2018-11-16 14:20:50: 0: STDOUT: RotoPaint7 .9
2018-11-16 14:21:33: 0: STDOUT: RotoPaint_aLARMS .9
2018-11-16 14:21:36: 0: STDOUT: RotoPaint6 .1.2.3
2018-11-16 14:21:40: 0: STDOUT: RotoPaint15 .9.2.4.8
2018-11-16 14:21:40: 0: STDOUT: Writing /###.1105.dpx took 125.46 seconds
2018-11-16 14:21:40: 0: STDOUT: Total render time: 2 minutes, 5 seconds
2018-11-16 14:21:40: 0: STDOUT: .9Frame 1105 (1 of 6)
2018-11-16 14:21:44: 0: STDOUT: Writing /###.1106.dpx
2018-11-16 14:21:51: 0: STDOUT: RotoPaint_aLARMS .3.9
2018-11-16 14:21:51: 0: STDOUT: RotoPaint9
2018-11-16 14:21:53: 0: STDOUT: RotoPaint10 .6
2018-11-16 14:22:25: 0: STDOUT: RotoPaint7 .9
2018-11-16 14:22:27: 0: STDOUT: RotoPaint6 .2.4
2018-11-16 14:22:30: 0: STDOUT: RotoPaint15 .9.3.8
2018-11-16 14:22:30: 0: STDOUT: Writing /###.1106.dpx took 48.82 seconds
2018-11-16 14:22:30: 0: STDOUT: Total render time: 49 seconds
2018-11-16 14:22:30: 0: STDOUT: .9Frame 1106 (2 of 6)
2018-11-16 14:22:34: 0: STDOUT: Writing /###.1107.dpx
2018-11-16 14:22:41: 0: STDOUT: RotoPaint_aLARMS .9
2018-11-16 14:22:41: 0: STDOUT: RotoPaint9
2018-11-16 14:22:43: 0: STDOUT: RotoPaint10 .6
2018-11-16 14:23:04: 0: STDOUT: RotoPaint7 .9
2018-11-16 14:23:07: 0: STDOUT: RotoPaint6 .2.3
2018-11-16 14:23:09: 0: STDOUT: RotoPaint15 .3.9.2.8
2018-11-16 14:23:09: 0: STDOUT: Writing /###.dpx took 37.93 seconds
2018-11-16 14:23:09: 0: STDOUT: Total render time: 38 seconds
2018-11-16 14:23:09: 0: STDOUT: .9Frame 1107 (3 of 6)
2018-11-16 14:23:09: 0: STDOUT: READY FOR INPUT
2018-11-16 14:23:09: 0: INFO: Rendering write node Write6
2018-11-16 14:23:15: 0: WARNING: Monitored managed process Nuke is no longer running
2018-11-16 14:23:15: 0: Done executing plugin command of type ‘Render Task’

4

Looks like a standard app crash. I’d test it on the machine that it’s failing on following this guide.

If it works from the command line, usually that’s an environment variable problem.

Also, Nuke’s usually pretty stable so my bet’s on a plugin or the machine running out of memory. Deadline’ll show memory usage in the job report so that’s an easy check.

1 Like