I’m sorry but this is getting on my nerves, and it’s something to do with Deadline.
We have a scene where via GUI the IFDs for Mantra take around 8secs per frame to be created.
Via Deadline, 1 frame takes 100% of the CPU until it reaches a 5 minute limit and then gives a random error. NO Ifds can be created.
What is going on? We already tried updating to the newest 14.4 Deadline version, same thing happens. We’re using Houdini 18.5.499.
Tried submitting both via the ROP or the Render menu.
Please advise.
Error:
2021-03-10 18:02:03: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-03-10 18:02:03: Exception Details
2021-03-10 18:02:03: RenderPluginException – Error: Renderer returned non-zero error code, 139. Check the log for more information.
2021-03-10 18:02:03: at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
2021-03-10 18:02:03: RenderPluginException.Cause: JobError (2)
2021-03-10 18:02:03: RenderPluginException.Level: Major (1)
2021-03-10 18:02:03: RenderPluginException.HasSlaveLog: True
2021-03-10 18:02:03: RenderPluginException.SlaveLogFileName: C:\ProgramData\Thinkbox\Deadline10\logs\deadlineslave_renderthread_3-GLWork03-0000.log
2021-03-10 18:02:03: Exception.TargetSite: Deadline.Slaves.Messaging.PluginResponseMemento d(Deadline.Net.DeadlineMessage, System.Threading.CancellationToken)
2021-03-10 18:02:03: Exception.Data: ( )
2021-03-10 18:02:03: Exception.Source: deadline
2021-03-10 18:02:03: Exception.HResult: -2146233088
2021-03-10 18:02:03: Exception.StackTrace:
2021-03-10 18:02:03: at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bcy, CancellationToken bcz)
2021-03-10 18:02:03: at Deadline.Plugins.SandboxedPlugin.RenderTask(Task task, CancellationToken cancellationToken)
2021-03-10 18:02:03: at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ajg, CancellationToken ajh)
2021-03-10 18:02:03: <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021-03-10 18:02:03: All job files are already synchronized
2021-03-10 18:02:03: Plugin Houdini was already synchronized.
2021-03-10 18:02:03: 4: nogui was not added to the CommandLineParser.
2021-03-10 18:02:03: 4: Secrets Management feature is enabled.
2021-03-10 18:02:04: 4: Executing plugin command of type ‘Initialize Plugin’
2021-03-10 18:02:04: 4: INFO: Executing plugin script ‘C:\ProgramData\Thinkbox\Deadline10\workers\GLWork03\plugins\604908a9d8ce65f06480d12c\Houdini.py’
2021-03-10 18:02:04: 4: INFO: About: Houdini Plugin for Deadline
2021-03-10 18:02:04: 4: INFO: The job’s environment will be merged with the current environment before rendering
2021-03-10 18:02:04: 4: Done executing plugin command of type ‘Initialize Plugin’
2021-03-10 18:02:04: 4: Start Job timeout is disabled.
2021-03-10 18:02:04: 4: Task timeout is disabled.
2021-03-10 18:02:04: 4: Loaded job: urs_shGen001_fx_v006_ocean - /out/mantra_sprayb (604908a9d8ce65f06480d12c)
2021-03-10 18:02:04: 4: Executing plugin command of type ‘Start Job’
2021-03-10 18:02:04: 4: DEBUG: S3BackedCache Client is not installed.
2021-03-10 18:02:04: 4: INFO: Executing global asset transfer preload script ‘C:\ProgramData\Thinkbox\Deadline10\workers\GLWork03\plugins\604908a9d8ce65f06480d12c\GlobalAssetTransferPreLoad.py’
2021-03-10 18:02:04: 4: INFO: Looking for legacy (pre-10.0.26) AWS Portal File Transfer…
2021-03-10 18:02:04: 4: INFO: Looking for legacy (pre-10.0.26) File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py…
2021-03-10 18:02:04: 4: INFO: Could not find legacy (pre-10.0.26) AWS Portal File Transfer.
2021-03-10 18:02:04: 4: INFO: Legacy (pre-10.0.26) AWS Portal File Transfer is not installed on the system.
2021-03-10 18:02:04: 4: Done executing plugin command of type ‘Start Job’
2021-03-10 18:02:04: 4: Plugin rendering frame(s): 105
2021-03-10 18:02:04: Scheduler Thread - Render Thread 2 threw a major error:
2021-03-10 18:02:04: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-03-10 18:02:04: Exception Details
2021-03-10 18:02:04: RenderPluginException – Error: Renderer returned non-zero error code, 139. Check the log for more information.
Deadline log with the error:
2021-03-10 18:33:37: 0: INFO: QT Popup Handling Enabled: False
2021-03-10 18:33:37: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2021-03-10 18:33:37: 0: INFO: Using Process Tree: True
2021-03-10 18:33:37: 0: INFO: Hiding DOS Window: True
2021-03-10 18:33:37: 0: INFO: Creating New Console: False
2021-03-10 18:33:37: 0: INFO: Running as user: GLPedro
2021-03-10 18:33:37: 0: INFO: Enforcing 64 bit build
2021-03-10 18:33:37: 0: INFO: Executable: “C:\Program Files\Side Effects Software\Houdini 18.5.499\bin\Hython.exe”
2021-03-10 18:33:37: 0: INFO: Argument: “C:\ProgramData\Thinkbox\Deadline10\workers\GLPedro\plugins\604910ce33362a1e0ca7122d\hrender_dl.py” -f 102 102 1 -o “$GLRENDER/ocean/sprayb/v002/shGen001_ocean_sprayb_v002.$F4.exr” -d /out/mantra_sprayb -tempdir “C:\ProgramData\Thinkbox\Deadline10\workers\GLPedro\jobsData\604910ce33362a1e0ca7122d\0_tempSj6nW0” -arnoldAbortOnLicenseFail 1 “S:/2021/uvcreations_radhe_shyam_urs/30_shots/shGen001/03_scenes/urs_shGen001_fx_v006_ocean.hip”
2021-03-10 18:33:37: 0: INFO: Full Command: “C:\Program Files\Side Effects Software\Houdini 18.5.499\bin\Hython.exe” “C:\ProgramData\Thinkbox\Deadline10\workers\GLPedro\plugins\604910ce33362a1e0ca7122d\hrender_dl.py” -f 102 102 1 -o “$GLRENDER/ocean/sprayb/v002/shGen001_ocean_sprayb_v002.$F4.exr” -d /out/mantra_sprayb -tempdir “C:\ProgramData\Thinkbox\Deadline10\workers\GLPedro\jobsData\604910ce33362a1e0ca7122d\0_tempSj6nW0” -arnoldAbortOnLicenseFail 1 “S:/2021/uvcreations_radhe_shyam_urs/30_shots/shGen001/03_scenes/urs_shGen001_fx_v006_ocean.hip”
2021-03-10 18:33:37: 0: INFO: Startup Directory: “C:\Program Files\Side Effects Software\Houdini 18.5.499\bin”
2021-03-10 18:33:37: 0: INFO: Process Priority: BelowNormal
2021-03-10 18:33:37: 0: INFO: Process Affinity: default
2021-03-10 18:33:37: 0: INFO: Process is now running
2021-03-10 18:33:42: 0: STDOUT: Detected Houdini version: (18, 5, 499)
2021-03-10 18:33:42: 0: STDOUT: [‘C:\ProgramData\Thinkbox\Deadline10\workers\GLPedro\plugins\604910ce33362a1e0ca7122d\hrender_dl.py’, ‘-f’, ‘102’, ‘102’, ‘1’, ‘-o’, ‘$GLRENDER/ocean/sprayb/v002/shGen001_ocean_sprayb_v002.$F4.exr’, ‘-d’, ‘/out/mantra_sprayb’, ‘-tempdir’, ‘C:\ProgramData\Thinkbox\Deadline10\workers\GLPedro\jobsData\604910ce33362a1e0ca7122d\0_tempSj6nW0’, ‘-arnoldAbortOnLicenseFail’, ‘1’, ‘S:/2021/uvcreations_radhe_shyam_urs/30_shots/shGen001/03_scenes/urs_shGen001_fx_v006_ocean.hip’]
2021-03-10 18:33:42: 0: STDOUT: Start: 102
2021-03-10 18:33:42: 0: STDOUT: End: 102
2021-03-10 18:33:42: 0: STDOUT: Increment: 1
2021-03-10 18:33:42: 0: STDOUT: Ignore Inputs: False
2021-03-10 18:33:42: 0: STDOUT: Output: $GLRENDER/ocean/sprayb/v002/shGen001_ocean_sprayb_v002.$F4.exr
2021-03-10 18:33:42: 0: STDOUT: Driver: /out/mantra_sprayb
2021-03-10 18:33:42: 0: STDOUT: Input File: S:/2021/uvcreations_radhe_shyam_urs/30_shots/shGen001/03_scenes/urs_shGen001_fx_v006_ocean.hip
2021-03-10 18:33:51: 0: Done executing plugin command of type ‘Render Task’
2021-03-10 18:33:51: 0: Executing plugin command of type ‘End Job’
2021-03-10 18:33:51: 0: Done executing plugin command of type ‘End Job’
2021-03-10 18:33:55: Scheduler Thread - Render Thread 0 threw a major error:
2021-03-10 18:33:55: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-03-10 18:33:55: Exception Details
2021-03-10 18:33:55: RenderPluginException – FailRenderException : Error: Caught exception: The attempted operation failed.
2021-03-10 18:33:55: at Deadline.Plugins.DeadlinePlugin.FailRender(String message) (Python.Runtime.PythonException)
2021-03-10 18:33:55: File “C:\ProgramData\Thinkbox\Deadline10\workers\GLPedro\plugins\604910ce33362a1e0ca7122d\Houdini.py”, line 424, in HandleStdoutError
2021-03-10 18:33:55: self.FailRender(self.GetRegexMatch(1))
2021-03-10 18:33:55: at Python.Runtime.Dispatcher.Dispatch(ArrayList args)
2021-03-10 18:33:55: at __FranticX_Processes_ManagedProcess_StdoutHandlerDelegateDispatcher.Invoke()
2021-03-10 18:33:55: at FranticX.Processes.ManagedProcess.RegexHandlerCallback.CallFunction()
2021-03-10 18:33:55: at FranticX.Processes.ManagedProcess.e(String di, Boolean dj)
2021-03-10 18:33:55: at FranticX.Processes.ManagedProcess.Execute(Boolean waitForExit)
2021-03-10 18:33:55: at Deadline.Plugins.DeadlinePlugin.DoRenderTasks()
2021-03-10 18:33:55: at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
2021-03-10 18:33:55: at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
2021-03-10 18:33:55: RenderPluginException.Cause: JobError (2)
2021-03-10 18:33:55: RenderPluginException.Level: Major (1)
2021-03-10 18:33:55: RenderPluginException.HasSlaveLog: True
2021-03-10 18:33:55: RenderPluginException.SlaveLogFileName: C:\ProgramData\Thinkbox\Deadline10\logs\deadlineslave_renderthread_0-GLPedro-0000.log
2021-03-10 18:33:55: Exception.TargetSite: Deadline.Slaves.Messaging.PluginResponseMemento d(Deadline.Net.DeadlineMessage, System.Threading.CancellationToken)
2021-03-10 18:33:55: Exception.Data: ( )
2021-03-10 18:33:55: Exception.Source: deadline
2021-03-10 18:33:55: Exception.HResult: -2146233088
2021-03-10 18:33:55: Exception.StackTrace:
2021-03-10 18:33:55: at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bcy, CancellationToken bcz)
2021-03-10 18:33:55: at Deadline.Plugins.SandboxedPlugin.RenderTask(Task task, CancellationToken cancellationToken)
2021-03-10 18:33:55: at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ajg, CancellationToken ajh)
2021-03-10 18:33:55: <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<