AWS Thinkbox Discussion Forums

Houdini Deadline solaris render errors on machines

Deadline
#1

Hi!

Deadline tasks are failing in all most all the machines with this specific shot. Please check the log below.

=======================================================

Error

=======================================================

FailRenderException : Error: Caught exception: The attempted operation failed.

at Deadline.Plugins.DeadlinePlugin.FailRender(String message) (Python.Runtime.PythonException)

File “C:\ProgramData\Thinkbox\Deadline10\workers\avril7956\plugins\662d1a00cf10d1b8372987ef\Houdini.py”, line 410, in HandleStdoutError

self.FailRender(self.GetRegexMatch(1))

at Python.Runtime.Dispatcher.Dispatch(ArrayList args)

at __FranticX_Processes_ManagedProcess_StdoutHandlerDelegateDispatcher.Invoke()

at FranticX.Processes.ManagedProcess.RegexHandlerCallback.CallFunction()

at FranticX.Processes.ManagedProcess.e(String dl, Boolean dm)

at FranticX.Processes.ManagedProcess.Execute(Boolean waitForExit)

at Deadline.Plugins.DeadlinePlugin.DoRenderTasks()

at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)

at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)

=======================================================

Type

=======================================================

RenderPluginException

=======================================================

Stack Trace

=======================================================

at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bgq, CancellationToken bgr)

at Deadline.Plugins.SandboxedPlugin.RenderTask(Task task, CancellationToken cancellationToken)

at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ajv, CancellationToken ajw)

=======================================================

Log

=======================================================

2024-04-27 21:00:36: 0: Loading Job’s Plugin timeout is Disabled

2024-04-27 21:00:36: 0: SandboxedPlugin: Render Job As User disabled, running as current user ‘render’

2024-04-27 21:00:38: 0: Executing plugin command of type ‘Initialize Plugin’

2024-04-27 21:00:38: 0: INFO: Executing plugin script ‘C:\ProgramData\Thinkbox\Deadline10\workers\avril7956\plugins\662d1a00cf10d1b8372987ef\Houdini.py’

2024-04-27 21:00:38: 0: INFO: Plugin execution sandbox using Python version 3

2024-04-27 21:00:38: 0: INFO: About: Houdini Plugin for Deadline

2024-04-27 21:00:38: 0: INFO: The job’s environment will be merged with the current environment before rendering

2024-04-27 21:00:38: 0: Done executing plugin command of type ‘Initialize Plugin’

2024-04-27 21:00:38: 0: Start Job timeout is disabled.

2024-04-27 21:00:38: 0: Task timeout is disabled.

2024-04-27 21:00:38: 0: Loaded job: COD_sh_0110A_lighting_v010_P_REN - /stage/Rnd_Dust1 (662d1a00cf10d1b8372987ef)

2024-04-27 21:00:38: 0: Skipping J: because it is already mapped

2024-04-27 21:00:38: 0: Skipping K: because it is already mapped

2024-04-27 21:00:38: 0: Executing plugin command of type ‘Start Job’

2024-04-27 21:00:38: 0: DEBUG: S3BackedCache Client is not installed.

2024-04-27 21:00:38: 0: INFO: Executing global asset transfer preload script ‘C:\ProgramData\Thinkbox\Deadline10\workers\avril7956\plugins\662d1a00cf10d1b8372987ef\GlobalAssetTransferPreLoad.py’

2024-04-27 21:00:38: 0: INFO: Looking for legacy (pre-10.0.26) AWS Portal File Transfer…

2024-04-27 21:00:38: 0: INFO: Looking for legacy (pre-10.0.26) File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py…

2024-04-27 21:00:38: 0: INFO: Could not find legacy (pre-10.0.26) AWS Portal File Transfer.

2024-04-27 21:00:38: 0: INFO: Legacy (pre-10.0.26) AWS Portal File Transfer is not installed on the system.

2024-04-27 21:00:38: 0: INFO: Executing global job preload script ‘C:\ProgramData\Thinkbox\Deadline10\workers\avril7956\plugins\662d1a00cf10d1b8372987ef\GlobalJobPreLoad.py’

2024-04-27 21:00:38: 0: PYTHON: *** GlobalJobPreload start …

2024-04-27 21:00:38: 0: PYTHON: >>> Getting job …

2024-04-27 21:00:38: 0: Done executing plugin command of type ‘Start Job’

2024-04-27 21:00:38: 0: Plugin rendering frame(s): 1001

2024-04-27 21:00:38: 0: Executing plugin command of type ‘Render Task’

2024-04-27 21:00:38: 0: INFO: Starting Houdini Job

2024-04-27 21:00:38: 0: INFO: Stdout Redirection Enabled: True

2024-04-27 21:00:38: 0: INFO: Stdout Handling Enabled: True

2024-04-27 21:00:38: 0: INFO: Popup Handling Enabled: True

2024-04-27 21:00:38: 0: INFO: QT Popup Handling Enabled: False

2024-04-27 21:00:38: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False

2024-04-27 21:00:38: 0: INFO: Using Process Tree: True

2024-04-27 21:00:38: 0: INFO: Hiding DOS Window: True

2024-04-27 21:00:38: 0: INFO: Creating New Console: False

2024-04-27 21:00:38: 0: INFO: Running as user: render

2024-04-27 21:00:38: 0: INFO: Executable: “C:\Program Files\Side Effects Software\Houdini 20.0.547\bin\hython.exe”

2024-04-27 21:00:38: 0: INFO: Argument: “C:\ProgramData\Thinkbox\Deadline10\workers\avril7956\plugins\662d1a00cf10d1b8372987ef\hrender_dl.py” -f 1001 1001 1 -g -d /stage/Rnd_Dust1 -tempdir “C:\ProgramData\Thinkbox\Deadline10\workers\avril7956\jobsData\662d1a00cf10d1b8372987ef\0_tempXzE8d0” -arnoldAbortOnLicenseFail 1 “//avril/jobs/ads/Chota_Bheem/sq26A/sh_0110A/work/lighting/COD_sh_0110A_lighting_v010_P_REN.hip”

2024-04-27 21:00:38: 0: INFO: Full Command: “C:\Program Files\Side Effects Software\Houdini 20.0.547\bin\hython.exe” “C:\ProgramData\Thinkbox\Deadline10\workers\avril7956\plugins\662d1a00cf10d1b8372987ef\hrender_dl.py” -f 1001 1001 1 -g -d /stage/Rnd_Dust1 -tempdir “C:\ProgramData\Thinkbox\Deadline10\workers\avril7956\jobsData\662d1a00cf10d1b8372987ef\0_tempXzE8d0” -arnoldAbortOnLicenseFail 1 “//avril/jobs/ads/Chota_Bheem/sq26A/sh_0110A/work/lighting/COD_sh_0110A_lighting_v010_P_REN.hip”

2024-04-27 21:00:38: 0: INFO: Startup Directory: “C:\Program Files\Side Effects Software\Houdini 20.0.547\bin”

2024-04-27 21:00:38: 0: INFO: Process Priority: BelowNormal

2024-04-27 21:00:38: 0: INFO: Process Affinity: default

2024-04-27 21:00:38: 0: INFO: Process is now running

2024-04-27 21:00:39: 0: STDOUT: //avril/softwares/Houdini_plugins/ENV/tools/axis/scripts/python/pythonrc.py:3: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module’s documentation for alternative uses

2024-04-27 21:00:39: 0: STDOUT: from imp import reload

2024-04-27 21:01:16: 0: STDOUT: Detected Houdini version: (20, 0, 547)

2024-04-27 21:01:16: 0: STDOUT: [‘C:\ProgramData\Thinkbox\Deadline10\workers\avril7956\plugins\662d1a00cf10d1b8372987ef\hrender_dl.py’, ‘-f’, ‘1001’, ‘1001’, ‘1’, ‘-g’, ‘-d’, ‘/stage/Rnd_Dust1’, ‘-tempdir’, ‘C:\ProgramData\Thinkbox\Deadline10\workers\avril7956\jobsData\662d1a00cf10d1b8372987ef\0_tempXzE8d0’, ‘-arnoldAbortOnLicenseFail’, ‘1’, ‘//avril/jobs/ads/Chota_Bheem/sq26A/sh_0110A/work/lighting/COD_sh_0110A_lighting_v010_P_REN.hip’]

2024-04-27 21:01:16: 0: STDOUT: Start: 1001

2024-04-27 21:01:16: 0: STDOUT: End: 1001

2024-04-27 21:01:16: 0: STDOUT: Increment: 1

2024-04-27 21:01:16: 0: STDOUT: Ignore Inputs: True

2024-04-27 21:01:16: 0: STDOUT: No output specified. Output will be handled by the driver

2024-04-27 21:01:16: 0: STDOUT: Driver: /stage/Rnd_Dust1

2024-04-27 21:01:16: 0: STDOUT: Input File: //avril/jobs/ads/Chota_Bheem/sq26A/sh_0110A/work/lighting/COD_sh_0110A_lighting_v010_P_REN.hip

2024-04-27 21:01:17: 0: STDOUT: Begin Path Mapping

2024-04-27 21:01:18: 0: STDOUT: b’’

2024-04-27 21:01:18: 0: STDOUT: b’’

2024-04-27 21:01:18: 0: STDOUT: End Path Mapping

2024-04-27 21:01:18: 0: STDOUT: ROP type: usdrender_rop

2024-04-27 21:01:18: 0: STDOUT: Rendering frame 1001

2024-04-27 21:01:18: 0: Done executing plugin command of type ‘Render Task’

=======================================================

Details

=======================================================

Date: 04/27/2024 21:03:57

Frames: 1001

Elapsed Time: 00:00:00:46

Job Submit Date: 04/27/2024 21:02:44

Job User: prasanth.p

Average RAM Usage: 9261382656 (15%)

Peak RAM Usage: 9516249088 (15%)

Average CPU Usage: 2%

Peak CPU Usage: 10%

Used CPU Clocks (x10^6 cycles): 122959

Total CPU Clocks (x10^6 cycles): 6147916

=======================================================

Worker Information

=======================================================

Worker Name: avril7956

Version: v10.2.1.1 Release (094cbe890)

Operating System: Windows 10 Pro

Running As Service: Yes

Machine User: render

IP Address: 192.168.XXXX

MAC Address: XXXXXXXXXXXXXXXXX

CPU Architecture: x64

CPUs: 32

CPU Usage: 0%

Memory Usage: 8.9 GB / 59.7 GB (14%)

Free Disk Space: 141.523 GB

Video Card: AMD Radeon™ Graphics

#2

And which version of deadline are you running?

Share the Task ID 0 (see in upper pane of Job reports UI - 4th column from left) because it is the most verbose.

Here’s how you get to the Job Reports:

https://docs.thinkboxsoftware.com/products/deadline/10.3/1_User%20Manual/manual/job-controlling.html#job-reports-and-history

to test further and get (maybe) more log out of Houdini follow below:

  • Backup [repo]/plugins/Houdini/Houdini.py
  • Look for line self.AddStdoutHandlerCallback( "(Error: .*)" ).HandleCallback += self.HandleStdoutError
  • Comment it out by putting # at the front of the line
  • Reproduce the issue and share the job report for this test too.
#3

We are using Deadline 10.2.1.1

Please find the job reports of the previous failed task:
Reports_Job.zip (22.3 KB)

After updating, renders are working fine without any problem, BTW I can changed the Houdini Karma Image mode from “Progressive” to “Bucket” after seeing the ‘Warning’ error in console when rendering with CDM(deep).

Kindly please check the log, if this was really solved the issue.

#4

Did you upgrade deadline or Houdini?

I’m not quite sure how you have your project configured, I don’t see an output file path configured

2024-04-27 21:00:07: 0: STDOUT: No output specified. Output will be handled by the driver

#5

No, due to project limitations we can’t upgrade the deadline now

Usually render path output will be saved in Karma render settings, If we leave empty on the rop node, it take the path from the karma node,

#6

“Attempted operation failed” is an error from inside Houdini. Unfortunately, in this case the real error is swallowed.
A local command-line render should reveal the error:

  • Copy full command from Deadline log
  • Adjust paths to be valid (e.g. to hrender_dl.py and other files)
  • Run command and observe for errors.
#7

+1 to @mois.moshev, this is the error coming from Houdini and the actual error from Houdini is ignored as it is formatted to show the generic error first. Here is more information on this: Errors running houdini on worker: ERROR: Encountered the following error while initializing the Plugin Sandbox: 'Value cannot be null. (Parameter 'input')' - #3 by Justin_B

We should isolate the Houdini render from Deadline and try run this render node it failed. Follow this documentation to isolate: Houdini — Deadline 10.3.2.1 documentation

Privacy | Site terms | Cookie preferences