I’m having trouble getting Wedge ROP to function as expected when running simulation wedges.
I have a basic flip simulation and I want to wedge one attribute. I’ve set it up to run 4 wedges for 10 frames and it points to Geometry ROP that uses $WEDGENUM to set the output files.
It works perfectly if I run it on my local machine. It also works if I send to single farm machine but if I try to separate the wedges using ‘Submit Wedges as Separate Jobs’ with ‘Frames Per Task’ set to 10 it picks up 4 boxes on the farm and runs ALL the wedges starting from wedge0 effectively overwriting everything 4 times.
I’ve seen discussions about this problem prior but I haven’t been able to find an answer yet.
Thank you for the help in advance!
We have the same problem now
Houdini 20.0.590 and Deadline 10.3.2.1
I am probably going to debug it today.
Hello @Toni_Pykalaniemi
Can you elaborate more on how 4 Workers are picking up the same task and overriding the output? Does the task fail in the first place and then a second Worker renders it? Or is it like the Worker renders all the wedges on a single job?
Please share an example job report here.
In our case it’s rather that one worker is rendering four times all four frames.
I will try to get you a report later but what effectively happens is that workers pick-up the task, no errors, all of them (4 in our example case) start from wedge 0, sim the frames, move to wedge 1, sim the frames etc etc.
And as this is happening with all 4 workers simultaneously every sim frame is overwritten 4 times.
Here’s one job report that illustrates the problem:
=======================================================
Log
2024-04-19 11:00:10: 0: Loading Job’s Plugin timeout is Disabled
2024-04-19 11:00:10: 0: SandboxedPlugin: Render Job As User disabled, running as current user ‘administrator’
2024-04-19 11:00:12: 0: Executing plugin command of type ‘Initialize Plugin’
2024-04-19 11:00:12: 0: INFO: Executing plugin script ‘C:\ProgramData\Thinkbox\Deadline10\workers\bc-pinotnoir\plugins\6622b128f26c419f01edf625\Houdini.py’
2024-04-19 11:00:12: 0: INFO: Plugin execution sandbox using Python version 3
2024-04-19 11:00:12: 0: INFO: About: Houdini Plugin for Deadline
2024-04-19 11:00:12: 0: INFO: The job’s environment will be merged with the current environment before rendering
2024-04-19 11:00:12: 0: Done executing plugin command of type ‘Initialize Plugin’
2024-04-19 11:00:12: 0: Start Job timeout is disabled.
2024-04-19 11:00:12: 0: Task timeout is disabled.
2024-04-19 11:00:12: 0: Loaded job: ocean_test_v007 - /out/OUT_ocean_flip_wedge{WEDGE #3} (6622b128f26c419f01edf625)
2024-04-19 11:00:12: 0: Executing plugin command of type ‘Start Job’
2024-04-19 11:00:12: 0: DEBUG: S3BackedCache Client is not installed.
2024-04-19 11:00:12: 0: INFO: Executing global asset transfer preload script ‘C:\ProgramData\Thinkbox\Deadline10\workers\bc-pinotnoir\plugins\6622b128f26c419f01edf625\GlobalAssetTransferPreLoad.py’
2024-04-19 11:00:12: 0: INFO: Looking for legacy (pre-10.0.26) AWS Portal File Transfer…
2024-04-19 11:00:12: 0: INFO: Looking for legacy (pre-10.0.26) File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py…
2024-04-19 11:00:12: 0: INFO: Could not find legacy (pre-10.0.26) AWS Portal File Transfer.
2024-04-19 11:00:12: 0: INFO: Legacy (pre-10.0.26) AWS Portal File Transfer is not installed on the system.
2024-04-19 11:00:12: 0: Done executing plugin command of type ‘Start Job’
2024-04-19 11:00:12: 0: Plugin rendering frame(s): 1-10
2024-04-19 11:00:13: 0: Executing plugin command of type ‘Render Task’
2024-04-19 11:00:13: 0: INFO: Starting Houdini Job
2024-04-19 11:00:13: 0: INFO: Stdout Redirection Enabled: True
2024-04-19 11:00:13: 0: INFO: Stdout Handling Enabled: True
2024-04-19 11:00:13: 0: INFO: Popup Handling Enabled: True
2024-04-19 11:00:13: 0: INFO: QT Popup Handling Enabled: False
2024-04-19 11:00:13: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2024-04-19 11:00:13: 0: INFO: Using Process Tree: True
2024-04-19 11:00:13: 0: INFO: Hiding DOS Window: True
2024-04-19 11:00:13: 0: INFO: Creating New Console: False
2024-04-19 11:00:13: 0: INFO: Running as user: administrator
2024-04-19 11:00:13: 0: INFO: Executable: “C:\Program Files\Side Effects Software\Houdini 20.0.634\bin\hython.exe”
2024-04-19 11:00:13: 0: INFO: Argument: “C:\ProgramData\Thinkbox\Deadline10\workers\bc-pinotnoir\plugins\6622b128f26c419f01edf625\hrender_dl.py” -f 1 10 1 -o “$HIP/geo/ocean_sim_wedge/v_$WEDGENUM/ocean_sim_v_$WEDGENUM.$F.bgeo.sc” -d /out/OUT_ocean_flip_wedge -tempdir “C:\ProgramData\Thinkbox\Deadline10\workers\bc-pinotnoir\jobsData\6622b128f26c419f01edf625\0_tempOTw9Z0” -arnoldAbortOnLicenseFail 1 “Z:/projects/sub/houdini/ocean_test_v007.hiplc”
2024-04-19 11:00:13: 0: INFO: Full Command: “C:\Program Files\Side Effects Software\Houdini 20.0.634\bin\hython.exe” “C:\ProgramData\Thinkbox\Deadline10\workers\bc-pinotnoir\plugins\6622b128f26c419f01edf625\hrender_dl.py” -f 1 10 1 -o “$HIP/geo/ocean_sim_wedge/v_$WEDGENUM/ocean_sim_v_$WEDGENUM.$F.bgeo.sc” -d /out/OUT_ocean_flip_wedge -tempdir “C:\ProgramData\Thinkbox\Deadline10\workers\bc-pinotnoir\jobsData\6622b128f26c419f01edf625\0_tempOTw9Z0” -arnoldAbortOnLicenseFail 1 “Z:/projects/sub/houdini/ocean_test_v007.hiplc”
2024-04-19 11:00:13: 0: INFO: Startup Directory: “C:\Program Files\Side Effects Software\Houdini 20.0.634\bin”
2024-04-19 11:00:13: 0: INFO: Process Priority: BelowNormal
2024-04-19 11:00:13: 0: INFO: Process Affinity: default
2024-04-19 11:00:13: 0: INFO: Process is now running
2024-04-19 11:00:14: 0: STDOUT: Detected Houdini version: (20, 0, 634)
2024-04-19 11:00:14: 0: STDOUT: [‘C:\ProgramData\Thinkbox\Deadline10\workers\bc-pinotnoir\plugins\6622b128f26c419f01edf625\hrender_dl.py’, ‘-f’, ‘1’, ‘10’, ‘1’, ‘-o’, ‘$HIP/geo/ocean_sim_wedge/v_$WEDGENUM/ocean_sim_v_$WEDGENUM.$F.bgeo.sc’, ‘-d’, ‘/out/OUT_ocean_flip_wedge’, ‘-tempdir’, ‘C:\ProgramData\Thinkbox\Deadline10\workers\bc-pinotnoir\jobsData\6622b128f26c419f01edf625\0_tempOTw9Z0’, ‘-arnoldAbortOnLicenseFail’, ‘1’, ‘Z:/projects/sub/houdini/ocean_test_v007.hiplc’]
2024-04-19 11:00:14: 0: STDOUT: Start: 1
2024-04-19 11:00:14: 0: STDOUT: End: 10
2024-04-19 11:00:14: 0: STDOUT: Increment: 1
2024-04-19 11:00:14: 0: STDOUT: Ignore Inputs: False
2024-04-19 11:00:14: 0: STDOUT: Output: $HIP/geo/ocean_sim_wedge/v_$WEDGENUM/ocean_sim_v_$WEDGENUM.$F.bgeo.sc
2024-04-19 11:00:14: 0: STDOUT: Driver: /out/OUT_ocean_flip_wedge
2024-04-19 11:00:14: 0: STDOUT: Input File: Z:/projects/sub/houdini/ocean_test_v007.hiplc
2024-04-19 11:00:15: 0: STDOUT: Warnings were generated during load.
2024-04-19 11:00:15: 0: STDOUT: Error loading: Z:/projects/sub/houdini/ocean_test_v007.hiplc
2024-04-19 11:00:15: 0: STDOUT: Warning: The following node types are using incomplete asset definitions:
2024-04-19 11:00:15: 0: STDOUT: labs::Sop/measure_curvature::3.1
2024-04-19 11:00:15: 0: STDOUT: Begin Path Mapping
2024-04-19 11:00:17: 0: STDOUT: b’’
2024-04-19 11:00:18: 0: STDOUT: b’’
2024-04-19 11:00:18: 0: STDOUT: End Path Mapping
2024-04-19 11:00:18: 0: STDOUT: ROP type: wedge
2024-04-19 11:00:18: 0: STDOUT: Enabled Alfred style progress
2024-04-19 11:00:18: 0: STDOUT: Enabled network use reporting
2024-04-19 11:00:18: 0: STDOUT: Rendering wedge 0 for frame 1 to 10
2024-04-19 11:00:28: 0: STDOUT: WRITE_ocean_sim at time 0
2024-04-19 11:00:28: 0: STDOUT: Bytes sent: 0
2024-04-19 11:00:28: 0: STDOUT: Bytes received: 0
2024-04-19 11:00:28: 0: STDOUT: Seconds taken: 0
2024-04-19 11:00:28: 0: STDOUT: ALF_PROGRESS 0%
2024-04-19 11:00:38: 0: STDOUT: WRITE_ocean_sim at time 0.04
2024-04-19 11:00:38: 0: STDOUT: Bytes sent: 0
2024-04-19 11:00:38: 0: STDOUT: Bytes received: 0
2024-04-19 11:00:38: 0: STDOUT: Seconds taken: 0
2024-04-19 11:00:38: 0: STDOUT: ALF_PROGRESS 11%
2024-04-19 11:00:43: 0: STDOUT: WRITE_ocean_sim at time 0.08
2024-04-19 11:00:43: 0: STDOUT: Bytes sent: 0
2024-04-19 11:00:43: 0: STDOUT: Bytes received: 0
2024-04-19 11:00:43: 0: STDOUT: Seconds taken: 0
2024-04-19 11:00:43: 0: STDOUT: ALF_PROGRESS 22%
2024-04-19 11:00:49: 0: STDOUT: WRITE_ocean_sim at time 0.12
2024-04-19 11:00:49: 0: STDOUT: Bytes sent: 0
2024-04-19 11:00:49: 0: STDOUT: Bytes received: 0
2024-04-19 11:00:49: 0: STDOUT: Seconds taken: 0
2024-04-19 11:00:49: 0: STDOUT: ALF_PROGRESS 33%
2024-04-19 11:00:55: 0: STDOUT: WRITE_ocean_sim at time 0.16
2024-04-19 11:00:55: 0: STDOUT: Bytes sent: 0
2024-04-19 11:00:55: 0: STDOUT: Bytes received: 0
2024-04-19 11:00:55: 0: STDOUT: Seconds taken: 0
2024-04-19 11:00:55: 0: STDOUT: ALF_PROGRESS 44%
2024-04-19 11:01:02: 0: STDOUT: WRITE_ocean_sim at time 0.2
2024-04-19 11:01:02: 0: STDOUT: Bytes sent: 0
2024-04-19 11:01:02: 0: STDOUT: Bytes received: 0
2024-04-19 11:01:02: 0: STDOUT: Seconds taken: 0
2024-04-19 11:01:02: 0: STDOUT: ALF_PROGRESS 56%
2024-04-19 11:01:09: 0: STDOUT: WRITE_ocean_sim at time 0.24
2024-04-19 11:01:09: 0: STDOUT: Bytes sent: 0
2024-04-19 11:01:09: 0: STDOUT: Bytes received: 0
2024-04-19 11:01:09: 0: STDOUT: Seconds taken: 0
2024-04-19 11:01:09: 0: STDOUT: ALF_PROGRESS 67%
2024-04-19 11:01:20: 0: STDOUT: WRITE_ocean_sim at time 0.28
2024-04-19 11:01:20: 0: STDOUT: Bytes sent: 0
2024-04-19 11:01:20: 0: STDOUT: Bytes received: 0
2024-04-19 11:01:20: 0: STDOUT: Seconds taken: 0
2024-04-19 11:01:20: 0: STDOUT: ALF_PROGRESS 78%
2024-04-19 11:01:33: 0: STDOUT: WRITE_ocean_sim at time 0.32
2024-04-19 11:01:33: 0: STDOUT: Bytes sent: 0
2024-04-19 11:01:33: 0: STDOUT: Bytes received: 0
2024-04-19 11:01:33: 0: STDOUT: Seconds taken: 0
2024-04-19 11:01:33: 0: STDOUT: ALF_PROGRESS 89%
2024-04-19 11:01:47: 0: STDOUT: WRITE_ocean_sim at time 0.36
2024-04-19 11:01:47: 0: STDOUT: Bytes sent: 0
2024-04-19 11:01:47: 0: STDOUT: Bytes received: 0
2024-04-19 11:01:47: 0: STDOUT: Seconds taken: 0
2024-04-19 11:01:47: 0: STDOUT: ALF_PROGRESS 100%
2024-04-19 11:01:57: 0: STDOUT: Rendering wedge 1 for frame 1 to 10
2024-04-19 11:01:57: 0: STDOUT: WRITE_ocean_sim at time 0
2024-04-19 11:01:57: 0: STDOUT: Bytes sent: 0
2024-04-19 11:01:57: 0: STDOUT: Bytes received: 0
2024-04-19 11:01:57: 0: STDOUT: Seconds taken: 0
2024-04-19 11:01:57: 0: STDOUT: ALF_PROGRESS 0%
2024-04-19 11:02:04: 0: STDOUT: WRITE_ocean_sim at time 0.04
2024-04-19 11:02:04: 0: STDOUT: Bytes sent: 0
2024-04-19 11:02:04: 0: STDOUT: Bytes received: 0
2024-04-19 11:02:04: 0: STDOUT: Seconds taken: 0
2024-04-19 11:02:04: 0: STDOUT: ALF_PROGRESS 11%
2024-04-19 11:02:09: 0: STDOUT: WRITE_ocean_sim at time 0.08
2024-04-19 11:02:09: 0: STDOUT: Bytes sent: 0
2024-04-19 11:02:09: 0: STDOUT: Bytes received: 0
2024-04-19 11:02:09: 0: STDOUT: Seconds taken: 0
2024-04-19 11:02:09: 0: STDOUT: ALF_PROGRESS 22%
2024-04-19 11:02:16: 0: STDOUT: WRITE_ocean_sim at time 0.12
2024-04-19 11:02:16: 0: STDOUT: Bytes sent: 0
2024-04-19 11:02:16: 0: STDOUT: Bytes received: 0
2024-04-19 11:02:16: 0: STDOUT: Seconds taken: 0
2024-04-19 11:02:16: 0: STDOUT: ALF_PROGRESS 33%
2024-04-19 11:02:23: 0: STDOUT: WRITE_ocean_sim at time 0.16
2024-04-19 11:02:23: 0: STDOUT: Bytes sent: 0
2024-04-19 11:02:23: 0: STDOUT: Bytes received: 0
2024-04-19 11:02:23: 0: STDOUT: Seconds taken: 0
2024-04-19 11:02:23: 0: STDOUT: ALF_PROGRESS 44%
2024-04-19 11:02:37: 0: STDOUT: WRITE_ocean_sim at time 0.2
2024-04-19 11:02:37: 0: STDOUT: Bytes sent: 0
2024-04-19 11:02:37: 0: STDOUT: Bytes received: 0
2024-04-19 11:02:37: 0: STDOUT: Seconds taken: 0
2024-04-19 11:02:37: 0: STDOUT: ALF_PROGRESS 56%
2024-04-19 11:02:52: 0: STDOUT: WRITE_ocean_sim at time 0.24
2024-04-19 11:02:52: 0: STDOUT: Bytes sent: 0
2024-04-19 11:02:52: 0: STDOUT: Bytes received: 0
2024-04-19 11:02:52: 0: STDOUT: Seconds taken: 0
2024-04-19 11:02:52: 0: STDOUT: ALF_PROGRESS 67%
2024-04-19 11:03:08: 0: STDOUT: WRITE_ocean_sim at time 0.28
2024-04-19 11:03:08: 0: STDOUT: Bytes sent: 0
2024-04-19 11:03:08: 0: STDOUT: Bytes received: 0
2024-04-19 11:03:08: 0: STDOUT: Seconds taken: 0
2024-04-19 11:03:08: 0: STDOUT: ALF_PROGRESS 78%
2024-04-19 11:03:25: 0: STDOUT: WRITE_ocean_sim at time 0.32
2024-04-19 11:03:25: 0: STDOUT: Bytes sent: 0
2024-04-19 11:03:25: 0: STDOUT: Bytes received: 0
2024-04-19 11:03:25: 0: STDOUT: Seconds taken: 0
2024-04-19 11:03:25: 0: STDOUT: ALF_PROGRESS 89%
2024-04-19 11:03:44: 0: STDOUT: WRITE_ocean_sim at time 0.36
2024-04-19 11:03:44: 0: STDOUT: Bytes sent: 0
2024-04-19 11:03:44: 0: STDOUT: Bytes received: 0
2024-04-19 11:03:44: 0: STDOUT: Seconds taken: 0
2024-04-19 11:03:44: 0: STDOUT: ALF_PROGRESS 100%
2024-04-19 11:04:13: 0: STDOUT: Rendering wedge 2 for frame 1 to 10
2024-04-19 11:04:14: 0: STDOUT: WRITE_ocean_sim at time 0
2024-04-19 11:04:14: 0: STDOUT: Bytes sent: 0
2024-04-19 11:04:14: 0: STDOUT: Bytes received: 0
2024-04-19 11:04:14: 0: STDOUT: Seconds taken: 0
2024-04-19 11:04:14: 0: STDOUT: ALF_PROGRESS 0%
2024-04-19 11:04:20: 0: STDOUT: WRITE_ocean_sim at time 0.04
2024-04-19 11:04:20: 0: STDOUT: Bytes sent: 0
2024-04-19 11:04:20: 0: STDOUT: Bytes received: 0
2024-04-19 11:04:20: 0: STDOUT: Seconds taken: 0
2024-04-19 11:04:20: 0: STDOUT: ALF_PROGRESS 11%
2024-04-19 11:04:26: 0: STDOUT: WRITE_ocean_sim at time 0.08
2024-04-19 11:04:26: 0: STDOUT: Bytes sent: 0
2024-04-19 11:04:26: 0: STDOUT: Bytes received: 0
2024-04-19 11:04:26: 0: STDOUT: Seconds taken: 0
2024-04-19 11:04:26: 0: STDOUT: ALF_PROGRESS 22%
2024-04-19 11:04:38: 0: STDOUT: WRITE_ocean_sim at time 0.12
2024-04-19 11:04:38: 0: STDOUT: Bytes sent: 0
2024-04-19 11:04:38: 0: STDOUT: Bytes received: 0
2024-04-19 11:04:38: 0: STDOUT: Seconds taken: 0
2024-04-19 11:04:38: 0: STDOUT: ALF_PROGRESS 33%
2024-04-19 11:04:51: 0: STDOUT: WRITE_ocean_sim at time 0.16
2024-04-19 11:04:51: 0: STDOUT: Bytes sent: 0
2024-04-19 11:04:51: 0: STDOUT: Bytes received: 0
2024-04-19 11:04:51: 0: STDOUT: Seconds taken: 0
2024-04-19 11:04:51: 0: STDOUT: ALF_PROGRESS 44%
2024-04-19 11:05:06: 0: STDOUT: WRITE_ocean_sim at time 0.2
2024-04-19 11:05:06: 0: STDOUT: Bytes sent: 0
2024-04-19 11:05:06: 0: STDOUT: Bytes received: 0
2024-04-19 11:05:06: 0: STDOUT: Seconds taken: 0
2024-04-19 11:05:06: 0: STDOUT: ALF_PROGRESS 56%
2024-04-19 11:05:21: 0: STDOUT: WRITE_ocean_sim at time 0.24
2024-04-19 11:05:21: 0: STDOUT: Bytes sent: 0
2024-04-19 11:05:21: 0: STDOUT: Bytes received: 0
2024-04-19 11:05:21: 0: STDOUT: Seconds taken: 0
2024-04-19 11:05:21: 0: STDOUT: ALF_PROGRESS 67%
2024-04-19 11:05:38: 0: STDOUT: WRITE_ocean_sim at time 0.28
2024-04-19 11:05:38: 0: STDOUT: Bytes sent: 0
2024-04-19 11:05:38: 0: STDOUT: Bytes received: 0
2024-04-19 11:05:38: 0: STDOUT: Seconds taken: 0
2024-04-19 11:05:38: 0: STDOUT: ALF_PROGRESS 78%
2024-04-19 11:05:57: 0: STDOUT: WRITE_ocean_sim at time 0.32
2024-04-19 11:05:57: 0: STDOUT: Bytes sent: 0
2024-04-19 11:05:57: 0: STDOUT: Bytes received: 0
2024-04-19 11:05:57: 0: STDOUT: Seconds taken: 0
2024-04-19 11:05:57: 0: STDOUT: ALF_PROGRESS 89%
2024-04-19 11:06:16: 0: STDOUT: WRITE_ocean_sim at time 0.36
2024-04-19 11:06:16: 0: STDOUT: Bytes sent: 0
2024-04-19 11:06:16: 0: STDOUT: Bytes received: 0
2024-04-19 11:06:16: 0: STDOUT: Seconds taken: 0
2024-04-19 11:06:16: 0: STDOUT: ALF_PROGRESS 100%
2024-04-19 11:06:19: 0: STDOUT: Rendering wedge 3 for frame 1 to 10
2024-04-19 11:06:19: 0: STDOUT: WRITE_ocean_sim at time 0
2024-04-19 11:06:19: 0: STDOUT: Bytes sent: 0
2024-04-19 11:06:19: 0: STDOUT: Bytes received: 0
2024-04-19 11:06:19: 0: STDOUT: Seconds taken: 0
2024-04-19 11:06:19: 0: STDOUT: ALF_PROGRESS 0%
2024-04-19 11:06:25: 0: STDOUT: WRITE_ocean_sim at time 0.04
2024-04-19 11:06:25: 0: STDOUT: Bytes sent: 0
2024-04-19 11:06:25: 0: STDOUT: Bytes received: 0
2024-04-19 11:06:25: 0: STDOUT: Seconds taken: 0
2024-04-19 11:06:25: 0: STDOUT: ALF_PROGRESS 11%
2024-04-19 11:06:36: 0: STDOUT: WRITE_ocean_sim at time 0.08
2024-04-19 11:06:36: 0: STDOUT: Bytes sent: 0
2024-04-19 11:06:36: 0: STDOUT: Bytes received: 0
2024-04-19 11:06:36: 0: STDOUT: Seconds taken: 0
2024-04-19 11:06:36: 0: STDOUT: ALF_PROGRESS 22%
2024-04-19 11:06:49: 0: STDOUT: WRITE_ocean_sim at time 0.12
2024-04-19 11:06:49: 0: STDOUT: Bytes sent: 0
2024-04-19 11:06:49: 0: STDOUT: Bytes received: 0
2024-04-19 11:06:49: 0: STDOUT: Seconds taken: 0
2024-04-19 11:06:49: 0: STDOUT: ALF_PROGRESS 33%
2024-04-19 11:07:02: 0: STDOUT: WRITE_ocean_sim at time 0.16
2024-04-19 11:07:02: 0: STDOUT: Bytes sent: 0
2024-04-19 11:07:02: 0: STDOUT: Bytes received: 0
2024-04-19 11:07:02: 0: STDOUT: Seconds taken: 0
2024-04-19 11:07:02: 0: STDOUT: ALF_PROGRESS 44%
2024-04-19 11:07:17: 0: STDOUT: WRITE_ocean_sim at time 0.2
2024-04-19 11:07:17: 0: STDOUT: Bytes sent: 0
2024-04-19 11:07:17: 0: STDOUT: Bytes received: 0
2024-04-19 11:07:17: 0: STDOUT: Seconds taken: 0
2024-04-19 11:07:17: 0: STDOUT: ALF_PROGRESS 56%
2024-04-19 11:07:33: 0: STDOUT: WRITE_ocean_sim at time 0.24
2024-04-19 11:07:33: 0: STDOUT: Bytes sent: 0
2024-04-19 11:07:33: 0: STDOUT: Bytes received: 0
2024-04-19 11:07:33: 0: STDOUT: Seconds taken: 0
2024-04-19 11:07:33: 0: STDOUT: ALF_PROGRESS 67%
2024-04-19 11:07:51: 0: STDOUT: WRITE_ocean_sim at time 0.28
2024-04-19 11:07:51: 0: STDOUT: Bytes sent: 0
2024-04-19 11:07:51: 0: STDOUT: Bytes received: 0
2024-04-19 11:07:51: 0: STDOUT: Seconds taken: 0
2024-04-19 11:07:51: 0: STDOUT: ALF_PROGRESS 78%
2024-04-19 11:08:10: 0: STDOUT: WRITE_ocean_sim at time 0.32
2024-04-19 11:08:10: 0: STDOUT: Bytes sent: 0
2024-04-19 11:08:10: 0: STDOUT: Bytes received: 0
2024-04-19 11:08:10: 0: STDOUT: Seconds taken: 0
2024-04-19 11:08:10: 0: STDOUT: ALF_PROGRESS 89%
2024-04-19 11:08:30: 0: STDOUT: WRITE_ocean_sim at time 0.36
2024-04-19 11:08:30: 0: STDOUT: Bytes sent: 0
2024-04-19 11:08:30: 0: STDOUT: Bytes received: 0
2024-04-19 11:08:30: 0: STDOUT: Seconds taken: 0
2024-04-19 11:08:30: 0: STDOUT: ALF_PROGRESS 100%
2024-04-19 11:08:33: 0: STDOUT: Finished Rendering
2024-04-19 11:08:33: 0: INFO: Process exit code: 0
2024-04-19 11:08:33: 0: INFO: Finished Houdini Job
2024-04-19 11:08:33: 0: Done executing plugin command of type ‘Render Task’
I think it is defined [Repo]/plugins/Houdini/hrender_dl.py: 442 - 447 and 855 - 877
442-447: It is checking whether the wedgeNum was the part of the arguments if not it sets it to -1 and continues to render all of the wedge on every task.
if "-wedgenum" not in args:
wedgeNum = -1
else:
wedgeNumIndex = args.index("-wedgenum")
wedgeNum = int(args[wedgeNumIndex + 1])
print( "Wedge Number: " + str(wedgeNum) )
855-867 Here it is iterating over all the options because wedgeNum was set to -1
if isWedge:
rop = wedgeNode
if wedgeNum == -1:
#Do all the wedges for the frame range. We will use this scripts' last call to render as the last wedge's render call,
# so we just need to render the first n-1 wedges here and then set up the rop for the last render.
for i in range(0, (numTasks - 1)):
print( "Rendering wedge " + str(i) + " for " + frameString )
rop.parm("wedgenum").set(i)
rop.render( frameTuple, resolution, ignore_inputs=ignoreInputs )
#Since we looped to the second last, we need to set the wedge number for the last render call
print( "Rendering wedge " + str(numTasks-1) + " for " + frameString )
rop.parm("wedgenum").set(numTasks-1)
I think the submission is not getting through correctly. I need more information to look into this further. Check in the submission params of the job : Right menu of job> Modify Job Properties> Plugin Info on the right> look for the value of WedgeNum set to?
If you cannot find it then there may be an issue with the submitter.
1 Like
Here’s the plugin params of the wedge #3:
Build=64bit
GPUsPerTask=0
IgnoreInputs=0
OpenCLUseGPU=0
Output=$HIP/geo/ocean_sim_wedge/v_$WEDGENUM/ocean_sim_v_$WEDGENUM.$F.bgeo.sc
OutputDriver=/out/OUT_ocean_flip_wedge
SceneFile=Z:/projects/sub/houdini/ocean_test_v007.hiplc
SelectGPUDevices=
Version=20.0
WedgeNum=3
and wedge #0 respectively:
Build=64bit
GPUsPerTask=0
IgnoreInputs=0
OpenCLUseGPU=0
Output=$HIP/geo/ocean_sim_wedge/v_$WEDGENUM/ocean_sim_v_$WEDGENUM.$F.bgeo.sc
OutputDriver=/out/OUT_ocean_flip_wedge
SceneFile=Z:/projects/sub/houdini/ocean_test_v007.hiplc
SelectGPUDevices=
Version=20.0
WedgeNum=0
Based on this it seems it’s getting the wedge number correctly but for some reason all the jobs start at wedge #0
Alright so it is the same case, after a deeper look.
Check out the “Full command” in the log. It does not pass a -wedgenum to hrender_dl
However, it is apparent that the job does have WedgeNum.
So the suspect piece is (Houdini.py line #100)
try:
wedgeNum = self.GetIntegerPluginInfoEntryWithDefault("WedgeNum", "-1")
except:
pass
Maybe because the default has the wrong type, and the exception is swallowed. I’m checking this hypothesis.
In any case, this is where the chain breaks.
Great work digging into it!
I’m not Python-savvy but I’m noticing inconsistent cases on “wedgenum” variable.
Nah these are different things - the job property and the command line argument. For some reason it’s not being read correctly when taking the first in order to pass it to the second. I implemented a fix, and still need to test it.
Hey Mois,
Have you found a solution to this? I would love to hear if there’s any fix for this.
I actually implemented a fix and the artist who uses wedges the most went on vacation 
I’ll let you know when he tests. I’m certain the issue comes from the line cited above. Possibly because “-1” is a string and does not match the function’s signature. I’m also printing the error instead of passing, to get more information.
Btw this part did not change in recent versions, but possibly the interpreter became stricter and started rejecting this default? Dunno, these are just hypotheses.
Yep, can confirm that changing "-1" to -1 as the default value fixed it.
wedgeNum = self.GetIntegerPluginInfoEntryWithDefault("WedgeNum", -1)