Houdini-Redshift exit code 134 workaround

Discussion and Support of Deadline, the Render Management System
yjh4477
Posts: 2
Joined: Thu Jul 06, 2017 9:23 am

Houdini-Redshift exit code 134 workaround

Postby yjh4477 » Sat Jul 08, 2017 2:35 am

hi
We're trying to render an houdini project using Deadline and Redshift renderer.
When we render Volume with Redshift in Houdini, Deadline reports an error as follows.
Rendered images are completed but Deadline reports an error and requeue the rendered frame.
Even in case of simple volume rendering, there are same errors 'Process exit code :134'
Is there any advice?

p.s. Houdini version :16.0.633, Redshift 2.5.20, Deadline 9.0.5.0


---------------------------------------------------------------------------------------------
=======================================================
Error
=======================================================
Error: Renderer returned non-zero error code, 134. Check the log for more information.
at Deadline.Plugins.PluginWrapper.RenderTasks (System.String taskId, System.Int32 startFrame, System.Int32 endFrame, System.String& outMessage, FranticX.Processes.ManagedProcess+AbortLevel& abortLevel) [0x002bc] in <f4b68c258ff84578bf17958fac63478b>:0

=======================================================
Type
=======================================================
RenderPluginException

=======================================================
Stack Trace
=======================================================
at Deadline.Plugins.SandboxedPlugin.SendMessageToSandbox (Deadline.Net.DeadlineMessage messageToSend) [0x0021c] in <f4b68c258ff84578bf17958fac63478b>:0
at Deadline.Plugins.SandboxedPlugin.RenderTask (System.String taskId, System.Int32 startFrame, System.Int32 endFrame) [0x000b5] in <f4b68c258ff84578bf17958fac63478b>:0
at Deadline.Slaves.SlaveRenderThread.RenderCurrentTask (Deadline.IO.TaskLogWriter tlw) [0x00734] in <f4b68c258ff84578bf17958fac63478b>:0

=======================================================
Log
=======================================================
2017-07-07 02:08:57: 0: Loading Job's Plugin timeout is Disabled
2017-07-07 02:08:58: 0: Executing plugin command of type 'Sync Files for Job'
2017-07-07 02:08:58: 0: All job files are already synchronized
2017-07-07 02:08:58: 0: Synchronizing Plugin Houdini from /iu/project/deadlinerepo/plugins/Houdini took: 0 seconds
2017-07-07 02:08:58: 0: Done executing plugin command of type 'Sync Files for Job'
2017-07-07 02:08:58: 0: Executing plugin command of type 'Initialize Plugin'
2017-07-07 02:08:59: 0: INFO: Executing plugin script '/tmp/Thinkbox/Deadline9/sunhyoungfx/slave/gpu0004/plugins/595dfd29ea798e4ccf504991/Houdini.py'
2017-07-07 02:08:59: 0: INFO: About: Houdini Plugin for Deadline
2017-07-07 02:08:59: 0: INFO: Render Job As User disabled, running as current user 'sunhyoungfx'
2017-07-07 02:08:59: 0: INFO: The job's environment will be merged with the current environment before rendering
2017-07-07 02:08:59: 0: Done executing plugin command of type 'Initialize Plugin'
2017-07-07 02:08:59: 0: Start Job timeout is disabled.
2017-07-07 02:08:59: 0: Task timeout is disabled.
2017-07-07 02:08:59: 0: Loaded job: tbd_s0010_c1891_fx_test_v001.hip - /out/Redshift_ROP1 (595dfd29ea798e4ccf504991)
2017-07-07 02:08:59: 0: Executing plugin command of type 'Start Job'
2017-07-07 02:08:59: 0: Done executing plugin command of type 'Start Job'
2017-07-07 02:08:59: 0: Plugin rendering frame(s): 1
2017-07-07 02:08:59: 0: Executing plugin command of type 'Render Task'
2017-07-07 02:09:00: 0: INFO: Starting Houdini Job
2017-07-07 02:09:00: 0: INFO: Stdout Redirection Enabled: True
2017-07-07 02:09:00: 0: INFO: Asynchronous Stdout Enabled: False
2017-07-07 02:09:00: 0: INFO: Stdout Handling Enabled: True
2017-07-07 02:09:00: 0: INFO: Popup Handling Enabled: True
2017-07-07 02:09:00: 0: INFO: QT Popup Handling Enabled: False
2017-07-07 02:09:00: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2017-07-07 02:09:00: 0: INFO: Using Process Tree: True
2017-07-07 02:09:00: 0: INFO: Hiding DOS Window: True
2017-07-07 02:09:00: 0: INFO: Creating New Console: False
2017-07-07 02:09:00: 0: INFO: Running as user: sunhyoungfx
2017-07-07 02:09:00: 0: INFO: Executable: "/opt/hfs16.0.633/bin/hython"
2017-07-07 02:09:00: 0: INFO: Argument: "/tmp/Thinkbox/Deadline9/sunhyoungfx/slave/gpu0004/plugins/595dfd29ea798e4ccf504991/hrender_dl.py" -f 1 1 1 -d /out/Redshift_ROP1 "/iu/project/tbd/sq/s0010/c1891/fx/devl/yhj4477/tbd_s0010_c1891_fx_test_v001.hip"
2017-07-07 02:09:00: 0: INFO: Full Command: "/opt/hfs16.0.633/bin/hython" "/tmp/Thinkbox/Deadline9/sunhyoungfx/slave/gpu0004/plugins/595dfd29ea798e4ccf504991/hrender_dl.py" -f 1 1 1 -d /out/Redshift_ROP1 "/iu/project/tbd/sq/s0010/c1891/fx/devl/yhj4477/tbd_s0010_c1891_fx_test_v001.hip"
2017-07-07 02:09:00: 0: INFO: Startup Directory: "/opt/hfs16.0.633/bin"
2017-07-07 02:09:00: 0: INFO: Process Priority: BelowNormal
2017-07-07 02:09:00: 0: INFO: Process Affinity: default
2017-07-07 02:09:00: 0: INFO: Process is now running
2017-07-07 02:09:01: 0: STDOUT: [Redshift]Redshift for Houdini plugin version 2.5.20
2017-07-07 02:09:01: 0: STDOUT: [Redshift]Plugin compile time HDK version: 16.0.633
2017-07-07 02:09:01: 0: STDOUT: [Redshift]Houdini host version: 16.0.633
2017-07-07 02:09:01: 0: STDOUT: [Redshift]Plugin dso/dll and config path: /usr/redshift/redshift4houdini/16.0.633/dso
2017-07-07 02:09:01: 0: STDOUT: [Redshift]Core data path: /usr/redshift
2017-07-07 02:09:01: 0: STDOUT: [Redshift]Local data path: /home/sunhyoungfx/redshift
2017-07-07 02:09:01: 0: STDOUT: [Redshift]Procedurals path: /usr/redshift/procedurals
2017-07-07 02:09:01: 0: STDOUT: [Redshift]Preferences file path: /home/sunhyoungfx/redshift/preferences.xml
2017-07-07 02:09:01: 0: STDOUT: [Redshift]License path: /home/sunhyoungfx/redshift
2017-07-07 02:09:02: 0: STDOUT: ['/tmp/Thinkbox/Deadline9/sunhyoungfx/slave/gpu0004/plugins/595dfd29ea798e4ccf504991/hrender_dl.py', '-f', '1', '1', '1', '-d', '/out/Redshift_ROP1', '/iu/project/tbd/sq/s0010/c1891/fx/devl/yhj4477/tbd_s0010_c1891_fx_test_v001.hip']
2017-07-07 02:09:02: 0: STDOUT: Start: 1
2017-07-07 02:09:02: 0: STDOUT: End: 1
2017-07-07 02:09:02: 0: STDOUT: Increment: 1
2017-07-07 02:09:02: 0: STDOUT: Ignore Inputs: False
2017-07-07 02:09:02: 0: STDOUT: No output specified. Output will be handled by the driver
2017-07-07 02:09:02: 0: STDOUT: Driver: /out/Redshift_ROP1
2017-07-07 02:09:02: 0: STDOUT: Input File: /iu/project/tbd/sq/s0010/c1891/fx/devl/yhj4477/tbd_s0010_c1891_fx_test_v001.hip
2017-07-07 02:09:04: 0: STDOUT: ROP type: Redshift_ROP
2017-07-07 02:09:04: 0: STDOUT: Rendering frame 1
2017-07-07 02:09:08: 0: STDOUT: [Redshift]ROP node 'Redshift_ROP1' render started for 1 frames. Time from 0.000000 to 0.000000
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Houdini/FX license found, no render restrictions
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Closing the RS scene
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Initializing the render session
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Textures cache size (MB): 65536
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Textures cache path: ~/redshift/cache
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Devices enabled: 0:GeForce GTX 1080 Ti,1:GeForce GTX 1080 Ti,2:GeForce GTX 1080 Ti,3:GeForce GTX 1080 Ti,4:GeForce GTX 1080 Ti,5:GeForce GTX 1080 Ti,6:GeForce GTX 1080 Ti,7:GeForce GTX 1080 Ti,
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Shading package: Houdini
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Redshift Initialized
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Linux Platform
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Release Build
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Number of CPU HW threads: 48
2017-07-07 02:09:08: 0: STDOUT: [Redshift] CPU speed: 2.20 GHz
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Total system memory: 125.64 GB
2017-07-07 02:09:08: 0: STDOUT: [Redshift]License acquired
2017-07-07 02:09:08: 0: STDOUT: [Redshift]License returned
2017-07-07 02:09:08: 0: STDOUT: [Redshift]License for redshift-core 2017.08 (permanent)
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Creating CUDA contexts
2017-07-07 02:09:08: 0: STDOUT: [Redshift] CUDA init ok
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Ordinals: { 0 1 2 3 4 5 6 7 }
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Initializing GPUComputing module (CUDA). Ordinal 0
2017-07-07 02:09:08: 0: STDOUT: [Redshift] CUDA Ver: 8000
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Device 1/8 : GeForce GTX 1080 Ti
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Compute capability: 6.1
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Num multiprocessors: 28
2017-07-07 02:09:08: 0: STDOUT: [Redshift] PCI busID: 4, deviceID: 0, domainID: 0
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Theoretical memory bandwidth: 484.440002 GB/Sec
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned CPU->GPU): 10.899158 GB/s
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned GPU->CPU): 11.781950 GB/s
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged CPU->GPU): 7.160657 GB/s
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged GPU->CPU): 4.919054 GB/s
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (0): 0.008025 ms
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (1): 0.007142 ms
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (2): 0.007153 ms
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (3): 0.007137 ms
2017-07-07 02:09:08: 0: STDOUT: [Redshift] New CUDA context created
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Available memory: 11011.4375 MB out of 11172.3750 MB
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Initializing GPUComputing module (CUDA). Ordinal 1
2017-07-07 02:09:08: 0: STDOUT: [Redshift] CUDA Ver: 8000
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Device 2/8 : GeForce GTX 1080 Ti
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Compute capability: 6.1
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Num multiprocessors: 28
2017-07-07 02:09:08: 0: STDOUT: [Redshift] PCI busID: 5, deviceID: 0, domainID: 0
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Theoretical memory bandwidth: 484.440002 GB/Sec
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned CPU->GPU): 10.907075 GB/s
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned GPU->CPU): 12.111660 GB/s
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged CPU->GPU): 7.193542 GB/s
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged GPU->CPU): 4.581645 GB/s
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (0): 0.007732 ms
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (1): 0.007701 ms
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (2): 0.007563 ms
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (3): 0.007557 ms
2017-07-07 02:09:08: 0: STDOUT: [Redshift] New CUDA context created
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Available memory: 10809.5000 MB out of 11172.0000 MB
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Initializing GPUComputing module (CUDA). Ordinal 2
2017-07-07 02:09:08: 0: STDOUT: [Redshift] CUDA Ver: 8000
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Device 3/8 : GeForce GTX 1080 Ti
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Compute capability: 6.1
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Num multiprocessors: 28
2017-07-07 02:09:08: 0: STDOUT: [Redshift] PCI busID: 8, deviceID: 0, domainID: 0
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Theoretical memory bandwidth: 484.440002 GB/Sec
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned CPU->GPU): 10.870672 GB/s
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned GPU->CPU): 12.082432 GB/s
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged CPU->GPU): 6.268368 GB/s
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged GPU->CPU): 4.255551 GB/s
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (0): 0.007891 ms
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (1): 0.007750 ms
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (2): 0.007536 ms
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (3): 0.007336 ms
2017-07-07 02:09:08: 0: STDOUT: [Redshift] New CUDA context created
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Available memory: 11011.4375 MB out of 11172.3750 MB
2017-07-07 02:09:08: 0: STDOUT: [Redshift]Initializing GPUComputing module (CUDA). Ordinal 3
2017-07-07 02:09:08: 0: STDOUT: [Redshift] CUDA Ver: 8000
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Device 4/8 : GeForce GTX 1080 Ti
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Compute capability: 6.1
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Num multiprocessors: 28
2017-07-07 02:09:08: 0: STDOUT: [Redshift] PCI busID: 9, deviceID: 0, domainID: 0
2017-07-07 02:09:08: 0: STDOUT: [Redshift] Theoretical memory bandwidth: 484.440002 GB/Sec
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned CPU->GPU): 10.873931 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned GPU->CPU): 12.072803 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged CPU->GPU): 6.426463 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged GPU->CPU): 4.328166 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (0): 0.007647 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (1): 0.007482 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (2): 0.007289 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (3): 0.007320 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] New CUDA context created
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Available memory: 11011.4375 MB out of 11172.3750 MB
2017-07-07 02:09:09: 0: STDOUT: [Redshift]Initializing GPUComputing module (CUDA). Ordinal 4
2017-07-07 02:09:09: 0: STDOUT: [Redshift] CUDA Ver: 8000
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Device 5/8 : GeForce GTX 1080 Ti
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Compute capability: 6.1
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Num multiprocessors: 28
2017-07-07 02:09:09: 0: STDOUT: [Redshift] PCI busID: 131, deviceID: 0, domainID: 0
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Theoretical memory bandwidth: 484.440002 GB/Sec
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned CPU->GPU): 8.791571 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned GPU->CPU): 7.055298 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged CPU->GPU): 6.230031 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged GPU->CPU): 5.704858 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (0): 0.012051 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (1): 0.011536 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (2): 0.011233 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (3): 0.011025 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] New CUDA context created
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Available memory: 11011.4375 MB out of 11172.3750 MB
2017-07-07 02:09:09: 0: STDOUT: [Redshift]Initializing GPUComputing module (CUDA). Ordinal 5
2017-07-07 02:09:09: 0: STDOUT: [Redshift] CUDA Ver: 8000
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Device 6/8 : GeForce GTX 1080 Ti
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Compute capability: 6.1
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Num multiprocessors: 28
2017-07-07 02:09:09: 0: STDOUT: [Redshift] PCI busID: 132, deviceID: 0, domainID: 0
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Theoretical memory bandwidth: 484.440002 GB/Sec
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned CPU->GPU): 7.771442 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned GPU->CPU): 6.942648 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged CPU->GPU): 6.281703 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged GPU->CPU): 4.197685 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (0): 0.010204 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (1): 0.010084 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (2): 0.010024 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (3): 0.010122 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] New CUDA context created
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Available memory: 11011.4375 MB out of 11172.3750 MB
2017-07-07 02:09:09: 0: STDOUT: [Redshift]Initializing GPUComputing module (CUDA). Ordinal 6
2017-07-07 02:09:09: 0: STDOUT: [Redshift] CUDA Ver: 8000
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Device 7/8 : GeForce GTX 1080 Ti
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Compute capability: 6.1
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Num multiprocessors: 28
2017-07-07 02:09:09: 0: STDOUT: [Redshift] PCI busID: 135, deviceID: 0, domainID: 0
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Theoretical memory bandwidth: 484.440002 GB/Sec
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned CPU->GPU): 10.864012 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned GPU->CPU): 12.083425 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged CPU->GPU): 6.799725 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged GPU->CPU): 4.676415 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (0): 0.007543 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (1): 0.007508 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (2): 0.007563 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (3): 0.007453 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] New CUDA context created
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Available memory: 11011.4375 MB out of 11172.3750 MB
2017-07-07 02:09:09: 0: STDOUT: [Redshift]Initializing GPUComputing module (CUDA). Ordinal 7
2017-07-07 02:09:09: 0: STDOUT: [Redshift] CUDA Ver: 8000
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Device 8/8 : GeForce GTX 1080 Ti
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Compute capability: 6.1
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Num multiprocessors: 28
2017-07-07 02:09:09: 0: STDOUT: [Redshift] PCI busID: 136, deviceID: 0, domainID: 0
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Theoretical memory bandwidth: 484.440002 GB/Sec
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned CPU->GPU): 10.858226 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (pinned GPU->CPU): 12.080326 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged CPU->GPU): 6.414644 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Measured PCIe bandwidth (paged GPU->CPU): 4.686457 GB/s
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (0): 0.007590 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (1): 0.007570 ms
2017-07-07 02:09:09: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (2): 0.007545 ms
2017-07-07 02:09:14: 0: STDOUT: [Redshift] Estimated GPU->CPU latency (3): 0.007525 ms
2017-07-07 02:09:14: 0: STDOUT: [Redshift] New CUDA context created
2017-07-07 02:09:14: 0: STDOUT: [Redshift] Available memory: 11011.4375 MB out of 11172.3750 MB
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Loading Redshift procedural extensions...
2017-07-07 02:09:14: 0: STDOUT: [Redshift] Done!
2017-07-07 02:09:14: 0: STDOUT: [Redshift]RS render object initialized successfully
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Loading RS rendering options
2017-07-07 02:09:14: 0: STDOUT: [Redshift]ROP node 'Redshift_ROP1' rendering frame 44 (time: 1.791667)
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Loading the RS scene
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Loading the camera data
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Loading the scene OBJ mesh nodes data
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Processing the objects to be extracted list
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Building the additional objects extraction list from the instancer objects
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Disabled objects to be extracted and used as base instance objects: 0
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Processing the objects to be extracted list
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Initializing the AOVs system
2017-07-07 02:09:14: 0: STDOUT: [Redshift]AOVs initialized sucessfully
2017-07-07 02:09:14: 0: STDOUT: [Redshift]=================================================================================================
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Rendering frame...
2017-07-07 02:09:14: 0: STDOUT: [Redshift]=================================================================================================
2017-07-07 02:09:14: 0: STDOUT: [Redshift]License acquired
2017-07-07 02:09:14: 0: STDOUT: [Redshift]License for redshift-core 2017.08 (permanent)
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Rendering time: 0.7s (8 GPU(s) used)
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Processing the AOVs list and writting files
2017-07-07 02:09:14: 0: STDOUT: [Redshift]AOVs list processed sucessfully
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Frame rendering done
2017-07-07 02:09:14: 0: STDOUT: [Redshift]ROP node 'Redshift_ROP1' scene extraction time 1.00 sec, render time 1.00 sec, total time 2.00 sec
2017-07-07 02:09:14: 0: STDOUT: [Redshift]ROP node endRender
2017-07-07 02:09:14: 0: STDOUT: [Redshift]Closing the RS scene
2017-07-07 02:09:17: 0: STDOUT: terminate called after throwing an instance of 'char*'
2017-07-07 02:09:17: 0: STDOUT: Finished Rendering
2017-07-07 02:09:17: 0: STDOUT: [Redshift]Closing the RS instance. End of the plugin log system.
2017-07-07 02:09:17: 0: STDOUT: [Redshift]License returned
2017-07-07 02:09:21: 0: INFO: Process exit code: 134
2017-07-07 02:09:21: 0: Done executing plugin command of type 'Render Task'

=======================================================
Details
=======================================================
Date: 07/06/2017 18:09:15
Frames: 1
Elapsed Time: 00:00:00:27
Job Submit Date: 07/06/2017 18:08:46
Job User: yhj4477
Average RAM Usage: 5824573125 (5%)
Peak RAM Usage: 7494488064 (6%)
Average CPU Usage: 3%
Peak CPU Usage: 4%
Used CPU Clocks (x10^6 cycles): 39763
Total CPU Clocks (x10^6 cycles): 1325412

=======================================================
Slave Information
=======================================================
Slave Name: gpu0004
Version: v9.0.5.0 Release (d7db21feb)
Operating System: CentOS Linux release 7.3.1611 (Core)
Machine User: sunhyoungfx
IP Address: 10.10.53.204
MAC Address: D0:50:99:C2:1A:FB
CPU Architecture: x86_64
CPUs: 48
CPU Usage: 3%
Memory Usage: 5.3 GB / 125.6 GB (4%)
Free Disk Space: 126.347 GB
Video Card: NVIDIA Corporation Device 1b06 (rev a1)



---------------------------------------------------------------------------------------------
Last edited by eamsler on Mon Jul 10, 2017 9:17 am, edited 1 time in total.
Reason: Changed title for easy solution finding

eamsler
Posts: 1827
Joined: Thu Dec 16, 2010 1:02 pm
Location: Winnipeg, MB, Canada

Re: Houdini-Redshift and Deadline issue

Postby eamsler » Mon Jul 10, 2017 9:16 am

It looks like Houdini is breaking spec here returning something other than zero is supposed to mean an error occurred, but I can't see one here at all.

There are really two workarounds here:
1) Wrap Houdini in a script or batch file to mask the exit code
2) Change the Houdini plugin to ignore that specific exit code

I'm more a fan of option #2, so we'll do that.

There is actually an example in the Houdini documentation for suppressing exit codes:
https://docs.thinkboxsoftware.com/produ ... d-meanings

Because both Houdini and After Effects are what we call a simple plugin, this should work just fine. Just use "134" for the number instead. For those curious about the plugin types, check here:
https://docs.thinkboxsoftware.com/produ ... nformation
Edwin Amsler
Head of Support
Thinkbox Software Inc
+1-866-419-0283 ext 804

Winnipeg

yjh4477
Posts: 2
Joined: Thu Jul 06, 2017 9:23 am

Re: Houdini-Redshift exit code 134 workaround

Postby yjh4477 » Tue Jul 11, 2017 12:28 am

Thanks for the answer !
I've modified the file and it completed successfully. Thanks!

eamsler
Posts: 1827
Joined: Thu Dec 16, 2010 1:02 pm
Location: Winnipeg, MB, Canada

Re: Houdini-Redshift exit code 134 workaround

Postby eamsler » Tue Jul 11, 2017 9:42 am

Welcome!
Edwin Amsler
Head of Support
Thinkbox Software Inc
+1-866-419-0283 ext 804

Winnipeg

oesponda
Posts: 3
Joined: Tue Aug 01, 2017 9:28 am

Re: Houdini-Redshift exit code 134 workaround

Postby oesponda » Tue Aug 01, 2017 3:32 pm

Hello,

I'm getting the same error:

Code: Select all

=======================================================
Error
=======================================================
Error: Renderer returned non-zero error code, 134. Check the log for more information.
  at Deadline.Plugins.PluginWrapper.RenderTasks (System.String taskId, System.Int32 startFrame, System.Int32 endFrame, System.String& outMessage, FranticX.Processes.ManagedProcess+AbortLevel& abortLevel) [0x002bc] in <443225edf4784f87b6282dd23c7b02ae>:0


I tried adding the following lines to /opt/Thinkbox/DeadlineRepository9/plugins/Houdini/Houdini.py inside the HoudiniPlugin class

Code: Select all

def CheckExitCode( self, exitCode ):
    if exitCode != 0:
        if exitCode == 134:
            LogInfo( "Ignoring exit code 134" )
        else:
            FailRender( "Renderer returned non-zero error code %d." % exitCode )


But unfortunately it doesn't help, the frames still fail, and although some of the frames were rendered correctly, now the failed frames produce just a 0 KB file instead of the expected exr files.

Please bear with me as I'm by no means a TD and my coding skills are rather limited. So I would greatly appreciate if you could help me with this as now I'm forced to render from within the interface and that's no good...

Deadline 9.0.6.1
Fedora 25
Houdini Core 16.0.671
Redshift 2.5.22


Thanks in advance,
Orlando.

oesponda
Posts: 3
Joined: Tue Aug 01, 2017 9:28 am

Re: Houdini-Redshift exit code 134 workaround

Postby oesponda » Tue Aug 01, 2017 5:06 pm

Here's the full log (had to edit the hip and rop names because of NDA):

Code: Select all

=======================================================
Error
=======================================================
Error: Renderer returned non-zero error code, 134. Check the log for more information.
  at Deadline.Plugins.PluginWrapper.RenderTasks (System.String taskId, System.Int32 startFrame, System.Int32 endFrame, System.String& outMessage, FranticX.Processes.ManagedProcess+AbortLevel& abortLevel) [0x002bc] in <443225edf4784f87b6282dd23c7b02ae>:0

=======================================================
Type
=======================================================
RenderPluginException

=======================================================
Stack Trace
=======================================================
  at Deadline.Plugins.SandboxedPlugin.a (Deadline.Net.DeadlineMessage A_0) [0x0021c] in <443225edf4784f87b6282dd23c7b02ae>:0
  at Deadline.Plugins.SandboxedPlugin.RenderTask (System.String taskId, System.Int32 startFrame, System.Int32 endFrame) [0x000b5] in <443225edf4784f87b6282dd23c7b02ae>:0
  at Deadline.Slaves.SlaveRenderThread.a (Deadline.IO.TaskLogWriter A_0) [0x00734] in <443225edf4784f87b6282dd23c7b02ae>:0

=======================================================
Log
=======================================================
2017-08-01 16:24:26:  0: Loading Job's Plugin timeout is Disabled
2017-08-01 16:24:27:  0: Executing plugin command of type 'Sync Files for Job'
2017-08-01 16:24:27:  0: All job files are already synchronized
2017-08-01 16:24:27:  0: Synchronizing Plugin Houdini from /opt/Thinkbox/DeadlineRepository9/plugins/Houdini took: 0 seconds
2017-08-01 16:24:27:  0: Done executing plugin command of type 'Sync Files for Job'
2017-08-01 16:24:27:  0: Executing plugin command of type 'Initialize Plugin'
2017-08-01 16:24:28:  0: INFO: Executing plugin script '/tmp/Thinkbox/Deadline9/oesponda/slave/brain/plugins/597fa7c78b373748a28ca870/Houdini.py'
2017-08-01 16:24:28:  0: INFO: About: Houdini Plugin for Deadline
2017-08-01 16:24:28:  0: INFO: Render Job As User disabled, running as current user 'oesponda'
2017-08-01 16:24:28:  0: INFO: The job's environment will be merged with the current environment before rendering
2017-08-01 16:24:28:  0: Done executing plugin command of type 'Initialize Plugin'
2017-08-01 16:24:28:  0: Start Job timeout is disabled.
2017-08-01 16:24:28:  0: Task timeout is disabled.
2017-08-01 16:24:28:  0: Loaded job: *some hip*.hip - *some rop* (597fa7c78b373748a28ca870)
2017-08-01 16:24:28:  0: Executing plugin command of type 'Start Job'
2017-08-01 16:24:28:  0: Done executing plugin command of type 'Start Job'
2017-08-01 16:24:28:  0: Plugin rendering frame(s): 1001
2017-08-01 16:24:28:  0: Executing plugin command of type 'Render Task'
2017-08-01 16:24:28:  0: INFO: Starting Houdini Job
2017-08-01 16:24:28:  0: INFO: Stdout Redirection Enabled: True
2017-08-01 16:24:28:  0: INFO: Asynchronous Stdout Enabled: False
2017-08-01 16:24:28:  0: INFO: Stdout Handling Enabled: True
2017-08-01 16:24:28:  0: INFO: Popup Handling Enabled: True
2017-08-01 16:24:28:  0: INFO: QT Popup Handling Enabled: False
2017-08-01 16:24:28:  0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2017-08-01 16:24:28:  0: INFO: Using Process Tree: True
2017-08-01 16:24:28:  0: INFO: Hiding DOS Window: True
2017-08-01 16:24:28:  0: INFO: Creating New Console: False
2017-08-01 16:24:28:  0: INFO: Running as user: oesponda
2017-08-01 16:24:28:  0: INFO: Executable: "/opt/hfs16.0.671/bin/hython"
2017-08-01 16:24:28:  0: INFO: Argument: "/tmp/Thinkbox/Deadline9/oesponda/slave/brain/plugins/597fa7c78b373748a28ca870/hrender_dl.py" -f 1001 1001 1 -d *some rop* "*some hip*.hip"
2017-08-01 16:24:28:  0: INFO: Full Command: "/opt/hfs16.0.671/bin/hython" "/tmp/Thinkbox/Deadline9/oesponda/slave/brain/plugins/597fa7c78b373748a28ca870/hrender_dl.py" -f 1001 1001 1 -d *some rop* "*some hip*.hip"
2017-08-01 16:24:28:  0: INFO: Startup Directory: "/opt/hfs16.0.671/bin"
2017-08-01 16:24:28:  0: INFO: Process Priority: BelowNormal
2017-08-01 16:24:28:  0: INFO: Process Affinity: default
2017-08-01 16:24:28:  0: INFO: Process is now running
2017-08-01 16:24:30:  0: STDOUT: [Redshift]Redshift for Houdini plugin version 2.5.22
2017-08-01 16:24:30:  0: STDOUT: [Redshift]Plugin compile time HDK version: 16.0.633
2017-08-01 16:24:30:  0: STDOUT: [Redshift]Houdini host version: 16.0.671
2017-08-01 16:24:30:  0: STDOUT: [Redshift]Plugin dso/dll and config path: /usr/redshift/redshift4houdini/16.0.633/dso
2017-08-01 16:24:30:  0: STDOUT: [Redshift]Core data path: /usr/redshift
2017-08-01 16:24:30:  0: STDOUT: [Redshift]Local data path: /home/oesponda/redshift
2017-08-01 16:24:30:  0: STDOUT: [Redshift]Procedurals path: /usr/redshift/procedurals
2017-08-01 16:24:30:  0: STDOUT: [Redshift]Preferences file path: /home/oesponda/redshift/preferences.xml
2017-08-01 16:24:30:  0: STDOUT: [Redshift]License path: /home/oesponda/redshift
2017-08-01 16:24:30:  0: STDOUT: Detected Houdini version: (16, 0, 671)
2017-08-01 16:24:30:  0: STDOUT: ['/tmp/Thinkbox/Deadline9/oesponda/slave/brain/plugins/597fa7c78b373748a28ca870/hrender_dl.py', '-f', '1001', '1001', '1', '-d', '*some rop*', '*some hip*.hip']
2017-08-01 16:24:30:  0: STDOUT: Start: 1001
2017-08-01 16:24:30:  0: STDOUT: End: 1001
2017-08-01 16:24:30:  0: STDOUT: Increment: 1
2017-08-01 16:24:30:  0: STDOUT: Ignore Inputs: False
2017-08-01 16:24:30:  0: STDOUT: No output specified. Output will be handled by the driver
2017-08-01 16:24:30:  0: STDOUT: Driver: *some rop*
2017-08-01 16:24:30:  0: STDOUT: Input File: *some hip*.hip
2017-08-01 16:25:07:  0: STDOUT: ROP type: Redshift_ROP
2017-08-01 16:25:07:  0: STDOUT: Rendering frame 1001
2017-08-01 16:25:11:  0: STDOUT: [Redshift]ROP node '*some rop name*' render started for 1 frames. Time from 41.666667 to 41.666667
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Houdini/FX license found, no render restrictions
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Closing the RS scene
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Initializing the render session
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Textures cache size (MB): 32768
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Textures cache path: ~/redshift/cache
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Devices enabled: 0:GeForce GTX 1070,1:GeForce GTX 1070,2:GeForce GTX 1070,
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Shading package: Houdini
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Redshift Initialized
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Linux Platform
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Release Build
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Number of CPU HW threads: 12
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   CPU speed: 3.33 GHz
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Total system memory: 23.54 GB
2017-08-01 16:25:11:  0: STDOUT: [Redshift]License acquired
2017-08-01 16:25:11:  0: STDOUT: [Redshift]License returned
2017-08-01 16:25:11:  0: STDOUT: [Redshift]License for redshift-core 2018.07 (permanent)
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Creating CUDA contexts
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   CUDA init ok
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Ordinals: { 0 1 2 }
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Initializing GPUComputing module (CUDA). Ordinal 0
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   CUDA Ver: 8000
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Device 1/3 : GeForce GTX 1070
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Compute capability: 6.1
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Num multiprocessors: 15
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   PCI busID: 3, deviceID: 0, domainID: 0
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Theoretical memory bandwidth: 256.256012 GB/Sec
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Measured PCIe bandwidth (pinned CPU->GPU): 2.914519 GB/s
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Measured PCIe bandwidth (pinned GPU->CPU): 3.106168 GB/s
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Measured PCIe bandwidth (paged CPU->GPU): 2.858558 GB/s
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Measured PCIe bandwidth (paged GPU->CPU): 2.861643 GB/s
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Estimated GPU->CPU latency (0): 0.006746 ms
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Estimated GPU->CPU latency (1): 0.006545 ms
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Estimated GPU->CPU latency (2): 0.006686 ms
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Estimated GPU->CPU latency (3): 0.006667 ms
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   New CUDA context created
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Available memory: 6425.7500 MB out of 8113.6250 MB
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Initializing GPUComputing module (CUDA). Ordinal 1
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   CUDA Ver: 8000
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Device 2/3 : GeForce GTX 1070
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Compute capability: 6.1
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Num multiprocessors: 15
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   PCI busID: 4, deviceID: 0, domainID: 0
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Theoretical memory bandwidth: 256.256012 GB/Sec
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Measured PCIe bandwidth (pinned CPU->GPU): 2.950051 GB/s
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Measured PCIe bandwidth (pinned GPU->CPU): 3.108012 GB/s
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Measured PCIe bandwidth (paged CPU->GPU): 2.897176 GB/s
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Measured PCIe bandwidth (paged GPU->CPU): 2.851731 GB/s
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Estimated GPU->CPU latency (0): 0.006609 ms
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Estimated GPU->CPU latency (1): 0.006619 ms
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Estimated GPU->CPU latency (2): 0.006593 ms
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Estimated GPU->CPU latency (3): 0.006528 ms
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   New CUDA context created
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Available memory: 7600.0000 MB out of 8114.0000 MB
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Initializing GPUComputing module (CUDA). Ordinal 2
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   CUDA Ver: 8000
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Device 3/3 : GeForce GTX 1070
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Compute capability: 6.1
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Num multiprocessors: 15
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   PCI busID: 5, deviceID: 0, domainID: 0
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Theoretical memory bandwidth: 256.256012 GB/Sec
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Measured PCIe bandwidth (pinned CPU->GPU): 5.553750 GB/s
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Measured PCIe bandwidth (pinned GPU->CPU): 6.196596 GB/s
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Measured PCIe bandwidth (paged CPU->GPU): 5.332586 GB/s
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Measured PCIe bandwidth (paged GPU->CPU): 4.624020 GB/s
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Estimated GPU->CPU latency (0): 0.006656 ms
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Estimated GPU->CPU latency (1): 0.006570 ms
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Estimated GPU->CPU latency (2): 0.006595 ms
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Estimated GPU->CPU latency (3): 0.006590 ms
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   New CUDA context created
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Available memory: 7600.0000 MB out of 8114.0000 MB
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Loading Redshift procedural extensions...
2017-08-01 16:25:11:  0: STDOUT: [Redshift]   Done!
2017-08-01 16:25:11:  0: STDOUT: [Redshift]RS render object initialized successfully
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Loading RS rendering options
2017-08-01 16:25:11:  0: STDOUT: [Redshift]ROP node '*some rop name*' rendering frame 1008 (time: 41.958333)
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Loading the RS scene
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Loading the camera data
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Loading the scene OBJ mesh nodes data
2017-08-01 16:25:11:  0: STDOUT: [Redshift]Processing the objects to be extracted list
2017-08-01 16:25:13:  0: STDOUT: [Redshift]Building the additional objects extraction list from the instancer objects
2017-08-01 16:25:13:  0: STDOUT: [Redshift]Disabled objects to be extracted and used as base instance objects: 0
2017-08-01 16:25:13:  0: STDOUT: [Redshift]Processing the objects to be extracted list
2017-08-01 16:25:13:  0: STDOUT: [Redshift]Initializing the AOVs system
2017-08-01 16:25:13:  0: STDOUT: [Redshift]AOVs initialized sucessfully
2017-08-01 16:25:13:  0: STDOUT: [Redshift]=================================================================================================
2017-08-01 16:25:13:  0: STDOUT: [Redshift]Rendering frame...
2017-08-01 16:25:13:  0: STDOUT: [Redshift]=================================================================================================
2017-08-01 16:25:13:  0: STDOUT: [Redshift]License acquired
2017-08-01 16:25:13:  0: STDOUT: [Redshift]License for redshift-core 2018.07 (permanent)
2017-08-01 16:25:13:  0: STDOUT: [Redshift]Failed to find volume file . Volume will be empty
2017-08-01 16:25:13:  0: STDOUT: [Redshift]Rendering time: 1.5s (3 GPU(s) used)
2017-08-01 16:25:13:  0: STDOUT: [Redshift]Processing the AOVs list and writting files
2017-08-01 16:25:13:  0: STDOUT: [Redshift]AOVs list processed sucessfully
2017-08-01 16:25:13:  0: STDOUT: [Redshift]Frame rendering done
2017-08-01 16:25:13:  0: STDOUT: [Redshift]ROP node '*some rop name*' scene extraction time 1.00 sec, render time 2.00 sec, total time 3.00 sec
2017-08-01 16:25:13:  0: STDOUT: [Redshift]ROP node endRender
2017-08-01 16:25:13:  0: STDOUT: [Redshift]Closing the RS scene
2017-08-01 16:25:14:  0: STDOUT: terminate called after throwing an instance of 'char*'
2017-08-01 16:25:14:  0: STDOUT: Finished Rendering
2017-08-01 16:25:14:  0: STDOUT: [Redshift]Closing the RS instance. End of the plugin log system.
2017-08-01 16:25:14:  0: STDOUT: [Redshift]License returned
2017-08-01 16:25:31:  0: INFO: Process exit code: 134
2017-08-01 16:25:31:  0: Done executing plugin command of type 'Render Task'

=======================================================
Details
=======================================================
Date: 08/01/2017 16:25:33
Frames: 1001
Elapsed Time: 00:00:01:07
Job Submit Date: 07/31/2017 16:57:27
Job User: oesponda
Average RAM Usage: 13480992378 (54%)
Peak RAM Usage: 14827315200 (59%)
Average CPU Usage: 14%
Peak CPU Usage: 24%
Used CPU Clocks (x10^6 cycles): 355261
Total CPU Clocks (x10^6 cycles): 2537578

=======================================================
Slave Information
=======================================================
Slave Name: brain
Version: v9.0.6.1 Release (96b611826)
Operating System: Fedora release 25 (Twenty Five)
Machine User: oesponda
IP Address: 192.168.0.110
MAC Address: 48:5B:39:5D:F6:85
CPU Architecture: x86_64
CPUs: 12
CPU Usage: 21%
Memory Usage: 13.6 GB / 23.5 GB (57%)
Free Disk Space: 8.793 GB
Video Card: NVIDIA Corporation GP104 [GeForce GTX 1070] (rev a1)




Some of the frames have huge volumes and thought it might be a memory issue, but this particular frame is using an empty volume and still fails. So nothing to do with memory apparently.

User avatar
MikeOwen
Posts: 3514
Joined: Thu Jul 19, 2007 5:00 am
Location: London, UK
Contact:

Re: Houdini-Redshift exit code 134 workaround

Postby MikeOwen » Wed Aug 02, 2017 8:28 am

I see a number of possibly relevant bug fixes in Redshift builds 2.5.23 and 2.5.24. Can you try updating? If Houdini is crashing out after it returns its Redshift license, it sounds like something you should report to the Redshift dev team. ie: Does Houdini crash out at exit if you don't use Redshift? If not, then again, this would be a stronger indicator that this is something that should be put on the radar of the Redshift dev team.
Mike Owen
Solutions Architect
Thinkbox / AWS


Return to “Thinkbox Software - Deadline”

Who is online

Users browsing this forum: No registered users and 1 guest