Hi all,
Since couple of days we’ve faced some issue when we try to render in our farm
This is most of common log we get after crash:
=======================================================
Error
=======================================================
Error: Error: Renderer returned non-zero error code, 139. Check the log for more information.
at Deadline.Plugins.ScriptPlugin.RenderTasks (System.String taskId, Int32 startFrame, Int32 endFrame, System.String& outMessage, FranticX.Processes.AbortLevel& abortLevel) [0x00000] in <filename unknown>:0
=======================================================
Type
=======================================================
RenderPluginException
=======================================================
Stack Trace
=======================================================
at Deadline.Plugins.Plugin.RenderTask (System.String taskId, Int32 startFrame, Int32 endFrame) [0x00000] in <filename unknown>:0
at Deadline.Slaves.SlaveRenderThread.RenderCurrentTask (Deadline.IO.TaskLogWriter tlw) [0x00000] in <filename unknown>:0
=======================================================
Log
=======================================================
2019-06-13 13:15:17: BEGIN - mk27\marco
2019-06-13 13:15:17: 0: Start Job timeout is disabled.
2019-06-13 13:15:17: 0: Task timeout is disabled.
2019-06-13 13:15:17: 0: Loaded job: BH_Shot02 (5d0176972dd4ad182411ed61)
2019-06-13 13:15:17: 0: INFO: Executing plugin script /tmp/Thinkbox/Deadline7/slave/mk27/plugins/5d0176972dd4ad182411ed61/Nuke.py
2019-06-13 13:15:17: 0: INFO: About: Nuke Plugin for Deadline
2019-06-13 13:15:17: 0: INFO: The job’s environment will be merged with the current environment before rendering
2019-06-13 13:15:17: 0: INFO: Scrubbing the LD and DYLD LIBRARY paths
2019-06-13 13:15:17: 0: INFO: Prepping OFX cache
2019-06-13 13:15:17: 0: INFO: Checking Nuke temp path: /var/tmp/nuke-u1000
2019-06-13 13:15:17: 0: INFO: Path already exists
2019-06-13 13:15:17: 0: INFO: OFX cache prepped
2019-06-13 13:15:17: 0: Plugin rendering frame(s): 73-74
2019-06-13 13:15:27: 0: INFO: Stdout Redirection Enabled: True
2019-06-13 13:15:27: 0: INFO: Asynchronous Stdout Enabled: True
2019-06-13 13:15:27: 0: INFO: Stdout Handling Enabled: True
2019-06-13 13:15:27: 0: INFO: Popup Handling Enabled: True
2019-06-13 13:15:27: 0: INFO: QT Popup Handling Enabled: False
2019-06-13 13:15:27: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2019-06-13 13:15:27: 0: INFO: Using Process Tree: True
2019-06-13 13:15:27: 0: INFO: Hiding DOS Window: True
2019-06-13 13:15:27: 0: INFO: Creating New Console: False
2019-06-13 13:15:27: 0: INFO: Running as user: marco
2019-06-13 13:15:27: 0: INFO: Executable: "/usr/local/Nuke9.0v8/Nuke9.0"
2019-06-13 13:15:27: 0: INFO: Argument: -V 2 -x -F 73-74 "/tmp/Thinkbox/Deadline7/slave/mk27/jobsData/5d0176972dd4ad182411ed61/thread0_tempttHZJ0/Bh_teaser_shot02_comp_v024_STB_MK_Lin2.nk"
2019-06-13 13:15:27: 0: INFO: Startup Directory: "/usr/local/Nuke9.0v8"
2019-06-13 13:15:27: 0: INFO: Process Priority: BelowNormal
2019-06-13 13:15:27: 0: INFO: Process Affinity: default
2019-06-13 13:15:27: 0: INFO: Process is now running
2019-06-13 13:15:28: 0: STDOUT: Nuke 9.0v8, 64 bit, built Oct 26 2015.
2019-06-13 13:15:28: 0: STDOUT: Copyright © 2015 The Foundry Visionmongers Ltd. All Rights Reserved.
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/_pathsetup.py
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/init.tcl
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/init.py
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/setenv.tcl
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/formats.tcl
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/getenv.tcl
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/movReader.tcl
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/mov64Reader.so
2019-06-13 13:15:28: 0: STDOUT: [13:15.28] Warning: Read2.decoder: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read2.mov32: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read2.mov32_codec: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read2.{0}: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read2.mov32_pixel_format: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read2.{0}: no such knob
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Grade.so
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/ColorCorrect.so
2019-06-13 13:15:28: 0: STDOUT: [13:15.28] Warning: Read3.decoder: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read3.mov32: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read3.mov32_codec: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read3.{0}: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read3.mov32_pixel_format: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read3.{0}: no such knob
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/GridWarp3.so
2019-06-13 13:15:28: 0: STDOUT: [13:15.28] Warning: Read1.decoder: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read1.mov32: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read1.mov32_codec: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read1.{0}: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read1.mov32_pixel_format: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read1.{0}: no such knob
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Merge2.so
2019-06-13 13:15:28: 0: STDOUT: [13:15.28] Warning: Read4.decoder: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read4.mov32: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read4.mov32_codec: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read4.{0}: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read4.mov32_pixel_format: no such knob
2019-06-13 13:15:28: 0: STDOUT: Read4.{0}: no such knob
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Tracker3.so
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/CornerPin2D.so
2019-06-13 13:15:28: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Tracker4.so
2019-06-13 13:15:29: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Dilate.so
2019-06-13 13:15:29: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/SphericalTransform.so
2019-06-13 13:15:29: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Copy.so
2019-06-13 13:15:29: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Premult.so
2019-06-13 13:15:29: 0: STDOUT: [13:15.28] Warning: Read5.decoder: no such knob
2019-06-13 13:15:29: 0: STDOUT: Read5.mov32: no such knob
2019-06-13 13:15:29: 0: STDOUT: Read5.mov32_codec: no such knob
2019-06-13 13:15:29: 0: STDOUT: Read5.{0}: no such knob
2019-06-13 13:15:29: 0: STDOUT: Read5.mov32_pixel_format: no such knob
2019-06-13 13:15:29: 0: STDOUT: Read5.{0}: no such knob
2019-06-13 13:15:29: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/pngReader.so
2019-06-13 13:15:29: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/jpegReader.so
2019-06-13 13:15:29: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Reformat.so
2019-06-13 13:15:29: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Transform.so
2019-06-13 13:15:29: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/HueShift.so
2019-06-13 13:15:29: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/EdgeBlur.so
2019-06-13 13:15:30: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Crop.so
2019-06-13 13:15:30: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Invert.so
2019-06-13 13:15:30: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/FilterErode.so
2019-06-13 13:15:30: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Clamp.so
2019-06-13 13:15:30: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/ChannelMerge.so
2019-06-13 13:15:30: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Remove.so
2019-06-13 13:15:30: 0: STDOUT: [13:15.30] Warning: Read6.decoder: no such knob
2019-06-13 13:15:30: 0: STDOUT: Read6.mov32: no such knob
2019-06-13 13:15:30: 0: STDOUT: Read6.mov32_codec: no such knob
2019-06-13 13:15:30: 0: STDOUT: Read6.{0}: no such knob
2019-06-13 13:15:30: 0: STDOUT: Read6.mov32_pixel_format: no such knob
2019-06-13 13:15:30: 0: STDOUT: Read6.{0}: no such knob
2019-06-13 13:15:31: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Colorspace.so
2019-06-13 13:15:31: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/Saturation.so
2019-06-13 13:15:31: 0: STDOUT: [13:15.31] Warning: Read13.decoder: no such knob
2019-06-13 13:15:31: 0: STDOUT: Read13.mov32: no such knob
2019-06-13 13:15:31: 0: STDOUT: Read13.mov32_codec: no such knob
2019-06-13 13:15:31: 0: STDOUT: Read13.{0}: no such knob
2019-06-13 13:15:31: 0: STDOUT: Read13.mov32_pixel_format: no such knob
2019-06-13 13:15:31: 0: STDOUT: Read13.{0}: no such knob
2019-06-13 13:15:31: 0: STDOUT: Loading /usr/local/Nuke9.0v8/plugins/pngWriter.so
2019-06-13 13:16:07: 0: STDOUT: [13:15:31 EDT] Read nuke script: /tmp/Thinkbox/Deadline7/slave/mk27/jobsData/5d0176972dd4ad182411ed61/thread0_tempttHZJ0/Bh_teaser_shot02_comp_v024_STB_MK_Lin2.nk
2019-06-13 13:16:11: 0: STDOUT: Writing /prod/nomad-new/Renders/Destination/Black_Hawks_Teaser/Composite/Shot_02/v024/BH_Teaser_Shot02_v024_000073.png
2019-06-13 13:16:12: 0: STDOUT: RotoPaint10 .9
2019-06-13 13:16:17: 0: STDOUT: RotoPaint11 .8
2019-06-13 13:16:18: 0: STDOUT: RotoPaint6
2019-06-13 13:16:18: 0: STDOUT: RotoPaint7
2019-06-13 13:16:18: 0: STDOUT: RotoPaint16 .9
2019-06-13 13:16:19: 0: STDOUT: RotoPaint9
2019-06-13 13:16:25: 0: STDOUT: RotoPaint12 .6.9
2019-06-13 13:16:55: 0: STDOUT: RotoPaint20 .8.1.2.3.4.5.6
2019-06-13 13:17:05: 0: STDOUT: RotoPaint8 .5.6
2019-06-13 13:17:05: 0: STDOUT: RotoPaint6
2019-06-13 13:17:05: 0: STDOUT: RotoPaint7 .8
2019-06-13 13:17:05: 0: STDOUT: RotoPaint16
2019-06-13 13:17:06: 0: STDOUT: RotoPaint9 .9
2019-06-13 13:17:15: 0: STDOUT: RotoPaint12 .9
2019-06-13 13:17:23: 0: STDOUT: RotoPaint8 .5
2019-06-13 13:17:36: 0: STDOUT: RotoPaint18 .3.9.6.7.8.9
2019-06-13 13:17:36: 0: STDOUT: Writing /prod/nomad-new/Renders/Destination/Black_Hawks_Teaser/Composite/Shot_02/v024/BH_Teaser_Shot02_v024_000073.png took 88.47 seconds
2019-06-13 13:17:36: 0: STDOUT: Frame 73 (1 of 2)
2019-06-13 13:17:39: 0: STDOUT: Writing /prod/nomad-new/Renders/Destination/Black_Hawks_Teaser/Composite/Shot_02/v024/BH_Teaser_Shot02_v024_000074.png
2019-06-13 13:17:40: 0: INFO: Process exit code: 139
=======================================================
Details
=======================================================
Date: 06/13/2019 13:17:41
Frames: 73-74
Elapsed Time: 00:00:02:28
Job Submit Date: 06/12/2019 18:02:54
Job User: marco
Average RAM Usage: 7222420564 (22%)
Peak RAM Usage: 18911399936 (57%)
Average CPU Usage: 42%
Peak CPU Usage: 100%
Used CPU Clocks: 3287532
Total CPU Clocks: 7827457
=======================================================
Slave Information
=======================================================
Slave Name: mk27
Version: v7.2.5.5 R (e00a18ff5)
Operating System: Ubuntu 18.04.2 LTS
Machine User: marco
IP Address: 172.18.60.176
MAC Address: FF:FF:FF:FF:FF:FF
CPU Architecture: x86_64
CPUs: 12
CPU Usage: 8%
Any ideas,
Thanks