AWS Thinkbox Discussion Forums

One step forward 10 steps back

Hi,

I am in a mixed environment of Linux RH6.2 and Windows 7. I have Maya 2015 SP3 and vray 3.0 installed on all machines. I submit from the windows 7 workstation through Maya 2015 sp3 a vray render to our 11 node render farm running red hat 6.2. The renders are currently failing on each node with the same messages. Can you please look at the log file and let me know if you have encountered these errors before?

=======================================================
Error

Error: Monitored managed process “MayaBatch” has exited or been terminated.
at Deadline.Plugins.ScriptPlugin.RenderTasks (System.String taskId, Int32 startFrame, Int32 endFrame, System.String& outMessage, FranticX.Processes.AbortLevel& abortLevel) [0x00000] in :0

=======================================================
Type

RenderPluginException

=======================================================
Stack Trace

at Deadline.Plugins.Plugin.RenderTask (System.String taskId, Int32 startFrame, Int32 endFrame) [0x00000] in :0
at Deadline.Slaves.SlaveRenderThread.a (Deadline.IO.TaskLogWriter A_0) [0x00000] in :0

=======================================================
Log

2015-05-05 17:15:33: BEGIN - node02\root
2015-05-05 17:15:33: 0: Start Job timeout is disabled.
2015-05-05 17:15:33: 0: Task timeout is disabled.
2015-05-05 17:15:33: 0: Loaded job: qx30_q30_lighting_final_v002 - persp1 (5548ea39ad9c451e8cd0274b)
2015-05-05 17:15:33: 0: INFO: Executing plugin script /root/Thinkbox/Deadline7/slave/node02/plugins/5548ea39ad9c451e8cd0274b/MayaBatch.py
2015-05-05 17:15:33: 0: INFO: About: Maya Batch Plugin for Deadline
2015-05-05 17:15:33: 0: INFO: The job’s environment will be merged with the current environment before rendering
2015-05-05 17:15:33: 0: INFO: Rendering with Maya version 2015.0
2015-05-05 17:15:33: 0: INFO: Starting monitored managed process MayaBatch
2015-05-05 17:15:33: 0: INFO: Stdout Handling Enabled: True
2015-05-05 17:15:33: 0: INFO: Popup Handling Enabled: True
2015-05-05 17:15:33: 0: INFO: QT Popup Handling Enabled: False
2015-05-05 17:15:33: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2015-05-05 17:15:33: 0: INFO: Using Process Tree: True
2015-05-05 17:15:33: 0: INFO: Hiding DOS Window: True
2015-05-05 17:15:33: 0: INFO: Creating New Console: False
2015-05-05 17:15:33: 0: INFO: Running as user: root
2015-05-05 17:15:33: 0: INFO: Enforcing 64 bit build of Maya
2015-05-05 17:15:33: 0: INFO: Executable: “/usr/autodesk/maya2015-x64/bin/maya”
2015-05-05 17:15:33: 0: INFO: Argument: -prompt -file “/root/Thinkbox/Deadline7/slave/node02/jobsData/5548ea39ad9c451e8cd0274b/qx30_q30_lighting_final_v002.mb” -proj “//uk-nde-s0008.nissaneu.nmcorp.nissan.biz/Projects/NON-PROJECT-SPECIFIC-DATA_X/INFINITI_GENERAL/QX30_Q30_Showcase
2015-05-05 17:15:33: 0: INFO: Startup Directory: “/usr/autodesk/maya2015-x64/bin”
2015-05-05 17:15:33: 0: INFO: Process Priority: BelowNormal
2015-05-05 17:15:33: 0: INFO: Process Affinity: default
2015-05-05 17:15:33: 0: INFO: Process is now running
2015-05-05 17:15:33: 0: Plugin rendering frame(s): 6
2015-05-05 17:15:37: 0: INFO: Waiting until maya is ready to go
2015-05-05 17:15:39: 0: STDOUT: [2015/May/5|17:15:39] V-Ray: V-Ray for Maya version 3.00.01 from Oct 16 2014, 20:26:25
2015-05-05 17:15:39: 0: STDOUT: [2015/May/5|17:15:39] V-Ray: V-Ray core version is 3.05.07
2015-05-05 17:15:39: 0: STDOUT: Initializing V-Ray for Maya
2015-05-05 17:15:40: 0: STDOUT: [2015/May/5|17:15:40] V-Ray: Registered dynamic node vrayMultiProjection (id: 1115335/0x001104C7)
2015-05-05 17:15:40: 0: STDOUT: [2015/May/5|17:15:40] V-Ray: Registered dynamic node VRayCurvature (id: 201308280/0x0BFFB878)
2015-05-05 17:15:40: 0: STDOUT: [2015/May/5|17:15:40] V-Ray: Registered dynamic node VRaySkinMtl (id: 1115348/0x001104D4)
2015-05-05 17:15:40: 0: STDOUT: [2015/May/5|17:15:40] V-Ray: Registered dynamic node VRayPointParticleMtl (id: 1115353/0x001104D9)
2015-05-05 17:15:40: 0: WARNING: Strict error checking on, ignoring the following unrecognized error or warning. If it is fatal, please email support@thinkboxsoftware.com with the error message.
2015-05-05 17:15:40: 0: STDOUT: Error: line 1: RuntimeError: file line 1: Plug-in, “Mayatomr”, was not found on MAYA_PLUG_IN_PATH.
2015-05-05 17:15:40: 0: WARNING: Strict error checking on, ignoring the following unrecognized error or warning. If it is fatal, please email support@thinkboxsoftware.com with the error message.
2015-05-05 17:15:40: 0: STDOUT: Error: line 1: RuntimeError: file line 1: Plug-in, “RenderMan_for_Maya”, was not found on MAYA_PLUG_IN_PATH.
2015-05-05 17:15:44: 0: WARNING: Strict error checking on, ignoring the following unrecognized error or warning. If it is fatal, please email support@thinkboxsoftware.com with the error message.
2015-05-05 17:15:44: 0: STDOUT: Warning: line 1: Unrecognized node type for node ‘mentalrayItemsList’; preserving node information during this session.
2015-05-05 17:15:44: 0: WARNING: Strict error checking on, ignoring the following unrecognized error or warning. If it is fatal, please email support@thinkboxsoftware.com with the error message.
2015-05-05 17:15:44: 0: STDOUT: Warning: line 1: Unrecognized node type for node ‘mentalrayGlobals’; preserving node information during this session.
2015-05-05 17:15:44: 0: WARNING: Strict error checking on, ignoring the following unrecognized error or warning. If it is fatal, please email support@thinkboxsoftware.com with the error message.
2015-05-05 17:15:44: 0: STDOUT: Warning: line 1: Unrecognized node type for node ‘miDefaultOptions’; preserving node information during this session.
2015-05-05 17:15:44: 0: WARNING: Strict error checking on, ignoring the following unrecognized error or warning. If it is fatal, please email support@thinkboxsoftware.com with the error message.
2015-05-05 17:15:44: 0: STDOUT: Warning: line 1: Unrecognized node type for node ‘miDefaultFramebuffer’; preserving node information during this session.
2015-05-05 17:15:45: 0: STDOUT: Result: externalContentTable
2015-05-05 17:15:45: 0: STDOUT: Result: 1
2015-05-05 17:15:46: 0: WARNING: Strict error checking on, ignoring the following unrecognized error or warning. If it is fatal, please email support@thinkboxsoftware.com with the error message.
2015-05-05 17:15:46: 0: STDOUT: Warning: line 1: Errors have occurred while reading this scene that may result in data loss.
2015-05-05 17:15:46: 0: STDOUT: File read in 8.7 seconds.
2015-05-05 17:15:46: 0: STDOUT: Result: /root/Thinkbox/Deadline7/slave/node02/jobsData/5548ea39ad9c451e8cd0274b/qx30_q30_lighting_final_v002.mb
2015-05-05 17:15:46: 0: STDOUT: READY FOR INPUT
2015-05-05 17:15:46: 0: INFO: Rendering with vray
2015-05-05 17:15:46: 0: INFO: Rendering to network drive
2015-05-05 17:15:46: 0: INFO: Creating melscript to execute
2015-05-05 17:15:46: 0: INFO: Auto memory detection for VRay disabled
2015-05-05 17:15:46: 0: INFO: Executing script: /tmp/tmp5bc9508d.tmp
2015-05-05 17:15:47: 0: INFO: Waiting for script to finish
2015-05-05 17:15:47: 0: WARNING: Strict error checking on, ignoring the following unrecognized error or warning. If it is fatal, please email support@thinkboxsoftware.com with the error message.
2015-05-05 17:15:47: 0: STDOUT: Warning: file: /usr/autodesk/maya2015-x64/scripts/others/makeCameraRenderable.mel line 60: Found camera perspShape1.
2015-05-05 17:15:47: 0: STDOUT: V-Ray: Starting render
2015-05-05 17:15:47: 0: STDOUT: [2015/May/5|17:15:47] V-Ray: Loading plugins from "/usr/ChaosGroup/V-Ray/Maya2015-x64/vrayplugins/libvray_.so"
2015-05-05 17:15:47: 0: STDOUT: [2015/May/5|17:15:47] V-Ray: 139 plugin(s) loaded successfully
2015-05-05 17:15:47: 0: STDOUT: [2015/May/5|17:15:47] V-Ray: Finished loading plugins.
2015-05-05 17:15:47: 0: STDOUT: [2015/May/5|17:15:47] V-Ray: Exporting scene to V-Ray.
2015-05-05 17:15:47: 0: STDOUT: [2015/May/5|17:15:47] V-Ray: Parsing light links time 0h 0m 0.1s (0.1 s)
2015-05-05 17:15:47: 0: STDOUT: MayaAnimatedPlugParam - plug: ‘ramp215.colorEntryList’ is networked - this is a potential problem and it is best to switch the plug to non-networked plug.
2015-05-05 17:15:47: 0: STDOUT: MayaAnimatedPlugParam - plug: ‘ramp216.colorEntryList’ is networked - this is a potential problem and it is best to switch the plug to non-networked plug.
2015-05-05 17:15:47: 0: STDOUT: MayaAnimatedPlugParam - plug: ‘ramp218.colorEntryList’ is networked - this is a potential problem and it is best to switch the plug to non-networked plug.
2015-05-05 17:15:47: 0: STDOUT: MayaAnimatedPlugParam - plug: ‘ramp220.colorEntryList’ is networked - this is a potential problem and it is best to switch the plug to non-networked plug.
2015-05-05 17:15:47: 0: STDOUT: MayaAnimatedPlugParam - plug: ‘ramp222.colorEntryList’ is networked - this is a potential problem and it is best to switch the plug to non-networked plug.
2015-05-05 17:15:47: 0: STDOUT: MayaAnimatedPlugParam - plug: ‘ramp226.colorEntryList’ is networked - this is a potential problem and it is best to switch the plug to non-networked plug.
2015-05-05 17:15:47: 0: STDOUT: [2015/May/5|17:15:47] V-Ray: Translating scene geometry for V-Ray
2015-05-05 17:15:47: 0: STDOUT: [2015/May/5|17:15:47] V-Ray: (Estimated time remaining: 0h 0m 0.4s): 12 % completed
2015-05-05 17:15:47: 0: STDOUT: [2015/May/5|17:15:47] V-Ray: (Estimated time remaining: 0h 0m 1.4s): 20 % completed
2015-05-05 17:15:48: 0: STDOUT: MayaAnimatedPlugParam - plug: ‘ramp191.colorEntryList’ is networked - this is a potential problem and it is best to switch the plug to non-networked plug.
2015-05-05 17:15:48: 0: STDOUT: MayaAnimatedPlugParam - plug: ‘ramp192.colorEntryList’ is networked - this is a potential problem and it is best to switch the plug to non-networked plug.
2015-05-05 17:15:48: 0: STDOUT: [2015/May/5|17:15:48] V-Ray: (Estimated time remaining: 0h 0m 1.9s): 30 % completed
2015-05-05 17:15:49: 0: STDOUT: [2015/May/5|17:15:48] V-Ray: (Estimated time remaining: 0h 0m 2.3s): 41 % completed
2015-05-05 17:15:49: 0: STDOUT: MayaAnimatedPlugParam - plug: ‘q30_data_prep_v014_ramp191.colorEntryList’ is networked - this is a potential problem and it is best to switch the plug to non-networked plug.
2015-05-05 17:15:49: 0: STDOUT: [2015/May/5|17:15:49] V-Ray: (Estimated time remaining: 0h 0m 1.9s): 50 % completed
2015-05-05 17:15:49: 0: STDOUT: [2015/May/5|17:15:49] V-Ray: (Estimated time remaining: 0h 0m 1.5s): 60 % completed
2015-05-05 17:15:50: 0: STDOUT: [2015/May/5|17:15:50] V-Ray: (Estimated time remaining: 0h 0m 1.2s): 70 % completed
2015-05-05 17:15:50: 0: STDOUT: MayaAnimatedPlugParam - plug: ‘q30_data_prep_v014_ramp192.colorEntryList’ is networked - this is a potential problem and it is best to switch the plug to non-networked plug.
2015-05-05 17:15:50: 0: STDOUT: [2015/May/5|17:15:50] V-Ray: (Estimated time remaining: 0h 0m 0.8s): 80 % completed
2015-05-05 17:15:50: 0: STDOUT: [2015/May/5|17:15:50] V-Ray: Total time translating scene for V-Ray 0h 0m 3.5s (3.5 s)
2015-05-05 17:15:50: 0: STDOUT: [2015/May/5|17:15:50] V-Ray: Rendering.
2015-05-05 17:15:50: 0: STDOUT: [2015/May/5|17:15:50] V-Ray: Rendering frames.
2015-05-05 17:15:50: 0: STDOUT: [2015/May/5|17:15:50] V-Ray: Updating frame at time 6.00
2015-05-05 17:15:52: 0: STDOUT: [2015/May/5|17:15:52] V-Ray: (Estimated time remaining: 0h 0m 17.2s): 10 % completed
2015-05-05 17:15:54: 0: STDOUT: [2015/May/5|17:15:54] V-Ray: (Estimated time remaining: 0h 0m 15.2s): 20 % completed
2015-05-05 17:15:58: 0: STDOUT: [2015/May/5|17:15:58] V-Ray: (Estimated time remaining: 0h 0m 18.6s): 30 % completed
2015-05-05 17:16:07: 0: STDOUT: [2015/May/5|17:16:07] V-Ray: (Estimated time remaining: 0h 0m 24.4s): 40 % completed
2015-05-05 17:16:11: 0: STDOUT: [2015/May/5|17:16:11] V-Ray: (Estimated time remaining: 0h 0m 20.0s): 50 % completed
2015-05-05 17:16:12: 0: STDOUT: [2015/May/5|17:16:12] V-Ray: (Estimated time remaining: 0h 0m 13.6s): 61 % completed
2015-05-05 17:16:15: 0: STDOUT: [2015/May/5|17:16:15] V-Ray: (Estimated time remaining: 0h 0m 10.4s): 70 % completed
2015-05-05 17:16:17: 0: STDOUT: [2015/May/5|17:16:17] V-Ray: (Estimated time remaining: 0h 0m 6.7s): 80 % completed
2015-05-05 17:16:21: 0: STDOUT: [2015/May/5|17:16:21] V-Ray: (Estimated time remaining: 0h 0m 3.4s): 90 % completed
2015-05-05 17:16:26: 0: STDOUT: [2015/May/5|17:16:26] V-Ray: Total time updating frame 0h 0m 35.9s (35.9 s)
2015-05-05 17:16:26: 0: STDOUT: [2015/May/5|17:16:26] V-Ray: Preparing renderer…
2015-05-05 17:16:26: 0: STDOUT: [2015/May/5|17:16:26] V-Ray error: Could not obtain a license (-98).
2015-05-05 17:16:26: 0: WARNING: Strict error checking on, ignoring the following unrecognized error or warning. If it is fatal, please email support@thinkboxsoftware.com with the error message.
2015-05-05 17:16:26: 0: STDOUT: Error: line 1: Scene modified. Use file -s to save or quit -f to quit without saving.
2015-05-05 17:16:26: 0: STDOUT: [2015/May/5|17:16:26] V-Ray: Camera rays: 0 (0.00 per pixel)
2015-05-05 17:16:26: 0: STDOUT: [2015/May/5|17:16:26] V-Ray: Shadow rays: 0 (0.00 per pixel)
2015-05-05 17:16:26: 0: STDOUT: [2015/May/5|17:16:26] V-Ray: GI rays: 0 (0.00 per pixel)
2015-05-05 17:16:26: 0: STDOUT: [2015/May/5|17:16:26] V-Ray: Reflection rays: 0 (0.00 per pixel)
2015-05-05 17:16:26: 0: STDOUT: [2015/May/5|17:16:26] V-Ray: Refraction rays: 0 (0.00 per pixel)
2015-05-05 17:16:26: 0: STDOUT: [2015/May/5|17:16:26] V-Ray: Unshaded rays: 0 (0.00 per pixel)
2015-05-05 17:16:26: 0: STDOUT: Stack trace:
2015-05-05 17:16:26: 0: STDOUT: /lib64/libc.so.6() [0x3709032900]
2015-05-05 17:16:26: 0: STDOUT: /usr/autodesk/maya2015-x64/lib/libvray.so(+0x158bce) [0x7fa580a5bbce]
2015-05-05 17:16:26: 0: STDOUT: VUtils::VRayRenderer::endFrame()
2015-05-05 17:16:26: 0: STDOUT: /usr/ChaosGroup/V-Ray/Maya2015-x64/plug-ins/vrayformaya.so(+0x2014eb) [0x7fa5835554eb]
2015-05-05 17:16:26: 0: STDOUT: /usr/ChaosGroup/V-Ray/Maya2015-x64/plug-ins/vrayformaya.so(+0x207118) [0x7fa58355b118]
2015-05-05 17:16:26: 0: STDOUT: /usr/ChaosGroup/V-Ray/Maya2015-x64/plug-ins/vrayformaya.so(+0x207398) [0x7fa58355b398]
2015-05-05 17:16:26: 0: STDOUT: /usr/ChaosGroup/V-Ray/Maya2015-x64/plug-ins/vrayformaya.so(+0x2076f2) [0x7fa58355b6f2]
2015-05-05 17:16:26: 0: STDOUT: /usr/ChaosGroup/V-Ray/Maya2015-x64/plug-ins/vrayformaya.so(+0x4d2378) [0x7fa583826378]
2015-05-05 17:16:26: 0: STDOUT: /usr/ChaosGroup/V-Ray/Maya2015-x64/plug-ins/vrayformaya.so(+0x4d29c4) [0x7fa5838269c4]
2015-05-05 17:16:26: 0: STDOUT: THcommandObject::doIt(TargList&)
2015-05-05 17:16:26: 0: STDOUT: TmetaCommand::doCommand(TargList&)
2015-05-05 17:16:26: 0: STDOUT: Mel_Command_Dispatch_old(SphNode
)
2015-05-05 17:16:26: 0: STDOUT: f_function_entry_node
2015-05-05 17:16:26: 0: STDOUT: node_exec
2015-05-05 17:16:26: 0: STDOUT: sophia_call_executable
2015-05-05 17:16:26: 0: STDOUT: SophiaExecutable::evaluate(void*)
2015-05-05 17:16:26: 0: STDOUT: TcommandEngine::executeCommand(SophiaExecutable*, void*)
2015-05-05 17:16:26: 0: STDOUT: TelfEvalCmd::doCommand(TargList&)
2015-05-05 17:16:26: 0: STDOUT: Mel_Command_Dispatch(SphNode*)
2015-05-05 17:16:26: 0: STDOUT: node_exec
2015-05-05 17:16:26: 0: STDOUT: fc_ifelse
2015-05-05 17:16:26: 0: STDOUT: node_exec
2015-05-05 17:16:26: 0: STDOUT: fc_for
2015-05-05 17:16:26: 0: STDOUT: node_exec
2015-05-05 17:16:26: 0: STDOUT: f_function_entry_node
2015-05-05 17:16:26: 0: STDOUT: node_exec
2015-05-05 17:16:26: 0: STDOUT: sophia_call_executable
2015-05-05 17:16:26: 0: STDOUT: SophiaExecutable::evaluate(void*)
2015-05-05 17:16:26: 0: STDOUT: TcommandEngine::executeCommand(SophiaExecutable*, void*)
2015-05-05 17:16:26: 0: STDOUT: TelfEvalCmd::doCommand(TargList&)
2015-05-05 17:16:26: 0: STDOUT: Mel_Command_Dispatch(SphNode*)
2015-05-05 17:16:26: 0: STDOUT: node_exec
2015-05-05 17:16:26: 0: STDOUT: f_catch
2015-05-05 17:16:26: 0: STDOUT: fc_if
2015-05-05 17:16:26: 0: STDOUT: node_exec
2015-05-05 17:16:26: 0: STDOUT: fc_ifelse
2015-05-05 17:16:26: 0: STDOUT: node_exec
2015-05-05 17:16:26: 0: STDOUT: fc_if
2015-05-05 17:16:26: 0: STDOUT: node_exec
2015-05-05 17:16:26: 0: STDOUT: fc_if
2015-05-05 17:16:26: 0: WARNING: Strict error checking on, ignoring the following unrecognized error or warning. If it is fatal, please email support@thinkboxsoftware.com with the error message.
2015-05-05 17:16:26: 0: STDOUT: Error: line 1: File contains unknown nodes or data. To preserve this information, the current file type cannot be changed.
2015-05-05 17:16:26: 0: STDOUT: Fatal Error. Attempting to save in /usr/tmp/root.20150505.1716.ma
2015-05-05 17:16:26: 0: WARNING: Strict error checking on, ignoring the following unrecognized error or warning. If it is fatal, please email support@thinkboxsoftware.com with the error message.
2015-05-05 17:16:26: 0: STDOUT: Error: line 1: File contains unknown nodes or data. To preserve this information, the current file type cannot be changed.
2015-05-05 17:16:26: 0: STDOUT: Writing crash report in /usr/tmp/root.20150505.1716.crash
2015-05-05 17:16:27: 0: STDOUT: mel: mel:
2015-05-05 17:16:27: 0: WARNING: Monitored managed process MayaBatch is no longer running

=======================================================
Details

Date: 05/05/2015 17:16:51
Frames: 6
Elapsed Time: 00:00:01:00
Job Submit Date: 05/05/2015 17:05:13
Job User: henshl
Average RAM Usage: 1790364058 (8%)
Peak RAM Usage: 3920613376 (16%)
Average CPU Usage: 8%
Peak CPU Usage: 13%
Used CPU Clocks: 194074
Total CPU Clocks: 2425920

=======================================================
Slave Information

Slave Name: node02
Version: v7.1.0.29 R (7e9b08b44)
Operating System: Linux
Machine User: root
IP Address: 10.170.104.16
MAC Address: 00:15:17:C7:7E:68
CPU Architecture: x86_64
CPUs: 16
CPU Usage: 8%
Memory Usage: 3.3 GB / 23.4 GB (14%)
Free Disk Space: 6.615 GB
Video Card: Matrox Graphics, Inc. MGA G200e [Pilot] ServerEngines (SEP1) (rev 02)

Looks like Maya is flat out crashing during the render. There are some hints in the log of what the cause could be:

2015-05-05 17:16:26: 0: STDOUT: [2015/May/5|17:16:26] V-Ray error: Could not obtain a license (-98).
Error: line 1: File contains unknown nodes or data. To preserve this information, the current file type cannot be changed.

The first one is complaining that VRay can’t get a license. Not sure what the second one means. However, since you are rendering with the VRay, the first step should be to figure out why your render can’t pull a VRay license (maybe the license server is down, or something like a firewall is preventing the render nodes from pulling a license).

Cheers,
Ryan

Privacy | Site terms | Cookie preferences