Error rendering with Maya

Deadline
1

Hi we are getting some errors and we cant figure out the reason. It’s inconsistent.

Some racks error out but they still render sometimes.

[attachment=0]RacksError.PNG[/attachment]

RACK22 - Log

[size=85]=======================================================
Error

Error: Monitored managed process “MayaBatch” has exited or been terminated.
at Deadline.Plugins.PluginWrapper.RenderTasks(String taskId, Int32 startFrame, Int32 endFrame, String& outMessage, AbortLevel& abortLevel)

=======================================================
Type

RenderPluginException

=======================================================
Stack Trace

at Deadline.Plugins.SandboxedPlugin.a(DeadlineMessage A_0)
at Deadline.Plugins.SandboxedPlugin.RenderTask(String taskId, Int32 startFrame, Int32 endFrame)
at Deadline.Slaves.SlaveRenderThread.a(TaskLogWriter A_0)

=======================================================
Log

2017-01-30 14:50:49: BEGIN - RACK22\NR2
2017-01-30 14:50:49: 0: Executing plugin command of type ‘Initialize Plugin’
2017-01-30 14:50:50: 0: INFO: Executing plugin script ‘C:\Users\NR2\AppData\Local\Thinkbox\Deadline8\slave\rack22\plugins\588f4f2463a7f845045ab33b\MayaBatch.py’
2017-01-30 14:50:50: 0: INFO: About: Maya Batch Plugin for Deadline
2017-01-30 14:50:50: 0: INFO: The job’s environment will be merged with the current environment before rendering
2017-01-30 14:50:50: 0: Done executing plugin command of type ‘Initialize Plugin’
2017-01-30 14:50:51: 0: Start Job timeout is disabled.
2017-01-30 14:50:51: 0: Task timeout is disabled.
2017-01-30 14:50:51: 0: Loaded job: testRender - persp (588f4f2463a7f845045ab33b)
2017-01-30 14:50:51: 0: Executing plugin command of type ‘Start Job’
2017-01-30 14:50:51: 0: INFO: Rendering with Maya Version 2017.0
2017-01-30 14:50:51: 0: INFO: Setting MAYA_DISABLE_CIP (ADSK Customer Involvement Program) environment variable to 1 for this session
2017-01-30 14:50:51: 0: INFO: Setting MAYA_DISABLE_CER (ADSK Customer Error Reporting) environment variable to 1 for this session
2017-01-30 14:50:51: 0: INFO: Setting MAYA_DISABLE_CLIC_IPM (ADSK In Product Messaging) environment variable to 1 for this session
2017-01-30 14:50:51: 0: INFO: Setting MAYA_ENABLE_LEGACY_RENDER_LAYERS environment variable to 1 for this session
2017-01-30 14:50:51: 0: INFO: Enforcing 64 bit build of Maya
2017-01-30 14:50:51: 0: INFO: Setting PYTHONHOME to C:\Program Files\Autodesk\Maya2017\Python for this session
2017-01-30 14:50:51: 0: INFO: Starting monitored managed process MayaBatch
2017-01-30 14:50:51: 0: INFO: Stdout Redirection Enabled: True
2017-01-30 14:50:51: 0: INFO: Stdout Handling Enabled: True
2017-01-30 14:50:51: 0: INFO: Popup Handling Enabled: True
2017-01-30 14:50:51: 0: INFO: QT Popup Handling Enabled: False
2017-01-30 14:50:51: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2017-01-30 14:50:51: 0: INFO: Using Process Tree: True
2017-01-30 14:50:51: 0: INFO: Hiding DOS Window: True
2017-01-30 14:50:51: 0: INFO: Creating New Console: False
2017-01-30 14:50:51: 0: INFO: Running as user: NR2
2017-01-30 14:50:51: 0: INFO: Enforcing 64 bit build of Maya
2017-01-30 14:50:51: 0: INFO: Executable: “C:\Program Files\Autodesk\Maya2017\bin\MayaBatch.exe”
2017-01-30 14:50:51: 0: INFO: Argument: -prompt -proj “//rock/rock/PROJECTS/Mace_Brand_16457/3D/Mace2017_Maya”
2017-01-30 14:50:51: 0: INFO: Full Command: “C:\Program Files\Autodesk\Maya2017\bin\MayaBatch.exe” -prompt -proj “//rock/rock/PROJECTS/Mace_Brand_16457/3D/Mace2017_Maya”
2017-01-30 14:50:51: 0: INFO: Startup Directory: “C:\Program Files\Autodesk\Maya2017\bin”
2017-01-30 14:50:51: 0: INFO: Process Priority: BelowNormal
2017-01-30 14:50:51: 0: INFO: Process Affinity: default
2017-01-30 14:50:51: 0: INFO: Process is now running
2017-01-30 14:50:51: 0: Done executing plugin command of type ‘Start Job’
2017-01-30 14:50:51: 0: Plugin rendering frame(s): 24
2017-01-30 14:50:51: 0: Executing plugin command of type ‘Render Task’
2017-01-30 14:50:51: 0: INFO: Waiting until maya is ready to go
2017-01-30 14:50:57: 0: STDOUT: Stack trace:
2017-01-30 14:50:57: 0: STDOUT: Fatal Error. Attempting to save in C:/Users/NR2/AppData/Local/Temp/NR2.20170130.1450.ma
2017-01-30 14:50:58: 0: WARNING: Monitored managed process MayaBatch is no longer running
2017-01-30 14:50:58: 0: Done executing plugin command of type ‘Render Task’

=======================================================
Details

Date: 01/30/2017 14:50:55
Frames: 24
Elapsed Time: 00:00:00:12
Job Submit Date: 01/30/2017 14:35:15
Job User: mario
Average RAM Usage: 4595441664 (14%)
Peak RAM Usage: 4595441664 (14%)
Average CPU Usage: 3%
Peak CPU Usage: 5%
Used CPU Clocks (x10^6 cycles): 10956
Total CPU Clocks (x10^6 cycles): 365196

=======================================================
Slave Information

Slave Name: RACK22
Version: v8.0.11.2 Release (ed3c7aaea)
Operating System: Windows 7 Professional (SP1)
Running As Service: No
Machine User: NR2
IP Address: 10.1.1.57
MAC Address: 00:25:90:4F:1C:90
CPU Architecture: x64
CPUs: 24
CPU Usage: 4%
Memory Usage: 4.3 GB / 32.0 GB (13%)
Free Disk Space: 72.567 GB
Video Card: Matrox G200eW (Nuvoton)[/size]

I hope someone can help tks!

2

So looking at the log, its hard to tell if the problem is maya is failing to load or if the scene file is failing to load.
Aslo cant tell what render engine your using, but if possible, can you go to the render global / render settings, and and turn the log verbosity all the way up.

That way we can at least see where maya is getting to.

also could you post the log of one of the machines that did work, that might help us figure out what is occurring.

cheers
Kym

3

Tks! I’ll do that.

4

Another nice thing to always try when debugging “MayaBatch”, is to switch to submitting the job to “MayaCmd”, by simply unchecking the “Use Batch Plugin” checkbox in the in-app/Monitor submitters. Not always, but sometimes executing Maya by the simple command-line, can reveal more information.

If it fails using MayaCmd, then it is trivial to copy the executing string from this plugin prefixed in the job log report as: “Full Command: xxx” and open a shell and paste that exact command into it and hit return. If it fails in that shell, then you know Deadline is simply the messenger here and you have successfully eliminated it from the equation.

5

I’m having the same problem. We’re using Maya 2017 and V-Ray. Frames are picked up. Mayabatch terminates. Frames requeue sometimes once sometimes 10 times then somehow the frames eventually render and complete with no error.

When I submit using MayaBatch I get this.

=======================================================
Error

Error: Monitored managed process “MayaBatch” has exited or been terminated.
at Deadline.Plugins.PluginWrapper.RenderTasks(String taskId, Int32 startFrame, Int32 endFrame, String& outMessage, AbortLevel& abortLevel)

=======================================================
Type

RenderPluginException

=======================================================
Stack Trace

at Deadline.Plugins.SandboxedPlugin.a(DeadlineMessage A_0)
at Deadline.Plugins.SandboxedPlugin.RenderTask(String taskId, Int32 startFrame, Int32 endFrame)
at Deadline.Slaves.SlaveRenderThread.a(TaskLogWriter A_0)

=======================================================
Log

2017-01-31 11:56:59: BEGIN - FARMW29\farmw29_User
2017-01-31 11:56:59: 0: Executing plugin command of type ‘Initialize Plugin’
2017-01-31 11:56:59: 0: INFO: Executing plugin script ‘C:\Users\FarmW29_User\AppData\Local\Thinkbox\Deadline8\slave\FARMW29\plugins\5890c1d12921d001a488361f\MayaBatch.py’
2017-01-31 11:57:00: 0: INFO: About: Maya Batch Plugin for Deadline
2017-01-31 11:57:00: 0: INFO: The job’s environment will be merged with the current environment before rendering
2017-01-31 11:57:00: 0: Done executing plugin command of type ‘Initialize Plugin’
2017-01-31 11:57:00: 0: Start Job timeout is disabled.
2017-01-31 11:57:00: 0: Task timeout is disabled.
2017-01-31 11:57:00: 0: Loaded job: 2017_TestRender02 - RENDER_CAM (5890c1d12921d001a488361f)
2017-01-31 11:57:00: 0: Executing plugin command of type ‘Start Job’
2017-01-31 11:57:00: 0: INFO: Rendering with Maya Version 2017.0
2017-01-31 11:57:00: 0: INFO: Setting MAYA_DISABLE_CIP (ADSK Customer Involvement Program) environment variable to 1 for this session
2017-01-31 11:57:00: 0: INFO: Setting MAYA_DISABLE_CER (ADSK Customer Error Reporting) environment variable to 1 for this session
2017-01-31 11:57:00: 0: INFO: Setting MAYA_DISABLE_CLIC_IPM (ADSK In Product Messaging) environment variable to 1 for this session
2017-01-31 11:57:00: 0: INFO: Setting MAYA_ENABLE_LEGACY_RENDER_LAYERS environment variable to 0 for this session
2017-01-31 11:57:00: 0: INFO: Enforcing 64 bit build of Maya
2017-01-31 11:57:00: 0: INFO: Setting PYTHONHOME to C:\Program Files\Autodesk\Maya2017\Python for this session
2017-01-31 11:57:00: 0: INFO: Starting monitored managed process MayaBatch
2017-01-31 11:57:00: 0: INFO: Stdout Redirection Enabled: True
2017-01-31 11:57:00: 0: INFO: Stdout Handling Enabled: True
2017-01-31 11:57:00: 0: INFO: Popup Handling Enabled: True
2017-01-31 11:57:00: 0: INFO: QT Popup Handling Enabled: False
2017-01-31 11:57:00: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2017-01-31 11:57:00: 0: INFO: Using Process Tree: True
2017-01-31 11:57:00: 0: INFO: Hiding DOS Window: True
2017-01-31 11:57:00: 0: INFO: Creating New Console: False
2017-01-31 11:57:00: 0: INFO: Running as user: farmw29_User
2017-01-31 11:57:00: 0: INFO: Enforcing 64 bit build of Maya
2017-01-31 11:57:00: 0: INFO: Executable: “C:\Program Files\Autodesk\Maya2017\bin\MayaBatch.exe”
2017-01-31 11:57:00: 0: INFO: Argument: -prompt -proj “Y:/Projects/FirstDivisionMuseum/ObjectiveNorfolk_BA9198/CG/BradleyTank/Maya”
2017-01-31 11:57:00: 0: INFO: Full Command: “C:\Program Files\Autodesk\Maya2017\bin\MayaBatch.exe” -prompt -proj “Y:/Projects/FirstDivisionMuseum/ObjectiveNorfolk_BA9198/CG/BradleyTank/Maya”
2017-01-31 11:57:00: 0: INFO: Startup Directory: “C:\Program Files\Autodesk\Maya2017\bin”
2017-01-31 11:57:00: 0: INFO: Process Priority: BelowNormal
2017-01-31 11:57:00: 0: INFO: Process Affinity: default
2017-01-31 11:57:00: 0: INFO: Process is now running
2017-01-31 11:57:00: 0: Done executing plugin command of type ‘Start Job’
2017-01-31 11:57:00: 0: Plugin rendering frame(s): 15
2017-01-31 11:57:00: 0: Executing plugin command of type ‘Render Task’
2017-01-31 11:57:00: 0: INFO: Waiting until maya is ready to go
2017-01-31 11:57:02: 0: WARNING: Strict error checking off, ignoring the following error or warning.
2017-01-31 11:57:02: 0: STDOUT: Error: The transforms path found in the configuration file does not exist: C:/Users/FarmW29_User/Documents/maya/2017/prefs/synColorConfig.xml
2017-01-31 11:57:03: 0: WARNING: Strict error checking off, ignoring the following error or warning.
2017-01-31 11:57:03: 0: STDOUT: Error: The SynColor package is not installed: C:\ProgramData\Autodesk\Synergy\SynColor\2017
2017-01-31 11:57:03: 0: WARNING: Strict error checking off, ignoring the following error or warning.
2017-01-31 11:57:03: 0: STDOUT: Warning: Parameter was not found: input_space
2017-01-31 11:57:03: 0: STDOUT: Stack trace:
2017-01-31 11:57:03: 0: STDOUT: DependEngine.dll!TdataBlockDG::attrMemAddr
2017-01-31 11:57:03: 0: STDOUT: DependEngine.dll!TdataBlockDG::~TdataBlockDG
2017-01-31 11:57:03: 0: STDOUT: DependEngine.dll!TplugPtrSObj::operator>=
2017-01-31 11:57:03: 0: STDOUT: DependEngine.dll!TdbCache::~TdbCache
2017-01-31 11:57:03: 0: STDOUT: DependEngine.dll!Tplug::netDestroy
2017-01-31 11:57:03: 0: STDOUT: DependEngine.dll!TdependNode::~TdependNode
2017-01-31 11:57:03: 0: STDOUT: RenderModel.dll!TdnColorMgtGlobals::TdnColorMgtGlobals
2017-01-31 11:57:03: 0: STDOUT: MSVCR110.dll!__unDNameEx
2017-01-31 11:57:03: 0: STDOUT: MSVCR110.dll!__FrameUnwindFilter
2017-01-31 11:57:03: 0: STDOUT: MSVCR110.dll!_CxxThrowException
2017-01-31 11:57:03: 0: STDOUT: MSVCR110.dll!__FrameUnwindFilter
2017-01-31 11:57:03: 0: STDOUT: MSVCR110.dll!__CxxFrameHandler2
2017-01-31 11:57:03: 0: STDOUT: ntdll.dll!RtlDecodePointer
2017-01-31 11:57:03: 0: STDOUT: ntdll.dll!RtlUnwindEx
2017-01-31 11:57:03: 0: STDOUT: kernel32.dll!RtlUnwindEx
2017-01-31 11:57:03: 0: STDOUT: MSVCR110.dll!_SetThrowImageBase
2017-01-31 11:57:03: 0: STDOUT: MSVCR110.dll!__DestructExceptionObject
2017-01-31 11:57:03: 0: STDOUT: MSVCR110.dll!__DestructExceptionObject
2017-01-31 11:57:03: 0: STDOUT: MSVCR110.dll!__FrameUnwindFilter
2017-01-31 11:57:03: 0: STDOUT: MSVCR110.dll!__CxxFrameHandler2
2017-01-31 11:57:03: 0: STDOUT: ntdll.dll!RtlDecodePointer
2017-01-31 11:57:03: 0: STDOUT: ntdll.dll!RtlUnwindEx
2017-01-31 11:57:03: 0: STDOUT: ntdll.dll!RtlRaiseException
2017-01-31 11:57:03: 0: STDOUT: KERNELBASE.dll!RaiseException
2017-01-31 11:57:03: 0: STDOUT: MSVCR110.dll!_CxxThrowException
2017-01-31 11:57:03: 0: STDOUT: RenderModel.dll!TdnColorMgtGlobals::SetViewTransformName
2017-01-31 11:57:03: 0: STDOUT: RenderModel.dll!TdnColorMgtGlobals::SetTransformDefaults
2017-01-31 11:57:03: 0: STDOUT: RenderModel.dll!TdnColorMgtGlobals::Reset
2017-01-31 11:57:03: 0: STDOUT: RenderModel.dll!TdnColorMgtGlobals::TdnColorMgtGlobals
2017-01-31 11:57:03: 0: STDOUT: RenderModel.dll!TrenderInfo::TrenderInfo
2017-01-31 11:57:03: 0: STDOUT: RenderModel.dll!TrenderInfo::getRenderInfo
2017-01-31 11:57:03: 0: STDOUT: DataModel.dll!Tmodel::create
2017-01-31 11:57:03: 0: STDOUT: Shared.dll!Tscene::createDefault
2017-01-31 11:57:03: 0: STDOUT: Shared.dll!TglobalTranslator::newDefaultScene
2017-01-31 11:57:03: 0: STDOUT: Shared.dll!TglobalTranslator::initializeDefaultScene
2017-01-31 11:57:03: 0: STDOUT: MayaBatch.exe!TiteratorWrapperBidir<TscenePartitions::ConstIteratorDescriptor,TiteratorWrapperTscenePartitions::ConstIteratorDescriptor >::operator=
2017-01-31 11:57:03: 0: STDOUT: ExtensionLayer.dll!Tapplication::start
2017-01-31 11:57:03: 0: STDOUT: MayaBatch.exe!TiteratorWrapperBidir<TscenePartitions::ConstIteratorDescriptor,TiteratorWrapperTscenePartitions::ConstIteratorDescriptor >::operator=
2017-01-31 11:57:03: 0: STDOUT: kernel32.dll!BaseThreadInitThunk
2017-01-31 11:57:04: 0: WARNING: Monitored managed process MayaBatch is no longer running
2017-01-31 11:57:04: 0: Done executing plugin command of type ‘Render Task’

=======================================================
Details

Date: 01/31/2017 12:22:37
Frames: 15
Elapsed Time: 00:00:00:08
Job Submit Date: 01/31/2017 12:22:21
Job User: rhobart
Average RAM Usage: 6551797760 (10%)
Peak RAM Usage: 6551797760 (10%)
Average CPU Usage: 2%
Peak CPU Usage: 5%
Used CPU Clocks (x10^6 cycles): 7329
Total CPU Clocks (x10^6 cycles): 366424

=======================================================
Slave Information

Slave Name: FARMW29
Version: v8.0.13.3 Release (2c55876a9)
Operating System: Windows 7 Professional (SP1)
Running As Service: No
Machine User: farmw29_User
IP Address: fe80::486:5f6c:cb6c:d93c%13
MAC Address: AC:22:0B:8A:0A:2E
CPU Architecture: x64
CPUs: 32
CPU Usage: 2%
Memory Usage: 6.1 GB / 64.0 GB (9%)
Free Disk Space: 48.827 GB
Video Card: Standard VGA Graphics Adapter

When I submit using MayaCmd I get this:

=======================================================
Error

Error: Renderer returned non-zero error code -1073741819. Check the renderer’s output.
at Deadline.Plugins.PluginWrapper.RenderTasks(String taskId, Int32 startFrame, Int32 endFrame, String& outMessage, AbortLevel& abortLevel)

=======================================================
Type

RenderPluginException

=======================================================
Stack Trace

at Deadline.Plugins.SandboxedPlugin.a(DeadlineMessage A_0)
at Deadline.Plugins.SandboxedPlugin.RenderTask(String taskId, Int32 startFrame, Int32 endFrame)
at Deadline.Slaves.SlaveRenderThread.a(TaskLogWriter A_0)

=======================================================
Log

2017-02-06 15:16:25: BEGIN - FARMW31\farmw31_User
2017-02-06 15:16:25: 0: Executing plugin command of type ‘Initialize Plugin’
2017-02-06 15:16:26: 0: INFO: Executing plugin script ‘C:\Users\FarmW31_User\AppData\Local\Thinkbox\Deadline8\slave\FARMW31\plugins\5898d98b2921d043309be6e5\MayaCmd.py’
2017-02-06 15:16:26: 0: INFO: About: Maya Cmd Plugin for Deadline
2017-02-06 15:16:26: 0: INFO: The job’s environment will be merged with the current environment before rendering
2017-02-06 15:16:26: 0: Done executing plugin command of type ‘Initialize Plugin’
2017-02-06 15:16:26: 0: Start Job timeout is disabled.
2017-02-06 15:16:26: 0: Task timeout is disabled.
2017-02-06 15:16:26: 0: Loaded job: 2017_test - persp (5898d98b2921d043309be6e5)
2017-02-06 15:16:26: 0: Executing plugin command of type ‘Start Job’
2017-02-06 15:16:26: 0: Done executing plugin command of type ‘Start Job’
2017-02-06 15:16:26: 0: Plugin rendering frame(s): 2
2017-02-06 15:16:27: 0: Executing plugin command of type ‘Render Task’
2017-02-06 15:16:27: 0: INFO: Setting MAYA_DISABLE_CIP (ADSK Customer Involvement Program) environment variable to 1 for this session
2017-02-06 15:16:27: 0: INFO: Setting MAYA_DISABLE_CER (ADSK Customer Error Reporting) environment variable to 1 for this session
2017-02-06 15:16:27: 0: INFO: Setting MAYA_DISABLE_CLIC_IPM (ADSK In Product Messaging) environment variable to 1 for this session
2017-02-06 15:16:27: 0: INFO: Rendering with Maya version 2017.0
2017-02-06 15:16:27: 0: INFO: Enforcing 64 bit build of Maya
2017-02-06 15:16:27: 0: INFO: Setting PYTHONHOME to C:\Program Files\Autodesk\Maya2017\Python for this session
2017-02-06 15:16:27: 0: INFO: Stdout Redirection Enabled: True
2017-02-06 15:16:27: 0: INFO: Stdout Handling Enabled: True
2017-02-06 15:16:27: 0: INFO: Popup Handling Enabled: True
2017-02-06 15:16:27: 0: INFO: QT Popup Handling Enabled: False
2017-02-06 15:16:27: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2017-02-06 15:16:27: 0: INFO: Using Process Tree: True
2017-02-06 15:16:27: 0: INFO: Hiding DOS Window: True
2017-02-06 15:16:27: 0: INFO: Creating New Console: False
2017-02-06 15:16:27: 0: INFO: Running as user: farmw31_User
2017-02-06 15:16:27: 0: INFO: Rendering with Maya version 2017.0
2017-02-06 15:16:27: 0: INFO: Enforcing 64 bit build of Maya
2017-02-06 15:16:27: 0: INFO: Executable: “C:\Program Files\Autodesk\Maya2017\bin\Render.exe”
2017-02-06 15:16:27: 0: INFO: Rendering to network drive
2017-02-06 15:16:27: 0: INFO: Rendering with VRay.
2017-02-06 15:16:27: 0: INFO: Argument: -r vray -threads 0 -x 1920 -y 1080 -s 2 -e 2 -b 1 -rd “X:/PROJECTS/2017_Test/images” -im “//" -cam “persp” -proj “X:/PROJECTS/2017_Test” “X:\PROJECTS\2017_Test\scenes\2017_test.mb”
2017-02-06 15:16:27: 0: INFO: Full Command: “C:\Program Files\Autodesk\Maya2017\bin\Render.exe” -r vray -threads 0 -x 1920 -y 1080 -s 2 -e 2 -b 1 -rd “X:/PROJECTS/2017_Test/images” -im "//” -cam “persp” -proj “X:/PROJECTS/2017_Test” “X:\PROJECTS\2017_Test\scenes\2017_test.mb”
2017-02-06 15:16:27: 0: INFO: Startup Directory: “C:\Program Files\Autodesk\Maya2017\bin”
2017-02-06 15:16:27: 0: INFO: Process Priority: BelowNormal
2017-02-06 15:16:27: 0: INFO: Process Affinity: default
2017-02-06 15:16:27: 0: INFO: Process is now running
2017-02-06 15:16:27: 0: STDOUT: Starting “C:\Program Files\Autodesk\Maya2017\bin\mayabatch.exe”
2017-02-06 15:16:31: 0: STDOUT: mental ray for Maya 2017
2017-02-06 15:16:32: 0: STDOUT: mental ray: version 3.14.3.31, 16 Nov 2016, revision 281811
2017-02-06 15:16:32: 0: STDOUT: mental ray: started on “FARMW31”, Mon Feb 06 15:16:32 2017
2017-02-06 15:16:32: 0: STDOUT: mental ray: Identified file “architectural.so” as identical to “architectural.dll”
2017-02-06 15:16:32: 0: STDOUT: mental ray: Identified file “paint.so” as identical to “paint.dll”
2017-02-06 15:16:32: 0: STDOUT: mental ray: Identified file “subsurface.so” as identical to “subsurface.dll”
2017-02-06 15:16:32: 0: STDOUT: mental ray: Identified file “layering.so” as identical to “layering.dll”
2017-02-06 15:16:32: 0: STDOUT: mental ray: Identified file “layering.so” as identical to “layering.dll”
2017-02-06 15:16:32: 0: STDOUT: Stack trace:
2017-02-06 15:16:32: 0: STDOUT: Fatal Error. Attempting to save in C:/Users/FARMW3~1/AppData/Local/Temp/farmw31_User.20170206.1516.ma
2017-02-06 15:16:34: 0: STDOUT: // Maya exited with status -1073741819
2017-02-06 15:16:34: 0: INFO: Process exit code: -1073741819
2017-02-06 15:16:34: 0: Done executing plugin command of type ‘Render Task’

=======================================================
Details

Date: 02/06/2017 15:42:05
Frames: 2
Elapsed Time: 00:00:00:13
Job Submit Date: 02/06/2017 15:41:47
Job User: rhobart
Average RAM Usage: 4640870400 (7%)
Peak RAM Usage: 4640870400 (7%)
Average CPU Usage: 2%
Peak CPU Usage: 4%
Used CPU Clocks (x10^6 cycles): 14160
Total CPU Clocks (x10^6 cycles): 707959

=======================================================
Slave Information

Slave Name: FARMW31
Version: v8.0.13.3 Release (2c55876a9)
Operating System: Windows 7 Professional (SP1)
Running As Service: No
Machine User: farmw31_User
IP Address: fe80::f16d:b502:ffdf:5b1e%13
MAC Address: AC:22:0B:8C:41:E4
CPU Architecture: x64
CPUs: 32
CPU Usage: 3%
Memory Usage: 4.3 GB / 64.0 GB (6%)
Free Disk Space: 60.232 GB
Video Card: Standard VGA Graphics Adapter

Eventually the frame renders correctly and I get this:

=======================================================
Log

2017-02-06 15:17:33: BEGIN - FARMW31\farmw31_User
2017-02-06 15:17:33: 0: Start Job timeout is disabled.
2017-02-06 15:17:33: 0: Task timeout is disabled.
2017-02-06 15:17:33: 0: Plugin rendering frame(s): 2
2017-02-06 15:17:33: 0: Executing plugin command of type ‘Render Task’
2017-02-06 15:17:33: 0: INFO: Setting MAYA_DISABLE_CIP (ADSK Customer Involvement Program) environment variable to 1 for this session
2017-02-06 15:17:33: 0: INFO: Setting MAYA_DISABLE_CER (ADSK Customer Error Reporting) environment variable to 1 for this session
2017-02-06 15:17:33: 0: INFO: Setting MAYA_DISABLE_CLIC_IPM (ADSK In Product Messaging) environment variable to 1 for this session
2017-02-06 15:17:33: 0: INFO: Setting MAYA_ENABLE_LEGACY_RENDER_LAYERS environment variable to 0 for this session
2017-02-06 15:17:33: 0: INFO: Rendering with Maya version 2017.0
2017-02-06 15:17:33: 0: INFO: Enforcing 64 bit build of Maya
2017-02-06 15:17:33: 0: INFO: Setting PYTHONHOME to C:\Program Files\Autodesk\Maya2017\Python for this session
2017-02-06 15:17:33: 0: INFO: Stdout Redirection Enabled: True
2017-02-06 15:17:33: 0: INFO: Stdout Handling Enabled: True
2017-02-06 15:17:33: 0: INFO: Popup Handling Enabled: True
2017-02-06 15:17:33: 0: INFO: QT Popup Handling Enabled: False
2017-02-06 15:17:33: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2017-02-06 15:17:33: 0: INFO: Using Process Tree: True
2017-02-06 15:17:33: 0: INFO: Hiding DOS Window: True
2017-02-06 15:17:33: 0: INFO: Creating New Console: False
2017-02-06 15:17:33: 0: INFO: Running as user: farmw31_User
2017-02-06 15:17:33: 0: INFO: Rendering with Maya version 2017.0
2017-02-06 15:17:33: 0: INFO: Enforcing 64 bit build of Maya
2017-02-06 15:17:33: 0: INFO: Executable: “C:\Program Files\Autodesk\Maya2017\bin\Render.exe”
2017-02-06 15:17:33: 0: INFO: Rendering to network drive
2017-02-06 15:17:33: 0: INFO: Rendering with VRay.
2017-02-06 15:17:33: 0: INFO: Argument: -r vray -threads 0 -x 1920 -y 1080 -s 2 -e 2 -b 1 -rd “X:/PROJECTS/2017_Test/images” -im “//" -cam “persp” -proj “X:/PROJECTS/2017_Test” “X:\PROJECTS\2017_Test\scenes\2017_test.mb”
2017-02-06 15:17:33: 0: INFO: Full Command: “C:\Program Files\Autodesk\Maya2017\bin\Render.exe” -r vray -threads 0 -x 1920 -y 1080 -s 2 -e 2 -b 1 -rd “X:/PROJECTS/2017_Test/images” -im "//” -cam “persp” -proj “X:/PROJECTS/2017_Test” “X:\PROJECTS\2017_Test\scenes\2017_test.mb”
2017-02-06 15:17:33: 0: INFO: Startup Directory: “C:\Program Files\Autodesk\Maya2017\bin”
2017-02-06 15:17:33: 0: INFO: Process Priority: BelowNormal
2017-02-06 15:17:33: 0: INFO: Process Affinity: default
2017-02-06 15:17:33: 0: INFO: Process is now running
2017-02-06 15:17:33: 0: STDOUT: Starting “C:\Program Files\Autodesk\Maya2017\bin\mayabatch.exe”
2017-02-06 15:17:37: 0: STDOUT: mental ray for Maya 2017
2017-02-06 15:17:38: 0: STDOUT: mental ray: version 3.14.3.31, 16 Nov 2016, revision 281811
2017-02-06 15:17:38: 0: STDOUT: mental ray: started on “FARMW31”, Mon Feb 06 15:17:37 2017
2017-02-06 15:17:38: 0: STDOUT: mental ray: Identified file “architectural.so” as identical to “architectural.dll”
2017-02-06 15:17:38: 0: STDOUT: mental ray: Identified file “paint.so” as identical to “paint.dll”
2017-02-06 15:17:38: 0: STDOUT: mental ray: Identified file “subsurface.so” as identical to “subsurface.dll”
2017-02-06 15:17:38: 0: STDOUT: mental ray: Identified file “layering.so” as identical to “layering.dll”
2017-02-06 15:17:38: 0: STDOUT: mental ray: Identified file “layering.so” as identical to “layering.dll”
2017-02-06 15:17:38: 0: STDOUT: VP2 Error : Failed to initialize graphics device.
2017-02-06 15:17:39: 0: STDOUT: Failed to register registerFragments.[2017/Feb/6|15:17:39] V-Ray: V-Ray for Maya version 3.40.06 from Nov 3 2016, 17:35:05
2017-02-06 15:17:39: 0: STDOUT: [2017/Feb/6|15:17:39] V-Ray: V-Ray core version is 3.25.01
2017-02-06 15:17:39: 0: STDOUT: [2017/Feb/6|15:17:39] V-Ray: Loading plugins from “C:\Program Files\Autodesk\Maya2017\vray/vrayplugins/vray_*.dll”
2017-02-06 15:17:40: 0: STDOUT: [2017/Feb/6|15:17:40] V-Ray: 75 plugin(s) loaded successfully
2017-02-06 15:17:40: 0: STDOUT: [2017/Feb/6|15:17:40] V-Ray: Finished loading plugins.
2017-02-06 15:17:41: 0: STDOUT: [2017/Feb/6|15:17:41] V-Ray: Registered dynamic node vrayMultiProjection (id: 1115335/0x001104C7)
2017-02-06 15:17:41: 0: STDOUT: [2017/Feb/6|15:17:41] V-Ray: Registered dynamic node VRayCurvature (id: 1115347/0x001104D3)
2017-02-06 15:17:41: 0: STDOUT: [2017/Feb/6|15:17:41] V-Ray: Registered dynamic node VRayTriplanar (id: 1115362/0x001104E2)
2017-02-06 15:17:41: 0: STDOUT: [2017/Feb/6|15:17:41] V-Ray: Registered dynamic node VRaySkinMtl (id: 1115348/0x001104D4)
2017-02-06 15:17:41: 0: STDOUT: [2017/Feb/6|15:17:41] V-Ray: Registered dynamic node VRayPointParticleMtl (id: 1115353/0x001104D9)
2017-02-06 15:17:41: 0: STDOUT: [2017/Feb/6|15:17:41] V-Ray: Registered dynamic node VRayStochasticFlakesMtl (id: 1115359/0x001104DF)
2017-02-06 15:17:42: 0: STDOUT: pymel.core : INFO : Updating pymel with pre-loaded plugins: mayaHIK, invertShape, GamePipeline, CloudImportExport, curveWarp, tiffFloatReader, MASH, poseInterpolator, bifrostvisplugin, hairPhysicalShader, ATFPlugin, Mayatomr, ikSpringSolver, ik2Bsolver, xgenToolkit, AbcExport, retargeterNodes, vrayformaya, gameFbxExporter, VectorRender, OpenEXRLoader, lookdevKit, Unfold3D, Type, mayaCharacterization, renderSetup, fbxmaya
2017-02-06 15:17:43: 0: STDOUT: Maya 2017 importing module pymel 1.0.9 (C:\Program Files\Autodesk\Maya2017\Python\lib\site-packages\pymel_init_.pyc)
2017-02-06 15:17:48: 0: STDOUT: File read in 0.25 seconds.
2017-02-06 15:17:48: 0: STDOUT: Result: X:/PROJECTS/2017_Test/scenes/2017_test.mb
2017-02-06 15:17:48: 0: WARNING: Strict error checking off, ignoring the following error or warning:
2017-02-06 15:17:48: 0: STDOUT: Warning: file: C:/Program Files/Autodesk/Maya2017/scripts/others/makeCameraRenderable.mel line 45: Found camera perspShape.
2017-02-06 15:17:48: 0: STDOUT: V-Ray: Starting render
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Exporting scene to V-Ray.
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Parsing light links time 0h 0m 0.0s (0.0 s)
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Translating scene geometry for V-Ray
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Total time translating scene for V-Ray 0h 0m 0.0s (0.0 s)
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Rendering.
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Clearing bitmap cache memory…
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Rendering frames.
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Updating frame at time 2.00
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Total time updating frame 0h 0m 0.0s (0.0 s)
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Preparing renderer…
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Preparing scene for rendering…
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: 1 lights found.
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Max ray intensity is enabled: rendered result may have incorrect brightness.
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Preparing scene for frame…
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Dome light resolution increased from 512 to 2048 for light “VRayLightDomeShape1”
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Compiling geometry…
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Building static raycast accelerator…
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: SDTree statistics:
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Total number of faces stored: 12
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Max tree depth: 4
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Average tree depth: 4
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Number of tree nodes: 101
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Number of tree faces: 36
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Number of tree leafs: 8
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Average faces/leaf: 4.5
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Memory usage: 1.61 MB
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Building static SD trees took 2 milliseconds
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: Rendering image…
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: (Estimated time remaining: 0h 0m 0.5s): 36 % completed
2017-02-06 15:17:48: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: (Estimated time remaining: 0h 0m 0.1s): 78 % completed
2017-02-06 15:17:49: 0: STDOUT: [2017/Feb/6|15:17:48] V-Ray: (Estimated time remaining: 0h 0m 0.0s): 99 % completed
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Successfully written image file “X:/PROJECTS/2017_Test/images/2017_test/masterLayer/2017_test_masterLayer.0002.exr”
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Number of raycasts: 3608958 (1.74 per pixel)
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Camera rays: 2447392 (1.18 per pixel)
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Shadow rays: 387242 (0.19 per pixel)
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: GI rays: 774324 (0.37 per pixel)
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Reflection rays: 0 (0.00 per pixel)
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Refraction rays: 0 (0.00 per pixel)
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Unshaded rays: 0 (0.00 per pixel)
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Number of light evaluations: 129054 (0.06 per pixel)
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Number of intersectable primitives: 13
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: SD triangles: 12
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: MB triangles: 0
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Static primitives: 0
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Moving primitives: 0
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Infinite primitives: 1
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Static hair segments: 0
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Moving hair segments: 0
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Total frame time 0h 0m 4.3s (4.3 s)
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Total sequence time 0h 0m 4.3s (4.3 s)
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Render complete
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: ========================
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Clearing exporter memory…
2017-02-06 15:17:52: 0: STDOUT: [2017/Feb/6|15:17:52] V-Ray: Total time clearing exporter memory 0h 0m 0.0s (0.0 s)
2017-02-06 15:17:52: 0: STDOUT: Scene X:\PROJECTS\2017_Test\scenes\2017_test.mb completed.
2017-02-06 15:17:53: 0: INFO: Process exit code: 0
2017-02-06 15:17:53: 0: Done executing plugin command of type ‘Render Task’

=======================================================
Details

Date: 02/06/2017 15:43:22
Frames: 2
Job Submit Date: 02/06/2017 15:41:47
Job User: rhobart
Average RAM Usage: 0 (0%)
Peak RAM Usage: 0 (0%)
Average CPU Usage: 0%
Peak CPU Usage: 0%
Used CPU Clocks (x10^6 cycles): 0
Total CPU Clocks (x10^6 cycles): 0

=======================================================
Slave Information

Slave Name: FARMW31
Version: v8.0.13.3 Release (2c55876a9)
Operating System: Windows 7 Professional (SP1)
Running As Service: No
Machine User: farmw31_User
IP Address: fe80::f16d:b502:ffdf:5b1e%13
MAC Address: AC:22:0B:8C:41:E4
CPU Architecture: x64
CPUs: 32
CPU Usage: 0%
Memory Usage: 4.8 GB / 64.0 GB (7%)
Free Disk Space: 60.225 GB
Video Card: Standard VGA Graphics Adapter

6

Well, it’s failing with what is usually a Windows #5 “Access denied” error:
msdn.microsoft.com/en-us/librar … 82(v=vs.85.aspx

I’m not sure why that’s happening here, but if you now want to try running the render outside of Deadline on FARMW31, you’d just have to run this from a command prompt:

"C:\Program Files\Autodesk\Maya2017\bin\Render.exe" -r vray -threads 0 -x 1920 -y 1080 -s 2 -e 2 -b 1 -rd "X:/PROJECTS/2017_Test/images" -im "<Scene>/<Layer>/<Scene>_<Layer>" -cam "persp" -proj "X:/PROJECTS/2017_Test" "X:\PROJECTS\2017_Test\scenes\2017_test.mb"

That’ll at least isolate the problem from Deadline so you can play around with plugins and config settings and manually trigger the render.

7

I think I have a fix. My farm nodes don’t have graphics cards. I added this Environment Variable and it seem to have fixed the intermittent crashing. All good now with no errors.

knowledge.autodesk.com/support/ … -time.html

8

Ugh. I’d forgotten about this one. Well done!

I’ll write up some notes for next time.

9

FYI. This issue and a few other edge cases are all documented here in our docs as well:
docs.thinkboxsoftware.com/produc … d-meanings

10

I actually have this problem on my rendernodes and I had to do all three of these things to make Maya 2017 work reliably on a headless render node.

a) Turn off OpenCL via environment variable MAYA_OPENCL_IGNORE_DRIVER_VERSION to value 1

b) Turn off OpenGL via environment variable MAYA_VP2_DEVICE_OVERRIDE to VirtualDeviceDx11

c) Make sure the syncolor xml “synColorConfig.xml” inside the Users’ folder (meaning the user that the renderfarm is rendering as) has to have the line “” in it.

To expand: the syncolor file should look like this:

<?xml version="1.0" encoding="UTF-8"?> <SynColorConfig version="2.0"> <AutoConfigure graphicsMonitor="false" /> <TransformsHome dir="C:/Program Files/Autodesk/Maya2017/synColor" /> <SharedHome dir="C:/Users/quberender/Documents/maya/synColor/Shared/" /> <ReferenceTable> <Ref alias="OutputToSceneBridge" path="misc/identity.ctf" basePath="Autodesk" /> <Ref alias="SceneToOutputBridge" path="RRT+ODT/ACES_to_CIE-XYZ_v0.1.1.ctf" basePath="Autodesk" /> <Ref alias="broadcastMonitor" path="display/broadcast/CIE-XYZ_to_HD-video.ctf" basePath="Autodesk" /> <Ref alias="defaultLook" path="misc/identity.ctf" basePath="Autodesk" /> <Ref alias="graphicsMonitor" path="interchange/sRGB/CIE-XYZ_to_sRGB.ctf" basePath="Autodesk" /> </ReferenceTable> </SynColorConfig>

11

Massive virtual hug to rhagen, you’re a genius! If we ever meet in person, please allow me to buy you a beer.

I’ve been wrestling the exact same issue for a couple of days, and your fixes solved it. Our error rate was closer to 100%.

Fixes a) and b) where required for all slaves. Fix c) was required was for half of our farm, because I had rolled it out slightly differently.

Roll out 1: Fix c) NOT required:

I deployed Maya 2017 + VRay; then I ran a test job that created the user folder. The synColorConfig.xml was okay and had the TransformsHome entry. I applied Fixes a) and b) deployed Maya Update 2, and all is now good.

Roll out 2: Fix c) WAS required.

I deployed Maya 2017 + VRay + Update2; then I ran a test job that created the user folder. The synColorConfig.xml was missing the TransformsHome entry. I applied Fixes a) b) and c), and all is now good.

Hope this feedback makes sense, and provides additional insight to anyone facing the same issue.

12

I’ve created an internal ticket to see what we can do to help automate this stuff in the future. Thanks for the feedback all! :slight_smile:

13

Hi Mike,

Deadline automation is always great, but it’s an Autodesk (and maybe VRay?) issue. I reproduced the error through Backburner, so it’s not Deadline specific.

It’s certainly worth gauging if it’s a candidate to be added to your ‘Error Message and Meanings’ section of the Deadline/Maya documentation page. This is always my first go-to place when I hit similar problems.

Best
Jim

14

Hi Jim,

Yeah, after internal discussion, we are also thinking the same here as well. We already have this error and these known solutions in our Maya docs:
docs.thinkboxsoftware.com/produc … d-meanings

A colleague mentioned to me that some/all of these issues stem from not running the latest Nvidia graphics drivers on the machines. So, it would be good to maybe clarify if that was the root of your issues. However, it doesn’t answer the issue of machines with no dedicated graphics card…or a non-Nvidia card…or does it?

15

Nope, sadly the Nvidia gpu driver solution isn’t a workable fix for either our bare metal or VM slaves. Both are CPU only, and only have basic VGA video controllers.

16

Autodesk posted the latest -

knowledge.autodesk.com/support/ … -card.html

They had lots of calls on that I guess.

17

Tks guys! Brilliant stuff here!