Everytime we submit a Max job (we are running 2014) to the farm (running latest RC1, but has been around for several previous beta versions) we get a couple of errors thrown up saying the following
Error in StartJob: ExecuteScript: Timed out waiting for the lightning 3dsmax plugin to acknowledge the ExecuteScript command.
But the job then picks up and renders fine. It only tends to happen on a couple of nodes, even if 10+ are assigned to the job. These are not the same nodes every time. Confused. Full error report below.
=======================================================
Error
=======================================================
Error in StartJob: ExecuteScript: Timed out waiting for the lightning 3dsmax plugin to acknowledge the ExecuteScript command.
2014/01/08 11:24:25 DBG: [02744] [02748] Starting network
2014/01/08 11:24:27 DBG: [02744] [02748] Calling NetRenderPreLoad
2014/01/08 11:24:27 DBG: [02744] [02748] in NetWorkerPreLoad. jobFile: ; jobname: C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\deadlineStartupMax2014.max
2014/01/08 11:24:27 DBG: [02744] [02748] in Init. jobFile: ; jobname: C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\deadlineStartupMax2014.max
2014/01/08 11:24:27 DBG: [02744] [02748] in Init. calling nrGetIface. jobToSend: C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\deadlineStartupMax2014.max
2014/01/08 11:24:27 DBG: [02744] [02748] in NetWorkerPreLoad. curJobname: C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\deadlineStartupMax2014.max; init: 0
2014/01/08 11:24:27 DBG: [02744] [02748] in NetWorkerPreLoad. calling PostInitMessageSystem()
2014/01/08 11:24:27 DBG: [02744] [02748] in NetWorkerPreLoad. srv_pid: 0
2014/01/08 11:24:27 DBG: [02744] [02748] leaving NetWorkerPreLoad. LoadLib()
2014/01/08 11:24:27 DBG: [02744] [02748] NetRenderPreLoad passed
2014/01/08 11:24:28 INF: [02744] [02748] [V-Ray] ============================================================
2014/01/08 11:24:28 INF: [02744] [02748] [V-Ray] Console created, V-Ray A for x64 from Jun 7 2013, 22:53:57
2014/01/08 11:24:28 INF: [02744] [02748] [V-Ray] ============================================================
2014/01/08 11:24:28 INF: [02744] [02748] [V-Ray] Compiled with Intel C++ compiler, version 12.1
2014/01/08 11:24:28 INF: [02744] [02748] [V-Ray] Host is 3dsmax, version 16
2014/01/08 11:24:28 INF: [02744] [02748] [V-Ray] V-Ray DLL version is 2.00.01
2014/01/08 11:24:32 DBG: [02744] [02748] Interface8::LoadFromFile(C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\deadlineStartupMax2014.max)
2014/01/08 11:24:32 INF: [02744] [02748] Starting to load file: C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\deadlineStartupMax2014.max
2014/01/08 11:24:33 INF: [02744] [02748] SYSTEM: Production renderer is changed to Default Scanline Renderer. Previous messages are cleared.
2014/01/08 11:24:34 INF: [02744] [02748] Done loading file: C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\deadlineStartupMax2014.max
2014/01/08 11:24:34 DBG: [02744] [02748] Interface8::LoadFromFile(C:/Users/RewindFX/AppData/Local/Thinkbox/Deadline6/slave/RENDER-D02/jobsData/52cd345b6a30da3858190517/RWD_DraftFCB_i10Parallax_v14_2D.max)
2014/01/08 11:24:34 INF: [02744] [02748] Starting to load file: C:/Users/RewindFX/AppData/Local/Thinkbox/Deadline6/slave/RENDER-D02/jobsData/52cd345b6a30da3858190517/RWD_DraftFCB_i10Parallax_v14_2D.max
2014/01/08 11:24:35 WRN: [02744] [02748] Missing dll: Built-in - AnchorHelperObject
2014/01/08 11:24:37 INF: [02744] [02748] Done loading file: C:/Users/RewindFX/AppData/Local/Thinkbox/Deadline6/slave/RENDER-D02/jobsData/52cd345b6a30da3858190517/RWD_DraftFCB_i10Parallax_v14_2D.max
2014/01/08 11:24:37 INF: [02744] [02748] SYSTEM: Production renderer is changed to V-Ray Adv 2.40.04. Previous messages are cleared.
at Deadline.Plugins.ScriptPlugin.StartJob(Job job, String& outMessage, AbortLevel& abortLevel)
=======================================================
Type
=======================================================
RenderPluginException
=======================================================
Stack Trace
=======================================================
at Deadline.Plugins.Plugin.StartJob(Job job)
at Deadline.Slaves.SlaveRenderThread.RenderCurrentTask(TaskLogWriter tlw)
=======================================================
Full Log
=======================================================
0: Task timeout is disabled.
0: Loaded job: RWD_DraftFCB_i10Parallax_v14_2D (52cd345b6a30da3858190517)
0: Successfully mapped S: to \\BILL\LiveProjects
0: Successfully mapped X: to \\BILL\ResourceLibrary
0: INFO: Executing plugin script C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\3dsmax.py
0: INFO: About: 3dsmax Plugin for Deadline
0: INFO: The current environment will be used for rendering
0: INFO: Start Job called - starting up 3dsmax plugin
0: INFO: Sys Env Var PATH: C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\Common Files\Autodesk Shared\;C:\Program Files (x86)\Autodesk\Backburner\;C:\Program Files (x86)\QuickTime\QTSystem\
0: INFO: Sys Env Var PATH length: 233
0: INFO: Backburner Path(s) Found in PATH: 'C:\Program Files (x86)\Autodesk\Backburner\'
0: INFO: Backburner server.exe version: 2014.0.0.1635
0: INFO: Rendering with 3dsmax version: 2014
0: INFO: Not forcing a build of 3dsmax because version 2014 and later is 64 bit only
0: INFO: Rendering with executable: C:\Program Files\Autodesk\3ds Max 2014\3dsmax.exe
0: INFO: 3dsmax.exe version: 16.3.253.0
0: INFO: Checking registry for 3dsmax language code
0: INFO: Language code string: ENU
0: INFO: Language sub directory: en-US
0: INFO: Fail on existing 3dsmax process: 0
0: INFO: Load 3dsmax timeout: 1000 seconds
0: INFO: Start job timeout: 1000 seconds
0: INFO: Progress update timeout: 8000 seconds
0: INFO: Progress update timeout disabled: 0
0: INFO: Kill ADSK WSCommCntr*.exe process: True
0: INFO: Slave mode enabled: 1
0: INFO: Silent mode enabled: 0
0: INFO: Local rendering enabled: 1
0: INFO: Running render sanity check using 3dsmaxcmd.exe
0: INFO: 3dsmaxcmd.exe returned: 08/01/2014 11:23:39; Error opening scene file: "C:\Program Files\Autodesk\3ds Max 2014\"
0: INFO: 3dsmax start up file: C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\deadlineStartupMax2014.max
0: INFO: Using user profiles: 1
0: INFO: 3dsmax user profile path: C:\Users\RewindFX\AppData\Local\Autodesk\3dsmax\2014 - 64bit\ENU
0: INFO: 3dsmax data path: C:\Users\RewindFX\AppData\Local\Autodesk\3dsMax\2014 - 64bit\ENU\
0: INFO: 3dsmax ini file: C:\Users\RewindFX\AppData\Local\Autodesk\3dsmax\2014 - 64bit\ENU\3dsmax.ini
0: INFO: Network log file: C:\Users\RewindFX\AppData\Local\Autodesk\3dsmax\2014 - 64bit\ENU\Network\Max.log
0: INFO: Plugin ini file: C:\Program Files\Autodesk\3ds Max 2014\en-US\plugin.ini
0: INFO: Including user profile plugin ini: C:\Users\RewindFX\AppData\Local\Autodesk\3dsMax\2014 - 64bit\ENU\Plugin.UserSettings.ini
0: INFO: Lightning connection plugin: C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\lightning64Max2014.dlx
0: INFO: 3dsmax socket connection port: 49187
0: INFO: Setting up startup environment
0: INFO: Copying C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\lightning64Max2014.dlx to C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\temp\lightning\lightning.dlx
0: INFO: Starting monitored managed process 3dsmaxProcess
0: INFO: Stdout Handling Enabled: True
0: INFO: Popup Handling Enabled: True
0: INFO: Using Process Tree: True
0: INFO: Hiding DOS Window: False
0: INFO: Creating New Console: False
0: INFO: Executable: "C:\Program Files\Autodesk\3ds Max 2014\3dsmax.exe"
0: INFO: Argument: -p "C:\Users\RewindFX\AppData\Local\Temp\dl.ini" -q -s "C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\deadlineStartupMax2014.max"
0: INFO: Startup Directory: "C:\Program Files\Autodesk\3ds Max 2014"
0: INFO: Process Priority: BelowNormal
0: INFO: Process Affinity: default
0: INFO: Process is now running
0: INFO: Waiting for connection from 3dsmax
0: STDOUT: - 11:23:43.000 INFO: Begin setting up global configuration
0: STDOUT: - 11:23:43.078 INFO: Begin resolve assembly 'Autodesk.Max.Wrappers.XmlSerializers, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null- 11:23:43.078 INFO: Cannot resolve assembly
0: STDOUT: - 11:23:43.078 INFO: Begin resolve assembly 'Autodesk.Max.Wrappers.XmlSerializers- 11:23:43.078 INFO: Cannot resolve assembly
0: STDOUT: - 11:23:44.281 INFO: Begin resolve assembly 'Autodesk.Max.Wrappers, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null- 11:23:44.281 INFO: Resolving current assembly
0: STDOUT: - 11:23:44.296 INFO: End setting up global configuration
0: STDOUT: - 11:23:44.296 INFO: Begin initialize system watcher to detect file changes
0: STDOUT: - 11:23:44.296 INFO: End initialize system watcher to detect file changes
0: STDOUT: - 11:23:44.296 INFO: Begin loading assemblies
0: STDOUT: - 11:23:44.296 INFO: Begin loading assembly 'C:\Program Files\Autodesk\3ds Max 2014\bin\assemblies\Autodesk.Max.StateSets.dll- 11:23:44.312 INFO: Begin loading assembly file
0: STDOUT: - 11:23:44.312 INFO: End loading assembly file
0: STDOUT: - 11:23:44.312 INFO: Begin discovering pluggable types in assembly
0: STDOUT: - 11:23:44.406 INFO: Retrieved a list of types, processing
0: STDOUT: - 11:23:44.406 INFO: Discovered IPlugin-derived type 'Plugin- 11:23:44.421 INFO: Begin resolve assembly 'Autodesk.Max.StateSets.XmlSerializers, Version=16.3.253.0, Culture=neutral, PublicKeyToken=null- 11:23:44.421 INFO: Cannot resolve assembly
0: STDOUT: - 11:23:44.421 INFO: Begin resolve assembly 'Autodesk.Max.StateSets.XmlSerializers- 11:23:44.421 INFO: Cannot resolve assembly
0: STDOUT: - 11:23:44.608 INFO: Begin resolve assembly 'Autodesk.Max.StateSets, Version=16.3.253.0, Culture=neutral, PublicKeyToken=null- 11:23:44.608 INFO: Cannot resolve assembly
0: STDOUT: - 11:23:44.123 INFO: Created instance of type
0: STDOUT: - 11:23:44.123 INFO: Adding as startup/static plugin
0: STDOUT: - 11:23:44.123 INFO: Discovered IPlugin-derived type 'Plugin- 11:23:44.123 INFO: Created instance of type
0: STDOUT: - 11:23:44.123 INFO: Adding as startup/static plugin
0: STDOUT: - 11:23:44.123 INFO: End discovering pluggable types in assembly
0: STDOUT: - 11:23:44.139 INFO: End loading assembly
0: STDOUT: - 11:23:44.139 INFO: Begin loading assembly 'C:\Program Files\Autodesk\3ds Max 2014\bin\assemblies\Autodesk.Max.Wrappers.dll- 11:23:44.139 INFO: Begin loading assembly file
0: STDOUT: - 11:23:44.139 INFO: End loading assembly file
0: STDOUT: - 11:23:44.139 INFO: Begin discovering pluggable types in assembly
0: STDOUT: - 11:23:45.201 INFO: Retrieved a list of types, processing
0: STDOUT: - 11:23:45.264 INFO: End discovering pluggable types in assembly
0: STDOUT: - 11:23:45.264 INFO: End loading assembly
0: STDOUT: - 11:23:45.264 INFO: Begin loading assembly 'C:\Program Files\Autodesk\3ds Max 2014\bin\assemblies\DaylightSimulation.dll- 11:23:45.264 INFO: Begin loading assembly file
0: STDOUT: - 11:23:45.264 INFO: End loading assembly file
0: STDOUT: - 11:23:45.264 INFO: Begin discovering pluggable types in assembly
0: STDOUT: - 11:23:45.279 INFO: Retrieved a list of types, processing
0: STDOUT: - 11:23:45.295 INFO: End discovering pluggable types in assembly
0: STDOUT: - 11:23:45.295 INFO: End loading assembly
0: STDOUT: - 11:23:45.295 INFO: Begin loading assembly 'C:\Program Files\Autodesk\3ds Max 2014\bin\assemblies\FPMaxWpfContent.dll- 11:23:45.295 INFO: Begin loading assembly file
0: STDOUT: - 11:23:45.295 INFO: End loading assembly file
0: STDOUT: - 11:23:45.295 INFO: Begin discovering pluggable types in assembly
0: STDOUT: - 11:23:45.295 INFO: Retrieved a list of types, processing
0: STDOUT: - 11:23:45.295 INFO: End discovering pluggable types in assembly
0: STDOUT: - 11:23:45.295 INFO: End loading assembly
0: STDOUT: - 11:23:45.295 INFO: Begin loading assembly 'C:\Program Files\Autodesk\3ds Max 2014\bin\assemblies\ManagedBootstrap.dll- 11:23:45.295 INFO: Begin loading assembly file
0: STDOUT: - 11:23:45.295 INFO: End loading assembly file
0: STDOUT: - 11:23:45.295 INFO: Begin discovering pluggable types in assembly
0: STDOUT: - 11:23:45.295 INFO: Retrieved a list of types, processing
0: STDOUT: - 11:23:45.295 INFO: End discovering pluggable types in assembly
0: STDOUT: - 11:23:45.295 INFO: End loading assembly
0: STDOUT: - 11:23:45.295 INFO: Begin loading assembly 'C:\Program Files\Autodesk\3ds Max 2014\bin\assemblies\ManagedNetworkUtilities.dll- 11:23:45.295 INFO: Begin loading assembly file
0: STDOUT: - 11:23:45.295 INFO: End loading assembly file
0: STDOUT: - 11:23:45.295 INFO: Begin discovering pluggable types in assembly
0: STDOUT: - 11:23:45.295 INFO: Retrieved a list of types, processing
0: STDOUT: - 11:23:45.295 INFO: End discovering pluggable types in assembly
0: STDOUT: - 11:23:45.295 INFO: End loading assembly
0: STDOUT: - 11:23:45.295 INFO: Begin loading assembly 'C:\Program Files\Autodesk\3ds Max 2014\bin\assemblies\MaterialExplorerView.dll- 11:23:45.295 INFO: Begin loading assembly file
0: STDOUT: - 11:23:45.295 INFO: End loading assembly file
0: STDOUT: - 11:23:45.295 INFO: Begin discovering pluggable types in assembly
0: STDOUT: - 11:23:45.295 INFO: Retrieved a list of types, processing
0: STDOUT: - 11:23:45.295 INFO: End discovering pluggable types in assembly
0: STDOUT: - 11:23:45.295 INFO: End loading assembly
0: STDOUT: - 11:23:45.295 INFO: Begin loading assembly 'C:\Program Files\Autodesk\3ds Max 2014\bin\assemblies\MaxWpfContent.dll- 11:23:45.295 INFO: Begin loading assembly file
0: STDOUT: - 11:23:45.295 INFO: End loading assembly file
0: STDOUT: - 11:23:45.295 INFO: Begin discovering pluggable types in assembly
0: STDOUT: - 11:23:45.326 INFO: Retrieved a list of types, processing
0: STDOUT: - 11:23:45.342 INFO: End discovering pluggable types in assembly
0: STDOUT: - 11:23:45.342 INFO: End loading assembly
0: STDOUT: - 11:23:45.342 INFO: Begin loading assembly 'C:\Program Files\Autodesk\3ds Max 2014\bin\assemblies\nunit.framework.dll- 11:23:45.342 INFO: Begin loading assembly file
0: STDOUT: - 11:23:45.342 INFO: End loading assembly file
0: STDOUT: - 11:23:45.342 INFO: Begin discovering pluggable types in assembly
0: STDOUT: - 11:23:45.342 INFO: Retrieved a list of types, processing
0: STDOUT: - 11:23:45.342 INFO: End discovering pluggable types in assembly
0: STDOUT: - 11:23:45.342 INFO: End loading assembly
0: STDOUT: - 11:23:45.342 INFO: Begin loading assembly 'C:\Program Files\Autodesk\3ds Max 2014\bin\assemblies\SceneExplorerView.dll- 11:23:45.342 INFO: Begin loading assembly file
0: STDOUT: - 11:23:45.342 INFO: End loading assembly file
0: STDOUT: - 11:23:45.342 INFO: Begin discovering pluggable types in assembly
0: STDOUT: - 11:23:45.357 INFO: Retrieved a list of types, processing
0: STDOUT: - 11:23:45.357 INFO: End discovering pluggable types in assembly
0: STDOUT: - 11:23:45.357 INFO: End loading assembly
0: STDOUT: - 11:23:45.357 INFO: Begin loading assembly 'C:\Program Files\Autodesk\3ds Max 2014\bin\assemblies\Sunlight.dll- 11:23:45.357 INFO: Begin loading assembly file
0: STDOUT: - 11:23:45.357 INFO: End loading assembly file
0: STDOUT: - 11:23:45.357 INFO: Begin discovering pluggable types in assembly
0: STDOUT: - 11:23:45.357 INFO: Retrieved a list of types, processing
0: STDOUT: - 11:23:45.357 INFO: End discovering pluggable types in assembly
0: STDOUT: - 11:23:45.357 INFO: End loading assembly
0: STDOUT: - 11:23:45.357 INFO: End loading assemblies
0: STDOUT: - 11:23:45.373 INFO: Begin registering loaded plugins
0: STDOUT: - 11:24:23.858 INFO: Begin resolve assembly 'ManagedMC3, Version=7.2.0.0, Culture=neutral, PublicKeyToken=99052d24520ebbb3- 11:24:23.858 INFO: Cannot resolve assembly
0: INFO: Connected to 3dsmax plugin version Lightning 6.1.0.54062 Dec 11 2013 08:28:03 R
0: INFO: Scene file to render: "C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\jobsData\52cd345b6a30da3858190517\RWD_DraftFCB_i10Parallax_v14_2D.max"
0: INFO: Camera: "Camera001"
0: INFO: Restarting renderer after each frame: 1
0: INFO: Showing frame buffer: 0
0: INFO: Overriding render output: "S:\DraftFCB\i10_Parallax_WebSite\Production\Renders\131122_draft_comp\2.5D_particles\RWD_i10_2half_particles_.exr"
0: INFO: Overriding save file option: True
0: INFO: Frame number base: 0
0: INFO: Remove padding from output filename: 0
0: INFO: Ignore missing external file errors: 1
0: INFO: Ignore missing UVW errors: 1
0: INFO: Ignore missing XREF errors: 1
0: INFO: Ignore missing DLL errors: 1
0: INFO: Disabling Multipass: 0
0: INFO: Loading 3dsmax scene file
0: INFO: Scene loaded successfully
0: INFO: Killed ADSK Communication Center process: WSCommCntr4
0: INFO: Executing script: C:\Users\RewindFX\AppData\Local\Thinkbox\Deadline6\slave\RENDER-D02\plugins\52cd345b6a30da3858190517\customize.ms
=======================================================
Details
=======================================================
Date: 01/08/2014 11:25:36
Frames: 3
Elapsed Time: 00:00:01:25
Job Submit Date: 01/08/2014 11:20:30
Job User: mvc
Average RAM Usage: 1961994624 (12%)
Peak RAM Usage: 2398314496 (14%)
Average CPU Usage: 13%
Peak CPU Usage: 93%
=======================================================
Slave Information
=======================================================
Slave Name: RENDER-D02
Version: v6.1.0.54062 R
Operating System: Windows 7 Professional
Machine User: RewindFX
IP Address: fe80::7895:e452:45bf:a91e%12
MAC Address: 00:15:17:9F:5A:24
CPU Architecture: x64
CPUs: 8
CPU Usage: 0%
Memory Usage: 2.2 GB / 16.0 GB (13%)
Free Disk Space: 862.854 GB
Video Card: Standard VGA Graphics Adapter