It seems the post job script errors can take down the slave, and it does not automatically restart.
These are the last lines of the slave log:
2013-02-15 12:14:17: Exception Details
2013-02-15 12:14:17: RenderPluginException – Post job script “//inferno2/exchange/software/managed/pythonScripts/site-packages/scl/farm/postScripts/removeSoftwareDepth.py”: Python Exception: IndexError : array index out of range (Python.Runtime.PythonException)
2013-02-15 12:14:17: Type: <type ‘exceptions.IndexError’>
2013-02-15 12:14:17: Value: array index out of range
2013-02-15 12:14:17: Stack Trace:
2013-02-15 12:14:17: [’ File “none”, line 12, in main\n’]
2013-02-15 12:14:17: (System.Exception)
2013-02-15 12:14:17: at FranticX.Scripting.PythonNetScriptEngine.a(Exception A_0)
2013-02-15 12:14:17: at FranticX.Scripting.PythonNetScriptEngine.CallFunction(String functionName, PyTuple args)
2013-02-15 12:14:17: at Deadline.Scripting.DeadlineScriptManager.CallFunction(String scopeName, String functionName, PyTuple args)
2013-02-15 12:14:17: at Deadline.Plugins.ScriptPlugin.RenderScript(Job job, String scriptFilename, Boolean preJobScript, String& outMessage, AbortLevel& abortLevel)
2013-02-15 12:14:17: at Deadline.Plugins.ScriptPlugin.RenderScript(Job job, String scriptFilename, Boolean preJobScript, String& outMessage, AbortLevel& abortLevel)
2013-02-15 12:14:17: RenderPluginException.Cause: JobError (2)
2013-02-15 12:14:17: RenderPluginException.Level: Major (1)
2013-02-15 12:14:17: RenderPluginException.HasSlaveLog: True
2013-02-15 12:14:17: Exception.Data: ( )
2013-02-15 12:14:17: Exception.TargetSite: Void RenderScript(Deadline.Jobs.Job, System.String, Boolean)
2013-02-15 12:14:17: Exception.Source: deadline
2013-02-15 12:14:17: Exception.StackTrace:
2013-02-15 12:14:17: at Deadline.Plugins.Plugin.RenderScript(Job job, String scriptFilename, Boolean preJobScript)
2013-02-15 12:14:17: at Deadline.Slaves.SlaveRenderThread.a(TaskLogWriter A_0)
2013-02-15 12:14:17: <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2013-02-15 12:14:25: Scheduler Thread - Synchronizing job auxiliary files from \inferno2\deadline\repository6\jobs\511e6ecb969b59172c133dc7
2013-02-15 12:14:25: Scheduler Thread - Synchronization time for job files: 0.000 s
2013-02-15 12:14:26: Constructor: MayaBatch
2013-02-15 12:14:26: 0: Task timeout is being ignored because this is a Post Job Script Task
2013-02-15 12:14:26: 0: Loaded job: [TEST] Software Render: TST_001_0001_maya_animation_mayaRigCache.ma version: v0066 (511e6ecb969b59172c133dc7)
2013-02-15 12:14:26: 0: Plugin executing post job script
2013-02-15 12:14:27: 0: Executing Post Job Script: “//inferno2/exchange/software/managed/pythonScripts/site-packages/scl/farm/postScripts/removeSoftwareDepth.py”
2013-02-15 12:14:27: 0: INFO: Executing plugin script C:\Documents and Settings\ScanlineVFX\Local Settings\Application Data\Thinkbox\Deadline6\slave\LAPRO0319\plugins\MayaBatch.py
2013-02-15 12:14:27: 0: INFO: About: Maya Batch Plugin for Deadline
2013-02-15 12:14:27: 0: INFO: The job’s environment will be merged with the current environment before rendering
2013-02-15 12:14:27: 0: INFO: Executing post job script //inferno2/exchange/software/managed/pythonScripts/site-packages/scl/farm/postScripts/removeSoftwareDepth.py
2013-02-15 12:14:29: Scheduler Thread - Render Thread 0 threw a major error:
2013-02-15 12:14:29: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2013-02-15 12:14:29: Exception Details
2013-02-15 12:14:29: RenderPluginException – Post job script “//inferno2/exchange/software/managed/pythonScripts/site-packages/scl/farm/postScripts/removeSoftwareDepth.py”: Python Exception: IndexError : array index out of range (Python.Runtime.PythonException)
2013-02-15 12:14:29: Type: <type ‘exceptions.IndexError’>
2013-02-15 12:14:29: Value: array index out of range
2013-02-15 12:14:29: Stack Trace:
2013-02-15 12:14:29: [’ File “none”, line 12, in main\n’]
2013-02-15 12:14:29: (System.Exception)
2013-02-15 12:14:29: at FranticX.Scripting.PythonNetScriptEngine.a(Exception A_0)
2013-02-15 12:14:29: at FranticX.Scripting.PythonNetScriptEngine.CallFunction(String functionName, PyTuple args)
2013-02-15 12:14:29: at Deadline.Scripting.DeadlineScriptManager.CallFunction(String scopeName, String functionName, PyTuple args)
2013-02-15 12:14:29: at Deadline.Plugins.ScriptPlugin.RenderScript(Job job, String scriptFilename, Boolean preJobScript, String& outMessage, AbortLevel& abortLevel)
2013-02-15 12:14:29: at Deadline.Plugins.ScriptPlugin.RenderScript(Job job, String scriptFilename, Boolean preJobScript, String& outMessage, AbortLevel& abortLevel)
2013-02-15 12:14:29: RenderPluginException.Cause: JobError (2)
2013-02-15 12:14:29: RenderPluginException.Level: Major (1)
2013-02-15 12:14:29: RenderPluginException.HasSlaveLog: True
2013-02-15 12:14:29: Exception.Data: ( )
2013-02-15 12:14:29: Exception.TargetSite: Void RenderScript(Deadline.Jobs.Job, System.String, Boolean)
2013-02-15 12:14:29: Exception.Source: deadline
2013-02-15 12:14:29: Exception.StackTrace:
2013-02-15 12:14:29: at Deadline.Plugins.Plugin.RenderScript(Job job, String scriptFilename, Boolean preJobScript)
2013-02-15 12:14:29: at Deadline.Slaves.SlaveRenderThread.a(TaskLogWriter A_0)
2013-02-15 12:14:29: <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2013-02-15 12:14:36: Scheduler Thread - Synchronizing job auxiliary files from \inferno2\deadline\repository6\jobs\511e6ecb969b59172c133dc7
2013-02-15 12:14:36: Scheduler Thread - Synchronization time for job files: 0.000 s
2013-02-15 12:14:37: Constructor: MayaBatch
2013-02-15 12:14:37: 0: Task timeout is being ignored because this is a Post Job Script Task
2013-02-15 12:14:37: 0: Loaded job: [TEST] Software Render: TST_001_0001_maya_animation_mayaRigCache.ma version: v0066 (511e6ecb969b59172c133dc7)
2013-02-15 12:14:37: 0: Plugin executing post job script
2013-02-15 12:14:37: 0: Executing Post Job Script: “//inferno2/exchange/software/managed/pythonScripts/site-packages/scl/farm/postScripts/removeSoftwareDepth.py”
2013-02-15 12:14:37: 0: INFO: Executing plugin script C:\Documents and Settings\ScanlineVFX\Local Settings\Application Data\Thinkbox\Deadline6\slave\LAPRO0319\plugins\MayaBatch.py
2013-02-15 12:14:37: 0: INFO: About: Maya Batch Plugin for Deadline
2013-02-15 12:14:37: 0: INFO: The job’s environment will be merged with the current environment before rendering
2013-02-15 12:14:37: 0: INFO: Executing post job script //inferno2/exchange/software/managed/pythonScripts/site-packages/scl/farm/postScripts/removeSoftwareDepth.py
The slave then stalled, remoting in showed the process gone.