2021-05-20 23:59:33: The license files (or license server system network addresses) attempted are
2021-05-20 23:59:33: listed below. Use LM_LICENSE_FILE to use a different license file,
2021-05-20 23:59:33: or contact your software provider for a license file.
2021-05-20 23:59:33: Feature: deadline
2021-05-20 23:59:33: Filename: C:\flexlm\license.dat
2021-05-20 23:59:33: License path: C:\flexlm\license.dat;
2021-05-20 23:59:33: FlexNet Licensing error:-1,359. System Error: 2 “No such file or directory”
2021-05-20 23:59:33: For further information, refer to the FlexNet Licensing documentation,
2021-05-20 23:59:33: available at “www.flexerasoftware.com”.
2021-05-20 23:59:33: Failed to checkout a license using current configuration, checking for auto configuration…
2021-05-20 23:59:33: Auto Configuration: Picking configuration based on: DESKTOP-7DR5NMQ / 192.168.1.110
2021-05-20 23:59:33: Auto Configuration: No auto configuration could be detected, using local configuration
2021-05-20 23:59:33: 0: Loading Job’s Plugin timeout is Disabled
2021-05-20 23:59:33: ERROR: Encountered the following error while initializing the Plugin Sandbox: ‘Value cannot be null. (Parameter ‘input’)’.
2021-05-20 23:59:33: Cannot render the current job [ID:“60a63f524644762ce0b0a845” / Name:“PDG SUBMIT AS GRAPH JOB”]. Contact Thinkbox Support for more information.
2021-05-20 23:59:34: Scheduler Thread - Render Thread 0 threw a major error:
2021-05-20 23:59:34: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-05-20 23:59:34: Exception Details
2021-05-20 23:59:34: RenderPluginException – Failed to load the plugin because: Could not initialize the plugin sandbox (Deadline.Plugins.PluginException)
2021-05-20 23:59:34: RenderPluginException.Cause: PluginLoadError (0)
2021-05-20 23:59:34: RenderPluginException.Level: Major (1)
2021-05-20 23:59:34: RenderPluginException.HasSlaveLog: True
2021-05-20 23:59:34: RenderPluginException.SlaveLogFileName: C:\ProgramData\Thinkbox\Deadline10\logs\deadlineslave_renderthread_0-DESKTOP-7DR5NMQ-0000.log
2021-05-20 23:59:34: Exception.TargetSite: Boolean e(System.String, Deadline.Jobs.Job, System.Threading.CancellationToken)
2021-05-20 23:59:34: Exception.Data: ( )
2021-05-20 23:59:34: Exception.Source: deadline
2021-05-20 23:59:34: Exception.HResult: -2146233088
2021-05-20 23:59:34: Exception.StackTrace:
2021-05-20 23:59:34: at Deadline.Slaves.SlaveRenderThread.e(String ajq, Job ajr, CancellationToken ajs)
2021-05-20 23:59:34: at Deadline.Slaves.SlaveRenderThread.b(TaskLogWriter ajm, CancellationToken ajn)
2021-05-20 23:59:34: <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021-05-20 23:59:36: Skipping pending job scan because it is not required at this time
2021-05-20 23:59:36: Skipping repository repair because it is not required at this time
2021-05-20 23:59:36: Skipping house cleaning because it is not required at this time
2021-05-20 23:59:36: Could not obtain license because:
2021-05-20 23:59:36: Cannot find license file.
If you right-click the Deadline Launcher > Change License Server, and switch to No License, does that fix the issue?
I would have expected the Worker to switch to License Free Mode if the list of Workers has less than 11 entries on the list. But forcing the Worker to not look for a license should work around this.
Hi Bobo
thanks a lot, i thought that would do it but i still have an issue with the workers, just a different log output. (sorry for adding the log of three tasks but the last part mentions something about holder “computername” not found which i thought would be useful to add.
2021-05-21 07:35:40: 0: Loading Job’s Plugin timeout is Disabled
2021-05-21 07:35:40: ERROR: Encountered the following error while initializing the Plugin Sandbox: ‘Value cannot be null. (Parameter ‘input’)’.
2021-05-21 07:35:40: Cannot render the current job [ID:“60a6d629f967ef11f89eb5aa” / Name:“PDG SUBMIT AS GRAPH JOB”]. Contact Thinkbox Support for more information.
2021-05-21 07:35:42: Scheduler Thread - Render Thread 0 threw a major error:
2021-05-21 07:35:42: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-05-21 07:35:42: Exception Details
2021-05-21 07:35:42: RenderPluginException – Failed to load the plugin because: Could not initialize the plugin sandbox (Deadline.Plugins.PluginException)
2021-05-21 07:35:42: RenderPluginException.Cause: PluginLoadError (0)
2021-05-21 07:35:42: RenderPluginException.Level: Major (1)
2021-05-21 07:35:42: RenderPluginException.HasSlaveLog: True
2021-05-21 07:35:42: RenderPluginException.SlaveLogFileName: C:\ProgramData\Thinkbox\Deadline10\logs\deadlineslave_renderthread_0-DESKTOP-7DR5NMQ-0000.log
2021-05-21 07:35:42: Exception.TargetSite: Boolean e(System.String, Deadline.Jobs.Job, System.Threading.CancellationToken)
2021-05-21 07:35:42: Exception.Data: ( )
2021-05-21 07:35:42: Exception.Source: deadline
2021-05-21 07:35:42: Exception.HResult: -2146233088
2021-05-21 07:35:42: Exception.StackTrace:
2021-05-21 07:35:42: at Deadline.Slaves.SlaveRenderThread.e(String ajq, Job ajr, CancellationToken ajs)
2021-05-21 07:35:42: at Deadline.Slaves.SlaveRenderThread.b(TaskLogWriter ajm, CancellationToken ajn)
2021-05-21 07:35:42: <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021-05-21 07:35:44: Skipping pending job scan because it is not required at this time
2021-05-21 07:35:44: Skipping repository repair because it is not required at this time
2021-05-21 07:35:44: Skipping house cleaning because it is not required at this time
2021-05-21 07:35:44: Scheduler Thread - Job’s Limit Groups:
2021-05-21 07:35:44: 0: Loading Job’s Plugin timeout is Disabled
2021-05-21 07:35:44: ERROR: Encountered the following error while initializing the Plugin Sandbox: ‘Value cannot be null. (Parameter ‘input’)’.
2021-05-21 07:35:44: Cannot render the current job [ID:“60a6d629f967ef11f89eb5aa” / Name:“PDG SUBMIT AS GRAPH JOB”]. Contact Thinkbox Support for more information.
2021-05-21 07:35:45: Scheduler Thread - Render Thread 0 threw a major error:
2021-05-21 07:35:45: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-05-21 07:35:45: Exception Details
2021-05-21 07:35:45: RenderPluginException – Failed to load the plugin because: Could not initialize the plugin sandbox (Deadline.Plugins.PluginException)
2021-05-21 07:35:45: RenderPluginException.Cause: PluginLoadError (0)
2021-05-21 07:35:45: RenderPluginException.Level: Major (1)
2021-05-21 07:35:45: RenderPluginException.HasSlaveLog: True
2021-05-21 07:35:45: RenderPluginException.SlaveLogFileName: C:\ProgramData\Thinkbox\Deadline10\logs\deadlineslave_renderthread_0-DESKTOP-7DR5NMQ-0000.log
2021-05-21 07:35:45: Exception.TargetSite: Boolean e(System.String, Deadline.Jobs.Job, System.Threading.CancellationToken)
2021-05-21 07:35:45: Exception.Data: ( )
2021-05-21 07:35:45: Exception.Source: deadline
2021-05-21 07:35:45: Exception.HResult: -2146233088
2021-05-21 07:35:45: Exception.StackTrace:
2021-05-21 07:35:45: at Deadline.Slaves.SlaveRenderThread.e(String ajq, Job ajr, CancellationToken ajs)
2021-05-21 07:35:45: at Deadline.Slaves.SlaveRenderThread.b(TaskLogWriter ajm, CancellationToken ajn)
2021-05-21 07:35:45: <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021-05-21 07:35:47: Skipping pending job scan because it is not required at this time
2021-05-21 07:35:47: Skipping repository repair because it is not required at this time
2021-05-21 07:35:47: Skipping house cleaning because it is not required at this time
2021-05-21 07:35:47: Scheduler Thread - Job’s Limit Groups:
2021-05-21 07:35:47: 0: Loading Job’s Plugin timeout is Disabled
2021-05-21 07:35:47: ERROR: Encountered the following error while initializing the Plugin Sandbox: ‘Value cannot be null. (Parameter ‘input’)’.
2021-05-21 07:35:47: Cannot render the current job [ID:“60a6d629f967ef11f89eb5aa” / Name:“PDG SUBMIT AS GRAPH JOB”]. Contact Thinkbox Support for more information.
2021-05-21 07:35:49: Scheduler Thread - Render Thread 0 threw a major error:
2021-05-21 07:35:49: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-05-21 07:35:49: Exception Details
2021-05-21 07:35:49: RenderPluginException – Failed to load the plugin because: Could not initialize the plugin sandbox (Deadline.Plugins.PluginException)
2021-05-21 07:35:49: RenderPluginException.Cause: PluginLoadError (0)
2021-05-21 07:35:49: RenderPluginException.Level: Major (1)
2021-05-21 07:35:49: RenderPluginException.HasSlaveLog: True
2021-05-21 07:35:49: RenderPluginException.SlaveLogFileName: C:\ProgramData\Thinkbox\Deadline10\logs\deadlineslave_renderthread_0-DESKTOP-7DR5NMQ-0000.log
2021-05-21 07:35:49: Exception.TargetSite: Boolean e(System.String, Deadline.Jobs.Job, System.Threading.CancellationToken)
2021-05-21 07:35:49: Exception.Data: ( )
2021-05-21 07:35:49: Exception.Source: deadline
2021-05-21 07:35:49: Exception.HResult: -2146233088
2021-05-21 07:35:49: Exception.StackTrace:
2021-05-21 07:35:49: at Deadline.Slaves.SlaveRenderThread.e(String ajq, Job ajr, CancellationToken ajs)
2021-05-21 07:35:49: at Deadline.Slaves.SlaveRenderThread.b(TaskLogWriter ajm, CancellationToken ajn)
2021-05-21 07:35:49: <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021-05-21 07:35:51: Skipping pending job scan because it is not required at this time
2021-05-21 07:35:51: Skipping repository repair because it is not required at this time
2021-05-21 07:35:51: Skipping house cleaning because it is not required at this time
2021-05-21 07:35:51: WARNING: Limit ‘60a6d629f967ef11f89eb5aa’ with holder named ‘desktop-7dr5nmq’ could not be found.
2021-05-21 07:35:58: Skipping pending job scan because it is not required at this time
2021-05-21 07:35:58: Skipping repository repair because it is not required at this time
It looks like you’ve got the same issue as this thread where custom plugin locations don’t work in 10.1.15.2. Houdini’s PDG plugin relies on that feature, so that explains why 3dsmax is working and Houdini isn’t.
If you’re able, avoid PDG for the moment. I’m going to see if I can fiddle with the PDGDeadline plugin to work around this.
Fair warning, I haven’t tested this within Houdini, so I can’t be sure I’m not missing a step.
To test this, backup and replace the file in path\to\installation\directory\Houdini [version number]\houdini\pdg\types\schedulers. Delete the matching .pyc file to force it to grab your fresh file and try submitting a new job.
If the fix above doesn’t work or you’d like to try fixing your job without messing around in the submitter you can manually edit the job and plugin info files to make my changes.
To do that:
Go into Modify Job properties → Submission Params and hit ‘Export’
In the [jobid]_jobInfo.job file add \PDGDeadline to the end of the CustomPluginDirectory= line.
It should look something like \path\to\houdini\pdg\plugins\PDGDeadline.
Hi Justin!
I have just tried both solutions but unfortunately the logs are still the same.
The version of Houdini i’m using right now is with Python 2.7 as i’ve previously tried to see if changing from 3.0 solved the issue. Would that make a difference?
Switching to Python 3 will break all this, as it’s written for Python 2 so don’t worry about that.
If it doesn’t have any company secrets in it, could I get the job archive from your latest test? I’d like to see the submission parameters that were created to see if I can correct that script.
You can create the archive by right clicking it in the Monitor.
It looks like my changes didn’t take effect. I’ve got no clue when Houdini grabs changes to its scripts, so I’m going to assume you’ve tried restarting Houdini and all that good stuff.
Time for a plan B that’s a lot grubbier. Let’s avoid using the CustomPluginDirectory option at all.
Copy the PDGDeadline directory from \path\to\houdini\pdg\plugins\PDGDeadline into your \DeadlineRepository10\custom\plugins\ folder.
Submit your PDG job as usual, check off ‘Submit as Suspended’ to save a Worker from picking it up and immediately failing.
Double click on the job to get to ‘Modify Job Properties’. Go to ‘Submission Params’ and hit the ‘Export’ button on the top right. Save those files somewhere you can get at them easily.
In the Job info file (the ending in _jobinfo) remove the line with CustomPluginDirectory and save your changes.
In a command prompt, submit your updated job files with deadlinecommand [jobinfo file] [plugininfo file].
Resume that new job, and let me know what results you get back.
I couldn’t find the “submit as suspended” in the PDG deadline scheduler options (only in the deadline submitter!), so I’ve shut down the worker instead, and ran it again after submitting it through deadlinecommand.
This is the log.
2021-06-10 19:16:03: 0: STDOUT: [Redshift] Redshift for Houdini plugin version 3.0.45 (Apr 27 2021 18:37:23)
2021-06-10 19:16:03: 0: STDOUT: [Redshift] Plugin compile time HDK version: 18.5.532
2021-06-10 19:16:03: 0: STDOUT: [Redshift] Houdini host version: 18.5.532
2021-06-10 19:16:03: 0: STDOUT: [Redshift] Plugin dso/dll and config path: C:/ProgramData/Redshift/Plugins/Houdini/18.5.532/dso
2021-06-10 19:16:03: 0: STDOUT: [Redshift] Core data path: C:\ProgramData\Redshift
2021-06-10 19:16:03: 0: STDOUT: [Redshift] Local data path: C:\ProgramData\Redshift
2021-06-10 19:16:03: 0: STDOUT: [Redshift] Procedurals path: C:\ProgramData\Redshift\Procedurals
2021-06-10 19:16:03: 0: STDOUT: [Redshift] Preferences file path: C:\ProgramData\Redshift\preferences.xml
2021-06-10 19:16:03: 0: STDOUT: [Redshift] License path: C:\ProgramData\Redshift
2021-06-10 19:16:05: 0: STDOUT: C:/PROGRA~1/SIDEEF~1/HOUDIN~1.532/bin/hython.exe: can’t open file ‘Y:/R&D/Houdini/DEADLINE/pdgtemp/1084/scripts/topcook.py’: [Errno 2] No such file or directory
2021-06-10 19:16:05: 0: Done executing plugin command of type ‘Render Task’
2021-06-10 19:16:05: 0: Executing plugin command of type ‘End Job’
2021-06-10 19:16:05: 0: Done executing plugin command of type ‘End Job’
2021-06-10 19:16:09: Scheduler Thread - Render Thread 0 threw a major error:
2021-06-10 19:16:09: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-06-10 19:16:09: Exception Details
2021-06-10 19:16:09: RenderPluginException – Error: FailRenderException : PDGDeadline exception: Traceback (most recent call last):
2021-06-10 19:16:09: File “C:\ProgramData\Thinkbox\Deadline10\workers\DESKTOP-7DR5NMQ\plugins\60c1d841d14b670cd4fd9f38\PDGDeadline.py”, line 350, in RenderTasks
2021-06-10 19:16:09: self.FailRender(‘Process returned non-zero exit code: {}’.format(exitCode))
2021-06-10 19:16:09: FailRenderException: Process returned non-zero exit code: 2
2021-06-10 19:16:09: at Deadline.Plugins.DeadlinePlugin.FailRender(String message)
2021-06-10 19:16:09: at Deadline.Plugins.DeadlinePlugin.FailRender(String message) (Python.Runtime.PythonException)
2021-06-10 19:16:09: File “C:\ProgramData\Thinkbox\Deadline10\workers\DESKTOP-7DR5NMQ\plugins\60c1d841d14b670cd4fd9f38\PDGDeadline.py”, line 355, in RenderTasks
2021-06-10 19:16:09: self.FailRender(‘PDGDeadline exception: {}’.format(traceback.format_exc(1)))
2021-06-10 19:16:09: at Python.Runtime.Dispatcher.Dispatch(ArrayList args)
2021-06-10 19:16:09: at __FranticX_GenericDelegate0Dispatcher.Invoke()
2021-06-10 19:16:09: at Deadline.Plugins.DeadlinePlugin.RenderTasks()
2021-06-10 19:16:09: at Deadline.Plugins.DeadlinePlugin.DoRenderTasks()
2021-06-10 19:16:09: at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
2021-06-10 19:16:09: at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
2021-06-10 19:16:09: RenderPluginException.Cause: JobError (2)
2021-06-10 19:16:09: RenderPluginException.Level: Major (1)
2021-06-10 19:16:09: RenderPluginException.HasSlaveLog: True
2021-06-10 19:16:09: RenderPluginException.SlaveLogFileName: C:\ProgramData\Thinkbox\Deadline10\logs\deadlineslave_renderthread_0-DESKTOP-7DR5NMQ-0000.log
2021-06-10 19:16:09: Exception.TargetSite: Deadline.Slaves.Messaging.PluginResponseMemento d(Deadline.Net.DeadlineMessage, System.Threading.CancellationToken)
2021-06-10 19:16:09: Exception.Data: ( )
2021-06-10 19:16:09: Exception.Source: deadline
2021-06-10 19:16:09: Exception.HResult: -2146233088
2021-06-10 19:16:09: Exception.StackTrace:
2021-06-10 19:16:09: at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bem, CancellationToken ben)
2021-06-10 19:16:09: at Deadline.Plugins.SandboxedPlugin.RenderTask(Task task, CancellationToken cancellationToken)
2021-06-10 19:16:09: at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ajo, CancellationToken ajp)
2021-06-10 19:16:09: <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021-06-10 19:16:11: Skipping pending job scan because it is not required at this time
2021-06-10 19:16:11: Skipping repository repair because it is not required at this time
2021-06-10 19:16:11: Skipping house cleaning because it is not required at this time
2021-06-10 19:16:11: Scheduler Thread - Job’s Limit Groups:
2021-06-10 19:16:12: 0: Loading Job’s Plugin timeout is Disabled
2021-06-10 19:16:12: 0: WARNING: Python version for ‘PDGDeadline’ plugin is not specified! Defaulting to Py2.
2021-06-10 19:16:12: 0: SandboxedPlugin: Render Job As User disabled, running as current user ‘mirko’
2021-06-10 19:16:13: All job files are already synchronized
2021-06-10 19:16:13: Plugin PDGDeadline was already synchronized.
2021-06-10 19:16:14: 0: nogui was not added to the CommandLineParser.
2021-06-10 19:16:14: 0: Executing plugin command of type ‘Initialize Plugin’
2021-06-10 19:16:14: 0: INFO: Executing plugin script ‘C:\ProgramData\Thinkbox\Deadline10\workers\DESKTOP-7DR5NMQ\plugins\60c1d841d14b670cd4fd9f38\PDGDeadline.py’
2021-06-10 19:16:14: 0: INFO: *********** PDGDeadline InitializeProcess
2021-06-10 19:16:14: 0: INFO: About: PDG Plugin for Deadline
2021-06-10 19:16:14: 0: INFO: The job’s environment will be merged with the current environment before rendering
2021-06-10 19:16:14: 0: Done executing plugin command of type ‘Initialize Plugin’
2021-06-10 19:16:14: 0: Start Job timeout is disabled.
2021-06-10 19:16:14: 0: Task timeout is disabled.
2021-06-10 19:16:14: 0: Loaded job: PDG SUBMIT AS GRAPH JOB (60c1d841d14b670cd4fd9f38)
2021-06-10 19:16:14: 0: Executing plugin command of type ‘Start Job’
2021-06-10 19:16:14: 0: DEBUG: S3BackedCache Client is not installed.
2021-06-10 19:16:14: 0: INFO: Executing global asset transfer preload script ‘C:\ProgramData\Thinkbox\Deadline10\workers\DESKTOP-7DR5NMQ\plugins\60c1d841d14b670cd4fd9f38\GlobalAssetTransferPreLoad.py’
2021-06-10 19:16:14: 0: INFO: Looking for legacy (pre-10.0.26) AWS Portal File Transfer…
2021-06-10 19:16:14: 0: INFO: Looking for legacy (pre-10.0.26) File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py…
2021-06-10 19:16:14: 0: INFO: Could not find legacy (pre-10.0.26) AWS Portal File Transfer.
2021-06-10 19:16:14: 0: INFO: Legacy (pre-10.0.26) AWS Portal File Transfer is not installed on the system.
2021-06-10 19:16:14: 0: Done executing plugin command of type ‘Start Job’
2021-06-10 19:16:14: 0: Plugin rendering frame(s): 0
2021-06-10 19:16:14: 0: Executing plugin command of type ‘Render Task’
2021-06-10 19:16:14: 0: INFO: StartFrame: 0
2021-06-10 19:16:14: 0: INFO: Startup Directory: Y:/R&D/Houdini/DEADLINE/pdgtemp/1084
2021-06-10 19:16:14: 0: INFO: Looking for task file: Y:/R&D/Houdini/DEADLINE/pdgtemp/1084/job_1c0806fedcd344e8ac7c96b793db2eef\task_0.txt
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable HOUDINI_PATH to Y:/R&D/Houdini/DEADLINE/pdgtemp/1084;&
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable HOUDINI_MAXTHREADS to 0
2021-06-10 19:16:14: 0: INFO: Setting os PATH with HFS: C:\Program Files\Thinkbox\Deadline10\bin\Library\bin;C:\Program Files\Thinkbox\Deadline10\bin\Library\bin;C:\Program Files\Thinkbox\Deadline10\bin;C:\Program Files\ImageMagick-7.0.10-Q16-HDRI;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0;C:\Windows\System32\OpenSSH;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Program Files\NVIDIA Corporation\NVIDIA NvDLISR;C:\Program Files\Calibre2;C:\Program Files\Common Files\Autodesk Shared;C:\Program Files\Microsoft SQL Server\120\Tools\Binn;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0;C:\WINDOWS\System32\OpenSSH;C:\Users\mirko\AppData\Local\Microsoft\WindowsApps;;C:/PROGRA~1/SIDEEF~1/HOUDIN~1.532/bin
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable PATH to C:\Program Files\Thinkbox\Deadline10\bin\Library\bin;C:\Program Files\Thinkbox\Deadline10\bin\Library\bin;C:\Program Files\Thinkbox\Deadline10\bin;C:\Program Files\ImageMagick-7.0.10-Q16-HDRI;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0;C:\Windows\System32\OpenSSH;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Program Files\NVIDIA Corporation\NVIDIA NvDLISR;C:\Program Files\Calibre2;C:\Program Files\Common Files\Autodesk Shared;C:\Program Files\Microsoft SQL Server\120\Tools\Binn;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0;C:\WINDOWS\System32\OpenSSH;C:\Users\mirko\AppData\Local\Microsoft\WindowsApps;;C:/PROGRA~1/SIDEEF~1/HOUDIN~1.532/bin
2021-06-10 19:16:14: 0: INFO: $HYTHON mapped to: C:/PROGRA~1/SIDEEF~1/HOUDIN~1.532/bin/hython.exe
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable PDG_TEMP to Y:/R&D/Houdini/DEADLINE/pdgtemp/1084
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable PDG_SHARED_TEMP to Y:/R&D/Houdini/DEADLINE/pdgtemp/1084
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable PDG_SCRIPTDIR to Y:/R&D/Houdini/DEADLINE/pdgtemp/1084/scripts
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable PDG_DIR to Y:/R&D/Houdini/DEADLINE
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable PDG_HFS to C:/PROGRA~1/SIDEEF~1/HOUDIN~1.532
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable HFS to C:/PROGRA~1/SIDEEF~1/HOUDIN~1.532
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable PYTHON to
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable PDG_JOBID to 60c1d841d14b670cd4fd9f38
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable PDG_JOB_BATCH_NAME to PDG untitled 1 2021-06-10 19:08:11.525000
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable PDG_ITEM_NAME to PDG SUBMIT AS GRAPH JOB
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable PDG_INDEX to 0
2021-06-10 19:16:14: 0: INFO: Submit as job: True
2021-06-10 19:16:14: 0: INFO: Setting Process Environment Variable PDG_SUBMIT_AS_JOB to True
2021-06-10 19:16:14: 0: INFO: Task Executable: C:/PROGRA~1/SIDEEF~1/HOUDIN~1.532/bin/hython.exe
2021-06-10 19:16:14: 0: INFO: Task Arguments: “Y:/R&D/Houdini/DEADLINE/pdgtemp/1084/scripts/topcook.py” “–report” “none” “–hip” “Y:/R&D/Houdini/DEADLINE/untitled 1.hiplc” “–toppath” “/obj/geo1/topnet1”
Thanks! Looks like we’ve fixed the original issue and now we’ve got a much more normal “file not found” problem. Since that’s a letter drive, it’s possible that Y:/ isn’t mounted for the Windows user that the Deadline Worker is running as. Luckily we’ve got a system in Deadline to fix this.
In the Monitor under Tools → Configure Repository Options → Mapped Drives add the Y: drive. Something like this but with the correct UNC path:
Once you’ve done that, restart the Worker to force it to notice that we’ve made a change and re-run the job. Then let us know how it goes!
Yeah interesting, now the log has changed.
Houdini and the worker are on the same machine, by the way, in the same user and the storage is mapped as drive Y. I thought there was something wrong in the way I’ve set up my admin user and normal user, so could have been that?
2021-06-11 22:27:03: 0: Done executing plugin command of type ‘Render Task’
2021-06-11 22:27:03: 0: Executing plugin command of type ‘End Job’
2021-06-11 22:27:03: 0: Done executing plugin command of type ‘End Job’
2021-06-11 22:27:06: Scheduler Thread - Render Thread 0 threw a major error:
2021-06-11 22:27:06: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-06-11 22:27:06: Exception Details
2021-06-11 22:27:06: RenderPluginException – Error: FailRenderException : PDGDeadline exception: Traceback (most recent call last):
2021-06-11 22:27:06: File “C:\ProgramData\Thinkbox\Deadline10\workers\DESKTOP-7DR5NMQ\plugins\60c35684319c772bc0604726\PDGDeadline.py”, line 345, in RenderTasks
2021-06-11 22:27:06: exitCode = self.RunProcess( executable, arguments, startupDir, -1 )
2021-06-11 22:27:06: Exception: Error starting “C:/PROGRA~1/SIDEEF~1/HOUDIN~1.532/bin/hython.exe” in “Y:/R&D/Houdini/DEADLINE/pdgtemp/14224” : The directory name is invalid.
2021-06-11 22:27:06: at FranticX.Processes.ChildProcess.i(String bz, String ca, String cb)
2021-06-11 22:27:06: at FranticX.Processes.ChildProcess.Launch(String executable, String arguments, String startupDirectory)
2021-06-11 22:27:06: at Deadline.Plugins.DeadlinePlugin.RunProcessAsUser(String executable, String arguments, String startupDirectory, Int32 timeoutMilliseconds, String userName, String domain, String password, Boolean useSu, Boolean preserveEnvironment, Boolean setHomeVariable)
2021-06-11 22:27:06: at Deadline.Plugins.DeadlinePlugin.RunProcess(String executable, String arguments, String startupDirectory, Int32 timeoutMilliseconds)
2021-06-11 22:27:06: at Deadline.Plugins.DeadlinePlugin.FailRender(String message) (Python.Runtime.PythonException)
2021-06-11 22:27:06: File “C:\ProgramData\Thinkbox\Deadline10\workers\DESKTOP-7DR5NMQ\plugins\60c35684319c772bc0604726\PDGDeadline.py”, line 355, in RenderTasks
2021-06-11 22:27:06: self.FailRender(‘PDGDeadline exception: {}’.format(traceback.format_exc(1)))
2021-06-11 22:27:06: at Python.Runtime.Dispatcher.Dispatch(ArrayList args)
2021-06-11 22:27:06: at __FranticX_GenericDelegate0Dispatcher.Invoke()
2021-06-11 22:27:06: at Deadline.Plugins.DeadlinePlugin.RenderTasks()
2021-06-11 22:27:06: at Deadline.Plugins.DeadlinePlugin.DoRenderTasks()
2021-06-11 22:27:06: at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
2021-06-11 22:27:06: at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
2021-06-11 22:27:06: RenderPluginException.Cause: JobError (2)
2021-06-11 22:27:06: RenderPluginException.Level: Major (1)
2021-06-11 22:27:06: RenderPluginException.HasSlaveLog: True
2021-06-11 22:27:06: RenderPluginException.SlaveLogFileName: C:\ProgramData\Thinkbox\Deadline10\logs\deadlineslave_renderthread_0-DESKTOP-7DR5NMQ-0000.log
2021-06-11 22:27:06: Exception.TargetSite: Deadline.Slaves.Messaging.PluginResponseMemento d(Deadline.Net.DeadlineMessage, System.Threading.CancellationToken)
2021-06-11 22:27:06: Exception.Data: ( )
2021-06-11 22:27:06: Exception.Source: deadline
2021-06-11 22:27:06: Exception.HResult: -2146233088
2021-06-11 22:27:06: Exception.StackTrace:
2021-06-11 22:27:06: at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bem, CancellationToken ben)
2021-06-11 22:27:06: at Deadline.Plugins.SandboxedPlugin.RenderTask(Task task, CancellationToken cancellationToken)
2021-06-11 22:27:06: at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ajo, CancellationToken ajp)
2021-06-11 22:27:06: <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
Alrighty, now it’s complaining that the directory name is invalid. I’m going to guess the problem directory is the Y:/R&D/Houdini/DEADLINE/pdgtemp/14224 path. Since you’ve got Y: getting mapped automatically I’m not sure what’s going wrong here.
Would you be able to try a different directory? I’m curious if PDG is having trouble with the & in R&D. And if that fails again could I get the whole task report? You can save it as a file from the Monitor by right clicking on the task report.
Yep not 100% sure what’s happening either. The confusing part for me is that if I send a caching task through the standard submitter the job works fine, so I’m guessing no drive mapping issues?.
Can you also confirm if the pairing of Houdini 18.5.532 and Deadline 10.1.15.2 is working fine with other users?
In that case i’m afraid I could have done something wrong somewhere else…
This is the log, after I’ve changed the folder of the HIP file.
The topcook.py is actually not in the folder. But the other files / subdirectories yes.
Error: FailRenderException : PDGDeadline exception: Traceback (most recent call last):
File “C:\ProgramData\Thinkbox\Deadline10\workers\DESKTOP-7DR5NMQ\plugins\60c405a083f9a83eec5bfc00\PDGDeadline.py”, line 350, in RenderTasks
self.FailRender(‘Process returned non-zero exit code: {}’.format(exitCode))
FailRenderException: Process returned non-zero exit code: 2
at Deadline.Plugins.DeadlinePlugin.FailRender(String message)
at Deadline.Plugins.DeadlinePlugin.FailRender(String message) (Python.Runtime.PythonException)
File “C:\ProgramData\Thinkbox\Deadline10\workers\DESKTOP-7DR5NMQ\plugins\60c405a083f9a83eec5bfc00\PDGDeadline.py”, line 355, in RenderTasks
self.FailRender(‘PDGDeadline exception: {}’.format(traceback.format_exc(1)))
at Python.Runtime.Dispatcher.Dispatch(ArrayList args)
at __FranticX_GenericDelegate0Dispatcher.Invoke()
at Deadline.Plugins.DeadlinePlugin.RenderTasks()
at Deadline.Plugins.DeadlinePlugin.DoRenderTasks()
at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
=======================================================
Type
at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bem, CancellationToken ben)
at Deadline.Plugins.SandboxedPlugin.RenderTask(Task task, CancellationToken cancellationToken)
at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ajo, CancellationToken ajp)
Houdini 18.5.532 and Deadline 10.1.15.2 work fine with the exception of PDG but I think we’ve worked around that. Since caching jobs work, we can discount a drive mapping issue.
The reason this job is failing is hython can’t find that topcook.py file, and I have no clue how the guts of PDG work or why it’s expecting to find that script in the temp directory. I would assume there’s some some “copy the needed scripts over to our new temp directory” in the plugin. But I’m only seeing that in the local scheduler and the Tractor scheduler, not in the Deadline one.
I don’t think this work-around has broke anything and from a Deadline perspective you’ve got this set up properly. Have you had a chance to ask SideFX support about how it might be failing?
Yes i have contacted SideFx and they’re looking at this issue as well. (also left them with the link to this conversation, just in case!)
I thought it could have been an issue on the Deadline side, so for now no more updates.
Has anyone managed to achieve any progress getting PDG to run with Deadline? Side FX have been very quiet for a long time on this too.
It may have arisen since the whole sandboxing concept was introduced because in late 2019 I did a presentation showing this working in AWS. in my basic test using a ropfetch in TOPS to cook a sphere, I dont get logs as detailed as what you show above, I just get value cannot be null. (parameter 'input').
No luck yet. I didn’t have any time to test this again, but will try again soon. I still have to reply to sidefx about some other tests.
I remember that presentation, great stuff.
