Hi, I apologize for posting another issue today. I’m trying to set up deadline across our studio and I have run into this issue when trying to ‘run as user’. Any ideas what the problem is?
=======================================================
Error
=======================================================
Failed to load the plugin because: Could not initialize the plugin sandbox (Deadline.Plugins.PluginException)
=======================================================
Type
=======================================================
RenderPluginException
=======================================================
Stack Trace
=======================================================
at Deadline.Slaves.SlaveRenderThread.e(String ajv, Job ajw, CancellationToken ajx)
at Deadline.Slaves.SlaveRenderThread.b(TaskLogWriter ajr, CancellationToken ajs)
=======================================================
Log
=======================================================
2023-02-24 16:07:10: 0: Loading Job's Plugin timeout is Disabled
2023-02-24 16:07:10: 0: SandboxedPlugin: Render Job As User enabled, running as user 'mha', which is defined in the User Settings for this job's user
2023-02-24 16:07:10: 0: ERROR: UpdateClient.MaybeSendRequestNow caught an exception: POST https://192.168.0.4:4433/rcs/v1/update returned "One or more errors occurred. (The SSL connection could not be established, see inner exception.)" (Deadline.Net.Clients.Http.DeadlineHttpRequestException)
2023-02-24 16:07:10: 0: ERROR: DataController threw a configuration exception during initialization: Failed to establish connection to 192.168.0.4:4433 due to a communication error. (Deadline.Configuration.DeadlineConfigException)
2023-02-24 16:07:10: 0: Deadline.Configuration.DeadlineConfigException: Failed to establish connection to 192.168.0.4:4433 due to a communication error.
2023-02-24 16:07:10: 0: ---> System.ComponentModel.Win32Exception (0x8009030D): The credentials supplied to the package were not recognized
2023-02-24 16:07:10: 0: at System.Net.SSPIWrapper.AcquireCredentialsHandle(ISSPIInterface secModule, String package, CredentialUse intent, SCH_CREDENTIALS* scc)
2023-02-24 16:07:10: 0: at System.Net.Security.SslStreamPal.AcquireCredentialsHandle(CredentialUse credUsage, SCH_CREDENTIALS* secureCredential)
2023-02-24 16:07:10: 0: at System.Net.Security.SslStreamPal.AcquireCredentialsHandleSchCredentials(SslStreamCertificateContext certificateContext, SslProtocols protocols, EncryptionPolicy policy, Boolean isServer)
2023-02-24 16:07:10: 0: at System.Net.Security.SslStreamPal.AcquireCredentialsHandle(SslStreamCertificateContext certificateContext, SslProtocols protocols, EncryptionPolicy policy, Boolean isServer)
2023-02-24 16:07:10: 0: --- End of inner exception stack trace ---
2023-02-24 16:07:10: 0: at Deadline.Controllers.RemoteDataController..ctor(RepositoryConnectionSettings settings)
2023-02-24 16:07:10: 0: at Deadline.Applications.DeadlineApplicationManager.CreateDataController(RepositoryConnectionSettings connSettings)
2023-02-24 16:07:10: 0: at Deadline.Applications.DeadlineApplicationManager.Connect(RepositoryConnectionSettings connSettings, Boolean updateScriptManager)
2023-02-24 16:07:10: 0: at Deadline.Sandbox.SandboxManager.Connect(RepositoryConnectionSettings connSettings, Boolean updateScriptManager)
2023-02-24 16:07:10: 0: at DeadlinePython.DeadlineSandboxApp.a(CommandLineParser d)
2023-02-24 16:07:10: 0: at DeadlinePython.DeadlineSandboxAppStartup.Main(String[] args)
=======================================================
Details
=======================================================
Date: 02/24/2023 16:07:12
Frames: 0-274
Elapsed Time: 00:00:00:02
Job Submit Date: 02/24/2023 15:54:34
Job User: mha
Average RAM Usage: 0 (0%)
Peak RAM Usage: 0 (0%)
Average CPU Usage: 0%
Peak CPU Usage: 0%
Used CPU Clocks (x10^6 cycles): 0
Total CPU Clocks (x10^6 cycles): 0
=======================================================
Worker Information
=======================================================
Worker Name: WSX24
Version: v10.2.0.10 Release (3b87216c7)
Operating System: Windows 10 Pro
Running As Service: No
Machine User: hojprod
IP Address: 192.168.0.135
MAC Address: 2C:F0:5D:9D:F6:03
CPU Architecture: x64
CPUs: 16
CPU Usage: 5%
Memory Usage: 5.3 GB / 31.9 GB (16%)
Free Disk Space: 253.488 GB
Video Card: Microsoft Remote Display Adapter
The error is reporting that the SSL connection could not be established. I’d check that your certs are in order, RCS is up and running, firewall is not blocking, etc.
2023-02-24 16:07:10: 0: ERROR: UpdateClient.MaybeSendRequestNow caught an exception: POST https://192.168.0.4:4433/rcs/v1/update returned "One or more errors occurred. (The SSL connection could not be established, see inner exception.)" (Deadline.Net.Clients.Http.DeadlineHttpRequestException)
2023-02-24 16:07:10: 0: ---> System.ComponentModel.Win32Exception (0x8009030D): The credentials supplied to the package were not recognized
Zain wrote up a post that may point you in the right direction:
Okay, thank you. I’m not quite sure why this was the issue popping up, as the machine should definitely have been connected to the repository via RCS. Either way, after the weekend, I haven’t seen this pop-up anymore. We made some progress with rendering as user, but now I’m stuck again with After Effects not wanting to render via deadline. But when I log in to the user and run the command, deadline prints out, it renders perfectly fine.
If you can see anything useful in this, please let me know. Any help is much appreciated.
=======================================================
Error
=======================================================
FailRenderException : aerender Error: After Effects error: Error in output for render queue item 1, output module 1. Directory does not exist: P:\930462_HOJ_Project\Production\Film\S107\S107_SQ030\S107_SQ030_SH080\_CompOutput.
at Deadline.Plugins.DeadlinePlugin.FailRender(String message) (Python.Runtime.PythonException)
File "C:/Temp/Deadline10\wsx15\plugins\63fccddf923a82bf9d089e41\AfterEffects.py", line 575, in HandleStdoutError
self.FailAERender( self.GetRegexMatch(0) )
File "C:/Temp/Deadline10\wsx15\plugins\63fccddf923a82bf9d089e41\AfterEffects.py", line 496, in FailAERender
self.FailRender( message )
at Python.Runtime.Dispatcher.Dispatch(ArrayList args)
at __FranticX_Processes_ManagedProcess_StdoutHandlerDelegateDispatcher.Invoke()
at FranticX.Processes.ManagedProcess.RegexHandlerCallback.CallFunction()
at FranticX.Processes.ManagedProcess.e(String dl, Boolean dm)
at FranticX.Processes.ManagedProcess.Execute(Boolean waitForExit)
at Deadline.Plugins.DeadlinePlugin.DoRenderTasks()
at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
=======================================================
Type
=======================================================
RenderPluginException
=======================================================
Stack Trace
=======================================================
at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bgo, CancellationToken bgp)
at Deadline.Plugins.SandboxedPlugin.RenderTask(Task task, CancellationToken cancellationToken)
at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ajt, CancellationToken aju)
=======================================================
Log
=======================================================
2023-02-27 16:38:50: 0: Loading Job's Plugin timeout is Disabled
2023-02-27 16:38:50: 0: SandboxedPlugin: Render Job As User enabled, running as user 'deadline', which is defined in the User Settings for this job's user
2023-02-27 16:38:52: 0: Executing plugin command of type 'Initialize Plugin'
2023-02-27 16:38:52: 0: INFO: Executing plugin script 'C:/Temp/Deadline10\wsx15\plugins\63fccddf923a82bf9d089e41\AfterEffects.py'
2023-02-27 16:38:52: 0: INFO: Plugin execution sandbox using Python version 3
2023-02-27 16:38:52: 0: INFO: Fail Without Finished Message set to: False
2023-02-27 16:38:52: 0: INFO: Fail on Existing After Effects process: False
2023-02-27 16:38:52: 0: INFO: About: After Effects Plugin for Deadline
2023-02-27 16:38:52: 0: INFO: The job's environment will be merged with the current environment before rendering
2023-02-27 16:38:52: 0: Done executing plugin command of type 'Initialize Plugin'
2023-02-27 16:38:52: 0: Start Job timeout is disabled.
2023-02-27 16:38:52: 0: Task timeout is disabled.
2023-02-27 16:38:52: 0: Loaded job: .RENDER (63fccddf923a82bf9d089e41)
2023-02-27 16:38:52: 0: Successfully mapped P: to \\dumpap3\production
2023-02-27 16:38:52: 0: Executing plugin command of type 'Start Job'
2023-02-27 16:38:52: 0: DEBUG: S3BackedCache Client is not installed.
2023-02-27 16:38:52: 0: INFO: Executing global asset transfer preload script 'C:/Temp/Deadline10\wsx15\plugins\63fccddf923a82bf9d089e41\GlobalAssetTransferPreLoad.py'
2023-02-27 16:38:52: 0: INFO: Looking for legacy (pre-10.0.26) AWS Portal File Transfer...
2023-02-27 16:38:52: 0: INFO: Looking for legacy (pre-10.0.26) File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py...
2023-02-27 16:38:52: 0: INFO: Could not find legacy (pre-10.0.26) AWS Portal File Transfer.
2023-02-27 16:38:52: 0: INFO: Legacy (pre-10.0.26) AWS Portal File Transfer is not installed on the system.
2023-02-27 16:38:52: 0: Done executing plugin command of type 'Start Job'
2023-02-27 16:38:52: 0: Plugin rendering frame(s): 0-274
2023-02-27 16:38:52: 0: Executing plugin command of type 'Render Task'
2023-02-27 16:38:52: 0: INFO: Attempting to create "C:\Users\deadline\Documents\ae_render_only_node.txt" to force After Effects to run in Render Engine mode
2023-02-27 16:38:52: 0: INFO: Stdout Redirection Enabled: True
2023-02-27 16:38:52: 0: INFO: Stdout Handling Enabled: True
2023-02-27 16:38:52: 0: INFO: Popup Handling Enabled: True
2023-02-27 16:38:52: 0: INFO: QT Popup Handling Enabled: False
2023-02-27 16:38:52: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2023-02-27 16:38:52: 0: INFO: Using Process Tree: True
2023-02-27 16:38:52: 0: INFO: Hiding DOS Window: True
2023-02-27 16:38:52: 0: INFO: Creating New Console: False
2023-02-27 16:38:52: 0: INFO: Running as user: deadline
2023-02-27 16:38:52: 0: INFO: Executable: "C:\Program Files\Adobe\Adobe After Effects 2023\Support Files\aerender.exe"
2023-02-27 16:38:52: 0: INFO: Argument: -project "C:\Temp\Deadline10\wsx15\jobsData\63fccddf923a82bf9d089e41\S107_SQ030_SH080_Comp_V001.aep" -comp ".RENDER" -s 0 -e 274 -v ERRORS_AND_PROGRESS -close DO_NOT_SAVE_CHANGES -sound OFF
2023-02-27 16:38:52: 0: INFO: Full Command: "C:\Program Files\Adobe\Adobe After Effects 2023\Support Files\aerender.exe" -project "C:\Temp\Deadline10\wsx15\jobsData\63fccddf923a82bf9d089e41\S107_SQ030_SH080_Comp_V001.aep" -comp ".RENDER" -s 0 -e 274 -v ERRORS_AND_PROGRESS -close DO_NOT_SAVE_CHANGES -sound OFF
2023-02-27 16:38:52: 0: INFO: Startup Directory: "C:\Program Files\Adobe\Adobe After Effects 2023\Support Files"
2023-02-27 16:38:52: 0: INFO: Process Priority: BelowNormal
2023-02-27 16:38:52: 0: INFO: Process Affinity: default
2023-02-27 16:38:52: 0: INFO: Process is now running
2023-02-27 16:38:52: 0: INFO: Submitted from After Effects version: 23.2.1x3
2023-02-27 16:38:52: 0: STDOUT: aerender version 23.2.1x3
2023-02-27 16:38:57: 0: STDOUT: PROGRESS: Launching After Effects...
2023-02-27 16:38:57: 0: INFO: Checking for file "C:\Users\deadline\Documents\ae_render_only_node.txt"
2023-02-27 16:38:57: 0: INFO: Attempting to delete "C:\Users\deadline\Documents\ae_render_only_node.txt" to allow After Effects to run in the workstation environment
2023-02-27 16:38:57: 0: Done executing plugin command of type 'Render Task'
=======================================================
Details
=======================================================
Date: 02/27/2023 16:39:00
Frames: 0-274
Elapsed Time: 00:00:00:10
Job Submit Date: 02/27/2023 16:35:59
Job User: mha
Average RAM Usage: 12626558976 (37%)
Peak RAM Usage: 12626558976 (37%)
Average CPU Usage: 7%
Peak CPU Usage: 18%
Used CPU Clocks (x10^6 cycles): 35171
Total CPU Clocks (x10^6 cycles): 502436
=======================================================
Worker Information
=======================================================
Worker Name: WSX15
Version: v10.2.0.10 Release (3b87216c7)
Operating System: Windows 10 Pro
Running As Service: Yes
Machine User: deadline
IP Address: 192.168.0.89
MAC Address: D8:BB:C1:93:73:E3
CPU Architecture: x64
CPUs: 20
CPU Usage: 10%
Memory Usage: 11.8 GB / 31.8 GB (36%)
Free Disk Space: 62.497 GB
Video Card: NVIDIA GeForce RTX 2060 SUPER
Yes, mois.moshev, thank you. The issue is that the directory definitely does exist, and the log states the P: drive letter was successfully mapped. Therefore, something must be happening in the ‘render as user’ or After Effects rendering process, that I do not understand and therefore cannot predict.
The drive is both mapped to the user it’s submitted from, the user that is rendering on, and it is set to map it via the drive mapping feature in deadline, which prints out that it was successfully mapped. But still it somehow claims the path does not exist. Which is why I am at a loss.
We know After Effects hates being run as a service. There’s enough plugins that expect throwing a popup is sufficient error handling that AE will hang for seemingly no reason when run as a service and function normally when run manually and thus not as a service.
I’d also test hitting the P:\ path via a different application plugin (like CommandLine) to be sure that the service user has access to that P:\ path.
Thanks for the tips Justin, I have done some more testing. The issue is, definitely, that somehow the P: drive letter is not mapped correctly or not at all. I tried creating a pre job script, which just maps the P: drive. After running the pre job script, the After Effects job starts renders perfectly fine. If, however, the render fails for any reason and deadline retries the job, the P-drive letter is no longer mapped. Therefore, it’d be preferable if we could figure out, getting the drive mapping feature to work as intended in deadline. Is there any extended documentation on the drive mapping feature? I have tried writing the path with forward slashes, backwards slashes, and I’ve tried with and without login. It just says it was successful in the log, but in actuality does not work. Any help is much appreciated.
Use the same settings you’d use setting up the Windows network path in that UI and it should work fine. The Worker application should pick up the changes after around 10 minutes or a restart of the application. It could be you had it right, but the changes hadn’t made it to the Worker yet and so it was still using cached settings.
I don’t think it’s an issue with the settings not having time, as I have left it overnight multiple times and tried in the morning with no difference in the result. These are the settings, I’m trying:
Mapped Drive: P:
Only Map if Unmapped: Unchecked
Remote Path: \\dumpap3\production
Region: All
Requires Authentication: Checked
Username: CPHBOM\deadline
Password: ********** (Filled in with the correct password of course)
We made a user specifically for the “rendering as user” feature called deadline, which is the one we are using. CPHBOM is the domain.
Alright, I left it overnight with the settings in my previous post, and it still does not work. It writes this line in the log:
Successfully mapped P: to \\dumpap3\production\
It happens both when “rendering as user” and not. I’m starting to suspect it might be some sort of bug in deadline, as pre job scripts work fine? I’m not sure.
We have still got this issue, where the mapping drives feature is not working for us. We have to use pre-render scripts to get around it. How would we go about flagging this as a possible bug? And is this feature something that compiles at runtime, which we can edit the code for ourselves, or will we have to stick with pre-render scripts?