AWS Thinkbox Discussion Forums

RCS Remote Connection Server wont Launch at startup or restart if closed - deadlinerrcs.exe

Hi, my deadlinercs.exe isnt launching on startup, the deadline launcher and worker launch just fine but just greet me with cant connect because the RCS isn’t running automatically, it also doesn’t re-open if i close it

I’ve checked the deadline.ini file in programdata both paramaters i need are already set to true

LaunchRemoteConnectionServerAtStartup=True
KeepRemoteConnectionServerRunning=True

I cant just drop a shortcut for deadlinercs.exe into the startup folder either, access denied

the RCS should be running on a server, not a machine running the Worker.

Is the RCS running as a service already? Can you see it in task manager processes or under services?

I understand that, however we have limited resourses, so thats the best i can do for now.

Anyway I’m not sure what it would be called in task manager services, all i’ve found is Deadline10DatabaseService which is running on startup along with deadlinelauncher.exe and deadlineworker.exe in the details panel

I think the settings Geoffrey mentioned are expected to start RCS when the launcher service is started?
I too have a similar problem (on Linux), but have not looked into it, since it needs restarting very rarely.

howevever if i end the proccess deadlinelauncher.exe, and then start deadlinelauncher.exe again, it seems to all work fine automatically i gain 2 additonal processes called deadlinesandbox.exe and deadlinerrcs.exe but i need it to do this on start up

Do the logs reveal anything?
C:\ProgramData\Thinkbox\Deadline10\logs\deadlinercs…log

Are you setting the GPU affinity to reserve a core or 2 for the RCS?

I’ve just seen the reply, is this set for a login option rather than a service option? is the database also on this machine or elsewhere?

I haven’t set any affinity settings up, deadinerrcs.exe was already set to use all cores, thats a nice idea though thanks.

image
I’m not sure so i’ll send a screenshot from the services properties.

I think the database is just on this machine, i have a certs and mongo folder in C:\DeadlineDatabase10

2024-04-15 10:48:30:  BEGIN - WINDOWS-00BMTEM\geoff
2024-04-15 10:48:30:  Operating System: Windows 11 Pro
2024-04-15 10:48:30:  CPU Architecture: x64
2024-04-15 10:48:30:  CPUs: 16
2024-04-15 10:48:30:  Video Card: NVIDIA GeForce RTX 3090
2024-04-15 10:48:30:  Deadline Remote Connection Server 10.3 [v10.3.2.1 Release (1a66fe40f)]
2024-04-15 10:48:30:  Connected to "C:\DeadlineRepository10"
2024-04-15 10:48:31:  Turning off Kestrel logging
2024-04-15 10:48:31:  DEBUG: The RCS is capable of sending responses compressed with :br
2024-04-15 10:48:32:  Using ASP.Net Core server.
2024-04-15 10:48:32:  Listening for https requests on 0.0.0.0 port 4433 loopbackOnly False...
2024-04-15 10:48:32:  Counters: http-process-calls-current=0 http-process-calls-count=0 http-process-slow-calls-count=0 http-process-last-slow=none http-process-histo: ApxMean=NaN P99=NaN BoundsMs=0 Counts=0 assign-tasks-calls-current=0 assign-tasks-calls-count=0
2024-04-15 10:49:32:  Update timeout has been set to 30 seconds
2024-04-15 10:49:32:  Stdout Redirection Enabled: True
2024-04-15 10:49:32:  Stdout Handling Enabled: False
2024-04-15 10:49:32:  Popup Handling Enabled: False
2024-04-15 10:49:32:  Using Process Tree: True
2024-04-15 10:49:32:  Hiding DOS Window: True
2024-04-15 10:49:32:  Creating New Console: False
2024-04-15 10:49:32:  Running as user: geoff
2024-04-15 10:49:32:  Executable: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe"
2024-04-15 10:49:32:  Argument: -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoPendingJobScan True False True "none"
2024-04-15 10:49:32:  Full Command: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe" -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoPendingJobScan True False True "none"
2024-04-15 10:49:32:  Startup Directory: "C:\Program Files\Thinkbox\Deadline10\bin"
2024-04-15 10:49:32:  Process Priority: BelowNormal
2024-04-15 10:49:32:  Process Affinity: default
2024-04-15 10:49:32:  Process is now running
2024-04-15 10:49:32:  Counters: http-process-calls-current=0 http-process-calls-count=154 http-process-slow-calls-count=0 http-process-last-slow=none http-process-histo: ApxMean=4.5 P99=64 BoundsMs=0,1.4,2,2.8,4,5.7,8,11.3,16,22.6,32,45.3,64,90.5,128 Counts=109,12,7,2,5,1,4,3,3,3,3,1,0,0,1 assign-tasks-calls-current=0 assign-tasks-calls-count=8
2024-04-15 10:49:33:  Events plugin 'AWSPortal' could not be loaded from the repository because: Error executing event plugin script "C:\DeadlineRepository10\events\AWSPortal\AWSPortal.py": No module named 'dateutil.parser' (Deadline.Events.DeadlineEventPluginException)
2024-04-15 10:49:33:  Performing pending job scan
2024-04-15 10:49:33:      Pending Job Scan - Loading pending and active jobs
2024-04-15 10:49:33:      Pending Job Scan - Loaded 0 pending and active jobs in 17.096 ms
2024-04-15 10:49:33:      Pending Job Scan - Done.
2024-04-15 10:49:33:  Processing Pending Job Events
2024-04-15 10:49:33:      Pending Job Events - Checking for pending job events...
2024-04-15 10:49:33:      Pending Job Events - Processing 0 job events
2024-04-15 10:49:33:      Pending Job Events - No more job events to process
2024-04-15 10:49:33:      Pending Job Events - Done.
2024-04-15 10:49:34:  Process exit code: 0
2024-04-15 10:49:34:  Update timeout has been set to 30 seconds
2024-04-15 10:49:34:  Stdout Redirection Enabled: True
2024-04-15 10:49:34:  Stdout Handling Enabled: False
2024-04-15 10:49:34:  Popup Handling Enabled: False
2024-04-15 10:49:34:  Using Process Tree: True
2024-04-15 10:49:34:  Hiding DOS Window: True
2024-04-15 10:49:34:  Creating New Console: False
2024-04-15 10:49:34:  Running as user: geoff
2024-04-15 10:49:34:  Executable: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe"
2024-04-15 10:49:34:  Argument: -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoHouseCleaning True False True
2024-04-15 10:49:34:  Full Command: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe" -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoHouseCleaning True False True
2024-04-15 10:49:34:  Startup Directory: "C:\Program Files\Thinkbox\Deadline10\bin"
2024-04-15 10:49:34:  Process Priority: BelowNormal
2024-04-15 10:49:34:  Process Affinity: default
2024-04-15 10:49:34:  Process is now running
2024-04-15 10:49:35:  Events plugin 'AWSPortal' could not be loaded from the repository because: Error executing event plugin script "C:\DeadlineRepository10\events\AWSPortal\AWSPortal.py": No module named 'dateutil.parser' (Deadline.Events.DeadlineEventPluginException)
2024-04-15 10:49:35:  Performing house cleaning
2024-04-15 10:49:35:  Performing Job Cleanup Scan...
2024-04-15 10:49:35:      Job Cleanup Scan - Loading completed jobs
2024-04-15 10:49:35:      Job Cleanup Scan - Loaded 2 completed and 0 active/pending jobs in 49.912 ms
2024-04-15 10:49:35:      Job Cleanup Scan - Scanning completed jobs
2024-04-15 10:49:35:      Job Cleanup Scan - Deleted 0 and archived 0 completed jobs in 1.278 ms
2024-04-15 10:49:35:      Job Cleanup Scan - Done.
2024-04-15 10:49:35:  Purging Unsubmitted Jobs
2024-04-15 10:49:35:      Unsubmitted Job Scan - Loading unsubmitted jobs
2024-04-15 10:49:35:      Unsubmitted Job Scan - Loaded 0 unsubmitted jobs in 656.600 µs
2024-04-15 10:49:35:      Unsubmitted Job Scan - Done.
2024-04-15 10:49:35:  Purging Deleted Jobs
2024-04-15 10:49:35:      Deleted Job Scan - Loading deleted jobs
2024-04-15 10:49:35:      Deleted Job Scan - Loaded 0 deleted jobs in 4.764 ms
2024-04-15 10:49:35:      Deleted Job Scan - Done.
2024-04-15 10:49:35:  Purging JobSubmissions
2024-04-15 10:49:35:  Deleting activated and cancelled JobSubmissions.
2024-04-15 10:49:35:  Deleting JobSubmissions and jobs stuck in ready for more than 3 days.
2024-04-15 10:49:35:      JobSubmissions Purge - Done.
2024-04-15 10:49:35:  Purging Obsolete Workers
2024-04-15 10:49:35:      Obsolete Worker Scan - Skipping because it is disabled in the Repository Options
2024-04-15 10:49:35:  Purging Obsolete AWS Portal Workers
2024-04-15 10:49:35:      Obsolete AWS Portal Worker Scan - Loading Worker states
2024-04-15 10:49:35:      Obsolete AWS Portal Worker Scan - Loading 2 Worker states in 12.596 ms
2024-04-15 10:49:35:      Obsolete AWS Portal Worker Scan - Purging offline/stalled Workers older than 5 days, 0 hours
2024-04-15 10:49:35:      Obsolete AWS Portal Worker Scan - Purged 0 obsolete AWS Portal Workers in 25.300 µs
2024-04-15 10:49:35:      Obsolete AWS Portal Worker Scan - Done.
2024-04-15 10:49:35:  Purging Old Worker Reports
2024-04-15 10:49:35:      Worker Report Scan - Loading Worker report collections
2024-04-15 10:49:35:      Worker Report Scan - Found 2 report collections and 0 job state objects in 17.448 ms
2024-04-15 10:49:35:      Worker Report Scan - Loading Worker IDs
2024-04-15 10:49:35:      Worker Report Scan - Loaded 2 Worker IDs in 1.170 ms
2024-04-15 10:49:35:      Worker Report Scan - Purged 0 report collections, 0 job state objects, and 0 licensed Worker stubs in 0
2024-04-15 10:49:35:      Worker Report Scan - Done.
2024-04-15 10:49:35:  Purging Timed Out Workers in Throttle Queue
2024-04-15 10:49:35:  Purging Old Statistics
2024-04-15 10:49:35:      Old Statistics - Skipping job statistics because the option to purge them is disabled in the Repository Options
2024-04-15 10:49:35:      Old Statistics - Purging Worker statistics that are older than Dec 17/23  10:49:35
2024-04-15 10:49:35:      Old Statistics - Purged old Worker statistics in 10.846 ms
2024-04-15 10:49:35:      Old Statistics - Purging repository statistics that are older than Dec 17/23  10:49:35
2024-04-15 10:49:35:      Old Statistics - Purged old repository statistics in 4.509 ms
2024-04-15 10:49:35:  Purging expired Remote Command Tokens
2024-04-15 10:49:35:  Purging Deleted Document Stubs From Database
2024-04-15 10:49:35:      Deleted Document Stubs - Deleting stubs that are older than 3 days
2024-04-15 10:49:35:      Deleted Document Stubs - Deleted 0 stubs in 430.500 µs
2024-04-15 10:49:35:  Triggering house cleaning events...
2024-04-15 10:49:35:  Process exit code: 0
2024-04-15 10:49:35:  Update timeout has been set to 30 seconds
2024-04-15 10:49:35:  Stdout Redirection Enabled: True
2024-04-15 10:49:35:  Stdout Handling Enabled: False
2024-04-15 10:49:35:  Popup Handling Enabled: False
2024-04-15 10:49:35:  Using Process Tree: True
2024-04-15 10:49:35:  Hiding DOS Window: True
2024-04-15 10:49:35:  Creating New Console: False
2024-04-15 10:49:35:  Running as user: geoff
2024-04-15 10:49:35:  Executable: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe"
2024-04-15 10:49:35:  Argument: -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoRepositoryRepair True False True
2024-04-15 10:49:35:  Full Command: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe" -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoRepositoryRepair True False True
2024-04-15 10:49:35:  Startup Directory: "C:\Program Files\Thinkbox\Deadline10\bin"
2024-04-15 10:49:35:  Process Priority: BelowNormal
2024-04-15 10:49:35:  Process Affinity: default
2024-04-15 10:49:35:  Process is now running
2024-04-15 10:49:37:  Events plugin 'AWSPortal' could not be loaded from the repository because: Error executing event plugin script "C:\DeadlineRepository10\events\AWSPortal\AWSPortal.py": No module named 'dateutil.parser' (Deadline.Events.DeadlineEventPluginException)
2024-04-15 10:49:37:  Performing repository repair
2024-04-15 10:49:37:  Performing Orphaned Task Scan...
2024-04-15 10:49:37:      Orphaned Task Scan - Loading rendering jobs
2024-04-15 10:49:37:      Orphaned Task Scan - Loaded 0 rendering jobs in 15.859 ms
2024-04-15 10:49:37:      Orphaned Task Scan - Done.
2024-04-15 10:49:37:  Performing Orphaned Limit Stub Scan...
2024-04-15 10:49:37:      Orphaned Limit Stub Scan - Loading limits
2024-04-15 10:49:37:      Orphaned Limit Stub Scan - Loaded 2 limits in 13.016 ms
2024-04-15 10:49:37:      Orphaned Limit Stub Scan - Loading Worker states
2024-04-15 10:49:37:      Orphaned Limit Stub Scan - Loaded 2 Worker states in 15.529 ms
2024-04-15 10:49:37:      Orphaned Limit Stub Scan - Returned 0 orphaned limit stubs in 7.481 ms
2024-04-15 10:49:37:      Orphaned Limit Stub Scan - Done.
2024-04-15 10:49:37:  Checking Available Database Connections
2024-04-15 10:49:37:      Available Database Connections - Skipping because there are no Low Database Connection notification email addresses set in the Repository Options
2024-04-15 10:49:37:  Performing Stalled Worker Scan...
2024-04-15 10:49:37:      Stalled Worker Scan - Loading Worker states
2024-04-15 10:49:37:      Stalled Worker Scan - Loaded 2 Worker states in 624.100 µs
2024-04-15 10:49:37:      Stalled Worker Scan - Scanning Worker states
2024-04-15 10:49:37:      Stalled Worker Scan - Cleaned up 0 stalled Worker in 2.230 ms
2024-04-15 10:49:37:      Stalled Worker Scan - Done.
2024-04-15 10:49:37:  Performing Stalled Pulse Scan...
2024-04-15 10:49:37:      Stalled Pulse Scan - Loading pulse states
2024-04-15 10:49:37:      Stalled Pulse Scan - Loaded 0 pulse states in 1.708 ms
2024-04-15 10:49:37:      Stalled Pulse Scan - Done.
2024-04-15 10:49:37:  Performing Stalled Balancer Scan...
2024-04-15 10:49:37:      Stalled Balancer Scan - Loading balancer states
2024-04-15 10:49:37:      Stalled Balancer Scan - Loaded 0 balancer states in 1.671 ms
2024-04-15 10:49:37:      Stalled Balancer Scan - Done.
2024-04-15 10:49:37:  Performing Stalled License Forwarder Scan...
2024-04-15 10:49:37:      Stalled License Forwarder Scan - Loading forwarder states
2024-04-15 10:49:37:      Stalled License Forwarder Scan - Loaded 0 forwarder states in 5.773 ms
2024-04-15 10:49:37:      Stalled License Forwarder Scan - Done.
2024-04-15 10:49:37:  Performing Stalled Connection Server Scan...
2024-04-15 10:49:37:      Stalled Connection Server Scan - Loading Connection Server states
2024-04-15 10:49:37:      Stalled Connection Server Scan - Loaded 1 Connection Server states in 3.357 ms
2024-04-15 10:49:37:      Stalled Connection Server Scan - Scanning Connection Server states
2024-04-15 10:49:37:      Stalled Connection Server Scan - Cleaned up 0 stalled Connection Servers in 614.700 µs
2024-04-15 10:49:37:      Stalled Connection Server Scan - Done.
2024-04-15 10:49:37:  Triggering repository repair events...
2024-04-15 10:49:37:  Process exit code: 0
2024-04-15 10:50:33:  Counters: http-process-calls-current=0 http-process-calls-count=233 http-process-slow-calls-count=0 http-process-last-slow=none http-process-histo: ApxMean=3.2 P99=45.3 BoundsMs=0,1.4,2,2.8,4,5.7,8,11.3,16,22.6,32,45.3,64,90.5,128 Counts=186,14,7,2,5,1,4,3,3,3,3,1,0,0,1 assign-tasks-calls-current=0 assign-tasks-calls-count=16
2024-04-15 10:50:34:  Update timeout has been set to 30 seconds
2024-04-15 10:50:34:  Stdout Redirection Enabled: True
2024-04-15 10:50:34:  Stdout Handling Enabled: False
2024-04-15 10:50:34:  Popup Handling Enabled: False
2024-04-15 10:50:34:  Using Process Tree: True
2024-04-15 10:50:34:  Hiding DOS Window: True
2024-04-15 10:50:34:  Creating New Console: False
2024-04-15 10:50:34:  Running as user: geoff
2024-04-15 10:50:34:  Executable: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe"
2024-04-15 10:50:34:  Argument: -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoPendingJobScan True False True "none"
2024-04-15 10:50:34:  Full Command: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe" -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoPendingJobScan True False True "none"
2024-04-15 10:50:34:  Startup Directory: "C:\Program Files\Thinkbox\Deadline10\bin"
2024-04-15 10:50:34:  Process Priority: BelowNormal
2024-04-15 10:50:34:  Process Affinity: default
2024-04-15 10:50:34:  Process is now running
2024-04-15 10:50:35:  Events plugin 'AWSPortal' could not be loaded from the repository because: Error executing event plugin script "C:\DeadlineRepository10\events\AWSPortal\AWSPortal.py": No module named 'dateutil.parser' (Deadline.Events.DeadlineEventPluginException)
2024-04-15 10:50:35:  Performing pending job scan
2024-04-15 10:50:35:      Pending Job Scan - Loading pending and active jobs
2024-04-15 10:50:35:      Pending Job Scan - Loaded 0 pending and active jobs in 17.085 ms
2024-04-15 10:50:35:      Pending Job Scan - Done.
2024-04-15 10:50:35:  Processing Pending Job Events
2024-04-15 10:50:35:      Pending Job Events - Checking for pending job events...
2024-04-15 10:50:35:      Pending Job Events - Processing 0 job events
2024-04-15 10:50:35:      Pending Job Events - No more job events to process
2024-04-15 10:50:35:      Pending Job Events - Done.
2024-04-15 10:50:35:  Process exit code: 0
2024-04-15 10:50:35:  Update timeout has been set to 30 seconds
2024-04-15 10:50:35:  Stdout Redirection Enabled: True
2024-04-15 10:50:35:  Stdout Handling Enabled: False
2024-04-15 10:50:35:  Popup Handling Enabled: False
2024-04-15 10:50:35:  Using Process Tree: True
2024-04-15 10:50:35:  Hiding DOS Window: True
2024-04-15 10:50:35:  Creating New Console: False
2024-04-15 10:50:35:  Running as user: geoff
2024-04-15 10:50:35:  Executable: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe"
2024-04-15 10:50:35:  Argument: -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoHouseCleaning True False True
2024-04-15 10:50:35:  Full Command: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe" -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoHouseCleaning True False True
2024-04-15 10:50:35:  Startup Directory: "C:\Program Files\Thinkbox\Deadline10\bin"
2024-04-15 10:50:35:  Process Priority: BelowNormal
2024-04-15 10:50:35:  Process Affinity: default
2024-04-15 10:50:35:  Process is now running
2024-04-15 10:50:37:  Events plugin 'AWSPortal' could not be loaded from the repository because: Error executing event plugin script "C:\DeadlineRepository10\events\AWSPortal\AWSPortal.py": No module named 'dateutil.parser' (Deadline.Events.DeadlineEventPluginException)
2024-04-15 10:50:37:  Performing house cleaning
2024-04-15 10:50:37:  Performing Job Cleanup Scan...
2024-04-15 10:50:37:      Job Cleanup Scan - Loading completed jobs
2024-04-15 10:50:37:      Job Cleanup Scan - Loaded 2 completed and 0 active/pending jobs in 46.004 ms
2024-04-15 10:50:37:      Job Cleanup Scan - Scanning completed jobs
2024-04-15 10:50:37:      Job Cleanup Scan - Deleted 0 and archived 0 completed jobs in 1.327 ms
2024-04-15 10:50:37:      Job Cleanup Scan - Done.
2024-04-15 10:50:37:  Purging Unsubmitted Jobs
2024-04-15 10:50:37:      Unsubmitted Job Scan - Loading unsubmitted jobs
2024-04-15 10:50:37:      Unsubmitted Job Scan - Loaded 0 unsubmitted jobs in 716.000 µs
2024-04-15 10:50:37:      Unsubmitted Job Scan - Done.
2024-04-15 10:50:37:  Purging Deleted Jobs
2024-04-15 10:50:37:      Deleted Job Scan - Loading deleted jobs
2024-04-15 10:50:37:      Deleted Job Scan - Loaded 0 deleted jobs in 572.000 µs
2024-04-15 10:50:37:      Deleted Job Scan - Done.
2024-04-15 10:50:37:  Purging JobSubmissions
2024-04-15 10:50:37:  Deleting activated and cancelled JobSubmissions.
2024-04-15 10:50:37:  Deleting JobSubmissions and jobs stuck in ready for more than 3 days.
2024-04-15 10:50:37:      JobSubmissions Purge - Done.
2024-04-15 10:50:37:  Purging Obsolete Workers
2024-04-15 10:50:37:      Obsolete Worker Scan - Skipping because it is disabled in the Repository Options
2024-04-15 10:50:37:  Purging Obsolete AWS Portal Workers
2024-04-15 10:50:37:      Obsolete AWS Portal Worker Scan - Loading Worker states
2024-04-15 10:50:37:      Obsolete AWS Portal Worker Scan - Loading 2 Worker states in 13.426 ms
2024-04-15 10:50:37:      Obsolete AWS Portal Worker Scan - Purging offline/stalled Workers older than 5 days, 0 hours
2024-04-15 10:50:37:      Obsolete AWS Portal Worker Scan - Purged 0 obsolete AWS Portal Workers in 28.100 µs
2024-04-15 10:50:37:      Obsolete AWS Portal Worker Scan - Done.
2024-04-15 10:50:37:  Purging Old Worker Reports
2024-04-15 10:50:37:      Worker Report Scan - Loading Worker report collections
2024-04-15 10:50:37:      Worker Report Scan - Found 2 report collections and 0 job state objects in 5.496 ms
2024-04-15 10:50:37:      Worker Report Scan - Loading Worker IDs
2024-04-15 10:50:37:      Worker Report Scan - Loaded 2 Worker IDs in 1.266 ms
2024-04-15 10:50:37:      Worker Report Scan - Purged 0 report collections, 0 job state objects, and 0 licensed Worker stubs in 0
2024-04-15 10:50:37:      Worker Report Scan - Done.
2024-04-15 10:50:37:  Purging Timed Out Workers in Throttle Queue
2024-04-15 10:50:37:  Purging Old Statistics
2024-04-15 10:50:37:      Old Statistics - Skipping job statistics because the option to purge them is disabled in the Repository Options
2024-04-15 10:50:37:      Old Statistics - Purging Worker statistics that are older than Dec 17/23  10:50:37
2024-04-15 10:50:37:      Old Statistics - Purged old Worker statistics in 1.194 ms
2024-04-15 10:50:37:      Old Statistics - Purging repository statistics that are older than Dec 17/23  10:50:37
2024-04-15 10:50:37:      Old Statistics - Purged old repository statistics in 453.200 µs
2024-04-15 10:50:37:  Purging expired Remote Command Tokens
2024-04-15 10:50:37:  Purging Deleted Document Stubs From Database
2024-04-15 10:50:37:      Deleted Document Stubs - Deleting stubs that are older than 3 days
2024-04-15 10:50:37:      Deleted Document Stubs - Deleted 0 stubs in 940.700 µs
2024-04-15 10:50:37:  Triggering house cleaning events...
2024-04-15 10:50:38:  Process exit code: 0
2024-04-15 10:50:38:  Update timeout has been set to 30 seconds
2024-04-15 10:50:38:  Stdout Redirection Enabled: True
2024-04-15 10:50:38:  Stdout Handling Enabled: False
2024-04-15 10:50:38:  Popup Handling Enabled: False
2024-04-15 10:50:38:  Using Process Tree: True
2024-04-15 10:50:38:  Hiding DOS Window: True
2024-04-15 10:50:38:  Creating New Console: False
2024-04-15 10:50:38:  Running as user: geoff
2024-04-15 10:50:38:  Executable: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe"
2024-04-15 10:50:38:  Argument: -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoRepositoryRepair True False True
2024-04-15 10:50:38:  Full Command: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe" -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoRepositoryRepair True False True
2024-04-15 10:50:38:  Startup Directory: "C:\Program Files\Thinkbox\Deadline10\bin"
2024-04-15 10:50:38:  Process Priority: BelowNormal
2024-04-15 10:50:38:  Process Affinity: default
2024-04-15 10:50:38:  Process is now running
2024-04-15 10:50:39:  Events plugin 'AWSPortal' could not be loaded from the repository because: Error executing event plugin script "C:\DeadlineRepository10\events\AWSPortal\AWSPortal.py": No module named 'dateutil.parser' (Deadline.Events.DeadlineEventPluginException)
2024-04-15 10:50:39:  Performing repository repair
2024-04-15 10:50:39:  Performing Orphaned Task Scan...
2024-04-15 10:50:39:      Orphaned Task Scan - Loading rendering jobs
2024-04-15 10:50:39:      Orphaned Task Scan - Loaded 0 rendering jobs in 15.272 ms
2024-04-15 10:50:39:      Orphaned Task Scan - Done.
2024-04-15 10:50:39:  Performing Orphaned Limit Stub Scan...
2024-04-15 10:50:39:      Orphaned Limit Stub Scan - Loading limits
2024-04-15 10:50:39:      Orphaned Limit Stub Scan - Loaded 2 limits in 5.518 ms
2024-04-15 10:50:39:      Orphaned Limit Stub Scan - Loading Worker states
2024-04-15 10:50:39:      Orphaned Limit Stub Scan - Loaded 2 Worker states in 12.679 ms
2024-04-15 10:50:39:      Orphaned Limit Stub Scan - Returned 0 orphaned limit stubs in 2.035 ms
2024-04-15 10:50:39:      Orphaned Limit Stub Scan - Done.
2024-04-15 10:50:39:  Checking Available Database Connections
2024-04-15 10:50:39:      Available Database Connections - Skipping because there are no Low Database Connection notification email addresses set in the Repository Options
2024-04-15 10:50:39:  Performing Stalled Worker Scan...
2024-04-15 10:50:39:      Stalled Worker Scan - Loading Worker states
2024-04-15 10:50:39:      Stalled Worker Scan - Loaded 2 Worker states in 594.500 µs
2024-04-15 10:50:39:      Stalled Worker Scan - Scanning Worker states
2024-04-15 10:50:39:      Stalled Worker Scan - Cleaned up 0 stalled Worker in 2.329 ms
2024-04-15 10:50:39:      Stalled Worker Scan - Done.
2024-04-15 10:50:39:  Performing Stalled Pulse Scan...
2024-04-15 10:50:39:      Stalled Pulse Scan - Loading pulse states
2024-04-15 10:50:39:      Stalled Pulse Scan - Loaded 0 pulse states in 1.581 ms
2024-04-15 10:50:39:      Stalled Pulse Scan - Done.
2024-04-15 10:50:39:  Performing Stalled Balancer Scan...
2024-04-15 10:50:39:      Stalled Balancer Scan - Loading balancer states
2024-04-15 10:50:39:      Stalled Balancer Scan - Loaded 0 balancer states in 1.658 ms
2024-04-15 10:50:39:      Stalled Balancer Scan - Done.
2024-04-15 10:50:39:  Performing Stalled License Forwarder Scan...
2024-04-15 10:50:39:      Stalled License Forwarder Scan - Loading forwarder states
2024-04-15 10:50:39:      Stalled License Forwarder Scan - Loaded 0 forwarder states in 1.573 ms
2024-04-15 10:50:39:      Stalled License Forwarder Scan - Done.
2024-04-15 10:50:39:  Performing Stalled Connection Server Scan...
2024-04-15 10:50:39:      Stalled Connection Server Scan - Loading Connection Server states
2024-04-15 10:50:39:      Stalled Connection Server Scan - Loaded 1 Connection Server states in 4.608 ms
2024-04-15 10:50:39:      Stalled Connection Server Scan - Scanning Connection Server states
2024-04-15 10:50:39:      Stalled Connection Server Scan - Cleaned up 0 stalled Connection Servers in 806.000 µs
2024-04-15 10:50:39:      Stalled Connection Server Scan - Done.
2024-04-15 10:50:39:  Triggering repository repair events...
2024-04-15 10:50:39:  Process exit code: 0
2024-04-15 10:51:33:  Counters: http-process-calls-current=0 http-process-calls-count=304 http-process-slow-calls-count=0 http-process-last-slow=none http-process-histo: ApxMean=2.7 P99=45.3 BoundsMs=0,1.4,2,2.8,4,5.7,8,11.3,16,22.6,32,45.3,64,90.5,128 Counts=253,17,7,2,5,2,4,3,3,3,3,1,0,0,1 assign-tasks-calls-current=0 assign-tasks-calls-count=23
2024-04-15 10:51:35:  Update timeout has been set to 30 seconds
2024-04-15 10:51:35:  Stdout Redirection Enabled: True
2024-04-15 10:51:35:  Stdout Handling Enabled: False
2024-04-15 10:51:35:  Popup Handling Enabled: False
2024-04-15 10:51:35:  Using Process Tree: True
2024-04-15 10:51:35:  Hiding DOS Window: True
2024-04-15 10:51:35:  Creating New Console: False
2024-04-15 10:51:35:  Running as user: geoff
2024-04-15 10:51:35:  Executable: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe"
2024-04-15 10:51:35:  Argument: -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoPendingJobScan True False True "none"
2024-04-15 10:51:35:  Full Command: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe" -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoPendingJobScan True False True "none"
2024-04-15 10:51:35:  Startup Directory: "C:\Program Files\Thinkbox\Deadline10\bin"
2024-04-15 10:51:35:  Process Priority: BelowNormal
2024-04-15 10:51:35:  Process Affinity: default
2024-04-15 10:51:35:  Process is now running
2024-04-15 10:51:37:  Events plugin 'AWSPortal' could not be loaded from the repository because: Error executing event plugin script "C:\DeadlineRepository10\events\AWSPortal\AWSPortal.py": No module named 'dateutil.parser' (Deadline.Events.DeadlineEventPluginException)
2024-04-15 10:51:37:  Performing pending job scan
2024-04-15 10:51:37:      Pending Job Scan - Loading pending and active jobs
2024-04-15 10:51:37:      Pending Job Scan - Loaded 0 pending and active jobs in 17.169 ms
2024-04-15 10:51:37:      Pending Job Scan - Done.
2024-04-15 10:51:37:  Processing Pending Job Events
2024-04-15 10:51:37:      Pending Job Events - Checking for pending job events...
2024-04-15 10:51:37:      Pending Job Events - Processing 0 job events
2024-04-15 10:51:37:      Pending Job Events - No more job events to process
2024-04-15 10:51:37:      Pending Job Events - Done.
2024-04-15 10:51:37:  Process exit code: 0
2024-04-15 10:51:38:  Update timeout has been set to 30 seconds
2024-04-15 10:51:38:  Stdout Redirection Enabled: True
2024-04-15 10:51:38:  Stdout Handling Enabled: False
2024-04-15 10:51:38:  Popup Handling Enabled: False
2024-04-15 10:51:38:  Using Process Tree: True
2024-04-15 10:51:38:  Hiding DOS Window: True
2024-04-15 10:51:38:  Creating New Console: False
2024-04-15 10:51:38:  Running as user: geoff
2024-04-15 10:51:38:  Executable: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe"
2024-04-15 10:51:38:  Argument: -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoHouseCleaning True False True
2024-04-15 10:51:38:  Full Command: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe" -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoHouseCleaning True False True
2024-04-15 10:51:38:  Startup Directory: "C:\Program Files\Thinkbox\Deadline10\bin"
2024-04-15 10:51:38:  Process Priority: BelowNormal
2024-04-15 10:51:38:  Process Affinity: default
2024-04-15 10:51:38:  Process is now running
2024-04-15 10:51:39:  Events plugin 'AWSPortal' could not be loaded from the repository because: Error executing event plugin script "C:\DeadlineRepository10\events\AWSPortal\AWSPortal.py": No module named 'dateutil.parser' (Deadline.Events.DeadlineEventPluginException)
2024-04-15 10:51:39:  Performing house cleaning
2024-04-15 10:51:39:  Performing Job Cleanup Scan...
2024-04-15 10:51:39:      Job Cleanup Scan - Loading completed jobs
2024-04-15 10:51:39:      Job Cleanup Scan - Loaded 2 completed and 0 active/pending jobs in 45.343 ms
2024-04-15 10:51:39:      Job Cleanup Scan - Scanning completed jobs
2024-04-15 10:51:39:      Job Cleanup Scan - Deleted 0 and archived 0 completed jobs in 1.169 ms
2024-04-15 10:51:39:      Job Cleanup Scan - Done.
2024-04-15 10:51:39:  Purging Unsubmitted Jobs
2024-04-15 10:51:39:      Unsubmitted Job Scan - Loading unsubmitted jobs
2024-04-15 10:51:39:      Unsubmitted Job Scan - Loaded 0 unsubmitted jobs in 461.600 µs
2024-04-15 10:51:39:      Unsubmitted Job Scan - Done.
2024-04-15 10:51:39:  Purging Deleted Jobs
2024-04-15 10:51:39:      Deleted Job Scan - Loading deleted jobs
2024-04-15 10:51:39:      Deleted Job Scan - Loaded 0 deleted jobs in 418.500 µs
2024-04-15 10:51:39:      Deleted Job Scan - Done.
2024-04-15 10:51:39:  Purging JobSubmissions
2024-04-15 10:51:39:  Deleting activated and cancelled JobSubmissions.
2024-04-15 10:51:39:  Deleting JobSubmissions and jobs stuck in ready for more than 3 days.
2024-04-15 10:51:39:      JobSubmissions Purge - Done.
2024-04-15 10:51:39:  Purging Obsolete Workers
2024-04-15 10:51:39:      Obsolete Worker Scan - Skipping because it is disabled in the Repository Options
2024-04-15 10:51:39:  Purging Obsolete AWS Portal Workers
2024-04-15 10:51:39:      Obsolete AWS Portal Worker Scan - Loading Worker states
2024-04-15 10:51:39:      Obsolete AWS Portal Worker Scan - Loading 2 Worker states in 14.227 ms
2024-04-15 10:51:39:      Obsolete AWS Portal Worker Scan - Purging offline/stalled Workers older than 5 days, 0 hours
2024-04-15 10:51:39:      Obsolete AWS Portal Worker Scan - Purged 0 obsolete AWS Portal Workers in 30.300 µs
2024-04-15 10:51:39:      Obsolete AWS Portal Worker Scan - Done.
2024-04-15 10:51:39:  Purging Old Worker Reports
2024-04-15 10:51:39:      Worker Report Scan - Loading Worker report collections
2024-04-15 10:51:39:      Worker Report Scan - Found 2 report collections and 0 job state objects in 4.980 ms
2024-04-15 10:51:39:      Worker Report Scan - Loading Worker IDs
2024-04-15 10:51:39:      Worker Report Scan - Loaded 2 Worker IDs in 1.112 ms
2024-04-15 10:51:39:      Worker Report Scan - Purged 0 report collections, 0 job state objects, and 0 licensed Worker stubs in 0
2024-04-15 10:51:39:      Worker Report Scan - Done.
2024-04-15 10:51:39:  Purging Timed Out Workers in Throttle Queue
2024-04-15 10:51:39:  Purging Old Statistics
2024-04-15 10:51:39:      Old Statistics - Skipping job statistics because the option to purge them is disabled in the Repository Options
2024-04-15 10:51:39:      Old Statistics - Purging Worker statistics that are older than Dec 17/23  10:51:39
2024-04-15 10:51:39:      Old Statistics - Purged old Worker statistics in 1.025 ms
2024-04-15 10:51:39:      Old Statistics - Purging repository statistics that are older than Dec 17/23  10:51:39
2024-04-15 10:51:39:      Old Statistics - Purged old repository statistics in 383.500 µs
2024-04-15 10:51:39:  Purging expired Remote Command Tokens
2024-04-15 10:51:39:  Purging Deleted Document Stubs From Database
2024-04-15 10:51:39:      Deleted Document Stubs - Deleting stubs that are older than 3 days
2024-04-15 10:51:39:      Deleted Document Stubs - Deleted 0 stubs in 410.300 µs
2024-04-15 10:51:39:  Triggering house cleaning events...
2024-04-15 10:51:39:  Process exit code: 0
2024-04-15 10:51:39:  Update timeout has been set to 30 seconds
2024-04-15 10:51:39:  Stdout Redirection Enabled: True
2024-04-15 10:51:39:  Stdout Handling Enabled: False
2024-04-15 10:51:39:  Popup Handling Enabled: False
2024-04-15 10:51:39:  Using Process Tree: True
2024-04-15 10:51:39:  Hiding DOS Window: True
2024-04-15 10:51:39:  Creating New Console: False
2024-04-15 10:51:39:  Running as user: geoff
2024-04-15 10:51:39:  Executable: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe"
2024-04-15 10:51:39:  Argument: -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoRepositoryRepair True False True
2024-04-15 10:51:39:  Full Command: "C:\Program Files\Thinkbox\Deadline10\bin\deadlinecommand.exe" -RunCommandForRepository "Repository" "C:\DeadlineRepository10;C:\DeadlineDatabase10\certs\Deadline10Client.pfx" -DoRepositoryRepair True False True
2024-04-15 10:51:39:  Startup Directory: "C:\Program Files\Thinkbox\Deadline10\bin"
2024-04-15 10:51:39:  Process Priority: BelowNormal
2024-04-15 10:51:39:  Process Affinity: default
2024-04-15 10:51:39:  Process is now running
2024-04-15 10:51:41:  Events plugin 'AWSPortal' could not be loaded from the repository because: Error executing event plugin script "C:\DeadlineRepository10\events\AWSPortal\AWSPortal.py": No module named 'dateutil.parser' (Deadline.Events.DeadlineEventPluginException)
2024-04-15 10:51:41:  Performing repository repair
2024-04-15 10:51:41:  Performing Orphaned Task Scan...
2024-04-15 10:51:41:      Orphaned Task Scan - Loading rendering jobs
2024-04-15 10:51:41:      Orphaned Task Scan - Loaded 0 rendering jobs in 15.683 ms
2024-04-15 10:51:41:      Orphaned Task Scan - Done.
2024-04-15 10:51:41:  Performing Orphaned Limit Stub Scan...
2024-04-15 10:51:41:      Orphaned Limit Stub Scan - Loading limits
2024-04-15 10:51:41:      Orphaned Limit Stub Scan - Loaded 2 limits in 5.426 ms
2024-04-15 10:51:41:      Orphaned Limit Stub Scan - Loading Worker states
2024-04-15 10:51:41:      Orphaned Limit Stub Scan - Loaded 2 Worker states in 14.553 ms
2024-04-15 10:51:41:      Orphaned Limit Stub Scan - Returned 0 orphaned limit stubs in 2.390 ms
2024-04-15 10:51:41:      Orphaned Limit Stub Scan - Done.
2024-04-15 10:51:41:  Checking Available Database Connections
2024-04-15 10:51:41:      Available Database Connections - Skipping because there are no Low Database Connection notification email addresses set in the Repository Options
2024-04-15 10:51:41:  Performing Stalled Worker Scan...
2024-04-15 10:51:41:      Stalled Worker Scan - Loading Worker states
2024-04-15 10:51:41:      Stalled Worker Scan - Loaded 2 Worker states in 626.400 µs
2024-04-15 10:51:41:      Stalled Worker Scan - Scanning Worker states
2024-04-15 10:51:41:      Stalled Worker Scan - Cleaned up 0 stalled Worker in 2.274 ms
2024-04-15 10:51:41:      Stalled Worker Scan - Done.
2024-04-15 10:51:41:  Performing Stalled Pulse Scan...
2024-04-15 10:51:41:      Stalled Pulse Scan - Loading pulse states
2024-04-15 10:51:41:      Stalled Pulse Scan - Loaded 0 pulse states in 1.925 ms
2024-04-15 10:51:41:      Stalled Pulse Scan - Done.
2024-04-15 10:51:41:  Performing Stalled Balancer Scan...
2024-04-15 10:51:41:      Stalled Balancer Scan - Loading balancer states
2024-04-15 10:51:41:      Stalled Balancer Scan - Loaded 0 balancer states in 1.946 ms
2024-04-15 10:51:41:      Stalled Balancer Scan - Done.
2024-04-15 10:51:41:  Performing Stalled License Forwarder Scan...
2024-04-15 10:51:41:      Stalled License Forwarder Scan - Loading forwarder states
2024-04-15 10:51:41:      Stalled License Forwarder Scan - Loaded 0 forwarder states in 1.885 ms
2024-04-15 10:51:41:      Stalled License Forwarder Scan - Done.
2024-04-15 10:51:41:  Performing Stalled Connection Server Scan...
2024-04-15 10:51:41:      Stalled Connection Server Scan - Loading Connection Server states
2024-04-15 10:51:41:      Stalled Connection Server Scan - Loaded 1 Connection Server states in 3.387 ms
2024-04-15 10:51:41:      Stalled Connection Server Scan - Scanning Connection Server states
2024-04-15 10:51:41:      Stalled Connection Server Scan - Cleaned up 0 stalled Connection Servers in 648.600 µs
2024-04-15 10:51:41:      Stalled Connection Server Scan - Done.
2024-04-15 10:51:41:  Triggering repository repair events...
2024-04-15 10:51:41:  Process exit code: 0

You’ll run into issues running a worker on the same machine as a Database. If the Database can’t use the CPU/RAM when the render is running it’ll lock up, then everything else will fail as it can no longer access the DB.

If you have to do this, ensure you uncheck enough cores for the DB/RCS/OS on the DeadlineWorker, so when it renders and goes 100% on the CPU it’ll leave enough cores for the DB/RCS/OS.

The logs make it look like it’s running, I assume the Worker launches because it’s connected to the DB via a Direct connection rather than RCS? If you can access the Monitor it’ll be worth disabling the AWS Event plugin as it looks like that is failing.

1 Like

Thanks all great suggestions, if it really struggles then i’ll just show it to my manager and hopefully they’ll set up a dedicated machine to run this in the office, however it sounds like it wont just run on anything? i was kinda hoping i could do this myself running on some low spec low power machine from home at some point, wonder what the minimum requirements are for the RCS.

So yeah on start-up the worker launches automatically along with the Deadline Launcher, i’ve changed it from direct to RCS connection already for both the launcher and worker, and it automatically points to that rather than a direct connection

I’ve managed to get a shortcut for deadlinercs.exe into my startup folder now, but it takes a while to launch on its own, i wonder if theres a way to speed this up?

Here are the minimum requirements: System Requirements — Deadline 10.3.2.1 documentation

The Launcher should start the RCS as the part of startup process. You have the configuration file correctly setup. We should debug that.

Yes, can you explain how the Launcher starts? Do you start it manually or are users which start at the first time vs start again are different?
Could you grab the Launcher log when it start the first time? There must be useful information in there. Logs live here: Logs — Deadline 10.3.2.1 documentation

RCS can run any where in the network but it is recommended to run geographically close to the Database on a Server OS or Linux with increased ulimits. Here’s the diagram: https://docs.thinkboxsoftware.com/products/deadline/10.3/1_User%20Manual/_images/connection_servers_overview.png

No, RCS does not install as service. You could make one for it but I do not think it is really needed. This is because if the Launcher is installed as a service it spins up RCS as a background process.

Not quiet, those should always Worker if the Launcher is running.

Privacy | Site terms | Cookie preferences