AWS Thinkbox Discussion Forums

2 Concurrent Tasks working only if preceding job is 100% complete (TOPS/PDG)

I have GPU affinity and 2 concurrent tasks working correctly in TOPS. However, I’ve run into this problem where if the preceding TOPS node hasn’t completed all tasks, the following node (using Deadline scheduler) still picks up frames and submits them to Deadline, but Deadline is only running one task at a time. Again, if all the tasks are complete beforehand, then Deadline runs 2 concurrent tasks as it should.

Update: Looks like it’s not if the preceding node is 100% complete, but rather if there are two batches complete. If only one batch is complete, the following Deadline node submits the job but only one task is run at a time even though the queue is loading with subsequent tasks. Only one ever runs at a time.

If two batches are complete, then the Deadline node submits the job and two tasks run concurrently. Subsequent jobs in the queue are also run concurrently.

bump. Why aren’t subsequent tasks being started/dequeued?

Privacy | Site terms | Cookie preferences