Hi, I am setting up a pipeline, that should allow for both rendering and simulating on the same farm. Everything works quite well so far, but I want to reformat how Deadline handles TOP jobs from Houdini. Right now the PDG is setup as combination of two jobs - monitor and “worker” - where monitor runs the scheduling and worker contains all the caching ROP Fetches that are set up as tasks. However, this is not wanted behaviour as each ROP Fetch represents different part of PDG network and you want to have overview how your jobs going.
What I would like to achieve is to have multiple “worker” jobs like this:
BATCH
ROP FETCH - SOURCE WEDGE
ROP FETCH - SOURCE WEDGE 1
ROP FETCH - SIMULATION
MONITOR JOB
Where each job would have work items only generated by the rop fetch they belong to.
Does a set up for this handling of PDG for deadline exist somewhere?
If not, is this achiavable by alterning the submission python file for deadline, or do I have to rework the Deadline Scheduler for TOPs from SideFX as well?
Is Deadline framework able to have job handling like this?
Any tips or direction where to look or what to do to achieve this is much appreciated.