Worker limited to only 16 threads?

Deadline
1

Hello it looks like my worker when rendering are pulling only 16 threads on my box when I have 128 available.
What can I do to force the worker to use the full bunch of threads ?

Houdini 19.5.640 / Linux

Thank you

2

Any news on that front ?
Any ways to unlock the 16 threads cap ?

3

Threads aren’t really the right way to think about that concurrent task limit (this one in the job settings), as they’re not synonymous with CPU threads.

It’s how many tasks can be run by a single Worker, and it cannot be unlocked. However I don’t recall Houdini being single-threaded. When you’re running Houdini outside of Deadline does it use more than a single CPU thread at a time?

4

hello, yes runnig outside of Deadline, I run with 128 threads maxed out

5

This is where I got problem, yes. I am running the job via worker BUT running it through the Houdini full scene, so it should be houdini rules.
I am checking a few things but I am almost sure I will end up in the same spot. just 16 threads out of 128

6

Interesting!

Have you got CPU Affinity set up on the Worker? If you do, could you disable that and re-test? Deadline isn’t NUMA aware, so it fails to manage across multiple NUMA cores. With CPU affinity disabled no CPU limitations are used, so child processes (like Houdini) are not limited.

And could you pull out the full command from one of your Deadline Houdini tasks and try running it? That’ll run the same script with the same flags but outside of the Deadline Worker application. The guide here shows how to pull a Houdini command out of the task report to run outside of Deadline.

Thanks!

7

Good to know, I am going to do that later today and let you know the result. happy to hear though that it should not be any limitations !

8

Hey @Justin_B ,
So I did try and rendered a scene via Deadline manual aka hython …/…hrender_dl.py blabla and It renders successfully and uses all my threads.
I am not successful yet at rendering successfully via the deadline submitter gui though, so i cannot say of it will use all the threads or not.

I will keep you posted

Tanguy

1 Like