What could remove the job’s repository folder?
I maya renderjob started failing mid render complaining that a prestart file is missing. Trying to find it, seems like the whole job folder is missing…
Only the aux file is copied to the job folder. A working example:
\inferno2\deadline\repository6\jobs\51ddf178b4e5bb0520a550f5
\inferno2\deadline\repository6\jobs\51ddf178b4e5bb0520a550f5\prestart.py
But for this particular job, after half the job finished successfully i got this error on all the last frames, and the job folder is indeed gone:
An error occurred while synchronizing the job’s auxiliary files: can not find source file: \inferno2\deadline\repository6\jobs\51dedf4cb4e5bb092861eca1\prestart.py (System.IO.FileNotFoundException)
That’s very odd. The only thing I can think of is that a slave (or pulse, if you guys are running it) thought that job was deleted, and cleaned up its auxiliary folder. If you are running Pulse, you could check its logs to see if it contains “Purging job auxiliary files” for that specific job to see if that was the case. If it was, we’ll need to figure out why it thought the job was deleted when it wasn’t.
I thought we had pulse running, but apparently its not.
This is what the monitor is saying:
Pulse Name:deadline
Machine Name:deadline.scanlinevfxla.com
Status: Running
Last Status Update:1.2 mths ago
Running Time: 3.6 wks
How can it be running, when the last status update was 1.2 months ago?
the process is not running btw
Heh, I don’t think we actually have “stalled Pulse detection” like we do for the slaves. We’ll add this to the todo list.