Had the nasty problem of running out of space on the server over the weekend, but Deadline continued to render (3ds max, Vray next), with no errors in the monitor, but of course nothing was getting saved. Would the renders be getting saved on the local slave, so we could go looking for them now we have space clear, or are the renders lost? The artist had submitted the animation rendering in tasks of 2 frames FYI.
Also, I would think that if a slave cant save the frame to the correct network location, such as if no space, then it would/should error?
Outputting work varies plugin to plugin but in general there are two styles:
The renderer saves the files directly to the destination (default)
Deadline hijacks the output path to the job’s temporary folder on the local machine (called local rendering)
In the second case, the plugin usually calls a function to generate a temporary directory and then calls a function to move each file to the destination. I’ve seen that call fail due to file permissions and I assume file servers would report if they ran out of space (there might be NAS firmware bugs that might fail that?).
Once the files are moved, regardless of success or failure as soon as the Slave moves onto a new job it will delete all of the temporary files and folders that were created during the render process.
Hi,
I believe the submitted tasks are not using the Local Rendering option, so they would be trying to save directly to the server. With the server out of space, the save would not be possible, so should Deadline not error, and flag the issue?
Mark
It absolutely should error. I’m not sure why it’s not though. I’ve seen it throw errors when it cannot write due to permissions and this would follow the same code path.
I’m not overly sure how I can reproduce your test case at the moment… I’m open to ideas there because I don’t want people losing work without knowing.
Yes a hard one to replicate. The only thing I could think of is setup a small partition on your local machine, and fill it, then render a scene to that drive and render on your local slave.
Or could you plug in a small/old USB stick, and fill that, and then use that drive letter to render to? Tricky one!