Deadline Version: 3.1.0.36430
Vray 1.5 SP2
Max 2009 SP1 64bit
Problem happens randomly on the slaves and occurs with heavy scenes which require a lot of RAM (total PF size is aroung 10Gb). Render progress update is stuck at some moment and the task is not marked as complete even when output image is saved. This actully stops all render process… Is that possible to somehow force deadline to mark task complete as soon as output image is saved? 3dsmaxconnect log is attached.
Also i would like to mention, that this happens when task contains one frame, when there is a contiguos number of frames in task, max renders subsequent frames all right.
3dsmaxConnect.log (523 KB)
How much RAM is available on the machines that you’re rendering on? Also, what’s the actual memory usage at when you see this problem occur? Just wondering if it’s the case were max is running out of memory, because that can cause all sorts of unexpected results. From looking at the log, it looks like the socket connection between 3dsmax and Deadline is getting corrupted. This socket connection is used to tell Deadline that the render has finished, so if it gets corrupted, there is no way for Deadline to know that the render has finished. Unfortunately, the presence of a rendered frame doesn’t always indicate success, as the frame itself could be corrupted.
Let us know if it’s possible that the render machine is running out of memory, because currently I can’t think of another reason why the socket connection would get corrupted like this.
Cheers,
our render slaves are 8GB RAm, and 3dsmax process can take up to 7GB Ram when error occurs. But 3dsmax doesn’t crash, and saved frame is absolutely OK. In case of direct/local rendering (without Deadline), everything goes fine, though the machine can be low on virtual memory. And, if the mention deadline stuck occurs, saved image is fine. I agree, that the scene is very heavy, and the reason of stuck is memory, but i wonder, if Deadline can be scripted to mark frame comlplete when in 3dsmaxconnect.log message about saved frame appears?
Would you happen to have a machine with more than 8GB kicking around that you could test these heavy scenes on, just to make sure it is memory related? Also, I noticed you’re using VRay 1.5 SP2. Any chance you could test with SP3 or SP4, just to see if it that helps? Currently, Deadline doesn’t scan the 3dsmaxConnect log, but that’s not to say it isn’t possible. However, I think it would be better to find out the true source of the problem first before we go down this route.
Cheers,