AWS Thinkbox Discussion Forums

hanging machine, deadline not detecting the error

Noticed loads of machines that have been hanging on their frames for 16+ hours. When i remote into the box, the log just shows:

0: INFO: Lightning: TYPE_MISSING_UVWS = IGNORE
0: INFO: Lightning: TYPE_MISSING_DLL_FILES = FAIL
0: INFO: Lightning: TYPE_MISSING_XREF_FILES = IGNORE
0: INFO: Lightning: Calling renderer
0: INFO: Preparing tone operator.
0: INFO: Preparing camera sampler…
0: INFO: Preparing objects
0: INFO: Loading bitmaps…
---- 2013/12/02 19:31 ----

If i manually kill the 3dsmax.exe process, suddently this appears:

0: WARNING: Monitored managed process 3dsmaxProcess is no longer running
0: An exception occurred: Error in RenderTasks: RenderTask: Unexpected exception (Monitored managed process "3dsmaxProcess" has exited or been terminated.
F: [MultiScatter] Version 1.2.0.5
2013/12/02 19:26:53 INF: SYSTEM: Production renderer is changed to Default Scanline Renderer. Previous messages are cleared.
2013/12/02 19:27:14 DBG: Starting network
2013/12/02 19:27:14 INF: [V-Ray] ============================================================
2013/12/02 19:27:14 INF: [V-Ray] Console created, V-Ray Adv 2.45.01 for x64 from Jan 19 2013, 01:32:46
2013/12/02 19:27:14 INF: [V-Ray] ============================================================
2013/12/02 19:27:14 INF: [V-Ray] Compiled with Intel C++ compiler, version 12.1
2013/12/02 19:27:14 INF: [V-Ray] Host is 3dsmax, version 14
2013/12/02 19:27:14 INF: [V-Ray] V-Ray DLL version is 2.00.02
2013/12/02 19:27:14 DBG: [MultiScatter] Try to load C:\3ds Max 2012\MultiScatterVRay23001.dlo
2013/12/02 19:27:14 INF: [MultiScatter] MultiScatterVRay23001.dlo is loaded.
2013/12/02 19:27:14 DBG: [MultiScatter] Try to load C:\3ds Max 2012\MultiScatterMental.dlo
2013/12/02 19:27:14 INF: [MultiScatter] MultiScatterMental.dlo is loaded.
2013/12/02 19:27:16 INF: Loaded C:\Users\scanlinevfx\AppData\Local\Thinkbox\Deadline6\slave\LAPRO0341\plugins\529d4f1426e88a1034a39cdb\deadlineStartupMax2012.max
2013/12/02 19:27:16 INF:    Job:  C:\Users\scanlinevfx\AppData\Local\Thinkbox\Deadline6\slave\LAPRO0341\plugins\529d4f1426e88a1034a39cdb\deadlineStartupMax2012.max 
2013/12/02 19:27:22 INF: Loaded C:/Users/scanlinevfx/AppData/Local/Thinkbox/Deadline6/slave/LAPRO0341/jobsData/529d4f1426e88a1034a39cdb/MR_102_0220_v0029_rza_newMatte.max
2013/12/02 19:27:32 WRN: Gamma Correction Settings are Being Changed
2013/12/02 19:28:34 INF:    Job:  C:/Users/scanlinevfx/AppData/Local/Thinkbox/Deadline6/slave/LAPRO0341/jobsData/529d4f1426e88a1034a39cdb/MR_102_0220_v0029_rza_newMatte.max 
2013/12/02 19:28:34 INF: SYSTEM: Production renderer is changed to V-Ray Adv 2.45.01. Previous messages are cleared.
2013/12/02 19:29:09 DBG: [MultiScatter] Render Begin
2013/12/02 19:34:27 ERR: [V-Ray] UNHANDLED EXCEPTION: Calling EvalWorldState() for node "Thinking_fxBldgDestr-RENDER_Mesher" at time 201400 Last marker is at ./src/vrayrenderer.cpp, line 2462: Preparing camera sampler 

Note the “ERR: [V-Ray] UNHANDLED EXCEPTION: Calling EvalWorldState() for node” error at the end,… it seems like deadline never noticed that.

Deadline didn’t notice that because we don’t actively watch the log file for errors. We only take the contents of that file and append it to the job error report when an error occurs.

Usually when an error like that does occur, it crashes Max, in which case we’ll append the log contents to the error and all is good. This is actually the first time I’ve seen this behavior where that error is written to the log but max hasn’t crashed.

We have found dozens of machines with this today,… very odd. All the same type of crashes

Privacy | Site terms | Cookie preferences