AWS Thinkbox Discussion Forums

Render Roulette. Only 50% success rate, but I can't see a pattern

I’m rendering a scene from 3ds max using Redshift. It’s a fairly simple scene with a couple of characters in a very basic environment. It’s fast to render… when it renders.
I’m currently getting about 50 error frames per 100 frames. The application quits without warning. Deadline then goes back and has another go and generally renders them OK again on the second (or third) attempt. Nothing on the system changes during the render, and system resources list as running around 40%.

I’ve read through the event log, but other than the final render error, I can’t see anything that points to what the problem is. Anyone got any idea what is causing this?

=======================================================

Error

=======================================================

Error: FailRenderException : RenderTask: Unexpected exception (Monitored managed process “3dsmaxProcess” has exited or been terminated.

2020/09/29 12:02:31 DBG: [15304] [14624] Starting network

2020/09/29 12:02:31 INF: [15304] [14624] Application started with secure mode state ‘OFF’

2020/09/29 12:02:31 INF: [15304] [14624] Python version: 3

2020/09/29 12:02:31 INF: [15304] [14624] Product version: 3ds Max 2021.2 Update (23.2.0.2215)

2020/09/29 12:02:31 DBG: [15304] [14624] ADP Initialize: Done

2020/09/29 12:02:31 INF: [15304] [14624] Data collection and use is ‘ON’. Change your participation anytime in the Help menu of 3ds Max.

2020/09/29 12:02:32 INF: [15304] [14624] Hair Farm Professional 2.7.2 (build 222) is loaded.

2020/09/29 12:02:37 DBG: [15304] [14624] Graphics driver requested by the user : Nitrous

2020/09/29 12:02:37 DBG: [15304] [14624] Graphics driver actually created in the viewports : null driver

2020/09/29 12:02:38 INF: [15304] [14624] Autodesk 3ds Max Security Tools is active via configuration settings

2020/09/29 12:02:38 INF: [15304] [14624] ALC Security Tool 1.0 loaded. (c:\program files\autodesk\3ds max 2021\applicationplugins\securitytools\contents\scripts\ALC_SecurityTool.ms)

2020/09/29 12:02:38 INF: [15304] [14624] ALC2 Security Tool 1.0 loaded. (c:\program files\autodesk\3ds max 2021\applicationplugins\securitytools\contents\scripts\ALC2_SecurityTool.ms)

2020/09/29 12:02:38 INF: [15304] [14624] CRP Security Tool 1.0 loaded. (c:\program files\autodesk\3ds max 2021\applicationplugins\securitytools\contents\scripts\CRP_SecurityTool.ms)

2020/09/29 12:02:38 INF: [15304] [14624] ADSL Security Tool 1.0 loaded. (c:\program files\autodesk\3ds max 2021\applicationplugins\securitytools\contents\scripts\ADSL_SecurityTool.ms)

2020/09/29 12:02:44 DBG: [15304] [14624] Starting network

2020/09/29 12:02:45 DBG: [15304] [14624] Calling NetRenderPreLoad

2020/09/29 12:02:45 DBG: [15304] [14624] in NetWorkerPreLoad. jobFile: ; jobname: C:\Users\Peter\AppData\Local\Thinkbox\Deadline10\slave\Putty-Phoenix\jobsData\5f728805a4b69d52b495fd20\maxStartup\0\deadlineStartupMax2021.max

2020/09/29 12:02:45 DBG: [15304] [14624] in Init. jobFile: ; jobname: C:\Users\Peter\AppData\Local\Thinkbox\Deadline10\slave\Putty-Phoenix\jobsData\5f728805a4b69d52b495fd20\maxStartup\0\deadlineStartupMax2021.max

2020/09/29 12:02:45 DBG: [15304] [14624] in Init. calling nrGetIface. jobToSend: C:\Users\Peter\AppData\Local\Thinkbox\Deadline10\slave\Putty-Phoenix\jobsData\5f728805a4b69d52b495fd20\maxStartup\0\deadlineStartupMax2021.max

2020/09/29 12:02:45 DBG: [15304] [14624] in NetWorkerPreLoad. curJobname: C:\Users\Peter\AppData\Local\Thinkbox\Deadline10\slave\Putty-Phoenix\jobsData\5f728805a4b69d52b495fd20\maxStartup\0\deadlineStartupMax2021.max; init: 0

2020/09/29 12:02:45 DBG: [15304] [14624] in NetWorkerPreLoad. calling PostInitMessageSystem()

2020/09/29 12:02:45 DBG: [15304] [14624] in NetWorkerPreLoad. srv_pid: 0

2020/09/29 12:02:45 DBG: [15304] [14624] leaving NetWorkerPreLoad. LoadLib()

2020/09/29 12:02:45 DBG: [15304] [14624] NetRenderPreLoad passed

2020/09/29 12:02:45 DBG: [15304] [14624] Graphics driver requested by the user : Nitrous

2020/09/29 12:02:45 DBG: [15304] [14624] Graphics driver actually created in the viewports : null driver

2020/09/29 12:02:45 DBG: [15304] [14624] Graphics driver requested by the user : Nitrous

2020/09/29 12:02:45 DBG: [15304] [14624] Graphics driver actually created in the viewports : null driver

2020/09/29 12:02:45 DBG: [15304] [14624] Graphics driver requested by the user : Nitrous

2020/09/29 12:02:45 DBG: [15304] [14624] Graphics driver actually created in the viewports : null driver

2020/09/29 12:02:49 INF: [15304] [14624] Initializing Python version: 3.7.6

2020/09/29 12:02:49 INF: [15304] [14624] SYSTEM: Production renderer is changed to Scanline Renderer. Previous messages are cleared.

2020/09/29 12:02:49 DBG: [15304] [14624] Interface8::LoadFromFile(C:\Users\Peter\AppData\Local\Thinkbox\Deadline10\slave\Putty-Phoenix\jobsData\5f728805a4b69d52b495fd20\maxStartup\0\deadlineStartupMax2021.max)

2020/09/29 12:02:49 INF: [15304] [14624] Starting to load file: C:\Users\Peter\AppData\Local\Thinkbox\Deadline10\slave\Putty-Phoenix\jobsData\5f728805a4b69d52b495fd20\maxStartup\0\deadlineStartupMax2021.max

2020/09/29 12:02:50 WRN: [15304] [14624] Gamma Correction is Being Enabled

2020/09/29 12:02:50 INF: [15304] [14624] Done loading file: C:\Users\Peter\AppData\Local\Thinkbox\Deadline10\slave\Putty-Phoenix\jobsData\5f728805a4b69d52b495fd20\maxStartup\0\deadlineStartupMax2021.max

2020/09/29 12:02:50 INF: [15304] [14624] SYSTEM: Production renderer is changed to Arnold. Previous messages are cleared.

2020/09/29 12:02:50 DBG: [15304] [14624] Interface8::LoadFromFile(C:/Users/Peter/AppData/Local/Thinkbox/Deadline10/slave/Putty-Phoenix/jobsData/5f728805a4b69d52b495fd20/11041434_Revolution_Chat03_anim_v003.max)

2020/09/29 12:02:50 INF: [15304] [14624] Starting to load file: C:/Users/Peter/AppData/Local/Thinkbox/Deadline10/slave/Putty-Phoenix/jobsData/5f728805a4b69d52b495fd20/11041434_Revolution_Chat03_anim_v003.max

2020/09/29 12:02:51 WRN: [15304] [14624] Gamma Correction is Being Disabled

2020/09/29 12:02:51 INF: [15304] [14624] Done loading file: C:/Users/Peter/AppData/Local/Thinkbox/Deadline10/slave/Putty-Phoenix/jobsData/5f728805a4b69d52b495fd20/11041434_Revolution_Chat03_anim_v003.max

2020/09/29 12:02:51 INF: [15304] [14624] SYSTEM: Production renderer is changed to Redshift Renderer. Previous messages are cleared.

)

at Deadline.Plugins.DeadlinePlugin.FailRender(String message) (Python.Runtime.PythonException)

File “C:\Users\Peter\AppData\Local\Thinkbox\Deadline10\slave\Putty-Phoenix\plugins\5f728805a4b69d52b495fd20\3dsmax.py”, line 378, in RenderTasks

self.MyMaxController.RenderTasks()

File “C:\Users\Peter\AppData\Local\Thinkbox\Deadline10\slave\Putty-Phoenix\plugins\5f728805a4b69d52b495fd20\3dsmax.py”, line 1572, in RenderTasks

self.RenderFrame( frame )

File “C:\Users\Peter\AppData\Local\Thinkbox\Deadline10\slave\Putty-Phoenix\plugins\5f728805a4b69d52b495fd20\3dsmax.py”, line 2449, in RenderFrame

self.PollUntilComplete( not self.DisableProgressUpdateTimeout )

File “C:\Users\Peter\AppData\Local\Thinkbox\Deadline10\slave\Putty-Phoenix\plugins\5f728805a4b69d52b495fd20\3dsmax.py”, line 2861, in PollUntilComplete

self.Plugin.FailRender( “RenderTask: Unexpected exception (%s)” % e.Message )

at Python.Runtime.Dispatcher.Dispatch(ArrayList args)

at __FranticX_GenericDelegate0Dispatcher.Invoke()

at Deadline.Plugins.DeadlinePlugin.RenderTasks()

at Deadline.Plugins.DeadlinePlugin.DoRenderTasks()

at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)

at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)

=======================================================

Type

=======================================================

RenderPluginException

=======================================================

Stack Trace

=======================================================

at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bcw, CancellationToken bcx)

at Deadline.Plugins.SandboxedPlugin.RenderTask(Task task, CancellationToken cancellationToken)

at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter aew, CancellationToken aex)

=======================================================

Log

=======================================================

2020-09-29 12:04:21: 0: Executing plugin command of type ‘Sync Files for Job’

2020-09-29 12:04:21: 0: All job files are already synchronized

2020-09-29 12:04:21: 0: Plugin 3dsmax was already synchronized.

2020-09-29 12:04:21: 0: Done executing plugin command of type ‘Sync Files for Job’

2020-09-29 12:04:21: 0: Start Job timeout is disabled.

2020-09-29 12:04:21: 0: Task timeout is disabled.

2020-09-29 12:04:21: 0: Plugin rendering frame(s): 713

2020-09-29 12:04:21: 0: Executing plugin command of type ‘Render Task’

2020-09-29 12:04:21: 0: INFO: Render Tasks called

2020-09-29 12:04:21: 0: INFO: Executing script: C:\Users\Peter\AppData\Local\Thinkbox\Deadline10\slave\Putty-Phoenix\jobsData\5f728805a4b69d52b495fd20\deadline_preFrame.ms

2020-09-29 12:04:22: 0: INFO: STARTED

2020-09-29 12:04:22: 0: INFO: MaxLightning: Render frame 713

2020-09-29 12:04:22: 0: INFO: MaxLightning: Overriding save file option to 1

2020-09-29 12:04:22: 0: INFO: MaxLightning: Rendering frame “S:\pintSizeChat\asset\media\renderAnim\Revolution\Chat03\Shot06\v001\Revolution_Chat03_Shot06_v001_0713.exr”

2020-09-29 12:04:22: 0: INFO: MaxLightning: Rendering 0 render elements

2020-09-29 12:04:22: 0: INFO: MaxLightning: Checking output paths

2020-09-29 12:04:22: 0: INFO: MaxLightning: Checking default actions

2020-09-29 12:04:22: 0: INFO: MaxLightning: TYPE_MISSING_EXTERNAL_FILES = IGNORE

2020-09-29 12:04:22: 0: INFO: MaxLightning: TYPE_MISSING_UVWS = IGNORE

2020-09-29 12:04:22: 0: INFO: MaxLightning: TYPE_MISSING_DLL_FILES = FAIL

2020-09-29 12:04:22: 0: INFO: MaxLightning: TYPE_MISSING_XREF_FILES = IGNORE

2020-09-29 12:04:22: 0: INFO: MaxLightning: Calling renderer

2020-09-29 12:04:33: 0: WARNING: Monitored managed process 3dsmaxProcess is no longer running

2020-09-29 12:04:33: 0: Done executing plugin command of type ‘Render Task’

=======================================================

Details

=======================================================

Date: 09/29/2020 12:04:36

Frames: 713

Elapsed Time: 00:00:00:15

Job Submit Date: 09/29/2020 03:04:04

Job User: peter

Average RAM Usage: 14525875200 (43%)

Peak RAM Usage: 14621630464 (43%)

Average CPU Usage: 11%

Peak CPU Usage: 27%

Used CPU Clocks (x10^6 cycles): 54766

Total CPU Clocks (x10^6 cycles): 497872

=======================================================

Worker Information

=======================================================

Worker Name: Putty-Phoenix

Version: v10.1.9.2 Release (3d6a64d94)

Operating System: Windows 10 Pro

Running As Service: No

Machine User: Peter

IP Address:

MAC Address:

CPU Architecture: x64

CPUs: 12

CPU Usage: 4%

Memory Usage: 13.6 GB / 31.9 GB (42%)

Free Disk Space: 2.144 TB (54.158 GB on C:, 622.725 GB on D:, 1.030 TB on E:, 463.581 GB on F:)

Video Card: NVIDIA GeForce GTX 1070

Is your roulette setting at 0.5 :wink:
image
Sorry, couldn’t help it.

which version of RS?
If you submit in batches does it process a whole batch, or does it fail after 1 frame?

2 Likes

Additionally, try submitting the job with ‘Use Batch Plugin’ unchecked so that Deadline is running Max as a simpler command-line program. That tends to get us better error messages.

Haha!
I’m using Redshift version 2.6.56
Have been reluctant to switch up to version 3 mid production. But when I just direct within max I never have any issues. As soon as I send it to Deadline all sorts of fun begins.
When I submit in batches it sometimes gets through quite a few frames before failing. The annoying thing is that when it resets the batch, the whole batch starts rendering again from new. (Maybe a setting I’ve missed?)
I’ll try the ‘batch plugin’ tip tonight and report back.

OK, interesting.
I didn’t find the “Use Batch Plugin” checkbox you mentioned. But this time around I ran it using “Force Workstation Mode” checked. (Maybe it has the same functionality?)
So far so good, with 0 errors!
This is not a sticky option though. If this is the solution, is there a way of forcing it to be on?

I always forget that 3dsMax is special! If you can get it to fail with the 3ds command submitter instead of the 3dsmax submitter. The other big plugins have check box the hides that there’s two plugins behind the scenes.

Running it through 3ds command should get us a better error than that stack trace. At the very least it should be clearer what’s triggering the plugin to fail the render.

All I know about Force Workstation is that it starts Max in Interactive mode which gets it to checkout a workstation license.

Privacy | Site terms | Cookie preferences