Not-completed stops and show completed

anon71649864 · July 21, 2008, 3:56pm

Hello,

We have a random issue where the render stops after a couple of seconds (between 10 and 40 seconds) and show the task as completed even if there’s nothing rendered. This is a problem since the frames are not written and the job continues without re-queuing those bad or missing frames.

Here’s a copy of the slave console. It contains log from a session and shows 3 different frames. First one renders fine, second one stops after 15 seconds and mark as completed with no frame written on disk and the third one renders fine to:

0: STDOUT: ==================================================
0: STDOUT: SOFTIMAGE® | XSI® Batch Version 6.5.2007.0829
0: STDOUT: Copyright© 1998-2007 Avid Technology, Inc. All rights reserved.
0: STDOUT: ==================================================
0: STDOUT:
0: STDOUT: License information: using [XSI Batch Win]
0: STDOUT: COMMAND: -render “M:\Production\Projects\Screamers2\Sandbox\Shots\SC045\MAP\SC045_XSI\Scenes\SC045_MAP_SCFactory_v008.scn” -frames 85,91,1 -pass “Factory_SPC” -output_dir “M:\Production\Projects\Screamers2\Sandbox\Shots\SC045\MAP\SC045_XSI\Render_Pictures” -skip False -mb False -script “c:\deadline\slave\plugins\AdditionalRenderOptions.vbs” -main SetAdditionalRenderOptions -args -verbose 60 -width “3840” -height “2160” -sampleMin “2” -sampleMax “2” -sampleFilter “mitchell” -sampleJitter “True” -outputPrefix “” -xMin “” -yMin “” -xMax “” -yMax “”
0: STDOUT: >Loading: M:\Production\Projects\Screamers2\Sandbox\Shots\SC045\MAP\SC045_XSI\Scenes\SC045_MAP_SCFactory_v008.scn…
0: STDOUT: ’ INFO : 4034 - Loaded scene was created with build number: 6.5.2007.0829 - compatibility version: 600
---- July 21 2008 – 11:05 AM ----
0: STDOUT: OpenScene “M:\Production\Projects\Screamers2\Sandbox\Shots\SC045\MAP\SC045_XSI\Scenes\SC045_MAP_SCFactory_v008.scn”, False, True
0: STDOUT: ’ INFO : Rendering passes: Passes.Factory_SPC
0: STDOUT: ’ INFO : Rendering frames 85 to 91 with a frame step of 1
0: STDOUT: ’ INFO : Setting the output directory to ‘M:\Production\Projects\Screamers2\Sandbox\Shots\SC045\MAP\SC045_XSI\Render_Pictures’
0: STDOUT: ’ INFO : Motion blur disabled.
0: STDOUT: ’ INFO : Overwrite rendered frames.
0: STDOUT: SetValue “Passes.List..mentalray.VerbosityLevel", “60”
0: STDOUT: SetValue "Passes.List..ImageWidth”, “3840”
0: STDOUT: SetValue “Passes.RenderOptions.ImageWidth”, “3840”
0: STDOUT: SetValue “Passes.List..ImageHeight", “2160”
0: STDOUT: SetValue “Passes.RenderOptions.ImageHeight”, “2160”
0: STDOUT: SetValue "Passes.List..mentalray.SamplesMin”, “2”
0: STDOUT: SetValue “Passes.List..mentalray.SamplesMax", “2”
0: STDOUT: SetValue "Passes.List..mentalray.SamplesFilterType”, 3
0: STDOUT: SetValue “Passes.List..mentalray.SamplesJitter", “True”
0: STDOUT: ’ INFO : Rendering pass ‘Factory_SPC’…
0: STDOUT: ’ INFO : Rendering frame 85 (0.0% done)
---- July 21 2008 – 11:18 AM ----
0: STDOUT: ’ INFO : Rendering frame 86 (14.3% done)
---- July 21 2008 – 11:31 AM ----
0: STDOUT: ’ INFO : Rendering frame 87 (28.6% done)
---- July 21 2008 – 11:34 AM ----
InfoThread - Cancelling task because task filename “\dean\DeadlineRepository\jobs\00o_050_o_35b2395a\Rendering\00o_050_o_35b2395a_00012_85-91.Render008a” could not be found, it was likely requeued
Sending cancel task command to Plugin
0: INFO: Plugin received a cancel message
0: In the process of canceling current task: ignoring exception thrown by PluginLoader
Scheduler Thread - In the process of canceling current tasks: ignoring exception thrown by render thread 0
---- July 21 2008 – 11:35 AM ----
Scheduler Thread - Plugin loaded in 0 seconds.
0: Loaded job: SC027_LIT_Medusa_Fullship_v004 - SC027_REN_Medusa_KEY (00o_050_o_1623a3a4)
0: INFO: Script plugin for Deadline 2.7.29178, built Aug 22 2007 14:02:42 R
0: INFO: >> Softimage XSI Plugin for Deadline, 2004-08-24
0: INFO: job file: c:\deadline\slave\jobsData\00o_050_o_1623a3a4.job
0: Plugin rendering frame(s): 200
0: INFO: Rendering using new batch mode introduced in XSI 6.01
0: INFO: Rendering with XSI version 6
0: INFO: Enforcing 32 bit build of XSI
0: INFO: Executable: “c:\softimage\xsi_6.5\application\bin\xsibatch.bat”
0: INFO: Arguments: " -render “M:\Production\Projects\Screamers2\Sandbox\Shots\SC027\LIT\SC027_XSI\Scenes\SC027_LIT_Medusa_Fullship_v004.scn” -frames 200,200,1 -pass “SC027_REN_Medusa_KEY” -output_dir “M:\Production\Projects\Screamers2\Sandbox\Shots\SC027\LIT\SC027_XSI\Render_Pictures” -skip False -mb False -script “c:\deadline\slave\plugins\AdditionalRenderOptions.vbs” -main SetAdditionalRenderOptions -args -verbose 60 -width “1920” -height “1080” -sampleMin “0” -sampleMax “2” -sampleFilter “box” -sampleJitter “True” -outputPrefix “” -xMin “” -yMin “” -xMax “” -yMax “”"
0: INFO: StartupDir: “c:\softimage\xsi_6.5\application\bin”
0: INFO: UseJobObject: true
0: INFO: HideDosWindow: true
0: STDOUT: ==================================================
0: STDOUT: SOFTIMAGE® | XSI® Batch Version 6.5.2007.0829
0: STDOUT: Copyright© 1998-2007 Avid Technology, Inc. All rights reserved.
0: STDOUT: ==================================================
0: STDOUT:
0: INFO: Process return code: -1073741819
0: INFO: Renderer returned non-zero error code, -1073741819, which will be ignored because it is part of the list of error codes to ignore in the XSI Plugin Configuration.
0: Plugin rendering frame(s): 220
0: INFO: Rendering using new batch mode introduced in XSI 6.01
0: INFO: Rendering with XSI version 6
0: INFO: Enforcing 32 bit build of XSI
0: INFO: Executable: “c:\softimage\xsi_6.5\application\bin\xsibatch.bat”
0: INFO: Arguments: " -render “M:\Production\Projects\Screamers2\Sandbox\Shots\SC027\LIT\SC027_XSI\Scenes\SC027_LIT_Medusa_Fullship_v004.scn” -frames 220,220,1 -pass “SC027_REN_Medusa_KEY” -output_dir “M:\Production\Projects\Screamers2\Sandbox\Shots\SC027\LIT\SC027_XSI\Render_Pictures” -skip False -mb False -script “c:\deadline\slave\plugins\AdditionalRenderOptions.vbs” -main SetAdditionalRenderOptions -args -verbose 60 -width “1920” -height “1080” -sampleMin “0” -sampleMax “2” -sampleFilter “box” -sampleJitter “True” -outputPrefix “” -xMin “” -yMin “” -xMax “” -yMax “”"
0: INFO: StartupDir: “c:\softimage\xsi_6.5\application\bin”
0: INFO: UseJobObject: true
0: INFO: HideDosWindow: true
0: STDOUT: ==================================================
0: STDOUT: SOFTIMAGE® | XSI® Batch Version 6.5.2007.0829
0: STDOUT: Copyright© 1998-2007 Avid Technology, Inc. All rights reserved.
0: STDOUT: ==================================================
0: STDOUT:
0: STDOUT: License information: using [XSI Batch Win]
0: STDOUT: COMMAND: -render “M:\Production\Projects\Screamers2\Sandbox\Shots\SC027\LIT\SC027_XSI\Scenes\SC027_LIT_Medusa_Fullship_v004.scn” -frames 220,220,1 -pass “SC027_REN_Medusa_KEY” -output_dir “M:\Production\Projects\Screamers2\Sandbox\Shots\SC027\LIT\SC027_XSI\Render_Pictures” -skip False -mb False -script “c:\deadline\slave\plugins\AdditionalRenderOptions.vbs” -main SetAdditionalRenderOptions -args -verbose 60 -width “1920” -height “1080” -sampleMin “0” -sampleMax “2” -sampleFilter “box” -sampleJitter “True” -outputPrefix “” -xMin “” -yMin “” -xMax “” -yMax “”
0: STDOUT: >Loading: M:\Production\Projects\Screamers2\Sandbox\Shots\SC027\LIT\SC027_XSI\Scenes\SC027_LIT_Medusa_Fullship_v004.scn…
0: STDOUT: ’ INFO : 4034 - Loaded scene was created with build number: 6.5.2007.0829 - compatibility version: 600
---- July 21 2008 – 11:36 AM ----
0: STDOUT: OpenScene “M:\Production\Projects\Screamers2\Sandbox\Shots\SC027\LIT\SC027_XSI\Scenes\SC027_LIT_Medusa_Fullship_v004.scn”, False, True
0: STDOUT: ’ INFO : Rendering passes: Passes.SC027_REN_Medusa_KEY
0: STDOUT: ’ INFO : Rendering frames 220 to 220 with a frame step of 1
0: STDOUT: ’ INFO : Setting the output directory to ‘M:\Production\Projects\Screamers2\Sandbox\Shots\SC027\LIT\SC027_XSI\Render_Pictures’
0: STDOUT: ’ INFO : Motion blur disabled.
0: STDOUT: ’ INFO : Overwrite rendered frames.
0: STDOUT: SetValue "Passes.List..mentalray.VerbosityLevel”, “60”
0: STDOUT: SetValue “Passes.List..ImageWidth", “1920”
0: STDOUT: SetValue “Passes.RenderOptions.ImageWidth”, “1920”
0: STDOUT: SetValue "Passes.List..ImageHeight”, “1080”
0: STDOUT: SetValue “Passes.RenderOptions.ImageHeight”, “1080”
0: STDOUT: SetValue “Passes.List..mentalray.SamplesMin", “0”
0: STDOUT: SetValue "Passes.List..mentalray.SamplesMax”, “2”
0: STDOUT: SetValue “Passes.List..mentalray.SamplesFilterType", 0
0: STDOUT: SetValue "Passes.List..mentalray.SamplesJitter”, “True”
0: STDOUT: ’ INFO : Rendering pass ‘SC027_REN_Medusa_KEY’…
0: STDOUT: ’ INFO : Rendering frame 220 (0.0% done)
---- July 21 2008 – 11:43 AM ----
0: STDOUT: ’ INFO : Render completed (100% done)
0: STDOUT: RenderPasses “Passes.SC027_REN_Medusa_KEY”
0: STDOUT: ’ INFO : TransformUVsPlugin has been unloaded.
0: STDOUT: ’ INFO : FBX-XSI import/export Plug-in has been unloaded.
0: STDOUT: ’ INFO : polymatricksPlugin has been unloaded.
0: INFO: Process return code: 0
0: Plugin rendering frame(s): 250
0: INFO: Rendering using new batch mode introduced in XSI 6.01
0: INFO: Rendering with XSI version 6
0: INFO: Enforcing 32 bit build of XSI
0: INFO: Executable: “c:\softimage\xsi_6.5\application\bin\xsibatch.bat”
0: INFO: Arguments: " -render “M:\Production\Projects\Screamers2\Sandbox\Shots\SC027\LIT\SC027_XSI\Scenes\SC027_LIT_Medusa_Fullship_v004.scn” -frames 250,250,1 -pass “SC027_REN_Medusa_KEY” -output_dir “M:\Production\Projects\Screamers2\Sandbox\Shots\SC027\LIT\SC027_XSI\Render_Pictures” -skip False -mb False -script “c:\deadline\slave\plugins\AdditionalRenderOptions.vbs” -main SetAdditionalRenderOptions -args -verbose 60 -width “1920” -height “1080” -sampleMin “0” -sampleMax “2” -sampleFilter “box” -sampleJitter “True” -outputPrefix “” -xMin “” -yMin “” -xMax “” -yMax “”"
0: INFO: StartupDir: “c:\softimage\xsi_6.5\application\bin”
0: INFO: UseJobObject: true
0: INFO: HideDosWindow: true

rrussell · July 21, 2008, 4:03pm

I’m seeing this line in the second log:

Process return code: -1073741819
0: INFO: Renderer returned non-zero error code, -1073741819, which will be ignored because it is part of the list of error codes to in the XSI Plugin Configuration.

This messy error code actually represents a memory access violation, which would likely explain your missing frame. You can configure which error codes to ignore in the XSI plugin configuration. Sometimes XSI returns this error code after it writes the frame, which is when it can be ignored. However in this case, it seems to be crashing before the frame is written, so I suggest removing this error code from the list of codes to ignore and see if it still reports success on missing frames.

Cheers,

Ryan

anon71649864 · July 21, 2008, 4:19pm

I went over the forum after searching for the error code and all the links are pointing on the old forum
Anyhow, I was ignoring this error because we were getting good frame even if the code was showing up. Since a couple days, we’re getting this before the frame is rendered. I guess I will remove the ignore from the plugin configuration.

Is it possible to check if the error pops before or after the frame is writen so we could ignore when the frame is there and re-queue if it’s not…

Vincent

rrussell · July 21, 2008, 5:52pm

For now, it’s probably best to just remove that error code from the ignore list. We could potentially look for a specific line of stdout to determine if the frame has completed successfully or not, but in 3.0, we will be introducing a new option to use the new XSIBatch plugin. This plugin only starts up XSI once for a job, and keeps the scene loaded in memory between tasks. Because of this, you shouldn’t even have to worry about this problem because XSI won’t have to be shutdown and restarted for each frame. If the XSIBatch doesn’t resolve this problem, we could take another look at this.

Cheers,

Ryan