Hi,
I’m currently running a small-scale test at our studio (license free mode, two slaves) to familiarize myself with Deadline 6.
I’ve discovered what I believe is a bug related to the Vray Standalone plugin: After a seemingly random number of render tasks (11, 21 and 25 in my tests) have been successfully completed, the slaves only return errors of this type:
error: Cannot write output image file "-numThreads=00092": "error writing file"
Both slaves fail at the same time, and do not seem to recover unless a new vrayexport job is submitted from within Maya. Requeueing tasks or resubmitting jobs does not work.
The ‘00092’ in the error message seems to be a combination of the ‘-numThreads’ argument (whose value is 0) and the frame number (in this case, frame 92, or 0092 with padding).
In the Vray Deadline plugin’s Python file the ‘-numThreads’ argument is added to the ‘renderarguments’ variable right after ‘-imgFile’, the variable for the image path. Thus it seems to me that the image path string gets corrupted somehow?
cheers,
-Henrik
INFO:
Deadline build: 6.1.0.52823
Operating system: Mac OS X 10.8.4 / 10.8.5
Rendering application: Vray Standalone
Partial output of the error log:
=======================================================
Error
=======================================================
error: Cannot write output image file "-numThreads=00092": "error writing file"
at Deadline.Plugins.ScriptPlugin.RenderTasks (System.String taskId, Int32 startFrame, Int32 endFrame, System.String& outMessage, FranticX.Processes.AbortLevel& abortLevel) [0x00000] in <filename unknown>:0
=======================================================
Type
=======================================================
RenderPluginException
=======================================================
Stack Trace
=======================================================
at Deadline.Plugins.Plugin.RenderTask (System.String taskId, Int32 startFrame, Int32 endFrame) [0x00000] in <filename unknown>:0
at Deadline.Slaves.SlaveRenderThread.a (Deadline.IO.TaskLogWriter A_0) [0x00000] in <filename unknown>:0
PS: I can post the entire error log if that is helpful, though I’d want to anonymize some file paths due to clients etc. Let me know if this would be helpful!
Hi Henrik,
Can you post the full log? I’m curious to see what the command line arguments that Deadline is passing to VRay look like. I’m looking at the vray plugin code, and it’s not obvious how this could even happen. 
Thanks!
Hi Ryan,
Here’s the full log, minus the render progress messages (reached the character limit for this post):
=======================================================
Error
=======================================================
error: Cannot write output image file "-numThreads=00092": "error writing file"
at Deadline.Plugins.ScriptPlugin.RenderTasks (System.String taskId, Int32 startFrame, Int32 endFrame, System.String& outMessage, FranticX.Processes.AbortLevel& abortLevel) [0x00000] in <filename unknown>:0
=======================================================
Type
=======================================================
RenderPluginException
=======================================================
Stack Trace
=======================================================
at Deadline.Plugins.Plugin.RenderTask (System.String taskId, Int32 startFrame, Int32 endFrame) [0x00000] in <filename unknown>:0
at Deadline.Slaves.SlaveRenderThread.a (Deadline.IO.TaskLogWriter A_0) [0x00000] in <filename unknown>:0
=======================================================
Full Log
=======================================================
0: Task timeout is disabled.
0: Loaded job: elgiganten_bling_60mnd_rentefritt_RENDER_v007_danmark_HTD - layer medaljong (5253e210b04d679ca5938ea5)
0: INFO: Executing plugin script /Users/andre.hay/Library/Application Support/Thinkbox/Deadline6/slave/VES01-AndreHay/plugins/5253e210b04d679ca5938ea5/Vray.py
0: INFO: About: VRay Standalone Plugin for Deadline
0: INFO: The current environment will be used for rendering
0: Plugin rendering frame(s): 92
0: INFO: Starting VRay Task
0: INFO: Stdout Handling Enabled: True
0: INFO: Popup Handling Enabled: False
0: INFO: Using Process Tree: True
0: INFO: Hiding DOS Window: True
0: INFO: Creating New Console: False
0: INFO: Render Executable: "/Applications/Autodesk/maya2013/vray/bin/vray"
0: INFO: Render Argument: -scenefile="/Volumes/Video1/Utvikling/Client/Project/Prosjekt/mayaBling/data/renderData/vrayscenes/bling_DK_render_v007_medaljong.vrscene" -interactive=0 -display=0 -frames=92 -imgFile="""" -numThreads=0
0: INFO: Startup Directory: "/Applications/Autodesk/maya2013/vray/bin"
0: INFO: Process Priority: BelowNormal
0: INFO: Process Affinity: default
0: INFO: Process is now running
0: STDOUT: [2013/Oct/9|13:09:16] Reading configuration from "/Applications/Autodesk/maya2013/vray/bin//vrayconfig.xml"
0: STDOUT: [2013/Oct/9|13:09:16] ===============================================
0: STDOUT: [2013/Oct/9|13:09:16] V-Ray Standalone, version 2.20.01 for x64
0: STDOUT: [2013/Oct/9|13:09:16] Copyright (C) 2000-2010 Chaos Group Ltd. All rights reserved.
0: STDOUT: [2013/Oct/9|13:09:16] Use -credits option for additional third-party copyright notices.
0: STDOUT: [2013/Oct/9|13:09:16]
0: STDOUT: [2013/Oct/9|13:09:16] Build from May 29 2012, 12:56:52
0: STDOUT: [2013/Oct/9|13:09:16] Compiled with GCC-compatible compiler, version 4.2
0: STDOUT: [2013/Oct/9|13:09:16] Operating system is Mac OS X
0: STDOUT: [2013/Oct/9|13:09:16]
0: STDOUT: [2013/Oct/9|13:09:16] V-Ray core version is 2.00.01
0: STDOUT: [2013/Oct/9|13:09:16] ===============================================
0: STDOUT: [2013/Oct/9|13:09:16]
0: STDOUT: [2013/Oct/9|13:09:16] Loading plugins from "/Applications/Autodesk/maya2013/vray/vrayplugins/libvray_*.so"
0: STDOUT: [2013/Oct/9|13:09:18] 102 plugin(s) loaded successfully
0: STDOUT: [2013/Oct/9|13:09:18] Finished loading plugins.
0: STDOUT: [2013/Oct/9|13:09:18] Reading scene file "/Volumes/Video1/Utvikling/Client/Project/Prosjekt/mayaBling/data/renderData/vrayscenes/bling_DK_render_v007_medaljong.vrscene"
0: STDOUT: [2013/Oct/9|13:09:18] /Volumes/Video1/Utvikling/Client/Project/Prosjekt/mayaBling/data/renderData/vrayscenes/bling_DK_render_v007_medaljong.vrscene: done [ 0h 0m 0.2s]
0: STDOUT: [2013/Oct/9|13:09:18] Scene file parsed successfully in 0.2 s.
0: STDOUT: [2013/Oct/9|13:09:18] Scene created successfully.
0: STDOUT: [2013/Oct/9|13:09:18] Objects in scene: 105
0: STDOUT: [2013/Oct/9|13:09:18] Starting render sequence.
0: STDOUT: [2013/Oct/9|13:09:18] Preparing renderer...
0: STDOUT: Preparing scene for rendering...: 0.00% [ 0h 0m 2.1s] [ 0h 0m 0.0s est][2013/Oct/9|13:09:18] Creating bitmap manager
0: STDOUT: [2013/Oct/9|13:09:18] Preparing scene for rendering...: done [ 0h 0m 0.0s]
0: STDOUT: [2013/Oct/9|13:09:18] ========================
0: STDOUT: [2013/Oct/9|13:09:18] Starting frame 92.
0: STDOUT: Preparing scene for frame...: 0.00% [ 0h 0m 2.3s] [ 0h 0m 0.0s est][2013/Oct/9|13:09:19] Bitmap file "/Volumes/Video1/Utvikling/__Assets/HDR_Panoramic/Studio_HDR_giveaway_by_zbyg/studio004small.hdr" loaded.
0: STDOUT: [2013/Oct/9|13:09:19] Bitmap file "/Volumes/Video1/Utvikling/__Assets/ProductionPhotoLightsHDRIvol4.rar Folder/fluorescent_pnl_lamps_03/flrsc_pnl_lamps_03_normal.hdr" loaded.
0: STDOUT: Preparing scene for frame...: 33.02% [ 0h 0m 0.7s] [ 0h 0m 1.4s est][2013/Oct/9|13:09:19] Preparing scene for frame...: done [ 0h 0m 0.8s]
0: STDOUT: Compiling geometry...: 0.00% [ 0h 0m 2.3s] [ 0h 0m 0.0s est][2013/Oct/9|13:09:19] Compiling geometry...: done [ 0h 0m 0.0s]
0: STDOUT: Building static raycast accelerator...: 0.00% [ 0h 0m 3.1s] [ 0h 0m 0.0s est][2013/Oct/9|13:09:19] Building static raycast accelerator...: done [ 0h 0m 0.0s]
0: STDOUT: [2013/Oct/9|13:09:19] SDTree statistics:
0: STDOUT: [2013/Oct/9|13:09:19] Total number of faces stored: 4
0: STDOUT: [2013/Oct/9|13:09:19] Max tree depth: 2
0: STDOUT: [2013/Oct/9|13:09:19] Average tree depth: 2
0: STDOUT: [2013/Oct/9|13:09:19] Number of tree nodes: 3
0: STDOUT: [2013/Oct/9|13:09:19] Number of tree faces: 4
0: STDOUT: [2013/Oct/9|13:09:19] Number of tree leafs: 2
0: STDOUT: [2013/Oct/9|13:09:19] Average faces/leaf: 2
0: STDOUT: [2013/Oct/9|13:09:19] Memory usage: 1.69 MB
0: STDOUT: Building motion blur raycast accelerator...: 0.00% [ 0h 0m 3.1s] [ 0h 0m 0.0s est]Building motion blur raycast accelerator...: 64.93% [ 0h 0m 0.2s] [ 0h 0m 0.1s est]Building motion blur raycast accelerator...: 148.07% [ 0h 0m 0.4s] [-1h -1m -0.1s est][2013/Oct/9|13:09:20] Building motion blur raycast accelerator...: done [ 0h 0m 0.6s]
0: STDOUT: [2013/Oct/9|13:09:20] MBTree statistics:
0: STDOUT: [2013/Oct/9|13:09:20] Number of node faces: 89310
0: STDOUT: [2013/Oct/9|13:09:20] Number of tree nodes: 7825
0: STDOUT: [2013/Oct/9|13:09:20] Max tree depth: 34
0: STDOUT: Rendering image...: 0.00% [ 0h 0m 3.1s] [ 0h 0m 0.0s est]Rendering image...: 2.35% [ 0h 0m 0.2s] [ 0h 0m 8.3s est] #### Shortened this line due to Deadline Forum's character limit #### Rendering image...: 99.95% [ 0h 5m 13.9s] [ 0h 0m 0.2s est][2013/Oct/9|13:14:34] Rendering image...: done [ 0h 5m 14.1s]
0: STDOUT: [2013/Oct/9|13:14:34] Number of raycasts: 496477740
0: STDOUT: [2013/Oct/9|13:14:34] Camera rays: 61005056
0: STDOUT: [2013/Oct/9|13:14:34] Shadow rays: 208241132
0: STDOUT: [2013/Oct/9|13:14:34] GI rays: 0
0: STDOUT: [2013/Oct/9|13:14:34] Reflection rays: 227231552
0: STDOUT: [2013/Oct/9|13:14:34] Refraction rays: 0
0: STDOUT: [2013/Oct/9|13:14:34] Unshaded rays: 0
0: STDOUT: [2013/Oct/9|13:14:34] Number of intersectable primitives: 31043
0: STDOUT: [2013/Oct/9|13:14:34] SD triangles: 4
0: STDOUT: [2013/Oct/9|13:14:34] MB triangles: 31038
0: STDOUT: [2013/Oct/9|13:14:34] Static primitives: 0
0: STDOUT: [2013/Oct/9|13:14:34] Moving primitives: 0
0: STDOUT: [2013/Oct/9|13:14:34] Infinite primitives: 1
0: STDOUT: [2013/Oct/9|13:14:34] error: Cannot write output image file "-numThreads=00092": "error writing file"
0: STDOUT: [2013/Oct/9|13:14:34] Frame took 315.50 s.
0: STDOUT: [2013/Oct/9|13:14:34] Bitmap file "/Volumes/Video1/Utvikling/__Assets/HDR_Panoramic/Studio_HDR_giveaway_by_zbyg/studio004small.hdr" unloaded.
0: STDOUT: [2013/Oct/9|13:14:34] Bitmap file "/Volumes/Video1/Utvikling/__Assets/ProductionPhotoLightsHDRIvol4.rar Folder/fluorescent_pnl_lamps_03/flrsc_pnl_lamps_03_normal.hdr" unloaded.
0: STDOUT: [2013/Oct/9|13:14:34] Cleaning up bitmap manager
0: STDOUT: [2013/Oct/9|13:14:34] Closing log - 1 error(s), 0 warning(s).
=======================================================
Details
=======================================================
Date: 10/09/2013 13:14:36
Frames: 92
Elapsed Time: 00:00:05:20
Job Submit Date: 10/08/2013 12:44:32
Job User: henrik
Average RAM Usage: 19388912982 (46%)
Peak RAM Usage: 20239876096 (48%)
Average CPU Usage: 86%
Peak CPU Usage: 100%
Slave Name: VES01-AndreHay
Slave Version: v6.1.0.52823 R
Thanks! We were able to figure out what the problem was, and it will be fixed in the next beta release. In the meantime, you can fix it manually on your end. Go to \your\repository\plugins\Vray and open Vray.options in a text editor. Find this line:
Default=""
Replace it with this (you’re just removing the quotes):
Default=
Now save the file. From now on, any new jobs you submit should no longer run into this problem.
The issue was this default of “” would make its way into the job properties at some point if you used the job properties dialog in the Monitor. This resulted in “”"" being passed as the -imgFile argument, which caused this error.
Cheers,
All right, thanks! Have a great weekend
-Henrik