MayaBatch error: Cannot find procedure "mapXGen"

Deadline
1

I’m getting some very odd results when enabling Use MayaBatch Plugin with Maya2016 using Deadline 9.0.0.18. I’m rendering with vray and it looks like the renders are all going through and Deadline says the frame is completed however randomly in the job reports I’ll receive this error (the same machine doesn’t kick the error on another frame):

2017-03-27 18:33:30: 0: STDOUT: Read 2 files in 7.3 seconds.
2017-03-27 18:33:31: 0: WARNING: Strict error checking off, ignoring the following error or warning.
2017-03-27 18:33:31: 0: STDOUT: Error: file: C:/Users/render/AppData/Local/Temp/tmpDF72.tmp line 8: Cannot find procedure “mapXGen”.
2017-03-27 18:33:31: 0: WARNING: Strict error checking off, ignoring the following error or warning.
2017-03-27 18:33:31: 0: STDOUT: Error: file: C:/Users/render/AppData/Local/Temp/tmpDF72.tmp line 50: Render failed.
2017-03-27 18:33:31: 0: STDOUT: mel: READY FOR INPUT
2017-03-27 18:33:31: 0: Done executing plugin command of type ‘Render Task’

Here’s the full reports from the same node just different frames in the same sequence:

=======================================================
Log

2017-03-27 18:33:14: 0: Loading Job’s Plugin timeout is Disabled
2017-03-27 18:33:16: 0: Executing plugin command of type ‘Sync Files for Job’
2017-03-27 18:33:16: 0: All job files are already synchronized
2017-03-27 18:33:16: 0: Synchronizing Plugin MayaBatch from S:\DeadlineRepository9\plugins\MayaBatch took: 0 seconds
2017-03-27 18:33:16: 0: Done executing plugin command of type ‘Sync Files for Job’
2017-03-27 18:33:16: 0: Executing plugin command of type ‘Initialize Plugin’
2017-03-27 18:33:17: 0: INFO: Executing plugin script ‘C:\Users\render\AppData\Local\Thinkbox\Deadline9\slave\z21\plugins\58d9bd5312f558ebbcc09639\MayaBatch.py’
2017-03-27 18:33:17: 0: INFO: About: Maya Batch Plugin for Deadline
2017-03-27 18:33:17: 0: INFO: Render Job As User disabled, running as current user ‘render’
2017-03-27 18:33:17: 0: INFO: The job’s environment will be merged with the current environment before rendering
2017-03-27 18:33:17: 0: Done executing plugin command of type ‘Initialize Plugin’
2017-03-27 18:33:17: 0: Start Job timeout is disabled.
2017-03-27 18:33:17: 0: Task timeout is disabled.
2017-03-27 18:33:17: 0: Loaded job: farm_test_v02 - BASELIGHT:shotCam (58d9bd5312f558ebbcc09639)
2017-03-27 18:33:17: 0: Executing plugin command of type ‘Start Job’
2017-03-27 18:33:17: 0: INFO: Rendering with Maya Version 2016.0
2017-03-27 18:33:17: 0: INFO: Setting MAYA_DISABLE_CIP (ADSK Customer Involvement Program) environment variable to 1 for this session
2017-03-27 18:33:17: 0: INFO: Setting MAYA_DISABLE_CER (ADSK Customer Error Reporting) environment variable to 1 for this session
2017-03-27 18:33:17: 0: INFO: Setting MAYA_DISABLE_CLIC_IPM (ADSK In Product Messaging) environment variable to 1 for this session
2017-03-27 18:33:17: 0: INFO: Setting MAYA_OPENCL_IGNORE_DRIVER_VERSION environment variable to 1 for this session
2017-03-27 18:33:17: 0: INFO: Setting MAYA_VP2_DEVICE_OVERRIDE environment variable to VirtualDeviceDx11 for this session
2017-03-27 18:33:17: 0: INFO: Enforcing 64 bit build of Maya
2017-03-27 18:33:17: 0: INFO: Setting PYTHONHOME to C:\Program Files\Autodesk\Maya2016\Python for this session
2017-03-27 18:33:17: 0: INFO: Starting monitored managed process MayaBatch
2017-03-27 18:33:17: 0: INFO: Stdout Redirection Enabled: True
2017-03-27 18:33:17: 0: INFO: Stdout Handling Enabled: True
2017-03-27 18:33:17: 0: INFO: Popup Handling Enabled: True
2017-03-27 18:33:17: 0: INFO: QT Popup Handling Enabled: False
2017-03-27 18:33:17: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2017-03-27 18:33:17: 0: INFO: Using Process Tree: True
2017-03-27 18:33:17: 0: INFO: Hiding DOS Window: True
2017-03-27 18:33:17: 0: INFO: Creating New Console: False
2017-03-27 18:33:17: 0: INFO: Running as user: render
2017-03-27 18:33:17: 0: INFO: Enforcing 64 bit build of Maya
2017-03-27 18:33:17: 0: INFO: Executable: “C:\Program Files\Autodesk\Maya2016\bin\MayaBatch.exe”
2017-03-27 18:33:17: 0: INFO: Argument: -prompt -proj “Z:/USERS/andrew/Farm/maya_test”
2017-03-27 18:33:17: 0: INFO: Full Command: “C:\Program Files\Autodesk\Maya2016\bin\MayaBatch.exe” -prompt -proj “Z:/USERS/andrew/Farm/maya_test”
2017-03-27 18:33:17: 0: INFO: Startup Directory: “C:\Program Files\Autodesk\Maya2016\bin”
2017-03-27 18:33:17: 0: INFO: Process Priority: BelowNormal
2017-03-27 18:33:17: 0: INFO: Process Affinity: default
2017-03-27 18:33:17: 0: INFO: Process is now running
2017-03-27 18:33:17: 0: Done executing plugin command of type ‘Start Job’
2017-03-27 18:33:17: 0: Plugin rendering frame(s): 11
2017-03-27 18:33:18: 0: Executing plugin command of type ‘Render Task’
2017-03-27 18:33:18: 0: INFO: Waiting until maya is ready to go
2017-03-27 18:33:22: 0: WARNING: Strict error checking off, ignoring the following error or warning.
2017-03-27 18:33:22: 0: STDOUT: Error: file: Z:/VAULT/CG/modules/maya/Ntropic/scripts/n_ntropicMenu.mel line 20: UI commands can’t be run in batch mode.
2017-03-27 18:33:22: 0: STDOUT: Result: untitled
2017-03-27 18:33:22: 0: STDOUT: mel: READY FOR INPUT
2017-03-27 18:33:22: 0: INFO: >This is a Render Job
2017-03-27 18:33:22: 0: INFO: Rendering with vray
2017-03-27 18:33:22: 0: INFO: Rendering to network drive
2017-03-27 18:33:22: 0: INFO: Creating melscript to execute render
2017-03-27 18:33:22: 0: INFO: Auto memory detection for VRay enabled
2017-03-27 18:33:22: 0: INFO: Auto memory buffer is 500 MB
2017-03-27 18:33:23: 0: INFO: Available system memory is 60912 MB
2017-03-27 18:33:23: 0: INFO: Setting VRay dynamic memory limit to 60412 MB
2017-03-27 18:33:23: 0: INFO: Executing script: C:\Users\render\AppData\Local\Temp\tmpDF72.tmp
2017-03-27 18:33:23: 0: INFO: Waiting for script to finish
2017-03-27 18:33:23: 0: STDOUT: mel: Loading scene: Z:/USERS/andrew/Farm/maya_test/scenes/farm_test_v02.mb
2017-03-27 18:33:25: 0: STDOUT: [2017/Mar/27|18:33:25] V-Ray: V-Ray for Maya version 3.40.04 from Aug 18 2016, 22:20:57
2017-03-27 18:33:25: 0: STDOUT: [2017/Mar/27|18:33:25] V-Ray: V-Ray core version is 3.25.01
2017-03-27 18:33:25: 0: STDOUT: Initializing V-Ray for Maya
2017-03-27 18:33:25: 0: STDOUT: [2017/Mar/27|18:33:25] V-Ray: Loading plugins from “Z:/VAULT/CG/modules/maya/vray/2016/maya_vray/vrayplugins/vray_.dll"
2017-03-27 18:33:28: 0: STDOUT: Loaded shave shaders for V-Ray 3.1.
2017-03-27 18:33:29: 0: STDOUT: [2017/Mar/27|18:33:29] V-Ray: 75 plugin(s) loaded successfully
2017-03-27 18:33:29: 0: STDOUT: [2017/Mar/27|18:33:29] V-Ray: Loading plugins from "%SHAVE_VRAY_PLUGINS%/vray_.dll”
2017-03-27 18:33:29: 0: STDOUT: [2017/Mar/27|18:33:29] V-Ray: Finished loading plugins.
2017-03-27 18:33:30: 0: STDOUT: [2017/Mar/27|18:33:30] V-Ray: Registered dynamic node vrayMultiProjection (id: 1115335/0x001104C7)
2017-03-27 18:33:30: 0: STDOUT: [2017/Mar/27|18:33:30] V-Ray: Registered dynamic node VRayCurvature (id: 1115347/0x001104D3)
2017-03-27 18:33:30: 0: STDOUT: [2017/Mar/27|18:33:30] V-Ray: Registered dynamic node VRayTriplanar (id: 1115362/0x001104E2)
2017-03-27 18:33:30: 0: STDOUT: [2017/Mar/27|18:33:30] V-Ray: Registered dynamic node VRaySkinMtl (id: 1115348/0x001104D4)
2017-03-27 18:33:30: 0: STDOUT: [2017/Mar/27|18:33:30] V-Ray: Registered dynamic node VRayPointParticleMtl (id: 1115353/0x001104D9)
2017-03-27 18:33:30: 0: STDOUT: [2017/Mar/27|18:33:30] V-Ray: Registered dynamic node VRayStochasticFlakesMtl (id: 1115359/0x001104DF)
2017-03-27 18:33:30: 0: STDOUT: Read 2 files in 7.3 seconds.
2017-03-27 18:33:31: 0: WARNING: Strict error checking off, ignoring the following error or warning.
2017-03-27 18:33:31: 0: STDOUT: Error: file: C:/Users/render/AppData/Local/Temp/tmpDF72.tmp line 8: Cannot find procedure “mapXGen”.
2017-03-27 18:33:31: 0: WARNING: Strict error checking off, ignoring the following error or warning.
2017-03-27 18:33:31: 0: STDOUT: Error: file: C:/Users/render/AppData/Local/Temp/tmpDF72.tmp line 50: Render failed.
2017-03-27 18:33:31: 0: STDOUT: mel: READY FOR INPUT
2017-03-27 18:33:31: 0: Done executing plugin command of type ‘Render Task’

=======================================================
Details

Date: 03/27/2017 18:33:32
Frames: 11
Job Submit Date: 03/27/2017 18:33:07
Job User: andrew
Average RAM Usage: 0 (0%)
Peak RAM Usage: 0 (0%)
Average CPU Usage: 0%
Peak CPU Usage: 0%
Used CPU Clocks (x10^6 cycles): 0
Total CPU Clocks (x10^6 cycles): 0

=======================================================
Slave Information

Slave Name: z21
Version: v9.0.0.18 Release (8bacaeca5)
Operating System: Windows 7 Professional (SP1)
Running As Service: No
Machine User: render
IP Address: 192.168.1.228
MAC Address: 00:25:90:5A:A5:78
CPU Architecture: x64
CPUs: 32
CPU Usage: 3%
Memory Usage: 4.2 GB / 64.0 GB (6%)
Free Disk Space: 200.361 GB
Video Card: Standard VGA Graphics Adapter

NOW SAME NODE DIFFERENT FRAME:

=======================================================
Log

2017-03-27 18:34:08: 0: Start Job timeout is disabled.
2017-03-27 18:34:08: 0: Task timeout is disabled.
2017-03-27 18:34:08: 0: Plugin rendering frame(s): 54
2017-03-27 18:34:08: 0: Executing plugin command of type ‘Render Task’
2017-03-27 18:34:08: 0: INFO: Waiting until maya is ready to go
2017-03-27 18:34:09: 0: STDOUT: mel: READY FOR INPUT
2017-03-27 18:34:09: 0: INFO: >This is a Render Job
2017-03-27 18:34:09: 0: INFO: Rendering with vray
2017-03-27 18:34:09: 0: INFO: Rendering to network drive
2017-03-27 18:34:09: 0: INFO: Creating melscript to execute render
2017-03-27 18:34:09: 0: INFO: Auto memory detection for VRay enabled
2017-03-27 18:34:09: 0: INFO: Auto memory buffer is 500 MB
2017-03-27 18:34:10: 0: INFO: Available system memory is 60835 MB
2017-03-27 18:34:10: 0: INFO: Setting VRay dynamic memory limit to 60335 MB
2017-03-27 18:34:10: 0: INFO: Executing script: C:\Users\render\AppData\Local\Temp\tmp9691.tmp
2017-03-27 18:34:10: 0: INFO: Waiting for script to finish
2017-03-27 18:34:10: 0: STDOUT: mel: Loading scene: Z:/USERS/andrew/Farm/maya_test/scenes/farm_test_v02.mb
2017-03-27 18:34:10: 0: WARNING: Strict error checking off, ignoring the following error or warning.
2017-03-27 18:34:10: 0: STDOUT: Warning: file: C:/Program Files/Autodesk/Maya2016/scripts/others/makeCameraRenderable.mel line 60: Found camera BASELIGHT:shotCamShape.
2017-03-27 18:34:10: 0: STDOUT: V-Ray: Starting render
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Exporting scene to V-Ray.
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Parsing light links time 0h 0m 0.0s (0.0 s)
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Translating scene geometry for V-Ray
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Total time translating scene for V-Ray 0h 0m 0.1s (0.1 s)
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Rendering.
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Clearing bitmap cache memory…
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Rendering frames.
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Updating frame at time 54.00
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Total time updating frame 0h 0m 0.0s (0.0 s)
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Preparing renderer…
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Preparing scene for rendering…
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Creating texture cache with size 1000 MB
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Creating bitmap manager
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: 1 lights found.
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Preparing scene for frame…
2017-03-27 18:34:10: 0: STDOUT: [2017/Mar/27|18:34:10] V-Ray: Dome light resolution increased from 512 to 2048 for light “BASELIGHT__baselightVrayDomeShape”
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Bitmap file “Z:/VAULT/CG/modules/maya/Ntropic/source/baselight/baselight_sun_qtrRes.hdr” loaded.
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: (Estimated time remaining: 0h 0m 0.3s): 61 % completed
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Compiling geometry…
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Building static raycast accelerator…
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: SDTree statistics:
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Total number of faces stored: 1920
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Max tree depth: 26
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Average tree depth: 16.0522
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Number of tree nodes: 1201
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Number of tree faces: 4308
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Number of tree leafs: 402
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Average faces/leaf: 10.7164
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Memory usage: 1.65 MB
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Building static SD trees took 5 milliseconds
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Tracing 250000 image samples for light cache in 64 passes.
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Building light cache…
2017-03-27 18:34:11: 0: STDOUT: [2017/Mar/27|18:34:11] V-Ray: Bitmap file “Z:/VAULT/CG/modules/maya/Ntropic/source/baselight/nuke_colorbars.exr” loaded.
2017-03-27 18:34:12: 0: STDOUT: [2017/Mar/27|18:34:12] V-Ray: (Estimated time remaining: 0h 0m 1.3s): 26 % completed
2017-03-27 18:34:12: 0: STDOUT: [2017/Mar/27|18:34:12] V-Ray: (Estimated time remaining: 0h 0m 0.6s): 51 % completed
2017-03-27 18:34:12: 0: STDOUT: [2017/Mar/27|18:34:12] V-Ray: Merging light cache passes…
2017-03-27 18:34:12: 0: STDOUT: [2017/Mar/27|18:34:12] V-Ray: Light cache contains 1419 samples.
2017-03-27 18:34:12: 0: STDOUT: [2017/Mar/27|18:34:12] V-Ray: Light cache takes 6.6 MB.
2017-03-27 18:34:12: 0: STDOUT: [2017/Mar/27|18:34:12] V-Ray: Prefiltering light cache…
2017-03-27 18:34:12: 0: STDOUT: [2017/Mar/27|18:34:12] V-Ray: Average rays per light cache sample: 124.86 (min 1, max 692)
2017-03-27 18:34:12: 0: STDOUT: [2017/Mar/27|18:34:12] V-Ray: Using premultiplied light cache.
2017-03-27 18:34:12: 0: STDOUT: [2017/Mar/27|18:34:12] V-Ray: Rendering image…
2017-03-27 18:34:12: 0: STDOUT: [2017/Mar/27|18:34:12] V-Ray: (Estimated time remaining: 0h 0m 2.0s): 11 % completed
2017-03-27 18:34:13: 0: STDOUT: [2017/Mar/27|18:34:13] V-Ray: (Estimated time remaining: 0h 0m 3.0s): 23 % completed
2017-03-27 18:34:14: 0: STDOUT: [2017/Mar/27|18:34:13] V-Ray: (Estimated time remaining: 0h 0m 2.9s): 32 % completed
2017-03-27 18:34:14: 0: STDOUT: [2017/Mar/27|18:34:14] V-Ray: (Estimated time remaining: 0h 0m 2.7s): 43 % completed
2017-03-27 18:34:15: 0: STDOUT: [2017/Mar/27|18:34:15] V-Ray: (Estimated time remaining: 0h 0m 2.3s): 51 % completed
2017-03-27 18:34:15: 0: STDOUT: [2017/Mar/27|18:34:15] V-Ray: (Estimated time remaining: 0h 0m 2.0s): 61 % completed
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:15] V-Ray: (Estimated time remaining: 0h 0m 0.4s): 90 % completed
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Number of raycasts: 24459799 (47.18 per pixel)
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Camera rays: 6297599 (12.15 per pixel)
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Shadow rays: 5569042 (10.74 per pixel)
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: GI rays: 11099230 (21.41 per pixel)
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Reflection rays: 1010902 (1.95 per pixel)
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Refraction rays: 0 (0.00 per pixel)
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Unshaded rays: 543056 (1.05 per pixel)
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Premultiplied light cache utilization: 88.74%
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Number of light evaluations: 6018786 (11.61 per pixel)
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Number of intersectable primitives: 1921
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: SD triangles: 1920
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: MB triangles: 0
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Static primitives: 0
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Moving primitives: 0
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Infinite primitives: 1
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Static hair segments: 0
2017-03-27 18:34:16: 0: STDOUT: [2017/Mar/27|18:34:16] V-Ray: Moving hair segments: 0
2017-03-27 18:34:17: 0: STDOUT: [2017/Mar/27|18:34:17] V-Ray: Successfully written image file “Z:/USERS/andrew/Farm/maya_test/images/farm_test_v02/farm_test_v02.0054.png”
2017-03-27 18:34:17: 0: STDOUT: [2017/Mar/27|18:34:17] V-Ray: Total frame time 0h 0m 7.0s (7.0 s)
2017-03-27 18:34:17: 0: STDOUT: [2017/Mar/27|18:34:17] V-Ray: Cleaning up bitmap manager
2017-03-27 18:34:17: 0: STDOUT: [2017/Mar/27|18:34:17] V-Ray: Cleaning up texture cache
2017-03-27 18:34:17: 0: STDOUT: [2017/Mar/27|18:34:17] V-Ray: Total sequence time 0h 0m 7.0s (7.0 s)
2017-03-27 18:34:17: 0: STDOUT: [2017/Mar/27|18:34:17] V-Ray: Render complete
2017-03-27 18:34:17: 0: STDOUT: [2017/Mar/27|18:34:17] V-Ray: ========================
2017-03-27 18:34:17: 0: STDOUT: [2017/Mar/27|18:34:17] V-Ray: Clearing exporter memory…
2017-03-27 18:34:17: 0: STDOUT: [2017/Mar/27|18:34:17] V-Ray: Total time clearing exporter memory 0h 0m 0.0s (0.0 s)
2017-03-27 18:34:17: 0: STDOUT: Render completed.
2017-03-27 18:34:17: 0: STDOUT: mel: READY FOR INPUT
2017-03-27 18:34:18: 0: Done executing plugin command of type ‘Render Task’

=======================================================
Details

Date: 03/27/2017 18:34:19
Frames: 54
Job Submit Date: 03/27/2017 18:33:07
Job User: andrew
Average RAM Usage: 0 (0%)
Peak RAM Usage: 0 (0%)
Average CPU Usage: 0%
Peak CPU Usage: 0%
Used CPU Clocks (x10^6 cycles): 0
Total CPU Clocks (x10^6 cycles): 0

=======================================================
Slave Information

Slave Name: z21
Version: v9.0.0.18 Release (8bacaeca5)
Operating System: Windows 7 Professional (SP1)
Running As Service: No
Machine User: render
IP Address: 192.168.1.228
MAC Address: 00:25:90:5A:A5:78
CPU Architecture: x64
CPUs: 32
CPU Usage: 0%
Memory Usage: 4.6 GB / 64.0 GB (7%)
Free Disk Space: 200.361 GB
Video Card: Standard VGA Graphics Adapter

2

Hi,

Please find attached an updated MayaBatch.py plugin file which should (I’m told) resolve this issue for you. It would be ace if you could let us know if this fixes this issue for you?

MayaBatch.py.zip (25.5 KB)

  1. Backup existing file of same name at: “<your_repo>/plugins/MayaBatch/MayaBatch.py”
  2. Unzip and overwrite same named file in step 1 above.
  3. Re-run previously failing job / re-submit job. As you prefer.

Alternatively, IF this py patch file does NOT resolve the issue for you, a temp work-around is to disable “Path Mapping” in the Maya plugin config here: docs.thinkboxsoftware.com/produc … #mayabatch
(set “Enable Path Mapping” to False)

However, it would be great if you could let us know if the above patch fixes the actual issue for you?

3

We’re having the same issue maya 2017 update3 and Deadline v9

I’ve replaced the mayabatch.py file- this has solved the issue, but not for MayaCmd. Can I get a fix for this too…

I’ve also applied the Autodesk https://knowledge.autodesk.com/support/maya/troubleshooting/caas/sfdcarticles/sfdcarticles/Script-to-fix-Batch-Render-crash-issue-with-im-flag-in-Maya-2017-Update-3.html hotfix as well.

Thanks,
Paul

4

@Paul - Thanks for the feedback. The OP’s error of: “mapXGen” only ever affected the “MayaBatch” plugin, so you must be seeing something unrelated in your “MayaCmd” plugin. Feel free to start a new thread, so we don’t end up confusing things here. Cheers.

5

Thanks Mike, I’ll check it out today and let you know.

Cheers,
Andrew

6

Hey Mike,

So it looks like that did not fix it for Maya2016. The interesting thing that is happening is that the first frame a machine tries to run does not render having the same error as originally posted but the 2nd frame it picks up will render fine.

Thanks,
Andrew

7

An update from me too. We were wrong…

With further testing the mayabatch.py isn’t working. Getting the same error mapXGen

2017-03-29 13:56:52: 0: STDOUT: Error: file: C:/Users/render/AppData/Local/Temp/tmp4C4F.tmp line 9: Cannot find procedure "mapXGen". 2017-03-29 13:56:52: 0: STDOUT: Error: file: C:/Users/render/AppData/Local/Temp/tmp4C4F.tmp line 47: Render failed.

We can render if we turn Maya Batch off so back to mayaCmd.

This is also affecting Maya 2015

8

Hey Paul,

Would you be able to try turning on “Log script contents to render log” and then post a log? I have been unable to reproduce this error with the updated script so far and I would like to see what is going on.

Thanks,
Grant Bartel

9

Hi Grant,

OK here’s where we are at. This is getting confusing as it seems non consistent.
Mixed win7/centos farm- using Deadline path substitution

Strict error checking on
Maya2017update3
Use MayaBatch Plugin- on
Submit Maya Scene File- on
Rendering OK across the farm

Maya2017update3
Use MayaBatch Plugin- on
Submit Maya Scene File- off
Rendering OK across the farm

Maya2017update3
Use MayaBatch Plugin- of
Submit Maya Scene File- on
Not rendering across the farm

Maya2017update3
Use MayaBatch Plugin- off
Submit Maya Scene File- on
Not rendering across the farm

Error log from mayacmd

[code]=======================================================
Error

Error: Renderer returned non-zero error code 208. Check the renderer’s output.
at Deadline.Plugins.PluginWrapper.RenderTasks (System.String taskId, System.Int32 startFrame, System.Int32 endFrame, System.String& outMessage, FranticX.Processes.ManagedProcess+AbortLevel& abortLevel) [0x002bc] in :0

=======================================================
Type

RenderPluginException

=======================================================
Stack Trace

at Deadline.Plugins.SandboxedPlugin.a (Deadline.Net.DeadlineMessage A_0) [0x0021c] in :0
at Deadline.Plugins.SandboxedPlugin.RenderTask (System.String taskId, System.Int32 startFrame, System.Int32 endFrame) [0x000b5] in :0
at Deadline.Slaves.SlaveRenderThread.a (Deadline.IO.TaskLogWriter A_0) [0x00734] in :0

=======================================================
Log

2017-03-29 18:10:07: 0: Plugin will be reloaded because a new job has been loaded.
2017-03-29 18:10:07: 0: Loading Job’s Plugin timeout is Disabled
2017-03-29 18:10:08: 0: Loaded plugin MayaCmd
2017-03-29 18:10:08: 0: Executing plugin command of type ‘Sync Files for Job’
2017-03-29 18:10:08: 0: All job files are already synchronized
2017-03-29 18:10:08: 0: Synchronizing Plugin MayaCmd from /mnt/deadline_repo/DeadlineRepository9/plugins/MayaCmd took: 0 seconds
2017-03-29 18:10:08: 0: Done executing plugin command of type ‘Sync Files for Job’
2017-03-29 18:10:08: 0: Executing plugin command of type ‘Initialize Plugin’
2017-03-29 18:10:08: 0: INFO: Executing plugin script ‘/tmp/Thinkbox/Deadline9/render/slave/render18/plugins/58dbea6d04b662414099dc36/MayaCmd.py’
2017-03-29 18:10:09: 0: INFO: About: Maya Cmd Plugin for Deadline
2017-03-29 18:10:09: 0: INFO: Render Job As User disabled, running as current user ‘render’
2017-03-29 18:10:09: 0: INFO: The job’s environment will be merged with the current environment before rendering
2017-03-29 18:10:09: 0: Done executing plugin command of type ‘Initialize Plugin’
2017-03-29 18:10:09: 0: Start Job timeout is disabled.
2017-03-29 18:10:09: 0: Task timeout is disabled.
2017-03-29 18:10:09: 0: Loaded job: test_cmd no submit scene - persp (58dbea6d04b662414099dc36)
2017-03-29 18:10:09: 0: Executing plugin command of type ‘Start Job’
2017-03-29 18:10:09: 0: Done executing plugin command of type ‘Start Job’
2017-03-29 18:10:09: 0: Plugin rendering frame(s): 2
2017-03-29 18:10:09: 0: Executing plugin command of type ‘Render Task’
2017-03-29 18:10:09: 0: INFO: Setting MAYA_DISABLE_CIP (ADSK Customer Involvement Program) environment variable to 1 for this session
2017-03-29 18:10:09: 0: INFO: Setting MAYA_DISABLE_CER (ADSK Customer Error Reporting) environment variable to 1 for this session
2017-03-29 18:10:09: 0: INFO: Setting MAYA_DISABLE_CLIC_IPM (ADSK In Product Messaging) environment variable to 1 for this session
2017-03-29 18:10:09: 0: INFO: Setting MAYA_OPENCL_IGNORE_DRIVER_VERSION environment variable to 1 for this session
2017-03-29 18:10:09: 0: INFO: Setting MAYA_VP2_DEVICE_OVERRIDE environment variable to VirtualDeviceDx11 for this session
2017-03-29 18:10:09: 0: CheckPathMapping: Swapped “U:/1_JOBS/3D/10_TESTS_AND_PITCHES/test/scenes/test.mb” with “/mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test/scenes/test.mb”
2017-03-29 18:10:09: 0: INFO: Stdout Redirection Enabled: True
2017-03-29 18:10:09: 0: INFO: Asynchronous Stdout Enabled: False
2017-03-29 18:10:09: 0: INFO: Stdout Handling Enabled: True
2017-03-29 18:10:09: 0: INFO: Popup Handling Enabled: True
2017-03-29 18:10:09: 0: INFO: QT Popup Handling Enabled: False
2017-03-29 18:10:09: 0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2017-03-29 18:10:09: 0: INFO: Using Process Tree: True
2017-03-29 18:10:09: 0: INFO: Hiding DOS Window: True
2017-03-29 18:10:09: 0: INFO: Creating New Console: False
2017-03-29 18:10:09: 0: INFO: Running as user: render
2017-03-29 18:10:09: 0: INFO: Rendering with Maya version 2017.0
2017-03-29 18:10:09: 0: INFO: Not enforcing a build of Maya
2017-03-29 18:10:09: 0: INFO: Executable: “/usr/autodesk/maya2017/bin/Render”
2017-03-29 18:10:09: 0: CheckPathMapping: Swapped “U:/1_JOBS/3D/10_TESTS_AND_PITCHES/test/images/” with “/mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test/images/”
2017-03-29 18:10:09: 0: INFO: Rendering to network drive
2017-03-29 18:10:09: 0: INFO: Rendering with Arnold.
2017-03-29 18:10:09: 0: CheckPathMapping: Swapped “U:/1_JOBS/3D/10_TESTS_AND_PITCHES/test” with “/mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test”
2017-03-29 18:10:09: 0: INFO: Argument: -r arnold -ai:lve 1 -rt 0 -x 1920 -y 1080 -s 2 -e 2 -b 1 -rd “/mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test/images” -im “/test” -cam “persp” -proj “/mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test” “/mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test/scenes/test.mb”
2017-03-29 18:10:09: 0: INFO: Full Command: “/usr/autodesk/maya2017/bin/Render” -r arnold -ai:lve 1 -rt 0 -x 1920 -y 1080 -s 2 -e 2 -b 1 -rd “/mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test/images” -im “/test” -cam “persp” -proj “/mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test” “/mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test/scenes/test.mb”
2017-03-29 18:10:09: 0: INFO: Startup Directory: “/usr/autodesk/maya2017/bin”
2017-03-29 18:10:09: 0: INFO: Process Priority: BelowNormal
2017-03-29 18:10:09: 0: INFO: Process Affinity: default
2017-03-29 18:10:09: 0: INFO: Process is now running
2017-03-29 18:10:09: 0: INFO: Process exit code: 208
2017-03-29 18:10:09: 0: Done executing plugin command of type ‘Render Task’
2017-03-29 18:10:09: 0: An exception occurred: Error: Renderer returned non-zero error code 208. Check the renderer’s output.
2017-03-29 18:10:09: at Deadline.Plugins.PluginWrapper.RenderTasks (System.String taskId, System.Int32 startFrame, System.Int32 endFrame, System.String& outMessage, FranticX.Processes.ManagedProcess+AbortLevel& abortLevel) [0x002bc] in :0 (Deadline.Plugins.RenderPluginException)
[/code]

10

Hey Paul,

So the mapXGen stuff is only in Maya Batch (not maya cmd) so if maya batch is working with those changes then that is good.

For the Maya Cmd (Batch mode turned off) would you be able to try running the command that is is printed on the line starting with Full Command from the terminal on the rendering machine, and then post the results? Also do you know if there are any paths inside the scene file that need to be remapped in order for this to render?

This appears to be the command from the log you provided.

"/usr/autodesk/maya2017/bin/Render"  -r arnold  -ai:lve 1 -rt 0 -x 1920 -y 1080  -s 2 -e 2 -b 1 -rd "/mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test/images" -im "<RenderPass>/test" -cam "persp" -proj "/mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test"  "/mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test/scenes/test.mb"

Grant Bartel

11

Hey Grant,

The MayaBatch file you provided is not working with Maya2016. We are still receiving the same errors. The first time a slave picks up a frame it will fail but all subsequent frames will run successfully.

Thanks,
Andrew

12

I’m having the exact same issues, and have been in contact with support over the past week or two. I had the issues in 2016.5, and am having them on 2017 as well. Note that 3 of the 5 computers running 2017 were clean installs with no previous versions installed. No machine or type of machine fails more often or any differently than any other.

Furthermore, I tried to render a slightly more complex, larger file last night with animation, rigs, ncloth caches, etc. and the same type of thing occurs, except instead of each machine missing one frame predictably, they each missed MOST of the frames, and would occasionally render one out randomly. The files that were rendered would be randomly distributed among all 5 slaves, were different frames every time I submitted, and showed no pattern.

I should note that I have resorted to manually splitting up the scene into dozens of smaller scenes and am manually managing the renders across 5 different computers. Every one of those computers will render every frame of every scene without issue, no matter how the render is invoked. But they absolutely will not render consistently through deadline.

I am adding this in here to provide any more information to help solve this problem. I will say that deadline seems to “phantom render” (fail) the files very quickly, before it’s possible that the scene file could have been fully read.

13

Hi Grant,

Here is the output from running the job through the cli

[root@render20 bin]# ./Render -r arnold -ai:lve 1 -rt 0 -x 1920 -y 1080 -s 2 -e 2 -b 1 -rd /mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test/images -im “/test” -cam “persp” -proj /mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test /mnt/warpfs1/1_JOBS/3D/10_TESTS_AND_PITCHES/test/scenes/test.mb

Starting “/usr/autodesk/maya2017/bin/maya”

terminate called after throwing an instance of ‘std::out_of_range’
what(): basic_string::erase
Stack trace:
gsignal
abort
__gnu_cxx::__verbose_terminate_handler()
/usr/lib64/libstdc++.so.6() [0x374f8bcbd6]
/usr/lib64/libstdc++.so.6() [0x374f8bcc03]
/usr/lib64/libstdc++.so.6() [0x374f8bcd22]
std::__throw_out_of_range(char const*)
/usr/autodesk/maya2017/lib/libMC3.so.9(+0x8bfb7) [0x7f473100afb7]
/usr/autodesk/maya2017/lib/libMC3.so.9(+0x91ed0) [0x7f4731010ed0]
/usr/autodesk/maya2017/lib/libMC3.so.9(+0x935d6) [0x7f47310125d6]
/usr/autodesk/maya2017/lib/libMC3.so.9(+0x3ca5a) [0x7f4730fbba5a]
/usr/autodesk/maya2017/lib/libMC3.so.9(+0x7d8b6) [0x7f4730ffc8b6]
/usr/autodesk/maya2017/lib/libMC3.so.9(+0x67e51) [0x7f4730fe6e51]
CMLFacade::Initialize(CMLWaypoint*, wchar_t const*, wchar_t const*, int, unsigned int, long long, long long, wchar_t const*, bool)
CMLFacade::Initialize(CMLWaypoint*, wchar_t const*, wchar_t const*, int, unsigned int, long long, long long, wchar_t const*)
TCIPClient::initialize()
TCIPClient::TCIPClient()
TCIPClient::theOne()
TbaseApp::cipReportStartup()
TbaseApp::initGeneral()
/usr/autodesk/maya2017/bin/maya.bin() [0x416392]
Tapplication::start()
/usr/autodesk/maya2017/bin/maya.bin() [0x40ef90]
main
__libc_start_main
/usr/autodesk/maya2017/bin/maya.bin() [0x40e82d]

Segmentation fault (core dumped)
// Maya exited with status 139

14

I think you’re being bitten by one of the bugs in Maya we workaround by setting environment variables. Can you throw these commands down first:

export MAYA_DISABLE_CIP=1
export MAYA_DISABLE_CER=1
export MAYA_DISABLE_CLIC_IPM=1
export MAYA_OPENCL_IGNORE_DRIVER_VERSION=1
export MAYA_VP2_DEVICE_OVERRIDE=VirtualDeviceDx11 # More of a Windows thing, but won’t hurt

15

Hello everyone,

Here is an updated Maya Batch that should fix this, it appears that there was another bug in it that only appeared if you had no pathmappings set in Deadline. Please let me know if you see this error any more after updating to this script.

Grant
MayaBatch.zip (25.2 KB)

16

Hey Grant,

Thanks for this… I tested this new MayaBatch plugin in both 2016 and 2017 and had no issues! One thing to note is that we do not have path mapping set so those last changes seem to do the trick.

Thanks,
Andrew