AWS Thinkbox Discussion Forums

One of the DBR nodes is not added

Hello
Just downloaded new beta 7 and i should say that this is really awesome !
I am testing dynamic DBR in our environment and for now it works fine. Though i encountered one problem , one of the slaves (the one where i submit job from) is not rendering. It is not being added to master slave DR list for some reason. I tried to reduce list to 1 and add them all back (i am testing on 4 machines) , also i tried to restart slave which is not being added - nothing helps. VRay spawner starts , but is not being added to the process.
Any logs which can help you understand why this happens ?
Thanks.

Also when i am re-adding nodes sometimes i get this error :

=======================================================
Error
=======================================================
Error: AttributeError : 'Task' object has no attribute 'TaskSlaveMachineName' (Python.Runtime.PythonException)
  File "C:\Users\pikadmin\AppData\Local\Thinkbox\Deadline8\slave\PR102\plugins\56b345837c0ec85daca9817b\3dsCmd.py", line 782, in PostRenderTasks
    RepositoryUtils.CompleteTasks( currentJob, [task,], task.TaskSlaveMachineName )

   at Deadline.Plugins.PluginWrapper.RenderTasks(String taskId, Int32 startFrame, Int32 endFrame, String& outMessage, AbortLevel& abortLevel)

=======================================================
Type
=======================================================
RenderPluginException

=======================================================
Stack Trace
=======================================================
   at Deadline.Plugins.SandboxedPlugin.a(DeadlineMessage A_0)
   at Deadline.Plugins.SandboxedPlugin.RenderTask(String taskId, Int32 startFrame, Int32 endFrame)
   at Deadline.Slaves.SlaveRenderThread.a(TaskLogWriter A_0)

=======================================================
Log
=======================================================
2016-02-04 12:35:25:  BEGIN - PR102\pikadmin
2016-02-04 12:35:25:  0: Executing plugin command of type 'Deadline.Slaves.Messaging.InitializeCommandMemento'
2016-02-04 12:35:26:  0: INFO: Executing plugin script 'C:\Users\pikadmin\AppData\Local\Thinkbox\Deadline8\slave\PR102\plugins\56b345837c0ec85daca9817b\3dsCmd.py'
2016-02-04 12:35:26:  0: INFO: Sys Env Var PATH: C:\Program Files\Thinkbox\Deadline8\bin\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files\Common Files\Autodesk Shared\;C:\Program Files (x86)\Autodesk\Backburner\
2016-02-04 12:35:26:  0: INFO: Sys Env Var PATH length: 274
2016-02-04 12:35:26:  0: INFO: Backburner Path(s) Found in PATH: 'C:\Program Files (x86)\Autodesk\Backburner\'
2016-02-04 12:35:26:  0: INFO: Backburner server.exe version: 2014.0.0.1635
2016-02-04 12:35:26:  0: INFO: About: 3dsCmd Plugin for Deadline
2016-02-04 12:35:26:  0: INFO: The job's environment will be merged with the current environment before rendering
2016-02-04 12:35:26:  0: Done executing plugin command of type 'Deadline.Slaves.Messaging.InitializeCommandMemento'
2016-02-04 12:35:26:  0: Start Job timeout is disabled.
2016-02-04 12:35:26:  0: Task timeout is disabled.
2016-02-04 12:35:26:  0: Loaded job: LG_SCENE_VD02 (56b345837c0ec85daca9817b)
2016-02-04 12:35:26:  0: Executing plugin command of type 'Deadline.Slaves.Messaging.StartJobCommandMemento'
2016-02-04 12:35:26:  0: Done executing plugin command of type 'Deadline.Slaves.Messaging.StartJobCommandMemento'
2016-02-04 12:35:26:  0: Plugin rendering frame(s): 0
2016-02-04 12:35:26:  0: Executing plugin command of type 'Deadline.Slaves.Messaging.RenderTaskCommandMemento'
2016-02-04 12:35:27:  0: INFO: VRay DBR: Waiting for all job tasks to be dequeued before starting distributed render
2016-02-04 12:35:27:  0: INFO: VRay DBR: Plugin Config Settings to be applied to local file: vray_dr.cfg
2016-02-04 12:35:27:  0: INFO: VRay DBR: Port Range: 20204
2016-02-04 12:35:27:  0: INFO: VRay DBR: Use Local Machine: True
2016-02-04 12:35:27:  0: INFO: VRay DBR: Transfer Missing Assets: False
2016-02-04 12:35:27:  0: INFO: VRay DBR: Use Cached Assets: False
2016-02-04 12:35:27:  0: INFO: VRay DBR: Cache Limit Type: None
2016-02-04 12:35:27:  0: INFO: VRay DBR: Cache Limit: 100
2016-02-04 12:35:27:  0: INFO: VRay DBR: Use IP Addresses: False
2016-02-04 12:35:27:  0: INFO: VRay DBR: Local FQDN: pr102.pikcells.local
2016-02-04 12:35:27:  0: INFO: VRay DBR: Local Machine Name: pr102
2016-02-04 12:35:27:  0: INFO: VRay DBR: Local Clean Machine Name: pr102
2016-02-04 12:35:27:  0: INFO: VRay DBR: Local IP Address: 10.3.222.102
2016-02-04 12:35:27:  0: INFO: VRay DBR: All tasks dequeued, setting up distributed config file with the following machines:
2016-02-04 12:35:27:  0: INFO:   pr102
2016-02-04 12:35:27:  0: INFO:   pr112
2016-02-04 12:35:27:  0: INFO:   pr101
2016-02-04 12:35:27:  0: INFO: Not enforcing a build of 3dsmax because version 2014 and later is 64 bit only
2016-02-04 12:35:27:  0: INFO: Slave 3dsmaxcmd.exe version: 16.5.277.0
2016-02-04 12:35:27:  0: INFO: Slave 3dsmaxcmd.exe description: 3ds Max 2014 + servicepack_sp5
2016-02-04 12:35:27:  0: INFO: Slave 3dsmax.exe version: 16.5.277.0
2016-02-04 12:35:27:  0: INFO: Slave 3dsmax.exe description: 3ds Max 2014 + servicepack_sp5
2016-02-04 12:35:27:  0: INFO: Submitted from 3dsmax.exe version: 16.5.277.0
2016-02-04 12:35:27:  0: INFO: Submitted from 3dsmax.exe description: 3ds Max 2014 + servicepack_sp5
2016-02-04 12:35:27:  0: INFO: Language code string: ENU
2016-02-04 12:35:27:  0: INFO: Language sub directory: en-US
2016-02-04 12:35:27:  0: INFO: 3dsmax user profile path: C:\Users\pikadmin\AppData\Local\Autodesk\3dsmax\2014 - 64bit\ENU
2016-02-04 12:35:27:  0: INFO: 3dsmax plugcfg directory: C:\Users\pikadmin\AppData\Local\Autodesk\3dsmax\2014 - 64bit\ENU\en-US\plugcfg
2016-02-04 12:35:27:  0: INFO: VRay DBR: Skipping backup and deletion of original config file as it does not exist
2016-02-04 12:35:27:  0: INFO: VRay DBR: Config file created: C:\Users\pikadmin\AppData\Local\Autodesk\3dsmax\2014 - 64bit\ENU\en-US\plugcfg\vray_dr.cfg
2016-02-04 12:35:27:  0: INFO: VRay DBR: Waiting 10 seconds to give VRay Spawner time to initialize on other machines
2016-02-04 12:35:37:  0: INFO: VRay DBR: Ready to go, moving on to distributed render
2016-02-04 12:35:37:  0: INFO: Stdout Redirection Enabled: True
2016-02-04 12:35:37:  0: INFO: Stdout Handling Enabled: True
2016-02-04 12:35:37:  0: INFO: Popup Handling Enabled: True
2016-02-04 12:35:37:  0: INFO: QT Popup Handling Enabled: False
2016-02-04 12:35:37:  0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2016-02-04 12:35:37:  0: INFO: Using Process Tree: True
2016-02-04 12:35:37:  0: INFO: Hiding DOS Window: True
2016-02-04 12:35:37:  0: INFO: Creating New Console: False
2016-02-04 12:35:37:  0: INFO: Running as user: pikadmin
2016-02-04 12:35:37:  0: INFO: Not enforcing a build of 3dsmax because version 2014 and later is 64 bit only
2016-02-04 12:35:37:  0: INFO: Slave 3dsmaxcmd.exe version: 16.5.277.0
2016-02-04 12:35:37:  0: INFO: Slave 3dsmaxcmd.exe description: 3ds Max 2014 + servicepack_sp5
2016-02-04 12:35:37:  0: INFO: Slave 3dsmax.exe version: 16.5.277.0
2016-02-04 12:35:37:  0: INFO: Slave 3dsmax.exe description: 3ds Max 2014 + servicepack_sp5
2016-02-04 12:35:37:  0: INFO: Submitted from 3dsmax.exe version: 16.5.277.0
2016-02-04 12:35:37:  0: INFO: Submitted from 3dsmax.exe description: 3ds Max 2014 + servicepack_sp5
2016-02-04 12:35:37:  0: INFO: Executable: "C:\Program Files\Autodesk\3ds Max 2014\3dsmaxcmd.exe"
2016-02-04 12:35:37:  0: INFO: Rendering to local drive, will copy files and folders to final location after render is complete
2016-02-04 12:35:37:  0: INFO: VRay DBR: Rendering frame 0
2016-02-04 12:35:37:  0: INFO: Argument: "C:\Users\pikadmin\AppData\Local\Thinkbox\Deadline8\slave\PR102\jobsData\56b345837c0ec85daca9817b\LG_SCENE_VD02.max" -v:4 -start:0 -end:0 -cam:"CAM Default" -w:4000 -h:3000 -pixelAspect:1.0 -atmospherics:true -renderHidden:false -effects:true -useAreaLights:false -displacements:true -force2Sided:false -videoColorCheck:false -superBlack:false -renderFields:false -fieldOrder:Odd -skipRenderedFrames:false -outputName:"C:\Users\pikadmin\AppData\Local\Thinkbox\Deadline8\slave\pr102\jobsData\56b345837c0ec85daca9817b\3dsOutput_tempnqfKX0\S2K4_FR1_DW2_OV2_CAM1-.exr" -renderElements:true -useAdvLight:true -computeAdvLight:false -continueOnError -rfw:0 -videopostJob:0
2016-02-04 12:35:37:  0: INFO: Startup Directory: "C:\Program Files\Autodesk\3ds Max 2014"
2016-02-04 12:35:37:  0: INFO: Process Priority: BelowNormal
2016-02-04 12:35:37:  0: INFO: Process Affinity: default
2016-02-04 12:35:37:  0: INFO: Process is now running
2016-02-04 12:35:37:  0: STDOUT: 04/02/2016 12:35:37;  1 frames initialized
2016-02-04 12:35:37:  0: STDOUT: 04/02/2016 12:35:37;  
2016-02-04 12:35:37:  0: STDOUT: Max install location: C:\Program Files\Autodesk\3ds Max 2014\
2016-02-04 12:35:37:  0: STDOUT: 04/02/2016 12:35:37;  Max file being rendered: C:\Users\pikadmin\AppData\Local\Thinkbox\Deadline8\slave\PR102\jobsData\56b345837c0ec85daca9817b\LG_SCENE_VD02.max
2016-02-04 12:35:37:  0: STDOUT: 04/02/2016 12:35:37;  Renderer: V-Ray Adv 3.30.03
2016-02-04 12:36:08:  0: STDOUT: 04/02/2016 12:36:08;  Max is ready
2016-02-04 12:36:09:  0: STDOUT: 04/02/2016 12:36:08;  Frame 0 assigned
2016-02-04 12:36:09:  0: STDOUT: 04/02/2016 12:36:08;  [V-Ray] ============================================================
2016-02-04 12:36:09:  0: STDOUT: 04/02/2016 12:36:08;  [V-Ray] Console created, V-Ray A for x64 from Dec 18 2015, 17:03:07
2016-02-04 12:36:09:  0: STDOUT: 04/02/2016 12:36:09;  [V-Ray] ============================================================
2016-02-04 12:36:09:  0: STDOUT: 04/02/2016 12:36:09;  [V-Ray] Compiled with Intel C++ compiler, version 14
2016-02-04 12:36:09:  0: STDOUT: 04/02/2016 12:36:09;  [V-Ray] Host is 3ds Max, version 16
2016-02-04 12:36:09:  0: STDOUT: 04/02/2016 12:36:09;  [V-Ray] V-Ray DLL version is 3.25.01
2016-02-04 14:16:20:  0: STDOUT: 04/02/2016 14:16:20;  Job Complete - Results in C:\Users\pikadmin\AppData\Local\Thinkbox\Deadline8\slave\pr102\jobsData\56b345837c0ec85daca9817b\3dsOutput_tempnqfKX0\
2016-02-04 14:16:21:  0: STDOUT: 04/02/2016 14:16:21;  Job Completed Successfully
2016-02-04 14:16:32:  0: INFO: Process exit code: 0
2016-02-04 14:16:32:  0: INFO: Moving output files and folders from C:\Users\pikadmin\AppData\Local\Thinkbox\Deadline8\slave\pr102\jobsData\56b345837c0ec85daca9817b\3dsOutput_tempnqfKX0 to \\piknas003\projects\2016\LG\KITCHEN_VISUALISER\ANIMATIONS\SHOTS\Style2\kitchen4\FR1\DW2\OV2\CAM1
2016-02-04 14:16:32:  0: INFO: Moving file C:\Users\pikadmin\AppData\Local\Thinkbox\Deadline8\slave\pr102\jobsData\56b345837c0ec85daca9817b\3dsOutput_tempnqfKX0\S2K4_FR1_DW2_OV2_CAM1-0000.exr to \\piknas003\projects\2016\LG\KITCHEN_VISUALISER\ANIMATIONS\SHOTS\Style2\kitchen4\FR1\DW2\OV2\CAM1\S2K4_FR1_DW2_OV2_CAM1-0000.exr
2016-02-04 14:16:32:  0: INFO: VRay DBR: Skipping restore of backup config file as it does not exist
2016-02-04 14:16:32:  0: INFO: VRay DBR: Marking other incomplete tasks as complete
2016-02-04 14:16:32:  0: Done executing plugin command of type 'Deadline.Slaves.Messaging.RenderTaskCommandMemento'

=======================================================
Details
=======================================================
Date: 02/04/2016 14:16:35
Frames: 0
Elapsed Time: 00:01:41:14
Job Submit Date: 02/04/2016 12:35:18
Job User: oleg
Average RAM Usage: 10731102208 (42%)
Peak RAM Usage: 11892449280 (47%)
Average CPU Usage: 98%
Peak CPU Usage: 100%
Used CPU Clocks (x10^6 cycles): 342583968
Total CPU Clocks (x10^6 cycles): 349575489

=======================================================
Slave Information
=======================================================
Slave Name: PR102
Version: v8.0.0.50 Beta (dd3a9e577)
Operating System: Windows 7 Professional (SP1)
Running As Service: No
Machine User: pikadmin
IP Address: 10.3.222.102
MAC Address: 00:25:90:49:4B:F8
CPU Architecture: x64
CPUs: 24
CPU Usage: 100%
Memory Usage: 8.6 GB / 24.0 GB (36%)
Free Disk Space: 218.164 GB 
Video Card: Standard VGA Graphics Adapter

i tried to remove - wait while tasks in list will be “completed” state , checked if VRaySpawner is turned off on slaves and added them back.
Scene was picked up only on one machine + the master machine.
dl.dropboxusercontent.com/s/3yr … 143242.png i have them all in “rendering” status.

And one more thing i’ve noticed.
When you are submitting job with DBR and pointing number more , than available slaves - the job will not start, until there will be enough slaves to “fill” all the tasks. I really thought that with “Dynamic DBR” implementation this will be really dynamic - i.e. job will start and just “pick up” available slaves , without waiting. Is this planned for future updates ? Because now you will need always manually correct the amount of slaves after submission , or your job will never start.

Hi,
I think there might be some confusion here. Beta 7 has delivered Dynamic VRay DBR support for DBR Interactive only currently (where you can submit a job to Deadline to ‘reserve’ X number of machines for VraySpawner to run. This now allows you to increase/decrease that number post submission and whilst rendering DBR locally as the MASTER machine). Looking at your log report, you are using the 3dsCmd based DBR Off-load system, which will have “Dynamic DBR” added to it in a future build, but it’s not quite there yet…[it’s like 85% complete in our internal code…so getting there…] :wink:

ahhh !
So if i get it correct

this will be changed as well ?
Thanks for letting me know , will wait for it !

If I understood you correctly, Yes, in the future, VRay DBR “off-load” will have an option (in plugin config under 3dsmax section) to enable “Dynamic Start = True”. With this enabled, a VRay DBR “off-load” job will commence rendering as soon as taskId:0 (the first frame) has been dequeued (picked up) by a slave. It will NOT wait for all other tasks to run up VRaySpawner before commencing to render. If other tasks get picked up later by an idle slave, they will run up VRaySpawner and join the render already taking place here, albeit, expect a worst case scenario of a ~30 sec update window between refreshes once the slave is running VRaySpawner (chances are it will be much quicker).

Additionally, there is a right-click job script in Beta 7, which will allow you in the future to increase/decrease the number of VRaySpawner machines to participate in this DBR render. (This script will only actually make a difference to VRay DBR “Interactive” jobs currently).

Yep everything’s correct , great news !

Privacy | Site terms | Cookie preferences