AWS Thinkbox Discussion Forums

Pending Jobs scan not working

Hi All,

I’ve been having issues with the pending Job scan not running automatically when we run a tiled 3dmax job.
The tiles render fine but the job to stitch them just sits as pending. If i right click on the job and choose release pending job it runs immediately.
The logs seem to indicate it’s all fine and runs after the tiled job but this job is from yesterday and i manually released it this morning.

Is there a setting i can change or are we doing something wrong?

=======================================================
Log

2016-09-13 16:14:03: BEGIN - LONREN107\svc-render
2016-09-13 16:14:03: Operating System: Windows 7 Professional (SP1)
2016-09-13 16:14:03: CPU Architecture: x64
2016-09-13 16:14:03: CPUs: 40
2016-09-13 16:14:03: Video Card: ASPEED Graphics Family(WDDM)
2016-09-13 16:14:03: 0: Loading Job’s Plugin timeout is Disabled
2016-09-13 16:14:03: 0: INFO: Executing plugin script ‘C:\Users\svc-render.CORPORATE.008\AppData\Local\Thinkbox\Deadline8\slave\lonren107\plugins\57d801d17af55921e8dafef1\DraftTileAssembler.py’
2016-09-13 16:14:03: 0: INFO: Found Draft python module at: ‘C:\Users\svc-render.CORPORATE.008\AppData\Local\Thinkbox\Deadline8\slave\lonren107\Draft\Draft.pyd’
2016-09-13 16:14:03: 0: INFO: About: Draft Tile Assembler Plugin for Deadline
2016-09-13 16:14:03: 0: INFO: The job’s environment will be merged with the current environment before rendering
2016-09-13 16:14:03: 0: Start Job timeout is disabled.
2016-09-13 16:14:03: 0: Task timeout is disabled.
2016-09-13 16:14:03: 0: Loaded job: PANO_VR_TEST_SAN_FRAN_05 - Draft Tile Assembly (57d801d17af55921e8dafef1)
2016-09-13 16:14:03: 0: Plugin rendering frame(s): 2
2016-09-13 16:14:03: 0: INFO: Draft Tile Assembler job starting…
2016-09-13 16:14:03: 0: INFO: Stdout Redirection Enabled: True
2016-09-13 16:14:03: 0: INFO: Stdout Handling Enabled: True
2016-09-13 16:14:03: 0: INFO: Popup Handling Enabled: False
2016-09-13 16:14:03: 0: INFO: Using Process Tree: True
2016-09-13 16:14:03: 0: INFO: Hiding DOS Window: True
2016-09-13 16:14:03: 0: INFO: Creating New Console: False
2016-09-13 16:14:03: 0: INFO: Running as user: svc-render
2016-09-13 16:14:03: 0: INFO: Looking for bundled python at: ‘C:\Program Files\Thinkbox\Deadline8\bin\dpython.exe’
2016-09-13 16:14:03: 0: INFO: Executable: “C:\Program Files\Thinkbox\Deadline8\bin\dpython.exe”
2016-09-13 16:14:03: 0: INFO: Argument: “C:\Users\svc-render.CORPORATE.008\AppData\Local\Thinkbox\Deadline8\slave\lonren107\plugins\57d801d17af55921e8dafef1\Assembler.py” “C:\Users\svc-render.CORPORATE.008\AppData\Local\Thinkbox\Deadline8\slave\lonren107\jobsData\57d801d17af55921e8dafef1\San_Fran_Render_Step_13.VRayRawShadow.0000_2_config_2016_9_013__14_40_30_0000.txt” False True False
2016-09-13 16:14:03: 0: INFO: Full Command: “C:\Program Files\Thinkbox\Deadline8\bin\dpython.exe” “C:\Users\svc-render.CORPORATE.008\AppData\Local\Thinkbox\Deadline8\slave\lonren107\plugins\57d801d17af55921e8dafef1\Assembler.py” “C:\Users\svc-render.CORPORATE.008\AppData\Local\Thinkbox\Deadline8\slave\lonren107\jobsData\57d801d17af55921e8dafef1\San_Fran_Render_Step_13.VRayRawShadow.0000_2_config_2016_9_013__14_40_30_0000.txt” False True False
2016-09-13 16:14:03: 0: INFO: Startup Directory: “C:\Users\svc-render.CORPORATE.008\AppData\Local\Thinkbox\Deadline8\slave\lonren107\Draft”
2016-09-13 16:14:04: 0: INFO: Process Priority: BelowNormal
2016-09-13 16:14:04: 0: INFO: Process Affinity: default
2016-09-13 16:14:04: 0: INFO: Process is now running
2016-09-13 16:14:04: 0: STDOUT: Checking for a license…
2016-09-13 16:14:04: 0: STDOUT: Draft 1.6.1.1
2016-09-13 16:14:04: 0: STDOUT: Error on missing tiles = False
2016-09-13 16:14:04: 0: STDOUT: Error on missing Background = False
2016-09-13 16:14:04: 0: STDOUT: Distance as pixels = True
2016-09-13 16:14:04: 0: STDOUT: Assembling Single File
2016-09-13 16:14:04: 0: STDOUT: Assembling File: \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13.VRayRawShadow.0000.tif
2016-09-13 16:14:04: 0: STDOUT: Writing File to temporary location: c:\users\svc-re~1.008\appdata\local\temp\San_Fran_Render_Step_13.VRayRawShadow.0000.tif
2016-09-13 16:14:04: 0: STDOUT: Tiles are cropped
2016-09-13 16:14:04: 0: STDOUT: Final Image Dimensions = 8000x4000
2016-09-13 16:14:04: 0: STDOUT: TileCount given: 9
2016-09-13 16:14:04: 0: STDOUT: Tile0 position: 0, 2667
2016-09-13 16:14:04: 0: STDOUT: Tile0 dimension: 2666, 1333
2016-09-13 16:14:04: 0: STDOUT: Tile1 position: 2666, 2667
2016-09-13 16:14:04: 0: STDOUT: Tile1 dimension: 2666, 1333
2016-09-13 16:14:04: 0: STDOUT: Tile2 position: 5332, 2667
2016-09-13 16:14:04: 0: STDOUT: Tile2 dimension: 2668, 1333
2016-09-13 16:14:04: 0: STDOUT: Tile3 position: 0, 1334
2016-09-13 16:14:04: 0: STDOUT: Tile3 dimension: 2666, 1333
2016-09-13 16:14:04: 0: STDOUT: Tile4 position: 2666, 1334
2016-09-13 16:14:04: 0: STDOUT: Tile4 dimension: 2666, 1333
2016-09-13 16:14:04: 0: STDOUT: Tile5 position: 5332, 1334
2016-09-13 16:14:04: 0: STDOUT: Tile5 dimension: 2668, 1333
2016-09-13 16:14:04: 0: STDOUT: Tile6 position: 0, 0
2016-09-13 16:14:04: 0: STDOUT: Tile6 dimension: 2666, 1334
2016-09-13 16:14:04: 0: STDOUT: Tile7 position: 2666, 0
2016-09-13 16:14:04: 0: STDOUT: Tile7 dimension: 2666, 1334
2016-09-13 16:14:04: 0: STDOUT: Tile8 position: 5332, 0
2016-09-13 16:14:04: 0: STDOUT: Tile8 dimension: 2668, 1334
2016-09-13 16:14:04: 0: STDOUT: Total Number of Output Channels: 3
2016-09-13 16:14:04: 0: STDOUT: Output Channels:
2016-09-13 16:14:04: 0: STDOUT: R
2016-09-13 16:14:04: 0: STDOUT: G
2016-09-13 16:14:04: 0: STDOUT: B
2016-09-13 16:14:07: 0: STDOUT: Assembling Progress: 18%
2016-09-13 16:14:10: 0: STDOUT: Assembling Progress: 36%
2016-09-13 16:14:10: 0: STDOUT: Assembling Progress: 55%
2016-09-13 16:14:13: 0: STDOUT: Assembling Progress: 73%
2016-09-13 16:14:13: 0: STDOUT: Assembling Progress: 91%
2016-09-13 16:14:13: 0: STDOUT: Assembling Progress: 100%
2016-09-13 16:14:24: 0: STDOUT: Copying output file from c:\users\svc-re~1.008\appdata\local\temp\San_Fran_Render_Step_13.VRayRawShadow.0000.tif to final output Location c:\users\svc-re~1.008\appdata\local\temp\San_Fran_Render_Step_13.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Cleaning up Tiles…
2016-09-13 16:14:24: 0: STDOUT: Deleting \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_1x1_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleted \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_1x1_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleting \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_2x1_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleted \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_2x1_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleting \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_3x1_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleted \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_3x1_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleting \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_1x2_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleted \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_1x2_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleting \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_2x2_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleted \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_2x2_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleting \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_3x2_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleted \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_3x2_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleting \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_1x3_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleted \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_1x3_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleting \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_2x3_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleted \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_2x3_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleting \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_3x3_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: STDOUT: Deleted \corporate\data\Visual\resource\users\Ben\BEN_DEADLINE\San_Fran_Render_Step_13_tile_3x3_3x3_.VRayRawShadow.0000.tif
2016-09-13 16:14:24: 0: INFO: Process exit code: 0
2016-09-13 16:14:24: 0: INFO: Draft Tile Assembler Job Completed

=======================================================
Details

Date: 09/13/2016 16:14:24
Frames: 2
Job Submit Date: 09/13/2016 14:40:32
Job User: bwakely
Average RAM Usage: 261732352 (1%)
Peak RAM Usage: 465563648 (1%)
Average CPU Usage: 1%
Peak CPU Usage: 2%
Used CPU Clocks (x10^6 cycles): 12445
Total CPU Clocks (x10^6 cycles): 1244423

=======================================================
Slave Information

Slave Name: LONREN107
Version: v8.1.3.1 Release (2c6807a07)
Operating System: Windows 7 Professional (SP1)
Running As Service: Yes
Machine User: svc-render
IP Address: 10.11.6.210
MAC Address: 0C:C4:7A:64:72:58
CPU Architecture: x64
CPUs: 40
CPU Usage: 1%
Memory Usage: 6.8 GB / 63.9 GB (10%)
Free Disk Space: 196.429 GB
Video Card: ASPEED Graphics Family(WDDM)

Thanks

raj

Slaves run the “Pending Job Scan” only when they are idle. If all your Slaves are always busy rendering, then it will feel like pending jobs are ‘never’ getting released. Running Pulse will allow you to automatically run the “Pending Job Scan” at a regular interval which solves this issue. Are you running Pulse?

We had turned Pulse off so here’s the solution that Mike sent me incase anyone else has the same problem:

“Allow Slaves to Perform the Pending Job Scan If Pulse is not Running” - should be enabled.

Thanks as always for your help DLTeam!!

Privacy | Site terms | Cookie preferences