AWS Thinkbox Discussion Forums

Jobs not getting auto cleaned up?

We have our auto cleanup set to 3 days:

Capture.PNG

Yet jobs are not being cleaned up:

That last history entry is me checking if the job was touched in any way in the last few days.

Maybe its related, but this job actually had an even stricter cleanup policy:

Capture.PNG

Which seems to have been ignored

Strange, we’ll have a look at it, hopefully it’s easy enough to reproduce.

Are any jobs being cleaned up? Or are they all sticking around? Does anything relevant show up in the Housecleaning logs?

Jobs set to auto-delete on complete do disappear, but it doesnt seem like the regular cleanup kicks in for anything… We only just noticed to be honest.

Here is a typical housecleaning log, i dont see anything about cleaning up complete jobs:

2016-06-09 15:37:19:  Deadline Command 8.0 [v8.0.2.1 Release (20fc3ef88)]
2016-06-09 15:37:19:  Purging old House Cleaning logs.
2016-06-09 15:37:19:  Performing house cleaning
2016-06-09 15:37:19:  Performing Job Cleanup Scan...
2016-06-09 15:37:19:      Job Cleanup Scan - Loading completed jobs
2016-06-09 15:37:26:      Job Cleanup Scan - Loaded 11032 completed and 575 active/pending jobs in 7.553 s
2016-06-09 15:37:26:      Job Cleanup Scan - Scanning completed jobs
2016-06-09 15:37:26:      Job Cleanup Scan - Skipping completed job '[SKWAD] Create Proxy Quicktime: AA_000_0090_comp_proxyMOV_v0012' because there are pending jobs that are dependent on it.
2016-06-09 15:37:26:      Job Cleanup Scan - Skipping completed job '[POW] Create Proxy Quicktime: SHR_shr_rsrc_chrGoldar01A-Model-TT_proxyMOV_v0036' because there are pending jobs that are dependent on it.
2016-06-09 15:37:26:      Job Cleanup Scan - Skipping completed job '[MPH] Create Proxy Quicktime: TA_090_0070_deep-DeepMattes6_proxyMOV_v0151' because there are pending jobs that are dependent on it.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[PROM] Create Proxy Quicktime: BG_244_0013_comp_proxyMOV_v0005' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[PROM] Create Proxy Quicktime: BG_244_0009_roto-matte_overlay_fg1_proxyMOV_v0001' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[MPH] Create Proxy Quicktime: TA_090_0070_deep-DeepMerge2_proxyMOV_v0151' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[MPH] Create Proxy Quicktime: TA_090_0070_deep-DeepMattes10_proxyMOV_v0151' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[PROM] Create Proxy Quicktime: BG_244_0009_roto-mb_fg1_02_proxyMOV_v0001' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[DRIFT] Create Proxy Quicktime: ENV_MET_0001_Light-FireThrusCamB_proxyMOV_v0020' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[PROM] Create Proxy Quicktime: BG_244_0009_roto-fg1_02_proxyMOV_v0001' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[PROM] Upload Proxy Quicktime: BG_244_0009_roto-matte_overlay_fg1_proxyMOV_v0001' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[PROM] Upload Proxy Quicktime: BG_244_0013_comp_proxyMOV_v0005' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[DRIFT] Upload Proxy Quicktime: ENV_MET_0001_Light-FireThrusCamB_proxyMOV_v0020' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[PROM] Upload Proxy Quicktime: BG_244_0009_roto-fg1_02_proxyMOV_v0001' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[PROM] Upload Proxy Quicktime: BG_224_0006_comp_proxyMOV_v0077' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[POW] ShootBot: Avid QT SHR_shr_rsrc_images_render3d_chrGoldar01A-Model-TT_v0036' because Delete On Complete was enabled.
2016-06-09 15:37:26:      Job Cleanup Scan - Deleted completed job '[POW] ShootBot: Editorial Sync SHR_shr_rsrc_images_render3d_chrGoldar01A-Model-TT_v0036 (project level)' because Delete On Complete was enabled.
2016-06-09 15:37:27:      Job Cleanup Scan - Error occurred while retrieving jobs for job cleanup:/mnt/isila/deadline/repository8/reports/jobs/30/1/57521783dd72a30408674301/57521786d2c775a28034716e.bz2 does not exist (System.IO.FileNotFoundException)
2016-06-09 15:37:27:      Job Cleanup Scan - Done.
2016-06-09 15:37:27:  Purging Unsubmitted Jobs
2016-06-09 15:37:27:      Unsubmitted Job Scan - Loading unsubmitted jobs
2016-06-09 15:37:27:      Unsubmitted Job Scan - Loaded 0 unsubmitted jobs in 12.937 ms
2016-06-09 15:37:27:      Unsubmitted Job Scan - Done.
2016-06-09 15:37:27:  Purging Deleted Jobs
2016-06-09 15:37:27:      Deleted Job Scan - Loading deleted jobs
2016-06-09 15:37:30:      Deleted Job Scan - Loaded 7565 deleted jobs in 3.386 s
2016-06-09 15:37:30:      Deleted Job Scan - Purging a maximum of 1000 deleted Jobs
2016-06-09 15:37:30:      Deleted Job Scan - Purged 0 deleted jobs in 504.000 μs
2016-06-09 15:37:30:      Deleted Job Scan - Done.
2016-06-09 15:37:30:  Purging Old Job Auxiliary Files
2016-06-09 15:37:30:      Auxiliary File Scan - Scanning for auxiliary directories
2016-06-09 15:37:42:      Auxiliary File Scan - Purged 0 auxiliary folders in 12.495 s
2016-06-09 15:37:42:      Auxiliary File Scan - Done.
2016-06-09 15:37:42:  Purging Old Job Reports
2016-06-09 15:37:42:      Job Report Scan - Loading job report collections
2016-06-09 15:37:43:      Job Report Scan - Found 20592 report collections in 229.667 ms
2016-06-09 15:37:43:      Job Report Scan - Loading job IDs
2016-06-09 15:37:43:      Job Report Scan - Loaded 20593 job IDs in 230.458 ms
2016-06-09 15:37:43:      Job Report Scan - Purged 0 report collections in 1.884 ms
2016-06-09 15:37:43:      Job Report Scan - Purging old job report files
2016-06-09 15:37:43:      Job Report Scan - Purging a maximum of 1000 report files
2016-06-09 15:37:44:      Job Report Scan - Purged 10 report files in 643.430 ms
2016-06-09 15:37:44:      Job Report Scan - Done.
2016-06-09 15:37:44:  Purging Obsolete Slaves
2016-06-09 15:37:44:      Obsolete Slave Scan - Skipping because it is disabled in the Repository Options
2016-06-09 15:37:44:  Purging Old Slave Reports
2016-06-09 15:37:44:      Slave Report Scan - Loading slave report collections
2016-06-09 15:37:44:      Slave Report Scan - Found 2327 report collections and 1454 job state objects in 34.758 ms
2016-06-09 15:37:44:      Slave Report Scan - Loading slave IDs
2016-06-09 15:37:44:      Slave Report Scan - Loaded 2327 slave IDs in 69.780 ms
2016-06-09 15:37:44:      Slave Report Scan - Purged 0 report collections, 0 job state objects, and 0 rendering Slave stubs in 0
2016-06-09 15:37:44:      Slave Report Scan - Done.
2016-06-09 15:37:44:  Purging Timed Out Slaves in Throttle Queue
2016-06-09 15:37:44:  Purging Old Limits
2016-06-09 15:37:44:      Old Limit Scan - Loading machine limits
2016-06-09 15:37:44:      Old Limit Scan - Found 13029 machine limits in 268.884 ms
2016-06-09 15:37:44:      Old Limit Scan - Loading job IDs
2016-06-09 15:37:44:      Old Limit Scan - Loaded 20593 job IDs in 210.938 ms
2016-06-09 15:37:44:      Old Limit Scan - Purged 0 machine limits in 1.480 ms
2016-06-09 15:37:44:      Old Limit Scan - Done.
2016-06-09 15:37:44:  Purging Temporary Repository Files
2016-06-09 15:37:44:      Temporary File Scan - Scanning for 'connectReadWriteTest' files
2016-06-09 15:37:44:      Temporary File Scan - Deleted 0 temporary files in 709.000 μs
2016-06-09 15:37:44:      Temporary File Scan - Done.
2016-06-09 15:37:44:  Purging Old Statistics
2016-06-09 15:37:44:      Old Statistics - Skipping job statistics because the option to purge them is disabled in the Repository Options
2016-06-09 15:37:44:      Old Statistics - Purging slave statistics that are older than Apr 10/16  15:37:44
2016-06-09 15:37:44:      Old Statistics - Purged old slave statistics in 992.000 μs
2016-06-09 15:37:44:      Old Statistics - Purging repository statistics that are older than Apr 10/16  15:37:44
2016-06-09 15:37:44:      Old Statistics - Purged old repository statistics in 497.000 μs
2016-06-09 15:37:44:  Purging Deleted Document Stubs From Database
2016-06-09 15:37:44:      Deleted Document Stubs - Deleting stubs that are older than 3 days
2016-06-09 15:37:44:      Deleted Document Stubs - Deleted 8 stubs in 21.781 ms
2016-06-09 15:37:44:  Triggering House Cleaning Events

I do see an error in there, not sure if thats related… most of the job cleanup scans i found in the log (if not all) end with that error btw.

Found the bug, should be fixed in 8.0.5.x, when that gets released in a couple weeks :slight_smile:

Cheers,
Jon

Are these fixes making it into the 8.1.x branch of versions?

Nevermind, just saw your response in another thread!

Privacy | Site terms | Cookie preferences