Mongo DB - Job corrupted?

Hey,

I’ve been writing some PHP modules to read the Deadline Mongo DB for displaying jobs on our local intranet page and came across a job that is not showing up in our deadline monitor but is showing up when I query it for the page. I was curious why this is? Here’s the raw output from Mongo:

array (size=30) 'Aux' => array (size=1) 0 => string 'deadlineSubmitFile.max' (length=22) 'Bad' => array (size=0) empty 'CompletedChunks' => int 0 'DataSize' => float 109143646 'Date' => object(MongoDate)[345] public 'sec' => int 1395255248 public 'usec' => int 870000 'DateComp' => object(MongoDate)[346] public 'sec' => int -62135596800 public 'usec' => int 0 'DateStart' => object(MongoDate)[347] public 'sec' => int -62135596800 public 'usec' => int 0 'Errs' => int 0 'FailedChunks' => int 0 'IsSub' => boolean false 'LastWriteTime' => object(MongoDate)[348] public 'sec' => int 1395255249 public 'usec' => int 113000 'Mach' => string 'LAZ800F-HP' (length=10) 'Main' => boolean false 'MainEnd' => int 0 'MainStart' => int 0 'OutDir' => array (size=1) 0 => string '\\nox1\Projects\jobs\1189_tri_subaru_swarm\07_sequences\1000\0080\3d\publish\3delements\lgt_droneblades\v0004\fullres\' (length=118) 'OutFile' => array (size=1) 0 => string '1000_0080_lgt_droneblades_v0004.####.exr' (length=40) 'PendingChunks' => int 0 'Plug' => string '3dsmax' (length=6) 'Props' => array (size=75) 'Name' => string '1000_0080_lgt_droneblades_v0004 ' (length=32) 'User' => string 'rob.glazer' (length=10) 'Cmmt' => string 'new blades' (length=10) 'CmmtTag' => string 'rob.glazer, 2014/03/19 11:54' (length=28) 'Dept' => string '' (length=0) 'Frames' => string '101-167' (length=7) 'Chunk' => int 1 'Tasks' => int 67 'Grp' => string '3d' (length=2) 'Pool' => string 'max14' (length=5) 'SecPool' => null 'Pri' => int 50 'ReqAss' => array (size=0) empty 'ScrDep' => array (size=0) empty 'Conc' => int 1 'ConcLimt' => boolean true 'AuxSync' => boolean false 'Int' => boolean false 'Seq' => boolean false 'Reload' => boolean true 'NoEvnt' => boolean false 'OnComp' => int 2 'AutoTime' => boolean false 'TimeScrpt' => boolean false 'MinTime' => int 0 'MaxTime' => int 0 'Timeout' => int 1 'Dep' => array (size=0) empty 'DepFrame' => boolean false 'DepFrameStart' => int 0 'DepFrameEnd' => int 0 'DepComp' => boolean true 'DepDel' => boolean false 'DepFail' => boolean false 'DepPer' => float -1 'NoBad' => boolean false 'JobFailOvr' => boolean false 'JobFailErr' => int 0 'TskFailOvr' => boolean false 'TskFailErr' => int 0 'SndWarn' => boolean true 'NotOvr' => boolean false 'SndEmail' => boolean false 'SndPopup' => boolean false 'NotEmail' => array (size=0) empty 'NotUser' => array (size=1) 0 => string 'rob.glazer' (length=10) 'NotNote' => string '' (length=0) 'Limits' => array (size=0) empty 'ListedSlaves' => array (size=0) empty 'White' => boolean false 'MachLmt' => int 60 'MachLmtProg' => float -1 'PrJobScrp' => string '' (length=0) 'PoJobScrp' => string '' (length=0) 'PrTskScrp' => string '' (length=0) 'PoTskScrp' => string '' (length=0) 'Schd' => int 0 'SchdDays' => int 1 'SchdDate' => object(MongoDate)[349] public 'sec' => int -62135596800 public 'usec' => int 0 'SchdDateRan' => object(MongoDate)[350] public 'sec' => int -62135596800 public 'usec' => int 0 'PlugInfo' => array (size=408) 'Version' => string '2014' (length=4) 'IsMaxDesign' => string '0' (length=1) 'Padding' => string '4' (length=1) 'RemovePadding' => string '0' (length=1) 'IgnoreMissingExternalFiles' => string '1' (length=1) 'IgnoreMissingUVWs' => string '1' (length=1) 'IgnoreMissingDLLs' => string '0' (length=1) 'IgnoreMissingXREFs' => string '1' (length=1) 'DisableMultipass' => string '0' (length=1) 'LocalRendering' => string '1' (length=1) 'OneCpuPerTask' => string '0' (length=1) 'UseSlaveMode' => string '1' (length=1) 'UseSilentMode' => string '0' (length=1) 'PopupHandling' => string '1' (length=1) 'RenderStateSet' => string '0' (length=1) 'FrameNumberBase' => string '0' (length=1) 'RestartRendererMode' => string '0' (length=1) 'DisableProgressUpdateTimeout' => string '0' (length=1) 'OverrideFailOnExistingMaxProcess' => string 'false' (length=5) 'FailOnExistingMaxProcess' => string 'false' (length=5) 'Camera' => string 'Cam_0080_[1-67]' (length=15) 'Camera0' => string '' (length=0) 'Camera1' => string 'Cam_0080_[1-67]' (length=15) 'MaxVersionToForce' => string 'none' (length=4) 'MaxVersionToForce0' => string 'none' (length=4) 'MaxVersionToForce1' => string '32bit' (length=5) 'MaxVersionToForce2' => string '64bit' (length=5) 'FailOnBlackFrames' => string '0' (length=1) 'BlackPixelPercentage' => string '1' (length=1) 'BlackPixelThreshold' => string '0.1' (length=3) 'BlackFramesCheckRenderElements' => string '0' (length=1) 'IgnoreRenderElements' => string '0' (length=1) 'IgnoreRenderElementsByName0' => string 'VRayDiffuseFilter' (length=17) 'IgnoreRenderElementsByName1' => string 'VRayNormals' (length=11) 'IgnoreRenderElementsByName2' => string 'VRayReflection' (length=14) 'IgnoreRenderElementsByName3' => string 'VRayRefraction' (length=14) 'IgnoreRenderElementsByName4' => string 'VRayShadows' (length=11) 'IgnoreRenderElementsByName5' => string 'VRaySpecular' (length=12) 'IgnoreRenderElementsByName6' => string 'VRayZDepth' (length=10) 'IgnoreRenderElementsByName7' => string 'VRayExtraTex' (length=12) 'IgnoreRenderElementsByName8' => string 'VRayExtraTex' (length=12) 'IgnoreRenderElementsByName9' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName10' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName11' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName12' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName13' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName14' => string 'VRaySelfIllumination' (length=20) 'IgnoreRenderElementsByName15' => string 'VRayBumpNormals' (length=15) 'IgnoreRenderElementsByName16' => string 'VRayReflectionFilter' (length=20) 'IgnoreRenderElementsByName17' => string 'VRayRefractionFilter' (length=20) 'IgnoreRenderElementsByName18' => string 'VRayLighting' (length=12) 'IgnoreRenderElementsByName19' => string 'VRayGlobalIllumination' (length=22) 'IgnoreRenderElementsByName20' => string 'VRayRawReflection' (length=17) 'IgnoreRenderElementsByName21' => string 'VRayRawRefraction' (length=17) 'IgnoreRenderElementsByName22' => string 'VRaySamplerInfo' (length=15) 'IgnoreRenderElementsByName23' => string 'VRaySamplerInfo' (length=15) 'IgnoreRenderElementsByName24' => string 'VRayExtraTex' (length=12) 'IgnoreRenderElementsByName25' => string 'VRayLightSelect' (length=15) 'IgnoreRenderElementsByName26' => string 'VRaySamplerInfo' (length=15) 'IgnoreRenderElementsByName27' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName28' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName29' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName30' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName31' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName32' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName33' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName34' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName35' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName36' => string 'MultiMatteElement' (length=17) 'IgnoreRenderElementsByName37' => string 'VRayExtraTex' (length=12) 'RenderOutput' => string '\\nox1\Projects\jobs\1189_tri_subaru_swarm\07_sequences\1000\0080\3d\publish\3delements\lgt_droneblades\v0004\fullres\1000_0080_lgt_droneblades_v0004..exr' (length=154) 'ShowFrameBuffer' => string 'true' (length=4) 'OverrideBitmapPager' => string 'false' (length=5) 'BitmapPager' => string 'false' (length=5) 'RenderWidth' => string '1280' (length=4) 'RenderHeight' => string '720' (length=3) 'renderPixelAspect' => string '1.0' (length=3) 'rendAtmosphere' => string 'true' (length=4) 'renderEffects' => string 'true' (length=4) 'renderDisplacements' => string 'true' (length=4) 'rendSimplifyAreaLights' => string 'false' (length=5) 'rendForce2Side' => string 'false' (length=5) 'rendHidden' => string 'false' (length=5) 'rendColorCheck' => string 'false' (length=5) 'rendSuperBlack' => string 'false' (length=5) 'rendFieldRender' => string 'false' (length=5) 'SkipRenderedFrames' => string 'false' (length=5) 'backgroundColor' => string '(color 0 0 0)' (length=13) 'useEnvironmentMap' => string 'true' (length=4) 'ambientColor' => string '(color 0 0 0)' (length=13) 'lightTintColor' => string '(color 255 255 255)' (length=19) 'lightLevel' => string '1.0' (length=3) 'vray_imageSampler_type' => string '1' (length=1) 'vray_filter_on' => string 'true' (length=4) 'vray_filter_kernel' => string 'Soften:(null)' (length=13) 'vray_filter_size' => string '3.0' (length=3) 'vray_filter_paramA' => string '0.0' (length=3) 'vray_filter_paramB' => string '0.0' (length=3) 'vray_filter_paramC' => string '0.0' (length=3) 'vray_fixedRate_subdivs' => string '1' (length=1) 'vray_fixedRate_rand' => string 'false' (length=5) 'vray_twoLevel_baseSubdivs' => string '1' (length=1) 'vray_twoLevel_fineSubdivs' => string '25' (length=2) 'vray_twoLevel_showSamples' => string 'false' (length=5) 'vray_twoLevel_useDMCSamplerThresh' => string 'false' (length=5) 'vray_twoLevel_threshold' => string '0.008' (length=5) 'vray_adaptiveSubdivision_minRate' => string '-1' (length=2) 'vray_adaptiveSubdivision_maxRate' => string '2' (length=1) 'vray_adaptiveSubdivision_threshold' => string '0.1' (length=3) 'vray_adaptiveSubdivision_rand' => string 'true' (length=4) 'vray_adaptiveSubdivision_showSamples' => string 'false' (length=5) 'vray_imageSampler_outline' => string 'false' (length=5) 'vray_imageSampler_mtlID' => string 'false' (length=5) 'vray_imageSampler_normal' => string 'false' (length=5) 'vray_imageSamper_normal_threshold' => string '0.05' (length=4) 'vray_imageSampler_zvalue' => string 'false' (length=5) 'vray_imageSampler_zvalue_threshold' => string '5.0' (length=3) 'vray_gi_on' => string 'false' (length=5) 'vray_gi_refractCaustics' => string 'true' (length=4) 'vray_gi_reflectCaustics' => string 'false' (length=5) 'vray_gi_primary_type' => string '2' (length=1) 'vray_gi_primary_multiplier' => string '1.3' (length=3) 'vray_gi_secondary_type' => string '3' (length=1) 'vray_gi_secondary_multiplier' => string '1.0' (length=3) 'vray_gi_saturation' => string '1.0' (length=3) 'vray_gi_contrast' => string '1.0' (length=3) 'vray_gi_contrast_base' => string '0.5' (length=3) 'vray_gi_saveMapsPerFrame' => string 'true' (length=4) more elements... 'Env' => array (size=0) empty 'EnvOnly' => boolean false 'PlugDir' => string '' (length=0) 'Ex0' => string '' (length=0) 'Ex1' => string '' (length=0) 'Ex2' => string '' (length=0) 'Ex3' => string '' (length=0) 'Ex4' => string '' (length=0) 'Ex5' => string '' (length=0) 'Ex6' => string 'Local' (length=5) 'Ex7' => string '' (length=0) 'Ex8' => string '' (length=0) 'Ex9' => string '' (length=0) 'ExDic' => array (size=4) 'DstLocation' => string 'Local' (length=5) 'MasterSceneFilePath' => string '\\nox1\Projects\jobs\1189_tri_subaru_swarm\07_sequences\1000\0080\3d\publish\3delements\lgt_droneblades\v0004\fullres\1000_0080_lgt_droneblades_v0004..max' (length=154) 'SceneFilePath' => string 'C:\Users\rob.glazer\AppData\Local\Thinkbox\Deadline6\temp\deadlineSubmitFile.max' (length=80) 'PluginProfile' => string '1189_ADK_Subaru_Swarm' (length=21) 'QueuedChunks' => int 67 'RenderingChunks' => int 0 'Stat' => int 1 'SuspendedChunks' => int 0 'Tile' => boolean false 'TileCount' => int 0 'TileFrame' => int 0 'TileX' => int 0 'TileY' => int 0 '_id' => string '5329e7d043b36a32a4075f31' (length=24)

Is the deadline monitor not displaying it because of the following negative values?

'DateComp' => object(MongoDate)[346] public 'sec' => int -62135596800 public 'usec' => int 0 'DateStart' => object(MongoDate)[347] public 'sec' => int -62135596800 public 'usec' => int 0

It has a Stat of 1 meaning it’s listed as active. Just curious what I could do to ignore this job so it emulates the functionality of the deadline monitor.

Thanks,

This is why the job isn’t showing up:

This flag is set to false while the job is being submitted, and then set to true after submission is complete. This is to prevent slaves from picking up jobs that are still in the process of being submitted. If the submission process is killed, a job can be left in this unsubmitted state. However, Deadline’s housecleaning operation should eventually clean these up after they have been in this state for over 3 days.

Cheers,
Ryan

Interesting, thanks for that info!

It looks like the house cleaning didn’t remove it though (I manually ran it):

2014-03-21 12:05:53: Purging Unsubmitted Jobs 2014-03-21 12:05:53: Unsubmitted Job Scan - Loading unsubmitted jobs 2014-03-21 12:05:53: Unsubmitted Job Scan - Loaded 1 unsubmitted jobs in 8.001 ms 2014-03-21 12:05:53: Unsubmitted Job Scan - Deleted 0 unsubmitted jobs in 0.000 s 2014-03-21 12:05:53: Unsubmitted Job Scan - Done.

So hopefully by later today or tomorrow it’ll be gone.