Hi,
We’ve been experiencing issues where dependencies are not getting picked up. Here’s the related info:
- Deadline 6.1.0.53441
- Windows 7
- 3ds Max
- Launch a job with a dependent job.
Thanks for your help!
-Shem
Do you guys have Pulse running? If not, then dependencies aren’t released on a regular interval (it’s more of a random process that the slaves perform between tasks). As a quick test to make sure the dependencies are working, you could perform a manual house cleaning from the Tools menu in the Monitor while in super user mode.
Cheers,
- Ryan
Alright, I’ll give that a shot and get back to you. Thanks!
Okay, I tried the manual house cleaning, and then started running pulse to see if it would work, but it looks like we’re still experiencing the same behavior.
But now that pulse is running, when I run the manual house cleaning, I also get this error:
2013-11-25 10:03:53: Error occurred while updating job cache: AttributeError : 'NoneType' object has no attribute 'QueuedChunks' (Python.Runtime.PythonException)
2013-11-25 10:03:53: Error occurred during periodic house cleaning:
2013-11-25 10:03:53: Object reference not set to an instance of an object. (System.NullReferenceException)
2013-11-25 10:03:53: at Deadline.StorageDB.MongoDB.MongoJobStorage.<GetJobIDs>b__0(Job value)
2013-11-25 10:03:53: at System.Linq.Enumerable.WhereSelectListIterator`2.MoveNext()
2013-11-25 10:03:53: at System.Linq.Buffer`1..ctor(IEnumerable`1 source)
2013-11-25 10:03:53: at System.Linq.Enumerable.ToArray[TSource](IEnumerable`1 source)
2013-11-25 10:03:53: at Deadline.StorageDB.MongoDB.MongoJobStorage.GetJobIDs(Boolean invalidateCache)
2013-11-25 10:03:53: at Deadline.Scheduling.HouseCleaning.DoPeriodicHouseCleaning(Boolean verbose, Boolean quitRequested, Int32 multiplier)
2013-11-25 10:03:53: Connecting to Pulse log
2013-11-25 10:03:53: Error occurred during periodic house cleaning:
2013-11-25 10:03:53: Object reference not set to an instance of an object. (System.NullReferenceException)
2013-11-25 10:03:53: at Deadline.StorageDB.MongoDB.MongoJobStorage.<GetJobIDs>b__0(Job value)
2013-11-25 10:03:53: at System.Linq.Enumerable.WhereSelectListIterator`2.MoveNext()
2013-11-25 10:03:53: at System.Linq.Buffer`1..ctor(IEnumerable`1 source)
2013-11-25 10:03:53: at System.Linq.Enumerable.ToArray[TSource](IEnumerable`1 source)
2013-11-25 10:03:53: at Deadline.StorageDB.MongoDB.MongoJobStorage.GetJobIDs(Boolean invalidateCache)
2013-11-25 10:03:53: at Deadline.Scheduling.HouseCleaning.DoPeriodicHouseCleaning(Boolean verbose, Boolean quitRequested, Int32 multiplier)Thanks for the help!
That would definitely explain the problem, but I have no idea why you would be getting that error. I wonder if there is some corrupt data in the database or something…
Would you be willing to zip up your mongo database and send it to us? You would just need to zip up the data folder in your mongo database folder. It should compress pretty well. If this is something you’d be willing to do, I can set up a temporary location for you to drop the files and email you the link privately. We could then dump it here and try to reproduce the problem.
We have changed the block of code that is throwing this error slightly for the upcoming beta 12 release, but I don’t know if it will make a difference or not, so it would be great to be able to test it here.
Cheers,
- Ryan
Okay, I’ll let you know once we can send the database.
Thanks!
Hey Russell,
Could you go ahead and set us up with that secure drop location?
Thanks!
I’ve emailed you the details.
Thanks!
- Ryan
Hi Shem,
Thanks for sending us your database! I connected to it with beta 12, and when I first ran housecleaning, I got some errors that seemed to indicate there was some database corruption. I then ran a repair operation on the database and tried again, and this time I had no problems. So I think you just need to repair your database and you should be good.
To repair, first stop the current running instance of mongo from running.
Second, open a command prompt, and run mongo with the --repair command. Here is an example if you installed the database to the default location on Windows:
"C:\DeadlineDatabase6\mongo\application\bin\mongod.exe" --dbpath "C:\DeadlineDatabase6\mongo\data" --repairAfter it finishes, start up mongo normally again.
I would also recommend upgrading to beta 12 if that’s an option. In the last few beta versions, there is a new Pending Job Scan option in the Tools menu for manually releasing pending jobs. The same command is run by the slaves randomly if pulse isn’t running, or at set intervals by Pulse if it is running. We split it off from the rest of housecleaning so that dependency checking occurs on a more reliable basis.
Hope this does the trick!
- Ryan
Okay, here goes. Thanks!