pulse hanging

LaszloSebo · September 19, 2014, 7:53pm

Pulse has been running since ~ last 11pm:

[root@deadline03 linux]# ps aux | grep pulse
root 5735 0.0 0.0 103252 824 pts/0 S+ 04:45 0:00 grep pulse
root 32432 1.9 0.2 1281616 68992 pts/0 Sl Sep18 23:12 ./mono --runtime=v4.0 /opt/Thinkbox/Deadline7/bin/deadlinepulse.exe -nogui

But there hasnt been any activity for hours (last lines of log):

2014-09-19 04:45:38:      Old Limit Scan - Purged 0 machine limits in 97.000 Î¼s
2014-09-19 04:45:38:      Old Limit Scan - Done.
2014-09-19 04:45:38:  Purging Temporary Repository Files
2014-09-19 04:45:38:      Temporary File Scan - Scanning for 'connectReadWriteTest' files
2014-09-19 04:45:38:      Temporary File Scan - Deleted 0 temporary files in 2.195 ms
2014-09-19 04:45:38:      Temporary File Scan - Done.
2014-09-19 04:45:38:  Purging Old Statistics
2014-09-19 04:45:38:      Old Statistics - Skipping job statistics because the option to purge them is disabled in the Repository Options
2014-09-19 04:45:38:      Old Statistics - Purging slave statistics that are older than May 22/14  12:52:03
2014-09-19 04:45:38:      Old Statistics - Purged old slave statistics in 9.640 ms
2014-09-19 04:45:38:      Old Statistics - Purging repository statistics that are older than May 22/14  12:52:03
2014-09-19 04:45:38:      Old Statistics - Purged old repository statistics in 688.000 Î¼s
2014-09-19 04:45:38:  Purging Deleted Document Stubs From Database
2014-09-19 04:45:38:      Deleted Document Stubs - Deleting stubs that are older than 3 days
2014-09-19 04:45:38:      Deleted Document Stubs - Deleted 0 stubs in 746.000 Î¼s
2014-09-19 04:45:38:  Triggering House Cleaning Events
2014-09-19 04:45:38:  ScanlineEventListener _init__ called, wiping PYTHONPATH from deadlineslave's embedded python
2014-09-19 04:45:38:  Process exit code: 0
2014-09-19 04:45:39:  Process exit code: 0

rrussell · September 19, 2014, 8:10pm

What’s the memory/cpu usage look like for Pulse? If you run “deadlinepulse -s”, does it respond to the shutdown message?

LaszloSebo · September 19, 2014, 8:21pm

I’ve killed it in the meantime, and manually restarted it. RAM usage (although not exact) is in that ps aux printout, around 1.2gigs, not as high as we have seen before (7-8gigs with deadline6)

rrussell · September 19, 2014, 8:47pm

Okay, let’s wait and see if it happens again. We can then fire up a VM here and try to reproduce.

Thanks!
Ryan