AWS Thinkbox Discussion Forums

[Linux] Monitor tanks after long run (thread-related)

Got a fairly obscure one here.

After leaving the Monitor running overnight, I came in to find it had crashed hard. I tried again the next night, with the same results.

I’ve included the crash dump below, but in doing some searching, it seems that this maybe be an issue related to .NET applications (possibly C# specifically) running on Mono spawning too many threads that are never properly cleaned up. The scary thing is that it looks like a standard Mono build sets this limit at 16384, and a “small” build at 256.

Unfortunately there isn’t a whole lot more info out there besides “the application needs to clean up threads,” but I think this is something worth looking into. I’m going to try running a Slave long-term as well to see if it suffers from the same issue, but this seems like it could have serious implications for some of the processes that need to be running for weeks or months at a time.

[code]Main Window shown

  • Assertion at threads.c:391, condition `id < HAZARD_TABLE_MAX_SIZE’ not met

Native stacktrace:

    mono() [0x4917da]
    /lib64/libpthread.so.0(+0xeef0) [0x7fe7b90f9ef0]
    /lib64/libc.so.6(gsignal+0x35) [0x7fe7b8b712d5]
    /lib64/libc.so.6(abort+0x17b) [0x7fe7b8b72beb]
    mono() [0x5caa8f]
    mono() [0x5cabb6]
    mono() [0x58dcf2]
    mono(mono_thread_attach+0xe8) [0x58f368]
    mono(mono_jit_thread_attach+0x48) [0x416588]
    [0x4108e0f0]

Debug info from gdb:

Mono support loaded.
Traceback (most recent call last):
File “/usr/share/gdb/auto-load/usr/lib64/libstdc++.so.6.0.16-gdb.py”, line 59, in
from libstdcxx.v6.printers import register_libstdcxx_printers
ImportError: No module named libstdcxx.v6.printers
[Thread debugging using libthread_db enabled]
[New Thread 0x7fe77ffff700 (LWP 2039)]
[New Thread 0x7fe785ccb700 (LWP 13013)]
[New Thread 0x7fe79e845700 (LWP 13011)]
[New Thread 0x7fe79ea8e700 (LWP 13010)]
[New Thread 0x7fe79fafb700 (LWP 13009)]
[New Thread 0x7fe7a257e700 (LWP 13008)]
[New Thread 0x7fe79fcfc700 (LWP 13007)]
[New Thread 0x7fe7aebe1700 (LWP 13006)]
[New Thread 0x7fe7af712700 (LWP 13005)]
[New Thread 0x7fe7aff13700 (LWP 13004)]
[New Thread 0x7fe7b0714700 (LWP 13003)]
[New Thread 0x7fe7b0f15700 (LWP 13002)]
[New Thread 0x7fe7b1716700 (LWP 13001)]
[New Thread 0x7fe7b1f17700 (LWP 13000)]
[New Thread 0x7fe7b2718700 (LWP 12999)]
0x00007fe7b90f8560 in sem_wait () from /lib64/libpthread.so.0
Id Target Id Frame
16 Thread 0x7fe7b2718700 (LWP 12999) “mono” 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
15 Thread 0x7fe7b1f17700 (LWP 13000) “mono” 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
14 Thread 0x7fe7b1716700 (LWP 13001) “mono” 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
13 Thread 0x7fe7b0f15700 (LWP 13002) “mono” 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
12 Thread 0x7fe7b0714700 (LWP 13003) “mono” 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
11 Thread 0x7fe7aff13700 (LWP 13004) “mono” 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
10 Thread 0x7fe7af712700 (LWP 13005) “mono” 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
9 Thread 0x7fe7aebe1700 (LWP 13006) “mono” 0x00007fe7b90f8560 in sem_wait () from /lib64/libpthread.so.0
8 Thread 0x7fe79fcfc700 (LWP 13007) “deadlinemonitor” 0x00007fe7b90f681f in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
7 Thread 0x7fe7a257e700 (LWP 13008) “deadlinemonitor” 0x00007fe7b8c1c303 in epoll_wait () from /lib64/libc.so.6
6 Thread 0x7fe79fafb700 (LWP 13009) “deadlinemonitor” 0x00007fe7b90f8640 in sem_timedwait () from /lib64/libpthread.so.0
5 Thread 0x7fe79ea8e700 (LWP 13010) “deadlinemonitor” 0x00007fe7b90f976d in nanosleep () from /lib64/libpthread.so.0
4 Thread 0x7fe79e845700 (LWP 13011) “deadlinemonitor” 0x00007fe7b90f8560 in sem_wait () from /lib64/libpthread.so.0
3 Thread 0x7fe785ccb700 (LWP 13013) “deadlinemonitor” 0x00007fe7b90f8560 in sem_wait () from /lib64/libpthread.so.0
2 Thread 0x7fe77ffff700 (LWP 2039) “deadlinemonitor” 0x00007fe7b90f901d in read () from /lib64/libpthread.so.0

  • 1 Thread 0x7fe7b9b90760 (LWP 12997) “deadlinemonitor” 0x00007fe7b90f8560 in sem_wait () from /lib64/libpthread.so.0

Thread 16 (Thread 0x7fe7b2718700 (LWP 12999)):
#0 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007fe7b90f2b31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007fe7b8c1bd2d in clone () from /lib64/libc.so.6

Thread 15 (Thread 0x7fe7b1f17700 (LWP 13000)):
#0 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007fe7b90f2b31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007fe7b8c1bd2d in clone () from /lib64/libc.so.6

Thread 14 (Thread 0x7fe7b1716700 (LWP 13001)):
#0 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007fe7b90f2b31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007fe7b8c1bd2d in clone () from /lib64/libc.so.6

Thread 13 (Thread 0x7fe7b0f15700 (LWP 13002)):
#0 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007fe7b90f2b31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007fe7b8c1bd2d in clone () from /lib64/libc.so.6

Thread 12 (Thread 0x7fe7b0714700 (LWP 13003)):
#0 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007fe7b90f2b31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007fe7b8c1bd2d in clone () from /lib64/libc.so.6

Thread 11 (Thread 0x7fe7aff13700 (LWP 13004)):
#0 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007fe7b90f2b31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007fe7b8c1bd2d in clone () from /lib64/libc.so.6

Thread 10 (Thread 0x7fe7af712700 (LWP 13005)):
#0 0x00007fe7b90f64b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007fe7b90f2b31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007fe7b8c1bd2d in clone () from /lib64/libc.so.6

Thread 9 (Thread 0x7fe7aebe1700 (LWP 13006)):
#0 0x00007fe7b90f8560 in sem_wait () from /lib64/libpthread.so.0
#1 0x00000000005c2808 in mono_sem_wait ()
#2 0x000000000051068b in ?? ()
#3 0x0000000000592eb7 in ?? ()
#4 0x00000000005bd202 in ?? ()
#5 0x00000000005dd04e in ?? ()
#6 0x00007fe7b90f2b31 in start_thread () from /lib64/libpthread.so.0
#7 0x00007fe7b8c1bd2d in clone () from /lib64/libc.so.6

Thread 8 (Thread 0x7fe79fcfc700 (LWP 13007)):
#0 0x00007fe7b90f681f in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005a9908 in ?? ()
#2 0x00000000005ba98c in ?? ()
#3 0x00000000005927fb in ?? ()
#4 0x0000000041f07758 in ?? ()
#5 0x00007fe798000c20 in ?? ()
#6 0xffffffffffffffff in ?? ()
#7 0x00007fe79fcfb99f in ?? ()
#8 0x00007fe7a5467910 in ?? ()
#9 0x0000000000000007 in ?? ()
#10 0x00007fe79fcfb9c0 in ?? ()
#11 0x00007fe79fcfb920 in ?? ()
#12 0x0000000000000000 in ?? ()

Thread 7 (Thread 0x7fe7a257e700 (LWP 13008)):
#0 0x00007fe7b8c1c303 in epoll_wait () from /lib64/libc.so.6
#1 0x000000000058a6e8 in ?? ()
#2 0x0000000000592eb7 in ?? ()
#3 0x00000000005bd202 in ?? ()
#4 0x00000000005dd04e in ?? ()
#5 0x00007fe7b90f2b31 in start_thread () from /lib64/libpthread.so.0
#6 0x00007fe7b8c1bd2d in clone () from /lib64/libc.so.6

Thread 6 (Thread 0x7fe79fafb700 (LWP 13009)):
#0 0x00007fe7b90f8640 in sem_timedwait () from /lib64/libpthread.so.0
#1 0x00000000005c28fb in mono_sem_timedwait ()
#2 0x000000000058c10f in ?? ()
#3 0x0000000000592eb7 in ?? ()
#4 0x00000000005bd202 in ?? ()
#5 0x00000000005dd04e in ?? ()
#6 0x00007fe7b90f2b31 in start_thread () from /lib64/libpthread.so.0
#7 0x00007fe7b8c1bd2d in clone () from /lib64/libc.so.6

Thread 5 (Thread 0x7fe79ea8e700 (LWP 13010)):
#0 0x00007fe7b90f976d in nanosleep () from /lib64/libpthread.so.0
#1 0x00000000005bc446 in ?? ()
#2 0x0000000000589cf8 in ?? ()
#3 0x0000000000592eb7 in ?? ()
#4 0x00000000005bd202 in ?? ()
#5 0x00000000005dd04e in ?? ()
#6 0x00007fe7b90f2b31 in start_thread () from /lib64/libpthread.so.0
#7 0x00007fe7b8c1bd2d in clone () from /lib64/libc.so.6

Thread 4 (Thread 0x7fe79e845700 (LWP 13011)):
#0 0x00007fe7b90f8560 in sem_wait () from /lib64/libpthread.so.0
#1 0x00007fe7ae3434f8 in PyThread_acquire_lock (lock=0x122adc0, waitflag=128) at Python/thread_pthread.h:349
#2 0x00007fe7ae312814 in PyEval_RestoreThread (tstate=0x7fe78c0e81d0) at Python/ceval.c:353
#3 0x00007fe7ae336936 in PyGILState_Ensure () at Python/pystate.c:610
#4 0x0000000041090825 in ?? ()
#5 0x00007fe78c000c20 in ?? ()
#6 0x00000000404da04d in ?? ()
#7 0x00007fe78c000c20 in ?? ()
#8 0xffffffffffffffff in ?? ()
#9 0x00007fe79e20bb80 in ?? ()
#10 0x00007fe79e844830 in ?? ()
#11 0x00007fe79e844780 in ?? ()
#12 0x00007fe7677d48c0 in ?? ()
#13 0x00007fe76bef0a00 in ?? ()
#14 0x00007fe784803690 in ?? ()
#15 0x0000000000000001 in ?? ()
#16 0x00000000410907bc in ?? ()
#17 0x00007fe79e844a70 in ?? ()
#18 0x00000000407f8250 in ?? ()
#19 0x00007fe78486ddc0 in ?? ()
#20 0x00007fe79dedefa0 in ?? ()
#21 0x00007fe76bef0a00 in ?? ()
#22 0x0000000000000000 in ?? ()

Thread 3 (Thread 0x7fe785ccb700 (LWP 13013)):
#0 0x00007fe7b90f8560 in sem_wait () from /lib64/libpthread.so.0
#1 0x00007fe7ae3434f8 in PyThread_acquire_lock (lock=0x122adc0, waitflag=128) at Python/thread_pthread.h:349
#2 0x00007fe7ae312814 in PyEval_RestoreThread (tstate=0x7fe7800012d0) at Python/ceval.c:353
#3 0x00007fe7a5da797d in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#4 0x00007fe7ae31729d in call_function (oparg=, pp_stack=) at Python/ceval.c:3750
#5 PyEval_EvalFrameEx (f=0x7fe7800013f0, throwflag=) at Python/ceval.c:2412
#6 0x00007fe7ae318fe9 in PyEval_EvalCodeEx (co=0x2f8dbe8, globals=, locals=, args=0x1256428, argcount=1, kws=0x0, kwcount=0, defs=0x0, defcount=0, closure=0x0) at Python/ceval.c:3000
#7 0x00007fe7ae29dc5d in function_call (func=0x2f942a8, arg=0x1256410, kw=0x0) at Objects/funcobject.c:524
#8 0x00007fe7ae26f0a8 in PyObject_Call (func=0x2f942a8, arg=0x1256410, kw=0x0) at Objects/abstract.c:2492
#9 0x00007fe7ae27feb0 in instancemethod_call (func=0x2f942a8, arg=0x1256410, kw=0x0) at Objects/classobject.c:2579
#10 0x00007fe7ae26f0a8 in PyObject_Call (func=0x2de4140, arg=0x7fe7adfc7050, kw=0x0) at Objects/abstract.c:2492
#11 0x00007fe7ae311dd6 in PyEval_CallObjectWithKeywords (func=0x2de4140, arg=0x7fe7adfc7050, kw=0x0) at Python/ceval.c:3619
#12 0x00007fe7a61594a2 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/sip.so
#13 0x00007fe7a5d72ff7 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#14 0x00007fe7a5da8882 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#15 0x00007fe7a7b8950f in ?? () from /lumalocal/Deadline6/client/bin/libQtCore.so.4
#16 0x00007fe7b90f2b31 in start_thread () from /lib64/libpthread.so.0
#17 0x00007fe7b8c1bd2d in clone () from /lib64/libc.so.6

Thread 2 (Thread 0x7fe77ffff700 (LWP 2039)):
#0 0x00007fe7b90f901d in read () from /lib64/libpthread.so.0
#1 0x0000000000491976 in ?? ()
#2
#3 0x00007fe7b8b712d5 in raise () from /lib64/libc.so.6
#4 0x00007fe7b8b72beb in abort () from /lib64/libc.so.6
#5 0x00000000005caa8f in ?? ()
#6 0x00000000005cabb6 in ?? ()
#7 0x000000000058dcf2 in ?? ()
#8 0x000000000058f368 in mono_thread_attach ()
#9 0x0000000000416588 in mono_jit_thread_attach ()
#10 0x000000004108e0f0 in ?? ()
#11 0x00007fe770001588 in ?? ()
#12 0x00000000020f70e0 in ?? ()
#13 0x0000000000000000 in ?? ()

Thread 1 (Thread 0x7fe7b9b90760 (LWP 12997)):
#0 0x00007fe7b90f8560 in sem_wait () from /lib64/libpthread.so.0
#1 0x00007fe7ae3434f8 in PyThread_acquire_lock (lock=0x122adc0, waitflag=128) at Python/thread_pthread.h:349
#2 0x00007fe7ae312814 in PyEval_RestoreThread (tstate=0x113fc90) at Python/ceval.c:353
#3 0x00007fe7ae336936 in PyGILState_Ensure () at Python/pystate.c:610
#4 0x00007fe7a5e8ff2e in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#5 0x00007fe7a5e90075 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#6 0x00007fe7a7cb2e20 in QMetaObject::activate(QObject*, QMetaObject const*, int, void**) () from /lumalocal/Deadline6/client/bin/libQtCore.so.4
#7 0x00007fe7a5da3eef in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#8 0x00007fe7a7cae4b4 in QObject::event(QEvent*) () from /lumalocal/Deadline6/client/bin/libQtCore.so.4
#9 0x00007fe7a5da3e82 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#10 0x00007fe7ac29bf6f in QApplicationPrivate::notify_helper(QObject*, QEvent*) () from /lumalocal/Deadline6/client/bin/libQtGui.so.4
#11 0x00007fe7ac2a25d0 in QApplication::notify(QObject*, QEvent*) () from /lumalocal/Deadline6/client/bin/libQtGui.so.4
#12 0x00007fe7ad318cc4 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtGui.so
#13 0x00007fe7a7c9ab64 in QCoreApplication::notifyInternal(QObject*, QEvent*) () from /lumalocal/Deadline6/client/bin/libQtCore.so.4
#14 0x00007fe7a7ccde9d in ?? () from /lumalocal/Deadline6/client/bin/libQtCore.so.4
#15 0x00007fe7a7ccec00 in QEventDispatcherUNIX::processEvents(QFlagsQEventLoop::ProcessEventsFlag) () from /lumalocal/Deadline6/client/bin/libQtCore.so.4
#16 0x00007fe7ac349526 in ?? () from /lumalocal/Deadline6/client/bin/libQtGui.so.4
#17 0x00007fe7a7c99bc5 in QEventLoop::processEvents(QFlagsQEventLoop::ProcessEventsFlag) () from /lumalocal/Deadline6/client/bin/libQtCore.so.4
#18 0x00007fe7a7c99f98 in QEventLoop::exec(QFlagsQEventLoop::ProcessEventsFlag) () from /lumalocal/Deadline6/client/bin/libQtCore.so.4
#19 0x00007fe7a7ca00f4 in QCoreApplication::exec() () from /lumalocal/Deadline6/client/bin/libQtCore.so.4
#20 0x00007fe7ad3198fd in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtGui.so
#21 0x00007fe7ae31729d in call_function (oparg=, pp_stack=) at Python/ceval.c:3750
#22 PyEval_EvalFrameEx (f=0x1f3d1f0, throwflag=) at Python/ceval.c:2412
#23 0x00007fe7ae3184b4 in fast_function (nk=, na=, n=, pp_stack=, func=) at Python/ceval.c:3836
#24 call_function (oparg=, pp_stack=) at Python/ceval.c:3771
#25 PyEval_EvalFrameEx (f=0x3717100, throwflag=) at Python/ceval.c:2412
#26 0x00007fe7ae3184b4 in fast_function (nk=, na=, n=, pp_stack=, func=) at Python/ceval.c:3836
#27 call_function (oparg=, pp_stack=) at Python/ceval.c:3771
#28 PyEval_EvalFrameEx (f=0x1ba7060, throwflag=) at Python/ceval.c:2412
#29 0x00007fe7ae318fe9 in PyEval_EvalCodeEx (co=0x7fe7adf09210, globals=, locals=, args=0x0, argcount=0, kws=0x0, kwcount=0, defs=0x0, defcount=0, closure=0x0) at Python/ceval.c:3000
#30 0x00007fe7ae319162 in PyEval_EvalCode (co=0x122adc0, globals=0x80, locals=0x0) at Python/ceval.c:541
#31 0x00007fe7ae32b710 in PyImport_ExecCodeModuleEx (name=0x1f40950 “MainWindow”, co=0x7fe7adf09210, pathname=0x0) at Python/import.c:677
#32 0x000000004143e013 in ?? ()
#33 0x0000000000ea8850 in ?? ()
#34 0x0000000000000040 in ?? ()
#35 0x0000000000ea8850 in ?? ()
#36 0x0000000000000000 in ?? ()

=================================================================
Got a SIGABRT while executing native code. This usually indicates
a fatal error in the mono runtime or one of the native libraries
used by your application.

Aborted[/code]

Let me know if I can provide any more info.

-Nathan

Hey Nathan,

There is a good chance this is related to the C++ object error messages that still happen in the Monitor. That C++ object error has become a higher priority for us, and we hope to get it fixed over the next few beta releases. We have logged this as a new bug though, in case its related.

Have you seen this happen on your slaves at all?

Cheers,

  • Ryan

Just wanted to follow up and note that this does not seem to be occurring in beta 8. However, I wanted to check and see how much you’ve explicitly addressed/fixed (as far as the “underlying C++ object has been deleted” errors, thread issues, etc.) and just make sure this isn’t a coincidence.

We haven’t tackled the “underlying C++ object has been deleted” errors yet, but we have been working on general threading improvements over the last couple beta releases. It could be the case where something we changed fixed the underlying issue, and it had nothing to do with the C++ error, but we can’t know for sure.

We still plan on addressing the C++ error eventually before 6.0 is released, so if you do see the Monitor crash again before that, let us know!

Cheers,

  • Ryan

Ok, I’ll leave a monitor running for a few days in case the thread leaking is just slower now.

Thanks for the update.

Bad news: this one hit me again after leaving the monitor open all night. This is using beta 11.

[code]Main Window shown

  • Assertion at threads.c:391, condition `id < HAZARD_TABLE_MAX_SIZE’ not met

Native stacktrace:

    mono() [0x4917da]
    /lib64/libpthread.so.0(+0xeef0) [0x7f8e2e241ef0]
    /lib64/libc.so.6(gsignal+0x35) [0x7f8e2dcb92d5]
    /lib64/libc.so.6(abort+0x17b) [0x7f8e2dcbabeb]
    mono() [0x5caa8f]
    mono() [0x5cabb6]
    mono() [0x58dcf2]
    mono(mono_thread_attach+0xe8) [0x58f368]
    mono(mono_jit_thread_attach+0x48) [0x416588]
    [0x41356750]

Debug info from gdb:

Mono support loaded.
Traceback (most recent call last):
File “/usr/share/gdb/auto-load/usr/lib64/libstdc++.so.6.0.16-gdb.py”, line 59, in
from libstdcxx.v6.printers import register_libstdcxx_printers
ImportError: No module named libstdcxx.v6.printers
[Thread debugging using libthread_db enabled]
[New Thread 0x7f8de7fff700 (LWP 30939)]
[New Thread 0x7f8dfe172700 (LWP 30936)]
[New Thread 0x7f8dfeafc700 (LWP 7024)]
[New Thread 0x7f8dff2fd700 (LWP 7023)]
[New Thread 0x7f8e116e1700 (LWP 7020)]
[New Thread 0x7f8e1287f700 (LWP 7019)]
[New Thread 0x7f8e2262c700 (LWP 7018)]
[New Thread 0x7f8e2266d700 (LWP 7017)]
[New Thread 0x7f8e2286e700 (LWP 7016)]
[New Thread 0x7f8e23d29700 (LWP 7015)]
[New Thread 0x7f8e2485a700 (LWP 7014)]
[New Thread 0x7f8e2505b700 (LWP 7013)]
[New Thread 0x7f8e2585c700 (LWP 7012)]
[New Thread 0x7f8e2605d700 (LWP 7011)]
[New Thread 0x7f8e2685e700 (LWP 7010)]
[New Thread 0x7f8e2705f700 (LWP 7009)]
[New Thread 0x7f8e27860700 (LWP 7008)]
0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0
Id Target Id Frame
18 Thread 0x7f8e27860700 (LWP 7008) “mono” 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
17 Thread 0x7f8e2705f700 (LWP 7009) “mono” 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
16 Thread 0x7f8e2685e700 (LWP 7010) “mono” 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
15 Thread 0x7f8e2605d700 (LWP 7011) “mono” 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
14 Thread 0x7f8e2585c700 (LWP 7012) “mono” 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
13 Thread 0x7f8e2505b700 (LWP 7013) “mono” 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
12 Thread 0x7f8e2485a700 (LWP 7014) “mono” 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
11 Thread 0x7f8e23d29700 (LWP 7015) “mono” 0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0
10 Thread 0x7f8e2286e700 (LWP 7016) “deadlinemonitor” 0x00007f8e2e23e81f in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
9 Thread 0x7f8e2266d700 (LWP 7017) “deadlinemonitor” 0x00007f8e2dd64303 in epoll_wait () from /lib64/libc.so.6
8 Thread 0x7f8e2262c700 (LWP 7018) “deadlinemonitor” 0x00007f8e2e240640 in sem_timedwait () from /lib64/libpthread.so.0
7 Thread 0x7f8e1287f700 (LWP 7019) “deadlinemonitor” 0x00007f8e2e240d3d in __lll_lock_wait () from /lib64/libpthread.so.0
6 Thread 0x7f8e116e1700 (LWP 7020) “deadlinemonitor” 0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0
5 Thread 0x7f8dff2fd700 (LWP 7023) “deadlinemonitor” 0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0
4 Thread 0x7f8dfeafc700 (LWP 7024) “deadlinemonitor” 0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0
3 Thread 0x7f8dfe172700 (LWP 30936) “deadlinemonitor” 0x00007f8e2e24101d in read () from /lib64/libpthread.so.0
2 Thread 0x7f8de7fff700 (LWP 30939) “deadlinemonitor” 0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0

  • 1 Thread 0x7f8e2ecd8760 (LWP 7006) “deadlinemonitor” 0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0

Thread 18 (Thread 0x7f8e27860700 (LWP 7008)):
#0 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 17 (Thread 0x7f8e2705f700 (LWP 7009)):
#0 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 16 (Thread 0x7f8e2685e700 (LWP 7010)):
#0 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 15 (Thread 0x7f8e2605d700 (LWP 7011)):
#0 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 14 (Thread 0x7f8e2585c700 (LWP 7012)):
#0 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 13 (Thread 0x7f8e2505b700 (LWP 7013)):
#0 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 12 (Thread 0x7f8e2485a700 (LWP 7014)):
#0 0x00007f8e2e23e4b5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005dd993 in ?? ()
#2 0x00000000005d7bac in ?? ()
#3 0x00000000005dc097 in ?? ()
#4 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 11 (Thread 0x7f8e23d29700 (LWP 7015)):
#0 0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0
#1 0x00000000005c2808 in mono_sem_wait ()
#2 0x000000000051068b in ?? ()
#3 0x0000000000592eb7 in ?? ()
#4 0x00000000005bd202 in ?? ()
#5 0x00000000005dd04e in ?? ()
#6 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#7 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 10 (Thread 0x7f8e2286e700 (LWP 7016)):
#0 0x00007f8e2e23e81f in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005a9908 in ?? ()
#2 0x00000000005ba98c in ?? ()
#3 0x00000000005927fb in ?? ()
#4 0x0000000040417148 in ?? ()
#5 0x00007f8e14000c20 in ?? ()
#6 0xffffffffffffffff in ?? ()
#7 0x00007f8e2286d99f in ?? ()
#8 0x00007f8e229136b8 in ?? ()
#9 0x0000000000000007 in ?? ()
#10 0x00007f8e2286d9c0 in ?? ()
#11 0x00007f8e2286d920 in ?? ()
#12 0x0000000000000001 in ?? ()
#13 0x00000000000000fa in ?? ()
#14 0x00007f8e22878d98 in ?? ()
#15 0x00000000000000f9 in ?? ()
#16 0x0000000040416ee8 in ?? ()
#17 0x00007f8e22878d98 in ?? ()
#18 0x0000000000000000 in ?? ()

Thread 9 (Thread 0x7f8e2266d700 (LWP 7017)):
#0 0x00007f8e2dd64303 in epoll_wait () from /lib64/libc.so.6
#1 0x000000000058a6e8 in ?? ()
#2 0x0000000000592eb7 in ?? ()
#3 0x00000000005bd202 in ?? ()
#4 0x00000000005dd04e in ?? ()
#5 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 8 (Thread 0x7f8e2262c700 (LWP 7018)):
#0 0x00007f8e2e240640 in sem_timedwait () from /lib64/libpthread.so.0
#1 0x00000000005c28fb in mono_sem_timedwait ()
#2 0x000000000058c10f in ?? ()
#3 0x0000000000592eb7 in ?? ()
#4 0x00000000005bd202 in ?? ()
#5 0x00000000005dd04e in ?? ()
#6 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#7 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 7 (Thread 0x7f8e1287f700 (LWP 7019)):
#0 0x00007f8e2e240d3d in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x00007f8e2e23caf1 in _L_lock_795 () from /lib64/libpthread.so.0
#2 0x00007f8e2e23ca0a in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x000000000058d967 in ?? ()
#4 0x00000000005923c6 in ?? ()
#5 0x0000000000589c43 in ?? ()
#6 0x0000000000589d44 in ?? ()
#7 0x0000000000592eb7 in ?? ()
#8 0x00000000005bd202 in ?? ()
#9 0x00000000005dd04e in ?? ()
#10 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#11 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 6 (Thread 0x7f8e116e1700 (LWP 7020)):
#0 0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0
#1 0x00007f8e234764f8 in PyThread_acquire_lock (lock=0x1436240, waitflag=128) at Python/thread_pthread.h:349
#2 0x00007f8e23445814 in PyEval_RestoreThread (tstate=0x7f8e000af1e0) at Python/ceval.c:353
#3 0x00007f8e23469936 in PyGILState_Ensure () at Python/pystate.c:610
#4 0x0000000041091835 in ?? ()
#5 0x00007f8e00000c20 in ?? ()
#6 0x000000004183504d in ?? ()
#7 0x00007f8e00000c20 in ?? ()
#8 0x00007f8e0584df30 in ?? ()
#9 0x00007f8e0584df30 in ?? ()
#10 0x00007f8e116e0980 in ?? ()
#11 0x00007f8e116e08d0 in ?? ()
#12 0x0000000000000000 in ?? ()

Thread 5 (Thread 0x7f8dff2fd700 (LWP 7023)):
#0 0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0
#1 0x00007f8e234764f8 in PyThread_acquire_lock (lock=0x1436240, waitflag=128) at Python/thread_pthread.h:349
#2 0x00007f8e23445814 in PyEval_RestoreThread (tstate=0x7f8df80012d0) at Python/ceval.c:353
#3 0x00007f8e12c8097d in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#4 0x00007f8e2344a29d in call_function (oparg=, pp_stack=) at Python/ceval.c:3750
#5 PyEval_EvalFrameEx (f=0x7f8df80013f0, throwflag=) at Python/ceval.c:2412
#6 0x00007f8e2344bfe9 in PyEval_EvalCodeEx (co=0x30d8c60, globals=, locals=, args=0x146c568, argcount=1, kws=0x0, kwcount=0, defs=0x0, defcount=0, closure=0x0) at Python/ceval.c:3000
#7 0x00007f8e233d0c5d in function_call (func=0x30dd320, arg=0x146c550, kw=0x0) at Objects/funcobject.c:524
#8 0x00007f8e233a20a8 in PyObject_Call (func=0x30dd320, arg=0x146c550, kw=0x0) at Objects/abstract.c:2492
#9 0x00007f8e233b2eb0 in instancemethod_call (func=0x30dd320, arg=0x146c550, kw=0x0) at Objects/classobject.c:2579
#10 0x00007f8e233a20a8 in PyObject_Call (func=0x2f32190, arg=0x7f8e230fa050, kw=0x0) at Objects/abstract.c:2492
#11 0x00007f8e23444dd6 in PyEval_CallObjectWithKeywords (func=0x2f32190, arg=0x7f8e230fa050, kw=0x0) at Python/ceval.c:3619
#12 0x00007f8e130324a2 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/sip.so
#13 0x00007f8e12c4bff7 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#14 0x00007f8e12c81882 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#15 0x00007f8e2140950f in ?? () from ./libQtCore.so.4
#16 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#17 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 4 (Thread 0x7f8dfeafc700 (LWP 7024)):
#0 0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0
#1 0x00007f8e234764f8 in PyThread_acquire_lock (lock=0x1436240, waitflag=128) at Python/thread_pthread.h:349
#2 0x00007f8e23445814 in PyEval_RestoreThread (tstate=0x7f8df00ab1e0) at Python/ceval.c:353
#3 0x00007f8e23469936 in PyGILState_Ensure () at Python/pystate.c:610
#4 0x0000000041091835 in ?? ()
#5 0x00007f8df0000c20 in ?? ()
#6 0x000000004183504d in ?? ()
#7 0x00007f8df0000c20 in ?? ()
#8 0x00007f8e0584dea0 in ?? ()
#9 0x00007f8e0584dea0 in ?? ()
#10 0x00007f8dfeafb980 in ?? ()
#11 0x00007f8dfeafb8d0 in ?? ()
#12 0x0000000000000000 in ?? ()

Thread 3 (Thread 0x7f8dfe172700 (LWP 30936)):
#0 0x00007f8e2e24101d in read () from /lib64/libpthread.so.0
#1 0x0000000000491976 in ?? ()
#2
#3 0x00007f8e2dcb92d5 in raise () from /lib64/libc.so.6
#4 0x00007f8e2dcbabeb in abort () from /lib64/libc.so.6
#5 0x00000000005caa8f in ?? ()
#6 0x00000000005cabb6 in ?? ()
#7 0x000000000058dcf2 in ?? ()
#8 0x000000000058f368 in mono_thread_attach ()
#9 0x0000000000416588 in mono_jit_thread_attach ()
#10 0x0000000041356750 in ?? ()
#11 0x00007f8dec001590 in ?? ()
#12 0x000000000283b5f0 in ?? ()
#13 0x000000000319e3f8 in ?? ()
#14 0x000000000287f500 in ?? ()
#15 0x000000000319e3f8 in ?? ()
#16 0x00007f8e233e852b in PyObject_GenericGetAttr (obj=0x319e3f8, name=0x2262768) at Objects/object.c:1424
#17 0x00007f8e23447c40 in PyEval_EvalFrameEx (f=0x7f8dec0013f0, throwflag=) at Python/ceval.c:2082
#18 0x00007f8e2344bfe9 in PyEval_EvalCodeEx (co=0x30d78a0, globals=, locals=, args=0x7f8dec0b6168, argcount=1, kws=0x0, kwcount=0, defs=0x0, defcount=0, closure=0x0) at Python/ceval.c:3000
#19 0x00007f8e233d0c5d in function_call (func=0x30d7ed8, arg=0x7f8dec0b6150, kw=0x0) at Objects/funcobject.c:524
#20 0x00007f8e233a20a8 in PyObject_Call (func=0x30d7ed8, arg=0x7f8dec0b6150, kw=0x0) at Objects/abstract.c:2492
#21 0x00007f8e233b2eb0 in instancemethod_call (func=0x30d7ed8, arg=0x7f8dec0b6150, kw=0x0) at Objects/classobject.c:2579
#22 0x00007f8e233a20a8 in PyObject_Call (func=0x3fb7dc0, arg=0x7f8e230fa050, kw=0x0) at Objects/abstract.c:2492
#23 0x00007f8e23444dd6 in PyEval_CallObjectWithKeywords (func=0x3fb7dc0, arg=0x7f8e230fa050, kw=0x0) at Python/ceval.c:3619
#24 0x00007f8e130324a2 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/sip.so
#25 0x00007f8e12c4bff7 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#26 0x00007f8e12c81882 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#27 0x00007f8e2140950f in ?? () from ./libQtCore.so.4
#28 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#29 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 2 (Thread 0x7f8de7fff700 (LWP 30939)):
#0 0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0
#1 0x00000000005c2808 in mono_sem_wait ()
#2 0x00000000005bd1e9 in ?? ()
#3 0x00000000005dd04e in ?? ()
#4 0x00007f8e2e23ab31 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f8e2dd63d2d in clone () from /lib64/libc.so.6

Thread 1 (Thread 0x7f8e2ecd8760 (LWP 7006)):
#0 0x00007f8e2e240560 in sem_wait () from /lib64/libpthread.so.0
#1 0x00007f8e234764f8 in PyThread_acquire_lock (lock=0x1436240, waitflag=128) at Python/thread_pthread.h:349
#2 0x00007f8e23445814 in PyEval_RestoreThread (tstate=0x12f8b20) at Python/ceval.c:353
#3 0x00007f8e23469936 in PyGILState_Ensure () at Python/pystate.c:610
#4 0x00007f8e12d68f2e in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#5 0x00007f8e12d69075 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#6 0x00007f8e21532e20 in QMetaObject::activate(QObject*, QMetaObject const*, int, void**) () from ./libQtCore.so.4
#7 0x00007f8e12c7ceef in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#8 0x00007f8e2152e4b4 in QObject::event(QEvent*) () from ./libQtCore.so.4
#9 0x00007f8e12c7ce82 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtCore.so
#10 0x00007f8e21a7ef6f in QApplicationPrivate::notify_helper(QObject*, QEvent*) () from ./libQtGui.so.4
#11 0x00007f8e21a855d0 in QApplication::notify(QObject*, QEvent*) () from ./libQtGui.so.4
#12 0x00007f8e13b97cc4 in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtGui.so
#13 0x00007f8e2151ab64 in QCoreApplication::notifyInternal(QObject*, QEvent*) () from ./libQtCore.so.4
#14 0x00007f8e2154de9d in ?? () from ./libQtCore.so.4
#15 0x00007f8e2154ec00 in QEventDispatcherUNIX::processEvents(QFlagsQEventLoop::ProcessEventsFlag) () from ./libQtCore.so.4
#16 0x00007f8e21b2c526 in ?? () from ./libQtGui.so.4
#17 0x00007f8e21519bc5 in QEventLoop::processEvents(QFlagsQEventLoop::ProcessEventsFlag) () from ./libQtCore.so.4
#18 0x00007f8e21519f98 in QEventLoop::exec(QFlagsQEventLoop::ProcessEventsFlag) () from ./libQtCore.so.4
#19 0x00007f8e215200f4 in QCoreApplication::exec() () from ./libQtCore.so.4
#20 0x00007f8e13b988fd in ?? () from /lumalocal/Deadline6/client/bin/python/lib/python2.6/site-packages/PyQt4/QtGui.so
#21 0x00007f8e2344a29d in call_function (oparg=, pp_stack=) at Python/ceval.c:3750
#22 PyEval_EvalFrameEx (f=0x38e2810, throwflag=) at Python/ceval.c:2412
#23 0x00007f8e2344b4b4 in fast_function (nk=, na=, n=, pp_stack=, func=) at Python/ceval.c:3836
#24 call_function (oparg=, pp_stack=) at Python/ceval.c:3771
#25 PyEval_EvalFrameEx (f=0x342c030, throwflag=) at Python/ceval.c:2412
#26 0x00007f8e2344b4b4 in fast_function (nk=, na=, n=, pp_stack=, func=) at Python/ceval.c:3836
#27 call_function (oparg=, pp_stack=) at Python/ceval.c:3771
#28 PyEval_EvalFrameEx (f=0x1761ec0, throwflag=) at Python/ceval.c:2412
#29 0x00007f8e2344bfe9 in PyEval_EvalCodeEx (co=0x1404210, globals=, locals=, args=0x0, argcount=0, kws=0x0, kwcount=0, defs=0x0, defcount=0, closure=0x0) at Python/ceval.c:3000
#30 0x00007f8e2344c162 in PyEval_EvalCode (co=0x1436240, globals=0x80, locals=0x0) at Python/ceval.c:541
#31 0x00007f8e2345e710 in PyImport_ExecCodeModuleEx (name=0x21da460 “MainWindow”, co=0x1404210, pathname=0x0) at Python/import.c:677
#32 0x00000000413624c3 in ?? ()
#33 0x0000000001079830 in ?? ()
#34 0x0000000000000040 in ?? ()
#35 0x0000000001079830 in ?? ()
#36 0x0000000000000000 in ?? ()

=================================================================
Got a SIGABRT while executing native code. This usually indicates
a fatal error in the mono runtime or one of the native libraries
used by your application.
=================================================================[/code]

Thanks for the report. We’ve logged it as a bug. It seems like it’s a very rare issue. That’s good on one hand because if we don’t track it down for release, it’s not a showstopper, but on the other hand, it will make it difficult to track down. :slight_smile:

Cheers,

  • Ryan

Seems like it just takes a lot longer for it to occur (somewhere in the 24-48 hour range) than it used to, but it’s still very reliable. It’s rare because you sort of have to be trying if you want to reproduce it, but I’m a little worried it may turn out to exist in the Slave as well, and the Slave does more autonomous writing to the database than the Monitor does…

We have done some digging on this issue already, and it looks like it’s a potential issue with using a ThreadPool. I checked our code, and the Monitor is the only application that uses the ThreadPool (mainly to execute right-click menu commands). The slave doesn’t use the Thread pool, meaning that this crash shouldn’t happen with the slaves (assuming it is a ThreadPool problem).

We’ll be running some tests, and we’ll post back here once we have more info.

Cheers,

  • Ryan
Privacy | Site terms | Cookie preferences