AWS Thinkbox Discussion Forums

Mongo Imploded

[code]4.171:49503 #9871 (60 connections now open)
Fri Dec 14 12:55:20 [initandlisten] connection accepted from 192.168.94.22:52595 #9872 (61 connections now open)
Fri Dec 14 12:55:33 [conn9842] update deadlinedb.SlaveReports query: { _id: “render-02” } update: { $push: { Errs: { Type: 1, Date: new Date(1355518532423), Slave: “RENDER-02”, Task: 58, Title: “No 64 bit 3dsmax 2013 render executable found in the semicolon separated list “C:\Program Files\Autodesk\3ds Max 2013\3dsmax.exe;C:\Program Files (x86…”, Ver: “v6.0.0.49513 R”, JobName: “Tmo_BOX_0010_A01.01”, JobUser: “gpaquin”, JobMach: “PONGOLOID”, JobDate: new Date(1355516473007), Plugin: “3dsmax”, Frames: “58-58”, TaskTime: 0, LogErr: “”, ErrType: “a”, Stack: " at Deadline.Plugins.DeadlinePlugin.FailRender(String message)
at Python.Runtime.Dispatcher.TrueDispatch(ArrayList args)
at Python.Runtime.D…”, File: “50cb92458712ac018843da8b.bz2”, RamPeak: 1046900736, RamPeakPer: 25, RamAvg: 1046900736, RamAvgPer: 25, CpuPeak: 0, CpuUtil: 0 } }, $inc: { ErrorEntryCount: 1 } } idhack:1 nmoved:1 nupdated:1 keyUpdates:0 locks(micros) w:97229 109ms
Fri Dec 14 12:55:44 [conn9836] info DFM::findAll(): extent 0:45000 was empty, skipping ahead. ns:deadlinedb.Jobs
Fri Dec 14 12:55:58 [conn9842] update deadlinedb.JobReports query: { _id: “50cb8a391ec44c1cb80bcc90” } update: { $push: { Reports: { Type: 1, Date: new Date(1355518557792), Slave: “RENDER-02”, Task: 61, Title: “No 64 bit 3dsmax 2013 render executable found in the semicolon separated list “C:\Program Files\Autodesk\3ds Max 2013\3dsmax.exe;C:\Program Files (x86…”, Ver: “v6.0.0.49513 R”, JobName: “Tmo_BOX_0010_A01.01”, JobUser: “gpaquin”, JobMach: “PONGOLOID”, JobDate: new Date(1355516473007), Plugin: “3dsmax”, Frames: “61-61”, TaskTime: 0, LogErr: “”, ErrType: “a”, Stack: " at Deadline.Plugins.DeadlinePlugin.FailRender(String message)
at Python.Runtime.Dispatcher.TrueDispatch(ArrayList args)
at Python.Runtime.D…”, File: “50cb925e8712ac018843da94.bz2”, RamPeak: 1044381696, RamPeakPer: 25, RamAvg: 1044381696, RamAvgPer: 25, CpuPeak: 3, CpuUtil: 3 } } } idhack:1 nmoved:1 nupdated:1 keyUpdates:0 locks(micros) w:137576 140ms
Fri Dec 14 12:56:42 [conn9836] update deadlinedb.JobReports query: { _id: “50cb8a391ec44c1cb80bcc90” } update: { $push: { Reports: { Type: 1, Date: new Date(1355518602386), Slave: “RENDER-05”, Task: 58, Title: “No 64 bit 3dsmax 2013 render executable found in the semicolon separated list “C:\Program Files\Autodesk\3ds Max 2013\3dsmax.exe;C:\Program Files (x86…”, Ver: “v6.0.0.49513 R”, JobName: “Tmo_BOX_0010_A01.01”, JobUser: “gpaquin”, JobMach: “PONGOLOID”, JobDate: new Date(1355516473007), Plugin: “3dsmax”, Frames: “58-58”, TaskTime: 0, LogErr: “”, ErrType: “a”, Stack: " at Deadline.Plugins.DeadlinePlugin.FailRender(String message)
at Python.Runtime.Dispatcher.TrueDispatch(ArrayList args)
at Python.Runtime.D…”, File: “50cb928a887c6d07b0d36eca.bz2”, RamPeak: 1389072384, RamPeakPer: 33, RamAvg: 1389072384, RamAvgPer: 33, CpuPeak: 0, CpuUtil: 0 } } } idhack:1 nmoved:1 nupdated:1 keyUpdates:0 locks(micros) w:107584 109ms
Fri Dec 14 12:57:28 [initandlisten] connection accepted from 192.168.94.152:59751 #9873 (62 connections now open)
Fri Dec 14 12:59:42 [initandlisten] connection accepted from 192.168.94.35:49588 #9874 (63 connections now open)
Fri Dec 14 12:59:53 [initandlisten] connection accepted from 192.168.94.157:61335 #9875 (64 connections now open)
Fri Dec 14 13:00:04 [conn9873] update deadlinedb.JobReports query: { _id: “50cb8a391ec44c1cb80bcc90” } update: { $push: { Reports: { Type: 1, Date: new Date(1355518804136), Slave: “RENDER-02”, Task: 55, Title: “No 64 bit 3dsmax 2013 render executable found in the semicolon separated list “C:\Program Files\Autodesk\3ds Max 2013\3dsmax.exe;C:\Program Files (x86…”, Ver: “v6.0.0.49513 R”, JobName: “Tmo_BOX_0010_A01.01”, JobUser: “gpaquin”, JobMach: “PONGOLOID”, JobDate: new Date(1355516473007), Plugin: “3dsmax”, Frames: “55-55”, TaskTime: 0, LogErr: “”, ErrType: “a”, Stack: " at Deadline.Plugins.DeadlinePlugin.FailRender(String message)
at Python.Runtime.Dispatcher.TrueDispatch(ArrayList args)
at Python.Runtime.D…”, File: “50cb93548712ac018843dae6.bz2”, RamPeak: 1061965824, RamPeakPer: 25, RamAvg: 1061965824, RamAvgPer: 25, CpuPeak: 0, CpuUtil: 0 } } } idhack:1 nmoved:1 nupdated:1 keyUpdates:0 locks(micros) w:148198 156ms
Fri Dec 14 13:00:31 [FileAllocator] allocating new datafile C:/mongo/data/deadlinedb.6, filling with zeroes…
Fri Dec 14 13:00:31 [conn9825] update deadlinedb.JobReports query: { _id: “50cb8a391ec44c1cb80bcc90” } update: { $push: { Reports: { Type: 0, Date: new Date(1355518831132), Slave: “RENDER-I7-02”, Task: 57, Title: “Render Log”, Ver: “v6.0.0.49513 R”, JobName: “Tmo_BOX_0010_A01.01”, JobUser: “gpaquin”, JobMach: “PONGOLOID”, JobDate: new Date(1355516473007), Plugin: “3dsmax”, Frames: “57-57”, TaskTime: 0, LogErr: “”, ErrType: “”, Stack: “”, File: “50cb936f05fe17095c7b85bb.bz2”, RamPeak: -1, RamPeakPer: -1, RamAvg: -1, RamAvgPer: -1, CpuPeak: -1, CpuUtil: -1 } } } idhack:1 nmoved:1 nupdated:1 keyUpdates:0 locks(micros) w:117560 124ms
Fri Dec 14 13:00:31 [initandlisten] connection accepted from 192.168.94.34:49588 #9876 (65 connections now open)
Fri Dec 14 13:00:32 [initandlisten] connection accepted from 192.168.94.172:49569 #9877 (66 connections now open)
Fri Dec 14 13:00:32 [initandlisten] connection accepted from 192.168.94.172:49570 #9878 (67 connections now open)
Fri Dec 14 13:00:32 [FileAllocator] done allocating datafile C:/mongo/data/deadlinedb.6, size: 511MB, took 1.693 secs
Fri Dec 14 13:00:47 [conn9833] update deadlinedb.JobReports query: { _id: “50cb8a391ec44c1cb80bcc90” } update: { $push: { Reports: { Type: 1, Date: new Date(1355518847662), Slave: “RENDER-08”, Task: 69, Title: “No 64 bit 3dsmax 2013 render executable found in the semicolon separated list “C:\Program Files\Autodesk\3ds Max 2013\3dsmax.exe;C:\Program Files (x86…”, Ver: “v6.0.0.49513 R”, JobName: “Tmo_BOX_0010_A01.01”, JobUser: “gpaquin”, JobMach: “PONGOLOID”, JobDate: new Date(1355516473007), Plugin: “3dsmax”, Frames: “69-69”, TaskTime: 0, LogErr: “”, ErrType: “a”, Stack: " at Deadline.Plugins.DeadlinePlugin.FailRender(String message)
at Python.Runtime.Dispatcher.TrueDispatch(ArrayList args)
at Python.Runtime.D…”, File: “50cb937f416d9b03948a5cc4.bz2”, RamPeak: 1239052288, RamPeakPer: 29, RamAvg: 1239052288, RamAvgPer: 29, CpuPeak: 0, CpuUtil: 0 } } } idhack:1 nmoved:1 nupdated:1 keyUpdates:0 locks(micros) w:234890 234ms
Fri Dec 14 13:01:22 [initandlisten] connection accepted from 192.168.94.174:49596 #9879 (68 connections now open)
Fri Dec 14 13:01:38 [conn9820] end connection 192.168.94.173:49388 (67 connections now open)
Fri Dec 14 13:01:39 [conn9822] end connection 192.168.94.171:49360 (66 connections now open)
Fri Dec 14 13:01:46 [initandlisten] connection accepted from 192.168.94.175:49604 #9880 (67 connections now open)
Fri Dec 14 13:02:00 [conn9841] end connection 192.168.94.155:65176 (66 connections now open)
Fri Dec 14 13:02:28 [initandlisten] connection accepted from 192.168.94.29:49587 #9881 (67 connections now open)
Fri Dec 14 13:03:15 [conn9865] end connection 192.168.94.159:59821 (66 connections now open)
Fri Dec 14 13:03:19 [initandlisten] connection accepted from 192.168.94.171:49593 #9882 (67 connections now open)
Fri Dec 14 13:03:20 [initandlisten] connection accepted from 192.168.94.173:49621 #9883 (68 connections now open)
Fri Dec 14 13:03:35 [conn9814] end connection 192.168.94.100:18414 (67 connections now open)
Fri Dec 14 13:03:35 [initandlisten] connection accepted from 192.168.94.100:40387 #9884 (68 connections now open)
Fri Dec 14 13:04:51 [conn9815] end connection 192.168.94.100:50331 (67 connections now open)
Fri Dec 14 13:04:51 [initandlisten] connection accepted from 192.168.94.100:15565 #9885 (68 connections now open)
Fri Dec 14 13:04:53 [initandlisten] connection accepted from 192.168.94.16:49631 #9886 (69 connections now open)
Fri Dec 14 13:05:08 [conn9816] end connection 192.168.94.37:53955 (68 connections now open)
Fri Dec 14 13:05:08 [initandlisten] connection accepted from 192.168.94.37:54350 #9887 (70 connections now open)
Fri Dec 14 13:06:53 [conn9840] info DFM::findAll(): extent 0:45000 was empty, skipping ahead. ns:deadlinedb.Jobs
Fri Dec 14 13:07:04 [initandlisten] connection accepted from 192.168.94.155:65206 #9888 (70 connections now open)
Fri Dec 14 13:08:47 [conn9847] end connection 192.168.94.156:49955 (69 connections now open)
Fri Dec 14 13:09:25 [conn9819] end connection 192.168.94.35:49387 (68 connections now open)
Fri Dec 14 13:10:00 [conn9823] end connection 192.168.94.175:49391 (67 connections now open)
Fri Dec 14 13:10:01 [conn9821] end connection 192.168.94.33:49388 (66 connections now open)
Fri Dec 14 13:10:01 [initandlisten] connection accepted from 192.168.94.33:49688 #9889 (67 connections now open)
Fri Dec 14 13:10:01 [initandlisten] connection accepted from 192.168.94.33:49689 #9890 (68 connections now open)
Fri Dec 14 13:10:02 [conn9845] end connection 192.168.94.157:61320 (67 connections now open)
Fri Dec 14 13:10:34 [conn9877] end connection 192.168.94.172:49569 (66 connections now open)
Fri Dec 14 13:10:35 [conn9830] update deadlinedb.JobReports query: { _id: “50cb8a391ec44c1cb80bcc90” } update: { $push: { Reports: { Type: 1, Date: new Date(1355519435279), Slave: “RENDER-02”, Task: 85, Title: “No 64 bit 3dsmax 2013 render executable found in the semicolon separated list “C:\Program Files\Autodesk\3ds Max 2013\3dsmax.exe;C:\Program Files (x86…”, Ver: “v6.0.0.49513 R”, JobName: “Tmo_BOX_0010_A01.01”, JobUser: “gpaquin”, JobMach: “PONGOLOID”, JobDate: new Date(1355516473007), Plugin: “3dsmax”, Frames: “85-85”, TaskTime: 0, LogErr: “”, ErrType: “a”, Stack: " at Deadline.Plugins.DeadlinePlugin.FailRender(String message)
at Python.Runtime.Dispatcher.TrueDispatch(ArrayList args)
at Python.Runtime.D…”, File: “50cb95cb8712ac018843dbc2.bz2”, RamPeak: 1084694528, RamPeakPer: 26, RamAvg: 1084694528, RamAvgPer: 26, CpuPeak: 0, CpuUtil: 0 } } } idhack:1 nmoved:1 nupdated:1 keyUpdates:0 locks(micros) w:100829 109ms
Fri Dec 14 13:10:36 [conn9849] end connection 192.168.94.34:49464 (65 connections now open)
Fri Dec 14 13:10:54 [initandlisten] connection accepted from 192.168.94.100:15781 #9891 (66 connections now open)
Fri Dec 14 13:11:27 [conn9824] end connection 192.168.94.174:49428 (65 connections now open)
Fri Dec 14 13:12:32 [conn9863] end connection 192.168.94.29:49496 (64 connections now open)
Fri Dec 14 13:13:10 [conn9836] info DFM::findAll(): extent 0:11b000 was empty, skipping ahead. ns:deadlinedb.SlaveReports
Fri Dec 14 13:13:29 [conn9852] end connection 192.168.94.173:49502 (63 connections now open)
Fri Dec 14 13:14:04 [conn9873] end connection 192.168.94.152:59751 (62 connections now open)
Fri Dec 14 13:14:19 [initandlisten] connection accepted from 192.168.94.34:49729 #9892 (63 connections now open)
Fri Dec 14 13:14:34 [conn9825] end connection 192.168.94.172:49414 (62 connections now open)
Fri Dec 14 13:15:18 [initandlisten] connection accepted from 192.168.94.174:49742 #9893 (63 connections now open)
Fri Dec 14 13:15:44 [conn9891] info DFM::findAll(): extent 0:45000 was empty, skipping ahead. ns:deadlinedb.Jobs
Fri Dec 14 13:16:23 [conn9827] end connection 192.168.94.154:63865 (62 connections now open)
Fri Dec 14 13:16:23 [initandlisten] connection accepted from 192.168.94.154:64242 #9894 (63 connections now open)
Fri Dec 14 13:16:25 [conn9829] end connection 192.168.94.154:63883 (62 connections now open)
Fri Dec 14 13:16:27 [conn9831] end connection 192.168.94.158:53204 (61 connections now open)
Fri Dec 14 13:16:27 [initandlisten] connection accepted from 192.168.94.158:53271 #9895 (62 connections now open)
Fri Dec 14 13:16:27 [conn9830] end connection 192.168.94.152:59698 (61 connections now open)
Fri Dec 14 13:16:27 [conn9826] end connection 192.168.94.159:59780 (60 connections now open)
Fri Dec 14 13:16:28 [initandlisten] connection accepted from 192.168.94.159:59834 #9896 (61 connections now open)
Fri Dec 14 13:16:28 [conn9828] end connection 192.168.94.152:59697 (60 connections now open)
Fri Dec 14 13:16:29 [conn9833] end connection 192.168.94.158:53205 (59 connections now open)
Fri Dec 14 13:16:30 [conn9835] end connection 192.168.94.157:61267 (58 connections now open)
Fri Dec 14 13:16:30 [initandlisten] connection accepted from 192.168.94.157:61345 #9897 (59 connections now open)
Fri Dec 14 13:16:30 [conn9832] end connection 192.168.94.159:59786 (58 connections now open)
Fri Dec 14 13:16:31 [conn9836] end connection 192.168.94.155:65140 (57 connections now open)
Fri Dec 14 13:16:32 [conn9837] end connection 192.168.94.157:61284 (56 connections now open)
Fri Dec 14 13:16:32 [initandlisten] connection accepted from 192.168.94.152:59759 #9898 (57 connections now open)
Fri Dec 14 13:16:33 [conn9834] end connection 192.168.94.155:65139 (56 connections now open)
Fri Dec 14 13:16:35 [conn9839] end connection 192.168.94.156:49911 (55 connections now open)
Fri Dec 14 13:16:35 [conn9838] end connection 192.168.94.156:49901 (54 connections now open)
Fri Dec 14 13:16:35 [initandlisten] connection accepted from 192.168.94.156:49980 #9899 (55 connections now open)
Fri Dec 14 13:16:36 [initandlisten] connection accepted from 192.168.94.159:59835 #9900 (56 connections now open)
Fri Dec 14 13:16:38 [conn9840] end connection 192.168.94.158:53243 (55 connections now open)
Fri Dec 14 13:16:38 [initandlisten] connection accepted from 192.168.94.158:53272 #9901 (57 connections now open)
Fri Dec 14 13:16:39 [initandlisten] connection accepted from 192.168.94.155:65209 #9902 (57 connections now open)
Fri Dec 14 13:16:44 [conn9842] end connection 192.168.94.152:59734 (56 connections now open)
Fri Dec 14 13:16:44 [initandlisten] connection accepted from 192.168.94.152:59760 #9903 (57 connections now open)
Fri Dec 14 13:16:44 [initandlisten] connection accepted from 192.168.94.152:59761 #9904 (58 connections now open)
Fri Dec 14 13:16:45 [conn9843] end connection 192.168.94.159:59804 (57 connections now open)
Fri Dec 14 13:16:49 [initandlisten] connection accepted from 192.168.94.156:49981 #9905 (58 connections now open)
Fri Dec 14 13:16:49 [initandlisten] connection accepted from 192.168.94.157:61346 #9906 (59 connections now open)
Fri Dec 14 13:16:49 [initandlisten] connection accepted from 192.168.94.158:53273 #9907 (60 connections now open)
Fri Dec 14 13:16:51 [conn9844] end connection 192.168.94.153:50346 (59 connections now open)
Fri Dec 14 13:16:54 [initandlisten] connection accepted from 192.168.94.159:59837 #9908 (60 connections now open)
Fri Dec 14 13:16:55 [initandlisten] connection accepted from 192.168.94.153:50764 #9909 (61 connections now open)
Fri Dec 14 13:16:57 [conn9848] end connection 192.168.94.153:50400 (60 connections now open)
Fri Dec 14 13:16:58 [conn9846] end connection 192.168.94.153:50357 (59 connections now open)
Fri Dec 14 13:16:58 [initandlisten] connection accepted from 192.168.94.153:50765 #9910 (61 connections now open)
Fri Dec 14 13:17:34 [initandlisten] connection accepted from 192.168.94.153:50775 #9911 (61 connections now open)
Fri Dec 14 13:17:41 [initandlisten] connection accepted from 192.168.94.35:49768 #9912 (62 connections now open)
Fri Dec 14 13:17:44 [initandlisten] connection accepted from 192.168.94.154:64262 #9913 (63 connections now open)
Fri Dec 14 13:17:57 [initandlisten] connection accepted from 192.168.94.156:49983 #9914 (64 connections now open)
Fri Dec 14 13:18:05 [conn9905] info DFM::findAll(): extent 0:11b000 was empty, skipping ahead. ns:deadlinedb.SlaveReports
Fri Dec 14 13:18:34 [conn9850] end connection 192.168.94.38:50772 (63 connections now open)
Fri Dec 14 13:18:34 [initandlisten] connection accepted from 192.168.94.38:50909 #9915 (65 connections now open)
Fri Dec 14 13:18:54 [conn9851] end connection 192.168.94.16:49468 (63 connections now open)
Fri Dec 14 13:19:27 [conn9911] info DFM::findAll(): extent 0:11b000 was empty, skipping ahead. ns:deadlinedb.SlaveReports
Fri Dec 14 13:19:48 [initandlisten] connection accepted from 192.168.94.16:49779 #9916 (64 connections now open)
Fri Dec 14 13:20:05 [conn9889] end connection 192.168.94.33:49688 (63 connections now open)
Fri Dec 14 13:21:02 [conn9885] end connection 192.168.94.100:15565 (62 connections now open)
Fri Dec 14 13:21:36 [conn9853] end connection 192.168.94.22:52581 (61 connections now open)
Fri Dec 14 13:21:36 [initandlisten] connection accepted from 192.168.94.22:52716 #9917 (63 connections now open)
Fri Dec 14 13:21:40 [conn9854] end connection 192.168.94.171:49475 (61 connections now open)
Fri Dec 14 13:21:41 [conn9855] info DFM::findAll(): extent 0:11b000 was empty, skipping ahead. ns:deadlinedb.SlaveReports
Fri Dec 14 13:21:45 [FileAllocator] allocating new datafile C:/mongo/data/deadlinedb.7, filling with zeroes…
Fri Dec 14 13:21:47 [FileAllocator] done allocating datafile C:/mongo/data/deadlinedb.7, size: 511MB, took 1.709 secs
Fri Dec 14 13:21:54 [conn9888] update deadlinedb.JobReports query: { _id: “50cb8a391ec44c1cb80bcc90” } update: { $push: { Reports: { Type: 1, Date: new Date(1355520114122), Slave: “RENDER-05”, Task: 98, Title: “No 64 bit 3dsmax 2013 render executable found in the semicolon separated list “C:\Program Files\Autodesk\3ds Max 2013\3dsmax.exe;C:\Program Files (x86…”, Ver: “v6.0.0.49513 R”, JobName: “Tmo_BOX_0010_A01.01”, JobUser: “gpaquin”, JobMach: “PONGOLOID”, JobDate: new Date(1355516473007), Plugin: “3dsmax”, Frames: “98-98”, TaskTime: 0, LogErr: “”, ErrType: “a”, Stack: " at Deadline.Plugins.DeadlinePlugin.FailRender(String message)
at Python.Runtime.Dispatcher.TrueDispatch(ArrayList args)
at Python.Runtime.D…”, File: “50cb9872887c6d07b0d37108.bz2”, RamPeak: 1277558784, RamPeakPer: 30, RamAvg: 1277558784, RamAvgPer: 30, CpuPeak: 0, CpuUtil: 0 } } } idhack:1 nmoved:1 nupdated:1 keyUpdates:0 locks(micros) w:111289 109ms
Fri Dec 14 13:21:59 [conn9856] end connection 192.168.94.101:53741 (60 connections now open)
Fri Dec 14 13:21:59 [initandlisten] connection accepted from 192.168.94.101:54568 #9918 (61 connections now open)
Fri Dec 14 13:22:01 [conn9855] end connection 192.168.94.155:65192 (60 connections now open)
Fri Dec 14 13:22:06 [initandlisten] connection accepted from 192.168.94.155:65212 #9919 (61 connections now open)
Fri Dec 14 13:22:11 [conn9857] end connection 192.168.94.154:63926 (60 connections now open)
Fri Dec 14 13:22:18 [conn9858] end connection 192.168.94.22:52582 (59 connections now open)
Fri Dec 14 13:22:28 [conn9859] end connection 192.168.94.156:49966 (58 connections now open)
Fri Dec 14 13:22:36 [conn9900] info DFM::findAll(): extent 0:11b000 was empty, skipping ahead. ns:deadlinedb.SlaveReports
Fri Dec 14 13:22:40 [conn9860] end connection 192.168.94.35:49519 (57 connections now open)
Fri Dec 14 13:22:40 [initandlisten] connection accepted from 192.168.94.35:49820 #9920 (58 connections now open)
Fri Dec 14 13:22:42 [conn9861] end connection 192.168.94.33:49514 (57 connections now open)
Fri Dec 14 13:22:42 [initandlisten] connection accepted from 192.168.94.33:49813 #9921 (58 connections now open)
Fri Dec 14 13:22:45 [conn9862] end connection 192.168.94.29:49493 (57 connections now open)
Fri Dec 14 13:22:45 [initandlisten] connection accepted from 192.168.94.29:49783 #9922 (58 connections now open)
Fri Dec 14 13:22:47 [initandlisten] connection accepted from 192.168.94.154:64330 #9923 (59 connections now open)
Fri Dec 14 13:22:47 [initandlisten] connection accepted from 192.168.94.33:49815 #9924 (60 connections now open)
Fri Dec 14 13:22:54 [conn9864] end connection 192.168.94.34:49513 (59 connections now open)
Fri Dec 14 13:22:54 [initandlisten] connection accepted from 192.168.94.34:49812 #9925 (60 connections now open)
Fri Dec 14 13:23:16 [initandlisten] connection accepted from 192.168.94.22:52722 #9926 (61 connections now open)
Fri Dec 14 13:23:19 [conn9866] end connection 192.168.94.174:49517 (60 connections now open)
Fri Dec 14 13:23:19 [initandlisten] connection accepted from 192.168.94.174:49823 #9927 (61 connections now open)
Fri Dec 14 13:23:22 [conn9867] end connection 192.168.94.173:49521 (60 connections now open)
Fri Dec 14 13:23:22 [initandlisten] connection accepted from 192.168.94.173:49817 #9928 (61 connections now open)
Fri Dec 14 13:23:22 [conn9868] end connection 192.168.94.175:49519 (60 connections now open)
Fri Dec 14 13:23:22 [initandlisten] connection accepted from 192.168.94.175:49826 #9929 (61 connections now open)
Fri Dec 14 13:23:26 [conn9869] end connection 192.168.94.16:49516 (60 connections now open)
Fri Dec 14 13:23:26 [initandlisten] connection accepted from 192.168.94.16:49828 #9930 (61 connections now open)
Fri Dec 14 13:23:34 [conn9870] end connection 192.168.94.172:49500 (60 connections now open)
Fri Dec 14 13:23:34 [initandlisten] connection accepted from 192.168.94.172:49796 #9931 (61 connections now open)
Fri Dec 14 13:24:26 [conn9871] end connection 192.168.94.171:49503 (60 connections now open)
Fri Dec 14 13:24:26 [initandlisten] connection accepted from 192.168.94.171:49797 #9932 (61 connections now open)
Fri Dec 14 13:24:30 [conn9919] info DFM::findAll(): extent 0:11b000 was empty, skipping ahead. ns:deadlinedb.SlaveReports
Fri Dec 14 13:25:22 [conn9872] end connection 192.168.94.22:52595 (60 connections now open)
Fri Dec 14 13:25:22 [initandlisten] connection accepted from 192.168.94.22:52728 #9933 (61 connections now open)
Fri Dec 14 13:25:28 [conn9879] end connection 192.168.94.174:49596 (60 connections now open)
Fri Dec 14 13:26:38 [conn9904] info DFM::findAll(): extent 0:11b000 was empty, skipping ahead. ns:deadlinedb.SlaveReports
Fri Dec 14 13:27:35 [initandlisten] connection accepted from 192.168.94.172:49836 #9934 (61 connections now open)
Fri Dec 14 13:27:38 [conn9875] info DFM::findAll(): extent 0:11b000 was empty, skipping ahead. ns:deadlinedb.SlaveReports
Fri Dec 14 13:27:52 [conn9881] update deadlinedb.Tasks query: { _id: “50cb8a391ec44c1cb80bcc90” } update: { $set: { Tasks.109.Stat: 4, Tasks.109.Slave: “RENDER-I7-09”, Tasks.109.WtgStrt: true, Tasks.109.Start: new Date(1355520472860) } } idhack:1 nmoved:1 nupdated:1 keyUpdates:0 109ms
Fri Dec 14 13:27:52 [conn9881] command deadlinedb.$cmd command: { findAndModify: “Tasks”, query: { _id: “50cb8a391ec44c1cb80bcc90” }, sort: {}, update: { $set: { Tasks.109.Stat: 4, Tasks.109.Slave: “RENDER-I7-09”, Tasks.109.WtgStrt: true, Tasks.109.Start: new Date(1355520472860) } } } ntoreturn:1 keyUpdates:0 locks(micros) w:98539 reslen:35718 109ms
Fri Dec 14 13:28:50 [conn9907] MapViewOfFileEx for C:/mongo/data/deadlinedb.7 failed with errno:8 Not enough storage is available to process this command. (file size is 536608768) in MemoryMappedFile::map
Fri Dec 14 13:28:50 [conn9907] deadlinedb.JobReports Fatal Assertion 16166
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907] mongod.exe ???
Fri Dec 14 13:28:51 [conn9907]

***aborting after fassert() failure

Fri Dec 14 13:28:52 [initandlisten] connection accepted from 192.168.94.175:49876 #9935 (62 connections now open)
Fri Dec 14 13:28:53 [initandlisten] connection accepted from 192.168.94.100:11560 #9936 (63 connections now open)
Fri Dec 14 13:28:53 [initandlisten] connection accepted from 192.168.94.22:52761 #9937 (64 connections now open)
Fri Dec 14 13:28:54 [initandlisten] connection accepted from 192.168.94.22:52762 #9938 (65 connections now open)
Fri Dec 14 13:28:54 [initandlisten] connection accepted from 192.168.94.22:52763 #9939 (66 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.22:52764 #9940 (67 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.174:49877 #9941 (68 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.22:52765 #9942 (69 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.172:49850 #9943 (70 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.174:49878 #9944 (71 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.159:59840 #9945 (72 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.33:49875 #9946 (73 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.154:64414 #9947 (74 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.153:50927 #9948 (75 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.35:49881 #9949 (76 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.29:49844 #9950 (77 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.173:49870 #9951 (78 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.171:49840 #9952 (79 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.174:49879 #9953 (80 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.156:49986 #9954 (81 connections now open)
Fri Dec 14 13:28:58 [initandlisten] connection accepted from 192.168.94.34:49873 #9955 (82 connections now open)

***** SERVER RESTARTED *****

Fri Dec 14 16:00:30 Trying to start Windows service ‘MongoDB’
Fri Dec 14 16:00:30 Service running
Fri Dec 14 16:00:30 [initandlisten] MongoDB starting : pid=8540 port=27017 dbpath=C:\mongo\data 32-bit host=SFS-File
Fri Dec 14 16:00:30 [initandlisten]
Fri Dec 14 16:00:30 [initandlisten] ** NOTE: when using MongoDB 32 bit, you are limited to about 2 gigabytes of data
Fri Dec 14 16:00:30 [initandlisten] ** see http://blog.mongodb.org/post/137788967/32-bit-limitations
Fri Dec 14 16:00:30 [initandlisten] ** with --journal, the limit is lower
Fri Dec 14 16:00:30 [initandlisten]
Fri Dec 14 16:00:30 [initandlisten] db version v2.2.0, pdfile version 4.5
Fri Dec 14 16:00:30 [initandlisten] git version: f5e83eae9cfbec7fb7a071321928f00d1b0c5207
Fri Dec 14 16:00:30 [initandlisten] build info: windows sys.getwindowsversion(major=6, minor=0, build=6002, platform=2, service_pack=‘Service Pack 2’) BOOST_LIB_VERSION=1_49
Fri Dec 14 16:00:30 [initandlisten] options: { dbpath: “C:\mongo\data”, logappend: true, logpath: “C:\mongo\data\logs\log.txt”, service: true }
Fri Dec 14 16:00:30 [initandlisten] Unable to check for journal files due to: boost::filesystem::basic_directory_iterator constructor: The system cannot find the path specified: “C:\mongo\data\journal”
Fri Dec 14 16:00:30 [initandlisten] exception in initAndListen: 12596 old lock file, terminating
Fri Dec 14 16:00:30 dbexit:
Fri Dec 14 16:00:30 [initandlisten] shutdown: going to close listening sockets…
Fri Dec 14 16:00:30 [initandlisten] shutdown: going to flush diaglog…
Fri Dec 14 16:00:30 [initandlisten] shutdown: going to close sockets…
Fri Dec 14 16:00:30 [initandlisten] shutdown: waiting for fs preallocator…
Fri Dec 14 16:00:30 [initandlisten] shutdown: closing all files…
Fri Dec 14 16:00:30 [initandlisten] closeAllFiles() finished
Fri Dec 14 16:00:30 dbexit: really exiting now

***** SERVER RESTARTED *****

Fri Dec 14 16:01:08 Trying to start Windows service ‘MongoDB’
Fri Dec 14 16:01:08 Service running
Fri Dec 14 16:01:08 [initandlisten] MongoDB starting : pid=8524 port=27017 dbpath=C:\mongo\data 32-bit host=SFS-File
Fri Dec 14 16:01:08 [initandlisten]
Fri Dec 14 16:01:08 [initandlisten] ** NOTE: when using MongoDB 32 bit, you are limited to about 2 gigabytes of data
Fri Dec 14 16:01:08 [initandlisten] ** see http://blog.mongodb.org/post/137788967/32-bit-limitations
Fri Dec 14 16:01:08 [initandlisten] ** with --journal, the limit is lower
Fri Dec 14 16:01:08 [initandlisten]
Fri Dec 14 16:01:08 [initandlisten] db version v2.2.0, pdfile version 4.5
Fri Dec 14 16:01:08 [initandlisten] git version: f5e83eae9cfbec7fb7a071321928f00d1b0c5207
Fri Dec 14 16:01:08 [initandlisten] build info: windows sys.getwindowsversion(major=6, minor=0, build=6002, platform=2, service_pack=‘Service Pack 2’) BOOST_LIB_VERSION=1_49
Fri Dec 14 16:01:08 [initandlisten] options: { dbpath: “C:\mongo\data”, logappend: true, logpath: “C:\mongo\data\logs\log.txt”, service: true }
Fri Dec 14 16:01:08 [initandlisten] Unable to check for journal files due to: boost::filesystem::basic_directory_iterator constructor: The system cannot find the path specified: “C:\mongo\data\journal”
Fri Dec 14 16:01:08 [initandlisten] exception in initAndListen: 12596 old lock file, terminating
Fri Dec 14 16:01:08 dbexit:
Fri Dec 14 16:01:08 [initandlisten] shutdown: going to close listening sockets…
Fri Dec 14 16:01:08 [initandlisten] shutdown: going to flush diaglog…
Fri Dec 14 16:01:08 [initandlisten] shutdown: going to close sockets…
Fri Dec 14 16:01:08 [initandlisten] shutdown: waiting for fs preallocator…
Fri Dec 14 16:01:08 [initandlisten] shutdown: closing all files…
Fri Dec 14 16:01:08 [initandlisten] closeAllFiles() finished
Fri Dec 14 16:01:08 dbexit: really exiting now
[/code]

I deleted the lock file and it seems to have started up now. But I don’t know why there was a bad lock file or why it shut down ever in the first place.

NEvermind Mongo started but the deadline monitor/slaves can’t connect.

Nevermind it didn’t even start. If I try to start it I get this error:

[code]Microsoft Windows [Version 6.0.6002]
Copyright © 2006 Microsoft Corporation. All rights reserved.

C:\Users\sfsadmin>“c:\mongo\application\bin\mongod.exe” --repair
Fri Dec 14 16:11:38
Fri Dec 14 16:11:38 warning: 32-bit servers don’t have journaling enabled by default. Please use --journal if you want d
urability.
Fri Dec 14 16:11:38
Fri Dec 14 16:11:38 [initandlisten] MongoDB starting : pid=8804 port=27017 dbpath=\data\db\ 32-bit host=SFS-File
Fri Dec 14 16:11:38 [initandlisten]
Fri Dec 14 16:11:38 [initandlisten] ** NOTE: when using MongoDB 32 bit, you are limited to about 2 gigabytes of data
Fri Dec 14 16:11:38 [initandlisten] ** see http://blog.mongodb.org/post/137788967/32-bit-limitations
Fri Dec 14 16:11:38 [initandlisten] ** with --journal, the limit is lower
Fri Dec 14 16:11:38 [initandlisten]
Fri Dec 14 16:11:38 [initandlisten] db version v2.2.0, pdfile version 4.5
Fri Dec 14 16:11:38 [initandlisten] git version: f5e83eae9cfbec7fb7a071321928f00d1b0c5207
Fri Dec 14 16:11:38 [initandlisten] build info: windows sys.getwindowsversion(major=6, minor=0, build=6002, platform=2,
service_pack=‘Service Pack 2’) BOOST_LIB_VERSION=1_49
Fri Dec 14 16:11:38 [initandlisten] options: { repair: true }
Fri Dec 14 16:11:38 [initandlisten] exception in initAndListen: 10296


ERROR: dbpath (\data\db) does not exist.
Create this directory or give existing directory in --dbpath.
See http://dochub.mongodb.org/core/startingandstoppingmongo


, terminating
Fri Dec 14 16:11:38 dbexit:
Fri Dec 14 16:11:38 [initandlisten] shutdown: going to close listening sockets…
Fri Dec 14 16:11:38 [initandlisten] shutdown: going to flush diaglog…
Fri Dec 14 16:11:38 [initandlisten] shutdown: going to close sockets…
Fri Dec 14 16:11:38 [initandlisten] shutdown: waiting for fs preallocator…
Fri Dec 14 16:11:38 [initandlisten] shutdown: closing all files…
Fri Dec 14 16:11:38 [initandlisten] closeAllFiles() finished
Fri Dec 14 16:11:38 dbexit: really exiting now

C:\Users\sfsadmin>[/code]

[code]**** SERVER RESTARTED *****

Fri Dec 14 16:07:57 Trying to start Windows service ‘MongoDB’
Fri Dec 14 16:07:57 Service running
Fri Dec 14 16:07:57 [initandlisten] MongoDB starting : pid=8336 port=27017 dbpath=C:\mongo\data 32-bit host=SFS-File
Fri Dec 14 16:07:57 [initandlisten]
Fri Dec 14 16:07:57 [initandlisten] ** NOTE: when using MongoDB 32 bit, you are limited to about 2 gigabytes of data
Fri Dec 14 16:07:57 [initandlisten] ** see http://blog.mongodb.org/post/137788967/32-bit-limitations
Fri Dec 14 16:07:57 [initandlisten] ** with --journal, the limit is lower
Fri Dec 14 16:07:57 [initandlisten]
Fri Dec 14 16:07:57 [initandlisten] db version v2.2.0, pdfile version 4.5
Fri Dec 14 16:07:57 [initandlisten] git version: f5e83eae9cfbec7fb7a071321928f00d1b0c5207
Fri Dec 14 16:07:57 [initandlisten] build info: windows sys.getwindowsversion(major=6, minor=0, build=6002, platform=2, service_pack=‘Service Pack 2’) BOOST_LIB_VERSION=1_49
Fri Dec 14 16:07:57 [initandlisten] options: { dbpath: “C:\mongo\data”, logappend: true, logpath: “C:\mongo\data\logs\log.txt”, service: true }
Fri Dec 14 16:07:57 [initandlisten] query deadlinedb.system.namespaces query: { options.temp: { $in: [ true, 1 ] } } ntoreturn:0 ntoskip:0 nscanned:45 keyUpdates:0 nreturned:0 reslen:20 140ms
Fri Dec 14 16:07:58 [websvr] admin web console waiting for connections on port 28017
Fri Dec 14 16:07:58 [initandlisten] waiting for connections on port 27017
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.33:56212 #1 (1 connection now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.157:55792 #2 (2 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.100:7733 #3 (3 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.100:7735 #4 (4 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.100:7736 #5 (5 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.100:7737 #6 (6 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.100:7738 #7 (7 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.152:54244 #8 (8 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.34:56134 #9 (9 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.154:52746 #10 (10 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.156:60770 #11 (11 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.158:64105 #12 (12 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.158:64106 #13 (13 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.156:60769 #14 (14 connections now open)
Fri Dec 14 16:07:58 [conn1] MapViewOfFileEx for C:/mongo/data/deadlinedb.7 failed with errno:8 Not enough storage is available to process this command. (file size is 536608768) in MemoryMappedFile::map
Fri Dec 14 16:07:58 [conn1] Fatal Assertion 16166
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.159:54248 #15 (15 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.153:61785 #16 (16 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.156:60771 #17 (17 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.159:54249 #18 (18 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.33:56213 #19 (19 connections now open)
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1] mongod.exe ???
Fri Dec 14 16:07:58 [conn1]

***aborting after fassert() failure

Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.175:56226 #20 (20 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.155:59574 #21 (21 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.155:59575 #22 (22 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.100:7734 #23 (23 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.175:56227 #24 (24 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.157:55793 #25 (25 connections now open)
Fri Dec 14 16:07:58 [initandlisten] connection accepted from 192.168.94.154:52747 #26 (26 connections now open)
Fri Dec 14 16:07:59 [initandlisten] connection accepted from 192.168.94.172:56166 #27 (27 connections now open)
Fri Dec 14 16:07:59 [initandlisten] connection accepted from 192.168.94.22:62059 #28 (28 connections now open)
Fri Dec 14 16:07:59 [initandlisten] connection accepted from 192.168.94.16:56118 #29 (29 connections now open)
Fri Dec 14 16:07:59 [initandlisten] connection accepted from 192.168.94.158:64107 #30 (30 connections now open)
Fri Dec 14 16:08:00 [initandlisten] connection accepted from 192.168.94.38:53666 #31 (31 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.159:54250 #32 (32 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.174:56121 #33 (33 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.158:64108 #34 (34 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.16:56119 #35 (35 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.35:56165 #36 (36 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.155:59576 #37 (37 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.33:56214 #38 (38 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.35:56166 #39 (39 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.175:56228 #40 (40 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.174:56122 #41 (41 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.157:55794 #42 (42 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.154:52748 #43 (43 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.152:54245 #44 (44 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.34:56135 #45 (45 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.153:61786 #46 (46 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.171:56165 #47 (47 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.173:56103 #48 (48 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.155:59577 #49 (49 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.152:54246 #50 (50 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.37:57589 #51 (51 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.173:56104 #52 (52 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.172:56167 #53 (53 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.16:56120 #54 (54 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.100:7739 #55 (55 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.16:56121 #56 (56 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.29:56163 #57 (57 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.157:55795 #58 (58 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.174:56124 #59 (59 connections now open)
Fri Dec 14 16:08:03 [initandlisten] connection accepted from 192.168.94.29:56164 #60 (60 connections now open)

***** SERVER RESTARTED *****

Fri Dec 14 16:10:53 Trying to start Windows service ‘MongoDB’
Fri Dec 14 16:10:53 Service running
Fri Dec 14 16:10:53 [initandlisten] MongoDB starting : pid=6288 port=27017 dbpath=C:\mongo\data 32-bit host=SFS-File
Fri Dec 14 16:10:53 [initandlisten]
Fri Dec 14 16:10:53 [initandlisten] ** NOTE: when using MongoDB 32 bit, you are limited to about 2 gigabytes of data
Fri Dec 14 16:10:53 [initandlisten] ** see http://blog.mongodb.org/post/137788967/32-bit-limitations
Fri Dec 14 16:10:53 [initandlisten] ** with --journal, the limit is lower
Fri Dec 14 16:10:53 [initandlisten]
Fri Dec 14 16:10:53 [initandlisten] db version v2.2.0, pdfile version 4.5
Fri Dec 14 16:10:53 [initandlisten] git version: f5e83eae9cfbec7fb7a071321928f00d1b0c5207
Fri Dec 14 16:10:53 [initandlisten] build info: windows sys.getwindowsversion(major=6, minor=0, build=6002, platform=2, service_pack=‘Service Pack 2’) BOOST_LIB_VERSION=1_49
Fri Dec 14 16:10:53 [initandlisten] options: { dbpath: “C:\mongo\data”, logappend: true, logpath: “C:\mongo\data\logs\log.txt”, service: true }
Fri Dec 14 16:10:53 [initandlisten] exception in initAndListen: 12596 old lock file, terminating
Fri Dec 14 16:10:53 dbexit:
Fri Dec 14 16:10:53 [initandlisten] shutdown: going to close listening sockets…
Fri Dec 14 16:10:53 [initandlisten] shutdown: going to flush diaglog…
Fri Dec 14 16:10:53 [initandlisten] shutdown: going to close sockets…
Fri Dec 14 16:10:53 [initandlisten] shutdown: waiting for fs preallocator…
Fri Dec 14 16:10:53 [initandlisten] shutdown: closing all files…
Fri Dec 14 16:10:53 [initandlisten] closeAllFiles() finished
Fri Dec 14 16:10:53 dbexit: really exiting now
[/code]

Ok I launched it by pointing it to the DB path. which apparently for deadline is in the wrong folder:

c:\mongo\application\bin\mongod --dbpath C:\mongo\data (THIS SHOULD BE \data\db but whatever).

[code]Microsoft Windows [Version 6.0.6002]
Copyright © 2006 Microsoft Corporation. All rights reserved.

C:\Users\sfsadmin>C:\mongo\application\bin\mongod --dbpath C:\mongo\data
Fri Dec 14 16:17:44
Fri Dec 14 16:17:44 warning: 32-bit servers don’t have journaling enabled by default. Please use --journal if you want d
urability.
Fri Dec 14 16:17:44
Fri Dec 14 16:17:44 [initandlisten] MongoDB starting : pid=616 port=27017 dbpath=C:\mongo\data\ 32-bit host=SFS-File
Fri Dec 14 16:17:44 [initandlisten]
Fri Dec 14 16:17:44 [initandlisten] ** NOTE: when using MongoDB 32 bit, you are limited to about 2 gigabytes of data
Fri Dec 14 16:17:44 [initandlisten] ** see http://blog.mongodb.org/post/137788967/32-bit-limitations
Fri Dec 14 16:17:44 [initandlisten] ** with --journal, the limit is lower
Fri Dec 14 16:17:44 [initandlisten]
Fri Dec 14 16:17:44 [initandlisten] db version v2.2.0, pdfile version 4.5
Fri Dec 14 16:17:44 [initandlisten] git version: f5e83eae9cfbec7fb7a071321928f00d1b0c5207
Fri Dec 14 16:17:44 [initandlisten] build info: windows sys.getwindowsversion(major=6, minor=0, build=6002, platform=2,
service_pack=‘Service Pack 2’) BOOST_LIB_VERSION=1_49
Fri Dec 14 16:17:44 [initandlisten] options: { dbpath: “C:\mongo\data” }
Fri Dec 14 16:17:44 [initandlisten] waiting for connections on port 27017
Fri Dec 14 16:17:44 [websvr] admin web console waiting for connections on port 28017
Fri Dec 14 16:17:44 [initandlisten] connection accepted from 192.168.94.154:53025 #1 (1 connection now open)
Fri Dec 14 16:17:44 [conn1] MapViewOfFileEx for C:/mongo/data/deadlinedb.7 failed with errno:8 Not enough storage is ava
ilable to process this command. (file size is 536608768) in MemoryMappedFile::map
Fri Dec 14 16:17:44 [initandlisten] connection accepted from 192.168.94.175:56620 #2 (2 connections now open)
Fri Dec 14 16:17:44 [conn1] Fatal Assertion 16166
Fri Dec 14 16:17:44 [initandlisten] connection accepted from 192.168.94.34:56518 #3 (3 connections now open)
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1] mongod.exe ???
Fri Dec 14 16:17:44 [conn1]

***aborting after fassert() failure

Fri Dec 14 16:17:45 [initandlisten] connection accepted from 192.168.94.29:56535 #4 (4 connections now open)
Fri Dec 14 16:17:45 [initandlisten] connection accepted from 192.168.94.29:56536 #5 (5 connections now open)
[/code]

Ok… so a little digging says that you can only have a 2GB mongo database. Ours is 2.06GB. So … umm… that’s a problem. Only 2GBs worth of job files? That aint gonna fly.

Reinstalled the Database. Obviously all of my settings are gone. : P But some of the stats are still around:

“Failed Tassk”

428,83,76,479,488,479,476,404

So I am going to guess that we hit the limit of how many logs Mongo can hold.

Can I turn off logging?

from your log

Fri Dec 14 16:17:44 [initandlisten] ** NOTE: when using MongoDB 32 bit, you are limited to about 2 gigabytes of data
Fri Dec 14 16:17:44 [initandlisten] ** see blog.mongodb.org/post/137788967/ … imitations

is this a 32bit machine?

[edited] 'cause if not, I would suggest running 64bit mongo.

cb

Yeah, the 64bit Mongo shouldn’t have the 2gb limitation. Did you install it yourself or did you leave the installation of Mongo to the Deadline Repo installer? I’m just wondering if we’re accidentally shipping/installing the wrong version of Mongo with our installer…

Cheers,

  • Jon

Yeah it’s a 32 bit system OS (we had some license servers which were unhappy with 64bit). But it’s generated 1.5GB in the last 3 days. At that pace we’d be out of RAM by the end of the week anyway.

EDIT: here is a copy of the DB if you want to take a look.

mediafire.com/?97z3d7cpbp4cen6

G -

can you let me know how many jobs you have in the queue, the number of slaves you have and the average of tasks? the last one doesn’t have to be perfect - just generally do you have 100 tasks per job, or 500 etc.

thanks!

cb

About 100 tasks per job, I don’t think we had more than 10 jobs in the queue today. So about 25 machines rendering.

EDIT: But today I did roll out Deadline 6 to the full farm.
EDIT EDIT: In the last half hour of normal error free rendering w/ 3 jobs and about 300 tasks it’s created approximately 55MB of data. So in 24 hours I would expect it to hit the 2GB limit.

hmm. I will let Ryan chime in here, or Matt.

cb

Would it be possible to get some stats for the collections?

Bring up the mongo command line:
mongo /deadlinedb

(if on the same machine)
mongo localhost/deadlinedb

Then run this command:
db.getCollectionNames().forEach(function© {s = db[c].validate(); printjson(s)})

This will print a long list of info we can use to see what’s happening.

Note that Mongo tends to pre-allocate files to reduce fragmentation. This surprised me the first time I ran the server. :open_mouth: So it may use 2GB of space before you actually save any data.

For safety, I would add --journal to the command line options when you start mongod.

The data files I got on mediafire appeared to be empty, but I’ll take a look again in the morning.

There is certainly preallocation going on to some degree.

I have 3 files in the dead mongo database (see media fire zip) that are all precisely 524,032KB. But compressability is extreme. The final file compresses from 524,032 KB to 510KB through standard windows zipping. The least compressible of the deadlinedb.# files in the mango/data folder compresses from 524MB to 17MB. Well over 10:1. That would suggest that it’s setting aside space somewhat flippantly.

Here is the current state of our server. Without any jobs being run through it over the weekend it appears to be staying static in size. So the good news it’s not growing without usage. I can’t run this on the old DB that broke the 2GB barrier for obvious reasons. :wink:

[code] “errors” : [ ],
“warning” : “Some checks omitted for speed. use {full:true} option to do more thorough scan.”,
“ok” : 1
}
{
“ns” : “deadlinedb.PulseInfo”,
“firstExtent” : “0:1b000 ns:deadlinedb.PulseInfo”,
“lastExtent” : “0:1b000 ns:deadlinedb.PulseInfo”,
“extentCount” : 1,
“datasize” : 508,
“nrecords” : 1,
“lastExtentSize” : 32768,
“padding” : 1.0000000000000004,
“firstExtentDetails” : {
“loc” : “0:1b000”,
“xnext” : “null”,
“xprev” : “null”,
“nsdiag” : “deadlinedb.PulseInfo”,
“size” : 32768,
“firstRecord” : “0:1b2a4”,
“lastRecord” : “0:1b2a4”
},
“deletedCount” : 2,
“deletedSize” : 32068,
“nIndexes” : 2,
“keysPerIndex” : {
“deadlinedb.PulseInfo.$id” : 1,
“deadlinedb.PulseInfo.$LastWriteTime_1” : 1
},
“valid” : true,
“errors” : [ ],
“warning” : “Some checks omitted for speed. use {full:true} option to do more thorough scan.”,
“ok” : 1
}
{
“ns” : “deadlinedb.RepositoryStatistics”,
“firstExtent” : “0:db000 ns:deadlinedb.RepositoryStatistics”,
“lastExtent” : “0:db000 ns:deadlinedb.RepositoryStatistics”,
“extentCount” : 1,
“datasize” : 9052,
“nrecords” : 31,
“lastExtentSize” : 20480,
“padding” : 1,
“firstExtentDetails” : {
“loc” : “0:db000”,
“xnext” : “null”,
“xprev” : “null”,
“nsdiag” : “deadlinedb.RepositoryStatistics”,
“size” : 20480,
“firstRecord” : “0:db0b0”,
“lastRecord” : “0:dd4c8”
},
“deletedCount” : 1,
“deletedSize” : 10756,
“nIndexes” : 1,
“keysPerIndex” : {
“deadlinedb.RepositoryStatistics.$id” : 31
},
“valid” : true,
“errors” : [ ],
“warning” : “Some checks omitted for speed. use {full:true} option to do more thorough scan.”,
“ok” : 1
}
{
“ns” : “deadlinedb.ScriptInfos”,
“firstExtent” : “0:b2000 ns:deadlinedb.ScriptInfos”,
“lastExtent” : “0:b2000 ns:deadlinedb.ScriptInfos”,
“extentCount” : 1,
“datasize” : 0,
“nrecords” : 0,
“lastExtentSize” : 8192,
“padding” : 1,
“firstExtentDetails” : {
“loc” : “0:b2000”,
“xnext” : “null”,
“xprev” : “null”,
“nsdiag” : “deadlinedb.ScriptInfos”,
“size” : 8192,
“firstRecord” : “null”,
“lastRecord” : “null”
},
“deletedCount” : 1,
“deletedSize” : 8016,
“nIndexes” : 3,
“keysPerIndex” : {
“deadlinedb.ScriptInfos.$id” : 0,
“deadlinedb.ScriptInfos.$ScriptType_1_ScriptName_1” : 0,
“deadlinedb.ScriptInfos.$EntryTime_1” : 0
},
“valid” : true,
“errors” : [ ],
“warning” : “Some checks omitted for speed. use {full:true} option to do more thorough scan.”,
“ok” : 1
}
{
“ns” : “deadlinedb.SlaveInfo”,
“firstExtent” : “0:2000 ns:deadlinedb.SlaveInfo”,
“lastExtent” : “0:4bf000 ns:deadlinedb.SlaveInfo”,
“extentCount” : 2,
“datasize” : 19388,
“nrecords” : 19,
“lastExtentSize” : 212992,
“padding” : 1.0000000000000142,
“firstExtentDetails” : {
“loc” : “0:2000”,
“xnext” : “0:4bf000”,
“xprev” : “null”,
“nsdiag” : “deadlinedb.SlaveInfo”,
“size” : 53248,
“firstRecord” : “0:be08”,
“lastRecord” : “0:c988”
},
“deletedCount” : 64,
“deletedSize” : 246196,
“nIndexes” : 2,
“keysPerIndex” : {
“deadlinedb.SlaveInfo.$id” : 19,
“deadlinedb.SlaveInfo.$LastWriteTime_1” : 19
},
“valid” : true,
“errors” : [ ],
“warning” : “Some checks omitted for speed. use {full:true} option to do more thorough scan.”,
“ok” : 1
}
{
“ns” : “deadlinedb.SlaveReports”,
“firstExtent” : “0:188000 ns:deadlinedb.SlaveReports”,
“lastExtent” : “0:4f3000 ns:deadlinedb.SlaveReports”,
“extentCount” : 4,
“datasize” : 216484,
“nrecords” : 18,
“lastExtentSize” : 1310720,
“padding” : 1.094000000000006,
“firstExtentDetails” : {
“loc” : “0:188000”,
“xnext” : “0:1ae000”,
“xprev” : “null”,
“nsdiag” : “deadlinedb.SlaveReports”,
“size” : 20480,
“firstRecord” : “0:188d2c”,
“lastRecord” : “0:188d2c”
},
“deletedCount” : 102,
“deletedSize” : 1523324,
“nIndexes” : 1,
“keysPerIndex” : {
“deadlinedb.SlaveReports.$id” : 18
},
“valid” : true,
“errors” : [ ],
“warning” : “Some checks omitted for speed. use {full:true} option to do more thorough scan.”,
“ok” : 1
}
{
“ns” : “deadlinedb.SlaveSettings”,
“firstExtent” : “0:5b000 ns:deadlinedb.SlaveSettings”,
“lastExtent” : “0:3f2000 ns:deadlinedb.SlaveSettings”,
“extentCount” : 2,
“datasize” : 6480,
“nrecords” : 19,
“lastExtentSize” : 32768,
“padding” : 1.0450000000000017,
“firstExtentDetails” : {
“loc” : “0:5b000”,
“xnext” : “0:3f2000”,
“xprev” : “null”,
“nsdiag” : “deadlinedb.SlaveSettings”,
“size” : 8192,
“firstRecord” : “0:5cd70”,
“lastRecord” : “0:5cd70”
},
“deletedCount” : 31,
“deletedSize” : 33824,
“nIndexes” : 2,
“keysPerIndex” : {
“deadlinedb.SlaveSettings.$id” : 19,
“deadlinedb.SlaveSettings.$LastWriteTime_1” : 19
},
“valid” : true,
“errors” : [ ],
“warning” : “Some checks omitted for speed. use {full:true} option to do more thorough scan.”,
“ok” : 1
}
{
“ns” : “deadlinedb.SlaveStatistics”,
“firstExtent” : “0:cf000 ns:deadlinedb.SlaveStatistics”,
“lastExtent” : “0:8b1000 ns:deadlinedb.SlaveStatistics”,
“extentCount” : 2,
“datasize” : 31048,
“nrecords” : 206,
“lastExtentSize” : 49152,
“padding” : 1,
“firstExtentDetails” : {
“loc” : “0:cf000”,
“xnext” : “0:8b1000”,
“xprev” : “null”,
“nsdiag” : “deadlinedb.SlaveStatistics”,
“size” : 12288,
“firstRecord” : “0:cf0b0”,
“lastRecord” : “0:d1ee4”
},
“deletedCount” : 2,
“deletedSize” : 26744,
“nIndexes” : 1,
“keysPerIndex” : {
“deadlinedb.SlaveStatistics.$id” : 206
},
“valid” : true,
“errors” : [ ],
“warning” : “Some checks omitted for speed. use {full:true} option to do more thorough scan.”,
“ok” : 1
}
{
“ns” : “deadlinedb.Tasks”,
“firstExtent” : “0:14a000 ns:deadlinedb.Tasks”,
“lastExtent” : “0:633000 ns:deadlinedb.Tasks”,
“extentCount” : 3,
“datasize” : 78832,
“nrecords” : 4,
“lastExtentSize” : 2555904,
“padding” : 1.0040000000000404,
“firstExtentDetails” : {
“loc” : “0:14a000”,
“xnext” : “0:3fa000”,
“xprev” : “null”,
“nsdiag” : “deadlinedb.Tasks”,
“size” : 159744,
“firstRecord” : “null”,
“lastRecord” : “null”
},
“deletedCount” : 263,
“deletedSize” : 3275200,
“nIndexes” : 1,
“keysPerIndex” : {
“deadlinedb.Tasks.$id” : 4
},
“valid” : true,
“errors” : [ ],
“warning” : “Some checks omitted for speed. use {full:true} option to do more thorough scan.”,
“ok” : 1
}
{
“ns” : “deadlinedb.UserInfo”,
“firstExtent” : “0:e9000 ns:deadlinedb.UserInfo”,
“lastExtent” : “0:e9000 ns:deadlinedb.UserInfo”,
“extentCount” : 1,
“datasize” : 264,
“nrecords” : 3,
“lastExtentSize” : 8192,
“padding” : 1,
“firstExtentDetails” : {
“loc” : “0:e9000”,
“xnext” : “null”,
“xprev” : “null”,
“nsdiag” : “deadlinedb.UserInfo”,
“size” : 8192,
“firstRecord” : “0:e90b0”,
“lastRecord” : “0:e9184”
},
“deletedCount” : 1,
“deletedSize” : 7704,
“nIndexes” : 1,
“keysPerIndex” : {
“deadlinedb.UserInfo.$id” : 3
},
“valid” : true,
“errors” : [ ],
“warning” : “Some checks omitted for speed. use {full:true} option to do more thorough scan.”,
“ok” : 1
}
{
“ns” : “deadlinedb.system.indexes”,
“firstExtent” : “0:f000 ns:deadlinedb.system.indexes”,
“lastExtent” : “0:f000 ns:deadlinedb.system.indexes”,
“extentCount” : 1,
“datasize” : 2448,
“nrecords” : 28,
“lastExtentSize” : 8192,
“padding” : 1,
“firstExtentDetails” : {
“loc” : “0:f000”,
“xnext” : “null”,
“xprev” : “null”,
“nsdiag” : “deadlinedb.system.indexes”,
“size” : 8192,
“firstRecord” : “0:f0b0”,
“lastRecord” : “0:fba0”
},
“deletedCount” : 1,
“deletedSize” : 5120,
“nIndexes” : 0,
“keysPerIndex” : {

    },
    "valid" : true,
    "errors" : [ ],
    "warning" : "Some checks omitted for speed. use {full:true} option to do more thorough scan.",
    "ok" : 1

}

[/code]

Hmm, I think it cut off a bit of the output there, but none of the collections seemed to be using much space.

Could you run db.stats() and display the output please?

We’re going to be adding warning messages to our repository installers to warn users that try to install 32 bit Mongo. We’re also going to add documentation to our system requirements and our installation pages to talk about this limitation. We definitely don’t want our users to learn of this problem while in the middle of production, and we’re very sorry you had to find this out yourself the hard way.

Mongo will aggressively pre-allocate disk space, especially for journaling, in order to improve performance. I think we’ll document this too.

Finally, the /data/db location is the default Mongo location (on Windows, this ends up being c:\data\db). We wanted to keep our MongoDB installation isolated, which is why we keep it all in c:\mongo.

Not trying to hijack this thread, but can you guys provide some rough figures on how the DB size increases when the queue gets into the thousands or tens of thousands of jobs?

[code]> db.stats()
{
“db” : “deadlinedb”,
“collections” : 18,
“objects” : 3006,
“avgObjSize” : 384.7052561543579,
“dataSize” : 1156424,
“storageSize” : 9793536,
“numExtents” : 35,
“indexes” : 28,
“indexSize” : 433328,
“fileSize” : 50331648,
“nsSizeMB” : 16,
“ok” : 1
}

localhost/deadlinedb[/code]

It doesn’t seem to be increasing in size nearly as fast anymore. But I also didn’t let an erroring job just go for a couple hours like before.

Also how do I add the --journal flag to the service path?

I think you have to do this through the registry.

Here’s a helpful article to describe how Mongo uses disk space:
mongodb.org/display/DOCS/Exc … Disk+Space

We have a 10,000 job repository that we’ve been testing with since August, and it’s sitting at just over 1 gig. It has pre-allocated its 64 MB, 128 MB, and 512 MB data files, but has yet to pre-allocate its 1 GB file. Because the 1 GB file hasn’t been pre-allocated yet, it means that the 512 MB file hasn’t been touched yet (based on the article above).

This means that we’re fitting 10,000 jobs into the 64 MB and 128 MB data files. Our server is also sitting at only 80 MB in RAM.

We’re very close to being feature complete in 6.0 (in terms of 5.2 features that are still missing), and once we’re there, we’ll be working on documenting this information better, as well as providing graphs that show how diskspace and RAM usage goes up with the amount of data that is stored. Based on our experience, disk space usage shouldn’t be a concern, but we will still be recommending 64 bit systems for Mongo going forward.

Cheers,

  • Ryan
Privacy | Site terms | Cookie preferences