Nameexact_genome_1512568488_43_3441_0
Workunit2588467
Created7 Dec 2017, 4:47:27 UTC
Sent7 Dec 2017, 4:53:54 UTC
Report deadline12 Dec 2017, 16:14:17 UTC
Received7 Dec 2017, 16:27:02 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time3 hours 8 min 46 sec
CPU time3 hours 5 min 44 sec
Validate stateInitial
Credit0.00
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.55 MB
Peak swap size157.77 MB
Peak disk usage1.89 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
 propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5244359970
validation[          , genome  3441] predictions:    9654/  10000 (96.54%), best:    9693/10000 (96.93%), error:      1220.19971, best error:      1155.23694 on epoch:     5, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 107.4209518433s, input_fired_time: 1.1161831617, output_fired_time: 0.9935781956, propagate_forward_time: 40.0983161926, propagate_backward_time: 62.1734199524, weight_update_time: 0.1467846483, other_time: 3.0394554138
epoch time: 8.2737455368s, input_fired_time: 0.1409660280, output_fired_time: 0.0000000000, propagate_forward_time: 7.5971317291, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5356473923
validation[          , genome  3441] predictions:    9638/  10000 (96.38%), best:    9693/10000 (96.93%), error:      1256.85400, best error:      1155.23694 on epoch:     5, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 106.4858016968s, input_fired_time: 1.1217920780, output_fired_time: 0.9874107242, propagate_forward_time: 40.2024230957, propagate_backward_time: 61.1208839417, weight_update_time: 0.1474785507, other_time: 3.0532875061
epoch time: 9.3450517654s, input_fired_time: 1.1548160315, output_fired_time: 0.0000000000, propagate_forward_time: 7.6467084885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5435276031
validation[          , genome  3441] predictions:    9671/  10000 (96.71%), best:    9693/10000 (96.93%), error:      1162.18530, best error:      1155.23694 on epoch:     5, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 110.4951095581s, input_fired_time: 1.1819114685, output_fired_time: 2.0455343723, propagate_forward_time: 41.6890678406, propagate_backward_time: 62.4147720337, weight_update_time: 0.1470700949, other_time: 3.1638259888
epoch time: 9.6727657318s, input_fired_time: 0.1453408897, output_fired_time: 0.0000000000, propagate_forward_time: 8.9808540344, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5465707779
validation[          , genome  3441] predictions:    9609/  10000 (96.09%), best:    9693/10000 (96.93%), error:      1283.35852, best error:      1155.23694 on epoch:     5, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 107.9844436646s, input_fired_time: 1.1535663605, output_fired_time: 1.9142988920, propagate_forward_time: 39.8988342285, propagate_backward_time: 61.9639244080, weight_update_time: 0.1472704113, other_time: 3.0538215637
epoch time: 9.4735250473s, input_fired_time: 0.1457465291, output_fired_time: 0.0000000000, propagate_forward_time: 8.7745923996, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5531864166
validation[          , genome  3441] predictions:    9641/  10000 (96.41%), best:    9693/10000 (96.93%), error:      1241.54736, best error:      1155.23694 on epoch:     5, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 106.4118194580s, input_fired_time: 1.1173539162, output_fired_time: 1.0020058155, propagate_forward_time: 40.2555656433, propagate_backward_time: 60.0019187927, weight_update_time: 0.1459489167, other_time: 4.0349769592
epoch time: 9.2573232651s, input_fired_time: 0.1418971121, output_fired_time: 0.0000000000, propagate_forward_time: 8.5850419998, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5303840637
validation[          , genome  3441] predictions:    9666/  10000 (96.66%), best:    9693/10000 (96.93%), error:      1195.95776, best error:      1155.23694 on epoch:     5, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 105.7404556274s, input_fired_time: 1.1179574728, output_fired_time: 0.9855601788, propagate_forward_time: 40.8630294800, propagate_backward_time: 58.7318267822, weight_update_time: 0.1465494484, other_time: 4.0420837402
epoch time: 8.2098522186s, input_fired_time: 0.1411953568, output_fired_time: 0.0000000000, propagate_forward_time: 7.5385351181, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5301218033
validation[          , genome  3441] predictions:    9678/  10000 (96.78%), best:    9678/10000 (96.78%), error:      1096.73303, best error:      1096.73303 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 107.9568481445s, input_fired_time: 1.1469583511, output_fired_time: 0.9927905202, propagate_forward_time: 40.4981193542, propagate_backward_time: 62.2476692200, weight_update_time: 0.1478563696, other_time: 3.0713157654
epoch time: 7.9316239357s, input_fired_time: 0.1355987787, output_fired_time: 0.0000000000, propagate_forward_time: 7.2620191574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5340061188
validation[          , genome  3441] predictions:    9657/  10000 (96.57%), best:    9678/10000 (96.78%), error:      1136.07764, best error:      1096.73303 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 106.2865219116s, input_fired_time: 2.1243367195, output_fired_time: 0.9878218770, propagate_forward_time: 40.2286949158, propagate_backward_time: 59.9148826599, weight_update_time: 0.1461684406, other_time: 3.0307846069
epoch time: 9.5142660141s, input_fired_time: 0.1453727186, output_fired_time: 0.0000000000, propagate_forward_time: 8.8184137344, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5504798889
validation[          , genome  3441] predictions:    9676/  10000 (96.76%), best:    9678/10000 (96.78%), error:      1144.07227, best error:      1096.73303 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 107.4427413940s, input_fired_time: 1.1257182360, output_fired_time: 2.0096838474, propagate_forward_time: 39.6408309937, propagate_backward_time: 60.6281814575, weight_update_time: 0.1467455775, other_time: 4.0383300781
epoch time: 9.5582647324s, input_fired_time: 0.1457480341, output_fired_time: 0.0000000000, propagate_forward_time: 8.8590164185, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5535001755
validation[          , genome  3441] predictions:    9684/  10000 (96.84%), best:    9678/10000 (96.78%), error:      1124.97449, best error:      1096.73303 on epoch:    20, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 110.1558914185s, input_fired_time: 1.1505814791, output_fired_time: 1.0180941820, propagate_forward_time: 43.5230979919, propagate_backward_time: 61.2871894836, weight_update_time: 0.1499869525, other_time: 3.1769218445
epoch time: 9.3802661896s, input_fired_time: 0.1455647349, output_fired_time: 0.0000000000, propagate_forward_time: 8.6912889481, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5434122086
validation[          , genome  3441] predictions:    9682/  10000 (96.82%), best:    9682/10000 (96.82%), error:      1075.34558, best error:      1075.34558 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 105.4201812744s, input_fired_time: 1.1336252689, output_fired_time: 0.9800574183, propagate_forward_time: 38.6604270935, propagate_backward_time: 61.5715255737, weight_update_time: 0.1456034184, other_time: 3.0745468140
epoch time: 8.1440391541s, input_fired_time: 0.1403264254, output_fired_time: 0.0000000000, propagate_forward_time: 7.4702124596, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5335001945
validation[          , genome  3441] predictions:    9659/  10000 (96.59%), best:    9682/10000 (96.82%), error:      1151.51282, best error:      1075.34558 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 106.7107009888s, input_fired_time: 1.1263046265, output_fired_time: 0.9941174984, propagate_forward_time: 40.3094139099, propagate_backward_time: 61.2356491089, weight_update_time: 0.1467200667, other_time: 3.0452194214
epoch time: 8.1386814117s, input_fired_time: 0.1398484260, output_fired_time: 0.0000000000, propagate_forward_time: 7.4723958969, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5264372826
validation[          , genome  3441] predictions:    9697/  10000 (96.97%), best:    9697/10000 (96.97%), error:      1058.02991, best error:      1058.02991 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 112.3595199585s, input_fired_time: 1.1509832144, output_fired_time: 1.0319418907, propagate_forward_time: 42.0728683472, propagate_backward_time: 63.8382072449, weight_update_time: 0.1562824249, other_time: 4.2655143738
epoch time: 8.2164096832s, input_fired_time: 0.1416414678, output_fired_time: 0.0000000000, propagate_forward_time: 7.5429806709, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5317873955
validation[          , genome  3441] predictions:    9643/  10000 (96.43%), best:    9697/10000 (96.97%), error:      1241.31079, best error:      1058.02991 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 107.9154815674s, input_fired_time: 1.1482567787, output_fired_time: 0.9919899702, propagate_forward_time: 40.2620086670, propagate_backward_time: 61.4504127502, weight_update_time: 0.1480581909, other_time: 4.0628166199
epoch time: 8.3107938766s, input_fired_time: 0.1448766589, output_fired_time: 0.0000000000, propagate_forward_time: 7.6235175133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5423998833
validation[          , genome  3441] predictions:    9696/  10000 (96.96%), best:    9696/10000 (96.96%), error:      1027.61829, best error:      1027.61829 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 113.2225875854s, input_fired_time: 1.1948693991, output_fired_time: 1.0406905413, propagate_forward_time: 43.2861862183, propagate_backward_time: 64.4571990967, weight_update_time: 0.1478308588, other_time: 3.2436447144
epoch time: 8.0777454376s, input_fired_time: 0.1397986412, output_fired_time: 0.0000000000, propagate_forward_time: 7.4133887291, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5245580673
validation[          , genome  3441] predictions:    9690/  10000 (96.90%), best:    9696/10000 (96.96%), error:      1071.50293, best error:      1027.61829 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 109.4533691406s, input_fired_time: 1.1398350000, output_fired_time: 0.9979875684, propagate_forward_time: 42.0871276855, propagate_backward_time: 62.1761436462, weight_update_time: 0.1468231529, other_time: 3.0522804260
epoch time: 8.0596742630s, input_fired_time: 0.1393803060, output_fired_time: 0.0000000000, propagate_forward_time: 7.3984851837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5218086243
validation[          , genome  3441] predictions:    9666/  10000 (96.66%), best:    9696/10000 (96.96%), error:      1117.78418, best error:      1027.61829 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 110.9524612427s, input_fired_time: 1.1722518206, output_fired_time: 1.0397967100, propagate_forward_time: 41.5204925537, propagate_backward_time: 64.0269317627, weight_update_time: 0.1556163728, other_time: 3.1929931641
epoch time: 8.3849811554s, input_fired_time: 0.1427567303, output_fired_time: 0.0000000000, propagate_forward_time: 7.7191910744, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5230336189
validation[          , genome  3441] predictions:    9713/  10000 (97.13%), best:    9696/10000 (96.96%), error:      1060.21631, best error:      1027.61829 on epoch:    28, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 115.3394241333s, input_fired_time: 1.1759213209, output_fired_time: 1.1025604010, propagate_forward_time: 42.1213607788, propagate_backward_time: 65.7267990112, weight_update_time: 1.1896195412, other_time: 5.2127838135
epoch time: 8.1466770172s, input_fired_time: 0.1409622580, output_fired_time: 0.0000000000, propagate_forward_time: 7.4815173149, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5241971016
validation[          , genome  3441] predictions:    9694/  10000 (96.94%), best:    9696/10000 (96.96%), error:      1053.34326, best error:      1027.61829 on epoch:    28, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 107.7441253662s, input_fired_time: 1.1307729483, output_fired_time: 0.9980008602, propagate_forward_time: 41.3661117554, propagate_backward_time: 60.1940002441, weight_update_time: 0.1466755718, other_time: 4.0552368164
epoch time: 8.2387733459s, input_fired_time: 0.1419551671, output_fired_time: 0.0000000000, propagate_forward_time: 7.5623478889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5344700813
validation[          , genome  3441] predictions:    9703/  10000 (97.03%), best:    9703/10000 (97.03%), error:      1023.79779, best error:      1023.79779 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 107.0633087158s, input_fired_time: 2.0372037888, output_fired_time: 0.9896014929, propagate_forward_time: 39.9357910156, propagate_backward_time: 61.0426177979, weight_update_time: 0.1468436867, other_time: 3.0580978394
epoch time: 8.1657333374s, input_fired_time: 0.1429741681, output_fired_time: 0.0000000000, propagate_forward_time: 7.4900069237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5327525139
validation[          , genome  3441] predictions:    9688/  10000 (96.88%), best:    9688/10000 (96.88%), error:       999.06232, best error:       999.06232 on epoch:    34, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 112.7782974243s, input_fired_time: 1.1762346029, output_fired_time: 1.0260580778, propagate_forward_time: 43.2547721863, propagate_backward_time: 64.1854629517, weight_update_time: 0.1479355097, other_time: 3.1357803345
epoch time: 8.3409061432s, input_fired_time: 0.1445301771, output_fired_time: 0.0000000000, propagate_forward_time: 7.6631131172, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5332627296
validation[          , genome  3441] predictions:    9680/  10000 (96.80%), best:    9688/10000 (96.88%), error:      1095.02478, best error:       999.06232 on epoch:    34, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 107.0140533447s, input_fired_time: 1.1262983084, output_fired_time: 0.9949377179, propagate_forward_time: 39.3694381714, propagate_backward_time: 62.5000419617, weight_update_time: 0.1461575925, other_time: 3.0233421326
epoch time: 9.4717893600s, input_fired_time: 0.1469340771, output_fired_time: 0.0000000000, propagate_forward_time: 8.7812252045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5436296463
validation[          , genome  3441] predictions:    9703/  10000 (97.03%), best:    9688/10000 (96.88%), error:      1136.87463, best error:       999.06232 on epoch:    34, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 104.6304855347s, input_fired_time: 1.1285171509, output_fired_time: 0.9821209908, propagate_forward_time: 41.6044006348, propagate_backward_time: 57.8842468262, weight_update_time: 0.1461097896, other_time: 3.0311965942
epoch time: 9.5576591492s, input_fired_time: 0.1479896158, output_fired_time: 0.0000000000, propagate_forward_time: 8.7978343964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6118354797
validation[          , genome  3441] predictions:    9712/  10000 (97.12%), best:    9712/10000 (97.12%), error:       989.93274, best error:       989.93274 on epoch:    37, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 106.3121261597s, input_fired_time: 1.1308982372, output_fired_time: 0.9931339622, propagate_forward_time: 40.1302413940, propagate_backward_time: 60.9881095886, weight_update_time: 0.1472919285, other_time: 3.0697441101
epoch time: 8.2501382828s, input_fired_time: 0.1428471357, output_fired_time: 0.0000000000, propagate_forward_time: 7.5773921013, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5298991203
validation[          , genome  3441] predictions:    9598/  10000 (95.98%), best:    9712/10000 (97.12%), error:      1313.61877, best error:       989.93274 on epoch:    37, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 108.0965576172s, input_fired_time: 1.1314232349, output_fired_time: 0.9910501242, propagate_forward_time: 40.5553474426, propagate_backward_time: 62.3962707520, weight_update_time: 0.1462430954, other_time: 3.0224609375
epoch time: 8.3151807785s, input_fired_time: 0.1429062635, output_fired_time: 0.0000000000, propagate_forward_time: 7.6408238411, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5314507484
validation[          , genome  3441] predictions:    9651/  10000 (96.51%), best:    9712/10000 (97.12%), error:      1144.03894, best error:       989.93274 on epoch:    37, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 108.8941802979s, input_fired_time: 1.1426212788, output_fired_time: 1.0065630674, propagate_forward_time: 42.7306251526, propagate_backward_time: 59.9498023987, weight_update_time: 0.1478288621, other_time: 4.0645713806
epoch time: 8.1486024857s, input_fired_time: 0.1413360834, output_fired_time: 0.0000000000, propagate_forward_time: 7.4834995270, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5237665176
validation[          , genome  3441] predictions:    9710/  10000 (97.10%), best:    9710/10000 (97.10%), error:       983.31262, best error:       983.31262 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 105.6168212891s, input_fired_time: 1.1276466846, output_fired_time: 0.9845820069, propagate_forward_time: 37.8654212952, propagate_backward_time: 62.5952606201, weight_update_time: 0.1481231153, other_time: 3.0439147949
epoch time: 9.3990974426s, input_fired_time: 0.1472077519, output_fired_time: 0.0000000000, propagate_forward_time: 8.7052249908, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5466642380
validation[          , genome  3441] predictions:    9695/  10000 (96.95%), best:    9710/10000 (97.10%), error:      1050.28186, best error:       983.31262 on epoch:    40, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 107.2364501953s, input_fired_time: 1.1258252859, output_fired_time: 0.9888421297, propagate_forward_time: 39.5865669250, propagate_backward_time: 62.4939537048, weight_update_time: 0.1473608017, other_time: 3.0412635803
epoch time: 10.1784648895s, input_fired_time: 0.1504570842, output_fired_time: 0.0000000000, propagate_forward_time: 9.4534540176, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5745534897
validation[          , genome  3441] predictions:    9669/  10000 (96.69%), best:    9710/10000 (97.10%), error:      1138.83423, best error:       983.31262 on epoch:    40, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 107.0178222656s, input_fired_time: 1.1283332109, output_fired_time: 0.9913224578, propagate_forward_time: 40.4019699097, propagate_backward_time: 61.4677238464, weight_update_time: 0.1468065977, other_time: 3.0284690857
epoch time: 9.4863700867s, input_fired_time: 0.1473524421, output_fired_time: 0.0000000000, propagate_forward_time: 8.7825069427, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5565109253
validation[          , genome  3441] predictions:    9720/  10000 (97.20%), best:    9720/10000 (97.20%), error:       978.05322, best error:       978.05322 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 107.3339767456s, input_fired_time: 1.1324141026, output_fired_time: 0.9963777065, propagate_forward_time: 39.5737686157, propagate_backward_time: 62.5763854980, weight_update_time: 0.1476638317, other_time: 3.0550308228
epoch time: 8.0253715515s, input_fired_time: 0.1415569186, output_fired_time: 0.0000000000, propagate_forward_time: 7.3565211296, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5272936821
validation[          , genome  3441] predictions:    9731/  10000 (97.31%), best:    9720/10000 (97.20%), error:       985.19391, best error:       978.05322 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 110.5403747559s, input_fired_time: 1.1323293447, output_fired_time: 1.0568611622, propagate_forward_time: 41.3475685120, propagate_backward_time: 62.8497467041, weight_update_time: 0.1467519552, other_time: 4.1538696289
epoch time: 13.8294754028s, input_fired_time: 0.2514385581, output_fired_time: 0.0000000000, propagate_forward_time: 12.7562694550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8217678070
validation[          , genome  3441] predictions:    9660/  10000 (96.60%), best:    9720/10000 (97.20%), error:      1181.53308, best error:       978.05322 on epoch:    43, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 106.6530990601s, input_fired_time: 1.1342635155, output_fired_time: 1.0020998716, propagate_forward_time: 39.3632240295, propagate_backward_time: 62.1060371399, weight_update_time: 0.1470602155, other_time: 3.0474815369
epoch time: 8.2020921707s, input_fired_time: 0.1416609734, output_fired_time: 0.0000000000, propagate_forward_time: 7.5366630554, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5237684250
validation[          , genome  3441] predictions:    9687/  10000 (96.87%), best:    9720/10000 (97.20%), error:      1098.44080, best error:       978.05322 on epoch:    43, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 106.8557815552s, input_fired_time: 1.1372814178, output_fired_time: 0.9893254042, propagate_forward_time: 38.3200645447, propagate_backward_time: 63.2887954712, weight_update_time: 0.1480992585, other_time: 3.1203079224
epoch time: 8.1456279755s, input_fired_time: 0.1441832185, output_fired_time: 0.0000000000, propagate_forward_time: 7.4673275948, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5341172218
validation[          , genome  3441] predictions:    9678/  10000 (96.78%), best:    9720/10000 (97.20%), error:      1124.25647, best error:       978.05322 on epoch:    43, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 107.3545684814s, input_fired_time: 1.1302744150, output_fired_time: 2.0024464130, propagate_forward_time: 40.1474456787, propagate_backward_time: 60.0204887390, weight_update_time: 0.1465617865, other_time: 4.0539131165
epoch time: 8.2786684036s, input_fired_time: 0.1443835348, output_fired_time: 0.0000000000, propagate_forward_time: 7.6004133224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5338716507
validation[          , genome  3441] predictions:    9662/  10000 (96.62%), best:    9720/10000 (97.20%), error:      1177.32056, best error:       978.05322 on epoch:    43, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 106.8064880371s, input_fired_time: 1.1340099573, output_fired_time: 0.9979980588, propagate_forward_time: 40.3269348145, propagate_backward_time: 61.3050422668, weight_update_time: 0.1469253153, other_time: 3.0424995422
epoch time: 9.5992927551s, input_fired_time: 0.1478430182, output_fired_time: 0.0000000000, propagate_forward_time: 8.8986291885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5528202057
validation[          , genome  3441] predictions:    9671/  10000 (96.71%), best:    9720/10000 (97.20%), error:      1083.39185, best error:       978.05322 on epoch:    43, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 106.2709655762s, input_fired_time: 1.1373533010, output_fired_time: 0.9868226647, propagate_forward_time: 39.1903457642, propagate_backward_time: 61.8753204346, weight_update_time: 0.1476413310, other_time: 3.0811233521
epoch time: 9.3808069229s, input_fired_time: 0.1486704201, output_fired_time: 0.0000000000, propagate_forward_time: 8.6871938705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5449428558
validation[          , genome  3441] predictions:    9643/  10000 (96.43%), best:    9720/10000 (97.20%), error:      1334.59265, best error:       978.05322 on epoch:    43, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 109.6616744995s, input_fired_time: 1.1406900883, output_fired_time: 1.0065207481, propagate_forward_time: 43.4477424622, propagate_backward_time: 60.9948577881, weight_update_time: 0.1481540054, other_time: 3.0718536377
epoch time: 11.0089864731s, input_fired_time: 0.1669501066, output_fired_time: 0.0000000000, propagate_forward_time: 10.2171010971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6249351501
validation[          , genome  3441] predictions:    9676/  10000 (96.76%), best:    9720/10000 (97.20%), error:      1136.20129, best error:       978.05322 on epoch:    43, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 105.1204833984s, input_fired_time: 2.1359529495, output_fired_time: 0.9858268499, propagate_forward_time: 38.5605049133, propagate_backward_time: 60.3873367310, weight_update_time: 0.1455368102, other_time: 3.0508613586
epoch time: 9.4420881271s, input_fired_time: 0.1490989625, output_fired_time: 0.0000000000, propagate_forward_time: 8.7478446960, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5451440811
validation[          , genome  3441] predictions:    9699/  10000 (96.99%), best:    9720/10000 (97.20%), error:      1037.54211, best error:       978.05322 on epoch:    43, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 107.5247192383s, input_fired_time: 1.1364812851, output_fired_time: 1.0257185698, propagate_forward_time: 40.1940345764, propagate_backward_time: 62.0323677063, weight_update_time: 0.1467621773, other_time: 3.1361198425
epoch time: 8.1949100494s, input_fired_time: 0.1445805281, output_fired_time: 0.0000000000, propagate_forward_time: 7.5104503632, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5398788452
validation[          , genome  3441] predictions:    9693/  10000 (96.93%), best:    9720/10000 (97.20%), error:      1069.08704, best error:       978.05322 on epoch:    43, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 108.9673233032s, input_fired_time: 1.1363143921, output_fired_time: 0.9955383539, propagate_forward_time: 39.7450485229, propagate_backward_time: 64.0340957642, weight_update_time: 0.1473584175, other_time: 3.0563278198
epoch time: 8.1159276962s, input_fired_time: 0.1432503164, output_fired_time: 0.0000000000, propagate_forward_time: 7.4453716278, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5273056030
validation[          , genome  3441] predictions:    9699/  10000 (96.99%), best:    9720/10000 (97.20%), error:      1079.54224, best error:       978.05322 on epoch:    43, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 108.6468048096s, input_fired_time: 1.1490223408, output_fired_time: 1.0077452660, propagate_forward_time: 40.7170295715, propagate_backward_time: 61.7101554871, weight_update_time: 0.1486656070, other_time: 4.0628547668
epoch time: 14.2569131851s, input_fired_time: 0.2675986290, output_fired_time: 0.0000000000, propagate_forward_time: 12.9741802216, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0151348114
validation[          , genome  3441] predictions:    9719/  10000 (97.19%), best:    9720/10000 (97.20%), error:       994.58704, best error:       978.05322 on epoch:    43, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 108.2497329712s, input_fired_time: 1.1380771399, output_fired_time: 0.9951823950, propagate_forward_time: 40.5683174133, propagate_backward_time: 62.5128173828, weight_update_time: 0.1474957764, other_time: 3.0353393555
epoch time: 8.1864118576s, input_fired_time: 0.1421540827, output_fired_time: 0.0000000000, propagate_forward_time: 7.5188636780, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5253944397
validation[          , genome  3441] predictions:    9603/  10000 (96.03%), best:    9720/10000 (97.20%), error:      1407.10315, best error:       978.05322 on epoch:    43, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 108.8203506470s, input_fired_time: 1.1467988491, output_fired_time: 1.0024237633, propagate_forward_time: 38.7478179932, propagate_backward_time: 64.8543930054, weight_update_time: 0.1487228721, other_time: 3.0689163208
epoch time: 8.3078889847s, input_fired_time: 0.1452382803, output_fired_time: 0.0000000000, propagate_forward_time: 7.6317167282, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5309343338
validation[          , genome  3441] predictions:    9680/  10000 (96.80%), best:    9720/10000 (97.20%), error:      1083.12146, best error:       978.05322 on epoch:    43, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 107.6692428589s, input_fired_time: 1.1385301352, output_fired_time: 0.9895214438, propagate_forward_time: 39.2329826355, propagate_backward_time: 63.2289924622, weight_update_time: 0.1477220207, other_time: 3.0792198181
epoch time: 8.3746385574s, input_fired_time: 0.1489366889, output_fired_time: 0.0000000000, propagate_forward_time: 7.6834592819, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5422430038
validation[          , genome  3441] predictions:    9647/  10000 (96.47%), best:    9720/10000 (97.20%), error:      1184.50842, best error:       978.05322 on epoch:    43, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 106.1613159180s, input_fired_time: 1.1401364803, output_fired_time: 0.9890937805, propagate_forward_time: 39.0659484863, propagate_backward_time: 61.9137077332, weight_update_time: 0.1470636725, other_time: 3.0524330139
epoch time: 9.4142999649s, input_fired_time: 0.1468196511, output_fired_time: 0.0000000000, propagate_forward_time: 7.7153139114, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5521659851
validation[          , genome  3441] predictions:    9684/  10000 (96.84%), best:    9720/10000 (97.20%), error:      1048.89026, best error:       978.05322 on epoch:    43, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 106.5846786499s, input_fired_time: 1.1498843431, output_fired_time: 0.9897782207, propagate_forward_time: 40.2092285156, propagate_backward_time: 60.1372756958, weight_update_time: 0.1472233981, other_time: 4.0985107422
epoch time: 9.3945388794s, input_fired_time: 0.1488438547, output_fired_time: 0.0000000000, propagate_forward_time: 8.6848773956, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5608177185
validation[          , genome  3441] predictions:    9681/  10000 (96.81%), best:    9720/10000 (97.20%), error:      1060.15234, best error:       978.05322 on epoch:    43, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 107.6555938721s, input_fired_time: 1.1374031305, output_fired_time: 1.0100288391, propagate_forward_time: 40.7111968994, propagate_backward_time: 61.7859687805, weight_update_time: 0.1465681940, other_time: 3.0109977722
epoch time: 8.7165870667s, input_fired_time: 0.1484632045, output_fired_time: 0.0000000000, propagate_forward_time: 8.0315465927, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5365772247
validation[          , genome  3441] predictions:    9656/  10000 (96.56%), best:    9720/10000 (97.20%), error:      1180.63733, best error:       978.05322 on epoch:    43, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 107.3294830322s, input_fired_time: 1.1459146738, output_fired_time: 2.0146508217, propagate_forward_time: 39.4498405457, propagate_backward_time: 61.6322784424, weight_update_time: 0.1486749053, other_time: 3.0868072510
epoch time: 8.2565507889s, input_fired_time: 0.1450613737, output_fired_time: 0.0000000000, propagate_forward_time: 7.5481710434, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5633182526
validation[          , genome  3441] predictions:    9702/  10000 (97.02%), best:    9720/10000 (97.20%), error:      1027.29041, best error:       978.05322 on epoch:    43, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 108.8593444824s, input_fired_time: 1.1470088959, output_fired_time: 1.0227725506, propagate_forward_time: 41.7762298584, propagate_backward_time: 61.8687438965, weight_update_time: 0.1475122422, other_time: 3.0445861816
epoch time: 8.1272974014s, input_fired_time: 0.1423935890, output_fired_time: 0.0000000000, propagate_forward_time: 7.4616613388, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5232424736
validation[          , genome  3441] predictions:    9682/  10000 (96.82%), best:    9720/10000 (97.20%), error:      1114.96326, best error:       978.05322 on epoch:    43, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 117.1984634399s, input_fired_time: 1.2633410692, output_fired_time: 1.0698610544, propagate_forward_time: 42.9591445923, propagate_backward_time: 68.6000137329, weight_update_time: 0.1649992019, other_time: 3.3060989380
epoch time: 9.0048236847s, input_fired_time: 0.1446440518, output_fired_time: 0.0000000000, propagate_forward_time: 8.2726106644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5875692368
validation[          , genome  3441] predictions:    9701/  10000 (97.01%), best:    9720/10000 (97.20%), error:      1041.52832, best error:       978.05322 on epoch:    43, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 107.9251861572s, input_fired_time: 1.1454576254, output_fired_time: 0.9945064783, propagate_forward_time: 41.4063720703, propagate_backward_time: 61.3297767639, weight_update_time: 0.1483010948, other_time: 3.0490760803
epoch time: 8.2393102646s, input_fired_time: 0.1443434507, output_fired_time: 0.0000000000, propagate_forward_time: 7.5684647560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5265021324
validation[          , genome  3441] predictions:    9689/  10000 (96.89%), best:    9720/10000 (97.20%), error:      1150.49988, best error:       978.05322 on epoch:    43, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 107.9302062988s, input_fired_time: 1.1466600895, output_fired_time: 0.9927948713, propagate_forward_time: 41.3936614990, propagate_backward_time: 61.3227310181, weight_update_time: 0.1478392333, other_time: 3.0743560791
epoch time: 8.1826448441s, input_fired_time: 0.1450564712, output_fired_time: 0.0000000000, propagate_forward_time: 7.5059127808, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5316753387
validation[          , genome  3441] predictions:    9700/  10000 (97.00%), best:    9720/10000 (97.20%), error:      1028.93579, best error:       978.05322 on epoch:    43, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 106.4957275391s, input_fired_time: 1.1375093460, output_fired_time: 1.9957827330, propagate_forward_time: 39.2788543701, propagate_backward_time: 61.0291976929, weight_update_time: 0.1467010975, other_time: 3.0543823242
epoch time: 8.9625425339s, input_fired_time: 0.1441479623, output_fired_time: 0.0000000000, propagate_forward_time: 8.2997474670, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5186471939
validation[          , genome  3441] predictions:    9721/  10000 (97.21%), best:    9720/10000 (97.20%), error:       998.31445, best error:       978.05322 on epoch:    43, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 107.6835632324s, input_fired_time: 1.1430988312, output_fired_time: 1.0318666697, propagate_forward_time: 41.6831817627, propagate_backward_time: 60.7879562378, weight_update_time: 0.1486074477, other_time: 3.0374603271
epoch time: 9.4938430786s, input_fired_time: 0.1492876858, output_fired_time: 0.0000000000, propagate_forward_time: 8.7961225510, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5484333038
validation[          , genome  3441] predictions:    9660/  10000 (96.60%), best:    9720/10000 (97.20%), error:      1179.95032, best error:       978.05322 on epoch:    43, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 106.1163787842s, input_fired_time: 1.1388827562, output_fired_time: 0.9850444794, propagate_forward_time: 39.1001777649, propagate_backward_time: 61.8397293091, weight_update_time: 0.1468564421, other_time: 3.0525436401
epoch time: 9.4259185791s, input_fired_time: 0.1485975683, output_fired_time: 0.0000000000, propagate_forward_time: 8.7309322357, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5463886261
validation[          , genome  3441] predictions:    9715/  10000 (97.15%), best:    9720/10000 (97.20%), error:       999.23383, best error:       978.05322 on epoch:    43, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 115.0783309937s, input_fired_time: 1.2305961847, output_fired_time: 2.0758614540, propagate_forward_time: 42.4355506897, propagate_backward_time: 66.0588760376, weight_update_time: 0.1563383788, other_time: 3.2774429321
epoch time: 9.5801696777s, input_fired_time: 0.1522628516, output_fired_time: 0.0000000000, propagate_forward_time: 8.8676710129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5602359772
validation[          , genome  3441] predictions:    9716/  10000 (97.16%), best:    9716/10000 (97.16%), error:       967.80267, best error:       967.80267 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 106.5626907349s, input_fired_time: 1.1434929371, output_fired_time: 1.0004162788, propagate_forward_time: 40.2488517761, propagate_backward_time: 61.1095581055, weight_update_time: 0.1477336287, other_time: 3.0603637695
epoch time: 9.4590845108s, input_fired_time: 0.1495637149, output_fired_time: 0.0000000000, propagate_forward_time: 8.7635641098, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5459566116
validation[          , genome  3441] predictions:    9691/  10000 (96.91%), best:    9716/10000 (97.16%), error:      1045.30371, best error:       967.80267 on epoch:    70, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 107.2458114624s, input_fired_time: 1.1381574869, output_fired_time: 2.0240859985, propagate_forward_time: 40.4781913757, propagate_backward_time: 60.5732574463, weight_update_time: 0.1473192573, other_time: 3.0321159363
epoch time: 8.1617240906s, input_fired_time: 0.1466838270, output_fired_time: 0.0000000000, propagate_forward_time: 7.4834847450, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5315556526
validation[          , genome  3441] predictions:    9705/  10000 (97.05%), best:    9716/10000 (97.16%), error:      1014.28473, best error:       967.80267 on epoch:    70, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 107.3458938599s, input_fired_time: 1.1446861029, output_fired_time: 1.0080949068, propagate_forward_time: 39.4989852905, propagate_backward_time: 62.6174468994, weight_update_time: 0.1468329132, other_time: 3.0766830444
epoch time: 8.1223163605s, input_fired_time: 0.1458951086, output_fired_time: 0.0000000000, propagate_forward_time: 7.4437026978, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5327186584
validation[          , genome  3441] predictions:    9625/  10000 (96.25%), best:    9716/10000 (97.16%), error:      1272.90991, best error:       967.80267 on epoch:    70, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 107.6761932373s, input_fired_time: 1.1471303701, output_fired_time: 0.9913794994, propagate_forward_time: 38.3178138733, propagate_backward_time: 63.1322097778, weight_update_time: 0.1471573412, other_time: 4.0876541138
epoch time: 8.0804567337s, input_fired_time: 0.1437453181, output_fired_time: 0.0000000000, propagate_forward_time: 7.4126939774, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5240173340
validation[          , genome  3441] predictions:    9691/  10000 (96.91%), best:    9716/10000 (97.16%), error:      1094.85071, best error:       967.80267 on epoch:    70, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 120.1975097656s, input_fired_time: 1.2877265215, output_fired_time: 1.0881783962, propagate_forward_time: 44.3039894104, propagate_backward_time: 70.0286941528, weight_update_time: 0.1801350862, other_time: 3.4889144897
epoch time: 9.5386476517s, input_fired_time: 0.1529787779, output_fired_time: 0.0000000000, propagate_forward_time: 8.8369979858, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5486707687
validation[          , genome  3441] predictions:    9720/  10000 (97.20%), best:    9716/10000 (97.16%), error:      1045.26770, best error:       967.80267 on epoch:    70, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 105.9647903442s, input_fired_time: 1.1384770870, output_fired_time: 0.9894247055, propagate_forward_time: 38.9384384155, propagate_backward_time: 61.8440818787, weight_update_time: 0.1464059651, other_time: 3.0543708801
epoch time: 8.2647056580s, input_fired_time: 0.1453174204, output_fired_time: 0.0000000000, propagate_forward_time: 7.5907750130, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5286135674
validation[          , genome  3441] predictions:    9643/  10000 (96.43%), best:    9716/10000 (97.16%), error:      1308.43591, best error:       967.80267 on epoch:    70, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 107.5957260132s, input_fired_time: 2.1588234901, output_fired_time: 0.9972527623, propagate_forward_time: 40.2057151794, propagate_backward_time: 61.1711616516, weight_update_time: 0.1474130452, other_time: 3.0627708435
epoch time: 8.2366132736s, input_fired_time: 0.1458809525, output_fired_time: 0.0000000000, propagate_forward_time: 7.5603604317, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5303721428
validation[          , genome  3441] predictions:    9732/  10000 (97.32%), best:    9716/10000 (97.16%), error:       976.77911, best error:       967.80267 on epoch:    70, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 107.4099273682s, input_fired_time: 1.1469261646, output_fired_time: 1.0061881542, propagate_forward_time: 43.1981468201, propagate_backward_time: 59.0102043152, weight_update_time: 0.1470099241, other_time: 3.0484619141
epoch time: 8.3603553772s, input_fired_time: 0.1465094090, output_fired_time: 0.0000000000, propagate_forward_time: 7.6769413948, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5369048119
validation[          , genome  3441] predictions:    9683/  10000 (96.83%), best:    9716/10000 (97.16%), error:      1116.64636, best error:       967.80267 on epoch:    70, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 105.5685882568s, input_fired_time: 1.3450984955, output_fired_time: 0.9861889482, propagate_forward_time: 39.2505989075, propagate_backward_time: 59.9233436584, weight_update_time: 0.1468534470, other_time: 4.0633544922
epoch time: 8.9993143082s, input_fired_time: 0.1474369168, output_fired_time: 0.0000000000, propagate_forward_time: 8.3054943085, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5463829041
validation[          , genome  3441] predictions:    9684/  10000 (96.84%), best:    9716/10000 (97.16%), error:      1094.00549, best error:       967.80267 on epoch:    70, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 105.6443176270s, input_fired_time: 1.1416342258, output_fired_time: 0.9982080460, propagate_forward_time: 38.8409194946, propagate_backward_time: 61.5961875916, weight_update_time: 0.1597560048, other_time: 3.0673713684
epoch time: 8.1729993820s, input_fired_time: 0.1475718170, output_fired_time: 0.0000000000, propagate_forward_time: 7.4834680557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5419597626
validation[          , genome  3441] predictions:    9703/  10000 (97.03%), best:    9716/10000 (97.16%), error:       983.44659, best error:       967.80267 on epoch:    70, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 106.7872390747s, input_fired_time: 2.1585710049, output_fired_time: 2.0076196194, propagate_forward_time: 40.2944221497, propagate_backward_time: 59.2571830750, weight_update_time: 0.1477522552, other_time: 3.0694427490
epoch time: 8.1560144424s, input_fired_time: 0.1460720450, output_fired_time: 0.0000000000, propagate_forward_time: 7.4798502922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5300917625
validation[          , genome  3441] predictions:    9725/  10000 (97.25%), best:    9716/10000 (97.16%), error:       971.99994, best error:       967.80267 on epoch:    70, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 111.1324386597s, input_fired_time: 1.1791672707, output_fired_time: 1.0246969461, propagate_forward_time: 42.7006149292, propagate_backward_time: 63.1015434265, weight_update_time: 0.1520980299, other_time: 3.1264152527
epoch time: 8.2132520676s, input_fired_time: 0.1471754909, output_fired_time: 0.0000000000, propagate_forward_time: 7.5305252075, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5355510712
validation[          , genome  3441] predictions:    9663/  10000 (96.63%), best:    9716/10000 (97.16%), error:      1108.16040, best error:       967.80267 on epoch:    70, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 108.4848175049s, input_fired_time: 1.1573568583, output_fired_time: 1.0036885738, propagate_forward_time: 40.6088790894, propagate_backward_time: 61.6412620544, weight_update_time: 0.1481651068, other_time: 4.0736351013
epoch time: 8.1891822815s, input_fired_time: 0.1452407092, output_fired_time: 0.0000000000, propagate_forward_time: 7.5162692070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5276722908
validation[          , genome  3441] predictions:    9699/  10000 (96.99%), best:    9716/10000 (97.16%), error:      1014.02692, best error:       967.80267 on epoch:    70, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 106.1544418335s, input_fired_time: 1.1641368866, output_fired_time: 0.9886658788, propagate_forward_time: 39.1126518250, propagate_backward_time: 61.8281593323, weight_update_time: 0.1466599852, other_time: 3.0608329773
epoch time: 9.4952678680s, input_fired_time: 0.1500778794, output_fired_time: 0.0000000000, propagate_forward_time: 8.7964391708, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5487508774
validation[          , genome  3441] predictions:    9659/  10000 (96.59%), best:    9716/10000 (97.16%), error:      1206.83655, best error:       967.80267 on epoch:    70, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 106.3477706909s, input_fired_time: 1.1523873806, output_fired_time: 0.9871923327, propagate_forward_time: 40.9754676819, propagate_backward_time: 60.1605834961, weight_update_time: 0.1600043029, other_time: 3.0721397400
epoch time: 9.4327497482s, input_fired_time: 0.1490667015, output_fired_time: 0.0000000000, propagate_forward_time: 8.7278451920, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5558376312
validation[          , genome  3441] predictions:    9669/  10000 (96.69%), best:    9716/10000 (97.16%), error:      1143.26453, best error:       967.80267 on epoch:    70, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 106.3416290283s, input_fired_time: 1.1446859837, output_fired_time: 1.0039306879, propagate_forward_time: 39.2133178711, propagate_backward_time: 61.9144668579, weight_update_time: 0.1479071528, other_time: 3.0652313232
epoch time: 9.5473070145s, input_fired_time: 0.1527250707, output_fired_time: 0.0000000000, propagate_forward_time: 8.8468236923, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5477581024
validation[          , genome  3441] predictions:    9706/  10000 (97.06%), best:    9716/10000 (97.16%), error:      1004.87097, best error:       967.80267 on epoch:    70, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 106.5260467529s, input_fired_time: 1.1509261131, output_fired_time: 0.9921773672, propagate_forward_time: 40.0711441040, propagate_backward_time: 61.2574539185, weight_update_time: 0.1478759050, other_time: 3.0543441772
epoch time: 8.3514919281s, input_fired_time: 0.1476798505, output_fired_time: 0.0000000000, propagate_forward_time: 7.6802258492, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5235857964
validation[          , genome  3441] predictions:    9730/  10000 (97.30%), best:    9716/10000 (97.16%), error:       996.80658, best error:       967.80267 on epoch:    70, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 110.0835266113s, input_fired_time: 1.1555283070, output_fired_time: 1.0279923677, propagate_forward_time: 42.3423423767, propagate_backward_time: 62.4244728088, weight_update_time: 0.1485982537, other_time: 3.1331901550
epoch time: 8.2359247208s, input_fired_time: 0.1488531381, output_fired_time: 0.0000000000, propagate_forward_time: 7.5535817146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5334897041
validation[          , genome  3441] predictions:    9717/  10000 (97.17%), best:    9716/10000 (97.16%), error:       987.56128, best error:       967.80267 on epoch:    70, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 107.6412277222s, input_fired_time: 1.1486129761, output_fired_time: 0.9976800084, propagate_forward_time: 39.2816352844, propagate_backward_time: 63.1857223511, weight_update_time: 0.1465964466, other_time: 3.0275802612
epoch time: 8.5103178024s, input_fired_time: 0.1459625363, output_fired_time: 0.0000000000, propagate_forward_time: 7.8098216057, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5545334816
validation[          , genome  3441] predictions:    9672/  10000 (96.72%), best:    9716/10000 (97.16%), error:      1095.64868, best error:       967.80267 on epoch:    70, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 109.4773178101s, input_fired_time: 1.1554424763, output_fired_time: 1.0532298088, propagate_forward_time: 43.8503837585, propagate_backward_time: 60.2905387878, weight_update_time: 0.1470147967, other_time: 3.1277236938
epoch time: 8.1748342514s, input_fired_time: 0.1462865323, output_fired_time: 0.0000000000, propagate_forward_time: 7.5004639626, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5280833244
validation[          , genome  3441] predictions:    9675/  10000 (96.75%), best:    9716/10000 (97.16%), error:      1125.66492, best error:       967.80267 on epoch:    70, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 106.4930267334s, input_fired_time: 1.1513757706, output_fired_time: 1.0073865652, propagate_forward_time: 39.2499160767, propagate_backward_time: 62.0167160034, weight_update_time: 0.1478925496, other_time: 3.0676345825
epoch time: 9.2859487534s, input_fired_time: 0.1518171430, output_fired_time: 0.0000000000, propagate_forward_time: 7.6734795570, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4606518745
validation[          , genome  3441] predictions:    9686/  10000 (96.86%), best:    9716/10000 (97.16%), error:      1053.31226, best error:       967.80267 on epoch:    70, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 106.3265838623s, input_fired_time: 1.1345664263, output_fired_time: 0.9934734702, propagate_forward_time: 39.1151771545, propagate_backward_time: 62.0413513184, weight_update_time: 0.1462305039, other_time: 3.0420074463
epoch time: 9.5694036484s, input_fired_time: 0.1465617120, output_fired_time: 0.0000000000, propagate_forward_time: 8.8685989380, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5542430878
validation[          , genome  3441] predictions:    9645/  10000 (96.45%), best:    9716/10000 (97.16%), error:      1177.97559, best error:       967.80267 on epoch:    70, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 106.6760025024s, input_fired_time: 1.1198400259, output_fired_time: 0.9973917603, propagate_forward_time: 40.2452049255, propagate_backward_time: 61.2837524414, weight_update_time: 0.1473574340, other_time: 3.0298156738
epoch time: 8.5272083282s, input_fired_time: 0.1441333145, output_fired_time: 0.0000000000, propagate_forward_time: 7.8180680275, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5650067329
validation[          , genome  3441] predictions:    9598/  10000 (95.98%), best:    9716/10000 (97.16%), error:      1333.50171, best error:       967.80267 on epoch:    70, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 108.0608444214s, input_fired_time: 1.1310280561, output_fired_time: 1.0020869970, propagate_forward_time: 40.3792037964, propagate_backward_time: 62.4743690491, weight_update_time: 0.1492363960, other_time: 3.0741539001
epoch time: 14.4961509705s, input_fired_time: 0.2316462100, output_fired_time: 0.0000000000, propagate_forward_time: 13.3636236191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9008808136
validation[          , genome  3441] predictions:    9691/  10000 (96.91%), best:    9716/10000 (97.16%), error:      1097.40259, best error:       967.80267 on epoch:    70, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 106.4389038086s, input_fired_time: 1.1256332397, output_fired_time: 0.9957235456, propagate_forward_time: 39.2116394043, propagate_backward_time: 62.0616416931, weight_update_time: 0.1476886421, other_time: 3.0442695618
epoch time: 8.1920785904s, input_fired_time: 0.1424796134, output_fired_time: 0.0000000000, propagate_forward_time: 7.5221667290, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5274319649
validation[          , genome  3441] predictions:    9692/  10000 (96.92%), best:    9716/10000 (97.16%), error:      1076.26819, best error:       967.80267 on epoch:    70, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 107.3859100342s, input_fired_time: 1.1267561913, output_fired_time: 0.9875947833, propagate_forward_time: 39.1600265503, propagate_backward_time: 63.0395202637, weight_update_time: 0.1486161947, other_time: 3.0720138550
epoch time: 8.2948169708s, input_fired_time: 0.1432189941, output_fired_time: 0.0000000000, propagate_forward_time: 7.6175355911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5340623856
validation[          , genome  3441] predictions:    9672/  10000 (96.72%), best:    9716/10000 (97.16%), error:      1135.20923, best error:       967.80267 on epoch:    70, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 105.6575088501s, input_fired_time: 1.1254227161, output_fired_time: 0.9939695597, propagate_forward_time: 38.3821411133, propagate_backward_time: 61.0997505188, weight_update_time: 0.1474258453, other_time: 4.0562248230
epoch time: 8.5418787003s, input_fired_time: 0.1491606086, output_fired_time: 0.0000000000, propagate_forward_time: 7.8412766457, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5514416695
validation[          , genome  3441] predictions:    9710/  10000 (97.10%), best:    9716/10000 (97.16%), error:      1005.54858, best error:       967.80267 on epoch:    70, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 105.5581283569s, input_fired_time: 1.1223489046, output_fired_time: 1.9963681698, propagate_forward_time: 38.8205337524, propagate_backward_time: 60.5883483887, weight_update_time: 0.1459783167, other_time: 3.0305252075
epoch time: 9.5237236023s, input_fired_time: 0.1508426815, output_fired_time: 0.0000000000, propagate_forward_time: 8.7943038940, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5785770416
validation[          , genome  3441] predictions:    9684/  10000 (96.84%), best:    9716/10000 (97.16%), error:      1104.15149, best error:       967.80267 on epoch:    70, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 118.8919906616s, input_fired_time: 2.1754727364, output_fired_time: 1.0839262009, propagate_forward_time: 46.4380607605, propagate_backward_time: 65.8846282959, weight_update_time: 0.1575288624, other_time: 3.3099060059
epoch time: 8.1681947708s, input_fired_time: 0.1426261812, output_fired_time: 0.0000000000, propagate_forward_time: 7.4959254265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5296435356
validation[          , genome  3441] predictions:    9697/  10000 (96.97%), best:    9716/10000 (97.16%), error:       996.06891, best error:       967.80267 on epoch:    70, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 106.3206558228s, input_fired_time: 1.1406062841, output_fired_time: 0.9913409352, propagate_forward_time: 42.0685958862, propagate_backward_time: 59.0293884277, weight_update_time: 0.1503232121, other_time: 3.0907211304
epoch time: 10.8502540588s, input_fired_time: 0.1821724921, output_fired_time: 0.0000000000, propagate_forward_time: 10.0260171890, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6420640945
validation[          , genome  3441] predictions:    9711/  10000 (97.11%), best:    9716/10000 (97.16%), error:      1024.97290, best error:       967.80267 on epoch:    70, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 44.1281318665s, input_fired_time: 0.7404011488, output_fired_time: 0.0000000000, propagate_forward_time: 40.5949096680, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7928199768
best training[          , genome  3441] predictions:   49411/  50000 (98.82%), best:    9716/10000 (97.16%), error:      2273.47339, best error:       967.80267 on epoch:    70, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 9.2658281326s, input_fired_time: 0.1468929946, output_fired_time: 0.0000000000, propagate_forward_time: 7.5679478645, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5509877205
   testing[          , genome  3441] predictions:    9740/  10000 (97.40%), best:    9716/10000 (97.16%), error:       829.50708, best error:       967.80267 on epoch:    70, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
07:27:55 (11996): called boinc_finish(0)

</stderr_txt>
]]>