Nameexact_genome_1512568488_41_6899_1
Workunit2605811
Created7 Dec 2017, 22:45:08 UTC
Sent7 Dec 2017, 22:47:12 UTC
Report deadline14 Dec 2017, 7:37:16 UTC
Received8 Dec 2017, 11:13:57 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID51414
Run time3 hours 37 min 47 sec
CPU time3 hours 28 min 40 sec
Validate stateValid
Credit1,592.03
Device peak FLOPS2.56 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.62 MB
Peak swap size159.48 MB
Peak disk usage1.98 MB

Stderr output

<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
28979111, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6143627167
validation[          , genome  6899] predictions:    9676/  10000 (96.76%), best:    9729/10000 (97.29%), error:      1061.12805, best error:       920.35028 on epoch:     8, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 116.5208816528s, input_fired_time: 1.6325333118, output_fired_time: 1.6593235731, propagate_forward_time: 43.4607353210, propagate_backward_time: 66.3840637207, weight_update_time: 0.1587109864, other_time: 3.3842315674
epoch time: 9.4235181808s, input_fired_time: 0.1989217848, output_fired_time: 0.0000000000, propagate_forward_time: 8.6090755463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6155204773
validation[          , genome  6899] predictions:    9705/  10000 (97.05%), best:    9729/10000 (97.29%), error:      1014.75934, best error:       920.35028 on epoch:     8, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 115.3274841309s, input_fired_time: 1.6349056959, output_fired_time: 1.5983895063, propagate_forward_time: 42.9193496704, propagate_backward_time: 65.7577438354, weight_update_time: 0.1586332023, other_time: 3.4170989990
epoch time: 9.4712848663s, input_fired_time: 0.2052470446, output_fired_time: 0.0000000000, propagate_forward_time: 8.6088476181, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6571903229
validation[          , genome  6899] predictions:    9677/  10000 (96.77%), best:    9729/10000 (97.29%), error:      1045.97180, best error:       920.35028 on epoch:     8, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 115.6972351074s, input_fired_time: 1.6372250319, output_fired_time: 1.6159806252, propagate_forward_time: 43.1115493774, propagate_backward_time: 65.9680786133, weight_update_time: 0.1581078321, other_time: 3.3644027710
epoch time: 9.5233573914s, input_fired_time: 0.1992960572, output_fired_time: 0.0000000000, propagate_forward_time: 8.6798677444, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6441936493
validation[          , genome  6899] predictions:    9641/  10000 (96.41%), best:    9729/10000 (97.29%), error:      1201.60938, best error:       920.35028 on epoch:     8, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 115.1758041382s, input_fired_time: 1.6387898922, output_fired_time: 1.6000595093, propagate_forward_time: 42.8852386475, propagate_backward_time: 65.6974182129, weight_update_time: 0.1585906595, other_time: 3.3543014526
epoch time: 9.5890474319s, input_fired_time: 0.2021729797, output_fired_time: 0.0000000000, propagate_forward_time: 8.7562236786, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6306505203
validation[          , genome  6899] predictions:    9716/  10000 (97.16%), best:    9716/10000 (97.16%), error:       907.14246, best error:       907.14246 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 116.3167953491s, input_fired_time: 1.6383492947, output_fired_time: 1.6204506159, propagate_forward_time: 43.3512268066, propagate_backward_time: 66.2769851685, weight_update_time: 0.1734866798, other_time: 3.4297790527
epoch time: 9.4600505829s, input_fired_time: 0.2005264014, output_fired_time: 0.0000000000, propagate_forward_time: 8.6446571350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6148672104
validation[          , genome  6899] predictions:    9643/  10000 (96.43%), best:    9716/10000 (97.16%), error:      1189.34155, best error:       907.14246 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 115.2685775757s, input_fired_time: 1.6607413292, output_fired_time: 1.6011766195, propagate_forward_time: 42.9452438354, propagate_backward_time: 65.6796646118, weight_update_time: 0.1607364863, other_time: 3.3817520142
epoch time: 10.0227966309s, input_fired_time: 0.2170803845, output_fired_time: 0.0000000000, propagate_forward_time: 9.1359987259, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6697177887
validation[          , genome  6899] predictions:    9667/  10000 (96.67%), best:    9716/10000 (97.16%), error:      1115.32263, best error:       907.14246 on epoch:    18, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 116.0006942749s, input_fired_time: 1.6532196999, output_fired_time: 1.6161454916, propagate_forward_time: 43.1574554443, propagate_backward_time: 66.1812286377, weight_update_time: 0.1594668031, other_time: 3.3926467896
epoch time: 9.4525365829s, input_fired_time: 0.2016957700, output_fired_time: 0.0000000000, propagate_forward_time: 8.6306390762, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6202020645
validation[          , genome  6899] predictions:    9685/  10000 (96.85%), best:    9716/10000 (97.16%), error:      1044.98645, best error:       907.14246 on epoch:    18, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 115.7005920410s, input_fired_time: 1.6568838358, output_fired_time: 1.6402748823, propagate_forward_time: 43.1135711670, propagate_backward_time: 65.9086608887, weight_update_time: 0.1588047147, other_time: 3.3812026978
epoch time: 9.4689350128s, input_fired_time: 0.2325284034, output_fired_time: 0.0000000000, propagate_forward_time: 8.6333599091, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6030464172
validation[          , genome  6899] predictions:    9679/  10000 (96.79%), best:    9716/10000 (97.16%), error:      1013.84833, best error:       907.14246 on epoch:    18, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 116.4455642700s, input_fired_time: 1.6765552759, output_fired_time: 1.6050668955, propagate_forward_time: 43.5702247620, propagate_backward_time: 66.1557693481, weight_update_time: 0.1587227583, other_time: 3.4379501343
epoch time: 9.4805278778s, input_fired_time: 0.2037191838, output_fired_time: 0.0000000000, propagate_forward_time: 8.6483583450, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6284503937
validation[          , genome  6899] predictions:    9720/  10000 (97.20%), best:    9716/10000 (97.16%), error:       909.12732, best error:       907.14246 on epoch:    18, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 117.3821716309s, input_fired_time: 1.6568323374, output_fired_time: 1.6677161455, propagate_forward_time: 43.6904869080, propagate_backward_time: 66.9458618164, weight_update_time: 0.1588692218, other_time: 3.4212799072
epoch time: 9.4380683899s, input_fired_time: 0.2011929750, output_fired_time: 0.0000000000, propagate_forward_time: 8.6190900803, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6177854538
validation[          , genome  6899] predictions:    9705/  10000 (97.05%), best:    9716/10000 (97.16%), error:       967.89374, best error:       907.14246 on epoch:    18, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 116.6144332886s, input_fired_time: 1.6769889593, output_fired_time: 1.6225684881, propagate_forward_time: 43.3226928711, propagate_backward_time: 66.5107650757, weight_update_time: 0.1597011536, other_time: 3.4814224243
epoch time: 9.4468669891s, input_fired_time: 0.2071393430, output_fired_time: 0.0000000000, propagate_forward_time: 8.6266689301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6130590439
validation[          , genome  6899] predictions:    9604/  10000 (96.04%), best:    9716/10000 (97.16%), error:      1262.96631, best error:       907.14246 on epoch:    18, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 116.5943756104s, input_fired_time: 1.7192481756, output_fired_time: 1.5997134447, propagate_forward_time: 43.3742790222, propagate_backward_time: 66.4415130615, weight_update_time: 0.1645027846, other_time: 3.4596252441
epoch time: 9.4218931198s, input_fired_time: 0.2036336958, output_fired_time: 0.0000000000, propagate_forward_time: 8.5949420929, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6233177185
validation[          , genome  6899] predictions:    9721/  10000 (97.21%), best:    9716/10000 (97.16%), error:       960.44684, best error:       907.14246 on epoch:    18, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 116.5991744995s, input_fired_time: 1.6571925879, output_fired_time: 1.6276887655, propagate_forward_time: 43.4118766785, propagate_backward_time: 66.5136108398, weight_update_time: 0.1654259861, other_time: 3.3888092041
epoch time: 9.5347423553s, input_fired_time: 0.2033843398, output_fired_time: 0.0000000000, propagate_forward_time: 8.7127151489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6186428070
validation[          , genome  6899] predictions:    9726/  10000 (97.26%), best:    9716/10000 (97.16%), error:       934.58240, best error:       907.14246 on epoch:    18, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 116.5904159546s, input_fired_time: 1.6503124237, output_fired_time: 1.6104725599, propagate_forward_time: 43.5514221191, propagate_backward_time: 66.3931655884, weight_update_time: 0.1632882655, other_time: 3.3850402832
epoch time: 9.4170217514s, input_fired_time: 0.2053806633, output_fired_time: 0.0000000000, propagate_forward_time: 8.5967845917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6148567200
validation[          , genome  6899] predictions:    9709/  10000 (97.09%), best:    9716/10000 (97.16%), error:       973.74341, best error:       907.14246 on epoch:    18, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 114.6597595215s, input_fired_time: 1.6412771940, output_fired_time: 1.6062599421, propagate_forward_time: 42.6337699890, propagate_backward_time: 65.3697891235, weight_update_time: 0.1582229882, other_time: 3.4086685181
epoch time: 9.5574426651s, input_fired_time: 0.2031519264, output_fired_time: 0.0000000000, propagate_forward_time: 8.7276744843, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6266164780
validation[          , genome  6899] predictions:    9734/  10000 (97.34%), best:    9734/10000 (97.34%), error:       894.37726, best error:       894.37726 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 115.7186050415s, input_fired_time: 1.6440402269, output_fired_time: 1.6016885042, propagate_forward_time: 43.0392494202, propagate_backward_time: 66.0334396362, weight_update_time: 0.1583925039, other_time: 3.4001846313
epoch time: 9.5142278671s, input_fired_time: 0.2049561590, output_fired_time: 0.0000000000, propagate_forward_time: 8.6743726730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6348991394
validation[          , genome  6899] predictions:    9704/  10000 (97.04%), best:    9734/10000 (97.34%), error:       967.98352, best error:       894.37726 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 114.4097747803s, input_fired_time: 1.6577028036, output_fired_time: 1.5808426142, propagate_forward_time: 42.6642684937, propagate_backward_time: 65.1614074707, weight_update_time: 0.1572992802, other_time: 3.3455581665
epoch time: 8.7343683243s, input_fired_time: 0.1933665574, output_fired_time: 0.0000000000, propagate_forward_time: 7.9483728409, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5926284790
validation[          , genome  6899] predictions:    9726/  10000 (97.26%), best:    9734/10000 (97.34%), error:       914.47864, best error:       894.37726 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 116.0001525879s, input_fired_time: 1.6622470617, output_fired_time: 1.5975815058, propagate_forward_time: 43.2457809448, propagate_backward_time: 66.0702743530, weight_update_time: 0.1578226089, other_time: 3.4242706299
epoch time: 9.5565128326s, input_fired_time: 0.2045911551, output_fired_time: 0.0000000000, propagate_forward_time: 8.7283372879, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6235847473
validation[          , genome  6899] predictions:    9678/  10000 (96.78%), best:    9734/10000 (97.34%), error:       982.46252, best error:       894.37726 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 112.7371597290s, input_fired_time: 1.6213126183, output_fired_time: 1.5794656277, propagate_forward_time: 41.9027862549, propagate_backward_time: 64.2880859375, weight_update_time: 0.1579055935, other_time: 3.3455047607
epoch time: 9.4408712387s, input_fired_time: 0.2068726867, output_fired_time: 0.0000000000, propagate_forward_time: 8.6046886444, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6293096542
validation[          , genome  6899] predictions:    9728/  10000 (97.28%), best:    9728/10000 (97.28%), error:       866.17328, best error:       866.17328 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 116.6018524170s, input_fired_time: 1.6817576885, output_fired_time: 1.6534374952, propagate_forward_time: 43.4381370544, propagate_backward_time: 66.4194488525, weight_update_time: 0.1609120220, other_time: 3.4090728760
epoch time: 9.4799852371s, input_fired_time: 0.2061558366, output_fired_time: 0.0000000000, propagate_forward_time: 8.6508722305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6229572296
validation[          , genome  6899] predictions:    9748/  10000 (97.48%), best:    9748/10000 (97.48%), error:       844.71942, best error:       844.71942 on epoch:    34, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 116.3351745605s, input_fired_time: 1.6630895138, output_fired_time: 1.6323232651, propagate_forward_time: 43.4867095947, propagate_backward_time: 66.1703796387, weight_update_time: 0.1621086299, other_time: 3.3826751709
epoch time: 9.8046989441s, input_fired_time: 0.2237347513, output_fired_time: 0.0000000000, propagate_forward_time: 8.9523811340, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6285829544
validation[          , genome  6899] predictions:    9640/  10000 (96.40%), best:    9748/10000 (97.48%), error:      1127.37756, best error:       844.71942 on epoch:    34, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 115.7166290283s, input_fired_time: 1.6641662121, output_fired_time: 1.6484539509, propagate_forward_time: 43.0231742859, propagate_backward_time: 65.9894409180, weight_update_time: 0.1607272327, other_time: 3.3913879395
epoch time: 9.9291639328s, input_fired_time: 0.2414407879, output_fired_time: 0.0000000000, propagate_forward_time: 9.0442485809, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6434745789
validation[          , genome  6899] predictions:    9715/  10000 (97.15%), best:    9748/10000 (97.48%), error:       959.31415, best error:       844.71942 on epoch:    34, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 117.0843811035s, input_fired_time: 1.6724785566, output_fired_time: 1.6219891310, propagate_forward_time: 43.5813560486, propagate_backward_time: 66.8052978516, weight_update_time: 0.1612079889, other_time: 3.4032592773
epoch time: 9.5080137253s, input_fired_time: 0.2067410648, output_fired_time: 0.0000000000, propagate_forward_time: 8.6726818085, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6285905838
validation[          , genome  6899] predictions:    9713/  10000 (97.13%), best:    9748/10000 (97.48%), error:       908.90912, best error:       844.71942 on epoch:    34, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 117.0228424072s, input_fired_time: 1.6950057745, output_fired_time: 1.6564390659, propagate_forward_time: 43.4999542236, propagate_backward_time: 66.7298202515, weight_update_time: 0.1605290323, other_time: 3.4416198730
epoch time: 9.5436658859s, input_fired_time: 0.2052597851, output_fired_time: 0.0000000000, propagate_forward_time: 8.7185974121, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6198091507
validation[          , genome  6899] predictions:    9667/  10000 (96.67%), best:    9748/10000 (97.48%), error:      1069.47534, best error:       844.71942 on epoch:    34, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 116.2887420654s, input_fired_time: 1.6805608273, output_fired_time: 1.6345378160, propagate_forward_time: 43.4115142822, propagate_backward_time: 66.1057815552, weight_update_time: 0.2026002407, other_time: 3.4563522339
epoch time: 9.5217781067s, input_fired_time: 0.2067558616, output_fired_time: 0.0000000000, propagate_forward_time: 8.6945724487, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6204500198
validation[          , genome  6899] predictions:    9740/  10000 (97.40%), best:    9748/10000 (97.48%), error:       851.36633, best error:       844.71942 on epoch:    34, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 116.7310485840s, input_fired_time: 1.6624720097, output_fired_time: 1.6261342764, propagate_forward_time: 43.6071472168, propagate_backward_time: 66.4197845459, weight_update_time: 0.1602946371, other_time: 3.4155044556
epoch time: 9.4471788406s, input_fired_time: 0.2079319656, output_fired_time: 0.0000000000, propagate_forward_time: 8.6244277954, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6148195267
validation[          , genome  6899] predictions:    9723/  10000 (97.23%), best:    9748/10000 (97.48%), error:       928.42480, best error:       844.71942 on epoch:    34, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 116.8755722046s, input_fired_time: 1.6726727486, output_fired_time: 1.6073026657, propagate_forward_time: 43.5674285889, propagate_backward_time: 66.6132507324, weight_update_time: 0.1647720784, other_time: 3.4149169922
epoch time: 9.4754962921s, input_fired_time: 0.2055147737, output_fired_time: 0.0000000000, propagate_forward_time: 8.6530990601, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6168823242
validation[          , genome  6899] predictions:    9710/  10000 (97.10%), best:    9748/10000 (97.48%), error:       933.38812, best error:       844.71942 on epoch:    34, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 116.3087692261s, input_fired_time: 1.6617956161, output_fired_time: 1.6381314993, propagate_forward_time: 43.4013023376, propagate_backward_time: 66.1910018921, weight_update_time: 0.1592281014, other_time: 3.4165420532
epoch time: 9.6056480408s, input_fired_time: 0.2083287835, output_fired_time: 0.0000000000, propagate_forward_time: 8.7678117752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6295070648
validation[          , genome  6899] predictions:    9645/  10000 (96.45%), best:    9748/10000 (97.48%), error:      1241.55981, best error:       844.71942 on epoch:    34, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 116.7948837280s, input_fired_time: 1.7012220621, output_fired_time: 1.6484144926, propagate_forward_time: 43.4910125732, propagate_backward_time: 66.4815750122, weight_update_time: 0.1598189175, other_time: 3.4726562500
epoch time: 9.4563016891s, input_fired_time: 0.2068470269, output_fired_time: 0.0000000000, propagate_forward_time: 8.6272764206, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6221780777
validation[          , genome  6899] predictions:    9722/  10000 (97.22%), best:    9748/10000 (97.48%), error:       939.21326, best error:       844.71942 on epoch:    34, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 115.1702575684s, input_fired_time: 1.6750971079, output_fired_time: 1.6049768925, propagate_forward_time: 42.8535156250, propagate_backward_time: 65.5627517700, weight_update_time: 0.1584657580, other_time: 3.4739151001
epoch time: 9.5025053024s, input_fired_time: 0.2076754272, output_fired_time: 0.0000000000, propagate_forward_time: 8.6587009430, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6361293793
validation[          , genome  6899] predictions:    9727/  10000 (97.27%), best:    9748/10000 (97.48%), error:       898.91101, best error:       844.71942 on epoch:    34, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 116.6288833618s, input_fired_time: 1.6736884117, output_fired_time: 1.6286460161, propagate_forward_time: 43.4560813904, propagate_backward_time: 66.4430236816, weight_update_time: 0.1607015878, other_time: 3.4274444580
epoch time: 9.4630889893s, input_fired_time: 0.2044437081, output_fired_time: 0.0000000000, propagate_forward_time: 8.6286716461, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6299734116
validation[          , genome  6899] predictions:    9715/  10000 (97.15%), best:    9748/10000 (97.48%), error:       964.57471, best error:       844.71942 on epoch:    34, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 116.4657592773s, input_fired_time: 1.6846823692, output_fired_time: 1.6241973639, propagate_forward_time: 43.4355659485, propagate_backward_time: 66.3366699219, weight_update_time: 0.1589582413, other_time: 3.3846435547
epoch time: 9.4659976959s, input_fired_time: 0.2086354047, output_fired_time: 0.0000000000, propagate_forward_time: 8.6383104324, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6190519333
validation[          , genome  6899] predictions:    9729/  10000 (97.29%), best:    9748/10000 (97.48%), error:       923.41119, best error:       844.71942 on epoch:    34, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 115.6755142212s, input_fired_time: 1.6652308702, output_fired_time: 1.6319158077, propagate_forward_time: 43.1348800659, propagate_backward_time: 65.8436050415, weight_update_time: 0.1596490145, other_time: 3.3998870850
epoch time: 9.3963079453s, input_fired_time: 0.2069063634, output_fired_time: 0.0000000000, propagate_forward_time: 8.5688447952, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6205568314
validation[          , genome  6899] predictions:    9712/  10000 (97.12%), best:    9748/10000 (97.48%), error:       931.25549, best error:       844.71942 on epoch:    34, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 115.8873367310s, input_fired_time: 1.6781705618, output_fired_time: 1.6278736591, propagate_forward_time: 43.2506942749, propagate_backward_time: 65.9658355713, weight_update_time: 0.1593581587, other_time: 3.3647613525
epoch time: 9.3578176498s, input_fired_time: 0.2043499947, output_fired_time: 0.0000000000, propagate_forward_time: 8.5359630585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6175041199
validation[          , genome  6899] predictions:    9652/  10000 (96.52%), best:    9748/10000 (97.48%), error:      1132.96619, best error:       844.71942 on epoch:    34, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 116.3300704956s, input_fired_time: 1.6970483065, output_fired_time: 1.6303368807, propagate_forward_time: 43.3595733643, propagate_backward_time: 66.2531280518, weight_update_time: 0.1599556059, other_time: 3.3899765015
epoch time: 9.7538661957s, input_fired_time: 0.2194867730, output_fired_time: 0.0000000000, propagate_forward_time: 8.8921527863, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6422262192
validation[          , genome  6899] predictions:    9730/  10000 (97.30%), best:    9748/10000 (97.48%), error:       897.73090, best error:       844.71942 on epoch:    34, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 116.5992431641s, input_fired_time: 1.6997947693, output_fired_time: 1.6324695349, propagate_forward_time: 43.4401016235, propagate_backward_time: 66.3601684570, weight_update_time: 0.1594548374, other_time: 3.4667053223
epoch time: 9.7476797104s, input_fired_time: 0.2079053223, output_fired_time: 0.0000000000, propagate_forward_time: 8.9112596512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6285142899
validation[          , genome  6899] predictions:    9729/  10000 (97.29%), best:    9748/10000 (97.48%), error:       871.33026, best error:       844.71942 on epoch:    34, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 117.3182067871s, input_fired_time: 1.6834084988, output_fired_time: 1.6433051825, propagate_forward_time: 43.7861099243, propagate_backward_time: 66.7728195190, weight_update_time: 0.1638771147, other_time: 3.4325637817
epoch time: 9.4942159653s, input_fired_time: 0.2095743716, output_fired_time: 0.0000000000, propagate_forward_time: 8.6632671356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6213741302
validation[          , genome  6899] predictions:    9748/  10000 (97.48%), best:    9748/10000 (97.48%), error:       829.52539, best error:       829.52539 on epoch:    51, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 115.8360443115s, input_fired_time: 1.7003285885, output_fired_time: 1.6025999784, propagate_forward_time: 43.1429634094, propagate_backward_time: 66.0084609985, weight_update_time: 0.1589792371, other_time: 3.3816909790
epoch time: 9.6614542007s, input_fired_time: 0.2116162777, output_fired_time: 0.0000000000, propagate_forward_time: 8.8146343231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6352033615
validation[          , genome  6899] predictions:    9695/  10000 (96.95%), best:    9748/10000 (97.48%), error:       966.76862, best error:       829.52539 on epoch:    51, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 116.5751800537s, input_fired_time: 1.7138669491, output_fired_time: 1.6195882559, propagate_forward_time: 43.5089187622, propagate_backward_time: 66.3527374268, weight_update_time: 0.1589776725, other_time: 3.3800659180
epoch time: 9.5651168823s, input_fired_time: 0.2089139670, output_fired_time: 0.0000000000, propagate_forward_time: 8.7316541672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6245489120
validation[          , genome  6899] predictions:    9716/  10000 (97.16%), best:    9748/10000 (97.48%), error:       973.51288, best error:       829.52539 on epoch:    51, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 117.1867752075s, input_fired_time: 1.6807429790, output_fired_time: 1.6353918314, propagate_forward_time: 43.7430534363, propagate_backward_time: 66.7220153809, weight_update_time: 0.1638669223, other_time: 3.4055786133
epoch time: 9.4671487808s, input_fired_time: 0.2055445015, output_fired_time: 0.0000000000, propagate_forward_time: 8.6467485428, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6148557663
validation[          , genome  6899] predictions:    9728/  10000 (97.28%), best:    9748/10000 (97.48%), error:       905.92688, best error:       829.52539 on epoch:    51, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 116.3839416504s, input_fired_time: 1.7382680178, output_fired_time: 1.6151828766, propagate_forward_time: 43.3688926697, propagate_backward_time: 66.2689056396, weight_update_time: 0.1596857756, other_time: 3.3927001953
epoch time: 9.4290084839s, input_fired_time: 0.2069099844, output_fired_time: 0.0000000000, propagate_forward_time: 8.6080484390, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6140499115
validation[          , genome  6899] predictions:    9697/  10000 (96.97%), best:    9748/10000 (97.48%), error:       977.50916, best error:       829.52539 on epoch:    51, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 115.7822952271s, input_fired_time: 1.6785522699, output_fired_time: 1.6121596098, propagate_forward_time: 43.2582206726, propagate_backward_time: 65.8393554688, weight_update_time: 0.1607129723, other_time: 3.3940124512
epoch time: 9.6452713013s, input_fired_time: 0.2151931524, output_fired_time: 0.0000000000, propagate_forward_time: 8.8012752533, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6288032532
validation[          , genome  6899] predictions:    9722/  10000 (97.22%), best:    9748/10000 (97.48%), error:       884.15302, best error:       829.52539 on epoch:    51, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 117.0226745605s, input_fired_time: 1.7145297527, output_fired_time: 1.6377373934, propagate_forward_time: 43.6645698547, propagate_backward_time: 66.5811309814, weight_update_time: 0.1599116474, other_time: 3.4246978760
epoch time: 9.4749889374s, input_fired_time: 0.2093819082, output_fired_time: 0.0000000000, propagate_forward_time: 8.6518507004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6137561798
validation[          , genome  6899] predictions:    9734/  10000 (97.34%), best:    9748/10000 (97.48%), error:       896.85461, best error:       829.52539 on epoch:    51, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 115.7300872803s, input_fired_time: 1.6790385246, output_fired_time: 1.6224282980, propagate_forward_time: 43.1064834595, propagate_backward_time: 65.9307861328, weight_update_time: 0.1607615352, other_time: 3.3913497925
epoch time: 9.3209705353s, input_fired_time: 0.2052848637, output_fired_time: 0.0000000000, propagate_forward_time: 8.5008316040, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6148538589
validation[          , genome  6899] predictions:    9731/  10000 (97.31%), best:    9748/10000 (97.48%), error:       872.69904, best error:       829.52539 on epoch:    51, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 116.2146072388s, input_fired_time: 1.7032642365, output_fired_time: 1.6399962902, propagate_forward_time: 43.2556686401, propagate_backward_time: 66.1844558716, weight_update_time: 0.1605157703, other_time: 3.4312210083
epoch time: 9.6477079391s, input_fired_time: 0.2117350847, output_fired_time: 0.0000000000, propagate_forward_time: 8.8050060272, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6309671402
validation[          , genome  6899] predictions:    9724/  10000 (97.24%), best:    9748/10000 (97.48%), error:       920.39636, best error:       829.52539 on epoch:    51, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 116.2565612793s, input_fired_time: 1.6876052618, output_fired_time: 1.6104937792, propagate_forward_time: 43.4300613403, propagate_backward_time: 66.1066284180, weight_update_time: 0.1640666276, other_time: 3.4217681885
epoch time: 9.4545164108s, input_fired_time: 0.2075704485, output_fired_time: 0.0000000000, propagate_forward_time: 8.6239423752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6230039597
validation[          , genome  6899] predictions:    9680/  10000 (96.80%), best:    9748/10000 (97.48%), error:      1017.47064, best error:       829.52539 on epoch:    51, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 117.0566558838s, input_fired_time: 1.6761319637, output_fired_time: 1.6336200237, propagate_forward_time: 43.4973602295, propagate_backward_time: 66.7914428711, weight_update_time: 0.1686382443, other_time: 3.4580993652
epoch time: 9.6142873764s, input_fired_time: 0.2110531181, output_fired_time: 0.0000000000, propagate_forward_time: 8.7701253891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6331090927
validation[          , genome  6899] predictions:    9719/  10000 (97.19%), best:    9748/10000 (97.48%), error:       891.29346, best error:       829.52539 on epoch:    51, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 116.0368270874s, input_fired_time: 1.6841493845, output_fired_time: 1.6191552877, propagate_forward_time: 43.1490821838, propagate_backward_time: 66.1769027710, weight_update_time: 0.1589034796, other_time: 3.4075393677
epoch time: 9.4290876389s, input_fired_time: 0.2074040622, output_fired_time: 0.0000000000, propagate_forward_time: 8.6079368591, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6137466431
validation[          , genome  6899] predictions:    9725/  10000 (97.25%), best:    9748/10000 (97.48%), error:       851.29242, best error:       829.52539 on epoch:    51, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 116.9961624146s, input_fired_time: 1.6941494942, output_fired_time: 1.6635289192, propagate_forward_time: 43.6409530640, propagate_backward_time: 66.5714874268, weight_update_time: 0.1594445854, other_time: 3.4260406494
epoch time: 9.5584049225s, input_fired_time: 0.2447102964, output_fired_time: 0.0000000000, propagate_forward_time: 8.6722412109, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6414537430
validation[          , genome  6899] predictions:    9711/  10000 (97.11%), best:    9748/10000 (97.48%), error:       965.21106, best error:       829.52539 on epoch:    51, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 116.2851257324s, input_fired_time: 1.6976802349, output_fired_time: 1.6054912806, propagate_forward_time: 43.3233489990, propagate_backward_time: 66.2607955933, weight_update_time: 0.1599822342, other_time: 3.3978118896
epoch time: 9.5047597885s, input_fired_time: 0.2071838975, output_fired_time: 0.0000000000, propagate_forward_time: 8.6723375320, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6252384186
validation[          , genome  6899] predictions:    9694/  10000 (96.94%), best:    9748/10000 (97.48%), error:      1046.26733, best error:       829.52539 on epoch:    51, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 116.9754180908s, input_fired_time: 1.7160651684, output_fired_time: 1.6392617226, propagate_forward_time: 43.5831565857, propagate_backward_time: 66.5660476685, weight_update_time: 0.1606847942, other_time: 3.4708938599
epoch time: 9.4186191559s, input_fired_time: 0.2144972533, output_fired_time: 0.0000000000, propagate_forward_time: 8.5895338058, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6145877838
validation[          , genome  6899] predictions:    9711/  10000 (97.11%), best:    9748/10000 (97.48%), error:       939.66394, best error:       829.52539 on epoch:    51, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 116.2718658447s, input_fired_time: 1.6742267609, output_fired_time: 1.6281666756, propagate_forward_time: 43.3735313416, propagate_backward_time: 66.1712875366, weight_update_time: 0.1587063670, other_time: 3.4246597290
epoch time: 9.5308513641s, input_fired_time: 0.2131983936, output_fired_time: 0.0000000000, propagate_forward_time: 8.6844921112, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6331605911
validation[          , genome  6899] predictions:    9712/  10000 (97.12%), best:    9748/10000 (97.48%), error:       936.94598, best error:       829.52539 on epoch:    51, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 116.5468826294s, input_fired_time: 1.7173860073, output_fired_time: 1.6107650995, propagate_forward_time: 43.4520988464, propagate_backward_time: 66.3680038452, weight_update_time: 0.1622954905, other_time: 3.3986282349
epoch time: 9.4646434784s, input_fired_time: 0.2074204534, output_fired_time: 0.0000000000, propagate_forward_time: 8.6314125061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6258106232
validation[          , genome  6899] predictions:    9733/  10000 (97.33%), best:    9748/10000 (97.48%), error:       876.47797, best error:       829.52539 on epoch:    51, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 116.0893707275s, input_fired_time: 1.7297059298, output_fired_time: 1.6119185686, propagate_forward_time: 43.2394981384, propagate_backward_time: 66.1152343750, weight_update_time: 0.1591942757, other_time: 3.3930206299
epoch time: 9.4225711823s, input_fired_time: 0.2061435729, output_fired_time: 0.0000000000, propagate_forward_time: 8.5974235535, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6190042496
validation[          , genome  6899] predictions:    9727/  10000 (97.27%), best:    9748/10000 (97.48%), error:       914.14398, best error:       829.52539 on epoch:    51, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 115.9249420166s, input_fired_time: 1.7133898735, output_fired_time: 1.6497341394, propagate_forward_time: 43.2335700989, propagate_backward_time: 65.9244384766, weight_update_time: 0.1589849293, other_time: 3.4038085938
epoch time: 9.4979629517s, input_fired_time: 0.2086569071, output_fired_time: 0.0000000000, propagate_forward_time: 8.6645946503, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6247110367
validation[          , genome  6899] predictions:    9615/  10000 (96.15%), best:    9748/10000 (97.48%), error:      1336.41943, best error:       829.52539 on epoch:    51, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 117.8935241699s, input_fired_time: 1.7010748386, output_fired_time: 1.6507451534, propagate_forward_time: 43.8762245178, propagate_backward_time: 67.1666793823, weight_update_time: 0.1612258703, other_time: 3.4988021851
epoch time: 9.7922859192s, input_fired_time: 0.2097833157, output_fired_time: 0.0000000000, propagate_forward_time: 8.9500055313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6324968338
validation[          , genome  6899] predictions:    9726/  10000 (97.26%), best:    9748/10000 (97.48%), error:       917.54895, best error:       829.52539 on epoch:    51, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 116.7943878174s, input_fired_time: 1.7118904591, output_fired_time: 1.6144626141, propagate_forward_time: 43.5316276550, propagate_backward_time: 66.5584487915, weight_update_time: 0.1594600081, other_time: 3.3779525757
epoch time: 9.6457796097s, input_fired_time: 0.2125061303, output_fired_time: 0.0000000000, propagate_forward_time: 8.8111896515, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6220836639
validation[          , genome  6899] predictions:    9686/  10000 (96.86%), best:    9748/10000 (97.48%), error:      1041.66394, best error:       829.52539 on epoch:    51, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 115.5848083496s, input_fired_time: 1.6985648870, output_fired_time: 1.6568876505, propagate_forward_time: 43.1280479431, propagate_backward_time: 65.7082519531, weight_update_time: 0.1589602679, other_time: 3.3930511475
epoch time: 9.4656515121s, input_fired_time: 0.2100633532, output_fired_time: 0.0000000000, propagate_forward_time: 8.6199235916, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6356649399
validation[          , genome  6899] predictions:    9735/  10000 (97.35%), best:    9748/10000 (97.48%), error:       857.22302, best error:       829.52539 on epoch:    51, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 115.0365066528s, input_fired_time: 1.6915618181, output_fired_time: 1.5954806805, propagate_forward_time: 42.7417678833, propagate_backward_time: 65.5848159790, weight_update_time: 0.1588333249, other_time: 3.4228820801
epoch time: 9.2828950882s, input_fired_time: 0.2073001266, output_fired_time: 0.0000000000, propagate_forward_time: 8.4624528885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6131420135
validation[          , genome  6899] predictions:    9721/  10000 (97.21%), best:    9748/10000 (97.48%), error:       909.19672, best error:       829.52539 on epoch:    51, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 116.5260391235s, input_fired_time: 1.7099196911, output_fired_time: 1.6108945608, propagate_forward_time: 43.5620765686, propagate_backward_time: 66.2088012695, weight_update_time: 0.1595265418, other_time: 3.4343414307
epoch time: 9.4288873672s, input_fired_time: 0.2213944793, output_fired_time: 0.0000000000, propagate_forward_time: 8.5846185684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6228742599
validation[          , genome  6899] predictions:    9678/  10000 (96.78%), best:    9748/10000 (97.48%), error:      1000.37732, best error:       829.52539 on epoch:    51, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 117.7549591064s, input_fired_time: 1.7109003067, output_fired_time: 1.6085575819, propagate_forward_time: 43.8197402954, propagate_backward_time: 67.0171890259, weight_update_time: 0.1586397886, other_time: 3.5985717773
epoch time: 9.6861486435s, input_fired_time: 0.2136325538, output_fired_time: 0.0000000000, propagate_forward_time: 8.8424367905, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6300792694
validation[          , genome  6899] predictions:    9710/  10000 (97.10%), best:    9748/10000 (97.48%), error:       956.30988, best error:       829.52539 on epoch:    51, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 115.9497375488s, input_fired_time: 1.6785109043, output_fired_time: 1.6065042019, propagate_forward_time: 43.1645202637, propagate_backward_time: 66.1132965088, weight_update_time: 0.1590687931, other_time: 3.3869018555
epoch time: 9.3570070267s, input_fired_time: 0.2109542489, output_fired_time: 0.0000000000, propagate_forward_time: 8.5250558853, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6209964752
validation[          , genome  6899] predictions:    9574/  10000 (95.74%), best:    9748/10000 (97.48%), error:      1359.92297, best error:       829.52539 on epoch:    51, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 116.3408660889s, input_fired_time: 1.6901669502, output_fired_time: 1.6140009165, propagate_forward_time: 43.4036064148, propagate_backward_time: 66.1224060059, weight_update_time: 0.1634597629, other_time: 3.5106811523
epoch time: 9.4231643677s, input_fired_time: 0.2070840895, output_fired_time: 0.0000000000, propagate_forward_time: 8.5974302292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6186504364
validation[          , genome  6899] predictions:    9696/  10000 (96.96%), best:    9748/10000 (97.48%), error:      1017.71014, best error:       829.52539 on epoch:    51, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 117.2062759399s, input_fired_time: 1.7212322950, output_fired_time: 1.6326727867, propagate_forward_time: 43.6079368591, propagate_backward_time: 66.7899551392, weight_update_time: 0.1621085554, other_time: 3.4544754028
epoch time: 9.3830451965s, input_fired_time: 0.2091647983, output_fired_time: 0.0000000000, propagate_forward_time: 8.5468015671, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6270790100
validation[          , genome  6899] predictions:    9665/  10000 (96.65%), best:    9748/10000 (97.48%), error:      1081.18921, best error:       829.52539 on epoch:    51, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 116.4282989502s, input_fired_time: 1.7258929014, output_fired_time: 1.6290661097, propagate_forward_time: 43.3929405212, propagate_backward_time: 66.2859268188, weight_update_time: 0.1602899134, other_time: 3.3944778442
epoch time: 9.7072000504s, input_fired_time: 0.2132981718, output_fired_time: 0.0000000000, propagate_forward_time: 8.8244752884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6694269180
validation[          , genome  6899] predictions:    9697/  10000 (96.97%), best:    9748/10000 (97.48%), error:       955.10706, best error:       829.52539 on epoch:    51, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 116.2108306885s, input_fired_time: 1.7019687891, output_fired_time: 1.6666043997, propagate_forward_time: 43.2778930664, propagate_backward_time: 66.0971527100, weight_update_time: 0.1601737142, other_time: 3.4672164917
epoch time: 9.5047721863s, input_fired_time: 0.2137646079, output_fired_time: 0.0000000000, propagate_forward_time: 8.6671524048, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6238555908
validation[          , genome  6899] predictions:    9730/  10000 (97.30%), best:    9748/10000 (97.48%), error:       863.45563, best error:       829.52539 on epoch:    51, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 115.5884323120s, input_fired_time: 1.6857190132, output_fired_time: 1.6162656546, propagate_forward_time: 43.1647415161, propagate_backward_time: 65.6729888916, weight_update_time: 0.1593201607, other_time: 3.4487152100
epoch time: 9.5687618256s, input_fired_time: 0.2106644958, output_fired_time: 0.0000000000, propagate_forward_time: 8.7274427414, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6306543350
validation[          , genome  6899] predictions:    9709/  10000 (97.09%), best:    9748/10000 (97.48%), error:       883.88916, best error:       829.52539 on epoch:    51, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 117.9071273804s, input_fired_time: 1.7072194815, output_fired_time: 1.6488230228, propagate_forward_time: 43.9032020569, propagate_backward_time: 67.1057586670, weight_update_time: 0.1940390766, other_time: 3.5421142578
epoch time: 9.6341743469s, input_fired_time: 0.2129438668, output_fired_time: 0.0000000000, propagate_forward_time: 8.7935190201, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6277112961
validation[          , genome  6899] predictions:    9727/  10000 (97.27%), best:    9748/10000 (97.48%), error:       932.62213, best error:       829.52539 on epoch:    51, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 116.5339965820s, input_fired_time: 1.7259756327, output_fired_time: 1.6377699375, propagate_forward_time: 43.3697471619, propagate_backward_time: 66.3847579956, weight_update_time: 0.1601219624, other_time: 3.4157485962
epoch time: 9.6779737473s, input_fired_time: 0.2276500612, output_fired_time: 0.0000000000, propagate_forward_time: 8.8188619614, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6314620972
validation[          , genome  6899] predictions:    9731/  10000 (97.31%), best:    9748/10000 (97.48%), error:       952.19330, best error:       829.52539 on epoch:    51, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 116.8687057495s, input_fired_time: 1.6880346537, output_fired_time: 1.6431753635, propagate_forward_time: 43.6992340088, propagate_backward_time: 66.3966751099, weight_update_time: 0.1661709398, other_time: 3.4415893555
epoch time: 10.1751785278s, input_fired_time: 0.2099225819, output_fired_time: 0.0000000000, propagate_forward_time: 9.3341455460, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6311101913
validation[          , genome  6899] predictions:    9715/  10000 (97.15%), best:    9748/10000 (97.48%), error:       964.32025, best error:       829.52539 on epoch:    51, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 116.5860900879s, input_fired_time: 1.6855462790, output_fired_time: 1.6277692318, propagate_forward_time: 43.6094932556, propagate_backward_time: 66.2300720215, weight_update_time: 0.1609283686, other_time: 3.4332122803
epoch time: 9.4719467163s, input_fired_time: 0.2112061083, output_fired_time: 0.0000000000, propagate_forward_time: 8.6392946243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6214456558
validation[          , genome  6899] predictions:    9729/  10000 (97.29%), best:    9748/10000 (97.48%), error:       906.20587, best error:       829.52539 on epoch:    51, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 116.8076705933s, input_fired_time: 1.6937122345, output_fired_time: 1.6181647778, propagate_forward_time: 43.6324119568, propagate_backward_time: 66.4202270508, weight_update_time: 0.1979834139, other_time: 3.4431610107
epoch time: 9.5270032883s, input_fired_time: 0.2114580870, output_fired_time: 0.0000000000, propagate_forward_time: 8.6872777939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6282672882
validation[          , genome  6899] predictions:    9713/  10000 (97.13%), best:    9748/10000 (97.48%), error:       923.29767, best error:       829.52539 on epoch:    51, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 116.1779708862s, input_fired_time: 1.6860886812, output_fired_time: 1.6361887455, propagate_forward_time: 43.2468452454, propagate_backward_time: 66.1952362061, weight_update_time: 0.1608224660, other_time: 3.4136047363
epoch time: 9.5543375015s, input_fired_time: 0.2123049200, output_fired_time: 0.0000000000, propagate_forward_time: 8.7163190842, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6257133484
validation[          , genome  6899] predictions:    9744/  10000 (97.44%), best:    9748/10000 (97.48%), error:       834.63947, best error:       829.52539 on epoch:    51, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 117.6856689453s, input_fired_time: 1.6960688829, output_fired_time: 1.6296087503, propagate_forward_time: 43.9963874817, propagate_backward_time: 66.8791885376, weight_update_time: 0.1944142729, other_time: 3.4844131470
epoch time: 9.6349258423s, input_fired_time: 0.2096112967, output_fired_time: 0.0000000000, propagate_forward_time: 8.7902746201, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6350402832
validation[          , genome  6899] predictions:    9659/  10000 (96.59%), best:    9748/10000 (97.48%), error:      1123.66016, best error:       829.52539 on epoch:    51, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 116.0940551758s, input_fired_time: 1.6913157701, output_fired_time: 1.6751496792, propagate_forward_time: 43.1720848083, propagate_backward_time: 66.1072921753, weight_update_time: 0.1601511985, other_time: 3.4482192993
epoch time: 9.4902963638s, input_fired_time: 0.2103127241, output_fired_time: 0.0000000000, propagate_forward_time: 8.6493015289, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6306819916
validation[          , genome  6899] predictions:    9670/  10000 (96.70%), best:    9748/10000 (97.48%), error:      1073.41760, best error:       829.52539 on epoch:    51, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 117.1372299194s, input_fired_time: 1.7488917112, output_fired_time: 1.6314500570, propagate_forward_time: 43.6591567993, propagate_backward_time: 66.6558380127, weight_update_time: 0.1597994417, other_time: 3.4418945313
epoch time: 9.6232366562s, input_fired_time: 0.2104084492, output_fired_time: 0.0000000000, propagate_forward_time: 8.7954511642, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6173772812
validation[          , genome  6899] predictions:    9724/  10000 (97.24%), best:    9748/10000 (97.48%), error:       893.05231, best error:       829.52539 on epoch:    51, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 116.6127471924s, input_fired_time: 1.7052025795, output_fired_time: 1.6099826097, propagate_forward_time: 43.4404983521, propagate_backward_time: 66.4172439575, weight_update_time: 0.1614712030, other_time: 3.4398193359
epoch time: 9.6922216415s, input_fired_time: 0.2119567692, output_fired_time: 0.0000000000, propagate_forward_time: 8.8403711319, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6398935318
validation[          , genome  6899] predictions:    9656/  10000 (96.56%), best:    9748/10000 (97.48%), error:      1114.12488, best error:       829.52539 on epoch:    51, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 116.6209259033s, input_fired_time: 1.7155562639, output_fired_time: 1.6293021441, propagate_forward_time: 43.4805488586, propagate_backward_time: 66.3738098145, weight_update_time: 0.1597533971, other_time: 3.4217071533
epoch time: 9.3712730408s, input_fired_time: 0.2093245387, output_fired_time: 0.0000000000, propagate_forward_time: 8.5419368744, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6200113297
validation[          , genome  6899] predictions:    9573/  10000 (95.73%), best:    9748/10000 (97.48%), error:      1376.71765, best error:       829.52539 on epoch:    51, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 114.4829406738s, input_fired_time: 1.6883718967, output_fired_time: 1.6045485735, propagate_forward_time: 42.7424888611, propagate_backward_time: 65.0686874390, weight_update_time: 0.1583694667, other_time: 3.3788528442
epoch time: 9.5883636475s, input_fired_time: 0.2087884992, output_fired_time: 0.0000000000, propagate_forward_time: 8.7385168076, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6410579681
validation[          , genome  6899] predictions:    9720/  10000 (97.20%), best:    9748/10000 (97.48%), error:       957.14923, best error:       829.52539 on epoch:    51, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 116.6704254150s, input_fired_time: 1.6752274036, output_fired_time: 1.6319717169, propagate_forward_time: 43.5664253235, propagate_backward_time: 66.3574600220, weight_update_time: 0.1607343554, other_time: 3.4393386841
epoch time: 9.5567035675s, input_fired_time: 0.2089533508, output_fired_time: 0.0000000000, propagate_forward_time: 8.7117261887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6360244751
validation[          , genome  6899] predictions:    9737/  10000 (97.37%), best:    9748/10000 (97.48%), error:       873.85406, best error:       829.52539 on epoch:    51, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 114.7926483154s, input_fired_time: 1.6703422070, output_fired_time: 1.6029665470, propagate_forward_time: 42.5821952820, propagate_backward_time: 65.5287628174, weight_update_time: 0.1588906497, other_time: 3.4083862305
epoch time: 9.5495634079s, input_fired_time: 0.2126392573, output_fired_time: 0.0000000000, propagate_forward_time: 8.7104396820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6264848709
validation[          , genome  6899] predictions:    9703/  10000 (97.03%), best:    9748/10000 (97.48%), error:       982.29742, best error:       829.52539 on epoch:    51, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 116.0928573608s, input_fired_time: 1.6847621202, output_fired_time: 1.6316291094, propagate_forward_time: 43.5225143433, propagate_backward_time: 65.8645858765, weight_update_time: 0.1589643061, other_time: 3.3893661499
epoch time: 9.3811931610s, input_fired_time: 0.2069739550, output_fired_time: 0.0000000000, propagate_forward_time: 8.5480823517, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6261367798
validation[          , genome  6899] predictions:    9690/  10000 (96.90%), best:    9748/10000 (97.48%), error:      1009.16296, best error:       829.52539 on epoch:    51, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 116.0945434570s, input_fired_time: 1.7147986889, output_fired_time: 1.6244648695, propagate_forward_time: 43.1924667358, propagate_backward_time: 66.1568679810, weight_update_time: 0.1624991894, other_time: 3.4059448242
epoch time: 9.2851314545s, input_fired_time: 0.2059975863, output_fired_time: 0.0000000000, propagate_forward_time: 8.4694318771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6097021103
validation[          , genome  6899] predictions:    9735/  10000 (97.35%), best:    9748/10000 (97.48%), error:       888.75128, best error:       829.52539 on epoch:    51, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 119.0191955566s, input_fired_time: 1.7234716415, output_fired_time: 1.6885869503, propagate_forward_time: 44.4688224792, propagate_backward_time: 67.5723953247, weight_update_time: 0.1936500221, other_time: 3.5659255981
epoch time: 9.3003606796s, input_fired_time: 0.2107013166, output_fired_time: 0.0000000000, propagate_forward_time: 8.4718093872, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6178503036
validation[          , genome  6899] predictions:    9693/  10000 (96.93%), best:    9748/10000 (97.48%), error:       966.18079, best error:       829.52539 on epoch:    51, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 116.5047149658s, input_fired_time: 1.6930294037, output_fired_time: 1.6171818972, propagate_forward_time: 43.5362968445, propagate_backward_time: 66.2492141724, weight_update_time: 0.1640573889, other_time: 3.4089889526
epoch time: 9.4357872009s, input_fired_time: 0.2102769017, output_fired_time: 0.0000000000, propagate_forward_time: 8.6028070450, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6227035522
validation[          , genome  6899] predictions:    9671/  10000 (96.71%), best:    9748/10000 (97.48%), error:      1031.62012, best error:       829.52539 on epoch:    51, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 117.1828918457s, input_fired_time: 1.6982584000, output_fired_time: 1.6275454760, propagate_forward_time: 43.6972389221, propagate_backward_time: 66.7228088379, weight_update_time: 0.1605274826, other_time: 3.4370422363
epoch time: 9.7145605087s, input_fired_time: 0.2144783437, output_fired_time: 0.0000000000, propagate_forward_time: 8.8720235825, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6280584335
validation[          , genome  6899] predictions:    9717/  10000 (97.17%), best:    9748/10000 (97.48%), error:       945.64307, best error:       829.52539 on epoch:    51, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 48.7823295593s, input_fired_time: 1.0551673174, output_fired_time: 0.0000000000, propagate_forward_time: 44.3786849976, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3484764099
best training[          , genome  6899] predictions:   49499/  50000 (99.00%), best:    9748/10000 (97.48%), error:      1823.20251, best error:       829.52539 on epoch:    51, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 9.4396514893s, input_fired_time: 0.2231490165, output_fired_time: 0.0000000000, propagate_forward_time: 8.5821495056, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6343526840
   testing[          , genome  6899] predictions:    9783/  10000 (97.83%), best:    9748/10000 (97.48%), error:       724.37018, best error:       829.52539 on epoch:    51, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
11:30:28 (11004): called boinc_finish(0)

</stderr_txt>
]]>