Nameexact_genome_1512568488_42_6734_0
Workunit2604931
Created7 Dec 2017, 21:35:25 UTC
Sent7 Dec 2017, 21:41:03 UTC
Report deadline14 Dec 2017, 4:38:33 UTC
Received8 Dec 2017, 12:26:13 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID57373
Run time3 hours 26 min 16 sec
CPU time3 hours 25 min 23 sec
Validate stateValid
Credit1,572.49
Device peak FLOPS3.51 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size156.47 MB
Peak swap size159.69 MB
Peak disk usage1.94 MB

Stderr output

<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
000000000, weight_update_time: 0.0000000000, other_time: 0.5784063339
validation[          , genome  6734] predictions:    9723/  10000 (97.23%), best:    9723/10000 (97.23%), error:       972.04559, best error:       972.04559 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 110.3671340942s, input_fired_time: 1.6134324074, output_fired_time: 1.4522186518, propagate_forward_time: 40.9198684692, propagate_backward_time: 63.1072921753, weight_update_time: 0.1473581195, other_time: 3.2743225098
epoch time: 8.8693923950s, input_fired_time: 0.2020225823, output_fired_time: 0.0000000000, propagate_forward_time: 8.0842647552, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5831050873
validation[          , genome  6734] predictions:    9705/  10000 (97.05%), best:    9723/10000 (97.23%), error:       989.26050, best error:       972.04559 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 110.4622573853s, input_fired_time: 1.5990964174, output_fired_time: 1.4562911987, propagate_forward_time: 40.9774284363, propagate_backward_time: 63.2168464661, weight_update_time: 0.1464671344, other_time: 3.2125968933
epoch time: 9.0377340317s, input_fired_time: 0.2035256624, output_fired_time: 0.0000000000, propagate_forward_time: 8.2202472687, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6139612198
validation[          , genome  6734] predictions:    9684/  10000 (96.84%), best:    9723/10000 (97.23%), error:      1056.30981, best error:       972.04559 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 110.8679275513s, input_fired_time: 1.6102772951, output_fired_time: 1.4620416164, propagate_forward_time: 41.1136207581, propagate_backward_time: 63.4653320313, weight_update_time: 0.1470313370, other_time: 3.2166595459
epoch time: 8.9792594910s, input_fired_time: 0.2020132393, output_fired_time: 0.0000000000, propagate_forward_time: 8.1952810287, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5819654465
validation[          , genome  6734] predictions:    9701/  10000 (97.01%), best:    9701/10000 (97.01%), error:       968.05823, best error:       968.05823 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 111.0192871094s, input_fired_time: 1.6303058863, output_fired_time: 1.4743062258, propagate_forward_time: 41.1055450439, propagate_backward_time: 63.5226211548, weight_update_time: 0.1480910778, other_time: 3.2865142822
epoch time: 8.9325656891s, input_fired_time: 0.2034318447, output_fired_time: 0.0000000000, propagate_forward_time: 8.1579771042, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5711565018
validation[          , genome  6734] predictions:    9710/  10000 (97.10%), best:    9710/10000 (97.10%), error:       946.66821, best error:       946.66821 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 110.8714675903s, input_fired_time: 1.6309312582, output_fired_time: 1.4474978447, propagate_forward_time: 41.0393867493, propagate_backward_time: 63.4314727783, weight_update_time: 0.1535980552, other_time: 3.3221893311
epoch time: 9.3578624725s, input_fired_time: 0.2108634710, output_fired_time: 0.0000000000, propagate_forward_time: 8.5418338776, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6051654816
validation[          , genome  6734] predictions:    9698/  10000 (96.98%), best:    9710/10000 (97.10%), error:      1041.95691, best error:       946.66821 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 111.1010513306s, input_fired_time: 1.6168149710, output_fired_time: 1.4737312794, propagate_forward_time: 41.0786628723, propagate_backward_time: 63.6370658875, weight_update_time: 0.1493079364, other_time: 3.2947731018
epoch time: 8.9995536804s, input_fired_time: 0.2029941976, output_fired_time: 0.0000000000, propagate_forward_time: 8.2257328033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5708265305
validation[          , genome  6734] predictions:    9684/  10000 (96.84%), best:    9710/10000 (97.10%), error:      1111.42688, best error:       946.66821 on epoch:    18, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 110.7412033081s, input_fired_time: 1.6160306931, output_fired_time: 1.4587001801, propagate_forward_time: 41.0577697754, propagate_backward_time: 63.3247528076, weight_update_time: 0.1468480527, other_time: 3.2839508057
epoch time: 8.9318447113s, input_fired_time: 0.2017434686, output_fired_time: 0.0000000000, propagate_forward_time: 8.1457118988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5843896866
validation[          , genome  6734] predictions:    9694/  10000 (96.94%), best:    9710/10000 (97.10%), error:      1049.40857, best error:       946.66821 on epoch:    18, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 111.1702117920s, input_fired_time: 1.6052668095, output_fired_time: 1.4791204929, propagate_forward_time: 41.1660842896, propagate_backward_time: 63.6454772949, weight_update_time: 0.1472853720, other_time: 3.2742614746
epoch time: 8.9289054871s, input_fired_time: 0.2086400539, output_fired_time: 0.0000000000, propagate_forward_time: 8.1503095627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5699558258
validation[          , genome  6734] predictions:    9700/  10000 (97.00%), best:    9710/10000 (97.10%), error:      1016.02502, best error:       946.66821 on epoch:    18, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 110.9523696899s, input_fired_time: 1.6140327454, output_fired_time: 1.4527280331, propagate_forward_time: 40.9747123718, propagate_backward_time: 63.6372146606, weight_update_time: 0.1474303752, other_time: 3.2736740112
epoch time: 9.0490570068s, input_fired_time: 0.2053520977, output_fired_time: 0.0000000000, propagate_forward_time: 8.2638959885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5798091888
validation[          , genome  6734] predictions:    9692/  10000 (96.92%), best:    9710/10000 (97.10%), error:      1054.44556, best error:       946.66821 on epoch:    18, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 111.3279724121s, input_fired_time: 1.6270806789, output_fired_time: 1.4585117102, propagate_forward_time: 41.1241493225, propagate_backward_time: 63.7953376770, weight_update_time: 0.1475267559, other_time: 3.3228874207
epoch time: 8.9677228928s, input_fired_time: 0.2032815963, output_fired_time: 0.0000000000, propagate_forward_time: 8.1897611618, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5746803284
validation[          , genome  6734] predictions:    9730/  10000 (97.30%), best:    9730/10000 (97.30%), error:       940.30103, best error:       940.30103 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 111.2196350098s, input_fired_time: 1.6268569231, output_fired_time: 1.4675744772, propagate_forward_time: 41.1487388611, propagate_backward_time: 63.6592445374, weight_update_time: 0.1480426937, other_time: 3.3172264099
epoch time: 9.3860778809s, input_fired_time: 0.2121968716, output_fired_time: 0.0000000000, propagate_forward_time: 8.5608892441, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6129913330
validation[          , genome  6734] predictions:    9700/  10000 (97.00%), best:    9730/10000 (97.30%), error:       985.86920, best error:       940.30103 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 111.4498901367s, input_fired_time: 1.6323837042, output_fired_time: 1.4849312305, propagate_forward_time: 41.1573677063, propagate_backward_time: 63.8212776184, weight_update_time: 0.1537957639, other_time: 3.3539237976
epoch time: 8.9191255569s, input_fired_time: 0.2025555521, output_fired_time: 0.0000000000, propagate_forward_time: 8.1456928253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5708770752
validation[          , genome  6734] predictions:    9719/  10000 (97.19%), best:    9730/10000 (97.30%), error:       950.38574, best error:       940.30103 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 112.8828964233s, input_fired_time: 1.6699815989, output_fired_time: 1.4890605211, propagate_forward_time: 41.6413764954, propagate_backward_time: 64.5911941528, weight_update_time: 0.1530840844, other_time: 3.4912796021
epoch time: 9.0558671951s, input_fired_time: 0.2048684210, output_fired_time: 0.0000000000, propagate_forward_time: 8.2494354248, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6015634537
validation[          , genome  6734] predictions:    9679/  10000 (96.79%), best:    9730/10000 (97.30%), error:      1049.91528, best error:       940.30103 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 111.7090759277s, input_fired_time: 1.6495548487, output_fired_time: 1.4534281492, propagate_forward_time: 41.1867027283, propagate_backward_time: 64.0303649902, weight_update_time: 0.1512779593, other_time: 3.3890228271
epoch time: 8.9301671982s, input_fired_time: 0.2038246542, output_fired_time: 0.0000000000, propagate_forward_time: 8.1499805450, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5763616562
validation[          , genome  6734] predictions:    9681/  10000 (96.81%), best:    9730/10000 (97.30%), error:      1067.31970, best error:       940.30103 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 112.7283630371s, input_fired_time: 1.6623394489, output_fired_time: 1.4652090073, propagate_forward_time: 41.5550918579, propagate_backward_time: 64.6468734741, weight_update_time: 0.1617980152, other_time: 3.3988494873
epoch time: 9.0287008286s, input_fired_time: 0.2042777538, output_fired_time: 0.0000000000, propagate_forward_time: 8.2479066849, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5765161514
validation[          , genome  6734] predictions:    9725/  10000 (97.25%), best:    9725/10000 (97.25%), error:       880.55444, best error:       880.55444 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 112.3104095459s, input_fired_time: 1.6746335030, output_fired_time: 1.4787000418, propagate_forward_time: 41.2546806335, propagate_backward_time: 64.4357223511, weight_update_time: 0.1569437534, other_time: 3.4666671753
epoch time: 8.9453248978s, input_fired_time: 0.2032786608, output_fired_time: 0.0000000000, propagate_forward_time: 8.1650609970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5769853592
validation[          , genome  6734] predictions:    9723/  10000 (97.23%), best:    9725/10000 (97.25%), error:       933.28271, best error:       880.55444 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 111.6035156250s, input_fired_time: 1.6300063133, output_fired_time: 1.4623945951, propagate_forward_time: 41.1446418762, propagate_backward_time: 64.0380477905, weight_update_time: 0.1478676200, other_time: 3.3284225464
epoch time: 9.0098199844s, input_fired_time: 0.2139414400, output_fired_time: 0.0000000000, propagate_forward_time: 8.2013120651, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5945663452
validation[          , genome  6734] predictions:    9699/  10000 (96.99%), best:    9725/10000 (97.25%), error:      1049.74329, best error:       880.55444 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 112.9194259644s, input_fired_time: 1.6611502171, output_fired_time: 1.4699640274, propagate_forward_time: 41.5647583008, propagate_backward_time: 64.7803955078, weight_update_time: 0.1480568945, other_time: 3.4431610107
epoch time: 8.9643783569s, input_fired_time: 0.2093411833, output_fired_time: 0.0000000000, propagate_forward_time: 8.1813058853, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5737314224
validation[          , genome  6734] predictions:    9668/  10000 (96.68%), best:    9725/10000 (97.25%), error:      1086.92200, best error:       880.55444 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 112.3208084106s, input_fired_time: 1.6661018133, output_fired_time: 1.4642784595, propagate_forward_time: 41.3591423035, propagate_backward_time: 64.4925765991, weight_update_time: 0.1587190926, other_time: 3.3387069702
epoch time: 8.7003536224s, input_fired_time: 0.2089246958, output_fired_time: 0.0000000000, propagate_forward_time: 7.9239764214, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5674529076
validation[          , genome  6734] predictions:    9672/  10000 (96.72%), best:    9725/10000 (97.25%), error:      1093.65894, best error:       880.55444 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 112.0218200684s, input_fired_time: 1.6072797775, output_fired_time: 1.4612319469, propagate_forward_time: 41.2182350159, propagate_backward_time: 64.5283355713, weight_update_time: 0.1464475691, other_time: 3.2067413330
epoch time: 9.0020380020s, input_fired_time: 0.2047236711, output_fired_time: 0.0000000000, propagate_forward_time: 8.2170381546, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5802764893
validation[          , genome  6734] predictions:    9727/  10000 (97.27%), best:    9725/10000 (97.25%), error:       915.51563, best error:       880.55444 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 112.2447509766s, input_fired_time: 1.6611194611, output_fired_time: 1.4755488634, propagate_forward_time: 41.2440185547, propagate_backward_time: 64.4283981323, weight_update_time: 0.1524947137, other_time: 3.4356689453
epoch time: 8.9942502975s, input_fired_time: 0.2062385827, output_fired_time: 0.0000000000, propagate_forward_time: 8.2070865631, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5809249878
validation[          , genome  6734] predictions:    9734/  10000 (97.34%), best:    9725/10000 (97.25%), error:       935.62067, best error:       880.55444 on epoch:    29, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 113.1827392578s, input_fired_time: 1.6595865488, output_fired_time: 1.4639306068, propagate_forward_time: 41.5145454407, propagate_backward_time: 65.0680465698, weight_update_time: 0.1504895091, other_time: 3.4766311646
epoch time: 8.9461231232s, input_fired_time: 0.2036572397, output_fired_time: 0.0000000000, propagate_forward_time: 8.1719970703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5704689026
validation[          , genome  6734] predictions:    9716/  10000 (97.16%), best:    9725/10000 (97.25%), error:       954.56702, best error:       880.55444 on epoch:    29, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 113.4507980347s, input_fired_time: 1.6801552773, output_fired_time: 1.4755651951, propagate_forward_time: 41.6884269714, propagate_backward_time: 65.1675796509, weight_update_time: 0.1531220227, other_time: 3.4390792847
epoch time: 8.8330907822s, input_fired_time: 0.2058250457, output_fired_time: 0.0000000000, propagate_forward_time: 8.0629072189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5643587112
validation[          , genome  6734] predictions:    9667/  10000 (96.67%), best:    9725/10000 (97.25%), error:      1028.47852, best error:       880.55444 on epoch:    29, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 111.8978576660s, input_fired_time: 1.6541968584, output_fired_time: 1.4634919167, propagate_forward_time: 41.0317306519, propagate_backward_time: 64.3864593506, weight_update_time: 0.1532636583, other_time: 3.3619766235
epoch time: 8.9219493866s, input_fired_time: 0.2048518211, output_fired_time: 0.0000000000, propagate_forward_time: 8.1413602829, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5757369995
validation[          , genome  6734] predictions:    9721/  10000 (97.21%), best:    9725/10000 (97.25%), error:       895.06464, best error:       880.55444 on epoch:    29, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 112.4624252319s, input_fired_time: 1.6536777020, output_fired_time: 1.4642590284, propagate_forward_time: 41.2346801758, propagate_backward_time: 64.6531143188, weight_update_time: 0.1489737630, other_time: 3.4566955566
epoch time: 9.0622014999s, input_fired_time: 0.2093326598, output_fired_time: 0.0000000000, propagate_forward_time: 8.2435264587, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6093425751
validation[          , genome  6734] predictions:    9715/  10000 (97.15%), best:    9725/10000 (97.25%), error:       934.22760, best error:       880.55444 on epoch:    29, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 112.1809768677s, input_fired_time: 1.6517469883, output_fired_time: 1.4723385572, propagate_forward_time: 41.1602287292, propagate_backward_time: 64.5055084229, weight_update_time: 0.1524533480, other_time: 3.3911590576
epoch time: 8.9634943008s, input_fired_time: 0.2089278847, output_fired_time: 0.0000000000, propagate_forward_time: 8.1563243866, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5982418060
validation[          , genome  6734] predictions:    9708/  10000 (97.08%), best:    9725/10000 (97.25%), error:       961.44958, best error:       880.55444 on epoch:    29, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 112.1246871948s, input_fired_time: 1.6289302111, output_fired_time: 1.4657018185, propagate_forward_time: 41.0755348206, propagate_backward_time: 64.6473388672, weight_update_time: 0.1480533332, other_time: 3.3071899414
epoch time: 9.2619419098s, input_fired_time: 0.2129044682, output_fired_time: 0.0000000000, propagate_forward_time: 8.4518165588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5972204208
validation[          , genome  6734] predictions:    9676/  10000 (96.76%), best:    9725/10000 (97.25%), error:      1027.60156, best error:       880.55444 on epoch:    29, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 112.2526397705s, input_fired_time: 1.6393412352, output_fired_time: 1.4709712267, propagate_forward_time: 41.2108459473, propagate_backward_time: 64.6489562988, weight_update_time: 0.1476136893, other_time: 3.2825241089
epoch time: 9.0119934082s, input_fired_time: 0.2116057575, output_fired_time: 0.0000000000, propagate_forward_time: 8.2202997208, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5800876617
validation[          , genome  6734] predictions:    9667/  10000 (96.67%), best:    9725/10000 (97.25%), error:      1090.52222, best error:       880.55444 on epoch:    29, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 111.4000854492s, input_fired_time: 1.6250591278, output_fired_time: 1.4589599371, propagate_forward_time: 40.8475151062, propagate_backward_time: 64.2147827148, weight_update_time: 0.1467745751, other_time: 3.2537689209
epoch time: 8.7978954315s, input_fired_time: 0.2032042593, output_fired_time: 0.0000000000, propagate_forward_time: 8.0269145966, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5677766800
validation[          , genome  6734] predictions:    9736/  10000 (97.36%), best:    9736/10000 (97.36%), error:       877.81531, best error:       877.81531 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 111.8225555420s, input_fired_time: 1.6127761602, output_fired_time: 1.4723968506, propagate_forward_time: 40.9636650085, propagate_backward_time: 64.5371398926, weight_update_time: 0.1471447796, other_time: 3.2365722656
epoch time: 8.9148960114s, input_fired_time: 0.2060718387, output_fired_time: 0.0000000000, propagate_forward_time: 8.1224117279, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5864124298
validation[          , genome  6734] predictions:    9709/  10000 (97.09%), best:    9736/10000 (97.36%), error:       959.43372, best error:       877.81531 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 111.7179946899s, input_fired_time: 1.6144721508, output_fired_time: 1.4668266773, propagate_forward_time: 40.9398918152, propagate_backward_time: 64.4964218140, weight_update_time: 0.1527776718, other_time: 3.2003860474
epoch time: 8.7423143387s, input_fired_time: 0.2024470419, output_fired_time: 0.0000000000, propagate_forward_time: 7.9748673439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5650000572
validation[          , genome  6734] predictions:    9716/  10000 (97.16%), best:    9736/10000 (97.36%), error:       893.62726, best error:       877.81531 on epoch:    43, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 111.6442871094s, input_fired_time: 1.6239899397, output_fired_time: 1.4620977640, propagate_forward_time: 40.9045677185, propagate_backward_time: 64.4190826416, weight_update_time: 0.1462184042, other_time: 3.2345428467
epoch time: 9.2023029327s, input_fired_time: 0.2332921624, output_fired_time: 0.0000000000, propagate_forward_time: 8.3434677124, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6255426407
validation[          , genome  6734] predictions:    9694/  10000 (96.94%), best:    9736/10000 (97.36%), error:      1002.40094, best error:       877.81531 on epoch:    43, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 112.6795196533s, input_fired_time: 1.6285305023, output_fired_time: 1.4709492922, propagate_forward_time: 41.2698173523, propagate_backward_time: 64.9916305542, weight_update_time: 0.1469370425, other_time: 3.3185958862
epoch time: 9.0563993454s, input_fired_time: 0.2197841257, output_fired_time: 0.0000000000, propagate_forward_time: 8.2260818481, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6105337143
validation[          , genome  6734] predictions:    9685/  10000 (96.85%), best:    9736/10000 (97.36%), error:      1102.35034, best error:       877.81531 on epoch:    43, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 112.2570495605s, input_fired_time: 1.6473284960, output_fired_time: 1.4776496887, propagate_forward_time: 41.1121902466, propagate_backward_time: 64.7223205566, weight_update_time: 0.1483265907, other_time: 3.2975540161
epoch time: 9.2148418427s, input_fired_time: 0.2136381418, output_fired_time: 0.0000000000, propagate_forward_time: 8.3753900528, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6258134842
validation[          , genome  6734] predictions:    9707/  10000 (97.07%), best:    9736/10000 (97.36%), error:       950.57916, best error:       877.81531 on epoch:    43, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 111.9604110718s, input_fired_time: 1.6357659101, output_fired_time: 1.4600270987, propagate_forward_time: 40.9706039429, propagate_backward_time: 64.6016235352, weight_update_time: 0.1479371339, other_time: 3.2923889160
epoch time: 9.1067895889s, input_fired_time: 0.2145507932, output_fired_time: 0.0000000000, propagate_forward_time: 8.2893047333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6029338837
validation[          , genome  6734] predictions:    9653/  10000 (96.53%), best:    9736/10000 (97.36%), error:      1102.24768, best error:       877.81531 on epoch:    43, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 111.6330566406s, input_fired_time: 1.6198679209, output_fired_time: 1.4574737549, propagate_forward_time: 40.8615875244, propagate_backward_time: 64.4329605103, weight_update_time: 0.1518294215, other_time: 3.2611694336
epoch time: 8.9469175339s, input_fired_time: 0.2064658850, output_fired_time: 0.0000000000, propagate_forward_time: 8.1673069000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5731449127
validation[          , genome  6734] predictions:    9732/  10000 (97.32%), best:    9736/10000 (97.36%), error:       900.69177, best error:       877.81531 on epoch:    43, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 111.9116668701s, input_fired_time: 1.6400206089, output_fired_time: 1.4630035162, propagate_forward_time: 41.0004997253, propagate_backward_time: 64.5187759399, weight_update_time: 0.1479951143, other_time: 3.2893600464
epoch time: 8.9396305084s, input_fired_time: 0.2058810443, output_fired_time: 0.0000000000, propagate_forward_time: 8.1629076004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5708417892
validation[          , genome  6734] predictions:    9683/  10000 (96.83%), best:    9736/10000 (97.36%), error:      1106.18250, best error:       877.81531 on epoch:    43, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 113.4261703491s, input_fired_time: 1.6840838194, output_fired_time: 1.4851549864, propagate_forward_time: 41.4794769287, propagate_backward_time: 65.3879547119, weight_update_time: 0.1500441879, other_time: 3.3895034790
epoch time: 9.0321836472s, input_fired_time: 0.2124897689, output_fired_time: 0.0000000000, propagate_forward_time: 8.2343130112, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5853805542
validation[          , genome  6734] predictions:    9707/  10000 (97.07%), best:    9736/10000 (97.36%), error:       940.36292, best error:       877.81531 on epoch:    43, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 112.2903518677s, input_fired_time: 1.6368156672, output_fired_time: 1.4716769457, propagate_forward_time: 41.1084136963, propagate_backward_time: 64.7832260132, weight_update_time: 0.1506007463, other_time: 3.2902145386
epoch time: 8.8786697388s, input_fired_time: 0.2108023763, output_fired_time: 0.0000000000, propagate_forward_time: 8.0930500031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5748176575
validation[          , genome  6734] predictions:    9715/  10000 (97.15%), best:    9736/10000 (97.36%), error:       927.33429, best error:       877.81531 on epoch:    43, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 112.8332290649s, input_fired_time: 1.6840810776, output_fired_time: 1.4627636671, propagate_forward_time: 41.2156524658, propagate_backward_time: 65.0650405884, weight_update_time: 0.1505805254, other_time: 3.4056930542
epoch time: 9.0281095505s, input_fired_time: 0.2123559564, output_fired_time: 0.0000000000, propagate_forward_time: 8.2283391953, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5874147415
validation[          , genome  6734] predictions:    9721/  10000 (97.21%), best:    9736/10000 (97.36%), error:       902.16833, best error:       877.81531 on epoch:    43, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 112.2038421631s, input_fired_time: 1.6286005974, output_fired_time: 1.4733835459, propagate_forward_time: 41.0702934265, propagate_backward_time: 64.8030090332, weight_update_time: 0.1479131579, other_time: 3.2285614014
epoch time: 8.9551143646s, input_fired_time: 0.2076499313, output_fired_time: 0.0000000000, propagate_forward_time: 8.1741418839, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5733222961
validation[          , genome  6734] predictions:    9732/  10000 (97.32%), best:    9736/10000 (97.36%), error:       881.57800, best error:       877.81531 on epoch:    43, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 113.1102447510s, input_fired_time: 1.6653214693, output_fired_time: 1.4628170729, propagate_forward_time: 41.3299407959, propagate_backward_time: 65.2452774048, weight_update_time: 0.1482567042, other_time: 3.4068908691
epoch time: 9.0992937088s, input_fired_time: 0.2089725286, output_fired_time: 0.0000000000, propagate_forward_time: 8.2896413803, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6006793976
validation[          , genome  6734] predictions:    9743/  10000 (97.43%), best:    9736/10000 (97.36%), error:       893.02765, best error:       877.81531 on epoch:    43, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 113.7602844238s, input_fired_time: 1.6944148540, output_fired_time: 1.4990724325, propagate_forward_time: 41.5083541870, propagate_backward_time: 65.6018142700, weight_update_time: 0.1669503897, other_time: 3.4566345215
epoch time: 8.9510908127s, input_fired_time: 0.2084787339, output_fired_time: 0.0000000000, propagate_forward_time: 8.1721010208, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5705108643
validation[          , genome  6734] predictions:    9692/  10000 (96.92%), best:    9736/10000 (97.36%), error:      1001.80200, best error:       877.81531 on epoch:    43, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 113.5021743774s, input_fired_time: 1.6592640877, output_fired_time: 1.4979894161, propagate_forward_time: 41.3987846375, propagate_backward_time: 65.5245208740, weight_update_time: 0.1495458335, other_time: 3.4216156006
epoch time: 8.9654865265s, input_fired_time: 0.2082124650, output_fired_time: 0.0000000000, propagate_forward_time: 8.1862401962, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5710334778
validation[          , genome  6734] predictions:    9711/  10000 (97.11%), best:    9736/10000 (97.36%), error:      1008.73517, best error:       877.81531 on epoch:    43, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 112.6038818359s, input_fired_time: 1.6592140198, output_fired_time: 1.4673517942, propagate_forward_time: 41.1065711975, propagate_backward_time: 65.0023422241, weight_update_time: 0.1494556367, other_time: 3.3684005737
epoch time: 8.9524059296s, input_fired_time: 0.2100882828, output_fired_time: 0.0000000000, propagate_forward_time: 8.1709327698, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5713844299
validation[          , genome  6734] predictions:    9670/  10000 (96.70%), best:    9736/10000 (97.36%), error:      1031.04822, best error:       877.81531 on epoch:    43, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 113.7197647095s, input_fired_time: 1.6515942812, output_fired_time: 1.4882361889, propagate_forward_time: 41.4927024841, propagate_backward_time: 65.8016662598, weight_update_time: 0.1510099322, other_time: 3.2855682373
epoch time: 9.0684041977s, input_fired_time: 0.2137248516, output_fired_time: 0.0000000000, propagate_forward_time: 8.2627925873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5918865204
validation[          , genome  6734] predictions:    9674/  10000 (96.74%), best:    9736/10000 (97.36%), error:      1081.58948, best error:       877.81531 on epoch:    43, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 113.6316146851s, input_fired_time: 1.6679711342, output_fired_time: 1.4598504305, propagate_forward_time: 41.4581184387, propagate_backward_time: 65.5747985840, weight_update_time: 0.1493524909, other_time: 3.4708709717
epoch time: 8.9788112640s, input_fired_time: 0.2091127634, output_fired_time: 0.0000000000, propagate_forward_time: 8.1851167679, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5845813751
validation[          , genome  6734] predictions:    9755/  10000 (97.55%), best:    9755/10000 (97.55%), error:       842.96082, best error:       842.96082 on epoch:    61, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 113.6045837402s, input_fired_time: 1.6674096584, output_fired_time: 1.4894738197, propagate_forward_time: 41.5036888123, propagate_backward_time: 65.5346984863, weight_update_time: 0.1594595015, other_time: 3.4093170166
epoch time: 9.0319538116s, input_fired_time: 0.2196130604, output_fired_time: 0.0000000000, propagate_forward_time: 8.2081966400, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6041440964
validation[          , genome  6734] predictions:    9728/  10000 (97.28%), best:    9755/10000 (97.55%), error:       919.03961, best error:       842.96082 on epoch:    61, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 112.5868148804s, input_fired_time: 1.6293281317, output_fired_time: 1.4577895403, propagate_forward_time: 41.0506858826, propagate_backward_time: 65.1461563110, weight_update_time: 0.1470430493, other_time: 3.3028640747
epoch time: 9.3469505310s, input_fired_time: 0.2199112773, output_fired_time: 0.0000000000, propagate_forward_time: 8.5053024292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6217365265
validation[          , genome  6734] predictions:    9661/  10000 (96.61%), best:    9755/10000 (97.55%), error:      1076.79504, best error:       842.96082 on epoch:    61, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 114.4580307007s, input_fired_time: 1.6974636316, output_fired_time: 1.5373474360, propagate_forward_time: 41.6799087524, propagate_backward_time: 66.0982971191, weight_update_time: 0.1536176056, other_time: 3.4450149536
epoch time: 8.9531459808s, input_fired_time: 0.2086937279, output_fired_time: 0.0000000000, propagate_forward_time: 8.1670532227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5773992538
validation[          , genome  6734] predictions:    9731/  10000 (97.31%), best:    9755/10000 (97.55%), error:       862.01593, best error:       842.96082 on epoch:    61, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 113.4832077026s, input_fired_time: 1.6723870039, output_fired_time: 1.4771928787, propagate_forward_time: 41.3241539001, propagate_backward_time: 65.6106567383, weight_update_time: 0.1542080045, other_time: 3.3988189697
epoch time: 9.0198812485s, input_fired_time: 0.2225864679, output_fired_time: 0.0000000000, propagate_forward_time: 8.2068424225, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5904521942
validation[          , genome  6734] predictions:    9762/  10000 (97.62%), best:    9762/10000 (97.62%), error:       834.26251, best error:       834.26251 on epoch:    65, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 114.7574386597s, input_fired_time: 1.6897773743, output_fired_time: 1.5196224451, propagate_forward_time: 41.8436241150, propagate_backward_time: 66.2891616821, weight_update_time: 0.1559585631, other_time: 3.4152450562
epoch time: 8.9137935638s, input_fired_time: 0.2078136504, output_fired_time: 0.0000000000, propagate_forward_time: 8.1353244781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5706558228
validation[          , genome  6734] predictions:    9754/  10000 (97.54%), best:    9762/10000 (97.62%), error:       842.46863, best error:       834.26251 on epoch:    65, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 113.1192398071s, input_fired_time: 1.6662881374, output_fired_time: 1.4763813019, propagate_forward_time: 41.2342643738, propagate_backward_time: 65.3476486206, weight_update_time: 0.1579246819, other_time: 3.3946609497
epoch time: 8.7467279434s, input_fired_time: 0.2044535726, output_fired_time: 0.0000000000, propagate_forward_time: 7.9803009033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5619735718
validation[          , genome  6734] predictions:    9651/  10000 (96.51%), best:    9762/10000 (97.62%), error:      1204.12769, best error:       834.26251 on epoch:    65, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 112.8829345703s, input_fired_time: 1.6507186890, output_fired_time: 1.4691203833, propagate_forward_time: 41.1749038696, propagate_backward_time: 65.2556457520, weight_update_time: 0.1483372897, other_time: 3.3325424194
epoch time: 8.9081172943s, input_fired_time: 0.2085100263, output_fired_time: 0.0000000000, propagate_forward_time: 8.1253099442, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5742969513
validation[          , genome  6734] predictions:    9739/  10000 (97.39%), best:    9762/10000 (97.62%), error:       836.59595, best error:       834.26251 on epoch:    65, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 113.2358474731s, input_fired_time: 1.6561012268, output_fired_time: 1.4646677971, propagate_forward_time: 41.2499389648, propagate_backward_time: 65.4940490723, weight_update_time: 0.1496137679, other_time: 3.3710861206
epoch time: 9.0744705200s, input_fired_time: 0.2093396485, output_fired_time: 0.0000000000, propagate_forward_time: 8.2866487503, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5784816742
validation[          , genome  6734] predictions:    9733/  10000 (97.33%), best:    9762/10000 (97.62%), error:       886.21790, best error:       834.26251 on epoch:    65, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 113.8420104980s, input_fired_time: 1.6974332333, output_fired_time: 1.4791462421, propagate_forward_time: 41.5293273926, propagate_backward_time: 65.6753082275, weight_update_time: 0.1508076340, other_time: 3.4607925415
epoch time: 8.9418973923s, input_fired_time: 0.2079501301, output_fired_time: 0.0000000000, propagate_forward_time: 8.1588382721, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5751085281
validation[          , genome  6734] predictions:    9710/  10000 (97.10%), best:    9762/10000 (97.62%), error:       970.29163, best error:       834.26251 on epoch:    65, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 114.4117736816s, input_fired_time: 1.6820544004, output_fired_time: 1.4853444099, propagate_forward_time: 41.6553688049, propagate_backward_time: 66.1317520142, weight_update_time: 0.1552538276, other_time: 3.4572525024
epoch time: 9.1256866455s, input_fired_time: 0.2128231525, output_fired_time: 0.0000000000, propagate_forward_time: 8.2988204956, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6140432358
validation[          , genome  6734] predictions:    9718/  10000 (97.18%), best:    9762/10000 (97.62%), error:       920.59412, best error:       834.26251 on epoch:    65, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 112.6283950806s, input_fired_time: 1.6465398073, output_fired_time: 1.4676465988, propagate_forward_time: 41.0488586426, propagate_backward_time: 65.1780471802, weight_update_time: 0.1533379704, other_time: 3.2873077393
epoch time: 8.9311294556s, input_fired_time: 0.2091687769, output_fired_time: 0.0000000000, propagate_forward_time: 8.1481723785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5737886429
validation[          , genome  6734] predictions:    9721/  10000 (97.21%), best:    9762/10000 (97.62%), error:       932.06622, best error:       834.26251 on epoch:    65, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 113.2281036377s, input_fired_time: 1.6668541431, output_fired_time: 1.4604010582, propagate_forward_time: 41.4381752014, propagate_backward_time: 65.3375244141, weight_update_time: 0.1535231471, other_time: 3.3251495361
epoch time: 9.0266246796s, input_fired_time: 0.2135056853, output_fired_time: 0.0000000000, propagate_forward_time: 8.2008571625, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6122617722
validation[          , genome  6734] predictions:    9709/  10000 (97.09%), best:    9762/10000 (97.62%), error:       912.18579, best error:       834.26251 on epoch:    65, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 112.9787826538s, input_fired_time: 1.6825826168, output_fired_time: 1.4692195654, propagate_forward_time: 41.1480484009, propagate_backward_time: 65.3049316406, weight_update_time: 0.1498422474, other_time: 3.3740005493
epoch time: 9.0900907516s, input_fired_time: 0.2140086740, output_fired_time: 0.0000000000, propagate_forward_time: 8.2392683029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6368141174
validation[          , genome  6734] predictions:    9675/  10000 (96.75%), best:    9762/10000 (97.62%), error:      1058.81287, best error:       834.26251 on epoch:    65, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 111.5881729126s, input_fired_time: 1.6194456816, output_fired_time: 1.4479049444, propagate_forward_time: 40.6707115173, propagate_backward_time: 64.6271286011, weight_update_time: 0.1466786861, other_time: 3.2229843140
epoch time: 9.0336875916s, input_fired_time: 0.2161768526, output_fired_time: 0.0000000000, propagate_forward_time: 8.2288579941, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5886526108
validation[          , genome  6734] predictions:    9708/  10000 (97.08%), best:    9762/10000 (97.62%), error:       962.38672, best error:       834.26251 on epoch:    65, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 114.4535675049s, input_fired_time: 1.6834203005, output_fired_time: 1.4910242558, propagate_forward_time: 41.7578811646, propagate_backward_time: 66.0831451416, weight_update_time: 0.1495349109, other_time: 3.4380950928
epoch time: 8.9954299927s, input_fired_time: 0.2124518454, output_fired_time: 0.0000000000, propagate_forward_time: 8.1995620728, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5834159851
validation[          , genome  6734] predictions:    9732/  10000 (97.32%), best:    9762/10000 (97.62%), error:       915.30426, best error:       834.26251 on epoch:    65, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 113.2785568237s, input_fired_time: 1.6726105213, output_fired_time: 1.4868711233, propagate_forward_time: 41.3727760315, propagate_backward_time: 65.4085235596, weight_update_time: 0.1486166418, other_time: 3.3377838135
epoch time: 9.0866098404s, input_fired_time: 0.2123750597, output_fired_time: 0.0000000000, propagate_forward_time: 8.2806978226, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5935373306
validation[          , genome  6734] predictions:    9696/  10000 (96.96%), best:    9762/10000 (97.62%), error:      1013.59662, best error:       834.26251 on epoch:    65, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 113.1117553711s, input_fired_time: 1.6634697914, output_fired_time: 1.4591016769, propagate_forward_time: 41.3297805786, propagate_backward_time: 65.3224792480, weight_update_time: 0.1520151794, other_time: 3.3369293213
epoch time: 9.0267095566s, input_fired_time: 0.2150612473, output_fired_time: 0.0000000000, propagate_forward_time: 8.2327251434, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5789232254
validation[          , genome  6734] predictions:    9738/  10000 (97.38%), best:    9762/10000 (97.62%), error:       848.95355, best error:       834.26251 on epoch:    65, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 112.5658950806s, input_fired_time: 1.6544902325, output_fired_time: 1.4696642160, propagate_forward_time: 41.0801811218, propagate_backward_time: 65.0744705200, weight_update_time: 0.1488838494, other_time: 3.2870864868
epoch time: 9.0984735489s, input_fired_time: 0.2231559008, output_fired_time: 0.0000000000, propagate_forward_time: 8.2700147629, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6053028107
validation[          , genome  6734] predictions:    9638/  10000 (96.38%), best:    9762/10000 (97.62%), error:      1096.83972, best error:       834.26251 on epoch:    65, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 113.0435485840s, input_fired_time: 1.6600446701, output_fired_time: 1.4746797085, propagate_forward_time: 41.2324829102, propagate_backward_time: 65.3573303223, weight_update_time: 0.1533870697, other_time: 3.3190155029
epoch time: 9.0586614609s, input_fired_time: 0.2124531269, output_fired_time: 0.0000000000, propagate_forward_time: 8.2348155975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6113929749
validation[          , genome  6734] predictions:    9355/  10000 (93.55%), best:    9762/10000 (97.62%), error:      2311.13989, best error:       834.26251 on epoch:    65, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

resetting weights to those on epoch: 65
epoch time: 114.9210739136s, input_fired_time: 1.6924892664, output_fired_time: 1.4972450733, propagate_forward_time: 41.9665718079, propagate_backward_time: 66.2238159180, weight_update_time: 0.1566408277, other_time: 3.5409545898
epoch time: 8.9994878769s, input_fired_time: 0.2184954435, output_fired_time: 0.0000000000, propagate_forward_time: 8.1988677979, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5821247101
validation[          , genome  6734] predictions:    9750/  10000 (97.50%), best:    9762/10000 (97.62%), error:       835.20538, best error:       834.26251 on epoch:    65, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 112.5128707886s, input_fired_time: 1.6729732752, output_fired_time: 1.4601066113, propagate_forward_time: 41.0909652710, propagate_backward_time: 64.9408264160, weight_update_time: 0.1551828682, other_time: 3.3479995728
epoch time: 9.0793371201s, input_fired_time: 0.2130339295, output_fired_time: 0.0000000000, propagate_forward_time: 8.2815065384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5847969055
validation[          , genome  6734] predictions:    9683/  10000 (96.83%), best:    9762/10000 (97.62%), error:      1063.04651, best error:       834.26251 on epoch:    65, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 111.9752120972s, input_fired_time: 1.6289526224, output_fired_time: 1.4532735348, propagate_forward_time: 40.9251823425, propagate_backward_time: 64.7477340698, weight_update_time: 0.1469099820, other_time: 3.2200698853
epoch time: 9.1074647903s, input_fired_time: 0.2203548998, output_fired_time: 0.0000000000, propagate_forward_time: 8.3000001907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5871095657
validation[          , genome  6734] predictions:    9726/  10000 (97.26%), best:    9762/10000 (97.62%), error:       926.23224, best error:       834.26251 on epoch:    65, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 112.7985916138s, input_fired_time: 1.6933794022, output_fired_time: 1.4580662251, propagate_forward_time: 41.1995620728, propagate_backward_time: 65.0782852173, weight_update_time: 0.1515516490, other_time: 3.3692932129
epoch time: 8.9466476440s, input_fired_time: 0.2108927518, output_fired_time: 0.0000000000, propagate_forward_time: 8.1647415161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5710134506
validation[          , genome  6734] predictions:    9732/  10000 (97.32%), best:    9762/10000 (97.62%), error:       896.41357, best error:       834.26251 on epoch:    65, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 113.5784835815s, input_fired_time: 1.7217223644, output_fired_time: 1.4815827608, propagate_forward_time: 41.4139289856, propagate_backward_time: 65.4856948853, weight_update_time: 0.1562770307, other_time: 3.4755477905
epoch time: 9.0330448151s, input_fired_time: 0.2175115645, output_fired_time: 0.0000000000, propagate_forward_time: 8.2356433868, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5798902512
validation[          , genome  6734] predictions:    9730/  10000 (97.30%), best:    9762/10000 (97.62%), error:       878.25763, best error:       834.26251 on epoch:    65, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 113.0747528076s, input_fired_time: 1.6715309620, output_fired_time: 1.4689116478, propagate_forward_time: 41.3228187561, propagate_backward_time: 65.2384796143, weight_update_time: 0.1573353261, other_time: 3.3730163574
epoch time: 8.9394102097s, input_fired_time: 0.2114805728, output_fired_time: 0.0000000000, propagate_forward_time: 8.1556472778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5722827911
validation[          , genome  6734] predictions:    9729/  10000 (97.29%), best:    9762/10000 (97.62%), error:       913.31067, best error:       834.26251 on epoch:    65, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 111.8791885376s, input_fired_time: 1.6481729746, output_fired_time: 1.4483457804, propagate_forward_time: 40.8738098145, propagate_backward_time: 64.6398162842, weight_update_time: 0.1476349682, other_time: 3.2690429688
epoch time: 8.9192323685s, input_fired_time: 0.2083660364, output_fired_time: 0.0000000000, propagate_forward_time: 8.1258430481, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5850229263
validation[          , genome  6734] predictions:    9746/  10000 (97.46%), best:    9762/10000 (97.62%), error:       893.87738, best error:       834.26251 on epoch:    65, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 111.9522018433s, input_fired_time: 1.6506236792, output_fired_time: 1.4536702633, propagate_forward_time: 40.8964805603, propagate_backward_time: 64.7397003174, weight_update_time: 0.1483490318, other_time: 3.2117309570
epoch time: 8.9858531952s, input_fired_time: 0.2114524692, output_fired_time: 0.0000000000, propagate_forward_time: 8.2027549744, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5716457367
validation[          , genome  6734] predictions:    9720/  10000 (97.20%), best:    9762/10000 (97.62%), error:       942.82306, best error:       834.26251 on epoch:    65, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 112.7752838135s, input_fired_time: 1.6723208427, output_fired_time: 1.4701282978, propagate_forward_time: 41.0934486389, propagate_backward_time: 65.1956863403, weight_update_time: 0.1494280547, other_time: 3.3436965942
epoch time: 8.9035625458s, input_fired_time: 0.2087333798, output_fired_time: 0.0000000000, propagate_forward_time: 8.1226272583, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5722017288
validation[          , genome  6734] predictions:    9711/  10000 (97.11%), best:    9762/10000 (97.62%), error:       983.34772, best error:       834.26251 on epoch:    65, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 113.5680389404s, input_fired_time: 1.6790553331, output_fired_time: 1.4739452600, propagate_forward_time: 41.4488487244, propagate_backward_time: 65.5602264404, weight_update_time: 0.1574514359, other_time: 3.4059600830
epoch time: 9.3087654114s, input_fired_time: 0.2204294652, output_fired_time: 0.0000000000, propagate_forward_time: 8.4850063324, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6033296585
validation[          , genome  6734] predictions:    9704/  10000 (97.04%), best:    9762/10000 (97.62%), error:       914.93658, best error:       834.26251 on epoch:    65, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 113.4793701172s, input_fired_time: 1.6969287395, output_fired_time: 1.4617023468, propagate_forward_time: 41.3389511108, propagate_backward_time: 65.5236587524, weight_update_time: 0.1500210017, other_time: 3.4581298828
epoch time: 9.0827665329s, input_fired_time: 0.2126722783, output_fired_time: 0.0000000000, propagate_forward_time: 8.2872104645, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5828838348
validation[          , genome  6734] predictions:    9723/  10000 (97.23%), best:    9762/10000 (97.62%), error:       891.77313, best error:       834.26251 on epoch:    65, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 112.4005432129s, input_fired_time: 1.6441203356, output_fired_time: 1.4574285746, propagate_forward_time: 41.0840797424, propagate_backward_time: 64.9871673584, weight_update_time: 0.1483258754, other_time: 3.2277526855
epoch time: 9.0956726074s, input_fired_time: 0.2190639526, output_fired_time: 0.0000000000, propagate_forward_time: 8.2686891556, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6079196930
validation[          , genome  6734] predictions:    9742/  10000 (97.42%), best:    9762/10000 (97.62%), error:       853.24353, best error:       834.26251 on epoch:    65, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 112.9038925171s, input_fired_time: 1.6691616774, output_fired_time: 1.4994645119, propagate_forward_time: 41.1543807983, propagate_backward_time: 65.1721496582, weight_update_time: 0.1500187665, other_time: 3.4087371826
epoch time: 8.9359693527s, input_fired_time: 0.2126499861, output_fired_time: 0.0000000000, propagate_forward_time: 8.1509284973, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5723905563
validation[          , genome  6734] predictions:    9591/  10000 (95.91%), best:    9762/10000 (97.62%), error:      1426.11829, best error:       834.26251 on epoch:    65, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 112.3101577759s, input_fired_time: 1.6474207640, output_fired_time: 1.4553620815, propagate_forward_time: 40.9839553833, propagate_backward_time: 64.9610519409, weight_update_time: 0.1480712891, other_time: 3.2623672485
epoch time: 9.0445814133s, input_fired_time: 0.2116756737, output_fired_time: 0.0000000000, propagate_forward_time: 8.2534198761, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5794858932
validation[          , genome  6734] predictions:    9701/  10000 (97.01%), best:    9762/10000 (97.62%), error:       997.65637, best error:       834.26251 on epoch:    65, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 112.1415328979s, input_fired_time: 1.6612868309, output_fired_time: 1.4593120813, propagate_forward_time: 40.8849411011, propagate_backward_time: 64.8218994141, weight_update_time: 0.1543482542, other_time: 3.3140945435
epoch time: 9.0348558426s, input_fired_time: 0.2152536660, output_fired_time: 0.0000000000, propagate_forward_time: 8.2214689255, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5981330872
validation[          , genome  6734] predictions:    9716/  10000 (97.16%), best:    9762/10000 (97.62%), error:       976.44183, best error:       834.26251 on epoch:    65, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 112.4701690674s, input_fired_time: 1.6422723532, output_fired_time: 1.4553381205, propagate_forward_time: 41.0837821960, propagate_backward_time: 65.0176467896, weight_update_time: 0.1487309933, other_time: 3.2711257935
epoch time: 9.0377101898s, input_fired_time: 0.2158994675, output_fired_time: 0.0000000000, propagate_forward_time: 8.2139835358, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6078271866
validation[          , genome  6734] predictions:    9733/  10000 (97.33%), best:    9762/10000 (97.62%), error:       917.28491, best error:       834.26251 on epoch:    65, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 112.5751266479s, input_fired_time: 1.6491026878, output_fired_time: 1.4578816891, propagate_forward_time: 41.2446632385, propagate_backward_time: 64.9463500977, weight_update_time: 0.1485746503, other_time: 3.2771301270
epoch time: 9.2674503326s, input_fired_time: 0.2250965089, output_fired_time: 0.0000000000, propagate_forward_time: 8.4373426437, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6050109863
validation[          , genome  6734] predictions:    9716/  10000 (97.16%), best:    9762/10000 (97.62%), error:       947.83789, best error:       834.26251 on epoch:    65, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 113.3787155151s, input_fired_time: 1.6966478825, output_fired_time: 1.4709877968, propagate_forward_time: 41.2924346924, propagate_backward_time: 65.4985580444, weight_update_time: 0.1564576477, other_time: 3.4200897217
epoch time: 8.9176750183s, input_fired_time: 0.2106591761, output_fired_time: 0.0000000000, propagate_forward_time: 8.1166849136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5903310776
validation[          , genome  6734] predictions:    9717/  10000 (97.17%), best:    9762/10000 (97.62%), error:       944.45721, best error:       834.26251 on epoch:    65, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 113.9435119629s, input_fired_time: 1.6842629910, output_fired_time: 1.4668910503, propagate_forward_time: 41.4681205750, propagate_backward_time: 65.9378356934, weight_update_time: 0.1609006226, other_time: 3.3863983154
epoch time: 8.9488105774s, input_fired_time: 0.2136859596, output_fired_time: 0.0000000000, propagate_forward_time: 8.1602659225, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5748586655
validation[          , genome  6734] predictions:    9693/  10000 (96.93%), best:    9762/10000 (97.62%), error:      1014.00116, best error:       834.26251 on epoch:    65, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 113.8683776855s, input_fired_time: 1.6705636978, output_fired_time: 1.4661372900, propagate_forward_time: 41.5449752808, propagate_backward_time: 65.8490142822, weight_update_time: 0.1502033174, other_time: 3.3376846313
epoch time: 9.2384977341s, input_fired_time: 0.2248161137, output_fired_time: 0.0000000000, propagate_forward_time: 8.3938426971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6198387146
validation[          , genome  6734] predictions:    9745/  10000 (97.45%), best:    9745/10000 (97.45%), error:       819.17566, best error:       819.17566 on epoch:   100, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 45.5105514526s, input_fired_time: 1.0852270126, output_fired_time: 0.0000000000, propagate_forward_time: 41.3329849243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0923385620
best training[          , genome  6734] predictions:   49617/  50000 (99.23%), best:    9745/10000 (97.45%), error:      1582.66980, best error:       819.17566 on epoch:   100, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 9.0792226791s, input_fired_time: 0.2137863636, output_fired_time: 0.0000000000, propagate_forward_time: 8.2844009399, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5810356140
   testing[          , genome  6734] predictions:    9776/  10000 (97.76%), best:    9745/10000 (97.45%), error:       728.70129, best error:       819.17566 on epoch:   100, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
19:37:57 (6256): called boinc_finish(0)

</stderr_txt>
]]>