Nameexact_genome_1512568488_41_6898_1
Workunit2605730
Created7 Dec 2017, 22:35:13 UTC
Sent7 Dec 2017, 22:42:51 UTC
Report deadline16 Dec 2017, 2:08:51 UTC
Received8 Dec 2017, 13:28:25 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID57373
Run time4 hours 12 min 22 sec
CPU time4 hours 11 min 19 sec
Validate stateValid
Credit2,035.77
Device peak FLOPS3.51 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.09 MB
Peak swap size158.49 MB
Peak disk usage1.84 MB

Stderr output

<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
), error:      1264.36597, best error:      1171.03699 on epoch:     6, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 136.5033264160s, input_fired_time: 1.4636132717, output_fired_time: 1.2946949005, propagate_forward_time: 51.0895843506, propagate_backward_time: 79.4457931519, weight_update_time: 0.1429662555, other_time: 3.2096481323
epoch time: 11.0180282593s, input_fired_time: 0.1815059185, output_fired_time: 0.0000000000, propagate_forward_time: 10.2730007172, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5635213852
validation[          , genome  6898] predictions:    9663/  10000 (96.63%), best:    9663/10000 (96.63%), error:      1139.88647, best error:      1139.88647 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 137.9381103516s, input_fired_time: 1.4378052950, output_fired_time: 1.3001110554, propagate_forward_time: 51.7384452820, propagate_backward_time: 80.2250671387, weight_update_time: 0.1504596919, other_time: 3.2366790771
epoch time: 11.0495023727s, input_fired_time: 0.1870020032, output_fired_time: 0.0000000000, propagate_forward_time: 10.2827901840, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5797100067
validation[          , genome  6898] predictions:    9633/  10000 (96.33%), best:    9663/10000 (96.63%), error:      1227.52844, best error:      1139.88647 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 136.6784973145s, input_fired_time: 1.4563682079, output_fired_time: 1.2750452757, propagate_forward_time: 51.1964225769, propagate_backward_time: 79.5781173706, weight_update_time: 0.1424525827, other_time: 3.1725387573
epoch time: 11.0141572952s, input_fired_time: 0.1814965755, output_fired_time: 0.0000000000, propagate_forward_time: 10.2585010529, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5741596222
validation[          , genome  6898] predictions:    9572/  10000 (95.72%), best:    9663/10000 (96.63%), error:      1432.26831, best error:      1139.88647 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 136.8643341064s, input_fired_time: 1.4345803261, output_fired_time: 1.2852864265, propagate_forward_time: 51.3491706848, propagate_backward_time: 79.6788711548, weight_update_time: 0.1402880400, other_time: 3.1164169312
epoch time: 10.8736085892s, input_fired_time: 0.1787887812, output_fired_time: 0.0000000000, propagate_forward_time: 10.1439037323, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5509157181
validation[          , genome  6898] predictions:    9651/  10000 (96.51%), best:    9663/10000 (96.63%), error:      1170.88672, best error:      1139.88647 on epoch:    15, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 136.0914001465s, input_fired_time: 1.4483652115, output_fired_time: 1.2752690315, propagate_forward_time: 50.9830665588, propagate_backward_time: 79.1760559082, weight_update_time: 0.1430821866, other_time: 3.2086486816
epoch time: 11.0346250534s, input_fired_time: 0.1786729246, output_fired_time: 0.0000000000, propagate_forward_time: 10.2848911285, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5710611343
validation[          , genome  6898] predictions:    9590/  10000 (95.90%), best:    9663/10000 (96.63%), error:      1313.59021, best error:      1139.88647 on epoch:    15, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 137.2889251709s, input_fired_time: 1.4745724201, output_fired_time: 1.3048191071, propagate_forward_time: 51.4742393494, propagate_backward_time: 79.7856216431, weight_update_time: 0.1486825198, other_time: 3.2496566772
epoch time: 11.0258569717s, input_fired_time: 0.1851457953, output_fired_time: 0.0000000000, propagate_forward_time: 10.2796897888, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5610218048
validation[          , genome  6898] predictions:    9651/  10000 (96.51%), best:    9663/10000 (96.63%), error:      1168.86890, best error:      1139.88647 on epoch:    15, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 137.7898101807s, input_fired_time: 1.4815586805, output_fired_time: 1.2797583342, propagate_forward_time: 51.6941642761, propagate_backward_time: 80.0997467041, weight_update_time: 0.1433920711, other_time: 3.2345886230
epoch time: 11.1989173889s, input_fired_time: 0.1840782762, output_fired_time: 0.0000000000, propagate_forward_time: 10.4543380737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5605010986
validation[          , genome  6898] predictions:    9706/  10000 (97.06%), best:    9706/10000 (97.06%), error:      1020.20807, best error:      1020.20807 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 137.6400299072s, input_fired_time: 1.4534231424, output_fired_time: 1.3085417747, propagate_forward_time: 51.5543251038, propagate_backward_time: 80.1776733398, weight_update_time: 0.1416161060, other_time: 3.1460571289
epoch time: 11.1933259964s, input_fired_time: 0.1918533444, output_fired_time: 0.0000000000, propagate_forward_time: 10.4351558685, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5663166046
validation[          , genome  6898] predictions:    9637/  10000 (96.37%), best:    9706/10000 (97.06%), error:      1184.30530, best error:      1020.20807 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 137.0770721436s, input_fired_time: 1.4444673061, output_fired_time: 1.2799706459, propagate_forward_time: 51.3666687012, propagate_backward_time: 79.7794418335, weight_update_time: 0.1468633115, other_time: 3.2065200806
epoch time: 11.0282983780s, input_fired_time: 0.1906884909, output_fired_time: 0.0000000000, propagate_forward_time: 10.2709712982, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5666389465
validation[          , genome  6898] predictions:    9601/  10000 (96.01%), best:    9706/10000 (97.06%), error:      1252.79456, best error:      1020.20807 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 136.8727111816s, input_fired_time: 1.4590345621, output_fired_time: 1.2870513201, propagate_forward_time: 51.2687225342, propagate_backward_time: 79.6526031494, weight_update_time: 0.1442440748, other_time: 3.2053070068
epoch time: 11.0422010422s, input_fired_time: 0.1867749244, output_fired_time: 0.0000000000, propagate_forward_time: 10.2811918259, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5742340088
validation[          , genome  6898] predictions:    9632/  10000 (96.32%), best:    9706/10000 (97.06%), error:      1171.67957, best error:      1020.20807 on epoch:    21, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 136.3545837402s, input_fired_time: 1.4667824507, output_fired_time: 1.2816598415, propagate_forward_time: 51.0308227539, propagate_backward_time: 79.3863906860, weight_update_time: 0.1440096796, other_time: 3.1889266968
epoch time: 10.9372835159s, input_fired_time: 0.1846853346, output_fired_time: 0.0000000000, propagate_forward_time: 10.1872692108, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5653285980
validation[          , genome  6898] predictions:    9674/  10000 (96.74%), best:    9706/10000 (97.06%), error:      1084.84534, best error:      1020.20807 on epoch:    21, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 136.5030822754s, input_fired_time: 1.4526200294, output_fired_time: 1.2814719677, propagate_forward_time: 51.0993690491, propagate_backward_time: 79.4323730469, weight_update_time: 0.1434121728, other_time: 3.2372436523
epoch time: 11.0333242416s, input_fired_time: 0.1828008741, output_fired_time: 0.0000000000, propagate_forward_time: 10.2870292664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5634937286
validation[          , genome  6898] predictions:    9666/  10000 (96.66%), best:    9706/10000 (97.06%), error:      1127.72693, best error:      1020.20807 on epoch:    21, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 136.7568817139s, input_fired_time: 1.4627712965, output_fired_time: 1.2841396332, propagate_forward_time: 51.2238044739, propagate_backward_time: 79.5805358887, weight_update_time: 0.1436062157, other_time: 3.2056427002
epoch time: 10.9997539520s, input_fired_time: 0.1810240149, output_fired_time: 0.0000000000, propagate_forward_time: 10.2568149567, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5619153976
validation[          , genome  6898] predictions:    9473/  10000 (94.73%), best:    9706/10000 (97.06%), error:      1682.28271, best error:      1020.20807 on epoch:    21, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 139.4961242676s, input_fired_time: 1.4680805206, output_fired_time: 1.3444169760, propagate_forward_time: 52.2796478271, propagate_backward_time: 81.1642379761, weight_update_time: 0.1509465277, other_time: 3.2397384644
epoch time: 11.0774002075s, input_fired_time: 0.1834529936, output_fired_time: 0.0000000000, propagate_forward_time: 10.3405323029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5534152985
validation[          , genome  6898] predictions:    9705/  10000 (97.05%), best:    9706/10000 (97.06%), error:      1033.38684, best error:      1020.20807 on epoch:    21, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 136.4217834473s, input_fired_time: 1.4428756237, output_fired_time: 1.2673630714, propagate_forward_time: 51.1457443237, propagate_backward_time: 79.3806152344, weight_update_time: 0.1472427547, other_time: 3.1851882935
epoch time: 11.2383680344s, input_fired_time: 0.1909083128, output_fired_time: 0.0000000000, propagate_forward_time: 10.4817819595, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5656776428
validation[          , genome  6898] predictions:    9679/  10000 (96.79%), best:    9706/10000 (97.06%), error:      1076.50928, best error:      1020.20807 on epoch:    21, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 137.6464996338s, input_fired_time: 1.4524600506, output_fired_time: 1.2893769741, propagate_forward_time: 51.5490875244, propagate_backward_time: 80.1706924438, weight_update_time: 0.1414652765, other_time: 3.1848831177
epoch time: 11.0767879486s, input_fired_time: 0.1898390055, output_fired_time: 0.0000000000, propagate_forward_time: 10.3081026077, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5788459778
validation[          , genome  6898] predictions:    9684/  10000 (96.84%), best:    9706/10000 (97.06%), error:      1057.70483, best error:      1020.20807 on epoch:    21, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 136.4949798584s, input_fired_time: 1.4535442591, output_fired_time: 1.2686080933, propagate_forward_time: 51.1711883545, propagate_backward_time: 79.4239196777, weight_update_time: 0.1423460841, other_time: 3.1777191162
epoch time: 11.0662670135s, input_fired_time: 0.1855844259, output_fired_time: 0.0000000000, propagate_forward_time: 10.3122901917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5683927536
validation[          , genome  6898] predictions:    9618/  10000 (96.18%), best:    9706/10000 (97.06%), error:      1184.88672, best error:      1020.20807 on epoch:    21, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 139.7904357910s, input_fired_time: 1.5038491488, output_fired_time: 1.2971911430, propagate_forward_time: 52.3269081116, propagate_backward_time: 81.4427795410, weight_update_time: 0.1450496912, other_time: 3.2197113037
epoch time: 10.8538837433s, input_fired_time: 0.1804434806, output_fired_time: 0.0000000000, propagate_forward_time: 10.1198482513, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5535917282
validation[          , genome  6898] predictions:    9688/  10000 (96.88%), best:    9688/10000 (96.88%), error:      1002.36945, best error:      1002.36945 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 137.0739746094s, input_fired_time: 1.4630659819, output_fired_time: 1.2788857222, propagate_forward_time: 51.3173522949, propagate_backward_time: 79.8389358521, weight_update_time: 0.1433916688, other_time: 3.1757431030
epoch time: 11.1639251709s, input_fired_time: 0.1944485158, output_fired_time: 0.0000000000, propagate_forward_time: 10.4065370560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5629396439
validation[          , genome  6898] predictions:    9689/  10000 (96.89%), best:    9688/10000 (96.88%), error:      1050.14978, best error:      1002.36945 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 137.0242919922s, input_fired_time: 1.4799934626, output_fired_time: 1.2919369936, propagate_forward_time: 51.3356285095, propagate_backward_time: 79.6993484497, weight_update_time: 0.1444319636, other_time: 3.2173843384
epoch time: 11.0972604752s, input_fired_time: 0.1839120090, output_fired_time: 0.0000000000, propagate_forward_time: 10.3406438828, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5727043152
validation[          , genome  6898] predictions:    9517/  10000 (95.17%), best:    9688/10000 (96.88%), error:      1517.22229, best error:      1002.36945 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 137.3381805420s, input_fired_time: 1.4640995264, output_fired_time: 1.2985272408, propagate_forward_time: 51.3775291443, propagate_backward_time: 79.9889678955, weight_update_time: 0.1429307908, other_time: 3.2090606689
epoch time: 11.0370140076s, input_fired_time: 0.1847306937, output_fired_time: 0.0000000000, propagate_forward_time: 10.2907905579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5614929199
validation[          , genome  6898] predictions:    9682/  10000 (96.82%), best:    9688/10000 (96.88%), error:      1078.06091, best error:      1002.36945 on epoch:    32, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 138.8482055664s, input_fired_time: 1.4741486311, output_fired_time: 1.2975465059, propagate_forward_time: 52.0539741516, propagate_backward_time: 80.7828750610, weight_update_time: 0.1434565336, other_time: 3.2396621704
epoch time: 11.3652658463s, input_fired_time: 0.1858693212, output_fired_time: 0.0000000000, propagate_forward_time: 10.5993289948, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5800676346
validation[          , genome  6898] predictions:    9689/  10000 (96.89%), best:    9688/10000 (96.88%), error:      1061.02771, best error:      1002.36945 on epoch:    32, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 137.6446533203s, input_fired_time: 1.4328638315, output_fired_time: 1.2776247263, propagate_forward_time: 51.6061553955, propagate_backward_time: 80.2041931152, weight_update_time: 0.1403174847, other_time: 3.1238250732
epoch time: 11.2641658783s, input_fired_time: 0.1826635301, output_fired_time: 0.0000000000, propagate_forward_time: 10.5037469864, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5777549744
validation[          , genome  6898] predictions:    9683/  10000 (96.83%), best:    9688/10000 (96.88%), error:      1061.10706, best error:      1002.36945 on epoch:    32, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 138.2109375000s, input_fired_time: 1.4878877401, output_fired_time: 1.3145078421, propagate_forward_time: 51.7016830444, propagate_backward_time: 80.4889450073, weight_update_time: 0.1478501558, other_time: 3.2179107666
epoch time: 11.0502967834s, input_fired_time: 0.1863109916, output_fired_time: 0.0000000000, propagate_forward_time: 10.3143768311, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5496091843
validation[          , genome  6898] predictions:    9660/  10000 (96.60%), best:    9688/10000 (96.88%), error:      1073.23047, best error:      1002.36945 on epoch:    32, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 137.3757934570s, input_fired_time: 1.4666900635, output_fired_time: 1.2784336805, propagate_forward_time: 51.4039192200, propagate_backward_time: 80.0199813843, weight_update_time: 0.1599694490, other_time: 3.2067794800
epoch time: 11.0269889832s, input_fired_time: 0.1870348454, output_fired_time: 0.0000000000, propagate_forward_time: 10.2879695892, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5519847870
validation[          , genome  6898] predictions:    9723/  10000 (97.23%), best:    9723/10000 (97.23%), error:       928.48334, best error:       928.48334 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 138.4451141357s, input_fired_time: 1.4650681019, output_fired_time: 1.2949410677, propagate_forward_time: 51.8082313538, propagate_backward_time: 80.6437835693, weight_update_time: 0.1438494921, other_time: 3.2330932617
epoch time: 11.0504226685s, input_fired_time: 0.1908328980, output_fired_time: 0.0000000000, propagate_forward_time: 10.2904081345, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5691814423
validation[          , genome  6898] predictions:    9689/  10000 (96.89%), best:    9723/10000 (97.23%), error:      1011.67999, best error:       928.48334 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 136.3691558838s, input_fired_time: 1.4450451136, output_fired_time: 1.2731282711, propagate_forward_time: 50.9847335815, propagate_backward_time: 79.4697265625, weight_update_time: 0.1427216977, other_time: 3.1965255737
epoch time: 11.0448331833s, input_fired_time: 0.1861158162, output_fired_time: 0.0000000000, propagate_forward_time: 10.2846355438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5740814209
validation[          , genome  6898] predictions:    9682/  10000 (96.82%), best:    9723/10000 (97.23%), error:      1060.73669, best error:       928.48334 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 136.8758087158s, input_fired_time: 1.4644273520, output_fired_time: 1.2853884697, propagate_forward_time: 51.3104476929, propagate_backward_time: 79.6109466553, weight_update_time: 0.1425180882, other_time: 3.2045974731
epoch time: 11.1295185089s, input_fired_time: 0.1842891276, output_fired_time: 0.0000000000, propagate_forward_time: 10.3725566864, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5726728439
validation[          , genome  6898] predictions:    9703/  10000 (97.03%), best:    9723/10000 (97.23%), error:      1047.29639, best error:       928.48334 on epoch:    39, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 136.6801452637s, input_fired_time: 1.4699957371, output_fired_time: 1.2857500315, propagate_forward_time: 51.1647911072, propagate_backward_time: 79.5527725220, weight_update_time: 0.1429226846, other_time: 3.2068252563
epoch time: 11.0589857101s, input_fired_time: 0.1872992069, output_fired_time: 0.0000000000, propagate_forward_time: 10.2984571457, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5732297897
validation[          , genome  6898] predictions:    9689/  10000 (96.89%), best:    9723/10000 (97.23%), error:      1022.11047, best error:       928.48334 on epoch:    39, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 139.2747497559s, input_fired_time: 1.4980219603, output_fired_time: 1.3023298979, propagate_forward_time: 52.2053337097, propagate_backward_time: 81.0303192139, weight_update_time: 0.1470529437, other_time: 3.2387542725
epoch time: 10.9150371552s, input_fired_time: 0.1894365996, output_fired_time: 0.0000000000, propagate_forward_time: 10.1597375870, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5658626556
validation[          , genome  6898] predictions:    9592/  10000 (95.92%), best:    9723/10000 (97.23%), error:      1250.88342, best error:       928.48334 on epoch:    39, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 137.1574249268s, input_fired_time: 1.4713284969, output_fired_time: 1.2913885117, propagate_forward_time: 51.3529624939, propagate_backward_time: 79.8296966553, weight_update_time: 0.1480928510, other_time: 3.2120513916
epoch time: 11.1504316330s, input_fired_time: 0.1884508878, output_fired_time: 0.0000000000, propagate_forward_time: 10.3965120316, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5654687881
validation[          , genome  6898] predictions:    9647/  10000 (96.47%), best:    9723/10000 (97.23%), error:      1162.20667, best error:       928.48334 on epoch:    39, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 137.7703704834s, input_fired_time: 1.4869453907, output_fired_time: 1.2878162861, propagate_forward_time: 51.6333312988, propagate_backward_time: 80.1280364990, weight_update_time: 0.1481453478, other_time: 3.2342529297
epoch time: 11.0660619736s, input_fired_time: 0.1938129216, output_fired_time: 0.0000000000, propagate_forward_time: 10.3160810471, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5561676025
validation[          , genome  6898] predictions:    9712/  10000 (97.12%), best:    9712/10000 (97.12%), error:       913.68231, best error:       913.68231 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 136.6685333252s, input_fired_time: 1.4820393324, output_fired_time: 1.2819488049, propagate_forward_time: 51.1371192932, propagate_backward_time: 79.5642623901, weight_update_time: 0.1435674429, other_time: 3.2031631470
epoch time: 11.0092840195s, input_fired_time: 0.1841443181, output_fired_time: 0.0000000000, propagate_forward_time: 10.2594022751, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5657377243
validation[          , genome  6898] predictions:    9655/  10000 (96.55%), best:    9712/10000 (97.12%), error:      1127.00940, best error:       913.68231 on epoch:    46, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 137.7387084961s, input_fired_time: 1.4830594063, output_fired_time: 1.2820936441, propagate_forward_time: 51.6019134521, propagate_backward_time: 80.1411285400, weight_update_time: 0.1428085417, other_time: 3.2305145264
epoch time: 11.0065469742s, input_fired_time: 0.1837089062, output_fired_time: 0.0000000000, propagate_forward_time: 10.2635030746, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5593347549
validation[          , genome  6898] predictions:    9696/  10000 (96.96%), best:    9712/10000 (97.12%), error:      1039.34729, best error:       913.68231 on epoch:    46, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 137.7503356934s, input_fired_time: 1.4602491856, output_fired_time: 1.2894489765, propagate_forward_time: 51.6191062927, propagate_backward_time: 80.2151031494, weight_update_time: 0.1440354884, other_time: 3.1664276123
epoch time: 11.1262788773s, input_fired_time: 0.1860702336, output_fired_time: 0.0000000000, propagate_forward_time: 10.3719940186, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5682144165
validation[          , genome  6898] predictions:    9091/  10000 (90.91%), best:    9712/10000 (97.12%), error:      3002.24878, best error:       913.68231 on epoch:    46, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

resetting weights to those on epoch: 46
epoch time: 137.3832397461s, input_fired_time: 1.4653096199, output_fired_time: 1.2799370289, propagate_forward_time: 51.4434013367, propagate_backward_time: 79.9922180176, weight_update_time: 0.1437695622, other_time: 3.2023620605
epoch time: 10.9254493713s, input_fired_time: 0.1878281981, output_fired_time: 0.0000000000, propagate_forward_time: 10.1803703308, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5572509766
validation[          , genome  6898] predictions:    9735/  10000 (97.35%), best:    9712/10000 (97.12%), error:       917.53430, best error:       913.68231 on epoch:    46, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 136.7032470703s, input_fired_time: 1.4794689417, output_fired_time: 1.2742835283, propagate_forward_time: 51.1501884460, propagate_backward_time: 79.6048736572, weight_update_time: 0.1484469324, other_time: 3.1944427490
epoch time: 11.2370004654s, input_fired_time: 0.1911706030, output_fired_time: 0.0000000000, propagate_forward_time: 10.4797735214, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5660562515
validation[          , genome  6898] predictions:    9693/  10000 (96.93%), best:    9712/10000 (97.12%), error:      1007.14459, best error:       913.68231 on epoch:    46, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 138.6420135498s, input_fired_time: 1.4836992025, output_fired_time: 1.3255096674, propagate_forward_time: 52.0191497803, propagate_backward_time: 80.5503005981, weight_update_time: 0.1438805759, other_time: 3.2633438110
epoch time: 11.0586423874s, input_fired_time: 0.1893709898, output_fired_time: 0.0000000000, propagate_forward_time: 10.3128185272, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5564527512
validation[          , genome  6898] predictions:    9714/  10000 (97.14%), best:    9712/10000 (97.12%), error:       996.47156, best error:       913.68231 on epoch:    46, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 136.9952850342s, input_fired_time: 1.4740238190, output_fired_time: 1.2865731716, propagate_forward_time: 51.3105354309, propagate_backward_time: 79.7361755371, weight_update_time: 0.1433630884, other_time: 3.1879730225
epoch time: 11.1750602722s, input_fired_time: 0.1904602498, output_fired_time: 0.0000000000, propagate_forward_time: 10.4312429428, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5533571243
validation[          , genome  6898] predictions:    9699/  10000 (96.99%), best:    9712/10000 (97.12%), error:       978.51563, best error:       913.68231 on epoch:    46, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 136.8795928955s, input_fired_time: 1.4915891886, output_fired_time: 1.2813704014, propagate_forward_time: 51.2509536743, propagate_backward_time: 79.6659622192, weight_update_time: 0.1431032717, other_time: 3.1897125244
epoch time: 11.1939868927s, input_fired_time: 0.1894208044, output_fired_time: 0.0000000000, propagate_forward_time: 10.4325056076, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5720605850
validation[          , genome  6898] predictions:    9710/  10000 (97.10%), best:    9712/10000 (97.12%), error:       958.62213, best error:       913.68231 on epoch:    46, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 137.7348327637s, input_fired_time: 1.4885177612, output_fired_time: 1.2859227657, propagate_forward_time: 51.4962348938, propagate_backward_time: 80.2566604614, weight_update_time: 0.1430754960, other_time: 3.2074966431
epoch time: 10.9284839630s, input_fired_time: 0.1863236129, output_fired_time: 0.0000000000, propagate_forward_time: 10.1808176041, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5613431931
validation[          , genome  6898] predictions:    9642/  10000 (96.42%), best:    9712/10000 (97.12%), error:      1173.13562, best error:       913.68231 on epoch:    46, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 139.2252502441s, input_fired_time: 1.4743473530, output_fired_time: 1.3101656437, propagate_forward_time: 52.1517372131, propagate_backward_time: 81.1080017090, weight_update_time: 0.1419370174, other_time: 3.1809997559
epoch time: 10.9862909317s, input_fired_time: 0.1895914823, output_fired_time: 0.0000000000, propagate_forward_time: 10.2300634384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5666360855
validation[          , genome  6898] predictions:    9701/  10000 (97.01%), best:    9712/10000 (97.12%), error:       973.53046, best error:       913.68231 on epoch:    46, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 138.2829132080s, input_fired_time: 1.4732238054, output_fired_time: 1.2753727436, propagate_forward_time: 51.7779312134, propagate_backward_time: 80.5990753174, weight_update_time: 0.1468597502, other_time: 3.1573104858
epoch time: 11.0275726318s, input_fired_time: 0.1898380071, output_fired_time: 0.0000000000, propagate_forward_time: 10.2527828217, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5849514008
validation[          , genome  6898] predictions:    9663/  10000 (96.63%), best:    9712/10000 (97.12%), error:      1054.76538, best error:       913.68231 on epoch:    46, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 137.9431762695s, input_fired_time: 1.4964904785, output_fired_time: 1.2935036421, propagate_forward_time: 51.7035293579, propagate_backward_time: 80.2005004883, weight_update_time: 0.1508829296, other_time: 3.2491531372
epoch time: 11.0213174820s, input_fired_time: 0.1944893301, output_fired_time: 0.0000000000, propagate_forward_time: 10.2617006302, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5651273727
validation[          , genome  6898] predictions:    9704/  10000 (97.04%), best:    9712/10000 (97.12%), error:       980.32928, best error:       913.68231 on epoch:    46, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 137.2292022705s, input_fired_time: 1.4629689455, output_fired_time: 1.2778462172, propagate_forward_time: 51.4060058594, propagate_backward_time: 79.9461898804, weight_update_time: 0.1408132911, other_time: 3.1361923218
epoch time: 10.9729728699s, input_fired_time: 0.1960848123, output_fired_time: 0.0000000000, propagate_forward_time: 10.1986589432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5782289505
validation[          , genome  6898] predictions:    9731/  10000 (97.31%), best:    9731/10000 (97.31%), error:       903.67908, best error:       903.67908 on epoch:    59, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 138.5238037109s, input_fired_time: 1.4941968918, output_fired_time: 1.3171067238, propagate_forward_time: 51.9197692871, propagate_backward_time: 80.5441284180, weight_update_time: 0.1429647058, other_time: 3.2485961914
epoch time: 11.0570087433s, input_fired_time: 0.1836619079, output_fired_time: 0.0000000000, propagate_forward_time: 10.3078899384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5654573441
validation[          , genome  6898] predictions:    9603/  10000 (96.03%), best:    9731/10000 (97.31%), error:      1346.15210, best error:       903.67908 on epoch:    59, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 136.8125152588s, input_fired_time: 1.4881353378, output_fired_time: 1.2740120888, propagate_forward_time: 51.1201095581, propagate_backward_time: 79.7074050903, weight_update_time: 0.1433891654, other_time: 3.2228546143
epoch time: 11.1837425232s, input_fired_time: 0.1915645152, output_fired_time: 0.0000000000, propagate_forward_time: 10.4270868301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5650911331
validation[          , genome  6898] predictions:    9636/  10000 (96.36%), best:    9731/10000 (97.31%), error:      1203.95044, best error:       903.67908 on epoch:    59, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 136.8772583008s, input_fired_time: 1.4645249844, output_fired_time: 1.2703796625, propagate_forward_time: 51.2546005249, propagate_backward_time: 79.6417236328, weight_update_time: 0.1423597783, other_time: 3.2460250854
epoch time: 10.8978538513s, input_fired_time: 0.1944983900, output_fired_time: 0.0000000000, propagate_forward_time: 10.1278858185, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5754699707
validation[          , genome  6898] predictions:    9724/  10000 (97.24%), best:    9731/10000 (97.31%), error:       930.01196, best error:       903.67908 on epoch:    59, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 136.5249328613s, input_fired_time: 1.4745255709, output_fired_time: 1.2654232979, propagate_forward_time: 51.0797958374, propagate_backward_time: 79.4614944458, weight_update_time: 0.1420933008, other_time: 3.2436828613
epoch time: 11.1153755188s, input_fired_time: 0.1914699227, output_fired_time: 0.0000000000, propagate_forward_time: 10.3560771942, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5678281784
validation[          , genome  6898] predictions:    9655/  10000 (96.55%), best:    9731/10000 (97.31%), error:      1107.05310, best error:       903.67908 on epoch:    59, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 138.7947387695s, input_fired_time: 1.4740581512, output_fired_time: 1.2853958607, propagate_forward_time: 52.0195121765, propagate_backward_time: 80.7958526611, weight_update_time: 0.1414097399, other_time: 3.2199096680
epoch time: 11.2948713303s, input_fired_time: 0.1912374943, output_fired_time: 0.0000000000, propagate_forward_time: 10.5262546539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5773792267
validation[          , genome  6898] predictions:    9712/  10000 (97.12%), best:    9731/10000 (97.31%), error:       964.58118, best error:       903.67908 on epoch:    59, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 136.9675140381s, input_fired_time: 1.4721275568, output_fired_time: 1.2836210728, propagate_forward_time: 51.2920684814, propagate_backward_time: 79.7884140015, weight_update_time: 0.1472914219, other_time: 3.1312942505
epoch time: 10.9177827835s, input_fired_time: 0.1908470988, output_fired_time: 0.0000000000, propagate_forward_time: 10.1615743637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5653610229
validation[          , genome  6898] predictions:    9709/  10000 (97.09%), best:    9731/10000 (97.31%), error:       997.23065, best error:       903.67908 on epoch:    59, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 136.7521057129s, input_fired_time: 1.4764170647, output_fired_time: 1.2798540592, propagate_forward_time: 51.2043952942, propagate_backward_time: 79.5910491943, weight_update_time: 0.1439161301, other_time: 3.2003936768
epoch time: 10.9737033844s, input_fired_time: 0.1843348145, output_fired_time: 0.0000000000, propagate_forward_time: 10.2320775986, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5572910309
validation[          , genome  6898] predictions:    9704/  10000 (97.04%), best:    9731/10000 (97.31%), error:       977.54279, best error:       903.67908 on epoch:    59, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 137.0435485840s, input_fired_time: 1.4780638218, output_fired_time: 1.2867717743, propagate_forward_time: 51.1910018921, propagate_backward_time: 79.8934173584, weight_update_time: 0.1417895705, other_time: 3.1942977905
epoch time: 11.0108642578s, input_fired_time: 0.1980262101, output_fired_time: 0.0000000000, propagate_forward_time: 10.2465047836, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5663328171
validation[          , genome  6898] predictions:    9678/  10000 (96.78%), best:    9731/10000 (97.31%), error:      1094.60425, best error:       903.67908 on epoch:    59, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 136.7879943848s, input_fired_time: 1.4667923450, output_fired_time: 1.2636728287, propagate_forward_time: 51.2348976135, propagate_backward_time: 79.6396102905, weight_update_time: 0.1426621675, other_time: 3.1830215454
epoch time: 11.2669410706s, input_fired_time: 0.1898753196, output_fired_time: 0.0000000000, propagate_forward_time: 10.4815282822, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5955371857
validation[          , genome  6898] predictions:    9714/  10000 (97.14%), best:    9731/10000 (97.31%), error:      1013.36676, best error:       903.67908 on epoch:    59, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 137.8153533936s, input_fired_time: 1.4953110218, output_fired_time: 1.3002634048, propagate_forward_time: 51.6459770203, propagate_backward_time: 80.2307968140, weight_update_time: 0.1419203132, other_time: 3.1429977417
epoch time: 11.0210227966s, input_fired_time: 0.1944625825, output_fired_time: 0.0000000000, propagate_forward_time: 10.2626361847, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5639238358
validation[          , genome  6898] predictions:    9723/  10000 (97.23%), best:    9731/10000 (97.31%), error:       920.64478, best error:       903.67908 on epoch:    59, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 137.7991638184s, input_fired_time: 1.4826915264, output_fired_time: 1.2811448574, propagate_forward_time: 51.5706367493, propagate_backward_time: 80.2855072021, weight_update_time: 0.1424649209, other_time: 3.1791839600
epoch time: 10.9800910950s, input_fired_time: 0.1926736832, output_fired_time: 0.0000000000, propagate_forward_time: 10.2256917953, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5617256165
validation[          , genome  6898] predictions:    9617/  10000 (96.17%), best:    9731/10000 (97.31%), error:      1268.73120, best error:       903.67908 on epoch:    59, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 136.8501739502s, input_fired_time: 1.4737108946, output_fired_time: 1.2835023403, propagate_forward_time: 51.2513694763, propagate_backward_time: 79.6662979126, weight_update_time: 0.1430960298, other_time: 3.1752853394
epoch time: 10.9462900162s, input_fired_time: 0.1896166950, output_fired_time: 0.0000000000, propagate_forward_time: 10.1990633011, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5576095581
validation[          , genome  6898] predictions:    9606/  10000 (96.06%), best:    9731/10000 (97.31%), error:      1262.15662, best error:       903.67908 on epoch:    59, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 137.4048919678s, input_fired_time: 1.5068953037, output_fired_time: 1.2880150080, propagate_forward_time: 51.3999481201, propagate_backward_time: 79.9952239990, weight_update_time: 0.1439183354, other_time: 3.2148132324
epoch time: 11.1354331970s, input_fired_time: 0.1910505444, output_fired_time: 0.0000000000, propagate_forward_time: 10.3623666763, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5820159912
validation[          , genome  6898] predictions:    9716/  10000 (97.16%), best:    9731/10000 (97.31%), error:      1028.70801, best error:       903.67908 on epoch:    59, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 136.6892700195s, input_fired_time: 1.4812344313, output_fired_time: 1.2809084654, propagate_forward_time: 51.1119995117, propagate_backward_time: 79.5843658447, weight_update_time: 0.1463739723, other_time: 3.2307586670
epoch time: 11.0419569016s, input_fired_time: 0.1920303255, output_fired_time: 0.0000000000, propagate_forward_time: 10.2832155228, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5667114258
validation[          , genome  6898] predictions:    9599/  10000 (95.99%), best:    9731/10000 (97.31%), error:      1411.04736, best error:       903.67908 on epoch:    59, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 137.6831512451s, input_fired_time: 1.4548866749, output_fired_time: 1.2874044180, propagate_forward_time: 51.5953483582, propagate_backward_time: 80.1718215942, weight_update_time: 0.1459313184, other_time: 3.1736984253
epoch time: 11.2726488113s, input_fired_time: 0.1969830096, output_fired_time: 0.0000000000, propagate_forward_time: 10.4796333313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5960321426
validation[          , genome  6898] predictions:    9682/  10000 (96.82%), best:    9731/10000 (97.31%), error:      1058.00342, best error:       903.67908 on epoch:    59, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 135.8251800537s, input_fired_time: 1.4775552750, output_fired_time: 1.2596646547, propagate_forward_time: 50.8601150513, propagate_backward_time: 79.0289993286, weight_update_time: 0.1429115534, other_time: 3.1988525391
epoch time: 11.0643358231s, input_fired_time: 0.1873719096, output_fired_time: 0.0000000000, propagate_forward_time: 10.3085203171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5684432983
validation[          , genome  6898] predictions:    9741/  10000 (97.41%), best:    9741/10000 (97.41%), error:       887.67694, best error:       887.67694 on epoch:    75, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 137.6743469238s, input_fired_time: 1.4833480120, output_fired_time: 1.2849404812, propagate_forward_time: 51.4502143860, propagate_backward_time: 80.2469635010, weight_update_time: 0.1428642422, other_time: 3.2088775635
epoch time: 11.0840072632s, input_fired_time: 0.1914651394, output_fired_time: 0.0000000000, propagate_forward_time: 10.3175153732, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5750265121
validation[          , genome  6898] predictions:    9651/  10000 (96.51%), best:    9741/10000 (97.41%), error:      1150.34998, best error:       887.67694 on epoch:    75, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 137.1603851318s, input_fired_time: 1.4949337244, output_fired_time: 1.2907799482, propagate_forward_time: 51.3367729187, propagate_backward_time: 79.8268661499, weight_update_time: 0.1440933794, other_time: 3.2110214233
epoch time: 11.2321882248s, input_fired_time: 0.1902505904, output_fired_time: 0.0000000000, propagate_forward_time: 10.4570379257, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5848999023
validation[          , genome  6898] predictions:    9707/  10000 (97.07%), best:    9741/10000 (97.41%), error:       983.15167, best error:       887.67694 on epoch:    75, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 136.2954559326s, input_fired_time: 1.4855681658, output_fired_time: 1.2744910717, propagate_forward_time: 50.9807472229, propagate_backward_time: 79.3469314575, weight_update_time: 0.1435662806, other_time: 3.2077255249
epoch time: 11.2293272018s, input_fired_time: 0.1936105192, output_fired_time: 0.0000000000, propagate_forward_time: 10.4574880600, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5782289505
validation[          , genome  6898] predictions:    9722/  10000 (97.22%), best:    9741/10000 (97.41%), error:       950.51306, best error:       887.67694 on epoch:    75, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 137.6691131592s, input_fired_time: 1.4550489187, output_fired_time: 1.2829097509, propagate_forward_time: 51.5751304626, propagate_backward_time: 80.1965866089, weight_update_time: 0.1432097256, other_time: 3.1594314575
epoch time: 10.8401098251s, input_fired_time: 0.1923782974, output_fired_time: 0.0000000000, propagate_forward_time: 10.0635719299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5841598511
validation[          , genome  6898] predictions:    9687/  10000 (96.87%), best:    9741/10000 (97.41%), error:      1050.20923, best error:       887.67694 on epoch:    75, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 139.0222320557s, input_fired_time: 1.4963556528, output_fired_time: 1.3069986105, propagate_forward_time: 52.0619468689, propagate_backward_time: 80.9227294922, weight_update_time: 0.1422103643, other_time: 3.2342071533
epoch time: 11.2980060577s, input_fired_time: 0.2043414265, output_fired_time: 0.0000000000, propagate_forward_time: 10.5130071640, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5806570053
validation[          , genome  6898] predictions:    9727/  10000 (97.27%), best:    9741/10000 (97.41%), error:       922.09229, best error:       887.67694 on epoch:    75, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 136.9687500000s, input_fired_time: 1.5046722889, output_fired_time: 1.2847237587, propagate_forward_time: 51.2521629333, propagate_backward_time: 79.7293853760, weight_update_time: 0.1425930262, other_time: 3.1977996826
epoch time: 11.0807447433s, input_fired_time: 0.1878672093, output_fired_time: 0.0000000000, propagate_forward_time: 10.3342676163, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5586099625
validation[          , genome  6898] predictions:    9665/  10000 (96.65%), best:    9741/10000 (97.41%), error:      1141.28137, best error:       887.67694 on epoch:    75, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 137.9393463135s, input_fired_time: 1.4726264477, output_fired_time: 1.3121075630, propagate_forward_time: 51.6718101501, propagate_backward_time: 80.3297576904, weight_update_time: 0.1406511515, other_time: 3.1530456543
epoch time: 11.0068826675s, input_fired_time: 0.1944706291, output_fired_time: 0.0000000000, propagate_forward_time: 10.2397441864, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5726680756
validation[          , genome  6898] predictions:    9705/  10000 (97.05%), best:    9741/10000 (97.41%), error:       994.00824, best error:       887.67694 on epoch:    75, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 136.7027587891s, input_fired_time: 1.4750914574, output_fired_time: 1.2771565914, propagate_forward_time: 51.1849670410, propagate_backward_time: 79.6069641113, weight_update_time: 0.1423538029, other_time: 3.1585693359
epoch time: 10.9797677994s, input_fired_time: 0.1914244145, output_fired_time: 0.0000000000, propagate_forward_time: 10.2243804932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5639629364
validation[          , genome  6898] predictions:    9688/  10000 (96.88%), best:    9741/10000 (97.41%), error:      1043.35693, best error:       887.67694 on epoch:    75, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 137.7200927734s, input_fired_time: 1.5292390585, output_fired_time: 1.2992314100, propagate_forward_time: 51.4921340942, propagate_backward_time: 80.1575775146, weight_update_time: 0.1492335051, other_time: 3.2419204712
epoch time: 11.1055469513s, input_fired_time: 0.1925010979, output_fired_time: 0.0000000000, propagate_forward_time: 10.3315277100, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5815181732
validation[          , genome  6898] predictions:    9669/  10000 (96.69%), best:    9741/10000 (97.41%), error:      1028.61707, best error:       887.67694 on epoch:    75, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 137.5113525391s, input_fired_time: 1.4879627228, output_fired_time: 1.2888308764, propagate_forward_time: 51.4918899536, propagate_backward_time: 80.0246734619, weight_update_time: 0.1439642608, other_time: 3.2179946899
epoch time: 11.0215120316s, input_fired_time: 0.1929934919, output_fired_time: 0.0000000000, propagate_forward_time: 10.2601747513, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5683441162
validation[          , genome  6898] predictions:    9679/  10000 (96.79%), best:    9741/10000 (97.41%), error:       995.82874, best error:       887.67694 on epoch:    75, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 137.6916351318s, input_fired_time: 1.4827913046, output_fired_time: 1.2943584919, propagate_forward_time: 51.5432128906, propagate_backward_time: 80.2086486816, weight_update_time: 0.1423677802, other_time: 3.1626281738
epoch time: 11.1419296265s, input_fired_time: 0.1948256195, output_fired_time: 0.0000000000, propagate_forward_time: 10.3651866913, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5819177628
validation[          , genome  6898] predictions:    9708/  10000 (97.08%), best:    9741/10000 (97.41%), error:       984.20392, best error:       887.67694 on epoch:    75, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 136.8257751465s, input_fired_time: 1.4799484015, output_fired_time: 1.2963519096, propagate_forward_time: 51.2052154541, propagate_backward_time: 79.6769561768, weight_update_time: 0.1431424469, other_time: 3.1672973633
epoch time: 11.1226749420s, input_fired_time: 0.1888187230, output_fired_time: 0.0000000000, propagate_forward_time: 10.3780794144, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5557765961
validation[          , genome  6898] predictions:    9734/  10000 (97.34%), best:    9741/10000 (97.41%), error:       922.19061, best error:       887.67694 on epoch:    75, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 137.4800872803s, input_fired_time: 1.4825652838, output_fired_time: 1.2988374233, propagate_forward_time: 51.5303344727, propagate_backward_time: 79.9755554199, weight_update_time: 0.1433251798, other_time: 3.1927947998
epoch time: 11.3206062317s, input_fired_time: 0.1932544410, output_fired_time: 0.0000000000, propagate_forward_time: 10.5306863785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5966653824
validation[          , genome  6898] predictions:    9709/  10000 (97.09%), best:    9741/10000 (97.41%), error:       946.62384, best error:       887.67694 on epoch:    75, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 137.4885253906s, input_fired_time: 1.4826511145, output_fired_time: 1.2883062363, propagate_forward_time: 51.5021095276, propagate_backward_time: 80.0503387451, weight_update_time: 0.1427664608, other_time: 3.1651306152
epoch time: 11.0942316055s, input_fired_time: 0.1903330535, output_fired_time: 0.0000000000, propagate_forward_time: 10.3327827454, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5711154938
validation[          , genome  6898] predictions:    9723/  10000 (97.23%), best:    9741/10000 (97.41%), error:       933.60059, best error:       887.67694 on epoch:    75, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 137.6144104004s, input_fired_time: 1.4869849682, output_fired_time: 1.3070343733, propagate_forward_time: 51.4435501099, propagate_backward_time: 80.2039566040, weight_update_time: 0.1477183700, other_time: 3.1728820801
epoch time: 11.1866474152s, input_fired_time: 0.1926228106, output_fired_time: 0.0000000000, propagate_forward_time: 10.4377365112, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5562877655
validation[          , genome  6898] predictions:    9717/  10000 (97.17%), best:    9741/10000 (97.41%), error:       940.07379, best error:       887.67694 on epoch:    75, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 137.0528869629s, input_fired_time: 1.4860796928, output_fired_time: 1.2756382227, propagate_forward_time: 51.3832168579, propagate_backward_time: 79.7453536987, weight_update_time: 0.1415844858, other_time: 3.1625976563
epoch time: 11.1004724503s, input_fired_time: 0.1963824332, output_fired_time: 0.0000000000, propagate_forward_time: 10.3437280655, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5603618622
validation[          , genome  6898] predictions:    9673/  10000 (96.73%), best:    9741/10000 (97.41%), error:      1133.15857, best error:       887.67694 on epoch:    75, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 138.4956817627s, input_fired_time: 1.5331653357, output_fired_time: 1.3018324375, propagate_forward_time: 51.8565216064, propagate_backward_time: 80.5751419067, weight_update_time: 0.1436603665, other_time: 3.2290115356
epoch time: 11.0058145523s, input_fired_time: 0.1976084113, output_fired_time: 0.0000000000, propagate_forward_time: 10.2416248322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5665817261
validation[          , genome  6898] predictions:    9632/  10000 (96.32%), best:    9741/10000 (97.41%), error:      1210.97949, best error:       887.67694 on epoch:    75, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 137.3168182373s, input_fired_time: 1.4605435133, output_fired_time: 1.2759020329, propagate_forward_time: 51.4485435486, propagate_backward_time: 80.0096740723, weight_update_time: 0.1406178176, other_time: 3.1221466064
epoch time: 10.9930324554s, input_fired_time: 0.1953292638, output_fired_time: 0.0000000000, propagate_forward_time: 10.2300634384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5676393509
validation[          , genome  6898] predictions:    9636/  10000 (96.36%), best:    9741/10000 (97.41%), error:      1201.51404, best error:       887.67694 on epoch:    75, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 138.6334991455s, input_fired_time: 1.4999136925, output_fired_time: 1.2883462906, propagate_forward_time: 51.9389419556, propagate_backward_time: 80.7380981445, weight_update_time: 0.1438233852, other_time: 3.1682052612
epoch time: 11.3175916672s, input_fired_time: 0.2000280172, output_fired_time: 0.0000000000, propagate_forward_time: 10.5338468552, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5837163925
validation[          , genome  6898] predictions:    9718/  10000 (97.18%), best:    9741/10000 (97.41%), error:       964.46649, best error:       887.67694 on epoch:    75, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 137.3015899658s, input_fired_time: 1.4969931841, output_fired_time: 1.2910393476, propagate_forward_time: 51.3612937927, propagate_backward_time: 80.0396423340, weight_update_time: 0.1413876265, other_time: 3.1126098633
epoch time: 11.0990419388s, input_fired_time: 0.2010357231, output_fired_time: 0.0000000000, propagate_forward_time: 10.3425445557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5554618835
validation[          , genome  6898] predictions:    9703/  10000 (97.03%), best:    9741/10000 (97.41%), error:      1045.75684, best error:       887.67694 on epoch:    75, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 137.8227233887s, input_fired_time: 1.4969495535, output_fired_time: 1.2838522196, propagate_forward_time: 51.5883216858, propagate_backward_time: 80.2858047485, weight_update_time: 0.1425584704, other_time: 3.1677932739
epoch time: 10.9527568817s, input_fired_time: 0.1943474859, output_fired_time: 0.0000000000, propagate_forward_time: 10.1925287247, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5658807755
validation[          , genome  6898] predictions:    9693/  10000 (96.93%), best:    9741/10000 (97.41%), error:      1021.19928, best error:       887.67694 on epoch:    75, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 137.3485107422s, input_fired_time: 1.4991731644, output_fired_time: 1.2871180773, propagate_forward_time: 51.4597320557, propagate_backward_time: 79.9414443970, weight_update_time: 0.1420294940, other_time: 3.1610336304
epoch time: 11.0044431686s, input_fired_time: 0.1889899075, output_fired_time: 0.0000000000, propagate_forward_time: 10.2532596588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5621938705
validation[          , genome  6898] predictions:    9725/  10000 (97.25%), best:    9741/10000 (97.41%), error:       893.92639, best error:       887.67694 on epoch:    75, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 137.5951843262s, input_fired_time: 1.4763588905, output_fired_time: 1.2877541780, propagate_forward_time: 51.5136299133, propagate_backward_time: 80.2202224731, weight_update_time: 0.1449149698, other_time: 3.0972213745
epoch time: 11.0761356354s, input_fired_time: 0.1903742105, output_fired_time: 0.0000000000, propagate_forward_time: 10.3240785599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5616827011
validation[          , genome  6898] predictions:    9698/  10000 (96.98%), best:    9741/10000 (97.41%), error:      1003.45526, best error:       887.67694 on epoch:    75, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 136.7101593018s, input_fired_time: 1.5081106424, output_fired_time: 1.2818987370, propagate_forward_time: 51.1687240601, propagate_backward_time: 79.5626068115, weight_update_time: 0.1440522671, other_time: 3.1888046265
epoch time: 11.0617818832s, input_fired_time: 0.1891177148, output_fired_time: 0.0000000000, propagate_forward_time: 10.3216085434, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5510559082
validation[          , genome  6898] predictions:    9738/  10000 (97.38%), best:    9741/10000 (97.41%), error:       911.66071, best error:       887.67694 on epoch:    75, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 138.5143280029s, input_fired_time: 1.5141474009, output_fired_time: 1.3006358147, propagate_forward_time: 51.8909873962, propagate_backward_time: 80.6064605713, weight_update_time: 0.1481533200, other_time: 3.2021026611
epoch time: 11.3939876556s, input_fired_time: 0.1991901845, output_fired_time: 0.0000000000, propagate_forward_time: 10.6110830307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5837144852
validation[          , genome  6898] predictions:    9730/  10000 (97.30%), best:    9741/10000 (97.41%), error:       933.53204, best error:       887.67694 on epoch:    75, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 55.6507530212s, input_fired_time: 0.9544641376, output_fired_time: 0.0000000000, propagate_forward_time: 51.7203254700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9759635925
best training[          , genome  6898] predictions:   49426/  50000 (98.85%), best:    9741/10000 (97.41%), error:      2171.29810, best error:       887.67694 on epoch:    75, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 11.3650188446s, input_fired_time: 0.1992292404, output_fired_time: 0.0000000000, propagate_forward_time: 10.5841884613, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5816011429
   testing[          , genome  6898] predictions:    9761/  10000 (97.61%), best:    9741/10000 (97.41%), error:       759.25354, best error:       887.67694 on epoch:    75, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
21:08:33 (3400): called boinc_finish(0)

</stderr_txt>
]]>