Nameexact_genome_1512568488_42_6726_0
Workunit2604843
Created7 Dec 2017, 21:27:46 UTC
Sent7 Dec 2017, 21:33:09 UTC
Report deadline14 Dec 2017, 18:11:10 UTC
Received9 Dec 2017, 7:22:56 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID57938
Run time4 hours 1 min 21 sec
CPU time3 hours 57 min 31 sec
Validate stateValid
Credit1,714.94
Device peak FLOPS2.90 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.43 MB
Peak swap size159.25 MB
Peak disk usage2.27 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
6726] predictions:    9677/  10000 (96.77%), best:    9737/10000 (97.37%), error:      1094.45520, best error:       919.33893 on epoch:    11, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 129.9342651367s, input_fired_time: 1.4890545607, output_fired_time: 1.5768628120, propagate_forward_time: 48.8760414124, propagate_backward_time: 74.8161544800, weight_update_time: 0.2102783024, other_time: 3.1761398315
epoch time: 10.1300363541s, input_fired_time: 0.1819848567, output_fired_time: 0.0000000000, propagate_forward_time: 9.3245592117, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6234922409
validation[          , genome  6726] predictions:    9693/  10000 (96.93%), best:    9737/10000 (97.37%), error:      1046.20422, best error:       919.33893 on epoch:    11, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 129.9771575928s, input_fired_time: 1.4955332279, output_fired_time: 1.5840326548, propagate_forward_time: 48.8152046204, propagate_backward_time: 74.8514328003, weight_update_time: 0.2117176950, other_time: 3.2309646606
epoch time: 10.7462453842s, input_fired_time: 0.1848780960, output_fired_time: 0.0000000000, propagate_forward_time: 9.9876823425, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5736846924
validation[          , genome  6726] predictions:    9695/  10000 (96.95%), best:    9737/10000 (97.37%), error:       985.21265, best error:       919.33893 on epoch:    11, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 130.1331024170s, input_fired_time: 1.4957159758, output_fired_time: 1.5802398920, propagate_forward_time: 48.8188247681, propagate_backward_time: 75.0153121948, weight_update_time: 0.2102439106, other_time: 3.2230148315
epoch time: 10.5020160675s, input_fired_time: 0.1838836372, output_fired_time: 0.0000000000, propagate_forward_time: 9.7478513718, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5702810287
validation[          , genome  6726] predictions:    9709/  10000 (97.09%), best:    9737/10000 (97.37%), error:      1012.32068, best error:       919.33893 on epoch:    11, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 130.3150787354s, input_fired_time: 1.5066537857, output_fired_time: 1.5984588861, propagate_forward_time: 48.7879524231, propagate_backward_time: 75.1012344360, weight_update_time: 0.2143219709, other_time: 3.3207778931
epoch time: 10.1111917496s, input_fired_time: 0.1812025011, output_fired_time: 0.0000000000, propagate_forward_time: 9.3518619537, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5781269073
validation[          , genome  6726] predictions:    9641/  10000 (96.41%), best:    9737/10000 (97.37%), error:      1136.59094, best error:       919.33893 on epoch:    11, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 131.5604553223s, input_fired_time: 1.5144720078, output_fired_time: 1.5922547579, propagate_forward_time: 49.5640258789, propagate_backward_time: 75.6311416626, weight_update_time: 0.2131525874, other_time: 3.2585678101
epoch time: 9.9938459396s, input_fired_time: 0.1842415929, output_fired_time: 0.0000000000, propagate_forward_time: 9.1963329315, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6132717133
validation[          , genome  6726] predictions:    9660/  10000 (96.60%), best:    9737/10000 (97.37%), error:      1113.02551, best error:       919.33893 on epoch:    11, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 130.6618194580s, input_fired_time: 1.5044845343, output_fired_time: 1.5833880901, propagate_forward_time: 49.2683296204, propagate_backward_time: 75.0692825317, weight_update_time: 0.2161707878, other_time: 3.2363357544
epoch time: 10.6270771027s, input_fired_time: 0.1835373193, output_fired_time: 0.0000000000, propagate_forward_time: 9.8901786804, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5533609390
validation[          , genome  6726] predictions:    9629/  10000 (96.29%), best:    9737/10000 (97.37%), error:      1212.08032, best error:       919.33893 on epoch:    11, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 130.4497222900s, input_fired_time: 1.5028724670, output_fired_time: 1.5860084295, propagate_forward_time: 49.0392303467, propagate_backward_time: 75.0596313477, weight_update_time: 0.2151089311, other_time: 3.2619857788
epoch time: 10.7167806625s, input_fired_time: 0.1895650476, output_fired_time: 0.0000000000, propagate_forward_time: 9.9503574371, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5768585205
validation[          , genome  6726] predictions:    9718/  10000 (97.18%), best:    9737/10000 (97.37%), error:       937.51038, best error:       919.33893 on epoch:    11, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 129.1367492676s, input_fired_time: 1.4974966049, output_fired_time: 1.5795184374, propagate_forward_time: 48.1539688110, propagate_backward_time: 74.6563720703, weight_update_time: 0.2092972547, other_time: 3.2493896484
epoch time: 10.6926546097s, input_fired_time: 0.1883036196, output_fired_time: 0.0000000000, propagate_forward_time: 9.9229621887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5813884735
validation[          , genome  6726] predictions:    9726/  10000 (97.26%), best:    9737/10000 (97.37%), error:       956.05432, best error:       919.33893 on epoch:    11, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 130.2373352051s, input_fired_time: 1.5014362335, output_fired_time: 1.5797479153, propagate_forward_time: 49.0585250854, propagate_backward_time: 74.8682098389, weight_update_time: 0.2120583057, other_time: 3.2294158936
epoch time: 9.6502847672s, input_fired_time: 0.1914846897, output_fired_time: 0.0000000000, propagate_forward_time: 8.8242406845, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6345596313
validation[          , genome  6726] predictions:    9702/  10000 (97.02%), best:    9737/10000 (97.37%), error:      1011.98193, best error:       919.33893 on epoch:    11, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 128.6154174805s, input_fired_time: 1.4873512983, output_fired_time: 1.5642269850, propagate_forward_time: 48.3736114502, propagate_backward_time: 74.0004882813, weight_update_time: 0.2092669308, other_time: 3.1897430420
epoch time: 10.6244373322s, input_fired_time: 0.1847482622, output_fired_time: 0.0000000000, propagate_forward_time: 9.8656597137, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5740289688
validation[          , genome  6726] predictions:    9650/  10000 (96.50%), best:    9737/10000 (97.37%), error:      1224.18298, best error:       919.33893 on epoch:    11, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 130.0295104980s, input_fired_time: 1.4898388386, output_fired_time: 1.5790076256, propagate_forward_time: 48.8367233276, propagate_backward_time: 74.9038925171, weight_update_time: 0.2108758092, other_time: 3.2200469971
epoch time: 10.6175870895s, input_fired_time: 0.1869820654, output_fired_time: 0.0000000000, propagate_forward_time: 9.8596382141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5709667206
validation[          , genome  6726] predictions:    9683/  10000 (96.83%), best:    9737/10000 (97.37%), error:       988.09540, best error:       919.33893 on epoch:    11, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 128.2578430176s, input_fired_time: 1.4851231575, output_fired_time: 1.5623844862, propagate_forward_time: 48.0123405457, propagate_backward_time: 73.9786071777, weight_update_time: 0.2071565837, other_time: 3.2193908691
epoch time: 10.6226434708s, input_fired_time: 0.1879872680, output_fired_time: 0.0000000000, propagate_forward_time: 9.8664054871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5682506561
validation[          , genome  6726] predictions:    9721/  10000 (97.21%), best:    9737/10000 (97.37%), error:       946.73187, best error:       919.33893 on epoch:    11, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 129.5744323730s, input_fired_time: 1.5021829605, output_fired_time: 1.5904840231, propagate_forward_time: 48.4834289551, propagate_backward_time: 74.7097930908, weight_update_time: 0.2123769522, other_time: 3.2885437012
epoch time: 10.3373336792s, input_fired_time: 0.1815617979, output_fired_time: 0.0000000000, propagate_forward_time: 9.5984592438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5573129654
validation[          , genome  6726] predictions:    9642/  10000 (96.42%), best:    9737/10000 (97.37%), error:      1210.54175, best error:       919.33893 on epoch:    11, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 131.1442565918s, input_fired_time: 1.5065925121, output_fired_time: 1.5965754986, propagate_forward_time: 49.3955612183, propagate_backward_time: 75.3967666626, weight_update_time: 0.2153495699, other_time: 3.2487640381
epoch time: 10.6419372559s, input_fired_time: 0.1851999313, output_fired_time: 0.0000000000, propagate_forward_time: 9.8788509369, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5778865814
validation[          , genome  6726] predictions:    9672/  10000 (96.72%), best:    9737/10000 (97.37%), error:      1109.85388, best error:       919.33893 on epoch:    11, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 129.2521057129s, input_fired_time: 1.4947565794, output_fired_time: 1.5845183134, propagate_forward_time: 48.4374465942, propagate_backward_time: 74.4873657227, weight_update_time: 0.2093985081, other_time: 3.2480163574
epoch time: 10.5424680710s, input_fired_time: 0.1825875491, output_fired_time: 0.0000000000, propagate_forward_time: 9.7804651260, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5794153214
validation[          , genome  6726] predictions:    9735/  10000 (97.35%), best:    9735/10000 (97.35%), error:       893.76019, best error:       893.76019 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 130.4575805664s, input_fired_time: 1.5088001490, output_fired_time: 1.5817734003, propagate_forward_time: 49.1892433167, propagate_backward_time: 74.9675064087, weight_update_time: 0.2108179480, other_time: 3.2102584839
epoch time: 10.6878843307s, input_fired_time: 0.1871780157, output_fired_time: 0.0000000000, propagate_forward_time: 9.9335727692, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5671339035
validation[          , genome  6726] predictions:    9730/  10000 (97.30%), best:    9735/10000 (97.35%), error:       924.60040, best error:       893.76019 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 130.2234039307s, input_fired_time: 1.5001109838, output_fired_time: 1.5800275803, propagate_forward_time: 49.0959129333, propagate_backward_time: 74.8386230469, weight_update_time: 0.2108687162, other_time: 3.2087402344
epoch time: 10.4357681274s, input_fired_time: 0.1860416681, output_fired_time: 0.0000000000, propagate_forward_time: 9.6900396347, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5596866608
validation[          , genome  6726] predictions:    9721/  10000 (97.21%), best:    9735/10000 (97.35%), error:       904.74902, best error:       893.76019 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 129.6229095459s, input_fired_time: 1.5072252750, output_fired_time: 1.5896643400, propagate_forward_time: 48.4423103333, propagate_backward_time: 74.7955474854, weight_update_time: 0.2124943435, other_time: 3.2881622314
epoch time: 10.6211833954s, input_fired_time: 0.1853243560, output_fired_time: 0.0000000000, propagate_forward_time: 9.8820390701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5538196564
validation[          , genome  6726] predictions:    9687/  10000 (96.87%), best:    9735/10000 (97.35%), error:      1037.35669, best error:       893.76019 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 130.6829986572s, input_fired_time: 1.4992703199, output_fired_time: 1.5838099718, propagate_forward_time: 49.2555541992, propagate_backward_time: 75.1797409058, weight_update_time: 0.2112601846, other_time: 3.1646270752
epoch time: 10.3256521225s, input_fired_time: 0.1904233247, output_fired_time: 0.0000000000, propagate_forward_time: 9.5376939774, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5975351334
validation[          , genome  6726] predictions:    9742/  10000 (97.42%), best:    9742/10000 (97.42%), error:       871.38519, best error:       871.38519 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 130.8575439453s, input_fired_time: 1.5211076736, output_fired_time: 1.5863920450, propagate_forward_time: 49.3130760193, propagate_backward_time: 75.2059097290, weight_update_time: 0.2122676224, other_time: 3.2310562134
epoch time: 10.5801343918s, input_fired_time: 0.1901822835, output_fired_time: 0.0000000000, propagate_forward_time: 9.8157711029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5741806030
validation[          , genome  6726] predictions:    9717/  10000 (97.17%), best:    9742/10000 (97.42%), error:       938.03625, best error:       871.38519 on epoch:    33, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 129.6976318359s, input_fired_time: 1.5017750263, output_fired_time: 1.5758036375, propagate_forward_time: 48.7160491943, propagate_backward_time: 74.7027740479, weight_update_time: 0.2100533396, other_time: 3.2012329102
epoch time: 10.3061590195s, input_fired_time: 0.1879863590, output_fired_time: 0.0000000000, propagate_forward_time: 9.5525054932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5656671524
validation[          , genome  6726] predictions:    9733/  10000 (97.33%), best:    9742/10000 (97.42%), error:       902.04346, best error:       871.38519 on epoch:    33, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 131.7824249268s, input_fired_time: 1.5272192955, output_fired_time: 1.6054980755, propagate_forward_time: 49.4225769043, propagate_backward_time: 75.9523696899, weight_update_time: 0.2134829909, other_time: 3.2747573853
epoch time: 10.5334815979s, input_fired_time: 0.1857216358, output_fired_time: 0.0000000000, propagate_forward_time: 9.7827978134, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5649623871
validation[          , genome  6726] predictions:    9685/  10000 (96.85%), best:    9742/10000 (97.42%), error:       999.30432, best error:       871.38519 on epoch:    33, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 130.3822784424s, input_fired_time: 1.5275712013, output_fired_time: 1.5858211517, propagate_forward_time: 49.0058593750, propagate_backward_time: 75.0167541504, weight_update_time: 0.2132254094, other_time: 3.2462692261
epoch time: 11.0463466644s, input_fired_time: 0.1940609366, output_fired_time: 0.0000000000, propagate_forward_time: 10.2602167130, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5920686722
validation[          , genome  6726] predictions:    9687/  10000 (96.87%), best:    9742/10000 (97.42%), error:      1000.56207, best error:       871.38519 on epoch:    33, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 130.2395172119s, input_fired_time: 1.5217491388, output_fired_time: 1.5830242634, propagate_forward_time: 48.9121818542, propagate_backward_time: 74.9627075195, weight_update_time: 0.2138010263, other_time: 3.2598571777
epoch time: 10.8247375488s, input_fired_time: 0.1923925430, output_fired_time: 0.0000000000, propagate_forward_time: 10.0566759109, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5756692886
validation[          , genome  6726] predictions:    9756/  10000 (97.56%), best:    9756/10000 (97.56%), error:       860.05072, best error:       860.05072 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 129.3312683105s, input_fired_time: 1.5017745495, output_fired_time: 1.5769481659, propagate_forward_time: 48.3915824890, propagate_backward_time: 74.6015167236, weight_update_time: 0.2122225016, other_time: 3.2594451904
epoch time: 10.3964624405s, input_fired_time: 0.1885848343, output_fired_time: 0.0000000000, propagate_forward_time: 9.6399259567, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5679512024
validation[          , genome  6726] predictions:    9674/  10000 (96.74%), best:    9756/10000 (97.56%), error:      1032.88892, best error:       860.05072 on epoch:    38, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 130.4058990479s, input_fired_time: 1.5114014149, output_fired_time: 1.5908042192, propagate_forward_time: 49.1133003235, propagate_backward_time: 75.0088958740, weight_update_time: 0.2098252326, other_time: 3.1815032959
epoch time: 10.8753747940s, input_fired_time: 0.1955797970, output_fired_time: 0.0000000000, propagate_forward_time: 10.1090650558, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5707302094
validation[          , genome  6726] predictions:    9707/  10000 (97.07%), best:    9756/10000 (97.56%), error:       936.36273, best error:       860.05072 on epoch:    38, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 131.8154144287s, input_fired_time: 1.5287754536, output_fired_time: 1.5999283791, propagate_forward_time: 49.7567710876, propagate_backward_time: 75.6927185059, weight_update_time: 0.2144582868, other_time: 3.2372131348
epoch time: 10.7245159149s, input_fired_time: 0.1900028288, output_fired_time: 0.0000000000, propagate_forward_time: 9.9674539566, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5670595169
validation[          , genome  6726] predictions:    9715/  10000 (97.15%), best:    9756/10000 (97.56%), error:       953.34253, best error:       860.05072 on epoch:    38, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 131.2393798828s, input_fired_time: 1.5276925564, output_fired_time: 1.5971792936, propagate_forward_time: 49.4345283508, propagate_backward_time: 75.4064559937, weight_update_time: 0.2141800523, other_time: 3.2735214233
epoch time: 10.6586294174s, input_fired_time: 0.1894190609, output_fired_time: 0.0000000000, propagate_forward_time: 9.8860521317, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5831584930
validation[          , genome  6726] predictions:    9746/  10000 (97.46%), best:    9746/10000 (97.46%), error:       837.31250, best error:       837.31250 on epoch:    42, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 130.8375549316s, input_fired_time: 1.5175843239, output_fired_time: 1.5904490948, propagate_forward_time: 49.2491302490, propagate_backward_time: 75.2195739746, weight_update_time: 0.2138172090, other_time: 3.2608261108
epoch time: 10.7044010162s, input_fired_time: 0.1925366521, output_fired_time: 0.0000000000, propagate_forward_time: 9.9272270203, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5846376419
validation[          , genome  6726] predictions:    9749/  10000 (97.49%), best:    9749/10000 (97.49%), error:       833.62830, best error:       833.62830 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 131.1481475830s, input_fired_time: 1.5206553936, output_fired_time: 1.5991283655, propagate_forward_time: 49.4094734192, propagate_backward_time: 75.3824310303, weight_update_time: 0.2127626091, other_time: 3.2364654541
epoch time: 10.8511123657s, input_fired_time: 0.1940965801, output_fired_time: 0.0000000000, propagate_forward_time: 10.0807008743, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5763149261
validation[          , genome  6726] predictions:    9765/  10000 (97.65%), best:    9765/10000 (97.65%), error:       781.41772, best error:       781.41772 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 130.3320465088s, input_fired_time: 1.5141410828, output_fired_time: 1.5892897844, propagate_forward_time: 48.9586029053, propagate_backward_time: 75.0496978760, weight_update_time: 0.2109687924, other_time: 3.2203140259
epoch time: 10.7266950607s, input_fired_time: 0.1907723546, output_fired_time: 0.0000000000, propagate_forward_time: 9.9654636383, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5704593658
validation[          , genome  6726] predictions:    9674/  10000 (96.74%), best:    9765/10000 (97.65%), error:      1109.86072, best error:       781.41772 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 131.9845733643s, input_fired_time: 1.5490444899, output_fired_time: 1.5997624397, propagate_forward_time: 49.7805519104, propagate_backward_time: 75.8424911499, weight_update_time: 0.2125836760, other_time: 3.2127304077
epoch time: 10.5866355896s, input_fired_time: 0.1888621300, output_fired_time: 0.0000000000, propagate_forward_time: 9.8419713974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5558023453
validation[          , genome  6726] predictions:    9721/  10000 (97.21%), best:    9765/10000 (97.65%), error:       934.24524, best error:       781.41772 on epoch:    44, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 131.1110839844s, input_fired_time: 1.5285904408, output_fired_time: 1.5910522938, propagate_forward_time: 49.4013748169, propagate_backward_time: 75.3423080444, weight_update_time: 0.2130651176, other_time: 3.2477569580
epoch time: 11.0684814453s, input_fired_time: 0.1978011876, output_fired_time: 0.0000000000, propagate_forward_time: 10.2848176956, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5858621597
validation[          , genome  6726] predictions:    9365/  10000 (93.65%), best:    9765/10000 (97.65%), error:      2445.58594, best error:       781.41772 on epoch:    44, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

resetting weights to those on epoch: 44
epoch time: 131.5312805176s, input_fired_time: 1.5242512226, output_fired_time: 1.5941042900, propagate_forward_time: 49.6792411804, propagate_backward_time: 75.5149765015, weight_update_time: 0.2151526809, other_time: 3.2187118530
epoch time: 10.6935701370s, input_fired_time: 0.1898586601, output_fired_time: 0.0000000000, propagate_forward_time: 9.9278888702, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5758228302
validation[          , genome  6726] predictions:    9742/  10000 (97.42%), best:    9765/10000 (97.65%), error:       890.60742, best error:       781.41772 on epoch:    44, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 131.0882415771s, input_fired_time: 1.5248576403, output_fired_time: 1.5892838240, propagate_forward_time: 49.3184814453, propagate_backward_time: 75.4370651245, weight_update_time: 0.2131893039, other_time: 3.2185516357
epoch time: 11.0218124390s, input_fired_time: 0.1998337805, output_fired_time: 0.0000000000, propagate_forward_time: 10.2357282639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5862503052
validation[          , genome  6726] predictions:    9690/  10000 (96.90%), best:    9765/10000 (97.65%), error:      1094.83105, best error:       781.41772 on epoch:    44, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 131.3311767578s, input_fired_time: 1.5340782404, output_fired_time: 1.5911161900, propagate_forward_time: 49.4669914246, propagate_backward_time: 75.4964828491, weight_update_time: 0.2138167918, other_time: 3.2425155640
epoch time: 10.8204851151s, input_fired_time: 0.1902827024, output_fired_time: 0.0000000000, propagate_forward_time: 10.0548629761, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5753393173
validation[          , genome  6726] predictions:    9595/  10000 (95.95%), best:    9765/10000 (97.65%), error:      1265.02661, best error:       781.41772 on epoch:    44, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 131.4106903076s, input_fired_time: 1.5329071283, output_fired_time: 1.5930229425, propagate_forward_time: 49.5880508423, propagate_backward_time: 75.4855880737, weight_update_time: 0.2120027840, other_time: 3.2111206055
epoch time: 10.3808221817s, input_fired_time: 0.1888977438, output_fired_time: 0.0000000000, propagate_forward_time: 9.6249122620, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5670118332
validation[          , genome  6726] predictions:    9732/  10000 (97.32%), best:    9765/10000 (97.65%), error:       920.96655, best error:       781.41772 on epoch:    44, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 131.9201507568s, input_fired_time: 1.5407894850, output_fired_time: 1.5967729092, propagate_forward_time: 49.7593116760, propagate_backward_time: 75.7950668335, weight_update_time: 0.2130425125, other_time: 3.2282180786
epoch time: 10.1594638824s, input_fired_time: 0.1903751045, output_fired_time: 0.0000000000, propagate_forward_time: 9.3818960190, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5871925354
validation[          , genome  6726] predictions:    9765/  10000 (97.65%), best:    9765/10000 (97.65%), error:       805.33325, best error:       781.41772 on epoch:    44, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 132.0013732910s, input_fired_time: 1.5441222191, output_fired_time: 1.6113140583, propagate_forward_time: 49.6283226013, propagate_backward_time: 75.9046249390, weight_update_time: 0.2158593088, other_time: 3.3129806519
epoch time: 10.5879173279s, input_fired_time: 0.1906683445, output_fired_time: 0.0000000000, propagate_forward_time: 9.8246736526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5725755692
validation[          , genome  6726] predictions:    9749/  10000 (97.49%), best:    9765/10000 (97.65%), error:       832.81036, best error:       781.41772 on epoch:    44, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 131.2139282227s, input_fired_time: 1.5287845135, output_fired_time: 1.5901170969, propagate_forward_time: 49.4656066895, propagate_backward_time: 75.4028244019, weight_update_time: 0.2142603546, other_time: 3.2266006470
epoch time: 10.6037054062s, input_fired_time: 0.1896198690, output_fired_time: 0.0000000000, propagate_forward_time: 9.8394737244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5746116638
validation[          , genome  6726] predictions:    9692/  10000 (96.92%), best:    9765/10000 (97.65%), error:      1019.19714, best error:       781.41772 on epoch:    44, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 130.6760559082s, input_fired_time: 1.5228222609, output_fired_time: 1.5860170126, propagate_forward_time: 49.2098045349, propagate_backward_time: 75.0941467285, weight_update_time: 0.2139941156, other_time: 3.2632598877
epoch time: 9.9894037247s, input_fired_time: 0.1851917803, output_fired_time: 0.0000000000, propagate_forward_time: 9.2242717743, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5799398422
validation[          , genome  6726] predictions:    9689/  10000 (96.89%), best:    9765/10000 (97.65%), error:      1058.84106, best error:       781.41772 on epoch:    44, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 129.5414276123s, input_fired_time: 1.5175172091, output_fired_time: 1.5778167248, propagate_forward_time: 48.4996032715, propagate_backward_time: 74.6690597534, weight_update_time: 0.2133698761, other_time: 3.2774276733
epoch time: 9.5546312332s, input_fired_time: 0.1807829887, output_fired_time: 0.0000000000, propagate_forward_time: 8.7282028198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6456451416
validation[          , genome  6726] predictions:    9736/  10000 (97.36%), best:    9765/10000 (97.65%), error:       930.63696, best error:       781.41772 on epoch:    44, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 130.5098724365s, input_fired_time: 1.5320496559, output_fired_time: 1.5968530178, propagate_forward_time: 48.9029998779, propagate_backward_time: 75.1631774902, weight_update_time: 0.2150825858, other_time: 3.3147964478
epoch time: 10.2913436890s, input_fired_time: 0.1851329207, output_fired_time: 0.0000000000, propagate_forward_time: 9.5541849136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5520257950
validation[          , genome  6726] predictions:    9762/  10000 (97.62%), best:    9765/10000 (97.65%), error:       806.37958, best error:       781.41772 on epoch:    44, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 128.5012359619s, input_fired_time: 1.5156750679, output_fired_time: 1.5776220560, propagate_forward_time: 47.8282012939, propagate_backward_time: 74.2109985352, weight_update_time: 0.2116507143, other_time: 3.3687362671
epoch time: 10.8273992538s, input_fired_time: 0.1884844601, output_fired_time: 0.0000000000, propagate_forward_time: 10.0642013550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5747137070
validation[          , genome  6726] predictions:    9741/  10000 (97.41%), best:    9765/10000 (97.65%), error:       889.17761, best error:       781.41772 on epoch:    44, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 131.4171295166s, input_fired_time: 1.5377264023, output_fired_time: 1.5977091789, propagate_forward_time: 49.5281333923, propagate_backward_time: 75.5029907227, weight_update_time: 0.2130152136, other_time: 3.2505798340
epoch time: 10.6809892654s, input_fired_time: 0.1946460605, output_fired_time: 0.0000000000, propagate_forward_time: 9.9137449265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5725984573
validation[          , genome  6726] predictions:    9725/  10000 (97.25%), best:    9765/10000 (97.65%), error:       927.97955, best error:       781.41772 on epoch:    44, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 130.8135833740s, input_fired_time: 1.5300157070, output_fired_time: 1.5862977505, propagate_forward_time: 49.2475051880, propagate_backward_time: 75.2306671143, weight_update_time: 0.2137109786, other_time: 3.2191009521
epoch time: 10.8842382431s, input_fired_time: 0.1983965784, output_fired_time: 0.0000000000, propagate_forward_time: 10.1167545319, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5690870285
validation[          , genome  6726] predictions:    9745/  10000 (97.45%), best:    9765/10000 (97.65%), error:       829.89740, best error:       781.41772 on epoch:    44, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 128.9526214600s, input_fired_time: 1.5170742273, output_fired_time: 1.5789986849, propagate_forward_time: 48.1838378906, propagate_backward_time: 74.3254394531, weight_update_time: 0.2156109661, other_time: 3.3472671509
epoch time: 10.6724166870s, input_fired_time: 0.1888102442, output_fired_time: 0.0000000000, propagate_forward_time: 9.9105186462, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5730876923
validation[          , genome  6726] predictions:    9736/  10000 (97.36%), best:    9765/10000 (97.65%), error:       837.46362, best error:       781.41772 on epoch:    44, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 127.4320373535s, input_fired_time: 1.5044913292, output_fired_time: 1.5688029528, propagate_forward_time: 47.1415557861, propagate_backward_time: 73.9085388184, weight_update_time: 0.2096496671, other_time: 3.3086471558
epoch time: 10.0831413269s, input_fired_time: 0.1865531504, output_fired_time: 0.0000000000, propagate_forward_time: 9.3154239655, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5811643600
validation[          , genome  6726] predictions:    9748/  10000 (97.48%), best:    9765/10000 (97.65%), error:       850.65387, best error:       781.41772 on epoch:    44, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 130.4484863281s, input_fired_time: 1.5221010447, output_fired_time: 1.5866891146, propagate_forward_time: 48.9999160767, propagate_backward_time: 75.1060256958, weight_update_time: 0.2124134749, other_time: 3.2337570190
epoch time: 10.6292276382s, input_fired_time: 0.1887500286, output_fired_time: 0.0000000000, propagate_forward_time: 9.8821191788, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5583581924
validation[          , genome  6726] predictions:    9717/  10000 (97.17%), best:    9765/10000 (97.65%), error:       907.69055, best error:       781.41772 on epoch:    44, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 131.1348724365s, input_fired_time: 1.5285278559, output_fired_time: 1.5886349678, propagate_forward_time: 49.4278564453, propagate_backward_time: 75.3358459473, weight_update_time: 0.2132303566, other_time: 3.2539978027
epoch time: 9.8808507919s, input_fired_time: 0.1903809309, output_fired_time: 0.0000000000, propagate_forward_time: 8.9730901718, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7173795700
validation[          , genome  6726] predictions:    9761/  10000 (97.61%), best:    9765/10000 (97.65%), error:       795.56506, best error:       781.41772 on epoch:    44, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 128.8765869141s, input_fired_time: 1.5217946768, output_fired_time: 1.5765267611, propagate_forward_time: 48.1011466980, propagate_backward_time: 74.3666076660, weight_update_time: 0.2130093724, other_time: 3.3105010986
epoch time: 10.6582517624s, input_fired_time: 0.1953080446, output_fired_time: 0.0000000000, propagate_forward_time: 9.8883256912, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5746183395
validation[          , genome  6726] predictions:    9725/  10000 (97.25%), best:    9765/10000 (97.65%), error:       949.09845, best error:       781.41772 on epoch:    44, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 131.1982116699s, input_fired_time: 1.5368109941, output_fired_time: 1.5983515978, propagate_forward_time: 49.4462318420, propagate_backward_time: 75.3468780518, weight_update_time: 0.2156462073, other_time: 3.2699432373
epoch time: 10.6993427277s, input_fired_time: 0.1944344491, output_fired_time: 0.0000000000, propagate_forward_time: 9.9283599854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5765485764
validation[          , genome  6726] predictions:    9723/  10000 (97.23%), best:    9765/10000 (97.65%), error:       943.63971, best error:       781.41772 on epoch:    44, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 129.4634246826s, input_fired_time: 1.5225480795, output_fired_time: 1.5755549669, propagate_forward_time: 48.5295562744, propagate_backward_time: 74.5882186890, weight_update_time: 0.2103750557, other_time: 3.2475509644
epoch time: 10.8226766586s, input_fired_time: 0.1920462102, output_fired_time: 0.0000000000, propagate_forward_time: 10.0685482025, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5620822906
validation[          , genome  6726] predictions:    9725/  10000 (97.25%), best:    9765/10000 (97.65%), error:       931.02740, best error:       781.41772 on epoch:    44, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 130.6589355469s, input_fired_time: 1.5290106535, output_fired_time: 1.5880550146, propagate_forward_time: 49.2003746033, propagate_backward_time: 75.0883331299, weight_update_time: 0.2138021290, other_time: 3.2531585693
epoch time: 11.1550025940s, input_fired_time: 0.1978292912, output_fired_time: 0.0000000000, propagate_forward_time: 10.3689785004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5881948471
validation[          , genome  6726] predictions:    9712/  10000 (97.12%), best:    9765/10000 (97.65%), error:       955.22156, best error:       781.41772 on epoch:    44, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 127.7197494507s, input_fired_time: 1.5077220201, output_fired_time: 1.5646721125, propagate_forward_time: 47.4484329224, propagate_backward_time: 73.9019927979, weight_update_time: 0.2105403394, other_time: 3.2969284058
epoch time: 10.8673000336s, input_fired_time: 0.1930259019, output_fired_time: 0.0000000000, propagate_forward_time: 10.1190061569, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5552682877
validation[          , genome  6726] predictions:    9711/  10000 (97.11%), best:    9765/10000 (97.65%), error:       987.46973, best error:       781.41772 on epoch:    44, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 131.1112365723s, input_fired_time: 1.5424063206, output_fired_time: 1.5945578814, propagate_forward_time: 49.4017105103, propagate_backward_time: 75.3252410889, weight_update_time: 0.2138083726, other_time: 3.2473220825
epoch time: 10.9201173782s, input_fired_time: 0.2032544464, output_fired_time: 0.0000000000, propagate_forward_time: 10.1175556183, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5993070602
validation[          , genome  6726] predictions:    9757/  10000 (97.57%), best:    9765/10000 (97.65%), error:       825.33472, best error:       781.41772 on epoch:    44, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 131.2935333252s, input_fired_time: 1.5356014967, output_fired_time: 1.5986514091, propagate_forward_time: 49.4325675964, propagate_backward_time: 75.4823226929, weight_update_time: 0.2159895301, other_time: 3.2443923950
epoch time: 10.8281688690s, input_fired_time: 0.1946929842, output_fired_time: 0.0000000000, propagate_forward_time: 10.0682868958, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5651893616
validation[          , genome  6726] predictions:    9749/  10000 (97.49%), best:    9765/10000 (97.65%), error:       865.98645, best error:       781.41772 on epoch:    44, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 130.8638000488s, input_fired_time: 1.5400947332, output_fired_time: 1.5848668814, propagate_forward_time: 49.2528495789, propagate_backward_time: 75.2430191040, weight_update_time: 0.2134522498, other_time: 3.2429580688
epoch time: 10.3962068558s, input_fired_time: 0.1885076463, output_fired_time: 0.0000000000, propagate_forward_time: 9.6424636841, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5652351379
validation[          , genome  6726] predictions:    9734/  10000 (97.34%), best:    9765/10000 (97.65%), error:       923.00000, best error:       781.41772 on epoch:    44, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 130.5131225586s, input_fired_time: 1.5385946035, output_fired_time: 1.5907076597, propagate_forward_time: 48.8769645691, propagate_backward_time: 75.1796264648, weight_update_time: 0.2129116356, other_time: 3.3272399902
epoch time: 10.4912366867s, input_fired_time: 0.1916101128, output_fired_time: 0.0000000000, propagate_forward_time: 9.7142667770, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5853595734
validation[          , genome  6726] predictions:    9720/  10000 (97.20%), best:    9765/10000 (97.65%), error:       953.07703, best error:       781.41772 on epoch:    44, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 130.7847290039s, input_fired_time: 1.5274082422, output_fired_time: 1.5909876823, propagate_forward_time: 49.3162918091, propagate_backward_time: 75.1487655640, weight_update_time: 0.2110535353, other_time: 3.2012786865
epoch time: 10.6958236694s, input_fired_time: 0.1945139617, output_fired_time: 0.0000000000, propagate_forward_time: 9.9340009689, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5673084259
validation[          , genome  6726] predictions:    9703/  10000 (97.03%), best:    9765/10000 (97.65%), error:      1011.77826, best error:       781.41772 on epoch:    44, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 131.1075439453s, input_fired_time: 1.5375533104, output_fired_time: 1.5914285183, propagate_forward_time: 49.4890747070, propagate_backward_time: 75.3001403809, weight_update_time: 0.2108840495, other_time: 3.1893463135
epoch time: 10.8504362106s, input_fired_time: 0.1948500276, output_fired_time: 0.0000000000, propagate_forward_time: 10.0801877975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5753984451
validation[          , genome  6726] predictions:    9676/  10000 (96.76%), best:    9765/10000 (97.65%), error:      1076.00830, best error:       781.41772 on epoch:    44, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 129.9011383057s, input_fired_time: 1.5283439159, output_fired_time: 1.5802910328, propagate_forward_time: 48.9390373230, propagate_backward_time: 74.6165695190, weight_update_time: 0.2122818381, other_time: 3.2368850708
epoch time: 10.6714763641s, input_fired_time: 0.1899404228, output_fired_time: 0.0000000000, propagate_forward_time: 9.9154376984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5660982132
validation[          , genome  6726] predictions:    9737/  10000 (97.37%), best:    9765/10000 (97.65%), error:       894.33350, best error:       781.41772 on epoch:    44, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 129.2808837891s, input_fired_time: 1.5312300920, output_fired_time: 1.5866740942, propagate_forward_time: 48.2505073547, propagate_backward_time: 74.5616607666, weight_update_time: 0.2161631286, other_time: 3.3508148193
epoch time: 9.9822683334s, input_fired_time: 0.1897953302, output_fired_time: 0.0000000000, propagate_forward_time: 9.1942672729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5982055664
validation[          , genome  6726] predictions:    9757/  10000 (97.57%), best:    9765/10000 (97.65%), error:       826.21069, best error:       781.41772 on epoch:    44, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 129.0484313965s, input_fired_time: 1.5257433653, output_fired_time: 1.5833990574, propagate_forward_time: 48.1484069824, propagate_backward_time: 74.5113449097, weight_update_time: 0.2107129991, other_time: 3.2795410156
epoch time: 10.4977397919s, input_fired_time: 0.1915587634, output_fired_time: 0.0000000000, propagate_forward_time: 9.7221059799, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5840749741
validation[          , genome  6726] predictions:    9743/  10000 (97.43%), best:    9765/10000 (97.65%), error:       849.35553, best error:       781.41772 on epoch:    44, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 131.2836303711s, input_fired_time: 1.5473483801, output_fired_time: 1.5899109840, propagate_forward_time: 49.6205978394, propagate_backward_time: 75.2921447754, weight_update_time: 0.2120854855, other_time: 3.2336349487
epoch time: 10.7754659653s, input_fired_time: 0.1971522123, output_fired_time: 0.0000000000, propagate_forward_time: 9.9930610657, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5852527618
validation[          , genome  6726] predictions:    9711/  10000 (97.11%), best:    9765/10000 (97.65%), error:       957.26044, best error:       781.41772 on epoch:    44, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 128.9641418457s, input_fired_time: 1.5292302370, output_fired_time: 1.5737663507, propagate_forward_time: 48.1397781372, propagate_backward_time: 74.4431838989, weight_update_time: 0.2124982327, other_time: 3.2781829834
epoch time: 10.1037664413s, input_fired_time: 0.1874302030, output_fired_time: 0.0000000000, propagate_forward_time: 9.3342952728, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5820407867
validation[          , genome  6726] predictions:    9759/  10000 (97.59%), best:    9765/10000 (97.65%), error:       846.11066, best error:       781.41772 on epoch:    44, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 129.6337585449s, input_fired_time: 1.5111743212, output_fired_time: 1.5773738623, propagate_forward_time: 48.7875595093, propagate_backward_time: 74.5629806519, weight_update_time: 0.2106727660, other_time: 3.1946716309
epoch time: 10.7662639618s, input_fired_time: 0.1904626042, output_fired_time: 0.0000000000, propagate_forward_time: 10.0199928284, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5558080673
validation[          , genome  6726] predictions:    9749/  10000 (97.49%), best:    9765/10000 (97.65%), error:       871.08490, best error:       781.41772 on epoch:    44, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 130.3118286133s, input_fired_time: 1.5271624327, output_fired_time: 1.5895649195, propagate_forward_time: 49.0366706848, propagate_backward_time: 74.8894424438, weight_update_time: 0.2131981850, other_time: 3.2689895630
epoch time: 10.9090909958s, input_fired_time: 0.2032911330, output_fired_time: 0.0000000000, propagate_forward_time: 10.1051559448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6006441116
validation[          , genome  6726] predictions:    9733/  10000 (97.33%), best:    9765/10000 (97.65%), error:       929.55023, best error:       781.41772 on epoch:    44, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 131.6176910400s, input_fired_time: 1.5466141701, output_fired_time: 1.5994139910, propagate_forward_time: 49.5078887939, propagate_backward_time: 75.7142333984, weight_update_time: 0.2137351930, other_time: 3.2495422363
epoch time: 10.1827640533s, input_fired_time: 0.1920148283, output_fired_time: 0.0000000000, propagate_forward_time: 9.3903875351, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6003618240
validation[          , genome  6726] predictions:    9712/  10000 (97.12%), best:    9765/10000 (97.65%), error:      1042.16565, best error:       781.41772 on epoch:    44, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 129.8418579102s, input_fired_time: 1.5161421299, output_fired_time: 1.5842746496, propagate_forward_time: 48.8093757629, propagate_backward_time: 74.7535247803, weight_update_time: 0.2084505260, other_time: 3.1785430908
epoch time: 9.2274532318s, input_fired_time: 0.1881158203, output_fired_time: 0.0000000000, propagate_forward_time: 8.3583288193, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6810083389
validation[          , genome  6726] predictions:    9753/  10000 (97.53%), best:    9765/10000 (97.65%), error:       847.97174, best error:       781.41772 on epoch:    44, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 129.4954223633s, input_fired_time: 1.5357074738, output_fired_time: 1.5791510344, propagate_forward_time: 48.5693740845, propagate_backward_time: 74.5604248047, weight_update_time: 0.2115305960, other_time: 3.2507705688
epoch time: 11.3506603241s, input_fired_time: 0.2058213651, output_fired_time: 0.0000000000, propagate_forward_time: 10.5465192795, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5983200073
validation[          , genome  6726] predictions:    9720/  10000 (97.20%), best:    9765/10000 (97.65%), error:       906.18359, best error:       781.41772 on epoch:    44, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 131.5861206055s, input_fired_time: 1.5269824266, output_fired_time: 1.5895174742, propagate_forward_time: 49.4414329529, propagate_backward_time: 75.7902908325, weight_update_time: 0.2148099095, other_time: 3.2378921509
epoch time: 11.0068349838s, input_fired_time: 0.1964643747, output_fired_time: 0.0000000000, propagate_forward_time: 10.2280921936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5822782516
validation[          , genome  6726] predictions:    9737/  10000 (97.37%), best:    9765/10000 (97.65%), error:       864.19946, best error:       781.41772 on epoch:    44, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 129.7575073242s, input_fired_time: 1.5199598074, output_fired_time: 1.5794417858, propagate_forward_time: 48.7490386963, propagate_backward_time: 74.6998138428, weight_update_time: 0.2093941271, other_time: 3.2092514038
epoch time: 10.8430767059s, input_fired_time: 0.1982010901, output_fired_time: 0.0000000000, propagate_forward_time: 10.0659008026, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5789747238
validation[          , genome  6726] predictions:    9749/  10000 (97.49%), best:    9765/10000 (97.65%), error:       839.87329, best error:       781.41772 on epoch:    44, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 129.8123931885s, input_fired_time: 1.5257853270, output_fired_time: 1.5791814327, propagate_forward_time: 48.7770042419, propagate_backward_time: 74.6960830688, weight_update_time: 0.2113783807, other_time: 3.2343368530
epoch time: 10.4231042862s, input_fired_time: 0.1949959993, output_fired_time: 0.0000000000, propagate_forward_time: 9.6368970871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5912113190
validation[          , genome  6726] predictions:    9761/  10000 (97.61%), best:    9765/10000 (97.65%), error:       799.42029, best error:       781.41772 on epoch:    44, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 129.7647247314s, input_fired_time: 1.5311453342, output_fired_time: 1.5826900005, propagate_forward_time: 48.6228561401, propagate_backward_time: 74.7363662720, weight_update_time: 0.2118525207, other_time: 3.2916717529
epoch time: 10.6305789948s, input_fired_time: 0.1938096285, output_fired_time: 0.0000000000, propagate_forward_time: 9.8683691025, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5684003830
validation[          , genome  6726] predictions:    9767/  10000 (97.67%), best:    9765/10000 (97.65%), error:       810.54529, best error:       781.41772 on epoch:    44, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 130.6374053955s, input_fired_time: 1.5448173285, output_fired_time: 1.5993509293, propagate_forward_time: 49.0080718994, propagate_backward_time: 75.2115783691, weight_update_time: 0.2125001401, other_time: 3.2735900879
epoch time: 10.6088981628s, input_fired_time: 0.1931289583, output_fired_time: 0.0000000000, propagate_forward_time: 9.8444890976, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5712804794
validation[          , genome  6726] predictions:    9721/  10000 (97.21%), best:    9765/10000 (97.65%), error:       921.40668, best error:       781.41772 on epoch:    44, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 130.1639556885s, input_fired_time: 1.5352076292, output_fired_time: 1.5855093002, propagate_forward_time: 48.8170356750, propagate_backward_time: 74.9260940552, weight_update_time: 0.2134428322, other_time: 3.3001174927
epoch time: 9.7487611771s, input_fired_time: 0.1832167953, output_fired_time: 0.0000000000, propagate_forward_time: 9.0121507645, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5533933640
validation[          , genome  6726] predictions:    9725/  10000 (97.25%), best:    9765/10000 (97.65%), error:       925.99292, best error:       781.41772 on epoch:    44, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 131.0643615723s, input_fired_time: 1.5425440073, output_fired_time: 1.5883895159, propagate_forward_time: 49.4506721497, propagate_backward_time: 75.2497940063, weight_update_time: 0.2127147913, other_time: 3.2329635620
epoch time: 10.3002414703s, input_fired_time: 0.1888972819, output_fired_time: 0.0000000000, propagate_forward_time: 9.5305309296, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5808134079
validation[          , genome  6726] predictions:    9702/  10000 (97.02%), best:    9765/10000 (97.65%), error:      1052.05066, best error:       781.41772 on epoch:    44, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 128.9170684814s, input_fired_time: 1.5156542063, output_fired_time: 1.5749542713, propagate_forward_time: 48.1729354858, propagate_backward_time: 74.4137344360, weight_update_time: 0.2095077932, other_time: 3.2397918701
epoch time: 10.5930156708s, input_fired_time: 0.1925156862, output_fired_time: 0.0000000000, propagate_forward_time: 9.8481025696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5523977280
validation[          , genome  6726] predictions:    9763/  10000 (97.63%), best:    9765/10000 (97.65%), error:       812.88220, best error:       781.41772 on epoch:    44, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 131.4061126709s, input_fired_time: 1.5387786627, output_fired_time: 1.5857188702, propagate_forward_time: 49.5796279907, propagate_backward_time: 75.4159011841, weight_update_time: 0.2167130709, other_time: 3.2860870361
epoch time: 10.8930444717s, input_fired_time: 0.2016160190, output_fired_time: 0.0000000000, propagate_forward_time: 10.1089801788, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5824480057
validation[          , genome  6726] predictions:    9732/  10000 (97.32%), best:    9765/10000 (97.65%), error:       887.17792, best error:       781.41772 on epoch:    44, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 131.2088470459s, input_fired_time: 1.5540904999, output_fired_time: 1.5970406532, propagate_forward_time: 49.4224700928, propagate_backward_time: 75.4006958008, weight_update_time: 0.2131755650, other_time: 3.2345428467
epoch time: 10.5638961792s, input_fired_time: 0.1899841726, output_fired_time: 0.0000000000, propagate_forward_time: 9.8181476593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5557641983
validation[          , genome  6726] predictions:    9748/  10000 (97.48%), best:    9765/10000 (97.65%), error:       884.27069, best error:       781.41772 on epoch:    44, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 131.5668487549s, input_fired_time: 1.5462276936, output_fired_time: 1.5954996347, propagate_forward_time: 49.6099662781, propagate_backward_time: 75.5822219849, weight_update_time: 0.2123270035, other_time: 3.2329177856
epoch time: 10.5943756104s, input_fired_time: 0.1915480494, output_fired_time: 0.0000000000, propagate_forward_time: 9.8465623856, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5562648773
validation[          , genome  6726] predictions:    9778/  10000 (97.78%), best:    9778/10000 (97.78%), error:       765.82660, best error:       765.82660 on epoch:    96, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 131.5763092041s, input_fired_time: 1.5651805401, output_fired_time: 1.5939170122, propagate_forward_time: 49.4870948792, propagate_backward_time: 75.6607742310, weight_update_time: 0.2149290293, other_time: 3.2693405151
epoch time: 10.7724657059s, input_fired_time: 0.1944488138, output_fired_time: 0.0000000000, propagate_forward_time: 10.0038642883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5741529465
validation[          , genome  6726] predictions:    9758/  10000 (97.58%), best:    9778/10000 (97.78%), error:       803.27679, best error:       765.82660 on epoch:    96, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 128.4239196777s, input_fired_time: 1.5382592678, output_fired_time: 1.5853464603, propagate_forward_time: 47.4809303284, propagate_backward_time: 74.3259048462, weight_update_time: 0.2156150639, other_time: 3.4934768677
epoch time: 10.6097164154s, input_fired_time: 0.1902844608, output_fired_time: 0.0000000000, propagate_forward_time: 9.8643064499, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5551252365
validation[          , genome  6726] predictions:    9730/  10000 (97.30%), best:    9778/10000 (97.78%), error:       874.13684, best error:       765.82660 on epoch:    96, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 130.1150512695s, input_fired_time: 1.5415954590, output_fired_time: 1.5874041319, propagate_forward_time: 49.0199050903, propagate_backward_time: 74.7175140381, weight_update_time: 0.2123297453, other_time: 3.2486343384
epoch time: 10.7620153427s, input_fired_time: 0.1999953687, output_fired_time: 0.0000000000, propagate_forward_time: 9.9686841965, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5933361053
validation[          , genome  6726] predictions:    9717/  10000 (97.17%), best:    9778/10000 (97.78%), error:       951.64514, best error:       765.82660 on epoch:    96, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 129.3180694580s, input_fired_time: 1.5385707617, output_fired_time: 1.5826801062, propagate_forward_time: 48.2983665466, propagate_backward_time: 74.6492156982, weight_update_time: 0.2101804018, other_time: 3.2492370605
epoch time: 11.0464696884s, input_fired_time: 0.2004997134, output_fired_time: 0.0000000000, propagate_forward_time: 10.2735300064, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5724401474
validation[          , genome  6726] predictions:    9744/  10000 (97.44%), best:    9778/10000 (97.78%), error:       871.01703, best error:       765.82660 on epoch:    96, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 52.4639129639s, input_fired_time: 0.9695160389, output_fired_time: 0.0000000000, propagate_forward_time: 48.5560493469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9383468628
best training[          , genome  6726] predictions:   49693/  50000 (99.39%), best:    9778/10000 (97.78%), error:      1419.11670, best error:       765.82660 on epoch:    96, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 10.7269067764s, input_fired_time: 0.1963894814, output_fired_time: 0.0000000000, propagate_forward_time: 9.9485826492, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5819349289
   testing[          , genome  6726] predictions:    9777/  10000 (97.77%), best:    9778/10000 (97.78%), error:       733.42889, best error:       765.82660 on epoch:    96, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
15:21:27 (3536): called boinc_finish(0)

</stderr_txt>
]]>