Nameexact_genome_1512568488_44_2202_1
Workunit2582290
Created6 Dec 2017, 22:33:29 UTC
Sent6 Dec 2017, 22:41:41 UTC
Report deadline10 Dec 2017, 0:00:07 UTC
Received7 Dec 2017, 22:36:29 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID65413
Run time1 hours 16 min 25 sec
CPU time1 hours 16 min 25 sec
Validate stateValid
Credit763.62
Device peak FLOPS3.73 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size150.04 MB
Peak swap size151.22 MB
Peak disk usage0.98 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
, epoch:   13/100, mu: 0.7384625077, learning_rate: 0.0064167744, weight_decay: 0.0002566710

epoch time: 44.8515014648s, input_fired_time: 0.4038642347, output_fired_time: 0.2828782499, propagate_forward_time: 18.1717453003, propagate_backward_time: 24.2535095215, weight_update_time: 0.0730839446, other_time: 1.7395019531
epoch time: 3.5203542709s, input_fired_time: 0.0389386564, output_fired_time: 0.0000000000, propagate_forward_time: 3.2030053139, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2784101963
validation[          , genome  2202] predictions:    9293/  10000 (92.93%), best:    9487/10000 (94.87%), error:      2356.02344, best error:      1726.61060 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 40.6217346191s, input_fired_time: 0.3683746159, output_fired_time: 0.2595770955, propagate_forward_time: 16.3990821838, propagate_backward_time: 21.9980583191, weight_update_time: 0.0668785721, other_time: 1.5966415405
epoch time: 3.6438567638s, input_fired_time: 0.0398413241, output_fired_time: 0.0000000000, propagate_forward_time: 3.3162276745, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2877876759
validation[          , genome  2202] predictions:    9280/  10000 (92.80%), best:    9487/10000 (94.87%), error:      2403.90771, best error:      1726.61060 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 42.1559753418s, input_fired_time: 0.3744795024, output_fired_time: 0.2712143362, propagate_forward_time: 17.0040874481, propagate_backward_time: 22.8647174835, weight_update_time: 0.0689559281, other_time: 1.6414756775
epoch time: 4.6501774788s, input_fired_time: 0.0486831889, output_fired_time: 0.0000000000, propagate_forward_time: 4.2460227013, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3554716110
validation[          , genome  2202] predictions:    9369/  10000 (93.69%), best:    9487/10000 (94.87%), error:      2182.94263, best error:      1726.61060 on epoch:    13, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 46.1074790955s, input_fired_time: 0.4011034667, output_fired_time: 0.2883149683, propagate_forward_time: 18.6700572968, propagate_backward_time: 24.9739093781, weight_update_time: 0.0753793120, other_time: 1.7740936279
epoch time: 3.1149230003s, input_fired_time: 0.0346504450, output_fired_time: 0.0000000000, propagate_forward_time: 2.8336558342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2466168404
validation[          , genome  2202] predictions:    9336/  10000 (93.36%), best:    9487/10000 (94.87%), error:      2242.43188, best error:      1726.61060 on epoch:    13, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 47.0620613098s, input_fired_time: 0.4024562836, output_fired_time: 0.2956117392, propagate_forward_time: 19.0888614655, propagate_backward_time: 25.4690189362, weight_update_time: 0.0771933421, other_time: 1.8061141968
epoch time: 4.2521867752s, input_fired_time: 0.0455196649, output_fired_time: 0.0000000000, propagate_forward_time: 3.8760478497, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3306190968
validation[          , genome  2202] predictions:    9335/  10000 (93.35%), best:    9487/10000 (94.87%), error:      2230.01147, best error:      1726.61060 on epoch:    13, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 43.2619972229s, input_fired_time: 0.3844510317, output_fired_time: 0.2751146853, propagate_forward_time: 17.4685039520, propagate_backward_time: 23.4581642151, weight_update_time: 0.0707554743, other_time: 1.6757602692
epoch time: 3.6199259758s, input_fired_time: 0.0403725430, output_fired_time: 0.0000000000, propagate_forward_time: 3.2960135937, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2835397720
validation[          , genome  2202] predictions:    9381/  10000 (93.81%), best:    9487/10000 (94.87%), error:      2119.96021, best error:      1726.61060 on epoch:    13, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 41.6692237854s, input_fired_time: 0.3742508292, output_fired_time: 0.2649556994, propagate_forward_time: 16.7516994476, propagate_backward_time: 22.6602478027, weight_update_time: 0.0680300072, other_time: 1.6180667877
epoch time: 4.6395597458s, input_fired_time: 0.0489077456, output_fired_time: 0.0000000000, propagate_forward_time: 4.2415113449, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3491406441
validation[          , genome  2202] predictions:    9383/  10000 (93.83%), best:    9487/10000 (94.87%), error:      2120.10229, best error:      1726.61060 on epoch:    13, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 40.9915847778s, input_fired_time: 0.3716439605, output_fired_time: 0.2626131177, propagate_forward_time: 16.4973850250, propagate_backward_time: 22.2583694458, weight_update_time: 0.0695759133, other_time: 1.6015758514
epoch time: 3.2569572926s, input_fired_time: 0.0367593057, output_fired_time: 0.0000000000, propagate_forward_time: 2.9561259747, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2640719414
validation[          , genome  2202] predictions:    9371/  10000 (93.71%), best:    9487/10000 (94.87%), error:      2164.96704, best error:      1726.61060 on epoch:    13, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 39.4103698730s, input_fired_time: 0.3628232777, output_fired_time: 0.2540542781, propagate_forward_time: 15.7545690536, propagate_backward_time: 21.4906692505, weight_update_time: 0.0663792863, other_time: 1.5482521057
epoch time: 3.4859480858s, input_fired_time: 0.0390202217, output_fired_time: 0.0000000000, propagate_forward_time: 3.1694025993, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2775251865
validation[          , genome  2202] predictions:    9376/  10000 (93.76%), best:    9487/10000 (94.87%), error:      2104.57471, best error:      1726.61060 on epoch:    13, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 40.5051689148s, input_fired_time: 0.3693116605, output_fired_time: 0.2574587166, propagate_forward_time: 16.2963466644, propagate_backward_time: 22.0008316040, weight_update_time: 0.0663530678, other_time: 1.5812206268
epoch time: 3.6076252460s, input_fired_time: 0.0400649905, output_fired_time: 0.0000000000, propagate_forward_time: 3.2861566544, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2814035416
validation[          , genome  2202] predictions:    9383/  10000 (93.83%), best:    9487/10000 (94.87%), error:      2132.22070, best error:      1726.61060 on epoch:    13, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 40.3928794861s, input_fired_time: 0.3675608933, output_fired_time: 0.2568249106, propagate_forward_time: 16.2929210663, propagate_backward_time: 21.9100360870, weight_update_time: 0.0664884150, other_time: 1.5655364990
epoch time: 3.4561345577s, input_fired_time: 0.0385412797, output_fired_time: 0.0000000000, propagate_forward_time: 3.1455085278, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2720847130
validation[          , genome  2202] predictions:    9370/  10000 (93.70%), best:    9487/10000 (94.87%), error:      2135.22461, best error:      1726.61060 on epoch:    13, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 39.6937980652s, input_fired_time: 0.3638176620, output_fired_time: 0.2542490661, propagate_forward_time: 15.9813804626, propagate_backward_time: 21.5439720154, weight_update_time: 0.0655276105, other_time: 1.5503768921
epoch time: 3.4801683426s, input_fired_time: 0.0390196368, output_fired_time: 0.0000000000, propagate_forward_time: 3.1636078358, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2775409222
validation[          , genome  2202] predictions:    9365/  10000 (93.65%), best:    9487/10000 (94.87%), error:      2202.76221, best error:      1726.61060 on epoch:    13, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 39.8475532532s, input_fired_time: 0.3624529839, output_fired_time: 0.2550540566, propagate_forward_time: 15.9505357742, propagate_backward_time: 21.7280864716, weight_update_time: 0.0656159148, other_time: 1.5514240265
epoch time: 3.5906836987s, input_fired_time: 0.0396048464, output_fired_time: 0.0000000000, propagate_forward_time: 3.2688031197, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2822756767
validation[          , genome  2202] predictions:    9401/  10000 (94.01%), best:    9487/10000 (94.87%), error:      2049.46289, best error:      1726.61060 on epoch:    13, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 39.4700737000s, input_fired_time: 0.3615157008, output_fired_time: 0.2538128197, propagate_forward_time: 15.8652858734, propagate_backward_time: 21.4483032227, weight_update_time: 0.0647573024, other_time: 1.5411548615
epoch time: 3.2687602043s, input_fired_time: 0.0366373509, output_fired_time: 0.0000000000, propagate_forward_time: 2.9735074043, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2586154938
validation[          , genome  2202] predictions:    9388/  10000 (93.88%), best:    9487/10000 (94.87%), error:      2065.26660, best error:      1726.61060 on epoch:    13, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 39.3900070190s, input_fired_time: 0.3571768701, output_fired_time: 0.2518215775, propagate_forward_time: 15.7713813782, propagate_backward_time: 21.4744377136, weight_update_time: 0.0648934692, other_time: 1.5351867676
epoch time: 3.5117835999s, input_fired_time: 0.0380681530, output_fired_time: 0.0000000000, propagate_forward_time: 3.1965403557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2771751881
validation[          , genome  2202] predictions:    9395/  10000 (93.95%), best:    9487/10000 (94.87%), error:      2155.00391, best error:      1726.61060 on epoch:    13, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 43.5727233887s, input_fired_time: 0.3806235790, output_fired_time: 0.2727297843, propagate_forward_time: 17.6217994690, propagate_backward_time: 23.6219959259, weight_update_time: 0.0719555244, other_time: 1.6755771637
epoch time: 3.1668202877s, input_fired_time: 0.0351466313, output_fired_time: 0.0000000000, propagate_forward_time: 2.8813452721, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2503283024
validation[          , genome  2202] predictions:    9375/  10000 (93.75%), best:    9487/10000 (94.87%), error:      2128.96826, best error:      1726.61060 on epoch:    13, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 39.8769226074s, input_fired_time: 0.3631999791, output_fired_time: 0.2550704181, propagate_forward_time: 16.0934562683, propagate_backward_time: 21.6087951660, weight_update_time: 0.0679388195, other_time: 1.5564002991
epoch time: 3.6966402531s, input_fired_time: 0.0408461057, output_fired_time: 0.0000000000, propagate_forward_time: 3.3672280312, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2885661125
validation[          , genome  2202] predictions:    9382/  10000 (93.82%), best:    9487/10000 (94.87%), error:      2088.95581, best error:      1726.61060 on epoch:    13, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 48.0050277710s, input_fired_time: 0.4054461420, output_fired_time: 0.2990656793, propagate_forward_time: 19.5283775330, propagate_backward_time: 25.9517993927, weight_update_time: 0.0798767954, other_time: 1.8203411102
epoch time: 4.5754218102s, input_fired_time: 0.0478275307, output_fired_time: 0.0000000000, propagate_forward_time: 4.1832370758, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3443570137
validation[          , genome  2202] predictions:    9377/  10000 (93.77%), best:    9487/10000 (94.87%), error:      2109.37695, best error:      1726.61060 on epoch:    13, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 42.0423164368s, input_fired_time: 0.3717141747, output_fired_time: 0.2656417191, propagate_forward_time: 16.9426708221, propagate_backward_time: 22.8195953369, weight_update_time: 0.0714458600, other_time: 1.6426944733
epoch time: 2.9465882778s, input_fired_time: 0.0325171538, output_fired_time: 0.0000000000, propagate_forward_time: 2.6729857922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2410852909
validation[          , genome  2202] predictions:    9399/  10000 (93.99%), best:    9487/10000 (94.87%), error:      2083.69458, best error:      1726.61060 on epoch:    13, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 44.7408676147s, input_fired_time: 0.3844946921, output_fired_time: 0.2807013094, propagate_forward_time: 18.1333007812, propagate_backward_time: 24.2229728699, weight_update_time: 0.0760349259, other_time: 1.7193984985
epoch time: 4.6320648193s, input_fired_time: 0.0474535637, output_fired_time: 0.0000000000, propagate_forward_time: 4.2387785912, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3458328247
validation[          , genome  2202] predictions:    9407/  10000 (94.07%), best:    9487/10000 (94.87%), error:      1992.67188, best error:      1726.61060 on epoch:    13, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 43.0456390381s, input_fired_time: 0.3766007721, output_fired_time: 0.2702361345, propagate_forward_time: 17.3336334229, propagate_backward_time: 23.3925380707, weight_update_time: 0.0709645525, other_time: 1.6726284027
epoch time: 3.2342748642s, input_fired_time: 0.0366408937, output_fired_time: 0.0000000000, propagate_forward_time: 2.9417686462, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2558653355
validation[          , genome  2202] predictions:    9422/  10000 (94.22%), best:    9487/10000 (94.87%), error:      2032.01721, best error:      1726.61060 on epoch:    13, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 41.3460807800s, input_fired_time: 0.3791791499, output_fired_time: 0.2639908493, propagate_forward_time: 16.6374645233, propagate_backward_time: 22.4576168060, weight_update_time: 0.0692142546, other_time: 1.6078262329
epoch time: 3.2474617958s, input_fired_time: 0.0384547859, output_fired_time: 0.0000000000, propagate_forward_time: 2.9496850967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2593219280
validation[          , genome  2202] predictions:    9450/  10000 (94.50%), best:    9487/10000 (94.87%), error:      1858.09692, best error:      1726.61060 on epoch:    13, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 40.7341728210s, input_fired_time: 0.3848822713, output_fired_time: 0.2603195310, propagate_forward_time: 16.4049568176, propagate_backward_time: 22.0799388885, weight_update_time: 0.0699464977, other_time: 1.6040744781
epoch time: 4.6620664597s, input_fired_time: 0.0523579307, output_fired_time: 0.0000000000, propagate_forward_time: 4.2600245476, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3496837616
validation[          , genome  2202] predictions:    9458/  10000 (94.58%), best:    9487/10000 (94.87%), error:      1861.43311, best error:      1726.61060 on epoch:    13, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 51.1023941040s, input_fired_time: 0.4442635775, output_fired_time: 0.3165807128, propagate_forward_time: 20.8501968384, propagate_backward_time: 27.5688610077, weight_update_time: 0.0830270201, other_time: 1.9224910736
epoch time: 4.6082110405s, input_fired_time: 0.0521508455, output_fired_time: 0.0000000000, propagate_forward_time: 4.2064757347, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3495845795
validation[          , genome  2202] predictions:    9476/  10000 (94.76%), best:    9487/10000 (94.87%), error:      1793.67395, best error:      1726.61060 on epoch:    13, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 42.7102432251s, input_fired_time: 0.3979393244, output_fired_time: 0.2709439993, propagate_forward_time: 17.2518768311, propagate_backward_time: 23.1340122223, weight_update_time: 0.0704312921, other_time: 1.6554737091
epoch time: 3.5310349464s, input_fired_time: 0.0430347361, output_fired_time: 0.0000000000, propagate_forward_time: 3.2083342075, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2796659470
validation[          , genome  2202] predictions:    9504/  10000 (95.04%), best:    9504/10000 (95.04%), error:      1703.24683, best error:      1703.24683 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 39.5682563782s, input_fired_time: 0.3820752800, output_fired_time: 0.2520855367, propagate_forward_time: 15.8364810944, propagate_backward_time: 21.5363807678, weight_update_time: 0.0650414973, other_time: 1.5612316132
epoch time: 3.4484052658s, input_fired_time: 0.0425687991, output_fired_time: 0.0000000000, propagate_forward_time: 3.1269657612, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2788708210
validation[          , genome  2202] predictions:    9463/  10000 (94.63%), best:    9504/10000 (95.04%), error:      1821.50940, best error:      1703.24683 on epoch:    38, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 39.3531188965s, input_fired_time: 0.3830085397, output_fired_time: 0.2525253296, propagate_forward_time: 15.8206090927, propagate_backward_time: 21.2989597321, weight_update_time: 0.0643027276, other_time: 1.5980167389
epoch time: 3.5488131046s, input_fired_time: 0.0429150462, output_fired_time: 0.0000000000, propagate_forward_time: 3.2272164822, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2786815166
validation[          , genome  2202] predictions:    9483/  10000 (94.83%), best:    9504/10000 (95.04%), error:      1758.31628, best error:      1703.24683 on epoch:    38, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 41.7681274414s, input_fired_time: 0.3951894939, output_fired_time: 0.2654905319, propagate_forward_time: 16.7783718109, propagate_backward_time: 22.6457481384, weight_update_time: 0.0680608451, other_time: 1.6833248138
epoch time: 4.2731246948s, input_fired_time: 0.0499967709, output_fired_time: 0.0000000000, propagate_forward_time: 3.8696441650, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3534836769
validation[          , genome  2202] predictions:    9481/  10000 (94.81%), best:    9504/10000 (95.04%), error:      1741.67004, best error:      1703.24683 on epoch:    38, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 50.5389060974s, input_fired_time: 0.4470062852, output_fired_time: 0.3135865927, propagate_forward_time: 20.5695590973, propagate_backward_time: 27.2153224945, weight_update_time: 0.0814195499, other_time: 1.9934310913
epoch time: 4.3311252594s, input_fired_time: 0.0508032031, output_fired_time: 0.0000000000, propagate_forward_time: 3.9465947151, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3337273598
validation[          , genome  2202] predictions:    9490/  10000 (94.90%), best:    9504/10000 (95.04%), error:      1705.81470, best error:      1703.24683 on epoch:    38, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 47.1179161072s, input_fired_time: 0.4267197251, output_fired_time: 0.2956064343, propagate_forward_time: 19.0631694794, propagate_backward_time: 25.4670562744, weight_update_time: 0.0764852613, other_time: 1.8653659821
epoch time: 3.3559155464s, input_fired_time: 0.0414911956, output_fired_time: 0.0000000000, propagate_forward_time: 3.0255842209, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2888400555
validation[          , genome  2202] predictions:    9494/  10000 (94.94%), best:    9494/10000 (94.94%), error:      1689.13232, best error:      1689.13232 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 39.9766082764s, input_fired_time: 0.3876548111, output_fired_time: 0.2604844868, propagate_forward_time: 16.1140823364, propagate_backward_time: 21.6268215179, weight_update_time: 0.0654083043, other_time: 1.5875682831
epoch time: 3.4841928482s, input_fired_time: 0.0493675061, output_fired_time: 0.0000000000, propagate_forward_time: 3.1606314182, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2741940022
validation[          , genome  2202] predictions:    9481/  10000 (94.81%), best:    9494/10000 (94.94%), error:      1784.94092, best error:      1689.13232 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 42.9828720093s, input_fired_time: 0.4050428271, output_fired_time: 0.2716461122, propagate_forward_time: 17.3629302979, propagate_backward_time: 23.2764167786, weight_update_time: 0.0717834756, other_time: 1.6668357849
epoch time: 3.4373383522s, input_fired_time: 0.0428428650, output_fired_time: 0.0000000000, propagate_forward_time: 3.1099121571, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2845833302
validation[          , genome  2202] predictions:    9518/  10000 (95.18%), best:    9518/10000 (95.18%), error:      1662.44836, best error:      1662.44836 on epoch:    45, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 45.7853202820s, input_fired_time: 0.4212250412, output_fired_time: 0.2882709205, propagate_forward_time: 18.5762805939, propagate_backward_time: 24.7024097443, weight_update_time: 0.0745369792, other_time: 1.7971343994
epoch time: 3.4821434021s, input_fired_time: 0.0426222123, output_fired_time: 0.0000000000, propagate_forward_time: 3.1634759903, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2760450840
validation[          , genome  2202] predictions:    9483/  10000 (94.83%), best:    9518/10000 (95.18%), error:      1695.63635, best error:      1662.44836 on epoch:    45, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 44.4418945312s, input_fired_time: 0.4163830876, output_fired_time: 0.2822485566, propagate_forward_time: 17.9804649353, propagate_backward_time: 24.0599136353, weight_update_time: 0.0724905506, other_time: 1.7028846741
epoch time: 3.1512293816s, input_fired_time: 0.0411285795, output_fired_time: 0.0000000000, propagate_forward_time: 2.8500473499, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2600533962
validation[          , genome  2202] predictions:    9502/  10000 (95.02%), best:    9518/10000 (95.18%), error:      1727.42798, best error:      1662.44836 on epoch:    45, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 42.6327209473s, input_fired_time: 0.4026419818, output_fired_time: 0.2796836793, propagate_forward_time: 17.1807861328, propagate_backward_time: 23.1094150543, weight_update_time: 0.0713859499, other_time: 1.6601963043
epoch time: 4.6692237854s, input_fired_time: 0.0542294793, output_fired_time: 0.0000000000, propagate_forward_time: 4.2611846924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3538098335
validation[          , genome  2202] predictions:    9510/  10000 (95.10%), best:    9510/10000 (95.10%), error:      1654.34558, best error:      1654.34558 on epoch:    48, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 48.0583648682s, input_fired_time: 0.4331945777, output_fired_time: 0.3071703315, propagate_forward_time: 19.5547733307, propagate_backward_time: 25.9197158813, weight_update_time: 0.0787888989, other_time: 1.8435115814
epoch time: 3.5427038670s, input_fired_time: 0.0434172638, output_fired_time: 0.0000000000, propagate_forward_time: 3.2198109627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2794756889
validation[          , genome  2202] predictions:    9477/  10000 (94.77%), best:    9510/10000 (95.10%), error:      1751.05481, best error:      1654.34558 on epoch:    48, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 39.6991348267s, input_fired_time: 0.3830567002, output_fired_time: 0.2563171685, propagate_forward_time: 15.9728755951, propagate_backward_time: 21.5460662842, weight_update_time: 0.0654543042, other_time: 1.5408191681
epoch time: 3.5722122192s, input_fired_time: 0.0429688394, output_fired_time: 0.0000000000, propagate_forward_time: 3.2531917095, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2760517597
validation[          , genome  2202] predictions:    9493/  10000 (94.93%), best:    9510/10000 (95.10%), error:      1672.00378, best error:      1654.34558 on epoch:    48, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 40.6466789246s, input_fired_time: 0.3861593008, output_fired_time: 0.2607776523, propagate_forward_time: 16.3702125549, propagate_backward_time: 22.0797176361, weight_update_time: 0.0665141568, other_time: 1.5498142242
epoch time: 3.6175899506s, input_fired_time: 0.0431243107, output_fired_time: 0.0000000000, propagate_forward_time: 3.2926840782, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2817816734
validation[          , genome  2202] predictions:    9497/  10000 (94.97%), best:    9510/10000 (95.10%), error:      1667.11230, best error:      1654.34558 on epoch:    48, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 42.0917434692s, input_fired_time: 0.3956176043, output_fired_time: 0.2668534219, propagate_forward_time: 16.9608478546, propagate_backward_time: 22.8452033997, weight_update_time: 0.0687691346, other_time: 1.6232204437
epoch time: 3.5641708374s, input_fired_time: 0.0431951433, output_fired_time: 0.0000000000, propagate_forward_time: 3.2373921871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2835834026
validation[          , genome  2202] predictions:    9461/  10000 (94.61%), best:    9510/10000 (95.10%), error:      1851.00769, best error:      1654.34558 on epoch:    48, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 46.3857612610s, input_fired_time: 0.4207155108, output_fired_time: 0.2893829048, propagate_forward_time: 18.8324069977, propagate_backward_time: 25.0737781525, weight_update_time: 0.0758880824, other_time: 1.7694778442
epoch time: 3.5244033337s, input_fired_time: 0.0433795415, output_fired_time: 0.0000000000, propagate_forward_time: 3.2039725780, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2770512104
validation[          , genome  2202] predictions:    9498/  10000 (94.98%), best:    9498/10000 (94.98%), error:      1633.88123, best error:      1633.88123 on epoch:    53, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 37.2063751221s, input_fired_time: 0.3716188073, output_fired_time: 0.2407102883, propagate_forward_time: 14.8822326660, propagate_backward_time: 20.2308902740, weight_update_time: 0.0637841895, other_time: 1.4809207916
epoch time: 3.4580113888s, input_fired_time: 0.0427729078, output_fired_time: 0.0000000000, propagate_forward_time: 3.1428313255, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2724070549
validation[          , genome  2202] predictions:    9517/  10000 (95.17%), best:    9517/10000 (95.17%), error:      1622.39246, best error:      1622.39246 on epoch:    54, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 37.1260910034s, input_fired_time: 0.3752184808, output_fired_time: 0.2424417287, propagate_forward_time: 14.8592109680, propagate_backward_time: 20.1692008972, weight_update_time: 0.0636997521, other_time: 1.4800186157
epoch time: 4.2264351845s, input_fired_time: 0.0515474491, output_fired_time: 0.0000000000, propagate_forward_time: 3.8502802849, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3246073723
validation[          , genome  2202] predictions:    9471/  10000 (94.71%), best:    9517/10000 (95.17%), error:      1732.28772, best error:      1622.39246 on epoch:    54, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 39.6249084473s, input_fired_time: 0.3879536986, output_fired_time: 0.2540170252, propagate_forward_time: 15.8485908508, propagate_backward_time: 21.5467395782, weight_update_time: 0.0677344799, other_time: 1.5876064301
epoch time: 3.2313141823s, input_fired_time: 0.0411762185, output_fired_time: 0.0000000000, propagate_forward_time: 2.9282579422, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2618799210
validation[          , genome  2202] predictions:    9505/  10000 (95.05%), best:    9517/10000 (95.17%), error:      1666.43115, best error:      1622.39246 on epoch:    54, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 37.5967826843s, input_fired_time: 0.3769289851, output_fired_time: 0.2451700121, propagate_forward_time: 15.1755065918, propagate_backward_time: 20.2947788239, weight_update_time: 0.0638411567, other_time: 1.5043964386
epoch time: 3.2775132656s, input_fired_time: 0.0413938612, output_fired_time: 0.0000000000, propagate_forward_time: 2.9738752842, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2622442245
validation[          , genome  2202] predictions:    9487/  10000 (94.87%), best:    9517/10000 (95.17%), error:      1695.44397, best error:      1622.39246 on epoch:    54, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 40.1625137329s, input_fired_time: 0.3899570107, output_fired_time: 0.2564541101, propagate_forward_time: 16.1587448120, propagate_backward_time: 21.7697715759, weight_update_time: 0.0683046579, other_time: 1.5875854492
epoch time: 2.6932895184s, input_fired_time: 0.0357615352, output_fired_time: 0.0000000000, propagate_forward_time: 2.4372129440, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2203149796
validation[          , genome  2202] predictions:    9501/  10000 (95.01%), best:    9517/10000 (95.17%), error:      1653.69214, best error:      1622.39246 on epoch:    54, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 41.1112365723s, input_fired_time: 0.3935909271, output_fired_time: 0.2618709803, propagate_forward_time: 16.5720329285, propagate_backward_time: 22.2805519104, weight_update_time: 0.0694137067, other_time: 1.6031875610
epoch time: 3.1193926334s, input_fired_time: 0.0399355069, output_fired_time: 0.0000000000, propagate_forward_time: 2.8301134109, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2493436337
validation[          , genome  2202] predictions:    9509/  10000 (95.09%), best:    9517/10000 (95.17%), error:      1653.13403, best error:      1622.39246 on epoch:    54, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 36.5334320068s, input_fired_time: 0.3692786396, output_fired_time: 0.2377129048, propagate_forward_time: 14.5645322800, propagate_backward_time: 19.8942642212, weight_update_time: 0.0628756136, other_time: 1.4676437378
epoch time: 3.2098526955s, input_fired_time: 0.0405545123, output_fired_time: 0.0000000000, propagate_forward_time: 2.9124042988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2568938732
validation[          , genome  2202] predictions:    9461/  10000 (94.61%), best:    9517/10000 (95.17%), error:      1747.11047, best error:      1622.39246 on epoch:    54, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 43.4581565857s, input_fired_time: 0.4070076644, output_fired_time: 0.2758300602, propagate_forward_time: 17.4941501617, propagate_backward_time: 23.6177482605, weight_update_time: 0.0721754283, other_time: 1.6634197235
epoch time: 4.2490029335s, input_fired_time: 0.0494886637, output_fired_time: 0.0000000000, propagate_forward_time: 3.8756401539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3238742352
validation[          , genome  2202] predictions:    9505/  10000 (95.05%), best:    9517/10000 (95.17%), error:      1698.78479, best error:      1622.39246 on epoch:    54, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 41.8849258423s, input_fired_time: 0.3994836509, output_fired_time: 0.2685469091, propagate_forward_time: 16.9361782074, propagate_backward_time: 22.6642017365, weight_update_time: 0.0689622909, other_time: 1.6165161133
epoch time: 3.5870611668s, input_fired_time: 0.0442817286, output_fired_time: 0.0000000000, propagate_forward_time: 3.2640235424, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2787559032
validation[          , genome  2202] predictions:    9503/  10000 (95.03%), best:    9517/10000 (95.17%), error:      1669.46704, best error:      1622.39246 on epoch:    54, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 40.1628303528s, input_fired_time: 0.3882520199, output_fired_time: 0.2576653957, propagate_forward_time: 16.1477451324, propagate_backward_time: 21.8076190948, weight_update_time: 0.0664730147, other_time: 1.5615501404
epoch time: 3.5651047230s, input_fired_time: 0.0440205000, output_fired_time: 0.0000000000, propagate_forward_time: 3.2408456802, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2802386284
validation[          , genome  2202] predictions:    9516/  10000 (95.16%), best:    9517/10000 (95.17%), error:      1626.46912, best error:      1622.39246 on epoch:    54, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 40.0060882568s, input_fired_time: 0.3854137957, output_fired_time: 0.2577658296, propagate_forward_time: 16.0919284821, propagate_backward_time: 21.7296524048, weight_update_time: 0.0659659579, other_time: 1.5413265228
epoch time: 3.6771755219s, input_fired_time: 0.0445370376, output_fired_time: 0.0000000000, propagate_forward_time: 3.3492400646, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2833983898
validation[          , genome  2202] predictions:    9490/  10000 (94.90%), best:    9517/10000 (95.17%), error:      1696.72595, best error:      1622.39246 on epoch:    54, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 43.1771774292s, input_fired_time: 0.4048890769, output_fired_time: 0.2733490169, propagate_forward_time: 17.4398841858, propagate_backward_time: 23.4211616516, weight_update_time: 0.0703410804, other_time: 1.6378936768
epoch time: 3.4016039371s, input_fired_time: 0.0431100465, output_fired_time: 0.0000000000, propagate_forward_time: 3.0891387463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2693550587
validation[          , genome  2202] predictions:    9493/  10000 (94.93%), best:    9517/10000 (95.17%), error:      1660.11780, best error:      1622.39246 on epoch:    54, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 48.0399208069s, input_fired_time: 0.4332264662, output_fired_time: 0.2987540066, propagate_forward_time: 19.5051250458, propagate_backward_time: 25.9934940338, weight_update_time: 0.0784480050, other_time: 1.8093185425
epoch time: 3.5785856247s, input_fired_time: 0.0439861529, output_fired_time: 0.0000000000, propagate_forward_time: 3.2576305866, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2769689560
validation[          , genome  2202] predictions:    9515/  10000 (95.15%), best:    9517/10000 (95.17%), error:      1622.91296, best error:      1622.39246 on epoch:    54, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 39.3353004456s, input_fired_time: 0.3832167387, output_fired_time: 0.2536289990, propagate_forward_time: 15.8155107498, propagate_backward_time: 21.3758010864, weight_update_time: 0.0642504469, other_time: 1.5071449280
epoch time: 3.4890558720s, input_fired_time: 0.0430808999, output_fired_time: 0.0000000000, propagate_forward_time: 3.1759729385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2700021267
validation[          , genome  2202] predictions:    9491/  10000 (94.91%), best:    9517/10000 (95.17%), error:      1697.10681, best error:      1622.39246 on epoch:    54, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 43.6191024780s, input_fired_time: 0.4074359834, output_fired_time: 0.2766626179, propagate_forward_time: 17.6155643463, propagate_backward_time: 23.6633777618, weight_update_time: 0.0715266094, other_time: 1.6560630798
epoch time: 3.3526990414s, input_fired_time: 0.0420666970, output_fired_time: 0.0000000000, propagate_forward_time: 3.0482156277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2624166012
validation[          , genome  2202] predictions:    9511/  10000 (95.11%), best:    9511/10000 (95.11%), error:      1620.06274, best error:      1620.06274 on epoch:    68, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 39.7329864502s, input_fired_time: 0.3851434290, output_fired_time: 0.2561262250, propagate_forward_time: 15.9627952576, propagate_backward_time: 21.6067752838, weight_update_time: 0.0653568059, other_time: 1.5221462250
epoch time: 3.5134840012s, input_fired_time: 0.0434365422, output_fired_time: 0.0000000000, propagate_forward_time: 3.1973075867, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2727398872
validation[          , genome  2202] predictions:    9513/  10000 (95.13%), best:    9511/10000 (95.11%), error:      1624.51709, best error:      1620.06274 on epoch:    68, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 49.1967239380s, input_fired_time: 0.4394547939, output_fired_time: 0.3043044508, propagate_forward_time: 20.0430469513, propagate_backward_time: 26.5575351715, weight_update_time: 0.0794297010, other_time: 1.8523826599
epoch time: 4.1441922188s, input_fired_time: 0.0493789949, output_fired_time: 0.0000000000, propagate_forward_time: 3.7786469460, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3161664009
validation[          , genome  2202] predictions:    9516/  10000 (95.16%), best:    9516/10000 (95.16%), error:      1610.84790, best error:      1610.84790 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 43.3052024841s, input_fired_time: 0.4040761888, output_fired_time: 0.2740181983, propagate_forward_time: 17.4714756012, propagate_backward_time: 23.4841175079, weight_update_time: 0.0706819445, other_time: 1.6715164185
epoch time: 3.2826237679s, input_fired_time: 0.0414534584, output_fired_time: 0.0000000000, propagate_forward_time: 2.9806833267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2604870796
validation[          , genome  2202] predictions:    9509/  10000 (95.09%), best:    9516/10000 (95.16%), error:      1628.35571, best error:      1610.84790 on epoch:    70, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 40.5739631653s, input_fired_time: 0.3912318647, output_fired_time: 0.2606872022, propagate_forward_time: 16.3068504333, propagate_backward_time: 22.0487232208, weight_update_time: 0.0661178455, other_time: 1.5664691925
epoch time: 3.5324358940s, input_fired_time: 0.0436155982, output_fired_time: 0.0000000000, propagate_forward_time: 3.2125399113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2762804031
validation[          , genome  2202] predictions:    9518/  10000 (95.18%), best:    9518/10000 (95.18%), error:      1591.79822, best error:      1591.79822 on epoch:    72, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 40.3746185303s, input_fired_time: 0.3897221088, output_fired_time: 0.2591518164, propagate_forward_time: 16.2974014282, propagate_backward_time: 21.8560218811, weight_update_time: 0.0662614629, other_time: 1.5723228455
epoch time: 3.6732821465s, input_fired_time: 0.0442620255, output_fired_time: 0.0000000000, propagate_forward_time: 3.3434224129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2855978012
validation[          , genome  2202] predictions:    9534/  10000 (95.34%), best:    9518/10000 (95.18%), error:      1632.05920, best error:      1591.79822 on epoch:    72, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 43.2430572510s, input_fired_time: 0.4046441615, output_fired_time: 0.2737414837, propagate_forward_time: 17.4768295288, propagate_backward_time: 23.4278450012, weight_update_time: 0.0703625157, other_time: 1.6599960327
epoch time: 4.0402979851s, input_fired_time: 0.0486523658, output_fired_time: 0.0000000000, propagate_forward_time: 3.6791167259, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3125288486
validation[          , genome  2202] predictions:    9499/  10000 (94.99%), best:    9518/10000 (95.18%), error:      1630.20300, best error:      1591.79822 on epoch:    72, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 38.4727935791s, input_fired_time: 0.3857838511, output_fired_time: 0.2525386810, propagate_forward_time: 15.4196462631, propagate_backward_time: 20.8518409729, weight_update_time: 0.0658458322, other_time: 1.5629844666
epoch time: 4.6536469460s, input_fired_time: 0.0547955371, output_fired_time: 0.0000000000, propagate_forward_time: 4.2499809265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3488702774
validation[          , genome  2202] predictions:    9490/  10000 (94.90%), best:    9518/10000 (95.18%), error:      1709.81812, best error:      1591.79822 on epoch:    72, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 38.2360877991s, input_fired_time: 0.3822451532, output_fired_time: 0.2470207810, propagate_forward_time: 15.2998962402, propagate_backward_time: 20.7924213409, weight_update_time: 0.0656285062, other_time: 1.5145053864
epoch time: 3.7327511311s, input_fired_time: 0.0460654385, output_fired_time: 0.0000000000, propagate_forward_time: 3.3872671127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2994186878
validation[          , genome  2202] predictions:    9508/  10000 (95.08%), best:    9518/10000 (95.18%), error:      1662.83435, best error:      1591.79822 on epoch:    72, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 41.6529998779s, input_fired_time: 0.4029552341, output_fired_time: 0.2667301595, propagate_forward_time: 16.7127285004, propagate_backward_time: 22.5784454346, weight_update_time: 0.0700374246, other_time: 1.6921405792
epoch time: 3.0755648613s, input_fired_time: 0.0406000353, output_fired_time: 0.0000000000, propagate_forward_time: 2.7881317139, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2468330860
validation[          , genome  2202] predictions:    9511/  10000 (95.11%), best:    9518/10000 (95.18%), error:      1634.29333, best error:      1591.79822 on epoch:    72, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 37.3586158752s, input_fired_time: 0.3828416467, output_fired_time: 0.2454341054, propagate_forward_time: 15.0017242432, propagate_backward_time: 20.2570075989, weight_update_time: 0.0635674596, other_time: 1.4716072083
epoch time: 3.3213977814s, input_fired_time: 0.0424047448, output_fired_time: 0.0000000000, propagate_forward_time: 3.0160319805, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2629611492
validation[          , genome  2202] predictions:    9504/  10000 (95.04%), best:    9518/10000 (95.18%), error:      1646.06909, best error:      1591.79822 on epoch:    72, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 41.2532844543s, input_fired_time: 0.4010642171, output_fired_time: 0.2668730617, propagate_forward_time: 16.6680221558, propagate_backward_time: 22.2687435150, weight_update_time: 0.0704650953, other_time: 1.6485805511
epoch time: 3.6328678131s, input_fired_time: 0.0457751378, output_fired_time: 0.0000000000, propagate_forward_time: 3.3019340038, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2851586342
validation[          , genome  2202] predictions:    9498/  10000 (94.98%), best:    9518/10000 (95.18%), error:      1648.93335, best error:      1591.79822 on epoch:    72, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 41.3422164917s, input_fired_time: 0.4006040394, output_fired_time: 0.2628158331, propagate_forward_time: 16.6303806305, propagate_backward_time: 22.4065399170, weight_update_time: 0.0706677809, other_time: 1.6418743134
epoch time: 3.1408796310s, input_fired_time: 0.0407521874, output_fired_time: 0.0000000000, propagate_forward_time: 2.8526825905, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2474448681
validation[          , genome  2202] predictions:    9501/  10000 (95.01%), best:    9518/10000 (95.18%), error:      1630.27832, best error:      1591.79822 on epoch:    72, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 36.8862419128s, input_fired_time: 0.3737781048, output_fired_time: 0.2421877235, propagate_forward_time: 14.7231283188, propagate_backward_time: 20.0736541748, weight_update_time: 0.0634851009, other_time: 1.4734916687
epoch time: 3.2337980270s, input_fired_time: 0.0413973890, output_fired_time: 0.0000000000, propagate_forward_time: 2.9365284443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2558722496
validation[          , genome  2202] predictions:    9498/  10000 (94.98%), best:    9518/10000 (95.18%), error:      1645.04370, best error:      1591.79822 on epoch:    72, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 40.0199737549s, input_fired_time: 0.3917701542, output_fired_time: 0.2604759634, propagate_forward_time: 16.0875644684, propagate_backward_time: 21.7289047241, weight_update_time: 0.0680167302, other_time: 1.5512599945
epoch time: 3.1505227089s, input_fired_time: 0.0408815667, output_fired_time: 0.0000000000, propagate_forward_time: 2.8561120033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2535290718
validation[          , genome  2202] predictions:    9445/  10000 (94.45%), best:    9518/10000 (95.18%), error:      1906.76648, best error:      1591.79822 on epoch:    72, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 36.3476524353s, input_fired_time: 0.3750030994, output_fired_time: 0.2396972477, propagate_forward_time: 14.6876220703, propagate_backward_time: 19.5954246521, weight_update_time: 0.0625827014, other_time: 1.4499053955
epoch time: 4.0478134155s, input_fired_time: 0.0499944873, output_fired_time: 0.0000000000, propagate_forward_time: 3.6747727394, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3230462074
validation[          , genome  2202] predictions:    9513/  10000 (95.13%), best:    9518/10000 (95.18%), error:      1680.67871, best error:      1591.79822 on epoch:    72, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 40.2146034241s, input_fired_time: 0.3939999938, output_fired_time: 0.2583779395, propagate_forward_time: 16.1892604828, propagate_backward_time: 21.7702274323, weight_update_time: 0.0684468970, other_time: 1.6027374268
epoch time: 3.2216756344s, input_fired_time: 0.0416313559, output_fired_time: 0.0000000000, propagate_forward_time: 2.9276952744, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2523488998
validation[          , genome  2202] predictions:    9519/  10000 (95.19%), best:    9518/10000 (95.18%), error:      1600.09302, best error:      1591.79822 on epoch:    72, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 38.2243804932s, input_fired_time: 0.3813102841, output_fired_time: 0.2453384995, propagate_forward_time: 15.2838516235, propagate_backward_time: 20.8169231415, weight_update_time: 0.0658453405, other_time: 1.4969577789
epoch time: 3.6104547977s, input_fired_time: 0.0456593521, output_fired_time: 0.0000000000, propagate_forward_time: 3.2830302715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2817652225
validation[          , genome  2202] predictions:    9501/  10000 (95.01%), best:    9518/10000 (95.18%), error:      1663.92236, best error:      1591.79822 on epoch:    72, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 37.3826293945s, input_fired_time: 0.3809131086, output_fired_time: 0.2464732081, propagate_forward_time: 14.9621391296, propagate_backward_time: 20.3204936981, weight_update_time: 0.0639529377, other_time: 1.4726123810
epoch time: 3.1579341888s, input_fired_time: 0.0415954515, output_fired_time: 0.0000000000, propagate_forward_time: 2.8667883873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2495503426
validation[          , genome  2202] predictions:    9488/  10000 (94.88%), best:    9518/10000 (95.18%), error:      1692.39661, best error:      1591.79822 on epoch:    72, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 36.4032745361s, input_fired_time: 0.3734279871, output_fired_time: 0.2410594970, propagate_forward_time: 14.5385265350, propagate_backward_time: 19.8112335205, weight_update_time: 0.0626494437, other_time: 1.4390277863
epoch time: 4.2792239189s, input_fired_time: 0.0514935032, output_fired_time: 0.0000000000, propagate_forward_time: 3.9041948318, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3235354424
validation[          , genome  2202] predictions:    9514/  10000 (95.14%), best:    9518/10000 (95.18%), error:      1620.09229, best error:      1591.79822 on epoch:    72, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 43.8708877563s, input_fired_time: 0.4156251848, output_fired_time: 0.2771663666, propagate_forward_time: 17.7328376770, propagate_backward_time: 23.7617874146, weight_update_time: 0.0739765093, other_time: 1.6834678650
epoch time: 3.1767203808s, input_fired_time: 0.0415138751, output_fired_time: 0.0000000000, propagate_forward_time: 2.8815071583, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2536993027
validation[          , genome  2202] predictions:    9526/  10000 (95.26%), best:    9518/10000 (95.18%), error:      1619.71863, best error:      1591.79822 on epoch:    72, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 36.4640464783s, input_fired_time: 0.3708359003, output_fired_time: 0.2360098660, propagate_forward_time: 14.4896869659, propagate_backward_time: 19.9223613739, weight_update_time: 0.0631334931, other_time: 1.4451522827
epoch time: 3.3025679588s, input_fired_time: 0.0427181274, output_fired_time: 0.0000000000, propagate_forward_time: 3.0002937317, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2595560551
validation[          , genome  2202] predictions:    9519/  10000 (95.19%), best:    9518/10000 (95.18%), error:      1619.66016, best error:      1591.79822 on epoch:    72, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 36.4637947083s, input_fired_time: 0.3734204173, output_fired_time: 0.2362679243, propagate_forward_time: 14.5832767487, propagate_backward_time: 19.8192729950, weight_update_time: 0.0634202063, other_time: 1.4515571594
epoch time: 3.2114605904s, input_fired_time: 0.0421228148, output_fired_time: 0.0000000000, propagate_forward_time: 2.9162542820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2530834675
validation[          , genome  2202] predictions:    9521/  10000 (95.21%), best:    9521/10000 (95.21%), error:      1580.33582, best error:      1580.33582 on epoch:    90, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 39.7184944153s, input_fired_time: 0.3924515247, output_fired_time: 0.2552122176, propagate_forward_time: 15.9039049149, propagate_backward_time: 21.6136054993, weight_update_time: 0.0678617433, other_time: 1.5533218384
epoch time: 3.2261447906s, input_fired_time: 0.0418847315, output_fired_time: 0.0000000000, propagate_forward_time: 2.9286251068, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2556350231
validation[          , genome  2202] predictions:    9535/  10000 (95.35%), best:    9521/10000 (95.21%), error:      1600.92273, best error:      1580.33582 on epoch:    90, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 33.9174728394s, input_fired_time: 0.3576945066, output_fired_time: 0.2229063809, propagate_forward_time: 13.3743638992, propagate_backward_time: 18.6057052612, weight_update_time: 0.0594674647, other_time: 1.3568038940
epoch time: 3.4109435081s, input_fired_time: 0.0437457189, output_fired_time: 0.0000000000, propagate_forward_time: 3.1012275219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2659702301
validation[          , genome  2202] predictions:    9520/  10000 (95.20%), best:    9521/10000 (95.21%), error:      1591.69934, best error:      1580.33582 on epoch:    90, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 39.4555854797s, input_fired_time: 0.3911809325, output_fired_time: 0.2556734979, propagate_forward_time: 15.8388834000, propagate_backward_time: 21.4386920929, weight_update_time: 0.0670905411, other_time: 1.5311565399
epoch time: 3.1188757420s, input_fired_time: 0.0412632376, output_fired_time: 0.0000000000, propagate_forward_time: 2.8295056820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2481067181
validation[          , genome  2202] predictions:    9528/  10000 (95.28%), best:    9521/10000 (95.21%), error:      1625.25623, best error:      1580.33582 on epoch:    90, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 40.6129035950s, input_fired_time: 0.3976743519, output_fired_time: 0.2615271807, propagate_forward_time: 16.3470745087, propagate_backward_time: 22.0332565308, weight_update_time: 0.0683930218, other_time: 1.5733699799
epoch time: 3.4581353664s, input_fired_time: 0.0444940999, output_fired_time: 0.0000000000, propagate_forward_time: 3.1390309334, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2746102810
validation[          , genome  2202] predictions:    9533/  10000 (95.33%), best:    9521/10000 (95.21%), error:      1593.57605, best error:      1580.33582 on epoch:    90, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 50.5178070068s, input_fired_time: 0.4581116438, output_fired_time: 0.3102478683, propagate_forward_time: 20.5746288300, propagate_backward_time: 27.2735214233, weight_update_time: 0.0838677287, other_time: 1.9012966156
epoch time: 3.1574268341s, input_fired_time: 0.0425249562, output_fired_time: 0.0000000000, propagate_forward_time: 2.8642492294, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2506525517
validation[          , genome  2202] predictions:    9500/  10000 (95.00%), best:    9521/10000 (95.21%), error:      1641.35205, best error:      1580.33582 on epoch:    90, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 46.0675201416s, input_fired_time: 0.4295645058, output_fired_time: 0.2894816399, propagate_forward_time: 18.6210994720, propagate_backward_time: 24.9587764740, weight_update_time: 0.0766036734, other_time: 1.7685966492
epoch time: 4.6582388878s, input_fired_time: 0.0554123335, output_fired_time: 0.0000000000, propagate_forward_time: 4.2560534477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3467731476
validation[          , genome  2202] predictions:    9501/  10000 (95.01%), best:    9521/10000 (95.21%), error:      1645.30347, best error:      1580.33582 on epoch:    90, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 43.0250129700s, input_fired_time: 0.4147299230, output_fired_time: 0.2757909000, propagate_forward_time: 17.4397583008, propagate_backward_time: 23.2274322510, weight_update_time: 0.0727418363, other_time: 1.6673011780
epoch time: 3.1551787853s, input_fired_time: 0.0415713452, output_fired_time: 0.0000000000, propagate_forward_time: 2.8624663353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2511410713
validation[          , genome  2202] predictions:    9513/  10000 (95.13%), best:    9521/10000 (95.21%), error:      1611.09631, best error:      1580.33582 on epoch:    90, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 36.7068367004s, input_fired_time: 0.3770286739, output_fired_time: 0.2400698066, propagate_forward_time: 14.7420892715, propagate_backward_time: 19.8962497711, weight_update_time: 0.0632869229, other_time: 1.4513988495
epoch time: 4.6276602745s, input_fired_time: 0.0547309257, output_fired_time: 0.0000000000, propagate_forward_time: 4.2253751755, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3475542068
validation[          , genome  2202] predictions:    9514/  10000 (95.14%), best:    9521/10000 (95.21%), error:      1600.47583, best error:      1580.33582 on epoch:    90, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 42.2917671204s, input_fired_time: 0.4109442830, output_fired_time: 0.2683553100, propagate_forward_time: 17.0372676849, propagate_backward_time: 22.9325885773, weight_update_time: 0.0715077445, other_time: 1.6426086426
epoch time: 3.1615755558s, input_fired_time: 0.0419591814, output_fired_time: 0.0000000000, propagate_forward_time: 2.8673963547, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2522199154
validation[          , genome  2202] predictions:    9514/  10000 (95.14%), best:    9521/10000 (95.21%), error:      1612.76880, best error:      1580.33582 on epoch:    90, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 39.6833648682s, input_fired_time: 0.3933455646, output_fired_time: 0.2564809024, propagate_forward_time: 15.9441289902, propagate_backward_time: 21.5407638550, weight_update_time: 0.0660592169, other_time: 1.5486450195
epoch time: 3.4664630890s, input_fired_time: 0.0446679927, output_fired_time: 0.0000000000, propagate_forward_time: 3.1476321220, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2741630077
validation[          , genome  2202] predictions:    9532/  10000 (95.32%), best:    9532/10000 (95.32%), error:      1578.86707, best error:      1578.86707 on epoch:   100, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 17.7012710571s, input_fired_time: 0.2305711359, output_fired_time: 0.0000000000, propagate_forward_time: 16.0251960754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4455032349
best training[          , genome  2202] predictions:   48425/  50000 (96.85%), best:    9532/10000 (95.32%), error:      5638.72070, best error:      1578.86707 on epoch:   100, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 3.6143975258s, input_fired_time: 0.0454514474, output_fired_time: 0.0000000000, propagate_forward_time: 3.2701811790, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2987649441
   testing[          , genome  2202] predictions:    9598/  10000 (95.98%), best:    9532/10000 (95.32%), error:      1389.05261, best error:      1578.86707 on epoch:   100, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
22:36:16 (36187): called boinc_finish(0)

</stderr_txt>
]]>