Nameexact_genome_1512568488_41_1903_0
Workunit2580815
Created6 Dec 2017, 21:15:05 UTC
Sent6 Dec 2017, 21:17:20 UTC
Report deadline9 Dec 2017, 20:24:45 UTC
Received7 Dec 2017, 21:57:36 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID65413
Run time1 hours 14 min 19 sec
CPU time1 hours 14 min 15 sec
Validate stateValid
Credit740.87
Device peak FLOPS3.73 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size148.86 MB
Peak swap size150.19 MB
Peak disk usage0.85 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
, epoch:   13/100, mu: 0.7384625077, learning_rate: 0.0064167744, weight_decay: 0.0002566710

epoch time: 46.2475090027s, input_fired_time: 0.3759071529, output_fired_time: 0.2707769871, propagate_forward_time: 18.0617675781, propagate_backward_time: 25.6985816956, weight_update_time: 0.0738543347, other_time: 1.8404731750
epoch time: 4.2656750679s, input_fired_time: 0.0447707139, output_fired_time: 0.0000000000, propagate_forward_time: 3.8773775101, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3435268402
validation[          , genome  1903] predictions:    9371/  10000 (93.71%), best:    9389/10000 (93.89%), error:      2132.75415, best error:      2116.16748 on epoch:    12, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 48.2943000793s, input_fired_time: 0.3840439916, output_fired_time: 0.2824114859, propagate_forward_time: 18.9310340881, propagate_backward_time: 26.8018665314, weight_update_time: 0.0762946457, other_time: 1.8949451447
epoch time: 3.6964883804s, input_fired_time: 0.0389612727, output_fired_time: 0.0000000000, propagate_forward_time: 3.3597381115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2977890968
validation[          , genome  1903] predictions:    9387/  10000 (93.87%), best:    9387/10000 (93.87%), error:      2033.15649, best error:      2033.15649 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 38.7779998779s, input_fired_time: 0.3299688101, output_fired_time: 0.2349619269, propagate_forward_time: 15.1070156097, propagate_backward_time: 21.5731849670, weight_update_time: 0.0610566325, other_time: 1.5328693390
epoch time: 3.9676332474s, input_fired_time: 0.0411308706, output_fired_time: 0.0000000000, propagate_forward_time: 3.6084845066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3180179596
validation[          , genome  1903] predictions:    9419/  10000 (94.19%), best:    9419/10000 (94.19%), error:      2005.89160, best error:      2005.89160 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 39.9198379517s, input_fired_time: 0.3384057283, output_fired_time: 0.2419867218, propagate_forward_time: 15.5222482681, propagate_backward_time: 22.2446746826, weight_update_time: 0.0628367439, other_time: 1.5725250244
epoch time: 4.2901668549s, input_fired_time: 0.0466294885, output_fired_time: 0.0000000000, propagate_forward_time: 3.8920962811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3514411449
validation[          , genome  1903] predictions:    9430/  10000 (94.30%), best:    9419/10000 (94.19%), error:      2014.53674, best error:      2005.89160 on epoch:    16, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 41.2075614929s, input_fired_time: 0.3438312113, output_fired_time: 0.2464692295, propagate_forward_time: 16.0372772217, propagate_backward_time: 22.9568367004, weight_update_time: 0.0650689453, other_time: 1.6231498718
epoch time: 2.9832837582s, input_fired_time: 0.0328552574, output_fired_time: 0.0000000000, propagate_forward_time: 2.6979362965, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2524921894
validation[          , genome  1903] predictions:    9363/  10000 (93.63%), best:    9419/10000 (94.19%), error:      2072.62231, best error:      2005.89160 on epoch:    16, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 40.8725852966s, input_fired_time: 0.3460792899, output_fired_time: 0.2457463592, propagate_forward_time: 15.8485631943, propagate_backward_time: 22.7829399109, weight_update_time: 0.0656252503, other_time: 1.6492538452
epoch time: 3.1626670361s, input_fired_time: 0.0366818383, output_fired_time: 0.0000000000, propagate_forward_time: 2.8573653698, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2686197758
validation[          , genome  1903] predictions:    9392/  10000 (93.92%), best:    9419/10000 (94.19%), error:      2039.42627, best error:      2005.89160 on epoch:    16, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 46.2748832703s, input_fired_time: 0.3742013574, output_fired_time: 0.2733676434, propagate_forward_time: 18.0438232422, propagate_backward_time: 25.7762641907, weight_update_time: 0.0726474673, other_time: 1.8072242737
epoch time: 3.1702878475s, input_fired_time: 0.0349793546, output_fired_time: 0.0000000000, propagate_forward_time: 2.8719301224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2633783817
validation[          , genome  1903] predictions:    9403/  10000 (94.03%), best:    9419/10000 (94.19%), error:      2018.95129, best error:      2005.89160 on epoch:    16, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 38.6547012329s, input_fired_time: 0.3308262825, output_fired_time: 0.2340686619, propagate_forward_time: 14.9598999023, propagate_backward_time: 21.6054153442, weight_update_time: 0.0608054176, other_time: 1.5244903564
epoch time: 3.2953989506s, input_fired_time: 0.0354791768, output_fired_time: 0.0000000000, propagate_forward_time: 2.9894499779, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2704699039
validation[          , genome  1903] predictions:    9383/  10000 (93.83%), best:    9419/10000 (94.19%), error:      2015.48779, best error:      2005.89160 on epoch:    16, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 36.8428421021s, input_fired_time: 0.3219061792, output_fired_time: 0.2244377583, propagate_forward_time: 14.3462686539, propagate_backward_time: 20.4768009186, weight_update_time: 0.0586419404, other_time: 1.4734287262
epoch time: 3.3287253380s, input_fired_time: 0.0359869078, output_fired_time: 0.0000000000, propagate_forward_time: 3.0195584297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2731800079
validation[          , genome  1903] predictions:    9422/  10000 (94.22%), best:    9422/10000 (94.22%), error:      1935.00977, best error:      1935.00977 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 37.3424758911s, input_fired_time: 0.3265158534, output_fired_time: 0.2279568315, propagate_forward_time: 14.4292869568, propagate_backward_time: 20.8660335541, weight_update_time: 0.0591951944, other_time: 1.4926815033
epoch time: 2.9182560444s, input_fired_time: 0.0328883901, output_fired_time: 0.0000000000, propagate_forward_time: 2.6397447586, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2456228733
validation[          , genome  1903] predictions:    9433/  10000 (94.33%), best:    9422/10000 (94.22%), error:      1957.38342, best error:      1935.00977 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 34.9139556885s, input_fired_time: 0.3143994510, output_fired_time: 0.2157553732, propagate_forward_time: 13.4911155701, propagate_backward_time: 19.4833164215, weight_update_time: 0.0556538887, other_time: 1.4093685150
epoch time: 3.1942031384s, input_fired_time: 0.0346049853, output_fired_time: 0.0000000000, propagate_forward_time: 2.8962543011, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2633438110
validation[          , genome  1903] predictions:    9402/  10000 (94.02%), best:    9422/10000 (94.22%), error:      1980.81812, best error:      1935.00977 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 36.6955718994s, input_fired_time: 0.3253071606, output_fired_time: 0.2239055932, propagate_forward_time: 14.1921291351, propagate_backward_time: 20.4790458679, weight_update_time: 0.0582628399, other_time: 1.4751834869
epoch time: 4.2418394089s, input_fired_time: 0.0449801795, output_fired_time: 0.0000000000, propagate_forward_time: 3.8563942909, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3404650688
validation[          , genome  1903] predictions:    9424/  10000 (94.24%), best:    9422/10000 (94.22%), error:      1940.45886, best error:      1935.00977 on epoch:    22, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 43.5186500549s, input_fired_time: 0.3578766882, output_fired_time: 0.2602432668, propagate_forward_time: 16.9753952026, propagate_backward_time: 24.2446117401, weight_update_time: 0.0674843639, other_time: 1.6805248260
epoch time: 3.0653870106s, input_fired_time: 0.0340054259, output_fired_time: 0.0000000000, propagate_forward_time: 2.7773463726, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2540352345
validation[          , genome  1903] predictions:    9428/  10000 (94.28%), best:    9428/10000 (94.28%), error:      1927.16968, best error:      1927.16968 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 39.6740150452s, input_fired_time: 0.3387793601, output_fired_time: 0.2388195544, propagate_forward_time: 15.4835338593, propagate_backward_time: 22.0472545624, weight_update_time: 0.0627565756, other_time: 1.5656280518
epoch time: 4.1443104744s, input_fired_time: 0.0432706177, output_fired_time: 0.0000000000, propagate_forward_time: 3.7707452774, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3302946091
validation[          , genome  1903] predictions:    9394/  10000 (93.94%), best:    9428/10000 (94.28%), error:      2036.06860, best error:      1927.16968 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 45.4371070862s, input_fired_time: 0.3705390990, output_fired_time: 0.2675069869, propagate_forward_time: 17.6873416901, propagate_backward_time: 25.3322448730, weight_update_time: 0.0714561641, other_time: 1.7794742584
epoch time: 3.8756697178s, input_fired_time: 0.0416610576, output_fired_time: 0.0000000000, propagate_forward_time: 3.5211174488, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3128912449
validation[          , genome  1903] predictions:    9402/  10000 (94.02%), best:    9428/10000 (94.28%), error:      2051.76514, best error:      1927.16968 on epoch:    26, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 41.2339401245s, input_fired_time: 0.3469837606, output_fired_time: 0.2469310611, propagate_forward_time: 16.0655307770, propagate_backward_time: 22.9481906891, weight_update_time: 0.0647474006, other_time: 1.6263046265
epoch time: 3.2295899391s, input_fired_time: 0.0356146395, output_fired_time: 0.0000000000, propagate_forward_time: 2.9266815186, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2672936916
validation[          , genome  1903] predictions:    9425/  10000 (94.25%), best:    9428/10000 (94.28%), error:      1955.45398, best error:      1927.16968 on epoch:    26, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 37.9921531677s, input_fired_time: 0.3302621245, output_fired_time: 0.2328102589, propagate_forward_time: 14.7607622147, propagate_backward_time: 21.1488094330, weight_update_time: 0.0602360182, other_time: 1.5195102692
epoch time: 3.2114508152s, input_fired_time: 0.0350860097, output_fired_time: 0.0000000000, propagate_forward_time: 2.9112291336, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2651357651
validation[          , genome  1903] predictions:    9430/  10000 (94.30%), best:    9428/10000 (94.28%), error:      1931.45874, best error:      1927.16968 on epoch:    26, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 43.4723014832s, input_fired_time: 0.3589684963, output_fired_time: 0.2579419613, propagate_forward_time: 16.9465026855, propagate_backward_time: 24.2110023499, weight_update_time: 0.0681217536, other_time: 1.6978874207
epoch time: 3.1476581097s, input_fired_time: 0.0348434709, output_fired_time: 0.0000000000, propagate_forward_time: 2.8544030190, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2584116459
validation[          , genome  1903] predictions:    9445/  10000 (94.45%), best:    9445/10000 (94.45%), error:      1889.96521, best error:      1889.96521 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 38.6319961548s, input_fired_time: 0.3335419297, output_fired_time: 0.2344181687, propagate_forward_time: 15.0040493011, propagate_backward_time: 21.5317211151, weight_update_time: 0.0608754046, other_time: 1.5282669067
epoch time: 3.7921605110s, input_fired_time: 0.0406665914, output_fired_time: 0.0000000000, propagate_forward_time: 3.4452335835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3062603474
validation[          , genome  1903] predictions:    9451/  10000 (94.51%), best:    9451/10000 (94.51%), error:      1884.81946, best error:      1884.81946 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 41.4272804260s, input_fired_time: 0.3526187241, output_fired_time: 0.2506186962, propagate_forward_time: 16.0575542450, propagate_backward_time: 23.1178245544, weight_update_time: 0.0644156784, other_time: 1.6486644745
epoch time: 3.1430590153s, input_fired_time: 0.0349180251, output_fired_time: 0.0000000000, propagate_forward_time: 2.8451573849, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2629835606
validation[          , genome  1903] predictions:    9407/  10000 (94.07%), best:    9451/10000 (94.51%), error:      2023.27295, best error:      1884.81946 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 38.2773933411s, input_fired_time: 0.3327535391, output_fired_time: 0.2318000197, propagate_forward_time: 14.8430471420, propagate_backward_time: 21.3535861969, weight_update_time: 0.0601394847, other_time: 1.5162067413
epoch time: 4.2582306862s, input_fired_time: 0.0449517220, output_fired_time: 0.0000000000, propagate_forward_time: 3.8738837242, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3393950462
validation[          , genome  1903] predictions:    9443/  10000 (94.43%), best:    9451/10000 (94.51%), error:      1921.02832, best error:      1884.81946 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 40.1989288330s, input_fired_time: 0.3447281420, output_fired_time: 0.2430190444, propagate_forward_time: 15.6251230240, propagate_backward_time: 22.3978557587, weight_update_time: 0.0627776757, other_time: 1.5882053375
epoch time: 3.2847876549s, input_fired_time: 0.0361780412, output_fired_time: 0.0000000000, propagate_forward_time: 2.9753456116, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2732639313
validation[          , genome  1903] predictions:    9399/  10000 (93.99%), best:    9451/10000 (94.51%), error:      2010.12671, best error:      1884.81946 on epoch:    32, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 37.8588142395s, input_fired_time: 0.3317495883, output_fired_time: 0.2285078466, propagate_forward_time: 14.7338886261, propagate_backward_time: 21.0117263794, weight_update_time: 0.0600829385, other_time: 1.5529422760
epoch time: 3.2658662796s, input_fired_time: 0.0361273289, output_fired_time: 0.0000000000, propagate_forward_time: 2.9550397396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2746992111
validation[          , genome  1903] predictions:    9395/  10000 (93.95%), best:    9451/10000 (94.51%), error:      2119.40576, best error:      1884.81946 on epoch:    32, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 37.9818267822s, input_fired_time: 0.3316101730, output_fired_time: 0.2325241566, propagate_forward_time: 14.7469034195, propagate_backward_time: 21.1442699432, weight_update_time: 0.0595418476, other_time: 1.5265178680
epoch time: 3.2246217728s, input_fired_time: 0.0354592651, output_fired_time: 0.0000000000, propagate_forward_time: 2.9188771248, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2702853680
validation[          , genome  1903] predictions:    9396/  10000 (93.96%), best:    9451/10000 (94.51%), error:      2022.03613, best error:      1884.81946 on epoch:    32, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 37.5227546692s, input_fired_time: 0.3306581974, output_fired_time: 0.2289287746, propagate_forward_time: 14.6084051132, propagate_backward_time: 20.8267860413, weight_update_time: 0.0594057590, other_time: 1.5279769897
epoch time: 3.2313556671s, input_fired_time: 0.0362387225, output_fired_time: 0.0000000000, propagate_forward_time: 2.9238328934, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2712841034
validation[          , genome  1903] predictions:    9399/  10000 (93.99%), best:    9451/10000 (94.51%), error:      2043.92615, best error:      1884.81946 on epoch:    32, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 42.8024253845s, input_fired_time: 0.3584976196, output_fired_time: 0.2554055750, propagate_forward_time: 16.7077579498, propagate_backward_time: 23.8101005554, weight_update_time: 0.0667719245, other_time: 1.6706638336
epoch time: 3.2208359241s, input_fired_time: 0.0354808308, output_fired_time: 0.0000000000, propagate_forward_time: 2.9194991589, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2658560276
validation[          , genome  1903] predictions:    9440/  10000 (94.40%), best:    9451/10000 (94.51%), error:      1896.55859, best error:      1884.81946 on epoch:    32, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 38.4324951172s, input_fired_time: 0.3361207545, output_fired_time: 0.2342596054, propagate_forward_time: 14.8847713470, propagate_backward_time: 21.4553661346, weight_update_time: 0.0607879683, other_time: 1.5219764709
epoch time: 3.7059767246s, input_fired_time: 0.0408483669, output_fired_time: 0.0000000000, propagate_forward_time: 3.3640887737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3010396957
validation[          , genome  1903] predictions:    9448/  10000 (94.48%), best:    9448/10000 (94.48%), error:      1838.45459, best error:      1838.45459 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 42.4412460327s, input_fired_time: 0.3572486639, output_fired_time: 0.2532992065, propagate_forward_time: 16.5381546021, propagate_backward_time: 23.6367321014, weight_update_time: 0.0668656528, other_time: 1.6558094025
epoch time: 4.2231254578s, input_fired_time: 0.0453733131, output_fired_time: 0.0000000000, propagate_forward_time: 3.8396923542, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3380596638
validation[          , genome  1903] predictions:    9452/  10000 (94.52%), best:    9448/10000 (94.48%), error:      1868.03296, best error:      1838.45459 on epoch:    40, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 39.1999435425s, input_fired_time: 0.3419008553, output_fired_time: 0.2385925651, propagate_forward_time: 15.2173347473, propagate_backward_time: 21.8504199982, weight_update_time: 0.0618880205, other_time: 1.5516948700
epoch time: 3.2030484676s, input_fired_time: 0.0360023193, output_fired_time: 0.0000000000, propagate_forward_time: 2.9045283794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2625176907
validation[          , genome  1903] predictions:    9423/  10000 (94.23%), best:    9448/10000 (94.48%), error:      1975.69678, best error:      1838.45459 on epoch:    40, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 46.1657867432s, input_fired_time: 0.3784297109, output_fired_time: 0.2730098367, propagate_forward_time: 18.0497741699, propagate_backward_time: 25.6957626343, weight_update_time: 0.0720437244, other_time: 1.7688102722
epoch time: 4.2345585823s, input_fired_time: 0.0446944609, output_fired_time: 0.0000000000, propagate_forward_time: 3.8523850441, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3374791145
validation[          , genome  1903] predictions:    9389/  10000 (93.89%), best:    9448/10000 (94.48%), error:      2057.13135, best error:      1838.45459 on epoch:    40, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 42.4030532837s, input_fired_time: 0.3628199995, output_fired_time: 0.2524154186, propagate_forward_time: 16.5298862457, propagate_backward_time: 23.5679798126, weight_update_time: 0.0677310452, other_time: 1.6899528503
epoch time: 2.9342663288s, input_fired_time: 0.0342193991, output_fired_time: 0.0000000000, propagate_forward_time: 2.6499228477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2501239777
validation[          , genome  1903] predictions:    9448/  10000 (94.48%), best:    9448/10000 (94.48%), error:      1859.35193, best error:      1838.45459 on epoch:    40, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 35.0460319519s, input_fired_time: 0.3254733980, output_fired_time: 0.2201795578, propagate_forward_time: 13.5359935760, propagate_backward_time: 19.5206546783, weight_update_time: 0.0569583327, other_time: 1.4437294006
epoch time: 3.0778012276s, input_fired_time: 0.0358684547, output_fired_time: 0.0000000000, propagate_forward_time: 2.7847254276, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2572073936
validation[          , genome  1903] predictions:    9440/  10000 (94.40%), best:    9448/10000 (94.48%), error:      1897.86890, best error:      1838.45459 on epoch:    40, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 37.2021560669s, input_fired_time: 0.3360853493, output_fired_time: 0.2295473516, propagate_forward_time: 14.4783277512, propagate_backward_time: 20.6385440826, weight_update_time: 0.0597802885, other_time: 1.5196514130
epoch time: 4.2752790451s, input_fired_time: 0.0473898537, output_fired_time: 0.0000000000, propagate_forward_time: 3.8843922615, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3434967995
validation[          , genome  1903] predictions:    9453/  10000 (94.53%), best:    9448/10000 (94.48%), error:      1854.73999, best error:      1838.45459 on epoch:    40, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 41.2912445068s, input_fired_time: 0.3574269712, output_fired_time: 0.2490361184, propagate_forward_time: 16.0888042450, propagate_backward_time: 22.9537143707, weight_update_time: 0.0658676550, other_time: 1.6422653198
epoch time: 2.9067769051s, input_fired_time: 0.0343564562, output_fired_time: 0.0000000000, propagate_forward_time: 2.6267325878, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2456879616
validation[          , genome  1903] predictions:    9424/  10000 (94.24%), best:    9448/10000 (94.48%), error:      1975.25598, best error:      1838.45459 on epoch:    40, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 42.8600769043s, input_fired_time: 0.3650456965, output_fired_time: 0.2550388873, propagate_forward_time: 16.6711940765, propagate_backward_time: 23.8706283569, weight_update_time: 0.0684406906, other_time: 1.6981678009
epoch time: 3.2401285172s, input_fired_time: 0.0380502455, output_fired_time: 0.0000000000, propagate_forward_time: 2.9334185123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2686598301
validation[          , genome  1903] predictions:    9462/  10000 (94.62%), best:    9448/10000 (94.48%), error:      1848.09595, best error:      1838.45459 on epoch:    40, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 35.8261070251s, input_fired_time: 0.3272852302, output_fired_time: 0.2206432223, propagate_forward_time: 13.8661575317, propagate_backward_time: 19.9508666992, weight_update_time: 0.0580686107, other_time: 1.4611549377
epoch time: 3.1312568188s, input_fired_time: 0.0357502066, output_fired_time: 0.0000000000, propagate_forward_time: 2.8363394737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2591671944
validation[          , genome  1903] predictions:    9437/  10000 (94.37%), best:    9448/10000 (94.48%), error:      1898.08533, best error:      1838.45459 on epoch:    40, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 37.4075698853s, input_fired_time: 0.3318672180, output_fired_time: 0.2290770411, propagate_forward_time: 14.4658823013, propagate_backward_time: 20.9078216553, weight_update_time: 0.0590950735, other_time: 1.4729232788
epoch time: 3.0624642372s, input_fired_time: 0.0351105779, output_fired_time: 0.0000000000, propagate_forward_time: 2.7732381821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2541155815
validation[          , genome  1903] predictions:    9453/  10000 (94.53%), best:    9453/10000 (94.53%), error:      1833.21179, best error:      1833.21179 on epoch:    50, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 36.9838027954s, input_fired_time: 0.3304304779, output_fired_time: 0.2263746709, propagate_forward_time: 14.3191280365, propagate_backward_time: 20.6663837433, weight_update_time: 0.0578559823, other_time: 1.4414863586
epoch time: 3.2654449940s, input_fired_time: 0.0367068723, output_fired_time: 0.0000000000, propagate_forward_time: 2.9587974548, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2699406147
validation[          , genome  1903] predictions:    9449/  10000 (94.49%), best:    9453/10000 (94.53%), error:      1873.76868, best error:      1833.21179 on epoch:    50, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 37.1572380066s, input_fired_time: 0.3307482004, output_fired_time: 0.2272809744, propagate_forward_time: 14.4110097885, propagate_backward_time: 20.7292366028, weight_update_time: 0.0585719310, other_time: 1.4589614868
epoch time: 3.2198266983s, input_fired_time: 0.0362144597, output_fired_time: 0.0000000000, propagate_forward_time: 2.9191305637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2644817829
validation[          , genome  1903] predictions:    9454/  10000 (94.54%), best:    9454/10000 (94.54%), error:      1820.96875, best error:      1820.96875 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 37.1403846741s, input_fired_time: 0.3309835494, output_fired_time: 0.2261112779, propagate_forward_time: 14.4307279587, propagate_backward_time: 20.6845245361, weight_update_time: 0.0591205694, other_time: 1.4680366516
epoch time: 3.1845872402s, input_fired_time: 0.0360988677, output_fired_time: 0.0000000000, propagate_forward_time: 2.8861138821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2623744011
validation[          , genome  1903] predictions:    9393/  10000 (93.93%), best:    9454/10000 (94.54%), error:      2044.91846, best error:      1820.96875 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 37.3778610229s, input_fired_time: 0.3333300352, output_fired_time: 0.2291657776, propagate_forward_time: 14.4982414246, propagate_backward_time: 20.8462047577, weight_update_time: 0.0591634698, other_time: 1.4709224701
epoch time: 3.9781725407s, input_fired_time: 0.0442907214, output_fired_time: 0.0000000000, propagate_forward_time: 3.6117153168, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3221664429
validation[          , genome  1903] predictions:    9459/  10000 (94.59%), best:    9454/10000 (94.54%), error:      1886.48376, best error:      1820.96875 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 47.6499137878s, input_fired_time: 0.3871712089, output_fired_time: 0.2795535028, propagate_forward_time: 18.6357917786, propagate_backward_time: 26.5216693878, weight_update_time: 0.0746340007, other_time: 1.8257274628
epoch time: 3.1317510605s, input_fired_time: 0.0354231410, output_fired_time: 0.0000000000, propagate_forward_time: 2.8389437199, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2573843002
validation[          , genome  1903] predictions:    9439/  10000 (94.39%), best:    9454/10000 (94.54%), error:      1867.99548, best error:      1820.96875 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 39.0240783691s, input_fired_time: 0.3462302387, output_fired_time: 0.2358888090, propagate_forward_time: 15.2264957428, propagate_backward_time: 21.6505546570, weight_update_time: 0.0621605478, other_time: 1.5649089813
epoch time: 2.8684549332s, input_fired_time: 0.0344764367, output_fired_time: 0.0000000000, propagate_forward_time: 2.5926363468, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2413420677
validation[          , genome  1903] predictions:    9435/  10000 (94.35%), best:    9454/10000 (94.54%), error:      1909.48718, best error:      1820.96875 on epoch:    52, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 43.3512878418s, input_fired_time: 0.3656916618, output_fired_time: 0.2572261989, propagate_forward_time: 16.8652610779, propagate_backward_time: 24.1809597015, weight_update_time: 0.0681407079, other_time: 1.6821498871
epoch time: 3.2700867653s, input_fired_time: 0.0370879620, output_fired_time: 0.0000000000, propagate_forward_time: 2.9638185501, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2691802979
validation[          , genome  1903] predictions:    9462/  10000 (94.62%), best:    9454/10000 (94.54%), error:      1871.88562, best error:      1820.96875 on epoch:    52, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 37.9695434570s, input_fired_time: 0.3373264074, output_fired_time: 0.2313406467, propagate_forward_time: 14.6876592636, propagate_backward_time: 21.2065372467, weight_update_time: 0.0601192527, other_time: 1.5066776276
epoch time: 3.2667517662s, input_fired_time: 0.0376158170, output_fired_time: 0.0000000000, propagate_forward_time: 2.9584619999, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2706739902
validation[          , genome  1903] predictions:    9485/  10000 (94.85%), best:    9454/10000 (94.54%), error:      1822.82996, best error:      1820.96875 on epoch:    52, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 37.3580245972s, input_fired_time: 0.3382994235, output_fired_time: 0.2282906473, propagate_forward_time: 14.4256000519, propagate_backward_time: 20.8441829681, weight_update_time: 0.0606748089, other_time: 1.5216522217
epoch time: 2.9576342106s, input_fired_time: 0.0350831784, output_fired_time: 0.0000000000, propagate_forward_time: 2.6716103554, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2509405613
validation[          , genome  1903] predictions:    9456/  10000 (94.56%), best:    9454/10000 (94.54%), error:      1862.94897, best error:      1820.96875 on epoch:    52, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 38.4788627625s, input_fired_time: 0.3444602489, output_fired_time: 0.2357758731, propagate_forward_time: 14.9043340683, propagate_backward_time: 21.4498405457, weight_update_time: 0.0612207577, other_time: 1.5444526672
epoch time: 4.2393894196s, input_fired_time: 0.0467537567, output_fired_time: 0.0000000000, propagate_forward_time: 3.8480427265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3445928097
validation[          , genome  1903] predictions:    9434/  10000 (94.34%), best:    9454/10000 (94.54%), error:      1891.60693, best error:      1820.96875 on epoch:    52, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 38.5035552979s, input_fired_time: 0.3404949307, output_fired_time: 0.2326190472, propagate_forward_time: 14.9023504257, propagate_backward_time: 21.4604568481, weight_update_time: 0.0611681901, other_time: 1.5676307678
epoch time: 3.2776443958s, input_fired_time: 0.0381488390, output_fired_time: 0.0000000000, propagate_forward_time: 2.9678800106, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2716155052
validation[          , genome  1903] predictions:    9461/  10000 (94.61%), best:    9454/10000 (94.54%), error:      1830.38245, best error:      1820.96875 on epoch:    52, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 40.5880851746s, input_fired_time: 0.3524055779, output_fired_time: 0.2429987639, propagate_forward_time: 15.7753410339, propagate_backward_time: 22.6291160583, weight_update_time: 0.0639872402, other_time: 1.5882225037
epoch time: 3.6793093681s, input_fired_time: 0.0412574112, output_fired_time: 0.0000000000, propagate_forward_time: 3.3382589817, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2997930050
validation[          , genome  1903] predictions:    9450/  10000 (94.50%), best:    9454/10000 (94.54%), error:      1838.76062, best error:      1820.96875 on epoch:    52, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 41.9156913757s, input_fired_time: 0.3617384732, output_fired_time: 0.2510931492, propagate_forward_time: 16.3213539124, propagate_backward_time: 23.3122539520, weight_update_time: 0.0659539402, other_time: 1.6692485809
epoch time: 4.2535052299s, input_fired_time: 0.0476258546, output_fired_time: 0.0000000000, propagate_forward_time: 3.8654096127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3404695988
validation[          , genome  1903] predictions:    9443/  10000 (94.43%), best:    9454/10000 (94.54%), error:      1882.72021, best error:      1820.96875 on epoch:    52, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 43.0543136597s, input_fired_time: 0.3667595983, output_fired_time: 0.2582646608, propagate_forward_time: 16.7912673950, propagate_backward_time: 23.9638004303, weight_update_time: 0.0670567229, other_time: 1.6742191315
epoch time: 3.3086383343s, input_fired_time: 0.0381464176, output_fired_time: 0.0000000000, propagate_forward_time: 2.9924809933, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2780108452
validation[          , genome  1903] predictions:    9494/  10000 (94.94%), best:    9494/10000 (94.94%), error:      1792.47412, best error:      1792.47412 on epoch:    64, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 46.0455741882s, input_fired_time: 0.3818412721, output_fired_time: 0.2709360421, propagate_forward_time: 17.9694156647, propagate_backward_time: 25.6359596252, weight_update_time: 0.0766002312, other_time: 1.7874240875
epoch time: 3.2757606506s, input_fired_time: 0.0376809426, output_fired_time: 0.0000000000, propagate_forward_time: 2.9674222469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2706575394
validation[          , genome  1903] predictions:    9471/  10000 (94.71%), best:    9494/10000 (94.94%), error:      1838.59692, best error:      1792.47412 on epoch:    64, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 38.6776695251s, input_fired_time: 0.3447380662, output_fired_time: 0.2330841273, propagate_forward_time: 14.9921960831, propagate_backward_time: 21.5614967346, weight_update_time: 0.0614414364, other_time: 1.5461540222
epoch time: 3.3005540371s, input_fired_time: 0.0382674597, output_fired_time: 0.0000000000, propagate_forward_time: 2.9844861031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2778005600
validation[          , genome  1903] predictions:    9486/  10000 (94.86%), best:    9494/10000 (94.94%), error:      1836.57336, best error:      1792.47412 on epoch:    64, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 38.5201797485s, input_fired_time: 0.3441911042, output_fired_time: 0.2325630188, propagate_forward_time: 14.9498624802, propagate_backward_time: 21.4784984589, weight_update_time: 0.0603838973, other_time: 1.5150623322
epoch time: 3.3124482632s, input_fired_time: 0.0381399244, output_fired_time: 0.0000000000, propagate_forward_time: 3.0009310246, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2733774185
validation[          , genome  1903] predictions:    9455/  10000 (94.55%), best:    9494/10000 (94.94%), error:      1901.33496, best error:      1792.47412 on epoch:    64, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 38.1409988403s, input_fired_time: 0.3417828381, output_fired_time: 0.2352591455, propagate_forward_time: 14.7943820953, propagate_backward_time: 21.2655696869, weight_update_time: 0.0603691116, other_time: 1.5040054321
epoch time: 2.9859137535s, input_fired_time: 0.0364997834, output_fired_time: 0.0000000000, propagate_forward_time: 2.6991651058, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2502489090
validation[          , genome  1903] predictions:    9486/  10000 (94.86%), best:    9494/10000 (94.94%), error:      1817.49585, best error:      1792.47412 on epoch:    64, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 43.4045066833s, input_fired_time: 0.3723303676, output_fired_time: 0.2577723265, propagate_forward_time: 16.9186553955, propagate_backward_time: 24.1724948883, weight_update_time: 0.0682516322, other_time: 1.6832561493
epoch time: 3.6278700829s, input_fired_time: 0.0412025377, output_fired_time: 0.0000000000, propagate_forward_time: 3.2718400955, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3148274422
validation[          , genome  1903] predictions:    9468/  10000 (94.68%), best:    9494/10000 (94.94%), error:      1803.38257, best error:      1792.47412 on epoch:    64, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 40.3910636902s, input_fired_time: 0.3531839848, output_fired_time: 0.2420068085, propagate_forward_time: 15.7026929855, propagate_backward_time: 22.5172843933, weight_update_time: 0.0632790402, other_time: 1.5758934021
epoch time: 3.7830622196s, input_fired_time: 0.0425757766, output_fired_time: 0.0000000000, propagate_forward_time: 3.4357273579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3047590256
validation[          , genome  1903] predictions:    9467/  10000 (94.67%), best:    9467/10000 (94.67%), error:      1789.83435, best error:      1789.83435 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 42.0522422791s, input_fired_time: 0.3657185435, output_fired_time: 0.2507021129, propagate_forward_time: 16.4144344330, propagate_backward_time: 23.3974094391, weight_update_time: 0.0657655150, other_time: 1.6239776611
epoch time: 3.2036883831s, input_fired_time: 0.0375845656, output_fired_time: 0.0000000000, propagate_forward_time: 2.9026794434, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2634243965
validation[          , genome  1903] predictions:    9474/  10000 (94.74%), best:    9467/10000 (94.67%), error:      1826.29065, best error:      1789.83435 on epoch:    70, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 38.6952629089s, input_fired_time: 0.3486040831, output_fired_time: 0.2338685095, propagate_forward_time: 15.0225124359, propagate_backward_time: 21.5314311981, weight_update_time: 0.0626571551, other_time: 1.5588493347
epoch time: 2.8474764824s, input_fired_time: 0.0351399593, output_fired_time: 0.0000000000, propagate_forward_time: 2.5712561607, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2410802841
validation[          , genome  1903] predictions:    9468/  10000 (94.68%), best:    9467/10000 (94.67%), error:      1831.39221, best error:      1789.83435 on epoch:    70, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 39.0503578186s, input_fired_time: 0.3500923216, output_fired_time: 0.2360664010, propagate_forward_time: 15.1388807297, propagate_backward_time: 21.7756652832, weight_update_time: 0.0639073178, other_time: 1.5496520996
epoch time: 4.2308583260s, input_fired_time: 0.0468025394, output_fired_time: 0.0000000000, propagate_forward_time: 3.8451273441, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3389284611
validation[          , genome  1903] predictions:    9463/  10000 (94.63%), best:    9467/10000 (94.67%), error:      1828.75818, best error:      1789.83435 on epoch:    70, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 44.9915809631s, input_fired_time: 0.3801987767, output_fired_time: 0.2803343832, propagate_forward_time: 17.5857696533, propagate_backward_time: 24.9866027832, weight_update_time: 0.0697066933, other_time: 1.7586746216
epoch time: 3.2233541012s, input_fired_time: 0.0378169678, output_fired_time: 0.0000000000, propagate_forward_time: 2.9170815945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2684555054
validation[          , genome  1903] predictions:    9472/  10000 (94.72%), best:    9467/10000 (94.67%), error:      1830.99414, best error:      1789.83435 on epoch:    70, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 38.7352104187s, input_fired_time: 0.3521805406, output_fired_time: 0.2342966050, propagate_forward_time: 15.0756711960, propagate_backward_time: 21.5290603638, weight_update_time: 0.0618690662, other_time: 1.5440025330
epoch time: 2.9673533440s, input_fired_time: 0.0368023589, output_fired_time: 0.0000000000, propagate_forward_time: 2.6795668602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2509841919
validation[          , genome  1903] predictions:    9472/  10000 (94.72%), best:    9467/10000 (94.67%), error:      1828.98401, best error:      1789.83435 on epoch:    70, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 39.6595649719s, input_fired_time: 0.3592960835, output_fired_time: 0.2409586757, propagate_forward_time: 15.3789577484, propagate_backward_time: 22.1056556702, weight_update_time: 0.0633416474, other_time: 1.5746974945
epoch time: 4.2479152679s, input_fired_time: 0.0489218719, output_fired_time: 0.0000000000, propagate_forward_time: 3.8578062057, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3411870003
validation[          , genome  1903] predictions:    9466/  10000 (94.66%), best:    9467/10000 (94.67%), error:      1828.77722, best error:      1789.83435 on epoch:    70, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 39.0070304871s, input_fired_time: 0.3522219360, output_fired_time: 0.2367472500, propagate_forward_time: 15.1029968262, propagate_backward_time: 21.7622203827, weight_update_time: 0.0619295537, other_time: 1.5528430939
epoch time: 2.9046490192s, input_fired_time: 0.0375391357, output_fired_time: 0.0000000000, propagate_forward_time: 2.6164963245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2506134510
validation[          , genome  1903] predictions:    9460/  10000 (94.60%), best:    9467/10000 (94.67%), error:      1832.96753, best error:      1789.83435 on epoch:    70, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 34.2215309143s, input_fired_time: 0.3337232172, output_fired_time: 0.2146340609, propagate_forward_time: 13.3291301727, propagate_backward_time: 18.9172382355, weight_update_time: 0.0560025051, other_time: 1.4268035889
epoch time: 2.9219267368s, input_fired_time: 0.0360613167, output_fired_time: 0.0000000000, propagate_forward_time: 2.6391022205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2467632294
validation[          , genome  1903] predictions:    9461/  10000 (94.61%), best:    9467/10000 (94.67%), error:      1852.67029, best error:      1789.83435 on epoch:    70, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 37.4975090027s, input_fired_time: 0.3462154269, output_fired_time: 0.2282050550, propagate_forward_time: 14.4790506363, propagate_backward_time: 20.9322223663, weight_update_time: 0.0602269731, other_time: 1.5118160248
epoch time: 2.9097802639s, input_fired_time: 0.0361746065, output_fired_time: 0.0000000000, propagate_forward_time: 2.6298434734, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2437622547
validation[          , genome  1903] predictions:    9465/  10000 (94.65%), best:    9467/10000 (94.67%), error:      1803.72815, best error:      1789.83435 on epoch:    70, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 36.2691383362s, input_fired_time: 0.3400657177, output_fired_time: 0.2236340344, propagate_forward_time: 13.9855079651, propagate_backward_time: 20.2436828613, weight_update_time: 0.0587528944, other_time: 1.4762496948
epoch time: 2.8692977428s, input_fired_time: 0.0354770757, output_fired_time: 0.0000000000, propagate_forward_time: 2.5916745663, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2421460152
validation[          , genome  1903] predictions:    9486/  10000 (94.86%), best:    9486/10000 (94.86%), error:      1780.54333, best error:      1780.54333 on epoch:    80, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 39.8909912109s, input_fired_time: 0.3599414527, output_fired_time: 0.2400458902, propagate_forward_time: 15.5251169205, propagate_backward_time: 22.1702270508, weight_update_time: 0.0639924780, other_time: 1.5956611633
epoch time: 4.2329735756s, input_fired_time: 0.0467295460, output_fired_time: 0.0000000000, propagate_forward_time: 3.8480858803, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3381581306
validation[          , genome  1903] predictions:    9436/  10000 (94.36%), best:    9486/10000 (94.86%), error:      1966.71350, best error:      1780.54333 on epoch:    80, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 38.6154441833s, input_fired_time: 0.3559992909, output_fired_time: 0.2360243797, propagate_forward_time: 15.0173559189, propagate_backward_time: 21.4327125549, weight_update_time: 0.0623023026, other_time: 1.5733528137
epoch time: 2.9162018299s, input_fired_time: 0.0364300758, output_fired_time: 0.0000000000, propagate_forward_time: 2.6309788227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2487928867
validation[          , genome  1903] predictions:    9472/  10000 (94.72%), best:    9486/10000 (94.86%), error:      1827.09180, best error:      1780.54333 on epoch:    80, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 34.2684516907s, input_fired_time: 0.3341092169, output_fired_time: 0.2121150494, propagate_forward_time: 13.2885971069, propagate_backward_time: 19.0062713623, weight_update_time: 0.0563126802, other_time: 1.4273567200
epoch time: 2.9969952106s, input_fired_time: 0.0388422385, output_fired_time: 0.0000000000, propagate_forward_time: 2.6971213818, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2610316277
validation[          , genome  1903] predictions:    9474/  10000 (94.74%), best:    9486/10000 (94.86%), error:      1830.95642, best error:      1780.54333 on epoch:    80, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 39.7562828064s, input_fired_time: 0.3595655560, output_fired_time: 0.2401643097, propagate_forward_time: 15.3587951660, propagate_backward_time: 22.2183914185, weight_update_time: 0.0634515956, other_time: 1.5793647766
epoch time: 4.2461686134s, input_fired_time: 0.0473198071, output_fired_time: 0.0000000000, propagate_forward_time: 3.8600428104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3388059139
validation[          , genome  1903] predictions:    9486/  10000 (94.86%), best:    9486/10000 (94.86%), error:      1804.41992, best error:      1780.54333 on epoch:    80, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 48.4646224976s, input_fired_time: 0.4027191997, output_fired_time: 0.2843201160, propagate_forward_time: 18.9777717590, propagate_backward_time: 26.9538764954, weight_update_time: 0.0755958036, other_time: 1.8459358215
epoch time: 4.0728769302s, input_fired_time: 0.0464492291, output_fired_time: 0.0000000000, propagate_forward_time: 3.7002336979, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3261940479
validation[          , genome  1903] predictions:    9485/  10000 (94.85%), best:    9486/10000 (94.86%), error:      1793.95215, best error:      1780.54333 on epoch:    80, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 43.7646789551s, input_fired_time: 0.3819500506, output_fired_time: 0.2612129748, propagate_forward_time: 17.0311050415, propagate_backward_time: 24.3671035767, weight_update_time: 0.0697005168, other_time: 1.7233085632
epoch time: 2.9161798954s, input_fired_time: 0.0366997048, output_fired_time: 0.0000000000, propagate_forward_time: 2.6342687607, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2452113628
validation[          , genome  1903] predictions:    9461/  10000 (94.61%), best:    9486/10000 (94.86%), error:      1833.32776, best error:      1780.54333 on epoch:    80, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 35.7844581604s, input_fired_time: 0.3416511118, output_fired_time: 0.2211623341, propagate_forward_time: 13.9013767242, propagate_backward_time: 19.8459415436, weight_update_time: 0.0582816713, other_time: 1.4743270874
epoch time: 2.9538695812s, input_fired_time: 0.0379916057, output_fired_time: 0.0000000000, propagate_forward_time: 2.6610059738, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2548720837
validation[          , genome  1903] predictions:    9456/  10000 (94.56%), best:    9486/10000 (94.86%), error:      1882.58752, best error:      1780.54333 on epoch:    80, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 43.8363075256s, input_fired_time: 0.3798043430, output_fired_time: 0.2616707683, propagate_forward_time: 17.0725021362, propagate_backward_time: 24.4172706604, weight_update_time: 0.0692022294, other_time: 1.7050628662
epoch time: 3.9305884838s, input_fired_time: 0.0462802052, output_fired_time: 0.0000000000, propagate_forward_time: 3.5650389194, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3192694187
validation[          , genome  1903] predictions:    9444/  10000 (94.44%), best:    9486/10000 (94.86%), error:      1910.10693, best error:      1780.54333 on epoch:    80, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 44.6688423157s, input_fired_time: 0.3860765398, output_fired_time: 0.2644867599, propagate_forward_time: 17.4147357941, propagate_backward_time: 24.8481044769, weight_update_time: 0.0710841045, other_time: 1.7554359436
epoch time: 3.2393939495s, input_fired_time: 0.0385371186, output_fired_time: 0.0000000000, propagate_forward_time: 2.9334812164, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2673757076
validation[          , genome  1903] predictions:    9445/  10000 (94.45%), best:    9486/10000 (94.86%), error:      1866.67151, best error:      1780.54333 on epoch:    80, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 41.3142433167s, input_fired_time: 0.3694662750, output_fired_time: 0.2481453568, propagate_forward_time: 16.0066318512, propagate_backward_time: 23.0429973602, weight_update_time: 0.0663399771, other_time: 1.6470031738
epoch time: 3.2048251629s, input_fired_time: 0.0389865637, output_fired_time: 0.0000000000, propagate_forward_time: 2.8981153965, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2677233219
validation[          , genome  1903] predictions:    9486/  10000 (94.86%), best:    9486/10000 (94.86%), error:      1805.67188, best error:      1780.54333 on epoch:    80, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 37.7548370361s, input_fired_time: 0.3499341905, output_fired_time: 0.2295632064, propagate_forward_time: 14.6444253922, propagate_backward_time: 21.0124702454, weight_update_time: 0.0608770885, other_time: 1.5184440613
epoch time: 3.2536449432s, input_fired_time: 0.0393402614, output_fired_time: 0.0000000000, propagate_forward_time: 2.9472966194, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2670080662
validation[          , genome  1903] predictions:    9471/  10000 (94.71%), best:    9486/10000 (94.86%), error:      1802.02173, best error:      1780.54333 on epoch:    80, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 44.5253295898s, input_fired_time: 0.3831996322, output_fired_time: 0.2623668313, propagate_forward_time: 17.3168735504, propagate_backward_time: 24.7884254456, weight_update_time: 0.0697458833, other_time: 1.7744655609
epoch time: 3.3698799610s, input_fired_time: 0.0403594747, output_fired_time: 0.0000000000, propagate_forward_time: 3.0476996899, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2818207741
validation[          , genome  1903] predictions:    9485/  10000 (94.85%), best:    9485/10000 (94.85%), error:      1771.06372, best error:      1771.06372 on epoch:    92, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 43.5293655396s, input_fired_time: 0.3785533905, output_fired_time: 0.2587969005, propagate_forward_time: 16.9513664246, propagate_backward_time: 24.2400856018, weight_update_time: 0.0683095753, other_time: 1.7005615234
epoch time: 4.2437434196s, input_fired_time: 0.0477320738, output_fired_time: 0.0000000000, propagate_forward_time: 3.8581383228, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3378732204
validation[          , genome  1903] predictions:    9476/  10000 (94.76%), best:    9485/10000 (94.85%), error:      1806.14160, best error:      1771.06372 on epoch:    92, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 43.9632492065s, input_fired_time: 0.3796747923, output_fired_time: 0.2603834271, propagate_forward_time: 17.1331253052, propagate_backward_time: 24.4743957520, weight_update_time: 0.0685392618, other_time: 1.7156715393
epoch time: 3.2512655258s, input_fired_time: 0.0390193239, output_fired_time: 0.0000000000, propagate_forward_time: 2.9396343231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2726118565
validation[          , genome  1903] predictions:    9482/  10000 (94.82%), best:    9485/10000 (94.85%), error:      1791.05823, best error:      1771.06372 on epoch:    92, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 42.3027076721s, input_fired_time: 0.3717195392, output_fired_time: 0.2534784675, propagate_forward_time: 16.4454135895, propagate_backward_time: 23.5597515106, weight_update_time: 0.0662837848, other_time: 1.6723442078
epoch time: 3.2180190086s, input_fired_time: 0.0387199447, output_fired_time: 0.0000000000, propagate_forward_time: 2.9147472382, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2645518780
validation[          , genome  1903] predictions:    9486/  10000 (94.86%), best:    9485/10000 (94.85%), error:      1793.64929, best error:      1771.06372 on epoch:    92, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 42.0860595703s, input_fired_time: 0.3720901906, output_fired_time: 0.2594414353, propagate_forward_time: 16.4367885590, propagate_backward_time: 23.3548145294, weight_update_time: 0.0662975386, other_time: 1.6629257202
epoch time: 3.2492747307s, input_fired_time: 0.0416247882, output_fired_time: 0.0000000000, propagate_forward_time: 2.9375796318, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2700703144
validation[          , genome  1903] predictions:    9457/  10000 (94.57%), best:    9485/10000 (94.85%), error:      1870.82410, best error:      1771.06372 on epoch:    92, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 40.2016983032s, input_fired_time: 0.3623990119, output_fired_time: 0.2432891130, propagate_forward_time: 15.6832294464, propagate_backward_time: 22.3432292938, weight_update_time: 0.0627809092, other_time: 1.5695495605
epoch time: 3.2691857815s, input_fired_time: 0.0395036489, output_fired_time: 0.0000000000, propagate_forward_time: 2.9626395702, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2670426369
validation[          , genome  1903] predictions:    9452/  10000 (94.52%), best:    9485/10000 (94.85%), error:      1874.95325, best error:      1771.06372 on epoch:    92, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 39.6455726624s, input_fired_time: 0.3593021035, output_fired_time: 0.2399515659, propagate_forward_time: 15.4051141739, propagate_backward_time: 22.0781555176, weight_update_time: 0.0625907928, other_time: 1.5630493164
epoch time: 3.6098041534s, input_fired_time: 0.0432248525, output_fired_time: 0.0000000000, propagate_forward_time: 3.2709062099, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2956731319
validation[          , genome  1903] predictions:    9473/  10000 (94.73%), best:    9485/10000 (94.85%), error:      1797.96448, best error:      1771.06372 on epoch:    92, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 40.8354530334s, input_fired_time: 0.3684118688, output_fired_time: 0.2457629144, propagate_forward_time: 15.8598337173, propagate_backward_time: 22.7316207886, weight_update_time: 0.0651432872, other_time: 1.6298255920
epoch time: 4.2567934990s, input_fired_time: 0.0496305078, output_fired_time: 0.0000000000, propagate_forward_time: 3.8642706871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3428921700
validation[          , genome  1903] predictions:    9488/  10000 (94.88%), best:    9485/10000 (94.85%), error:      1782.46545, best error:      1771.06372 on epoch:    92, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 43.5291709900s, input_fired_time: 0.3825820088, output_fired_time: 0.2582236230, propagate_forward_time: 16.9907169342, propagate_backward_time: 24.2151718140, weight_update_time: 0.0680579469, other_time: 1.6824741364
epoch time: 4.2707700729s, input_fired_time: 0.0484425463, output_fired_time: 0.0000000000, propagate_forward_time: 3.8671088219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3552188873
validation[          , genome  1903] predictions:    9483/  10000 (94.83%), best:    9485/10000 (94.85%), error:      1808.04333, best error:      1771.06372 on epoch:    92, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 18.8534374237s, input_fired_time: 0.2239290625, output_fired_time: 0.0000000000, propagate_forward_time: 17.0411376953, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5883712769
best training[          , genome  1903] predictions:   48047/  50000 (96.09%), best:    9485/10000 (94.85%), error:      6786.84912, best error:      1771.06372 on epoch:    92, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 3.9408421516s, input_fired_time: 0.0521604195, output_fired_time: 0.0000000000, propagate_forward_time: 3.5637996197, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3248820305
   testing[          , genome  1903] predictions:    9529/  10000 (95.29%), best:    9485/10000 (94.85%), error:      1588.10681, best error:      1771.06372 on epoch:    92, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
21:57:23 (36139): called boinc_finish(0)

</stderr_txt>
]]>