Nameexact_genome_1512568488_42_6429_1
Workunit2603346
Created7 Dec 2017, 19:42:20 UTC
Sent7 Dec 2017, 19:47:36 UTC
Report deadline17 Dec 2017, 13:53:22 UTC
Received8 Dec 2017, 14:41:57 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time5 hours 44 min 55 sec
CPU time5 hours 34 min 6 sec
Validate stateInitial
Credit0.00
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size159.49 MB
Peak swap size162.59 MB
Peak disk usage3.07 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
18.20563 on epoch:    11, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 196.9249267578s, input_fired_time: 2.4227340221, output_fired_time: 2.2097568512, propagate_forward_time: 76.0219573975, propagate_backward_time: 112.0420150757, weight_update_time: 0.2444300801, other_time: 4.2284622192
epoch time: 15.9531106949s, input_fired_time: 0.3015079796, output_fired_time: 0.0000000000, propagate_forward_time: 14.8998870850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7517156601
validation[          , genome  6429] predictions:    9684/  10000 (96.84%), best:    9768/10000 (97.68%), error:      1031.88660, best error:       818.20563 on epoch:    11, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 194.2900695801s, input_fired_time: 2.3761227131, output_fired_time: 2.1774220467, propagate_forward_time: 71.8222122192, propagate_backward_time: 113.8285217285, weight_update_time: 0.2242900133, other_time: 4.0857772827
epoch time: 15.9972677231s, input_fired_time: 0.2978129685, output_fired_time: 0.0000000000, propagate_forward_time: 14.9919767380, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7074775696
validation[          , genome  6429] predictions:    9711/  10000 (97.11%), best:    9768/10000 (97.68%), error:       936.56189, best error:       818.20563 on epoch:    11, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 192.3958587646s, input_fired_time: 2.4015748501, output_fired_time: 2.1569814682, propagate_forward_time: 72.4801940918, propagate_backward_time: 111.3006439209, weight_update_time: 0.2224090248, other_time: 4.0564575195
epoch time: 16.2875480652s, input_fired_time: 0.3063201308, output_fired_time: 0.0000000000, propagate_forward_time: 15.2228441238, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7583837509
validation[          , genome  6429] predictions:    9742/  10000 (97.42%), best:    9768/10000 (97.68%), error:       833.11664, best error:       818.20563 on epoch:    11, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 193.0061645508s, input_fired_time: 2.3941998482, output_fired_time: 2.1627893448, propagate_forward_time: 71.2184143066, propagate_backward_time: 113.1388626099, weight_update_time: 0.2253344059, other_time: 4.0918960571
epoch time: 15.6707906723s, input_fired_time: 0.2991494536, output_fired_time: 0.0000000000, propagate_forward_time: 14.6396408081, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7320003510
validation[          , genome  6429] predictions:    9744/  10000 (97.44%), best:    9768/10000 (97.68%), error:       855.17017, best error:       818.20563 on epoch:    11, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 192.0761566162s, input_fired_time: 3.2786004543, output_fired_time: 2.1619858742, propagate_forward_time: 72.3290710449, propagate_backward_time: 110.2102966309, weight_update_time: 0.2253251225, other_time: 4.0962066650
epoch time: 15.6399869919s, input_fired_time: 0.2950185835, output_fired_time: 0.0000000000, propagate_forward_time: 14.6370143890, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7079544067
validation[          , genome  6429] predictions:    9756/  10000 (97.56%), best:    9756/10000 (97.56%), error:       800.01556, best error:       800.01556 on epoch:    19, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 192.6595916748s, input_fired_time: 2.3909158707, output_fired_time: 2.1521327496, propagate_forward_time: 74.1047668457, propagate_backward_time: 109.9393463135, weight_update_time: 0.2236175686, other_time: 4.0724334717
epoch time: 15.8843965530s, input_fired_time: 0.2985791862, output_fired_time: 0.0000000000, propagate_forward_time: 14.8671426773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7186746597
validation[          , genome  6429] predictions:    9723/  10000 (97.23%), best:    9756/10000 (97.56%), error:       949.42328, best error:       800.01556 on epoch:    19, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 192.7472686768s, input_fired_time: 2.3747615814, output_fired_time: 2.1554694176, propagate_forward_time: 72.7828826904, propagate_backward_time: 111.3639831543, weight_update_time: 0.2253984213, other_time: 4.0701751709
epoch time: 17.1502571106s, input_fired_time: 0.3239503205, output_fired_time: 0.0000000000, propagate_forward_time: 16.0011425018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8251647949
validation[          , genome  6429] predictions:    9753/  10000 (97.53%), best:    9756/10000 (97.56%), error:       834.29462, best error:       800.01556 on epoch:    19, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 204.2931365967s, input_fired_time: 2.5325055122, output_fired_time: 2.2593417168, propagate_forward_time: 76.8502960205, propagate_backward_time: 118.4183197021, weight_update_time: 0.2343017012, other_time: 4.2326812744
epoch time: 16.2111740112s, input_fired_time: 0.3066792786, output_fired_time: 0.0000000000, propagate_forward_time: 15.1684598923, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7360343933
validation[          , genome  6429] predictions:    9736/  10000 (97.36%), best:    9756/10000 (97.56%), error:       831.65112, best error:       800.01556 on epoch:    19, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 198.4956970215s, input_fired_time: 3.4889204502, output_fired_time: 3.2321374416, propagate_forward_time: 74.2037963867, propagate_backward_time: 113.4335479736, weight_update_time: 0.2257305980, other_time: 4.1372985840
epoch time: 15.8439292908s, input_fired_time: 0.2969430983, output_fired_time: 0.0000000000, propagate_forward_time: 14.8334665298, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7135200500
validation[          , genome  6429] predictions:    9695/  10000 (96.95%), best:    9756/10000 (97.56%), error:      1018.95667, best error:       800.01556 on epoch:    19, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 202.3342132568s, input_fired_time: 2.4566779137, output_fired_time: 2.2622869015, propagate_forward_time: 76.6829757690, propagate_backward_time: 116.7298965454, weight_update_time: 0.2394175977, other_time: 4.2023773193
epoch time: 20.3159427643s, input_fired_time: 0.3918766975, output_fired_time: 0.0000000000, propagate_forward_time: 19.0423870087, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8816795349
validation[          , genome  6429] predictions:    9771/  10000 (97.71%), best:    9771/10000 (97.71%), error:       753.73840, best error:       753.73840 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 205.7124633789s, input_fired_time: 2.5885777473, output_fired_time: 4.2479958534, propagate_forward_time: 77.3415451050, propagate_backward_time: 117.0011444092, weight_update_time: 0.2484307289, other_time: 4.5331954956
epoch time: 16.7084980011s, input_fired_time: 0.3236615062, output_fired_time: 0.0000000000, propagate_forward_time: 15.6174907684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7673454285
validation[          , genome  6429] predictions:    9703/  10000 (97.03%), best:    9771/10000 (97.71%), error:       944.56055, best error:       753.73840 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 193.1856994629s, input_fired_time: 2.4394948483, output_fired_time: 2.1519708633, propagate_forward_time: 74.2651519775, propagate_backward_time: 110.2405548096, weight_update_time: 0.2239044458, other_time: 4.0885162354
epoch time: 16.0820884705s, input_fired_time: 0.3039538264, output_fired_time: 0.0000000000, propagate_forward_time: 15.0636415482, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7144927979
validation[          , genome  6429] predictions:    9769/  10000 (97.69%), best:    9771/10000 (97.71%), error:       758.32404, best error:       753.73840 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 194.5268249512s, input_fired_time: 2.4013643265, output_fired_time: 2.1836748123, propagate_forward_time: 74.9515762329, propagate_backward_time: 110.9240798950, weight_update_time: 0.2232391536, other_time: 4.0661315918
epoch time: 14.3668251038s, input_fired_time: 0.2930329442, output_fired_time: 0.0000000000, propagate_forward_time: 13.3710451126, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7027473450
validation[          , genome  6429] predictions:    9742/  10000 (97.42%), best:    9771/10000 (97.71%), error:       831.89899, best error:       753.73840 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 194.3376770020s, input_fired_time: 2.4006109238, output_fired_time: 2.1546027660, propagate_forward_time: 72.0672912598, propagate_backward_time: 112.6502304077, weight_update_time: 0.2251535505, other_time: 5.0649490356
epoch time: 16.0831241608s, input_fired_time: 0.3022337258, output_fired_time: 0.0000000000, propagate_forward_time: 15.0537815094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7271089554
validation[          , genome  6429] predictions:    9771/  10000 (97.71%), best:    9771/10000 (97.71%), error:       786.01941, best error:       753.73840 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 194.6034393311s, input_fired_time: 2.3837442398, output_fired_time: 3.1875028610, propagate_forward_time: 71.9447860718, propagate_backward_time: 111.0221786499, weight_update_time: 0.2231224626, other_time: 6.0652313232
epoch time: 14.8074884415s, input_fired_time: 0.3006370664, output_fired_time: 0.0000000000, propagate_forward_time: 13.7884969711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7183542252
validation[          , genome  6429] predictions:    9739/  10000 (97.39%), best:    9771/10000 (97.71%), error:       894.85321, best error:       753.73840 on epoch:    24, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 199.9898986816s, input_fired_time: 3.4794530869, output_fired_time: 2.2121117115, propagate_forward_time: 75.0776596069, propagate_backward_time: 114.0257339478, weight_update_time: 0.2331046313, other_time: 5.1949462891
epoch time: 15.8845567703s, input_fired_time: 0.3028058410, output_fired_time: 0.0000000000, propagate_forward_time: 14.8470125198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7347383499
validation[          , genome  6429] predictions:    9772/  10000 (97.72%), best:    9771/10000 (97.71%), error:       785.31427, best error:       753.73840 on epoch:    24, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 193.1161651611s, input_fired_time: 2.3896327019, output_fired_time: 2.1471254826, propagate_forward_time: 72.4212799072, propagate_backward_time: 112.0468063354, weight_update_time: 0.2257243246, other_time: 4.1113204956
epoch time: 15.9626083374s, input_fired_time: 0.3061813712, output_fired_time: 0.0000000000, propagate_forward_time: 14.9236631393, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7327642441
validation[          , genome  6429] predictions:    9775/  10000 (97.75%), best:    9771/10000 (97.71%), error:       764.00677, best error:       753.73840 on epoch:    24, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 196.0698699951s, input_fired_time: 2.4249050617, output_fired_time: 2.1784477234, propagate_forward_time: 72.3792190552, propagate_backward_time: 113.9203414917, weight_update_time: 0.2252586186, other_time: 5.1669464111
epoch time: 15.7786264420s, input_fired_time: 0.3009053171, output_fired_time: 0.0000000000, propagate_forward_time: 14.7656049728, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7121162415
validation[          , genome  6429] predictions:    9780/  10000 (97.80%), best:    9780/10000 (97.80%), error:       732.64569, best error:       732.64569 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 193.3196716309s, input_fired_time: 2.3977785110, output_fired_time: 2.2193922997, propagate_forward_time: 76.4730682373, propagate_backward_time: 108.1537399292, weight_update_time: 0.2256070226, other_time: 4.0756912231
epoch time: 15.5022068024s, input_fired_time: 0.2988454700, output_fired_time: 0.0000000000, propagate_forward_time: 14.4883861542, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7149753571
validation[          , genome  6429] predictions:    9708/  10000 (97.08%), best:    9780/10000 (97.80%), error:       934.62610, best error:       732.64569 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 206.0959472656s, input_fired_time: 2.5194673538, output_fired_time: 2.3390150070, propagate_forward_time: 76.3852539063, propagate_backward_time: 120.5936737061, weight_update_time: 0.2315360010, other_time: 4.2585296631
epoch time: 16.0942916870s, input_fired_time: 0.3045080602, output_fired_time: 0.0000000000, propagate_forward_time: 15.0645484924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7252349854
validation[          , genome  6429] predictions:    9745/  10000 (97.45%), best:    9780/10000 (97.80%), error:       802.85541, best error:       732.64569 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 199.7647705078s, input_fired_time: 2.4610376358, output_fired_time: 2.2182517052, propagate_forward_time: 76.1187820435, propagate_backward_time: 114.8415527344, weight_update_time: 0.2539833486, other_time: 4.1251449585
epoch time: 15.6532630920s, input_fired_time: 0.3001644313, output_fired_time: 0.0000000000, propagate_forward_time: 14.6390495300, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7140493393
validation[          , genome  6429] predictions:    9783/  10000 (97.83%), best:    9783/10000 (97.83%), error:       727.04602, best error:       727.04602 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 192.5665435791s, input_fired_time: 2.3855895996, output_fired_time: 2.1581563950, propagate_forward_time: 72.3479232788, propagate_backward_time: 111.5645446777, weight_update_time: 0.2234440297, other_time: 4.1103286743
epoch time: 15.3587236404s, input_fired_time: 0.2888859510, output_fired_time: 0.0000000000, propagate_forward_time: 14.3627767563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7070608139
validation[          , genome  6429] predictions:    9747/  10000 (97.47%), best:    9783/10000 (97.83%), error:       872.93298, best error:       727.04602 on epoch:    35, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 194.4580993652s, input_fired_time: 2.3902606964, output_fired_time: 2.2253437042, propagate_forward_time: 71.8453521729, propagate_backward_time: 113.9409027100, weight_update_time: 0.2254437357, other_time: 4.0562438965
epoch time: 17.1237926483s, input_fired_time: 0.3107149899, output_fired_time: 0.0000000000, propagate_forward_time: 15.0406084061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7724695206
validation[          , genome  6429] predictions:    9743/  10000 (97.43%), best:    9783/10000 (97.83%), error:       785.63293, best error:       727.04602 on epoch:    35, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 203.8793640137s, input_fired_time: 3.5659625530, output_fired_time: 2.2851254940, propagate_forward_time: 75.6080551147, propagate_backward_time: 117.1439208984, weight_update_time: 0.2248168290, other_time: 5.2762985229
epoch time: 15.9017314911s, input_fired_time: 0.3028195202, output_fired_time: 0.0000000000, propagate_forward_time: 14.8539543152, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7449579239
validation[          , genome  6429] predictions:    9745/  10000 (97.45%), best:    9783/10000 (97.83%), error:       809.44568, best error:       727.04602 on epoch:    35, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 198.5185089111s, input_fired_time: 2.4632377625, output_fired_time: 2.1698763371, propagate_forward_time: 74.1797332764, propagate_backward_time: 115.5685806274, weight_update_time: 0.2280417681, other_time: 4.1370773315
epoch time: 14.4896545410s, input_fired_time: 0.2962979972, output_fired_time: 0.0000000000, propagate_forward_time: 13.4755735397, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7177829742
validation[          , genome  6429] predictions:    9751/  10000 (97.51%), best:    9783/10000 (97.83%), error:       785.88489, best error:       727.04602 on epoch:    35, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 194.3003082275s, input_fired_time: 2.4150898457, output_fired_time: 2.1609227657, propagate_forward_time: 73.2718124390, propagate_backward_time: 112.3706054688, weight_update_time: 0.2325913757, other_time: 4.0818862915
epoch time: 16.0260238647s, input_fired_time: 0.3045544922, output_fired_time: 0.0000000000, propagate_forward_time: 13.9942312241, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7272377014
validation[          , genome  6429] predictions:    9758/  10000 (97.58%), best:    9783/10000 (97.83%), error:       859.60455, best error:       727.04602 on epoch:    35, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 201.6476287842s, input_fired_time: 2.5014228821, output_fired_time: 2.2323286533, propagate_forward_time: 77.5801773071, propagate_backward_time: 115.1183929443, weight_update_time: 0.2327282876, other_time: 4.2153091431
epoch time: 15.8580713272s, input_fired_time: 0.3042603135, output_fired_time: 0.0000000000, propagate_forward_time: 14.8254690170, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7283420563
validation[          , genome  6429] predictions:    9742/  10000 (97.42%), best:    9783/10000 (97.83%), error:       873.07214, best error:       727.04602 on epoch:    35, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 194.2983856201s, input_fired_time: 2.5197954178, output_fired_time: 2.1794581413, propagate_forward_time: 74.6205749512, propagate_backward_time: 109.9062652588, weight_update_time: 0.2245064825, other_time: 5.0722961426
epoch time: 14.8142023087s, input_fired_time: 0.3017082512, output_fired_time: 0.0000000000, propagate_forward_time: 13.7826452255, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7298488617
validation[          , genome  6429] predictions:    9759/  10000 (97.59%), best:    9783/10000 (97.83%), error:       789.59296, best error:       727.04602 on epoch:    35, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 214.1068115234s, input_fired_time: 2.6148016453, output_fired_time: 2.3627429008, propagate_forward_time: 80.2028274536, propagate_backward_time: 124.4888839722, weight_update_time: 0.2417933047, other_time: 4.4375381470
epoch time: 15.9046621323s, input_fired_time: 0.3057317436, output_fired_time: 0.0000000000, propagate_forward_time: 14.8693494797, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7295808792
validation[          , genome  6429] predictions:    9759/  10000 (97.59%), best:    9783/10000 (97.83%), error:       759.54559, best error:       727.04602 on epoch:    35, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 209.7052917480s, input_fired_time: 2.6005446911, output_fired_time: 2.3833229542, propagate_forward_time: 78.6220016479, propagate_backward_time: 121.6923751831, weight_update_time: 0.2386395782, other_time: 4.4070587158
epoch time: 15.9074697495s, input_fired_time: 0.3060763180, output_fired_time: 0.0000000000, propagate_forward_time: 14.8810491562, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7203445435
validation[          , genome  6429] predictions:    9762/  10000 (97.62%), best:    9783/10000 (97.83%), error:       785.58771, best error:       727.04602 on epoch:    35, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 208.3354797363s, input_fired_time: 2.6204166412, output_fired_time: 2.3187096119, propagate_forward_time: 79.3836441040, propagate_backward_time: 119.6618576050, weight_update_time: 0.2253011614, other_time: 4.3508453369
epoch time: 14.5888519287s, input_fired_time: 0.2939286530, output_fired_time: 0.0000000000, propagate_forward_time: 13.6005306244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6943922043
validation[          , genome  6429] predictions:    9726/  10000 (97.26%), best:    9783/10000 (97.83%), error:       905.22229, best error:       727.04602 on epoch:    35, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 199.0855102539s, input_fired_time: 2.5284743309, output_fired_time: 2.2058858871, propagate_forward_time: 78.5979309082, propagate_backward_time: 111.5483627319, weight_update_time: 0.2242930382, other_time: 4.2048568726
epoch time: 16.5734844208s, input_fired_time: 0.3227720857, output_fired_time: 0.0000000000, propagate_forward_time: 15.4818363190, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7688751221
validation[          , genome  6429] predictions:    9740/  10000 (97.40%), best:    9783/10000 (97.83%), error:       854.29712, best error:       727.04602 on epoch:    35, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 206.3499908447s, input_fired_time: 2.4618594646, output_fired_time: 2.2850949764, propagate_forward_time: 78.0342102051, propagate_backward_time: 118.1995697021, weight_update_time: 0.2454753667, other_time: 5.3692626953
epoch time: 16.5453758240s, input_fired_time: 0.3130127490, output_fired_time: 0.0000000000, propagate_forward_time: 15.5144557953, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7179069519
validation[          , genome  6429] predictions:    9754/  10000 (97.54%), best:    9783/10000 (97.83%), error:       857.74469, best error:       727.04602 on epoch:    35, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 218.1322326660s, input_fired_time: 3.7894694805, output_fired_time: 2.4394419193, propagate_forward_time: 83.1178817749, propagate_backward_time: 124.2723770142, weight_update_time: 0.2577772141, other_time: 4.5130538940
epoch time: 16.1960468292s, input_fired_time: 0.3104090393, output_fired_time: 0.0000000000, propagate_forward_time: 15.1602172852, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7254209518
validation[          , genome  6429] predictions:    9782/  10000 (97.82%), best:    9783/10000 (97.83%), error:       748.77271, best error:       727.04602 on epoch:    35, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 218.4550781250s, input_fired_time: 2.6920852661, output_fired_time: 2.3782575130, propagate_forward_time: 82.6356506348, propagate_backward_time: 126.0100097656, weight_update_time: 0.2646115124, other_time: 4.7390899658
epoch time: 16.2684345245s, input_fired_time: 0.3023191690, output_fired_time: 0.0000000000, propagate_forward_time: 15.2229948044, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7431201935
validation[          , genome  6429] predictions:    9764/  10000 (97.64%), best:    9783/10000 (97.83%), error:       794.93469, best error:       727.04602 on epoch:    35, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 198.9744567871s, input_fired_time: 2.4499878883, output_fired_time: 2.2223274708, propagate_forward_time: 77.6313095093, propagate_backward_time: 112.4506454468, weight_update_time: 0.2238970697, other_time: 4.2201995850
epoch time: 15.7259511948s, input_fired_time: 0.3021983802, output_fired_time: 0.0000000000, propagate_forward_time: 14.7087335587, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7150192261
validation[          , genome  6429] predictions:    9753/  10000 (97.53%), best:    9783/10000 (97.83%), error:       839.66888, best error:       727.04602 on epoch:    35, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 191.5266418457s, input_fired_time: 2.4059250355, output_fired_time: 2.1578493118, propagate_forward_time: 73.9987716675, propagate_backward_time: 108.9050903320, weight_update_time: 0.2248847336, other_time: 4.0589981079
epoch time: 15.8558378220s, input_fired_time: 0.3034254611, output_fired_time: 0.0000000000, propagate_forward_time: 14.8476371765, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7047748566
validation[          , genome  6429] predictions:    9771/  10000 (97.71%), best:    9783/10000 (97.83%), error:       759.09894, best error:       727.04602 on epoch:    35, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 193.3503570557s, input_fired_time: 2.4152894020, output_fired_time: 2.1660919189, propagate_forward_time: 73.5208892822, propagate_backward_time: 111.1829681396, weight_update_time: 0.2249668837, other_time: 4.0651245117
epoch time: 14.7017803192s, input_fired_time: 0.2981564999, output_fired_time: 0.0000000000, propagate_forward_time: 13.6949949265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7086286545
validation[          , genome  6429] predictions:    9769/  10000 (97.69%), best:    9783/10000 (97.83%), error:       755.65143, best error:       727.04602 on epoch:    35, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 193.5022888184s, input_fired_time: 2.4185826778, output_fired_time: 2.1496386528, propagate_forward_time: 74.8534545898, propagate_backward_time: 110.0106124878, weight_update_time: 0.2238432318, other_time: 4.0699996948
epoch time: 15.6195802689s, input_fired_time: 0.3070482016, output_fired_time: 0.0000000000, propagate_forward_time: 14.5986232758, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7139091492
validation[          , genome  6429] predictions:    9795/  10000 (97.95%), best:    9795/10000 (97.95%), error:       685.03088, best error:       685.03088 on epoch:    53, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 197.3888397217s, input_fired_time: 2.4860363007, output_fired_time: 2.2260274887, propagate_forward_time: 76.4815902710, propagate_backward_time: 112.0294723511, weight_update_time: 0.2244473845, other_time: 4.1657104492
epoch time: 15.9257822037s, input_fired_time: 0.3066529632, output_fired_time: 0.0000000000, propagate_forward_time: 14.8794631958, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7396659851
validation[          , genome  6429] predictions:    9800/  10000 (98.00%), best:    9800/10000 (98.00%), error:       667.98315, best error:       667.98315 on epoch:    54, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 195.2909545898s, input_fired_time: 2.4549310207, output_fired_time: 2.1984176636, propagate_forward_time: 72.6888504028, propagate_backward_time: 113.8155059814, weight_update_time: 0.2256637067, other_time: 4.1332473755
epoch time: 18.9018249512s, input_fired_time: 0.3709914088, output_fired_time: 0.0000000000, propagate_forward_time: 17.6880435944, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8427906036
validation[          , genome  6429] predictions:    9767/  10000 (97.67%), best:    9800/10000 (98.00%), error:       776.12085, best error:       667.98315 on epoch:    54, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 194.0618896484s, input_fired_time: 2.4532704353, output_fired_time: 2.1533632278, propagate_forward_time: 72.5619583130, propagate_backward_time: 112.7818222046, weight_update_time: 0.2234219313, other_time: 4.1114654541
epoch time: 15.9587154388s, input_fired_time: 0.3069104254, output_fired_time: 0.0000000000, propagate_forward_time: 14.9323511124, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7194538116
validation[          , genome  6429] predictions:    9800/  10000 (98.00%), best:    9800/10000 (98.00%), error:       722.69153, best error:       667.98315 on epoch:    54, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 192.3654632568s, input_fired_time: 2.4188914299, output_fired_time: 2.1512486935, propagate_forward_time: 70.3230667114, propagate_backward_time: 113.4024429321, weight_update_time: 0.2250352949, other_time: 4.0698242188
epoch time: 15.9934482574s, input_fired_time: 0.3068298101, output_fired_time: 0.0000000000, propagate_forward_time: 14.9777698517, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7088489532
validation[          , genome  6429] predictions:    9781/  10000 (97.81%), best:    9800/10000 (98.00%), error:       699.44458, best error:       667.98315 on epoch:    54, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 199.8124847412s, input_fired_time: 2.5518603325, output_fired_time: 2.2079110146, propagate_forward_time: 76.2127227783, propagate_backward_time: 114.5911331177, weight_update_time: 0.2364250422, other_time: 4.2488479614
epoch time: 16.0934143066s, input_fired_time: 0.3120393455, output_fired_time: 0.0000000000, propagate_forward_time: 15.0327749252, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7486000061
validation[          , genome  6429] predictions:    9697/  10000 (96.97%), best:    9800/10000 (98.00%), error:      1029.56372, best error:       667.98315 on epoch:    54, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 199.0116271973s, input_fired_time: 2.5018169880, output_fired_time: 2.2255723476, propagate_forward_time: 73.6269454956, propagate_backward_time: 116.5283660889, weight_update_time: 0.2250821590, other_time: 4.1289291382
epoch time: 16.0540142059s, input_fired_time: 0.3065849841, output_fired_time: 0.0000000000, propagate_forward_time: 15.0272130966, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7202157974
validation[          , genome  6429] predictions:    9731/  10000 (97.31%), best:    9800/10000 (98.00%), error:       882.68634, best error:       667.98315 on epoch:    54, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 191.4468078613s, input_fired_time: 2.4612054825, output_fired_time: 2.1447186470, propagate_forward_time: 72.9365158081, propagate_backward_time: 109.8410720825, weight_update_time: 0.2223362029, other_time: 4.0632934570
epoch time: 14.8392639160s, input_fired_time: 0.3052548468, output_fired_time: 0.0000000000, propagate_forward_time: 13.8156890869, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7183198929
validation[          , genome  6429] predictions:    9767/  10000 (97.67%), best:    9800/10000 (98.00%), error:       771.67169, best error:       667.98315 on epoch:    54, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 194.2302398682s, input_fired_time: 2.4258689880, output_fired_time: 2.3438796997, propagate_forward_time: 72.7627868652, propagate_backward_time: 111.5826950073, weight_update_time: 0.2248686552, other_time: 5.1149978638
epoch time: 16.0517234802s, input_fired_time: 0.3141373992, output_fired_time: 0.0000000000, propagate_forward_time: 15.0101137161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7274723053
validation[          , genome  6429] predictions:    9784/  10000 (97.84%), best:    9800/10000 (98.00%), error:       712.56274, best error:       667.98315 on epoch:    54, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 191.0652465820s, input_fired_time: 2.4417331219, output_fired_time: 2.1438868046, propagate_forward_time: 74.5970840454, propagate_backward_time: 107.8401870728, weight_update_time: 0.2222726047, other_time: 4.0423583984
epoch time: 15.9519166946s, input_fired_time: 0.3115086257, output_fired_time: 0.0000000000, propagate_forward_time: 14.9134054184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7270030975
validation[          , genome  6429] predictions:    9765/  10000 (97.65%), best:    9800/10000 (98.00%), error:       762.47339, best error:       667.98315 on epoch:    54, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 192.5598754883s, input_fired_time: 2.4201753139, output_fired_time: 2.1529932022, propagate_forward_time: 73.2507400513, propagate_backward_time: 110.6378326416, weight_update_time: 0.2249663323, other_time: 4.0981216431
epoch time: 15.7782535553s, input_fired_time: 0.3053290248, output_fired_time: 0.0000000000, propagate_forward_time: 14.7603855133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7125387192
validation[          , genome  6429] predictions:    9808/  10000 (98.08%), best:    9808/10000 (98.08%), error:       629.10132, best error:       629.10132 on epoch:    63, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 202.9097137451s, input_fired_time: 2.5080771446, output_fired_time: 2.1894965172, propagate_forward_time: 74.2266769409, propagate_backward_time: 119.6946716309, weight_update_time: 0.2386681437, other_time: 4.2907943726
epoch time: 15.9417228699s, input_fired_time: 0.3096706569, output_fired_time: 0.0000000000, propagate_forward_time: 14.9098119736, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7222404480
validation[          , genome  6429] predictions:    9750/  10000 (97.50%), best:    9808/10000 (98.08%), error:       811.06207, best error:       629.10132 on epoch:    63, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 194.3224792480s, input_fired_time: 2.4441897869, output_fired_time: 2.1594479084, propagate_forward_time: 71.1452713013, propagate_backward_time: 113.4618072510, weight_update_time: 0.2242913693, other_time: 5.1117630005
epoch time: 20.7639713287s, input_fired_time: 0.3920713067, output_fired_time: 0.0000000000, propagate_forward_time: 19.4831390381, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8887615204
validation[          , genome  6429] predictions:    9755/  10000 (97.55%), best:    9808/10000 (98.08%), error:       822.44910, best error:       629.10132 on epoch:    63, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 193.5425109863s, input_fired_time: 2.4277062416, output_fired_time: 3.1550438404, propagate_forward_time: 74.4237976074, propagate_backward_time: 109.4748382568, weight_update_time: 0.2237157077, other_time: 4.0611267090
epoch time: 16.0547637939s, input_fired_time: 0.3049254119, output_fired_time: 0.0000000000, propagate_forward_time: 15.0410041809, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7088346481
validation[          , genome  6429] predictions:    9798/  10000 (97.98%), best:    9808/10000 (98.08%), error:       671.55096, best error:       629.10132 on epoch:    63, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 193.1366424561s, input_fired_time: 2.4260556698, output_fired_time: 2.1573250294, propagate_forward_time: 71.8611373901, propagate_backward_time: 112.5774078369, weight_update_time: 0.2259829342, other_time: 4.1147232056
epoch time: 14.7443685532s, input_fired_time: 0.3022003472, output_fired_time: 0.0000000000, propagate_forward_time: 13.7313547134, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7108135223
validation[          , genome  6429] predictions:    9748/  10000 (97.48%), best:    9808/10000 (98.08%), error:       805.89746, best error:       629.10132 on epoch:    63, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 202.3261108398s, input_fired_time: 2.5499362946, output_fired_time: 2.2755534649, propagate_forward_time: 75.0472564697, propagate_backward_time: 118.2002716064, weight_update_time: 0.2397763431, other_time: 4.2530822754
epoch time: 16.3716773987s, input_fired_time: 0.3096271455, output_fired_time: 0.0000000000, propagate_forward_time: 15.2862462997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7758035660
validation[          , genome  6429] predictions:    9794/  10000 (97.94%), best:    9808/10000 (98.08%), error:       681.56860, best error:       629.10132 on epoch:    63, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 208.9965057373s, input_fired_time: 2.7257983685, output_fired_time: 2.3487641811, propagate_forward_time: 79.9395599365, propagate_backward_time: 119.7755050659, weight_update_time: 0.2388739437, other_time: 4.2068710327
epoch time: 15.9474582672s, input_fired_time: 0.3089497685, output_fired_time: 0.0000000000, propagate_forward_time: 14.9227228165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7157859802
validation[          , genome  6429] predictions:    9789/  10000 (97.89%), best:    9808/10000 (98.08%), error:       699.81671, best error:       629.10132 on epoch:    63, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 210.0486450195s, input_fired_time: 2.6211025715, output_fired_time: 2.3531696796, propagate_forward_time: 77.5949935913, propagate_backward_time: 122.1504058838, weight_update_time: 0.2398321182, other_time: 5.3289718628
epoch time: 16.3140621185s, input_fired_time: 0.3132655323, output_fired_time: 0.0000000000, propagate_forward_time: 15.2775096893, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7232875824
validation[          , genome  6429] predictions:    9748/  10000 (97.48%), best:    9808/10000 (98.08%), error:       853.49487, best error:       629.10132 on epoch:    63, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 193.0391845703s, input_fired_time: 3.4328446388, output_fired_time: 2.1562016010, propagate_forward_time: 69.1635055542, propagate_backward_time: 114.2567367554, weight_update_time: 0.2237597853, other_time: 4.0298919678
epoch time: 14.6824083328s, input_fired_time: 0.3067726791, output_fired_time: 0.0000000000, propagate_forward_time: 13.6578998566, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7177362442
validation[          , genome  6429] predictions:    9792/  10000 (97.92%), best:    9808/10000 (98.08%), error:       710.97754, best error:       629.10132 on epoch:    63, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 197.9907684326s, input_fired_time: 2.4880654812, output_fired_time: 2.2154209614, propagate_forward_time: 75.2791824341, propagate_backward_time: 113.9179000854, weight_update_time: 0.2241355777, other_time: 4.0901947021
epoch time: 25.9915943146s, input_fired_time: 0.4604649842, output_fired_time: 0.0000000000, propagate_forward_time: 24.3513755798, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1797542572
validation[          , genome  6429] predictions:    9800/  10000 (98.00%), best:    9808/10000 (98.08%), error:       699.70221, best error:       629.10132 on epoch:    63, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 200.5869598389s, input_fired_time: 2.5118114948, output_fired_time: 2.2371833324, propagate_forward_time: 77.2797622681, propagate_backward_time: 114.3529815674, weight_update_time: 0.2356168926, other_time: 4.2052230835
epoch time: 14.8325328827s, input_fired_time: 0.3065977097, output_fired_time: 0.0000000000, propagate_forward_time: 13.8183240891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7076110840
validation[          , genome  6429] predictions:    9786/  10000 (97.86%), best:    9808/10000 (98.08%), error:       675.85815, best error:       629.10132 on epoch:    63, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 192.3972473145s, input_fired_time: 3.4586775303, output_fired_time: 2.1488718987, propagate_forward_time: 71.6561203003, propagate_backward_time: 111.0515136719, weight_update_time: 0.2250211537, other_time: 4.0820693970
epoch time: 15.8750305176s, input_fired_time: 0.3121893406, output_fired_time: 0.0000000000, propagate_forward_time: 14.8393955231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7234458923
validation[          , genome  6429] predictions:    9722/  10000 (97.22%), best:    9808/10000 (98.08%), error:       891.53363, best error:       629.10132 on epoch:    63, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 191.3179473877s, input_fired_time: 3.4363000393, output_fired_time: 2.1430146694, propagate_forward_time: 71.8038482666, propagate_backward_time: 109.8721084595, weight_update_time: 0.2252816260, other_time: 4.0626754761
epoch time: 16.1794338226s, input_fired_time: 0.3190653622, output_fired_time: 0.0000000000, propagate_forward_time: 15.1256504059, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7347183228
validation[          , genome  6429] predictions:    9783/  10000 (97.83%), best:    9808/10000 (98.08%), error:       675.83478, best error:       629.10132 on epoch:    63, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 209.0437316895s, input_fired_time: 3.5939049721, output_fired_time: 2.3748230934, propagate_forward_time: 79.5243225098, propagate_backward_time: 119.1657943726, weight_update_time: 0.2307213545, other_time: 4.3848953247
epoch time: 14.4856920242s, input_fired_time: 0.3048892021, output_fired_time: 0.0000000000, propagate_forward_time: 13.4723806381, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7084226608
validation[          , genome  6429] predictions:    9756/  10000 (97.56%), best:    9808/10000 (98.08%), error:       851.52966, best error:       629.10132 on epoch:    63, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 214.8256683350s, input_fired_time: 2.6970121861, output_fired_time: 2.3602142334, propagate_forward_time: 81.7635116577, propagate_backward_time: 123.6107406616, weight_update_time: 0.2345999926, other_time: 4.3942031860
epoch time: 22.0530033112s, input_fired_time: 0.4581475258, output_fired_time: 0.0000000000, propagate_forward_time: 20.6708812714, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9239749908
validation[          , genome  6429] predictions:    9789/  10000 (97.89%), best:    9808/10000 (98.08%), error:       711.13208, best error:       629.10132 on epoch:    63, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 202.0011901855s, input_fired_time: 2.5478770733, output_fired_time: 2.2282493114, propagate_forward_time: 77.5013198853, propagate_backward_time: 115.6577072144, weight_update_time: 0.2308164984, other_time: 4.0660247803
epoch time: 15.7543067932s, input_fired_time: 0.3052763641, output_fired_time: 0.0000000000, propagate_forward_time: 14.7414579391, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7075729370
validation[          , genome  6429] predictions:    9788/  10000 (97.88%), best:    9808/10000 (98.08%), error:       728.95428, best error:       629.10132 on epoch:    63, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 197.7706756592s, input_fired_time: 2.4704768658, output_fired_time: 2.1896438599, propagate_forward_time: 75.4320373535, propagate_backward_time: 113.5689163208, weight_update_time: 0.2240182012, other_time: 4.1096115112
epoch time: 16.0014572144s, input_fired_time: 0.3126242757, output_fired_time: 0.0000000000, propagate_forward_time: 14.9428863525, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7459468842
validation[          , genome  6429] predictions:    9777/  10000 (97.77%), best:    9808/10000 (98.08%), error:       751.91156, best error:       629.10132 on epoch:    63, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 206.0858917236s, input_fired_time: 2.5721402168, output_fired_time: 2.2622869015, propagate_forward_time: 78.0703887939, propagate_backward_time: 118.8366088867, weight_update_time: 0.2326606810, other_time: 4.3444671631
epoch time: 16.2674064636s, input_fired_time: 0.3161590397, output_fired_time: 0.0000000000, propagate_forward_time: 15.2165050507, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7347421646
validation[          , genome  6429] predictions:    9778/  10000 (97.78%), best:    9808/10000 (98.08%), error:       743.54791, best error:       629.10132 on epoch:    63, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 196.1660614014s, input_fired_time: 2.4538455009, output_fired_time: 3.2018630505, propagate_forward_time: 72.4053115845, propagate_backward_time: 113.8244323730, weight_update_time: 0.2250421047, other_time: 4.2806167603
epoch time: 15.7811088562s, input_fired_time: 0.3079895079, output_fired_time: 0.0000000000, propagate_forward_time: 14.7111721039, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7619476318
validation[          , genome  6429] predictions:    9773/  10000 (97.73%), best:    9808/10000 (98.08%), error:       721.83997, best error:       629.10132 on epoch:    63, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 192.8256988525s, input_fired_time: 3.4516377449, output_fired_time: 2.1651017666, propagate_forward_time: 73.2230224609, propagate_backward_time: 109.8392105103, weight_update_time: 0.2240056545, other_time: 4.1467208862
epoch time: 16.0217647552s, input_fired_time: 0.3151733279, output_fired_time: 0.0000000000, propagate_forward_time: 14.9584798813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7481117249
validation[          , genome  6429] predictions:    9758/  10000 (97.58%), best:    9808/10000 (98.08%), error:       818.28967, best error:       629.10132 on epoch:    63, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 194.3066406250s, input_fired_time: 2.4570055008, output_fired_time: 2.1845042706, propagate_forward_time: 72.7352905273, propagate_backward_time: 112.6965484619, weight_update_time: 0.2268883288, other_time: 4.2332916260
epoch time: 16.4330902100s, input_fired_time: 0.3204928637, output_fired_time: 0.0000000000, propagate_forward_time: 15.3430128098, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7695837021
validation[          , genome  6429] predictions:    9767/  10000 (97.67%), best:    9808/10000 (98.08%), error:       752.01532, best error:       629.10132 on epoch:    63, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 192.6026611328s, input_fired_time: 2.4461836815, output_fired_time: 2.1603801250, propagate_forward_time: 75.1965560913, propagate_backward_time: 108.6137924194, weight_update_time: 0.2255683541, other_time: 4.1857452393
epoch time: 15.9420585632s, input_fired_time: 0.3123701513, output_fired_time: 0.0000000000, propagate_forward_time: 14.9141530991, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7155351639
validation[          , genome  6429] predictions:    9757/  10000 (97.57%), best:    9808/10000 (98.08%), error:       844.20764, best error:       629.10132 on epoch:    63, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 193.0211029053s, input_fired_time: 2.4427556992, output_fired_time: 2.1485488415, propagate_forward_time: 72.1374282837, propagate_backward_time: 112.0900344849, weight_update_time: 0.2266290784, other_time: 4.2023468018
epoch time: 15.9612598419s, input_fired_time: 0.3158717453, output_fired_time: 0.0000000000, propagate_forward_time: 14.9227571487, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7226305008
validation[          , genome  6429] predictions:    9753/  10000 (97.53%), best:    9808/10000 (98.08%), error:       810.26038, best error:       629.10132 on epoch:    63, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 191.4504394531s, input_fired_time: 2.4441394806, output_fired_time: 2.1836566925, propagate_forward_time: 70.8826293945, propagate_backward_time: 111.7641143799, weight_update_time: 0.2241483182, other_time: 4.1759033203
epoch time: 16.2147006989s, input_fired_time: 0.3242659569, output_fired_time: 0.0000000000, propagate_forward_time: 15.1296939850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7607402802
validation[          , genome  6429] predictions:    9773/  10000 (97.73%), best:    9808/10000 (98.08%), error:       763.19232, best error:       629.10132 on epoch:    63, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 192.1135711670s, input_fired_time: 2.4807569981, output_fired_time: 2.1804852486, propagate_forward_time: 73.8161163330, propagate_backward_time: 109.4175491333, weight_update_time: 0.2244991064, other_time: 4.2186660767
epoch time: 14.6133661270s, input_fired_time: 0.3101045489, output_fired_time: 0.0000000000, propagate_forward_time: 13.5653438568, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7379179001
validation[          , genome  6429] predictions:    9783/  10000 (97.83%), best:    9808/10000 (98.08%), error:       732.74329, best error:       629.10132 on epoch:    63, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 195.9623413086s, input_fired_time: 3.4000108242, output_fired_time: 2.1800527573, propagate_forward_time: 74.4561843872, propagate_backward_time: 111.5945129395, weight_update_time: 0.2272129059, other_time: 4.3315811157
epoch time: 15.9454593658s, input_fired_time: 0.3114718795, output_fired_time: 0.0000000000, propagate_forward_time: 14.8879261017, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7460613251
validation[          , genome  6429] predictions:    9780/  10000 (97.80%), best:    9808/10000 (98.08%), error:       756.29572, best error:       629.10132 on epoch:    63, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 195.8757171631s, input_fired_time: 2.5288519859, output_fired_time: 2.1803534031, propagate_forward_time: 74.5485916138, propagate_backward_time: 111.3170547485, weight_update_time: 0.2260504216, other_time: 5.3008575439
epoch time: 17.0689086914s, input_fired_time: 0.3267515600, output_fired_time: 0.0000000000, propagate_forward_time: 15.8796491623, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8625078201
validation[          , genome  6429] predictions:    9807/  10000 (98.07%), best:    9808/10000 (98.08%), error:       701.81549, best error:       629.10132 on epoch:    63, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 200.8240814209s, input_fired_time: 2.5423381329, output_fired_time: 2.3017420769, propagate_forward_time: 74.8902511597, propagate_backward_time: 116.4777145386, weight_update_time: 0.2314689755, other_time: 4.6120300293
epoch time: 15.2664098740s, input_fired_time: 0.3114568293, output_fired_time: 0.0000000000, propagate_forward_time: 14.1643257141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7906274796
validation[          , genome  6429] predictions:    9749/  10000 (97.49%), best:    9808/10000 (98.08%), error:       817.56677, best error:       629.10132 on epoch:    63, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 190.5764465332s, input_fired_time: 2.4613962173, output_fired_time: 2.1600630283, propagate_forward_time: 71.4317932129, propagate_backward_time: 110.0869140625, weight_update_time: 0.2291018367, other_time: 4.4362792969
epoch time: 15.4540586472s, input_fired_time: 1.2158011198, output_fired_time: 0.0000000000, propagate_forward_time: 13.4915866852, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7466707230
validation[          , genome  6429] predictions:    9738/  10000 (97.38%), best:    9808/10000 (98.08%), error:       846.11517, best error:       629.10132 on epoch:    63, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 190.8459014893s, input_fired_time: 2.4646396637, output_fired_time: 3.1663689613, propagate_forward_time: 74.6285247803, propagate_backward_time: 106.2300186157, weight_update_time: 0.2270258963, other_time: 4.3563461304
epoch time: 15.9942626953s, input_fired_time: 0.3191361725, output_fired_time: 0.0000000000, propagate_forward_time: 14.8516616821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8234643936
validation[          , genome  6429] predictions:    9771/  10000 (97.71%), best:    9808/10000 (98.08%), error:       765.39282, best error:       629.10132 on epoch:    63, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 192.0254364014s, input_fired_time: 2.4742524624, output_fired_time: 2.1554536819, propagate_forward_time: 70.7168121338, propagate_backward_time: 112.3639068604, weight_update_time: 0.2271313220, other_time: 4.3150024414
epoch time: 16.0834693909s, input_fired_time: 0.3145613968, output_fired_time: 0.0000000000, propagate_forward_time: 14.9263229370, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8425846100
validation[          , genome  6429] predictions:    9738/  10000 (97.38%), best:    9808/10000 (98.08%), error:       815.90985, best error:       629.10132 on epoch:    63, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 192.0945587158s, input_fired_time: 2.4549591541, output_fired_time: 2.1741347313, propagate_forward_time: 71.1202392578, propagate_backward_time: 111.9707946777, weight_update_time: 0.2261137813, other_time: 4.3744354248
epoch time: 16.4101047516s, input_fired_time: 0.3228663504, output_fired_time: 0.0000000000, propagate_forward_time: 15.3429737091, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7442646027
validation[          , genome  6429] predictions:    9748/  10000 (97.48%), best:    9808/10000 (98.08%), error:       852.42126, best error:       629.10132 on epoch:    63, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 193.7036285400s, input_fired_time: 2.4806940556, output_fired_time: 2.2488622665, propagate_forward_time: 72.5711746216, propagate_backward_time: 111.8741836548, weight_update_time: 0.2486910075, other_time: 4.5287170410
epoch time: 17.5556926727s, input_fired_time: 0.3628642857, output_fired_time: 0.0000000000, propagate_forward_time: 16.3834781647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8093509674
validation[          , genome  6429] predictions:    9780/  10000 (97.80%), best:    9808/10000 (98.08%), error:       715.39502, best error:       629.10132 on epoch:    63, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 198.1908721924s, input_fired_time: 2.5847518444, output_fired_time: 2.2020411491, propagate_forward_time: 75.0315933228, propagate_backward_time: 113.9516906738, weight_update_time: 0.2290251255, other_time: 4.4207992554
epoch time: 14.8446435928s, input_fired_time: 0.3172352016, output_fired_time: 0.0000000000, propagate_forward_time: 13.7475595474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7798490524
validation[          , genome  6429] predictions:    9659/  10000 (96.59%), best:    9808/10000 (98.08%), error:      1112.98047, best error:       629.10132 on epoch:    63, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 203.8560180664s, input_fired_time: 2.5816581249, output_fired_time: 2.3448734283, propagate_forward_time: 75.8087692261, propagate_backward_time: 118.6170425415, weight_update_time: 0.2361975461, other_time: 4.5036621094
epoch time: 14.6020126343s, input_fired_time: 0.3118917048, output_fired_time: 0.0000000000, propagate_forward_time: 13.5519571304, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7381639481
validation[          , genome  6429] predictions:    9727/  10000 (97.27%), best:    9808/10000 (98.08%), error:       920.00256, best error:       629.10132 on epoch:    63, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 195.3664398193s, input_fired_time: 2.4809284210, output_fired_time: 2.2169396877, propagate_forward_time: 74.4571762085, propagate_backward_time: 109.7936935425, weight_update_time: 0.2338136584, other_time: 6.4177093506
epoch time: 15.8798618317s, input_fired_time: 0.3192856908, output_fired_time: 0.0000000000, propagate_forward_time: 14.7527952194, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8077812195
validation[          , genome  6429] predictions:    9690/  10000 (96.90%), best:    9808/10000 (98.08%), error:       973.86438, best error:       629.10132 on epoch:    63, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 190.5854187012s, input_fired_time: 2.4515459538, output_fired_time: 2.1565799713, propagate_forward_time: 71.6097793579, propagate_backward_time: 109.0683746338, weight_update_time: 0.2273248881, other_time: 5.2991256714
epoch time: 14.8910551071s, input_fired_time: 0.3115107119, output_fired_time: 0.0000000000, propagate_forward_time: 13.8040113449, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7755327225
validation[          , genome  6429] predictions:    9749/  10000 (97.49%), best:    9808/10000 (98.08%), error:       876.97467, best error:       629.10132 on epoch:    63, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 194.4413299561s, input_fired_time: 2.4526951313, output_fired_time: 2.1944525242, propagate_forward_time: 71.7624740601, propagate_backward_time: 113.7223434448, weight_update_time: 0.2358084619, other_time: 4.3093566895
epoch time: 15.1835155487s, input_fired_time: 0.3037534058, output_fired_time: 0.0000000000, propagate_forward_time: 14.0940732956, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7856884003
validation[          , genome  6429] predictions:    9752/  10000 (97.52%), best:    9808/10000 (98.08%), error:       801.73083, best error:       629.10132 on epoch:    63, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 78.1719589233s, input_fired_time: 1.5613073111, output_fired_time: 0.0000000000, propagate_forward_time: 72.4878158569, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1228332520
best training[          , genome  6429] predictions:   49816/  50000 (99.63%), best:    9808/10000 (98.08%), error:       951.70184, best error:       629.10132 on epoch:    63, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 14.5160570145s, input_fired_time: 0.3025748134, output_fired_time: 0.0000000000, propagate_forward_time: 13.4915981293, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7218837738
   testing[          , genome  6429] predictions:    9833/  10000 (98.33%), best:    9808/10000 (98.08%), error:       574.11560, best error:       629.10132 on epoch:    63, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
05:53:20 (11456): called boinc_finish(0)

</stderr_txt>
]]>