Nameexact_genome_1512568488_43_6123_0
Workunit2601869
Created7 Dec 2017, 18:02:26 UTC
Sent7 Dec 2017, 18:11:34 UTC
Report deadline18 Dec 2017, 7:07:33 UTC
Received8 Dec 2017, 23:25:08 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID65825
Run time2 hours 39 min 25 sec
CPU time2 hours 28 min 21 sec
Validate stateValid
Credit2,634.72
Device peak FLOPS3.09 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34

Stderr output

<core_client_version>7.0.80</core_client_version>
<![CDATA[
<stderr_txt>
 on epoch:    11, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 203.1479187012s, input_fired_time: 1.9240117073, output_fired_time: 1.7152295113, propagate_forward_time: 78.9513626099, propagate_backward_time: 111.8303527832, weight_update_time: 1.1028571129, other_time: 8.7269668579
epoch time: 17.0686111450s, input_fired_time: 0.1122211516, output_fired_time: 0.0000000000, propagate_forward_time: 16.6119861603, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3444042206
validation[          , genome  6123] predictions:    9682/  10000 (96.82%), best:    9739/10000 (97.39%), error:      1090.31091, best error:       858.94055 on epoch:    11, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 203.5025482178s, input_fired_time: 2.9111900330, output_fired_time: 3.7206814289, propagate_forward_time: 71.3139801025, propagate_backward_time: 119.8433303833, weight_update_time: 0.0987633169, other_time: 5.7133560181
epoch time: 15.4254484177s, input_fired_time: 1.1045488119, output_fired_time: 0.0000000000, propagate_forward_time: 14.0198249817, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3010749817
validation[          , genome  6123] predictions:    9683/  10000 (96.83%), best:    9739/10000 (97.39%), error:      1026.70215, best error:       858.94055 on epoch:    11, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 204.7126617432s, input_fired_time: 0.9226242304, output_fired_time: 2.7308533192, propagate_forward_time: 77.3088455200, propagate_backward_time: 119.0361175537, weight_update_time: 0.1013786569, other_time: 4.7142257690
epoch time: 15.4379177094s, input_fired_time: 0.1089312062, output_fired_time: 0.0000000000, propagate_forward_time: 15.0161628723, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3128232956
validation[          , genome  6123] predictions:    9710/  10000 (97.10%), best:    9739/10000 (97.39%), error:       952.72772, best error:       858.94055 on epoch:    11, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 204.6426849365s, input_fired_time: 3.9159975052, output_fired_time: 0.7181299925, propagate_forward_time: 69.1358718872, propagate_backward_time: 126.1556091309, weight_update_time: 2.1062242985, other_time: 4.7170715332
epoch time: 14.4959249496s, input_fired_time: 0.1090821177, output_fired_time: 0.0000000000, propagate_forward_time: 14.0745744705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3122682571
validation[          , genome  6123] predictions:    9725/  10000 (97.25%), best:    9739/10000 (97.39%), error:       909.75909, best error:       858.94055 on epoch:    11, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 203.2911224365s, input_fired_time: 2.9169073105, output_fired_time: 2.7277970314, propagate_forward_time: 75.2318954468, propagate_backward_time: 118.7096939087, weight_update_time: 0.1008667797, other_time: 3.7048339844
epoch time: 17.7854003906s, input_fired_time: 0.1130521968, output_fired_time: 0.0000000000, propagate_forward_time: 17.3508949280, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3214530945
validation[          , genome  6123] predictions:    9733/  10000 (97.33%), best:    9739/10000 (97.39%), error:       901.80182, best error:       858.94055 on epoch:    11, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 202.2962493896s, input_fired_time: 3.9225742817, output_fired_time: 0.7078363299, propagate_forward_time: 79.1299819946, propagate_backward_time: 116.8258590698, weight_update_time: 0.0999082252, other_time: 1.7099914551
epoch time: 15.4003639221s, input_fired_time: 0.1043214649, output_fired_time: 0.0000000000, propagate_forward_time: 12.9866437912, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3093986511
validation[          , genome  6123] predictions:    9723/  10000 (97.23%), best:    9739/10000 (97.39%), error:       885.98969, best error:       858.94055 on epoch:    11, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 203.5545654297s, input_fired_time: 5.9299902916, output_fired_time: 0.7158145905, propagate_forward_time: 71.2250671387, propagate_backward_time: 117.7375793457, weight_update_time: 0.1107695550, other_time: 7.9461059570
epoch time: 14.4437036514s, input_fired_time: 0.1106343046, output_fired_time: 0.0000000000, propagate_forward_time: 14.0273084641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3057613373
validation[          , genome  6123] predictions:    9714/  10000 (97.14%), best:    9739/10000 (97.39%), error:       981.45441, best error:       858.94055 on epoch:    11, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 203.1645812988s, input_fired_time: 1.9300026894, output_fired_time: 0.7064389586, propagate_forward_time: 87.0198211670, propagate_backward_time: 111.8126144409, weight_update_time: 0.0987689942, other_time: 1.6957015991
epoch time: 15.4318027496s, input_fired_time: 0.1076051667, output_fired_time: 0.0000000000, propagate_forward_time: 15.0259666443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2982311249
validation[          , genome  6123] predictions:    9757/  10000 (97.57%), best:    9757/10000 (97.57%), error:       817.37500, best error:       817.37500 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 202.1631317139s, input_fired_time: 0.9140665531, output_fired_time: 5.7363138199, propagate_forward_time: 74.9242019653, propagate_backward_time: 110.8640060425, weight_update_time: 0.1006270573, other_time: 9.7245483398
epoch time: 17.4209117889s, input_fired_time: 0.1055587158, output_fired_time: 0.0000000000, propagate_forward_time: 17.0094203949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3059329987
validation[          , genome  6123] predictions:    9738/  10000 (97.38%), best:    9757/10000 (97.57%), error:       897.49969, best error:       817.37500 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 202.4365081787s, input_fired_time: 2.9102308750, output_fired_time: 0.7149400115, propagate_forward_time: 72.1499099731, propagate_backward_time: 122.9497909546, weight_update_time: 0.1019974723, other_time: 3.7116394043
epoch time: 17.5709152222s, input_fired_time: 1.1104239225, output_fired_time: 0.0000000000, propagate_forward_time: 15.1170845032, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3434066772
validation[          , genome  6123] predictions:    9716/  10000 (97.16%), best:    9757/10000 (97.57%), error:       920.00897, best error:       817.37500 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 203.1580810547s, input_fired_time: 0.9242653847, output_fired_time: 0.7090803385, propagate_forward_time: 74.7733612061, propagate_backward_time: 120.1295547485, weight_update_time: 3.1093983650, other_time: 6.6218185425
epoch time: 15.4064264297s, input_fired_time: 0.1056577042, output_fired_time: 0.0000000000, propagate_forward_time: 15.0007896423, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2999792099
validation[          , genome  6123] predictions:    9719/  10000 (97.19%), best:    9757/10000 (97.57%), error:       916.18884, best error:       817.37500 on epoch:    22, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 204.2804718018s, input_fired_time: 2.9148466587, output_fired_time: 2.6164176464, propagate_forward_time: 82.1021423340, propagate_backward_time: 112.9072113037, weight_update_time: 0.1016474590, other_time: 3.7398529053
epoch time: 14.3289041519s, input_fired_time: 0.1081415266, output_fired_time: 0.0000000000, propagate_forward_time: 13.9124336243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3083286285
validation[          , genome  6123] predictions:    9667/  10000 (96.67%), best:    9757/10000 (97.57%), error:      1110.61670, best error:       817.37500 on epoch:    22, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 202.2185058594s, input_fired_time: 0.9046898484, output_fired_time: 0.7085160613, propagate_forward_time: 75.1731262207, propagate_backward_time: 119.7120056152, weight_update_time: 0.0984686911, other_time: 5.7201690674
epoch time: 15.4281597137s, input_fired_time: 0.1080256626, output_fired_time: 0.0000000000, propagate_forward_time: 15.0195598602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3005743027
validation[          , genome  6123] predictions:    9724/  10000 (97.24%), best:    9757/10000 (97.57%), error:       911.18359, best error:       817.37500 on epoch:    22, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 203.0617065430s, input_fired_time: 1.8073785305, output_fired_time: 4.7252178192, propagate_forward_time: 73.1902008057, propagate_backward_time: 120.6399002075, weight_update_time: 0.0999860838, other_time: 2.6990127563
epoch time: 16.4016399384s, input_fired_time: 0.1046018600, output_fired_time: 0.0000000000, propagate_forward_time: 15.9977674484, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2992715836
validation[          , genome  6123] predictions:    9734/  10000 (97.34%), best:    9757/10000 (97.57%), error:       868.09833, best error:       817.37500 on epoch:    22, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 203.2931823730s, input_fired_time: 1.9120441675, output_fired_time: 0.7132847905, propagate_forward_time: 89.1050109863, propagate_backward_time: 108.8679428101, weight_update_time: 0.1003313735, other_time: 2.6948928833
epoch time: 15.5401420593s, input_fired_time: 1.1087778807, output_fired_time: 0.0000000000, propagate_forward_time: 14.1304168701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3009471893
validation[          , genome  6123] predictions:    9719/  10000 (97.19%), best:    9757/10000 (97.57%), error:       887.43555, best error:       817.37500 on epoch:    22, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 202.4366302490s, input_fired_time: 0.9138010740, output_fired_time: 0.7092112899, propagate_forward_time: 74.2678985596, propagate_backward_time: 120.8391265869, weight_update_time: 0.1004680991, other_time: 5.7065887451
epoch time: 15.3277721405s, input_fired_time: 0.1061411276, output_fired_time: 0.0000000000, propagate_forward_time: 14.9221563339, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2994747162
validation[          , genome  6123] predictions:    9696/  10000 (96.96%), best:    9757/10000 (97.57%), error:      1032.84460, best error:       817.37500 on epoch:    22, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 203.3301239014s, input_fired_time: 1.9185076952, output_fired_time: 1.7224837542, propagate_forward_time: 73.0965881348, propagate_backward_time: 121.8547744751, weight_update_time: 0.0995606035, other_time: 4.7377700806
epoch time: 15.5426597595s, input_fired_time: 0.1156790331, output_fired_time: 0.0000000000, propagate_forward_time: 12.1121883392, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3147926331
validation[          , genome  6123] predictions:    9764/  10000 (97.64%), best:    9757/10000 (97.57%), error:       865.04297, best error:       817.37500 on epoch:    22, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 202.2430877686s, input_fired_time: 0.9069389105, output_fired_time: 1.7288613319, propagate_forward_time: 76.1675262451, propagate_backward_time: 116.8275299072, weight_update_time: 2.1091816425, other_time: 6.6122283936
epoch time: 15.4235134125s, input_fired_time: 0.1056629941, output_fired_time: 0.0000000000, propagate_forward_time: 14.0136966705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3041534424
validation[          , genome  6123] predictions:    9736/  10000 (97.36%), best:    9757/10000 (97.57%), error:       881.56470, best error:       817.37500 on epoch:    22, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 205.0829315186s, input_fired_time: 1.9331960678, output_fired_time: 2.7279484272, propagate_forward_time: 67.3624954224, propagate_backward_time: 129.3370513916, weight_update_time: 0.1045213416, other_time: 3.7222442627
epoch time: 16.4347400665s, input_fired_time: 0.1097403094, output_fired_time: 0.0000000000, propagate_forward_time: 16.0194110870, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3055877686
validation[          , genome  6123] predictions:    9734/  10000 (97.34%), best:    9757/10000 (97.57%), error:       873.44843, best error:       817.37500 on epoch:    22, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 210.0690917969s, input_fired_time: 5.0901799202, output_fired_time: 3.7243566513, propagate_forward_time: 81.5040130615, propagate_backward_time: 117.9934463501, weight_update_time: 0.1048481464, other_time: 1.7571029663
epoch time: 16.4746303558s, input_fired_time: 0.1087524295, output_fired_time: 0.0000000000, propagate_forward_time: 16.0551662445, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3107109070
validation[          , genome  6123] predictions:    9786/  10000 (97.86%), best:    9786/10000 (97.86%), error:       753.23450, best error:       753.23450 on epoch:    34, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 202.9309539795s, input_fired_time: 0.9129363298, output_fired_time: 2.7167448997, propagate_forward_time: 73.7975387573, propagate_backward_time: 121.7853927612, weight_update_time: 0.1000833884, other_time: 3.7183380127
epoch time: 16.4466819763s, input_fired_time: 0.1054769456, output_fired_time: 0.0000000000, propagate_forward_time: 15.0383882523, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3028173447
validation[          , genome  6123] predictions:    9771/  10000 (97.71%), best:    9786/10000 (97.86%), error:       763.96045, best error:       753.23450 on epoch:    34, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 202.0310058594s, input_fired_time: 2.9208426476, output_fired_time: 0.7138944268, propagate_forward_time: 71.0721817017, propagate_backward_time: 123.7207031250, weight_update_time: 0.0992249325, other_time: 3.6033859253
epoch time: 17.4778079987s, input_fired_time: 0.1063658893, output_fired_time: 0.0000000000, propagate_forward_time: 17.0519218445, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3195209503
validation[          , genome  6123] predictions:    9753/  10000 (97.53%), best:    9786/10000 (97.86%), error:       838.94189, best error:       753.23450 on epoch:    34, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 202.2048034668s, input_fired_time: 2.9282805920, output_fired_time: 0.7151925564, propagate_forward_time: 72.0987472534, propagate_backward_time: 122.7582168579, weight_update_time: 0.1023497283, other_time: 3.7043609619
epoch time: 17.5093116760s, input_fired_time: 0.1069353595, output_fired_time: 0.0000000000, propagate_forward_time: 15.0946435928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3077325821
validation[          , genome  6123] predictions:    9756/  10000 (97.56%), best:    9786/10000 (97.86%), error:       805.04254, best error:       753.23450 on epoch:    34, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 202.4447937012s, input_fired_time: 0.9073740840, output_fired_time: 4.7380337715, propagate_forward_time: 72.1969375610, propagate_backward_time: 118.9021987915, weight_update_time: 0.0996516123, other_time: 5.7002410889
epoch time: 15.4483461380s, input_fired_time: 0.1145964190, output_fired_time: 0.0000000000, propagate_forward_time: 13.0277833939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3059663773
validation[          , genome  6123] predictions:    9711/  10000 (97.11%), best:    9786/10000 (97.86%), error:       964.53247, best error:       753.23450 on epoch:    34, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 202.9108734131s, input_fired_time: 1.9140951633, output_fired_time: 0.7051648498, propagate_forward_time: 75.9165649414, propagate_backward_time: 119.6839675903, weight_update_time: 0.0987845883, other_time: 4.6910781860
epoch time: 16.4498538971s, input_fired_time: 0.1077647209, output_fired_time: 0.0000000000, propagate_forward_time: 16.0401973724, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3018913269
validation[          , genome  6123] predictions:    9762/  10000 (97.62%), best:    9786/10000 (97.86%), error:       786.06183, best error:       753.23450 on epoch:    34, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 202.9312286377s, input_fired_time: 0.9118982553, output_fired_time: 0.7093483210, propagate_forward_time: 73.0628128052, propagate_backward_time: 121.6312026978, weight_update_time: 0.0990219712, other_time: 6.6159591675
epoch time: 17.4508171082s, input_fired_time: 0.1128078774, output_fired_time: 0.0000000000, propagate_forward_time: 15.0180797577, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3199291229
validation[          , genome  6123] predictions:    9748/  10000 (97.48%), best:    9786/10000 (97.86%), error:       833.25421, best error:       753.23450 on epoch:    34, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 205.3235168457s, input_fired_time: 2.9502887726, output_fired_time: 2.7328522205, propagate_forward_time: 79.5111694336, propagate_backward_time: 116.3864746094, weight_update_time: 0.1005578563, other_time: 3.7427368164
epoch time: 17.4090461731s, input_fired_time: 0.1075107977, output_fired_time: 0.0000000000, propagate_forward_time: 15.0970382690, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2044963837
validation[          , genome  6123] predictions:    9757/  10000 (97.57%), best:    9786/10000 (97.86%), error:       818.96906, best error:       753.23450 on epoch:    34, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 203.0036315918s, input_fired_time: 4.9263014793, output_fired_time: 0.7208343148, propagate_forward_time: 78.9218978882, propagate_backward_time: 116.7273178101, weight_update_time: 0.1025281772, other_time: 1.7072753906
epoch time: 16.3765830994s, input_fired_time: 0.1084282100, output_fired_time: 0.0000000000, propagate_forward_time: 15.9635496140, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3046045303
validation[          , genome  6123] predictions:    9684/  10000 (96.84%), best:    9786/10000 (97.86%), error:      1013.89331, best error:       753.23450 on epoch:    34, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 202.1553039551s, input_fired_time: 0.9090349078, output_fired_time: 2.7230739594, propagate_forward_time: 81.1555557251, propagate_backward_time: 115.6650466919, weight_update_time: 0.1013375819, other_time: 1.7025909424
epoch time: 16.4816799164s, input_fired_time: 0.1071671173, output_fired_time: 0.0000000000, propagate_forward_time: 16.0662078857, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3083057404
validation[          , genome  6123] predictions:    9762/  10000 (97.62%), best:    9786/10000 (97.86%), error:       807.28387, best error:       753.23450 on epoch:    34, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 204.7154998779s, input_fired_time: 0.9233978987, output_fired_time: 0.7167794704, propagate_forward_time: 82.2260742188, propagate_backward_time: 116.0924987793, weight_update_time: 0.1006733775, other_time: 4.7567443848
epoch time: 16.4495067596s, input_fired_time: 0.1075468957, output_fired_time: 0.0000000000, propagate_forward_time: 16.0329742432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3089847565
validation[          , genome  6123] predictions:    9785/  10000 (97.85%), best:    9785/10000 (97.85%), error:       751.20984, best error:       751.20984 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 204.8465270996s, input_fired_time: 1.9227522612, output_fired_time: 2.7256646156, propagate_forward_time: 77.3632965088, propagate_backward_time: 121.0995559692, weight_update_time: 0.1016090438, other_time: 1.7352676392
epoch time: 15.5682315826s, input_fired_time: 0.1139391735, output_fired_time: 0.0000000000, propagate_forward_time: 15.1467866898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3075056076
validation[          , genome  6123] predictions:    9777/  10000 (97.77%), best:    9785/10000 (97.85%), error:       766.94336, best error:       751.20984 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 203.0702056885s, input_fired_time: 1.9353715181, output_fired_time: 1.7187904119, propagate_forward_time: 73.0943756104, propagate_backward_time: 123.6200027466, weight_update_time: 0.0991653502, other_time: 2.7016525269
epoch time: 15.4481458664s, input_fired_time: 2.1143474579, output_fired_time: 0.0000000000, propagate_forward_time: 13.0321035385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3016948700
validation[          , genome  6123] predictions:    9721/  10000 (97.21%), best:    9785/10000 (97.85%), error:       903.48206, best error:       751.20984 on epoch:    44, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 205.2534332275s, input_fired_time: 5.9345674515, output_fired_time: 0.7282237411, propagate_forward_time: 78.4014816284, propagate_backward_time: 116.4421386719, weight_update_time: 0.1002138630, other_time: 3.7470169067
epoch time: 15.4513969421s, input_fired_time: 0.1080428585, output_fired_time: 0.0000000000, propagate_forward_time: 15.0423221588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3010320663
validation[          , genome  6123] predictions:    9724/  10000 (97.24%), best:    9785/10000 (97.85%), error:       872.21912, best error:       751.20984 on epoch:    44, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 203.9731903076s, input_fired_time: 3.9432263374, output_fired_time: 0.7204564214, propagate_forward_time: 71.6260147095, propagate_backward_time: 124.9761962891, weight_update_time: 0.1034591570, other_time: 2.7072982788
epoch time: 17.4082794189s, input_fired_time: 0.1111332402, output_fired_time: 0.0000000000, propagate_forward_time: 14.9877014160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3094444275
validation[          , genome  6123] predictions:    9744/  10000 (97.44%), best:    9785/10000 (97.85%), error:       815.93036, best error:       751.20984 on epoch:    44, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 203.2785949707s, input_fired_time: 3.9228494167, output_fired_time: 0.7179079652, propagate_forward_time: 72.9648666382, propagate_backward_time: 121.9598236084, weight_update_time: 2.1049664021, other_time: 3.7131423950
epoch time: 14.4716434479s, input_fired_time: 0.1157081947, output_fired_time: 0.0000000000, propagate_forward_time: 12.0457801819, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3101549149
validation[          , genome  6123] predictions:    9731/  10000 (97.31%), best:    9785/10000 (97.85%), error:       834.46967, best error:       751.20984 on epoch:    44, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 203.2160949707s, input_fired_time: 3.9341073036, output_fired_time: 0.7187431455, propagate_forward_time: 77.1733551025, propagate_backward_time: 118.6738357544, weight_update_time: 0.1072020903, other_time: 2.7160415649
epoch time: 17.8810386658s, input_fired_time: 0.1271249652, output_fired_time: 0.0000000000, propagate_forward_time: 17.4164409637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3374729156
validation[          , genome  6123] predictions:    9753/  10000 (97.53%), best:    9785/10000 (97.85%), error:       802.63831, best error:       751.20984 on epoch:    44, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 205.2276916504s, input_fired_time: 2.9243512154, output_fired_time: 2.7289149761, propagate_forward_time: 76.6803970337, propagate_backward_time: 118.1720275879, weight_update_time: 2.1057481766, other_time: 4.7220077515
epoch time: 17.5068473816s, input_fired_time: 0.1075141355, output_fired_time: 0.0000000000, propagate_forward_time: 17.0958671570, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3034667969
validation[          , genome  6123] predictions:    9775/  10000 (97.75%), best:    9785/10000 (97.85%), error:       786.99744, best error:       751.20984 on epoch:    44, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 204.3363342285s, input_fired_time: 2.9254336357, output_fired_time: 0.7137359381, propagate_forward_time: 71.1969757080, propagate_backward_time: 124.7809982300, weight_update_time: 0.1004628390, other_time: 4.7192001343
epoch time: 15.4453954697s, input_fired_time: 1.1120781898, output_fired_time: 0.0000000000, propagate_forward_time: 12.0183734894, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3149433136
validation[          , genome  6123] predictions:    9759/  10000 (97.59%), best:    9785/10000 (97.85%), error:       792.42523, best error:       751.20984 on epoch:    44, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 205.2104339600s, input_fired_time: 2.9332342148, output_fired_time: 0.7275949717, propagate_forward_time: 72.3025665283, propagate_backward_time: 118.5032958984, weight_update_time: 4.1128349304, other_time: 10.7437438965
epoch time: 16.4850788116s, input_fired_time: 0.1074148118, output_fired_time: 0.0000000000, propagate_forward_time: 16.0763893127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3012752533
validation[          , genome  6123] predictions:    9751/  10000 (97.51%), best:    9785/10000 (97.85%), error:       790.51160, best error:       751.20984 on epoch:    44, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 203.4017333984s, input_fired_time: 1.9352946281, output_fired_time: 0.7213267088, propagate_forward_time: 75.2406845093, propagate_backward_time: 122.7835769653, weight_update_time: 0.0994831473, other_time: 2.7208557129
epoch time: 16.4629611969s, input_fired_time: 0.1065824255, output_fired_time: 0.0000000000, propagate_forward_time: 16.0492839813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3070945740
validation[          , genome  6123] predictions:    9765/  10000 (97.65%), best:    9785/10000 (97.85%), error:       814.19800, best error:       751.20984 on epoch:    44, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 202.3282165527s, input_fired_time: 0.9224278331, output_fired_time: 0.7264199257, propagate_forward_time: 81.1664276123, propagate_backward_time: 117.8121948242, weight_update_time: 0.1019342244, other_time: 1.7007446289
epoch time: 15.4547224045s, input_fired_time: 1.1111116409, output_fired_time: 0.0000000000, propagate_forward_time: 14.0407314301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3028793335
validation[          , genome  6123] predictions:    9785/  10000 (97.85%), best:    9785/10000 (97.85%), error:       697.38812, best error:       697.38812 on epoch:    55, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 205.0036621094s, input_fired_time: 4.9477224350, output_fired_time: 0.7282313108, propagate_forward_time: 69.3983383179, propagate_backward_time: 126.1983489990, weight_update_time: 0.1019683629, other_time: 3.7310333252
epoch time: 16.4743137360s, input_fired_time: 0.1112958044, output_fired_time: 0.0000000000, propagate_forward_time: 16.0564823151, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3065357208
validation[          , genome  6123] predictions:    9722/  10000 (97.22%), best:    9785/10000 (97.85%), error:       881.55597, best error:       697.38812 on epoch:    55, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 205.4038085938s, input_fired_time: 0.9285919666, output_fired_time: 1.7335275412, propagate_forward_time: 72.7593841553, propagate_backward_time: 119.2033538818, weight_update_time: 4.1195602417, other_time: 10.7789611816
epoch time: 16.4018993378s, input_fired_time: 0.1153823584, output_fired_time: 0.0000000000, propagate_forward_time: 15.9802894592, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3062267303
validation[          , genome  6123] predictions:    9713/  10000 (97.13%), best:    9785/10000 (97.85%), error:       915.83405, best error:       697.38812 on epoch:    55, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 204.3996734619s, input_fired_time: 0.9277321100, output_fired_time: 1.7297670841, propagate_forward_time: 80.2006607056, propagate_backward_time: 116.7943038940, weight_update_time: 0.1007777303, other_time: 4.7472076416
epoch time: 15.4782304764s, input_fired_time: 0.1137859076, output_fired_time: 0.0000000000, propagate_forward_time: 13.0495834351, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3148612976
validation[          , genome  6123] predictions:    9758/  10000 (97.58%), best:    9785/10000 (97.85%), error:       847.62610, best error:       697.38812 on epoch:    55, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 203.3770446777s, input_fired_time: 2.9271910191, output_fired_time: 0.7120458484, propagate_forward_time: 70.2291946411, propagate_backward_time: 124.7671890259, weight_update_time: 0.1128652096, other_time: 4.7414169312
epoch time: 16.3846874237s, input_fired_time: 0.1092649028, output_fired_time: 0.0000000000, propagate_forward_time: 15.9684782028, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3069448471
validation[          , genome  6123] predictions:    9714/  10000 (97.14%), best:    9785/10000 (97.85%), error:       940.98163, best error:       697.38812 on epoch:    55, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 205.2115325928s, input_fired_time: 4.9542455673, output_fired_time: 4.7430791855, propagate_forward_time: 72.6035766602, propagate_backward_time: 120.1703414917, weight_update_time: 0.0993997082, other_time: 2.7403030396
epoch time: 16.5279655457s, input_fired_time: 0.1091469973, output_fired_time: 0.0000000000, propagate_forward_time: 16.1140880585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3047313690
validation[          , genome  6123] predictions:    9719/  10000 (97.19%), best:    9785/10000 (97.85%), error:       888.51056, best error:       697.38812 on epoch:    55, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 203.4926910400s, input_fired_time: 0.9277564287, output_fired_time: 0.7150714397, propagate_forward_time: 74.2502288818, propagate_backward_time: 121.8759307861, weight_update_time: 0.1045596227, other_time: 5.7237091064
epoch time: 14.4644708633s, input_fired_time: 1.1112189293, output_fired_time: 0.0000000000, propagate_forward_time: 12.0453252792, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3079271317
validation[          , genome  6123] predictions:    9756/  10000 (97.56%), best:    9785/10000 (97.85%), error:       880.01355, best error:       697.38812 on epoch:    55, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 203.3017425537s, input_fired_time: 2.9414076805, output_fired_time: 0.7170631289, propagate_forward_time: 73.1357803345, propagate_backward_time: 122.7977371216, weight_update_time: 0.1009393185, other_time: 3.7097625732
epoch time: 15.4700365067s, input_fired_time: 0.1093970239, output_fired_time: 0.0000000000, propagate_forward_time: 15.0580139160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3026256561
validation[          , genome  6123] predictions:    9780/  10000 (97.80%), best:    9785/10000 (97.85%), error:       732.96655, best error:       697.38812 on epoch:    55, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 205.6092529297s, input_fired_time: 3.9315011501, output_fired_time: 2.7249956131, propagate_forward_time: 69.3262176514, propagate_backward_time: 127.8911209106, weight_update_time: 0.1017534062, other_time: 1.7354202271
epoch time: 16.5651302338s, input_fired_time: 0.1115901545, output_fired_time: 0.0000000000, propagate_forward_time: 16.1474761963, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3060646057
validation[          , genome  6123] predictions:    9768/  10000 (97.68%), best:    9785/10000 (97.85%), error:       779.07385, best error:       697.38812 on epoch:    55, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 203.1393585205s, input_fired_time: 0.9188740849, output_fired_time: 0.7140481472, propagate_forward_time: 75.0315551758, propagate_backward_time: 122.7706909180, weight_update_time: 0.1000711545, other_time: 3.7041931152
epoch time: 15.4907464981s, input_fired_time: 0.1100379601, output_fired_time: 0.0000000000, propagate_forward_time: 15.0796642303, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3010444641
validation[          , genome  6123] predictions:    9771/  10000 (97.71%), best:    9785/10000 (97.85%), error:       761.56372, best error:       697.38812 on epoch:    55, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 204.5998535156s, input_fired_time: 0.9296797514, output_fired_time: 1.7183629274, propagate_forward_time: 81.1040496826, propagate_backward_time: 119.1293792725, weight_update_time: 0.1006373093, other_time: 1.7183837891
epoch time: 17.4755325317s, input_fired_time: 2.1149363518, output_fired_time: 0.0000000000, propagate_forward_time: 15.0541219711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3064737320
validation[          , genome  6123] predictions:    9744/  10000 (97.44%), best:    9785/10000 (97.85%), error:       808.41876, best error:       697.38812 on epoch:    55, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 202.4760894775s, input_fired_time: 2.9265470505, output_fired_time: 0.7118076682, propagate_forward_time: 75.3104629517, propagate_backward_time: 119.7981948853, weight_update_time: 0.1009432599, other_time: 3.7290802002
epoch time: 15.5250406265s, input_fired_time: 0.1129081473, output_fired_time: 0.0000000000, propagate_forward_time: 13.1020393372, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3100929260
validation[          , genome  6123] predictions:    9768/  10000 (97.68%), best:    9785/10000 (97.85%), error:       810.25745, best error:       697.38812 on epoch:    55, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 204.5863037109s, input_fired_time: 2.9248814583, output_fired_time: 2.7240555286, propagate_forward_time: 75.3674392700, propagate_backward_time: 117.9313964844, weight_update_time: 0.1003280655, other_time: 5.6385269165
epoch time: 16.4907646179s, input_fired_time: 0.1165074110, output_fired_time: 0.0000000000, propagate_forward_time: 16.0713958740, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3028621674
validation[          , genome  6123] predictions:    9723/  10000 (97.23%), best:    9785/10000 (97.85%), error:       874.83087, best error:       697.38812 on epoch:    55, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 204.0435791016s, input_fired_time: 2.9364664555, output_fired_time: 0.7317963839, propagate_forward_time: 72.3110733032, propagate_backward_time: 120.1992645264, weight_update_time: 0.0995890871, other_time: 7.8649749756
epoch time: 17.5003509521s, input_fired_time: 0.1102998853, output_fired_time: 0.0000000000, propagate_forward_time: 16.0849494934, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3051013947
validation[          , genome  6123] predictions:    9737/  10000 (97.37%), best:    9785/10000 (97.85%), error:       892.24274, best error:       697.38812 on epoch:    55, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 205.8432464600s, input_fired_time: 2.9295539856, output_fired_time: 5.7521104813, propagate_forward_time: 64.4466094971, propagate_backward_time: 123.0893936157, weight_update_time: 0.1019183099, other_time: 9.6255874634
epoch time: 16.6151618958s, input_fired_time: 0.1129561663, output_fired_time: 0.0000000000, propagate_forward_time: 16.1886425018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3135623932
validation[          , genome  6123] predictions:    9794/  10000 (97.94%), best:    9794/10000 (97.94%), error:       696.54865, best error:       696.54865 on epoch:    69, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 205.0842895508s, input_fired_time: 0.9316401482, output_fired_time: 0.7228801250, propagate_forward_time: 82.3880767822, propagate_backward_time: 117.4050521851, weight_update_time: 0.1011753008, other_time: 3.6366348267
epoch time: 16.4479179382s, input_fired_time: 0.1102941781, output_fired_time: 0.0000000000, propagate_forward_time: 16.0311031342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3065204620
validation[          , genome  6123] predictions:    9803/  10000 (98.03%), best:    9794/10000 (97.94%), error:       712.37885, best error:       696.54865 on epoch:    69, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 204.6324310303s, input_fired_time: 1.9306901693, output_fired_time: 2.7291011810, propagate_forward_time: 71.1747207642, propagate_backward_time: 121.0766067505, weight_update_time: 2.1080987453, other_time: 7.7213058472
epoch time: 16.4770622253s, input_fired_time: 0.1103823334, output_fired_time: 0.0000000000, propagate_forward_time: 16.0656452179, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3010349274
validation[          , genome  6123] predictions:    9772/  10000 (97.72%), best:    9794/10000 (97.94%), error:       765.20892, best error:       696.54865 on epoch:    69, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 215.9601440430s, input_fired_time: 2.9965429306, output_fired_time: 0.7871142030, propagate_forward_time: 86.6508102417, propagate_backward_time: 122.7513351440, weight_update_time: 0.1049219146, other_time: 2.7743530273
epoch time: 34.7589874268s, input_fired_time: 0.1500492245, output_fired_time: 0.0000000000, propagate_forward_time: 34.0974311829, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5115051270
validation[          , genome  6123] predictions:    9761/  10000 (97.61%), best:    9794/10000 (97.94%), error:       795.16754, best error:       696.54865 on epoch:    69, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 227.2395172119s, input_fired_time: 3.0518848896, output_fired_time: 4.7248196602, propagate_forward_time: 86.7735824585, propagate_backward_time: 124.8303909302, weight_update_time: 0.1068867072, other_time: 7.8588485718
epoch time: 17.5601253510s, input_fired_time: 0.1123784184, output_fired_time: 0.0000000000, propagate_forward_time: 17.1395168304, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3082294464
validation[          , genome  6123] predictions:    9773/  10000 (97.73%), best:    9794/10000 (97.94%), error:       812.73175, best error:       696.54865 on epoch:    69, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 207.6605224609s, input_fired_time: 1.9645792246, output_fired_time: 1.7456853390, propagate_forward_time: 75.1958465576, propagate_backward_time: 124.8283691406, weight_update_time: 0.1035350338, other_time: 3.9260406494
epoch time: 15.5157861710s, input_fired_time: 2.1155538559, output_fired_time: 0.0000000000, propagate_forward_time: 12.0939130783, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3063192368
validation[          , genome  6123] predictions:    9771/  10000 (97.71%), best:    9794/10000 (97.94%), error:       774.38861, best error:       696.54865 on epoch:    69, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 207.7016296387s, input_fired_time: 1.9470182657, output_fired_time: 0.7246947885, propagate_forward_time: 86.9430999756, propagate_backward_time: 115.3360061646, weight_update_time: 0.1015884727, other_time: 2.7508010864
epoch time: 15.4790077209s, input_fired_time: 0.1119258329, output_fired_time: 0.0000000000, propagate_forward_time: 15.0550136566, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3120679855
validation[          , genome  6123] predictions:    9776/  10000 (97.76%), best:    9794/10000 (97.94%), error:       743.69116, best error:       696.54865 on epoch:    69, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 207.9007568359s, input_fired_time: 1.9505580664, output_fired_time: 0.7304439545, propagate_forward_time: 75.8463287354, propagate_backward_time: 124.6169891357, weight_update_time: 0.1059227884, other_time: 4.7564392090
epoch time: 15.5653734207s, input_fired_time: 0.1100293472, output_fired_time: 0.0000000000, propagate_forward_time: 14.1438055038, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3115386963
validation[          , genome  6123] predictions:    9764/  10000 (97.64%), best:    9794/10000 (97.94%), error:       808.37122, best error:       696.54865 on epoch:    69, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 207.1300201416s, input_fired_time: 1.9449616671, output_fired_time: 2.7301709652, propagate_forward_time: 74.9415664673, propagate_backward_time: 120.7600479126, weight_update_time: 0.1030781344, other_time: 6.7532806396
epoch time: 15.5292434692s, input_fired_time: 0.1093006581, output_fired_time: 0.0000000000, propagate_forward_time: 14.1081714630, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3117713928
validation[          , genome  6123] predictions:    9773/  10000 (97.73%), best:    9794/10000 (97.94%), error:       733.10272, best error:       696.54865 on epoch:    69, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 205.5818786621s, input_fired_time: 1.9480546713, output_fired_time: 0.7267091870, propagate_forward_time: 70.6006622314, propagate_backward_time: 126.5662002563, weight_update_time: 0.1011905447, other_time: 5.7402420044
epoch time: 15.4439125061s, input_fired_time: 0.1103263721, output_fired_time: 0.0000000000, propagate_forward_time: 15.0238513947, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3097343445
validation[          , genome  6123] predictions:    9796/  10000 (97.96%), best:    9794/10000 (97.94%), error:       712.90363, best error:       696.54865 on epoch:    69, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 206.5531768799s, input_fired_time: 2.9453878403, output_fired_time: 1.7312417030, propagate_forward_time: 69.4275283813, propagate_backward_time: 128.7144317627, weight_update_time: 0.0998344049, other_time: 3.7345733643
epoch time: 17.5527648926s, input_fired_time: 0.1109544635, output_fired_time: 0.0000000000, propagate_forward_time: 17.1325740814, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3092365265
validation[          , genome  6123] predictions:    9752/  10000 (97.52%), best:    9794/10000 (97.94%), error:       796.02869, best error:       696.54865 on epoch:    69, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 207.6752319336s, input_fired_time: 2.9581003189, output_fired_time: 0.7549800873, propagate_forward_time: 69.4887771606, propagate_backward_time: 125.7299118042, weight_update_time: 0.1018577665, other_time: 8.7434768677
epoch time: 15.4573354721s, input_fired_time: 0.1094695106, output_fired_time: 0.0000000000, propagate_forward_time: 15.0382251740, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3096408844
validation[          , genome  6123] predictions:    9759/  10000 (97.59%), best:    9794/10000 (97.94%), error:       782.82635, best error:       696.54865 on epoch:    69, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 207.3557586670s, input_fired_time: 0.9482998848, output_fired_time: 0.7338703275, propagate_forward_time: 70.6196899414, propagate_backward_time: 132.3049316406, weight_update_time: 0.1009283140, other_time: 2.7489624023
epoch time: 17.7489204407s, input_fired_time: 0.1143189520, output_fired_time: 0.0000000000, propagate_forward_time: 16.3096199036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3249816895
validation[          , genome  6123] predictions:    9792/  10000 (97.92%), best:    9794/10000 (97.94%), error:       713.56677, best error:       696.54865 on epoch:    69, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 207.8488159180s, input_fired_time: 0.9628169537, output_fired_time: 4.7260107994, propagate_forward_time: 69.6850967407, propagate_backward_time: 128.8171691895, weight_update_time: 0.1034466252, other_time: 3.6577148438
epoch time: 16.6269092560s, input_fired_time: 0.1124645025, output_fired_time: 0.0000000000, propagate_forward_time: 16.2009944916, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3134498596
validation[          , genome  6123] predictions:    9767/  10000 (97.67%), best:    9794/10000 (97.94%), error:       833.22229, best error:       696.54865 on epoch:    69, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 206.6374359131s, input_fired_time: 0.9551395178, output_fired_time: 2.7345354557, propagate_forward_time: 79.6655349731, propagate_backward_time: 119.6506729126, weight_update_time: 0.1021967903, other_time: 3.6315460205
epoch time: 17.5910587311s, input_fired_time: 0.1115239114, output_fired_time: 0.0000000000, propagate_forward_time: 17.1705474854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3089866638
validation[          , genome  6123] predictions:    9766/  10000 (97.66%), best:    9794/10000 (97.94%), error:       818.21875, best error:       696.54865 on epoch:    69, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 207.8403778076s, input_fired_time: 0.9479166865, output_fired_time: 3.7404696941, propagate_forward_time: 74.8314132690, propagate_backward_time: 119.5636749268, weight_update_time: 2.1072216034, other_time: 8.7569122314
epoch time: 17.2624015808s, input_fired_time: 0.1240313500, output_fired_time: 0.0000000000, propagate_forward_time: 16.8077163696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3306541443
validation[          , genome  6123] predictions:    9782/  10000 (97.82%), best:    9794/10000 (97.94%), error:       736.94049, best error:       696.54865 on epoch:    69, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 206.9292755127s, input_fired_time: 2.9594876766, output_fired_time: 0.7309902310, propagate_forward_time: 78.9162597656, propagate_backward_time: 121.5738296509, weight_update_time: 0.1012799069, other_time: 2.7487106323
epoch time: 15.5693655014s, input_fired_time: 0.1135852784, output_fired_time: 0.0000000000, propagate_forward_time: 15.1446418762, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3111381531
validation[          , genome  6123] predictions:    9779/  10000 (97.79%), best:    9794/10000 (97.94%), error:       728.62750, best error:       696.54865 on epoch:    69, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 209.1699981689s, input_fired_time: 2.9580876827, output_fired_time: 1.7388443947, propagate_forward_time: 74.8980712891, propagate_backward_time: 122.9097442627, weight_update_time: 0.0996761620, other_time: 6.6652526855
epoch time: 17.6794986725s, input_fired_time: 0.1326743662, output_fired_time: 0.0000000000, propagate_forward_time: 17.2233657837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3234577179
validation[          , genome  6123] predictions:    9684/  10000 (96.84%), best:    9794/10000 (97.94%), error:      1047.84021, best error:       696.54865 on epoch:    69, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 207.8629150391s, input_fired_time: 0.9642051458, output_fired_time: 0.7241008282, propagate_forward_time: 82.8086090088, propagate_backward_time: 121.6268310547, weight_update_time: 0.1027238667, other_time: 1.7391662598
epoch time: 16.5693359375s, input_fired_time: 2.1202418804, output_fired_time: 0.0000000000, propagate_forward_time: 14.1400060654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3090877533
validation[          , genome  6123] predictions:    9784/  10000 (97.84%), best:    9794/10000 (97.94%), error:       769.14752, best error:       696.54865 on epoch:    69, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 206.9760284424s, input_fired_time: 5.9616451263, output_fired_time: 0.7284544706, propagate_forward_time: 77.7612228394, propagate_backward_time: 117.7719955444, weight_update_time: 0.1040177792, other_time: 4.7527160645
epoch time: 18.2657146454s, input_fired_time: 0.1269320399, output_fired_time: 0.0000000000, propagate_forward_time: 14.7893352509, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3494472504
validation[          , genome  6123] predictions:    9750/  10000 (97.50%), best:    9794/10000 (97.94%), error:       822.51648, best error:       696.54865 on epoch:    69, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 207.3759307861s, input_fired_time: 2.9584062099, output_fired_time: 1.7259480953, propagate_forward_time: 82.7843704224, propagate_backward_time: 118.1708679199, weight_update_time: 0.1014607102, other_time: 1.7363357544
epoch time: 16.5946006775s, input_fired_time: 0.1120423600, output_fired_time: 0.0000000000, propagate_forward_time: 16.1666812897, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3158779144
validation[          , genome  6123] predictions:    9781/  10000 (97.81%), best:    9794/10000 (97.94%), error:       746.64661, best error:       696.54865 on epoch:    69, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 206.5878143311s, input_fired_time: 0.9400697947, output_fired_time: 1.7341729403, propagate_forward_time: 89.2775497437, propagate_backward_time: 111.8893508911, weight_update_time: 0.1036298051, other_time: 2.7466735840
epoch time: 17.5694789886s, input_fired_time: 1.1180144548, output_fired_time: 0.0000000000, propagate_forward_time: 16.1471996307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3042640686
validation[          , genome  6123] predictions:    9785/  10000 (97.85%), best:    9794/10000 (97.94%), error:       712.35968, best error:       696.54865 on epoch:    69, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 205.6688232422s, input_fired_time: 0.9507942200, output_fired_time: 0.7239008546, propagate_forward_time: 91.5903930664, propagate_backward_time: 107.6664505005, weight_update_time: 2.1091480255, other_time: 4.7372817993
epoch time: 15.4677925110s, input_fired_time: 0.1118625775, output_fired_time: 0.0000000000, propagate_forward_time: 15.0520849228, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3038454056
validation[          , genome  6123] predictions:    9772/  10000 (97.72%), best:    9794/10000 (97.94%), error:       729.23975, best error:       696.54865 on epoch:    69, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 212.1869812012s, input_fired_time: 3.0075256824, output_fired_time: 0.7230585814, propagate_forward_time: 79.3823776245, propagate_backward_time: 127.2755813599, weight_update_time: 0.1078232601, other_time: 1.7984542847
epoch time: 26.2196884155s, input_fired_time: 2.1405429840, output_fired_time: 0.0000000000, propagate_forward_time: 23.7286243439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3505210876
validation[          , genome  6123] predictions:    9794/  10000 (97.94%), best:    9794/10000 (97.94%), error:       667.44476, best error:       667.44476 on epoch:    92, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 259.3043518066s, input_fired_time: 3.1321969032, output_fired_time: 1.9343492985, propagate_forward_time: 86.1012573242, propagate_backward_time: 159.9454040527, weight_update_time: 0.1205767319, other_time: 8.1911315918
epoch time: 26.8019409180s, input_fired_time: 0.1478146464, output_fired_time: 0.0000000000, propagate_forward_time: 25.0924739838, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5616531372
validation[          , genome  6123] predictions:    9795/  10000 (97.95%), best:    9794/10000 (97.94%), error:       697.56384, best error:       667.44476 on epoch:    92, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 237.9750823975s, input_fired_time: 2.0648713112, output_fired_time: 0.8122681975, propagate_forward_time: 73.8758468628, propagate_backward_time: 155.1819152832, weight_update_time: 0.1229263097, other_time: 6.0401916504
epoch time: 17.1008281708s, input_fired_time: 0.1279593855, output_fired_time: 0.0000000000, propagate_forward_time: 15.6269731522, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3458948135
validation[          , genome  6123] predictions:    9774/  10000 (97.74%), best:    9794/10000 (97.94%), error:       768.59802, best error:       667.44476 on epoch:    92, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 259.5975341797s, input_fired_time: 1.1609525681, output_fired_time: 2.8108959198, propagate_forward_time: 82.3994522095, propagate_backward_time: 168.0496826172, weight_update_time: 0.1132073924, other_time: 5.1765441895
epoch time: 20.4337024689s, input_fired_time: 0.1371645927, output_fired_time: 0.0000000000, propagate_forward_time: 19.8759346008, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4206027985
validation[          , genome  6123] predictions:    9773/  10000 (97.73%), best:    9794/10000 (97.94%), error:       719.44360, best error:       667.44476 on epoch:    92, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 279.4127807617s, input_fired_time: 3.0814068317, output_fired_time: 0.9001027942, propagate_forward_time: 99.9436721802, propagate_backward_time: 168.1724395752, weight_update_time: 0.1675849557, other_time: 7.3151397705
epoch time: 16.9109134674s, input_fired_time: 0.1219732985, output_fired_time: 0.0000000000, propagate_forward_time: 16.4645900726, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3243503571
validation[          , genome  6123] predictions:    9792/  10000 (97.92%), best:    9794/10000 (97.94%), error:       699.32574, best error:       667.44476 on epoch:    92, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 277.2779541016s, input_fired_time: 5.1172060966, output_fired_time: 1.9930136204, propagate_forward_time: 102.8548431396, propagate_backward_time: 165.1478271484, weight_update_time: 0.1184220165, other_time: 2.1650543213
epoch time: 24.7239112854s, input_fired_time: 1.1769667864, output_fired_time: 0.0000000000, propagate_forward_time: 21.0790920258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4678516388
validation[          , genome  6123] predictions:    9784/  10000 (97.84%), best:    9794/10000 (97.94%), error:       697.85229, best error:       667.44476 on epoch:    92, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 322.7870483398s, input_fired_time: 3.4173197746, output_fired_time: 4.0906567574, propagate_forward_time: 117.2173767090, propagate_backward_time: 188.3047180176, weight_update_time: 0.1403363496, other_time: 9.7569580078
epoch time: 24.8342838287s, input_fired_time: 0.1866209805, output_fired_time: 0.0000000000, propagate_forward_time: 23.1492118835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4984512329
validation[          , genome  6123] predictions:    9750/  10000 (97.50%), best:    9794/10000 (97.94%), error:       821.25659, best error:       667.44476 on epoch:    92, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 336.6531677246s, input_fired_time: 2.3824298382, output_fired_time: 6.0967378616, propagate_forward_time: 137.4255676270, propagate_backward_time: 180.9923400879, weight_update_time: 0.1607491821, other_time: 9.7561035156
epoch time: 23.5983428955s, input_fired_time: 1.1662302017, output_fired_time: 0.0000000000, propagate_forward_time: 21.9211711884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5109424591
validation[          , genome  6123] predictions:    9797/  10000 (97.97%), best:    9794/10000 (97.94%), error:       710.68475, best error:       667.44476 on epoch:    92, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 321.6734924316s, input_fired_time: 1.4708559513, output_fired_time: 1.0548601151, propagate_forward_time: 139.5728607178, propagate_backward_time: 174.5353088379, weight_update_time: 1.3537086248, other_time: 5.0395965576
epoch time: 23.1493930817s, input_fired_time: 0.1725500971, output_fired_time: 0.0000000000, propagate_forward_time: 20.4959812164, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4808616638
validation[          , genome  6123] predictions:    9778/  10000 (97.78%), best:    9794/10000 (97.94%), error:       750.29688, best error:       667.44476 on epoch:    92, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 117.8705596924s, input_fired_time: 1.8642772436, output_fired_time: 0.0000000000, propagate_forward_time: 113.4604721069, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5458068848
best training[          , genome  6123] predictions:   49828/  50000 (99.66%), best:    9794/10000 (97.94%), error:       939.66583, best error:       667.44476 on epoch:    92, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 22.7336959839s, input_fired_time: 0.1539473683, output_fired_time: 0.0000000000, propagate_forward_time: 20.0733203888, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5064277649
   testing[          , genome  6123] predictions:    9814/  10000 (98.14%), best:    9794/10000 (97.94%), error:       634.55957, best error:       667.44476 on epoch:    92, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
09:38:20 (10340): called boinc_finish(0)

</stderr_txt>
]]>