Nameexact_genome_1512568488_44_6198_0
Workunit2602286
Created7 Dec 2017, 18:31:07 UTC
Sent7 Dec 2017, 18:39:18 UTC
Report deadline17 Dec 2017, 13:17:25 UTC
Received8 Dec 2017, 12:33:01 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time5 hours 23 min 54 sec
CPU time5 hours 16 min 32 sec
Validate stateValid
Credit2,444.12
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size156.47 MB
Peak swap size159.74 MB
Peak disk usage2.13 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
863.40210 on epoch:    11, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 181.0150451660s, input_fired_time: 2.4667439461, output_fired_time: 2.2355194092, propagate_forward_time: 65.0424880981, propagate_backward_time: 107.1682739258, weight_update_time: 0.1943233758, other_time: 4.1020126343
epoch time: 15.0800867081s, input_fired_time: 0.3160749674, output_fired_time: 0.0000000000, propagate_forward_time: 14.0292921066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7347192764
validation[          , genome  6198] predictions:    9749/  10000 (97.49%), best:    9749/10000 (97.49%), error:       806.07410, best error:       806.07410 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 186.6824340820s, input_fired_time: 2.5340948105, output_fired_time: 2.3167548180, propagate_forward_time: 69.9007186890, propagate_backward_time: 107.7604980469, weight_update_time: 0.2014999092, other_time: 4.1703720093
epoch time: 16.9787921906s, input_fired_time: 0.3387676775, output_fired_time: 0.0000000000, propagate_forward_time: 15.7531404495, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8868837357
validation[          , genome  6198] predictions:    9765/  10000 (97.65%), best:    9749/10000 (97.49%), error:       843.69135, best error:       806.07410 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 182.7383422852s, input_fired_time: 2.4749553204, output_fired_time: 2.2847754955, propagate_forward_time: 67.7745819092, propagate_backward_time: 106.1492614746, weight_update_time: 0.1937237382, other_time: 4.0547637939
epoch time: 14.7995262146s, input_fired_time: 0.3110800385, output_fired_time: 0.0000000000, propagate_forward_time: 13.7702198029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7182264328
validation[          , genome  6198] predictions:    9737/  10000 (97.37%), best:    9749/10000 (97.49%), error:       854.92456, best error:       806.07410 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 196.9408569336s, input_fired_time: 2.6279487610, output_fired_time: 2.5492291451, propagate_forward_time: 73.7415313721, propagate_backward_time: 112.6224441528, weight_update_time: 0.2096317261, other_time: 5.3997116089
epoch time: 15.1300039291s, input_fired_time: 0.3148024380, output_fired_time: 0.0000000000, propagate_forward_time: 14.0797290802, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7354726791
validation[          , genome  6198] predictions:    9730/  10000 (97.30%), best:    9749/10000 (97.49%), error:       859.63556, best error:       806.07410 on epoch:    15, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 183.5583190918s, input_fired_time: 2.5605456829, output_fired_time: 2.2774686813, propagate_forward_time: 64.9756393433, propagate_backward_time: 109.6831054688, weight_update_time: 0.1945892870, other_time: 4.0615615845
epoch time: 15.0368232727s, input_fired_time: 0.3107613921, output_fired_time: 0.0000000000, propagate_forward_time: 14.0013561249, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7247056961
validation[          , genome  6198] predictions:    9687/  10000 (96.87%), best:    9749/10000 (97.49%), error:       991.78876, best error:       806.07410 on epoch:    15, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 182.3857269287s, input_fired_time: 3.5200719833, output_fired_time: 2.2566208839, propagate_forward_time: 68.5479812622, propagate_backward_time: 103.9696655273, weight_update_time: 0.1931206137, other_time: 4.0913925171
epoch time: 13.6663274765s, input_fired_time: 0.3076650202, output_fired_time: 0.0000000000, propagate_forward_time: 12.6354970932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7231655121
validation[          , genome  6198] predictions:    9757/  10000 (97.57%), best:    9757/10000 (97.57%), error:       800.06519, best error:       800.06519 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 183.7702636719s, input_fired_time: 2.4857301712, output_fired_time: 2.2690565586, propagate_forward_time: 67.5913467407, propagate_backward_time: 107.3050765991, weight_update_time: 0.1945735514, other_time: 4.1190490723
epoch time: 13.9268083572s, input_fired_time: 0.3126718104, output_fired_time: 0.0000000000, propagate_forward_time: 12.8703222275, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7438144684
validation[          , genome  6198] predictions:    9741/  10000 (97.41%), best:    9757/10000 (97.57%), error:       838.18018, best error:       800.06519 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 185.1945190430s, input_fired_time: 2.4876830578, output_fired_time: 2.2947034836, propagate_forward_time: 69.1818771362, propagate_backward_time: 107.1543350220, weight_update_time: 0.1933909506, other_time: 4.0759124756
epoch time: 13.6995334625s, input_fired_time: 0.3081381023, output_fired_time: 0.0000000000, propagate_forward_time: 12.6607751846, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7306203842
validation[          , genome  6198] predictions:    9768/  10000 (97.68%), best:    9768/10000 (97.68%), error:       789.35480, best error:       789.35480 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 195.7369079590s, input_fired_time: 3.6853239536, output_fired_time: 2.3564238548, propagate_forward_time: 73.8976821899, propagate_backward_time: 111.2912673950, weight_update_time: 0.2117975056, other_time: 4.5062103271
epoch time: 15.1399221420s, input_fired_time: 0.3203120530, output_fired_time: 0.0000000000, propagate_forward_time: 13.0678358078, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7517738342
validation[          , genome  6198] predictions:    9727/  10000 (97.27%), best:    9768/10000 (97.68%), error:       847.06238, best error:       789.35480 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 196.1997985840s, input_fired_time: 2.6547284126, output_fired_time: 2.4341747761, propagate_forward_time: 69.8612060547, propagate_backward_time: 116.7821273804, weight_update_time: 0.2028891146, other_time: 4.4675674438
epoch time: 13.6223258972s, input_fired_time: 0.3075434268, output_fired_time: 0.0000000000, propagate_forward_time: 12.5814647675, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7333173752
validation[          , genome  6198] predictions:    9723/  10000 (97.23%), best:    9768/10000 (97.68%), error:       885.10474, best error:       789.35480 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 184.0212707520s, input_fired_time: 2.5072627068, output_fired_time: 2.2606019974, propagate_forward_time: 68.8398132324, propagate_backward_time: 104.3687820435, weight_update_time: 0.1942217946, other_time: 6.0448074341
epoch time: 13.9903841019s, input_fired_time: 0.3791735470, output_fired_time: 0.0000000000, propagate_forward_time: 12.8735952377, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7376155853
validation[          , genome  6198] predictions:    9766/  10000 (97.66%), best:    9766/10000 (97.66%), error:       758.62274, best error:       758.62274 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 182.4116668701s, input_fired_time: 2.4863274097, output_fired_time: 2.2716569901, propagate_forward_time: 71.4206314087, propagate_backward_time: 102.1304397583, weight_update_time: 0.2144307196, other_time: 4.1026153564
epoch time: 14.8565769196s, input_fired_time: 0.3151885867, output_fired_time: 0.0000000000, propagate_forward_time: 13.8088960648, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7324924469
validation[          , genome  6198] predictions:    9742/  10000 (97.42%), best:    9766/10000 (97.66%), error:       848.25470, best error:       758.62274 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 182.7373962402s, input_fired_time: 3.4973552227, output_fired_time: 2.2593755722, propagate_forward_time: 66.5537414551, propagate_backward_time: 105.3047943115, weight_update_time: 0.1940247566, other_time: 5.1221313477
epoch time: 15.4714994431s, input_fired_time: 0.3230541050, output_fired_time: 0.0000000000, propagate_forward_time: 14.3807325363, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7677125931
validation[          , genome  6198] predictions:    9760/  10000 (97.60%), best:    9766/10000 (97.66%), error:       813.68335, best error:       758.62274 on epoch:    25, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 188.6528320313s, input_fired_time: 4.6177353859, output_fired_time: 2.3209078312, propagate_forward_time: 69.2574462891, propagate_backward_time: 107.1669921875, weight_update_time: 0.2071723640, other_time: 5.2897491455
epoch time: 13.7236623764s, input_fired_time: 0.3107575774, output_fired_time: 0.0000000000, propagate_forward_time: 12.6928720474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7200326920
validation[          , genome  6198] predictions:    9764/  10000 (97.64%), best:    9766/10000 (97.66%), error:       772.43030, best error:       758.62274 on epoch:    25, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 181.2349090576s, input_fired_time: 2.4824421406, output_fired_time: 2.2391645908, propagate_forward_time: 67.3237304688, propagate_backward_time: 104.7866592407, weight_update_time: 0.1937667578, other_time: 4.4029159546
epoch time: 15.0515127182s, input_fired_time: 0.3173926175, output_fired_time: 0.0000000000, propagate_forward_time: 13.9996557236, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7344646454
validation[          , genome  6198] predictions:    9764/  10000 (97.64%), best:    9766/10000 (97.66%), error:       778.93292, best error:       758.62274 on epoch:    25, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 181.2502136230s, input_fired_time: 2.4863820076, output_fired_time: 2.2617409229, propagate_forward_time: 70.9593734741, propagate_backward_time: 101.4495162964, weight_update_time: 0.1930742413, other_time: 4.0932006836
epoch time: 14.9465751648s, input_fired_time: 0.3176594377, output_fired_time: 0.0000000000, propagate_forward_time: 13.8957195282, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7331962585
validation[          , genome  6198] predictions:    9769/  10000 (97.69%), best:    9769/10000 (97.69%), error:       734.10822, best error:       734.10822 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 193.1654510498s, input_fired_time: 2.6143665314, output_fired_time: 2.3208589554, propagate_forward_time: 71.9751739502, propagate_backward_time: 111.9581451416, weight_update_time: 0.1957385689, other_time: 4.2969055176
epoch time: 13.7219343185s, input_fired_time: 0.3124293685, output_fired_time: 0.0000000000, propagate_forward_time: 12.6857690811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7237358093
validation[          , genome  6198] predictions:    9709/  10000 (97.09%), best:    9769/10000 (97.69%), error:       919.10315, best error:       734.10822 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 187.4761657715s, input_fired_time: 2.5339255333, output_fired_time: 2.3059935570, propagate_forward_time: 73.3608551025, propagate_backward_time: 105.1775360107, weight_update_time: 0.1947681010, other_time: 4.0978546143
epoch time: 14.4000225067s, input_fired_time: 0.3212254345, output_fired_time: 0.0000000000, propagate_forward_time: 13.3348064423, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7439908981
validation[          , genome  6198] predictions:    9757/  10000 (97.57%), best:    9769/10000 (97.69%), error:       784.40839, best error:       734.10822 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 184.3705596924s, input_fired_time: 2.5419406891, output_fired_time: 2.2878921032, propagate_forward_time: 68.7462387085, propagate_backward_time: 106.7022552490, weight_update_time: 0.1950612962, other_time: 4.0922317505
epoch time: 13.7112874985s, input_fired_time: 0.3097845018, output_fired_time: 0.0000000000, propagate_forward_time: 12.6846323013, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7168703079
validation[          , genome  6198] predictions:    9775/  10000 (97.75%), best:    9769/10000 (97.69%), error:       785.93457, best error:       734.10822 on epoch:    30, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 186.0533752441s, input_fired_time: 2.5580885410, output_fired_time: 2.3136262894, propagate_forward_time: 69.5649871826, propagate_backward_time: 107.4325942993, weight_update_time: 0.2032037228, other_time: 4.1840744019
epoch time: 13.9107131958s, input_fired_time: 0.3116210699, output_fired_time: 0.0000000000, propagate_forward_time: 12.8830385208, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7160539627
validation[          , genome  6198] predictions:    9749/  10000 (97.49%), best:    9769/10000 (97.69%), error:       856.38416, best error:       734.10822 on epoch:    30, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 185.7453613281s, input_fired_time: 2.5206043720, output_fired_time: 2.2558205128, propagate_forward_time: 67.6583023071, propagate_backward_time: 109.1789855957, weight_update_time: 0.1951561272, other_time: 4.1316604614
epoch time: 13.7999420166s, input_fired_time: 0.3113278151, output_fired_time: 0.0000000000, propagate_forward_time: 12.7693805695, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7192335129
validation[          , genome  6198] predictions:    9743/  10000 (97.43%), best:    9769/10000 (97.69%), error:       839.25421, best error:       734.10822 on epoch:    30, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 192.4807739258s, input_fired_time: 3.6001579762, output_fired_time: 2.3806948662, propagate_forward_time: 72.1569442749, propagate_backward_time: 109.9146499634, weight_update_time: 0.2044884712, other_time: 4.4283294678
epoch time: 15.0719442368s, input_fired_time: 0.3146665692, output_fired_time: 0.0000000000, propagate_forward_time: 14.0316858292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7255916595
validation[          , genome  6198] predictions:    9758/  10000 (97.58%), best:    9769/10000 (97.69%), error:       814.92426, best error:       734.10822 on epoch:    30, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 183.2961273193s, input_fired_time: 2.5054013729, output_fired_time: 3.1788022518, propagate_forward_time: 66.9390106201, propagate_backward_time: 104.5707855225, weight_update_time: 0.1933654994, other_time: 6.1021270752
epoch time: 15.0955924988s, input_fired_time: 0.3156762421, output_fired_time: 0.0000000000, propagate_forward_time: 14.0267915726, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7531242371
validation[          , genome  6198] predictions:    9710/  10000 (97.10%), best:    9769/10000 (97.69%), error:       929.01813, best error:       734.10822 on epoch:    30, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 183.0665588379s, input_fired_time: 2.5018358231, output_fired_time: 2.2888486385, propagate_forward_time: 69.8247985840, propagate_backward_time: 104.3674392700, weight_update_time: 0.2074058205, other_time: 4.0836410522
epoch time: 15.0000114441s, input_fired_time: 0.3173461258, output_fired_time: 0.0000000000, propagate_forward_time: 13.9372491837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7454156876
validation[          , genome  6198] predictions:    9774/  10000 (97.74%), best:    9769/10000 (97.69%), error:       752.29285, best error:       734.10822 on epoch:    30, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 182.5475616455s, input_fired_time: 2.5049116611, output_fired_time: 2.2515318394, propagate_forward_time: 67.4929428101, propagate_backward_time: 106.1836547852, weight_update_time: 0.1942504793, other_time: 4.1145248413
epoch time: 14.7657890320s, input_fired_time: 0.3147217631, output_fired_time: 0.0000000000, propagate_forward_time: 13.7300777435, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7209892273
validation[          , genome  6198] predictions:    9764/  10000 (97.64%), best:    9769/10000 (97.69%), error:       802.46588, best error:       734.10822 on epoch:    30, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 182.6419677734s, input_fired_time: 3.5134956837, output_fired_time: 2.2548255920, propagate_forward_time: 66.5026168823, propagate_backward_time: 106.2684020996, weight_update_time: 0.1935809702, other_time: 4.1026382446
epoch time: 13.5024452209s, input_fired_time: 0.3081684709, output_fired_time: 0.0000000000, propagate_forward_time: 12.4745922089, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7196846008
validation[          , genome  6198] predictions:    9796/  10000 (97.96%), best:    9796/10000 (97.96%), error:       693.45605, best error:       693.45605 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 185.4429016113s, input_fired_time: 2.5409622192, output_fired_time: 3.3204014301, propagate_forward_time: 67.9269485474, propagate_backward_time: 107.4498138428, weight_update_time: 0.1953578442, other_time: 4.2047805786
epoch time: 13.7284088135s, input_fired_time: 0.3175421059, output_fired_time: 0.0000000000, propagate_forward_time: 12.6839227676, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7269439697
validation[          , genome  6198] predictions:    9746/  10000 (97.46%), best:    9796/10000 (97.96%), error:       866.50195, best error:       693.45605 on epoch:    40, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 183.9253234863s, input_fired_time: 2.5040371418, output_fired_time: 3.2631139755, propagate_forward_time: 68.6076812744, propagate_backward_time: 105.4681625366, weight_update_time: 0.1941714585, other_time: 4.0823287964
epoch time: 13.9583988190s, input_fired_time: 0.3268234730, output_fired_time: 0.0000000000, propagate_forward_time: 12.8947353363, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7368402481
validation[          , genome  6198] predictions:    9763/  10000 (97.63%), best:    9796/10000 (97.96%), error:       760.92548, best error:       693.45605 on epoch:    40, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 181.5877227783s, input_fired_time: 2.5223343372, output_fired_time: 2.2466471195, propagate_forward_time: 66.2615356445, propagate_backward_time: 106.4407501221, weight_update_time: 0.1945154816, other_time: 4.1164550781
epoch time: 14.9165420532s, input_fired_time: 0.3197413087, output_fired_time: 0.0000000000, propagate_forward_time: 13.8662357330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7305650711
validation[          , genome  6198] predictions:    9755/  10000 (97.55%), best:    9796/10000 (97.96%), error:       783.12128, best error:       693.45605 on epoch:    40, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 183.2754974365s, input_fired_time: 2.5095343590, output_fired_time: 2.2566294670, propagate_forward_time: 67.9173965454, propagate_backward_time: 106.4454727173, weight_update_time: 0.1950780451, other_time: 4.1464691162
epoch time: 15.1867742538s, input_fired_time: 0.3205220997, output_fired_time: 0.0000000000, propagate_forward_time: 14.1267795563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7394723892
validation[          , genome  6198] predictions:    9781/  10000 (97.81%), best:    9796/10000 (97.96%), error:       737.69470, best error:       693.45605 on epoch:    40, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 184.6692352295s, input_fired_time: 2.5575370789, output_fired_time: 2.2932827473, propagate_forward_time: 70.6979446411, propagate_backward_time: 105.0165863037, weight_update_time: 0.1938844323, other_time: 4.1038742065
epoch time: 14.9542522430s, input_fired_time: 0.3167870939, output_fired_time: 0.0000000000, propagate_forward_time: 12.9004507065, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7370147705
validation[          , genome  6198] predictions:    9734/  10000 (97.34%), best:    9796/10000 (97.96%), error:       821.71545, best error:       693.45605 on epoch:    40, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 182.9552459717s, input_fired_time: 2.5169076920, output_fired_time: 2.2717435360, propagate_forward_time: 66.6366806030, propagate_backward_time: 107.4631958008, weight_update_time: 0.1951199919, other_time: 4.0667190552
epoch time: 20.2869739532s, input_fired_time: 0.4648241997, output_fired_time: 0.0000000000, propagate_forward_time: 18.7379837036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0841655731
validation[          , genome  6198] predictions:    9753/  10000 (97.53%), best:    9796/10000 (97.96%), error:       815.49353, best error:       693.45605 on epoch:    40, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 183.5293579102s, input_fired_time: 2.5198223591, output_fired_time: 3.3110034466, propagate_forward_time: 67.9243698120, propagate_backward_time: 105.6886367798, weight_update_time: 0.1939801723, other_time: 4.0855255127
epoch time: 15.0745210648s, input_fired_time: 0.3177048862, output_fired_time: 0.0000000000, propagate_forward_time: 14.0281534195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7286624908
validation[          , genome  6198] predictions:    9745/  10000 (97.45%), best:    9796/10000 (97.96%), error:       843.51025, best error:       693.45605 on epoch:    40, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 185.0711212158s, input_fired_time: 2.5299906731, output_fired_time: 2.3053598404, propagate_forward_time: 66.7508163452, propagate_backward_time: 109.3828582764, weight_update_time: 0.1949293464, other_time: 4.1021041870
epoch time: 17.4200668335s, input_fired_time: 0.4057514668, output_fired_time: 0.0000000000, propagate_forward_time: 16.1486454010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8656692505
validation[          , genome  6198] predictions:    9801/  10000 (98.01%), best:    9796/10000 (97.96%), error:       694.85089, best error:       693.45605 on epoch:    40, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 184.9713287354s, input_fired_time: 2.5194420815, output_fired_time: 2.2741270065, propagate_forward_time: 68.9106903076, propagate_backward_time: 107.1152954102, weight_update_time: 0.1947778463, other_time: 4.1517791748
epoch time: 14.4866409302s, input_fired_time: 0.3181387782, output_fired_time: 0.0000000000, propagate_forward_time: 13.4276399612, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7408618927
validation[          , genome  6198] predictions:    9739/  10000 (97.39%), best:    9796/10000 (97.96%), error:       852.04669, best error:       693.45605 on epoch:    40, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 183.3474578857s, input_fired_time: 2.4998502731, output_fired_time: 2.2531840801, propagate_forward_time: 67.3410568237, propagate_backward_time: 107.1636276245, weight_update_time: 0.1937935352, other_time: 4.0897369385
epoch time: 13.6683654785s, input_fired_time: 0.3105312586, output_fired_time: 0.0000000000, propagate_forward_time: 12.6422672272, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7155666351
validation[          , genome  6198] predictions:    9739/  10000 (97.39%), best:    9796/10000 (97.96%), error:       787.14691, best error:       693.45605 on epoch:    40, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 188.6651458740s, input_fired_time: 2.5573077202, output_fired_time: 2.2988424301, propagate_forward_time: 72.5769271851, propagate_backward_time: 105.9887237549, weight_update_time: 0.1988395303, other_time: 5.2433395386
epoch time: 13.5117692947s, input_fired_time: 0.3147683442, output_fired_time: 0.0000000000, propagate_forward_time: 12.4785728455, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7184276581
validation[          , genome  6198] predictions:    9776/  10000 (97.76%), best:    9796/10000 (97.96%), error:       755.63208, best error:       693.45605 on epoch:    40, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 184.5648803711s, input_fired_time: 2.5332591534, output_fired_time: 2.2614021301, propagate_forward_time: 68.0452575684, propagate_backward_time: 107.6284103394, weight_update_time: 0.1946976632, other_time: 4.0965499878
epoch time: 13.9512414932s, input_fired_time: 0.3194753528, output_fired_time: 0.0000000000, propagate_forward_time: 12.8983287811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7334375381
validation[          , genome  6198] predictions:    9724/  10000 (97.24%), best:    9796/10000 (97.96%), error:       827.30487, best error:       693.45605 on epoch:    40, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 185.1733551025s, input_fired_time: 2.5203371048, output_fired_time: 3.2819955349, propagate_forward_time: 69.2233810425, propagate_backward_time: 105.9826431274, weight_update_time: 0.1971622556, other_time: 4.1649932861
epoch time: 13.7327241898s, input_fired_time: 0.3143846393, output_fired_time: 0.0000000000, propagate_forward_time: 12.7001953125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7181444168
validation[          , genome  6198] predictions:    9755/  10000 (97.55%), best:    9796/10000 (97.96%), error:       835.34808, best error:       693.45605 on epoch:    40, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 186.5510711670s, input_fired_time: 2.5430424213, output_fired_time: 3.2977206707, propagate_forward_time: 67.5635375977, propagate_backward_time: 108.9574584961, weight_update_time: 0.1946728230, other_time: 4.1893157959
epoch time: 13.7356033325s, input_fired_time: 0.3164777458, output_fired_time: 0.0000000000, propagate_forward_time: 12.7080392838, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7110862732
validation[          , genome  6198] predictions:    9754/  10000 (97.54%), best:    9796/10000 (97.96%), error:       817.04480, best error:       693.45605 on epoch:    40, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 183.4911956787s, input_fired_time: 3.5215539932, output_fired_time: 2.2645716667, propagate_forward_time: 68.3820724487, propagate_backward_time: 104.2094497681, weight_update_time: 0.1944728196, other_time: 5.1135406494
epoch time: 13.7842435837s, input_fired_time: 0.3145253360, output_fired_time: 0.0000000000, propagate_forward_time: 12.7425737381, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7271442413
validation[          , genome  6198] predictions:    9744/  10000 (97.44%), best:    9796/10000 (97.96%), error:       820.29681, best error:       693.45605 on epoch:    40, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 181.9019165039s, input_fired_time: 3.5074775219, output_fired_time: 2.2680230141, propagate_forward_time: 67.2559204102, propagate_backward_time: 104.7819366455, weight_update_time: 0.1936748475, other_time: 4.0885620117
epoch time: 14.8489351273s, input_fired_time: 0.3153620958, output_fired_time: 0.0000000000, propagate_forward_time: 13.8084325790, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7251405716
validation[          , genome  6198] predictions:    9761/  10000 (97.61%), best:    9796/10000 (97.96%), error:       741.72260, best error:       693.45605 on epoch:    40, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 192.9774475098s, input_fired_time: 2.7318770885, output_fired_time: 2.4642903805, propagate_forward_time: 72.0547943115, propagate_backward_time: 111.4106369019, weight_update_time: 0.2187292874, other_time: 4.3158493042
epoch time: 14.9084415436s, input_fired_time: 0.3204034567, output_fired_time: 0.0000000000, propagate_forward_time: 13.8524446487, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7355937958
validation[          , genome  6198] predictions:    9776/  10000 (97.76%), best:    9796/10000 (97.96%), error:       705.37109, best error:       693.45605 on epoch:    40, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 182.4827270508s, input_fired_time: 2.5137398243, output_fired_time: 2.2599232197, propagate_forward_time: 71.4960021973, propagate_backward_time: 102.1057357788, weight_update_time: 0.1942661256, other_time: 4.1073379517
epoch time: 13.9040927887s, input_fired_time: 0.3156904280, output_fired_time: 0.0000000000, propagate_forward_time: 12.8845348358, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7038679123
validation[          , genome  6198] predictions:    9784/  10000 (97.84%), best:    9796/10000 (97.96%), error:       751.65717, best error:       693.45605 on epoch:    40, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 186.4631347656s, input_fired_time: 2.5398933887, output_fired_time: 2.3130061626, propagate_forward_time: 69.9322204590, propagate_backward_time: 107.5856399536, weight_update_time: 0.1938004792, other_time: 4.0923843384
epoch time: 13.7034053802s, input_fired_time: 0.3129629195, output_fired_time: 0.0000000000, propagate_forward_time: 12.6486110687, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7418317795
validation[          , genome  6198] predictions:    9756/  10000 (97.56%), best:    9796/10000 (97.96%), error:       828.28235, best error:       693.45605 on epoch:    40, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 189.9502716064s, input_fired_time: 2.6415615082, output_fired_time: 2.3691430092, propagate_forward_time: 67.8046798706, propagate_backward_time: 110.9720687866, weight_update_time: 0.2033607215, other_time: 6.1628265381
epoch time: 14.8783588409s, input_fired_time: 0.3214888573, output_fired_time: 0.0000000000, propagate_forward_time: 13.8271732330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7296962738
validation[          , genome  6198] predictions:    9752/  10000 (97.52%), best:    9796/10000 (97.96%), error:       802.73492, best error:       693.45605 on epoch:    40, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 184.4060821533s, input_fired_time: 2.5375592709, output_fired_time: 2.2665734291, propagate_forward_time: 68.3851013184, propagate_backward_time: 107.1127929688, weight_update_time: 0.1952513903, other_time: 4.1040649414
epoch time: 15.0546798706s, input_fired_time: 0.3231059015, output_fired_time: 0.0000000000, propagate_forward_time: 14.0006923676, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7308816910
validation[          , genome  6198] predictions:    9740/  10000 (97.40%), best:    9796/10000 (97.96%), error:       845.32056, best error:       693.45605 on epoch:    40, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 190.5836181641s, input_fired_time: 2.6287040710, output_fired_time: 2.3785722256, propagate_forward_time: 69.6811599731, propagate_backward_time: 111.5540390015, weight_update_time: 0.2029468715, other_time: 4.3411407471
epoch time: 15.0362033844s, input_fired_time: 0.3220572174, output_fired_time: 0.0000000000, propagate_forward_time: 13.9913835526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7227630615
validation[          , genome  6198] predictions:    9777/  10000 (97.77%), best:    9796/10000 (97.96%), error:       718.15967, best error:       693.45605 on epoch:    40, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 207.6553497314s, input_fired_time: 2.9079868793, output_fired_time: 2.5230998993, propagate_forward_time: 78.3511047363, propagate_backward_time: 119.1453475952, weight_update_time: 0.2320675254, other_time: 4.7278060913
epoch time: 14.8430042267s, input_fired_time: 0.3200022578, output_fired_time: 0.0000000000, propagate_forward_time: 13.7971744537, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7258272171
validation[          , genome  6198] predictions:    9786/  10000 (97.86%), best:    9796/10000 (97.96%), error:       723.34283, best error:       693.45605 on epoch:    40, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 191.9508361816s, input_fired_time: 2.6144781113, output_fired_time: 2.3239052296, propagate_forward_time: 69.5504226685, propagate_backward_time: 113.1990737915, weight_update_time: 0.2029572874, other_time: 4.2629699707
epoch time: 13.8407135010s, input_fired_time: 0.3188776970, output_fired_time: 0.0000000000, propagate_forward_time: 12.8133964539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7084388733
validation[          , genome  6198] predictions:    9778/  10000 (97.78%), best:    9796/10000 (97.96%), error:       751.24670, best error:       693.45605 on epoch:    40, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 183.5910491943s, input_fired_time: 2.5186026096, output_fired_time: 2.2613444328, propagate_forward_time: 68.7979965210, propagate_backward_time: 105.4495162964, weight_update_time: 0.1931905001, other_time: 4.5635986328
epoch time: 13.8456363678s, input_fired_time: 0.3178138733, output_fired_time: 0.0000000000, propagate_forward_time: 12.8108806610, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7169418335
validation[          , genome  6198] predictions:    9788/  10000 (97.88%), best:    9796/10000 (97.96%), error:       696.73114, best error:       693.45605 on epoch:    40, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 186.7127227783s, input_fired_time: 3.6334776878, output_fired_time: 3.2934017181, propagate_forward_time: 69.3433074951, propagate_backward_time: 106.3030166626, weight_update_time: 0.1945277303, other_time: 4.1395187378
epoch time: 13.4735202789s, input_fired_time: 0.3071924448, output_fired_time: 0.0000000000, propagate_forward_time: 12.4406309128, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7256965637
validation[          , genome  6198] predictions:    9758/  10000 (97.58%), best:    9796/10000 (97.96%), error:       815.66113, best error:       693.45605 on epoch:    40, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 187.0704193115s, input_fired_time: 2.5403342247, output_fired_time: 2.3363111019, propagate_forward_time: 68.8146209717, propagate_backward_time: 108.0830612183, weight_update_time: 0.1956198514, other_time: 5.2961044312
epoch time: 14.0420904160s, input_fired_time: 0.3178094625, output_fired_time: 0.0000000000, propagate_forward_time: 12.9973068237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7269744873
validation[          , genome  6198] predictions:    9655/  10000 (96.55%), best:    9796/10000 (97.96%), error:      1188.42419, best error:       693.45605 on epoch:    40, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 202.3556060791s, input_fired_time: 2.7209916115, output_fired_time: 3.5684227943, propagate_forward_time: 76.8349838257, propagate_backward_time: 114.6594543457, weight_update_time: 0.2047018707, other_time: 4.5717544556
epoch time: 13.5565347672s, input_fired_time: 0.3108934164, output_fired_time: 0.0000000000, propagate_forward_time: 12.5370235443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7086181641
validation[          , genome  6198] predictions:    9763/  10000 (97.63%), best:    9796/10000 (97.96%), error:       772.59235, best error:       693.45605 on epoch:    40, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 186.2430572510s, input_fired_time: 2.5444226265, output_fired_time: 2.2880711555, propagate_forward_time: 71.5179367065, propagate_backward_time: 105.8054428101, weight_update_time: 0.1949327439, other_time: 4.0871887207
epoch time: 13.3820800781s, input_fired_time: 0.3114456236, output_fired_time: 0.0000000000, propagate_forward_time: 12.3489313126, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7217035294
validation[          , genome  6198] predictions:    9777/  10000 (97.77%), best:    9796/10000 (97.96%), error:       758.76361, best error:       693.45605 on epoch:    40, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 186.0479278564s, input_fired_time: 2.5542612076, output_fired_time: 2.2908675671, propagate_forward_time: 71.5209732056, propagate_backward_time: 105.5594940186, weight_update_time: 0.1941958517, other_time: 4.1223373413
epoch time: 13.7529745102s, input_fired_time: 0.3150609434, output_fired_time: 0.0000000000, propagate_forward_time: 12.7130460739, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7248678207
validation[          , genome  6198] predictions:    9736/  10000 (97.36%), best:    9796/10000 (97.96%), error:       882.39954, best error:       693.45605 on epoch:    40, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 185.3489379883s, input_fired_time: 2.6084318161, output_fired_time: 2.2752251625, propagate_forward_time: 69.2345733643, propagate_backward_time: 107.0895462036, weight_update_time: 0.1947294176, other_time: 4.1411666870
epoch time: 13.9989748001s, input_fired_time: 0.3156523407, output_fired_time: 0.0000000000, propagate_forward_time: 12.9656047821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7177181244
validation[          , genome  6198] predictions:    9766/  10000 (97.66%), best:    9796/10000 (97.96%), error:       833.91644, best error:       693.45605 on epoch:    40, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 186.7154541016s, input_fired_time: 2.5321280956, output_fired_time: 2.3054013252, propagate_forward_time: 70.7720031738, propagate_backward_time: 106.0491256714, weight_update_time: 0.1935413778, other_time: 5.0567855835
epoch time: 14.0254011154s, input_fired_time: 0.3266988099, output_fired_time: 0.0000000000, propagate_forward_time: 12.9243316650, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7743701935
validation[          , genome  6198] predictions:    9741/  10000 (97.41%), best:    9796/10000 (97.96%), error:       846.90515, best error:       693.45605 on epoch:    40, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 197.7180175781s, input_fired_time: 2.7188110352, output_fired_time: 2.4227004051, propagate_forward_time: 73.9838485718, propagate_backward_time: 114.1615524292, weight_update_time: 0.1983484030, other_time: 4.4311065674
epoch time: 17.5553550720s, input_fired_time: 0.3747830987, output_fired_time: 0.0000000000, propagate_forward_time: 16.3155002594, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8650722504
validation[          , genome  6198] predictions:    9770/  10000 (97.70%), best:    9796/10000 (97.96%), error:       794.23230, best error:       693.45605 on epoch:    40, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 203.1576080322s, input_fired_time: 2.8001718521, output_fired_time: 2.6317372322, propagate_forward_time: 76.4092712402, propagate_backward_time: 115.7444992065, weight_update_time: 0.2128629833, other_time: 5.5719223022
epoch time: 14.9369745255s, input_fired_time: 0.3268722892, output_fired_time: 0.0000000000, propagate_forward_time: 13.8750181198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7350845337
validation[          , genome  6198] predictions:    9749/  10000 (97.49%), best:    9796/10000 (97.96%), error:       862.36017, best error:       693.45605 on epoch:    40, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 204.6294860840s, input_fired_time: 2.7557103634, output_fired_time: 2.4932594299, propagate_forward_time: 78.6537551880, propagate_backward_time: 116.0508728027, weight_update_time: 0.2297028750, other_time: 4.6758956909
epoch time: 15.0660743713s, input_fired_time: 0.3250333369, output_fired_time: 0.0000000000, propagate_forward_time: 14.0133619308, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7276792526
validation[          , genome  6198] predictions:    9634/  10000 (96.34%), best:    9796/10000 (97.96%), error:      1259.92676, best error:       693.45605 on epoch:    40, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 182.9384918213s, input_fired_time: 2.5301036835, output_fired_time: 2.3126449585, propagate_forward_time: 65.6748886108, propagate_backward_time: 108.3180313110, weight_update_time: 0.1949913651, other_time: 4.1028137207
epoch time: 14.5051202774s, input_fired_time: 0.3160432279, output_fired_time: 0.0000000000, propagate_forward_time: 13.4774665833, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7116107941
validation[          , genome  6198] predictions:    9780/  10000 (97.80%), best:    9796/10000 (97.96%), error:       756.41058, best error:       693.45605 on epoch:    40, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 182.7817535400s, input_fired_time: 3.5441381931, output_fired_time: 2.2615706921, propagate_forward_time: 66.4028625488, propagate_backward_time: 106.4194183350, weight_update_time: 0.1972865015, other_time: 4.1537628174
epoch time: 14.9983758926s, input_fired_time: 0.3268601894, output_fired_time: 0.0000000000, propagate_forward_time: 13.9434032440, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7281122208
validation[          , genome  6198] predictions:    9781/  10000 (97.81%), best:    9796/10000 (97.96%), error:       785.96527, best error:       693.45605 on epoch:    40, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 182.6199798584s, input_fired_time: 2.5254878998, output_fired_time: 2.2548327446, propagate_forward_time: 68.6834945679, propagate_backward_time: 105.0206680298, weight_update_time: 0.2049082369, other_time: 4.1354980469
epoch time: 15.0869245529s, input_fired_time: 0.3254086375, output_fired_time: 0.0000000000, propagate_forward_time: 14.0281076431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7334079742
validation[          , genome  6198] predictions:    9767/  10000 (97.67%), best:    9796/10000 (97.96%), error:       754.63983, best error:       693.45605 on epoch:    40, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 182.4079742432s, input_fired_time: 2.5242290497, output_fired_time: 2.2507965565, propagate_forward_time: 69.3354187012, propagate_backward_time: 104.1867446899, weight_update_time: 0.1950085312, other_time: 4.1107864380
epoch time: 15.4563331604s, input_fired_time: 0.3292357028, output_fired_time: 0.0000000000, propagate_forward_time: 14.3693943024, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7577028275
validation[          , genome  6198] predictions:    9747/  10000 (97.47%), best:    9796/10000 (97.96%), error:       884.50311, best error:       693.45605 on epoch:    40, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 183.3694000244s, input_fired_time: 2.5314924717, output_fired_time: 2.2702264786, propagate_forward_time: 67.8535156250, propagate_backward_time: 106.6578140259, weight_update_time: 0.1941072345, other_time: 4.0563430786
epoch time: 15.1512899399s, input_fired_time: 0.3235715926, output_fired_time: 0.0000000000, propagate_forward_time: 14.0752573013, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7524614334
validation[          , genome  6198] predictions:    9776/  10000 (97.76%), best:    9796/10000 (97.96%), error:       722.37268, best error:       693.45605 on epoch:    40, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 190.0251312256s, input_fired_time: 2.6503069401, output_fired_time: 3.3450770378, propagate_forward_time: 69.2538528442, propagate_backward_time: 110.5303115845, weight_update_time: 0.2035649717, other_time: 4.2455749512
epoch time: 14.9521121979s, input_fired_time: 0.3239959478, output_fired_time: 0.0000000000, propagate_forward_time: 12.8762350082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7518815994
validation[          , genome  6198] predictions:    9742/  10000 (97.42%), best:    9796/10000 (97.96%), error:       845.32269, best error:       693.45605 on epoch:    40, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 191.5441894531s, input_fired_time: 2.6570649147, output_fired_time: 2.3534436226, propagate_forward_time: 71.1462173462, propagate_backward_time: 110.0133285522, weight_update_time: 0.1963597834, other_time: 5.3741455078
epoch time: 13.8439664841s, input_fired_time: 0.3207430542, output_fired_time: 0.0000000000, propagate_forward_time: 12.7924346924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7307891846
validation[          , genome  6198] predictions:    9740/  10000 (97.40%), best:    9796/10000 (97.96%), error:       807.78210, best error:       693.45605 on epoch:    40, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 184.0994110107s, input_fired_time: 2.5564007759, output_fired_time: 3.2671008110, propagate_forward_time: 67.6149749756, propagate_backward_time: 106.5300903320, weight_update_time: 0.2524243295, other_time: 4.1308441162
epoch time: 13.8887510300s, input_fired_time: 0.3236606121, output_fired_time: 0.0000000000, propagate_forward_time: 12.8345708847, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7305192947
validation[          , genome  6198] predictions:    9789/  10000 (97.89%), best:    9796/10000 (97.96%), error:       708.60828, best error:       693.45605 on epoch:    40, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 182.5294189453s, input_fired_time: 2.5589354038, output_fired_time: 2.2666997910, propagate_forward_time: 66.4641799927, propagate_backward_time: 107.1437377930, weight_update_time: 0.1943834424, other_time: 4.0958786011
epoch time: 14.8711156845s, input_fired_time: 0.3429885507, output_fired_time: 0.0000000000, propagate_forward_time: 13.8048686981, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7232580185
validation[          , genome  6198] predictions:    9673/  10000 (96.73%), best:    9796/10000 (97.96%), error:      1053.86487, best error:       693.45605 on epoch:    40, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 193.2550964355s, input_fired_time: 2.7145986557, output_fired_time: 2.3612232208, propagate_forward_time: 72.2327880859, propagate_backward_time: 110.6328125000, weight_update_time: 0.2106583267, other_time: 5.3136749268
epoch time: 14.7981166840s, input_fired_time: 0.3198565841, output_fired_time: 0.0000000000, propagate_forward_time: 13.7558803558, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7223796844
validation[          , genome  6198] predictions:    9754/  10000 (97.54%), best:    9796/10000 (97.96%), error:       810.30902, best error:       693.45605 on epoch:    40, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 183.2372589111s, input_fired_time: 2.5494122505, output_fired_time: 2.2604913712, propagate_forward_time: 70.7960052490, propagate_backward_time: 103.5054779053, weight_update_time: 0.1947251558, other_time: 4.1258697510
epoch time: 13.8162279129s, input_fired_time: 0.3222830594, output_fired_time: 0.0000000000, propagate_forward_time: 12.7713546753, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7225904465
validation[          , genome  6198] predictions:    9790/  10000 (97.90%), best:    9790/10000 (97.90%), error:       690.35913, best error:       690.35913 on epoch:    86, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 184.3929443359s, input_fired_time: 2.5420863628, output_fired_time: 2.2568182945, propagate_forward_time: 68.7776718140, propagate_backward_time: 105.6834335327, weight_update_time: 0.1955357641, other_time: 5.1329345703
epoch time: 13.8022413254s, input_fired_time: 0.3223122656, output_fired_time: 0.0000000000, propagate_forward_time: 12.7610836029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7188453674
validation[          , genome  6198] predictions:    9785/  10000 (97.85%), best:    9790/10000 (97.90%), error:       768.30756, best error:       690.35913 on epoch:    86, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 183.6621093750s, input_fired_time: 3.5511064529, output_fired_time: 2.2602908611, propagate_forward_time: 67.4231033325, propagate_backward_time: 106.3113174438, weight_update_time: 0.1960240752, other_time: 4.1163024902
epoch time: 13.9724807739s, input_fired_time: 0.3296574354, output_fired_time: 0.0000000000, propagate_forward_time: 12.9188337326, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7239894867
validation[          , genome  6198] predictions:    9646/  10000 (96.46%), best:    9790/10000 (97.90%), error:      1203.29407, best error:       690.35913 on epoch:    86, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 181.0163574219s, input_fired_time: 2.5331182480, output_fired_time: 2.2576494217, propagate_forward_time: 66.5347290039, propagate_backward_time: 104.3255920410, weight_update_time: 0.1953350604, other_time: 5.3652801514
epoch time: 15.0067472458s, input_fired_time: 0.3257043064, output_fired_time: 0.0000000000, propagate_forward_time: 13.9477357864, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7333068848
validation[          , genome  6198] predictions:    9786/  10000 (97.86%), best:    9790/10000 (97.90%), error:       752.11731, best error:       690.35913 on epoch:    86, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 183.2909851074s, input_fired_time: 2.5398318768, output_fired_time: 2.2635803223, propagate_forward_time: 68.8587036133, propagate_backward_time: 105.5451889038, weight_update_time: 0.1950276196, other_time: 4.0836868286
epoch time: 15.5779094696s, input_fired_time: 0.3336514533, output_fired_time: 0.0000000000, propagate_forward_time: 14.5070886612, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7371692657
validation[          , genome  6198] predictions:    9727/  10000 (97.27%), best:    9790/10000 (97.90%), error:       934.66693, best error:       690.35913 on epoch:    86, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 189.0022430420s, input_fired_time: 2.6502702236, output_fired_time: 2.3283333778, propagate_forward_time: 66.4282836914, propagate_backward_time: 113.3892822266, weight_update_time: 0.2039998770, other_time: 4.2060699463
epoch time: 14.4519348145s, input_fired_time: 0.3570685089, output_fired_time: 0.0000000000, propagate_forward_time: 13.3652057648, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7296609879
validation[          , genome  6198] predictions:    9795/  10000 (97.95%), best:    9790/10000 (97.90%), error:       730.97266, best error:       690.35913 on epoch:    86, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 185.3765563965s, input_fired_time: 3.5647790432, output_fired_time: 2.2756586075, propagate_forward_time: 67.3662109375, propagate_backward_time: 108.0547866821, weight_update_time: 0.1958441883, other_time: 4.1151199341
epoch time: 14.0464019775s, input_fired_time: 0.3247655332, output_fired_time: 0.0000000000, propagate_forward_time: 12.9815845490, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7400522232
validation[          , genome  6198] predictions:    9793/  10000 (97.93%), best:    9790/10000 (97.90%), error:       702.83099, best error:       690.35913 on epoch:    86, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 182.3367919922s, input_fired_time: 2.5214321613, output_fired_time: 2.2537841797, propagate_forward_time: 66.7453384399, propagate_backward_time: 105.6962280273, weight_update_time: 0.1952000707, other_time: 5.1200027466
epoch time: 15.0715656281s, input_fired_time: 0.3246057928, output_fired_time: 0.0000000000, propagate_forward_time: 14.0056772232, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7412824631
validation[          , genome  6198] predictions:    9754/  10000 (97.54%), best:    9790/10000 (97.90%), error:       818.31836, best error:       690.35913 on epoch:    86, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 182.7886810303s, input_fired_time: 2.5488467216, output_fired_time: 2.2617065907, propagate_forward_time: 66.7445068359, propagate_backward_time: 107.1320724487, weight_update_time: 0.1942188591, other_time: 4.1015548706
epoch time: 15.0043830872s, input_fired_time: 0.3241029382, output_fired_time: 0.0000000000, propagate_forward_time: 13.9442310333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7360486984
validation[          , genome  6198] predictions:    9785/  10000 (97.85%), best:    9790/10000 (97.90%), error:       733.29883, best error:       690.35913 on epoch:    86, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 185.4999389648s, input_fired_time: 2.5735890865, output_fired_time: 2.3164000511, propagate_forward_time: 71.5961380005, propagate_backward_time: 104.9079742432, weight_update_time: 0.2015287578, other_time: 4.1058273315
epoch time: 15.0946168900s, input_fired_time: 0.3291955888, output_fired_time: 0.0000000000, propagate_forward_time: 13.0291566849, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7362642288
validation[          , genome  6198] predictions:    9781/  10000 (97.81%), best:    9790/10000 (97.90%), error:       751.30792, best error:       690.35913 on epoch:    86, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 185.3415069580s, input_fired_time: 2.5883467197, output_fired_time: 2.3025703430, propagate_forward_time: 69.9239807129, propagate_backward_time: 106.4562530518, weight_update_time: 0.1947725266, other_time: 4.0703582764
epoch time: 25.5816402435s, input_fired_time: 0.4989844561, output_fired_time: 0.0000000000, propagate_forward_time: 23.7359981537, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3466567993
validation[          , genome  6198] predictions:    9735/  10000 (97.35%), best:    9790/10000 (97.90%), error:       883.63971, best error:       690.35913 on epoch:    86, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 190.0722656250s, input_fired_time: 2.6454689503, output_fired_time: 2.3442580700, propagate_forward_time: 71.5238037109, propagate_backward_time: 108.3043594360, weight_update_time: 0.2049121410, other_time: 5.2543869019
epoch time: 15.0673084259s, input_fired_time: 0.3298723698, output_fired_time: 0.0000000000, propagate_forward_time: 14.0008926392, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7365436554
validation[          , genome  6198] predictions:    9793/  10000 (97.93%), best:    9790/10000 (97.90%), error:       705.17450, best error:       690.35913 on epoch:    86, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 182.5933685303s, input_fired_time: 2.5300443172, output_fired_time: 2.2635726929, propagate_forward_time: 66.4408950806, propagate_backward_time: 106.2455673218, weight_update_time: 0.1951443106, other_time: 5.1132812500
epoch time: 15.1006402969s, input_fired_time: 0.3306070566, output_fired_time: 0.0000000000, propagate_forward_time: 14.0115766525, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7584562302
validation[          , genome  6198] predictions:    9777/  10000 (97.77%), best:    9790/10000 (97.90%), error:       743.46759, best error:       690.35913 on epoch:    86, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 195.8176727295s, input_fired_time: 2.6359128952, output_fired_time: 2.4259839058, propagate_forward_time: 73.0742645264, propagate_backward_time: 113.2470169067, weight_update_time: 0.1956902295, other_time: 4.4345016479
epoch time: 14.4042892456s, input_fired_time: 0.3434469998, output_fired_time: 0.0000000000, propagate_forward_time: 13.3343935013, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7264490128
validation[          , genome  6198] predictions:    9788/  10000 (97.88%), best:    9790/10000 (97.90%), error:       752.15601, best error:       690.35913 on epoch:    86, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 194.3987121582s, input_fired_time: 2.7326433659, output_fired_time: 2.4505071640, propagate_forward_time: 71.3537826538, propagate_backward_time: 113.5224990845, weight_update_time: 0.1952401996, other_time: 4.3392791748
epoch time: 15.2291383743s, input_fired_time: 0.3280398846, output_fired_time: 0.0000000000, propagate_forward_time: 14.1592779160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7418203354
validation[          , genome  6198] predictions:    9739/  10000 (97.39%), best:    9790/10000 (97.90%), error:       880.29767, best error:       690.35913 on epoch:    86, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 73.4276123047s, input_fired_time: 1.6215893030, output_fired_time: 0.0000000000, propagate_forward_time: 67.9865417480, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8194808960
best training[          , genome  6198] predictions:   49796/  50000 (99.59%), best:    9790/10000 (97.90%), error:      1034.54980, best error:       690.35913 on epoch:    86, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 13.7377061844s, input_fired_time: 0.3770483136, output_fired_time: 0.0000000000, propagate_forward_time: 12.6295280457, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7311296463
   testing[          , genome  6198] predictions:    9798/  10000 (97.98%), best:    9790/10000 (97.90%), error:       704.98010, best error:       690.35913 on epoch:    86, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
04:17:36 (2348): called boinc_finish(0)

</stderr_txt>
]]>