Nameexact_genome_1512568488_43_3433_1
Workunit2588459
Created7 Dec 2017, 4:47:27 UTC
Sent7 Dec 2017, 4:53:54 UTC
Report deadline16 Dec 2017, 17:45:09 UTC
Received7 Dec 2017, 17:37:58 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time5 hours 12 min 5 sec
CPU time5 hours 3 min 51 sec
Validate stateValid
Credit2,383.90
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.62 MB
Peak swap size158.90 MB
Peak disk usage1.97 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
077.75757 on epoch:    10, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 174.8160400391s, input_fired_time: 1.7344604731, output_fired_time: 1.5146209002, propagate_forward_time: 66.5953292847, propagate_backward_time: 101.3831863403, weight_update_time: 0.1659318507, other_time: 3.5884399414
epoch time: 14.5855293274s, input_fired_time: 0.2231766433, output_fired_time: 0.0000000000, propagate_forward_time: 13.7271451950, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6352071762
validation[          , genome  3433] predictions:    9684/  10000 (96.84%), best:    9702/10000 (97.02%), error:      1099.11377, best error:      1077.75757 on epoch:    10, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 175.4455871582s, input_fired_time: 1.7214992046, output_fired_time: 1.5130351782, propagate_forward_time: 66.3926849365, propagate_backward_time: 102.2765808105, weight_update_time: 0.1640909761, other_time: 3.5417938232
epoch time: 14.5167255402s, input_fired_time: 0.2253019661, output_fired_time: 0.0000000000, propagate_forward_time: 13.6530799866, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6383438110
validation[          , genome  3433] predictions:    9531/  10000 (95.31%), best:    9702/10000 (97.02%), error:      1509.09644, best error:      1077.75757 on epoch:    10, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 173.7062377930s, input_fired_time: 1.7281181812, output_fired_time: 1.5027443171, propagate_forward_time: 65.2787399292, propagate_backward_time: 101.6676483154, weight_update_time: 0.1629531980, other_time: 3.5289840698
epoch time: 14.5545282364s, input_fired_time: 0.2220980674, output_fired_time: 0.0000000000, propagate_forward_time: 13.7070951462, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6253347397
validation[          , genome  3433] predictions:    9629/  10000 (96.29%), best:    9702/10000 (97.02%), error:      1222.41040, best error:      1077.75757 on epoch:    10, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 174.8199462891s, input_fired_time: 1.7310249805, output_fired_time: 1.5047825575, propagate_forward_time: 67.3566284180, propagate_backward_time: 100.6887817383, weight_update_time: 0.1634023637, other_time: 3.5387420654
epoch time: 14.2065906525s, input_fired_time: 0.2165782303, output_fired_time: 0.0000000000, propagate_forward_time: 13.3744144440, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6155977249
validation[          , genome  3433] predictions:    9690/  10000 (96.90%), best:    9690/10000 (96.90%), error:      1034.61230, best error:      1034.61230 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 174.0660552979s, input_fired_time: 1.7223970890, output_fired_time: 1.5085573196, propagate_forward_time: 66.3114089966, propagate_backward_time: 101.0026931763, weight_update_time: 0.1630065292, other_time: 3.5209960938
epoch time: 14.5789737701s, input_fired_time: 0.2237626612, output_fired_time: 0.0000000000, propagate_forward_time: 13.7157373428, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6394739151
validation[          , genome  3433] predictions:    9695/  10000 (96.95%), best:    9690/10000 (96.90%), error:      1099.37598, best error:      1034.61230 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 176.7653350830s, input_fired_time: 1.7463186979, output_fired_time: 1.5225135088, propagate_forward_time: 67.0035934448, propagate_backward_time: 102.9233169556, weight_update_time: 0.1647267640, other_time: 3.5695953369
epoch time: 19.8842792511s, input_fired_time: 0.2903539836, output_fired_time: 0.0000000000, propagate_forward_time: 18.5866718292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0072536469
validation[          , genome  3433] predictions:    9678/  10000 (96.78%), best:    9690/10000 (96.90%), error:      1042.03833, best error:      1034.61230 on epoch:    18, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 180.0301513672s, input_fired_time: 1.7746424675, output_fired_time: 1.5145188570, propagate_forward_time: 67.3406143188, propagate_backward_time: 105.7503204346, weight_update_time: 0.1725637168, other_time: 3.6500473022
epoch time: 14.3826446533s, input_fired_time: 0.2194317132, output_fired_time: 0.0000000000, propagate_forward_time: 13.5403280258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6228847504
validation[          , genome  3433] predictions:    9689/  10000 (96.89%), best:    9690/10000 (96.90%), error:      1044.68689, best error:      1034.61230 on epoch:    18, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 173.4432220459s, input_fired_time: 1.7271819115, output_fired_time: 1.5142396688, propagate_forward_time: 65.1464462280, propagate_backward_time: 101.5326461792, weight_update_time: 0.1636818647, other_time: 3.5227050781
epoch time: 14.4871416092s, input_fired_time: 0.2222765237, output_fired_time: 0.0000000000, propagate_forward_time: 13.6310281754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6338367462
validation[          , genome  3433] predictions:    9661/  10000 (96.61%), best:    9690/10000 (96.90%), error:      1119.33716, best error:      1034.61230 on epoch:    18, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 175.0448760986s, input_fired_time: 1.7327841520, output_fired_time: 2.5114355087, propagate_forward_time: 66.3333206177, propagate_backward_time: 100.9345169067, weight_update_time: 0.1631281078, other_time: 3.5328216553
epoch time: 14.5071964264s, input_fired_time: 1.2318389416, output_fired_time: 0.0000000000, propagate_forward_time: 12.6372270584, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6381301880
validation[          , genome  3433] predictions:    9653/  10000 (96.53%), best:    9690/10000 (96.90%), error:      1121.82239, best error:      1034.61230 on epoch:    18, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 184.5804595947s, input_fired_time: 1.7884659767, output_fired_time: 1.6160664558, propagate_forward_time: 68.3585128784, propagate_backward_time: 109.0826034546, weight_update_time: 0.1723156720, other_time: 3.7348022461
epoch time: 14.6363468170s, input_fired_time: 0.2210093141, output_fired_time: 0.0000000000, propagate_forward_time: 13.7899818420, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6253557205
validation[          , genome  3433] predictions:    9685/  10000 (96.85%), best:    9685/10000 (96.85%), error:      1009.93182, best error:      1009.93182 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 173.8596649170s, input_fired_time: 1.7317205667, output_fired_time: 1.5026048422, propagate_forward_time: 62.4626121521, propagate_backward_time: 104.6336135864, weight_update_time: 0.1631932408, other_time: 3.5291061401
epoch time: 14.1374654770s, input_fired_time: 0.2177955955, output_fired_time: 0.0000000000, propagate_forward_time: 13.3043346405, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6153354645
validation[          , genome  3433] predictions:    9657/  10000 (96.57%), best:    9685/10000 (96.85%), error:      1127.09875, best error:      1009.93182 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 177.7344360352s, input_fired_time: 1.7411363125, output_fired_time: 1.5806884766, propagate_forward_time: 66.1775283813, propagate_backward_time: 103.6083526611, weight_update_time: 0.1660340279, other_time: 4.6267318726
epoch time: 14.0270099640s, input_fired_time: 0.2165719718, output_fired_time: 0.0000000000, propagate_forward_time: 13.1992816925, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6111564636
validation[          , genome  3433] predictions:    9723/  10000 (97.23%), best:    9723/10000 (97.23%), error:       979.41882, best error:       979.41882 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 175.1504821777s, input_fired_time: 1.7435562611, output_fired_time: 1.5172965527, propagate_forward_time: 66.6023101807, propagate_backward_time: 101.7326660156, weight_update_time: 0.1649119854, other_time: 3.5546417236
epoch time: 14.5920772552s, input_fired_time: 0.2213303447, output_fired_time: 0.0000000000, propagate_forward_time: 13.7470541000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6236925125
validation[          , genome  3433] predictions:    9660/  10000 (96.60%), best:    9723/10000 (97.23%), error:      1056.68726, best error:       979.41882 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 176.6327819824s, input_fired_time: 1.7569253445, output_fired_time: 1.5197451115, propagate_forward_time: 65.9883804321, propagate_backward_time: 103.7998809814, weight_update_time: 0.1663374454, other_time: 3.5678482056
epoch time: 16.0312175751s, input_fired_time: 0.2394214720, output_fired_time: 0.0000000000, propagate_forward_time: 15.1062717438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6855239868
validation[          , genome  3433] predictions:    9669/  10000 (96.69%), best:    9723/10000 (97.23%), error:      1106.69617, best error:       979.41882 on epoch:    26, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 197.9783172607s, input_fired_time: 1.9413439035, output_fired_time: 1.7324637175, propagate_forward_time: 72.2323684692, propagate_backward_time: 117.1562805176, weight_update_time: 0.1723120064, other_time: 4.9158554077
epoch time: 13.5159454346s, input_fired_time: 0.2202009708, output_fired_time: 0.0000000000, propagate_forward_time: 12.6471700668, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6485748291
validation[          , genome  3433] predictions:    9671/  10000 (96.71%), best:    9723/10000 (97.23%), error:      1028.61072, best error:       979.41882 on epoch:    26, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 175.0132751465s, input_fired_time: 1.7299314737, output_fired_time: 1.5027385950, propagate_forward_time: 65.3331985474, propagate_backward_time: 102.9469451904, weight_update_time: 0.1629052162, other_time: 3.5004653931
epoch time: 14.1858329773s, input_fired_time: 0.2211006880, output_fired_time: 0.0000000000, propagate_forward_time: 13.3419065475, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6228256226
validation[          , genome  3433] predictions:    9720/  10000 (97.20%), best:    9720/10000 (97.20%), error:       936.69989, best error:       936.69989 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 179.1938476563s, input_fired_time: 1.7614902258, output_fired_time: 1.5527570248, propagate_forward_time: 64.7859344482, propagate_backward_time: 107.4092178345, weight_update_time: 0.1762004346, other_time: 3.6844558716
epoch time: 14.3160028458s, input_fired_time: 0.2238745689, output_fired_time: 0.0000000000, propagate_forward_time: 13.4670209885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6251077652
validation[          , genome  3433] predictions:    9664/  10000 (96.64%), best:    9720/10000 (97.20%), error:      1114.12451, best error:       936.69989 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 173.8912048340s, input_fired_time: 1.7490626574, output_fired_time: 1.5091848373, propagate_forward_time: 64.7869033813, propagate_backward_time: 101.2647705078, weight_update_time: 0.1662608683, other_time: 4.5812759399
epoch time: 14.6638917923s, input_fired_time: 0.2271038741, output_fired_time: 0.0000000000, propagate_forward_time: 13.7979059219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6388816833
validation[          , genome  3433] predictions:    9662/  10000 (96.62%), best:    9720/10000 (97.20%), error:      1109.98267, best error:       936.69989 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 175.3084411621s, input_fired_time: 1.7444779873, output_fired_time: 1.5412108898, propagate_forward_time: 66.4407272339, propagate_backward_time: 102.0694503784, weight_update_time: 0.1627856344, other_time: 3.5125732422
epoch time: 14.3645935059s, input_fired_time: 0.2227911055, output_fired_time: 0.0000000000, propagate_forward_time: 13.5268297195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6149730682
validation[          , genome  3433] predictions:    9661/  10000 (96.61%), best:    9720/10000 (97.20%), error:      1160.60095, best error:       936.69989 on epoch:    30, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 187.1935119629s, input_fired_time: 1.8383584023, output_fired_time: 1.5986900330, propagate_forward_time: 69.6628265381, propagate_backward_time: 109.3817749023, weight_update_time: 0.1752283871, other_time: 4.7118530273
epoch time: 14.2987785339s, input_fired_time: 0.2234542966, output_fired_time: 0.0000000000, propagate_forward_time: 13.4404611588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6348628998
validation[          , genome  3433] predictions:    9667/  10000 (96.67%), best:    9720/10000 (97.20%), error:      1056.28357, best error:       936.69989 on epoch:    30, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 173.9629821777s, input_fired_time: 1.7309613228, output_fired_time: 1.5069963932, propagate_forward_time: 63.2290229797, propagate_backward_time: 103.9760971069, weight_update_time: 0.1633759588, other_time: 3.5199050903
epoch time: 14.2988500595s, input_fired_time: 0.2247374803, output_fired_time: 0.0000000000, propagate_forward_time: 12.4353313446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6387815475
validation[          , genome  3433] predictions:    9605/  10000 (96.05%), best:    9720/10000 (97.20%), error:      1246.13452, best error:       936.69989 on epoch:    30, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 184.1359252930s, input_fired_time: 1.8455879688, output_fired_time: 1.5723946095, propagate_forward_time: 72.0712814331, propagate_backward_time: 103.9125823975, weight_update_time: 0.1713279933, other_time: 4.7340927124
epoch time: 14.4558095932s, input_fired_time: 0.2273266912, output_fired_time: 0.0000000000, propagate_forward_time: 13.5805425644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6479406357
validation[          , genome  3433] predictions:    9705/  10000 (97.05%), best:    9720/10000 (97.20%), error:       991.52374, best error:       936.69989 on epoch:    30, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 180.1629333496s, input_fired_time: 1.7691196203, output_fired_time: 1.5700012445, propagate_forward_time: 67.4506759644, propagate_backward_time: 105.8240509033, weight_update_time: 0.1632811576, other_time: 3.5490798950
epoch time: 14.5661306381s, input_fired_time: 0.2236902863, output_fired_time: 0.0000000000, propagate_forward_time: 12.6936111450, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6488294601
validation[          , genome  3433] predictions:    9719/  10000 (97.19%), best:    9720/10000 (97.20%), error:       948.30444, best error:       936.69989 on epoch:    30, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 175.3337249756s, input_fired_time: 1.7309732437, output_fired_time: 2.5185122490, propagate_forward_time: 65.3918838501, propagate_backward_time: 102.2058334351, weight_update_time: 0.1613101214, other_time: 3.4865264893
epoch time: 13.0194711685s, input_fired_time: 0.2171246558, output_fired_time: 0.0000000000, propagate_forward_time: 12.1885576248, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6137886047
validation[          , genome  3433] predictions:    9680/  10000 (96.80%), best:    9720/10000 (97.20%), error:      1145.77100, best error:       936.69989 on epoch:    30, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 174.8992767334s, input_fired_time: 1.7370972633, output_fired_time: 1.5076855421, propagate_forward_time: 64.3181610107, propagate_backward_time: 103.8212356567, weight_update_time: 0.1631565243, other_time: 3.5150985718
epoch time: 14.4931068420s, input_fired_time: 0.2252580076, output_fired_time: 0.0000000000, propagate_forward_time: 13.6344585419, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6333904266
validation[          , genome  3433] predictions:    9690/  10000 (96.90%), best:    9720/10000 (97.20%), error:      1035.51074, best error:       936.69989 on epoch:    30, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 174.8040618896s, input_fired_time: 1.7298172712, output_fired_time: 1.4955658913, propagate_forward_time: 65.3644866943, propagate_backward_time: 101.7111816406, weight_update_time: 0.1634726673, other_time: 4.5030212402
epoch time: 13.1531496048s, input_fired_time: 0.2218986899, output_fired_time: 0.0000000000, propagate_forward_time: 12.2984790802, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6327714920
validation[          , genome  3433] predictions:    9730/  10000 (97.30%), best:    9730/10000 (97.30%), error:       900.36841, best error:       900.36841 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 178.5309143066s, input_fired_time: 1.7547161579, output_fired_time: 1.5186011791, propagate_forward_time: 67.4399261475, propagate_backward_time: 104.2349929810, weight_update_time: 0.1865080148, other_time: 3.5826797485
epoch time: 14.4442691803s, input_fired_time: 0.2234219760, output_fired_time: 0.0000000000, propagate_forward_time: 13.5887384415, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6321086884
validation[          , genome  3433] predictions:    9703/  10000 (97.03%), best:    9730/10000 (97.30%), error:       947.95898, best error:       900.36841 on epoch:    40, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 186.9695129395s, input_fired_time: 1.8701505661, output_fired_time: 1.6538965702, propagate_forward_time: 67.9692153931, propagate_backward_time: 111.7671890259, weight_update_time: 0.1642253250, other_time: 3.7090606689
epoch time: 14.1455869675s, input_fired_time: 0.2214657068, output_fired_time: 0.0000000000, propagate_forward_time: 13.3047256470, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6193952560
validation[          , genome  3433] predictions:    9664/  10000 (96.64%), best:    9730/10000 (97.30%), error:      1142.98718, best error:       900.36841 on epoch:    40, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 180.7564392090s, input_fired_time: 1.8604497910, output_fired_time: 1.5483896732, propagate_forward_time: 69.7468109131, propagate_backward_time: 104.0454788208, weight_update_time: 0.1637537181, other_time: 3.5553207397
epoch time: 19.1015968323s, input_fired_time: 0.2913395464, output_fired_time: 0.0000000000, propagate_forward_time: 17.9991340637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8111228943
validation[          , genome  3433] predictions:    9685/  10000 (96.85%), best:    9730/10000 (97.30%), error:      1028.90332, best error:       900.36841 on epoch:    40, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 177.9972381592s, input_fired_time: 1.7917593718, output_fired_time: 2.5604653358, propagate_forward_time: 66.4821624756, propagate_backward_time: 103.5348052979, weight_update_time: 0.1658751816, other_time: 3.6280364990
epoch time: 14.4757461548s, input_fired_time: 0.2248112410, output_fired_time: 0.0000000000, propagate_forward_time: 13.6116294861, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6393051147
validation[          , genome  3433] predictions:    9696/  10000 (96.96%), best:    9730/10000 (97.30%), error:       993.44092, best error:       900.36841 on epoch:    40, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 174.6783294678s, input_fired_time: 2.7494215965, output_fired_time: 1.5089688301, propagate_forward_time: 64.6207580566, propagate_backward_time: 102.3238372803, weight_update_time: 0.1619259268, other_time: 3.4753417969
epoch time: 14.4421510696s, input_fired_time: 0.2246837616, output_fired_time: 0.0000000000, propagate_forward_time: 13.5864019394, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6310653687
validation[          , genome  3433] predictions:    9715/  10000 (97.15%), best:    9730/10000 (97.30%), error:       947.06512, best error:       900.36841 on epoch:    40, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 175.3742675781s, input_fired_time: 1.7391114235, output_fired_time: 1.5163691044, propagate_forward_time: 64.5404739380, propagate_backward_time: 104.0933609009, weight_update_time: 0.1622871608, other_time: 3.4849548340
epoch time: 18.3106346130s, input_fired_time: 0.2767373621, output_fired_time: 0.0000000000, propagate_forward_time: 17.1873874664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8465099335
validation[          , genome  3433] predictions:    9664/  10000 (96.64%), best:    9730/10000 (97.30%), error:      1128.10327, best error:       900.36841 on epoch:    40, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 188.3350524902s, input_fired_time: 1.8656579256, output_fired_time: 1.6402180195, propagate_forward_time: 73.4846038818, propagate_backward_time: 107.6440811157, weight_update_time: 0.1759373099, other_time: 3.7004928589
epoch time: 14.4558629990s, input_fired_time: 0.2283222079, output_fired_time: 0.0000000000, propagate_forward_time: 13.5902719498, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6372690201
validation[          , genome  3433] predictions:    9667/  10000 (96.67%), best:    9730/10000 (97.30%), error:      1048.55994, best error:       900.36841 on epoch:    40, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 178.4044647217s, input_fired_time: 1.7720329762, output_fired_time: 1.5194466114, propagate_forward_time: 69.6484146118, propagate_backward_time: 101.9253082275, weight_update_time: 0.1634325981, other_time: 3.5392684937
epoch time: 15.4232482910s, input_fired_time: 0.2257496715, output_fired_time: 0.0000000000, propagate_forward_time: 14.5522470474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6452512741
validation[          , genome  3433] predictions:    9713/  10000 (97.13%), best:    9730/10000 (97.30%), error:       926.53320, best error:       900.36841 on epoch:    40, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 180.9012451172s, input_fired_time: 1.7953292131, output_fired_time: 1.5775144100, propagate_forward_time: 68.5757446289, propagate_backward_time: 105.3790130615, weight_update_time: 0.1730036587, other_time: 3.5736389160
epoch time: 13.1183938980s, input_fired_time: 0.2192739248, output_fired_time: 0.0000000000, propagate_forward_time: 12.2797946930, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6193256378
validation[          , genome  3433] predictions:    9715/  10000 (97.15%), best:    9730/10000 (97.30%), error:       931.91022, best error:       900.36841 on epoch:    40, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 175.1927947998s, input_fired_time: 2.7534642220, output_fired_time: 1.5032209158, propagate_forward_time: 65.4998931885, propagate_backward_time: 101.9160232544, weight_update_time: 0.1627127975, other_time: 3.5201950073
epoch time: 14.5819931030s, input_fired_time: 0.2318549305, output_fired_time: 0.0000000000, propagate_forward_time: 13.7245483398, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6255893707
validation[          , genome  3433] predictions:    9688/  10000 (96.88%), best:    9730/10000 (97.30%), error:      1003.71838, best error:       900.36841 on epoch:    40, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 178.9605865479s, input_fired_time: 2.7779498100, output_fired_time: 1.5417616367, propagate_forward_time: 65.6186981201, propagate_backward_time: 104.5086135864, weight_update_time: 0.1624249518, other_time: 4.5135574341
epoch time: 14.4050598145s, input_fired_time: 0.2252966315, output_fired_time: 0.0000000000, propagate_forward_time: 13.5531158447, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6266469955
validation[          , genome  3433] predictions:    9690/  10000 (96.90%), best:    9730/10000 (97.30%), error:       991.56665, best error:       900.36841 on epoch:    40, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 183.6244812012s, input_fired_time: 1.8555450439, output_fired_time: 1.5842159986, propagate_forward_time: 71.2506408691, propagate_backward_time: 104.2355422974, weight_update_time: 0.1643244624, other_time: 4.6985397339
epoch time: 14.3167934418s, input_fired_time: 0.2239996046, output_fired_time: 0.0000000000, propagate_forward_time: 13.4562244415, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6365690231
validation[          , genome  3433] predictions:    9736/  10000 (97.36%), best:    9736/10000 (97.36%), error:       885.18018, best error:       885.18018 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 173.8727722168s, input_fired_time: 1.7486841679, output_fired_time: 2.4135620594, propagate_forward_time: 64.4020385742, propagate_backward_time: 101.7794036865, weight_update_time: 0.1636901945, other_time: 3.5290832520
epoch time: 14.4906101227s, input_fired_time: 0.2260726541, output_fired_time: 0.0000000000, propagate_forward_time: 13.6383419037, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6261959076
validation[          , genome  3433] predictions:    9707/  10000 (97.07%), best:    9736/10000 (97.36%), error:       979.03595, best error:       885.18018 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 186.2148284912s, input_fired_time: 1.8098390102, output_fired_time: 1.6190125942, propagate_forward_time: 69.6414718628, propagate_backward_time: 109.3210754395, weight_update_time: 0.1676585823, other_time: 3.8234176636
epoch time: 14.4933233261s, input_fired_time: 0.2270261794, output_fired_time: 0.0000000000, propagate_forward_time: 13.6349258423, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6313714981
validation[          , genome  3433] predictions:    9721/  10000 (97.21%), best:    9721/10000 (97.21%), error:       880.12299, best error:       880.12299 on epoch:    54, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 180.4928436279s, input_fired_time: 1.8333752155, output_fired_time: 1.5486261845, propagate_forward_time: 66.5816040039, propagate_backward_time: 106.9221267700, weight_update_time: 0.1640649587, other_time: 3.6071090698
epoch time: 14.5882329941s, input_fired_time: 0.2273364812, output_fired_time: 0.0000000000, propagate_forward_time: 13.7237739563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6371221542
validation[          , genome  3433] predictions:    9685/  10000 (96.85%), best:    9721/10000 (97.21%), error:       970.89105, best error:       880.12299 on epoch:    54, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 175.4218597412s, input_fired_time: 2.7596459389, output_fired_time: 1.5096876621, propagate_forward_time: 65.6113586426, propagate_backward_time: 101.9995498657, weight_update_time: 0.1635469794, other_time: 3.5416183472
epoch time: 12.9682321548s, input_fired_time: 0.2214686722, output_fired_time: 0.0000000000, propagate_forward_time: 12.1294317245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6173315048
validation[          , genome  3433] predictions:    9720/  10000 (97.20%), best:    9721/10000 (97.21%), error:       926.54883, best error:       880.12299 on epoch:    54, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 175.6473236084s, input_fired_time: 1.7549376488, output_fired_time: 1.5109931231, propagate_forward_time: 66.5084228516, propagate_backward_time: 102.3512954712, weight_update_time: 0.1635791957, other_time: 3.5216751099
epoch time: 14.1587533951s, input_fired_time: 0.2208944261, output_fired_time: 0.0000000000, propagate_forward_time: 13.3216447830, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6162137985
validation[          , genome  3433] predictions:    9685/  10000 (96.85%), best:    9721/10000 (97.21%), error:       990.52258, best error:       880.12299 on epoch:    54, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 172.6869506836s, input_fired_time: 1.7760051489, output_fired_time: 1.5050323009, propagate_forward_time: 64.8527450562, propagate_backward_time: 101.0011444092, weight_update_time: 0.1635025442, other_time: 3.5520248413
epoch time: 14.5509624481s, input_fired_time: 0.2295204848, output_fired_time: 0.0000000000, propagate_forward_time: 13.6790962219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6423454285
validation[          , genome  3433] predictions:    9690/  10000 (96.90%), best:    9721/10000 (97.21%), error:      1012.25482, best error:       880.12299 on epoch:    54, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 176.3620300293s, input_fired_time: 1.7733254433, output_fired_time: 1.5134075880, propagate_forward_time: 63.8716049194, propagate_backward_time: 105.6652908325, weight_update_time: 0.1720179766, other_time: 3.5383911133
epoch time: 19.1401481628s, input_fired_time: 0.2703520656, output_fired_time: 0.0000000000, propagate_forward_time: 18.0261669159, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8436298370
validation[          , genome  3433] predictions:    9707/  10000 (97.07%), best:    9721/10000 (97.21%), error:      1030.22949, best error:       880.12299 on epoch:    54, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 178.9857940674s, input_fired_time: 1.7985477448, output_fired_time: 1.5389463902, propagate_forward_time: 67.9912185669, propagate_backward_time: 104.0907745361, weight_update_time: 0.1639941484, other_time: 3.5663070679
epoch time: 14.6285419464s, input_fired_time: 0.2294686437, output_fired_time: 0.0000000000, propagate_forward_time: 13.7694835663, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6295900345
validation[          , genome  3433] predictions:    9690/  10000 (96.90%), best:    9721/10000 (97.21%), error:      1008.70636, best error:       880.12299 on epoch:    54, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 174.4883270264s, input_fired_time: 1.7549685240, output_fired_time: 2.5307509899, propagate_forward_time: 65.5326232910, propagate_backward_time: 101.1463012695, weight_update_time: 0.1640234590, other_time: 3.5236816406
epoch time: 14.6611156464s, input_fired_time: 0.2262842804, output_fired_time: 0.0000000000, propagate_forward_time: 13.8032789230, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6315526962
validation[          , genome  3433] predictions:    9710/  10000 (97.10%), best:    9721/10000 (97.21%), error:       943.06500, best error:       880.12299 on epoch:    54, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 175.6275787354s, input_fired_time: 1.7571351528, output_fired_time: 1.5104457140, propagate_forward_time: 62.6073684692, propagate_backward_time: 106.2551498413, weight_update_time: 0.1637462825, other_time: 3.4974670410
epoch time: 14.6232681274s, input_fired_time: 0.2300560921, output_fired_time: 0.0000000000, propagate_forward_time: 13.7473735809, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6458387375
validation[          , genome  3433] predictions:    9635/  10000 (96.35%), best:    9721/10000 (97.21%), error:      1236.39954, best error:       880.12299 on epoch:    54, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 180.9406585693s, input_fired_time: 1.8585336208, output_fired_time: 1.5595490932, propagate_forward_time: 67.9240341187, propagate_backward_time: 105.9689712524, weight_update_time: 0.1640894264, other_time: 3.6295623779
epoch time: 13.2343778610s, input_fired_time: 0.2240137756, output_fired_time: 0.0000000000, propagate_forward_time: 12.3914003372, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6189641953
validation[          , genome  3433] predictions:    9736/  10000 (97.36%), best:    9721/10000 (97.21%), error:       889.26447, best error:       880.12299 on epoch:    54, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 185.1438751221s, input_fired_time: 1.8201780319, output_fired_time: 1.5929803848, propagate_forward_time: 70.0805435181, propagate_backward_time: 107.9645080566, weight_update_time: 0.1750212759, other_time: 3.6856613159
epoch time: 13.1538915634s, input_fired_time: 0.2242386192, output_fired_time: 0.0000000000, propagate_forward_time: 12.3065109253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6231422424
validation[          , genome  3433] predictions:    9703/  10000 (97.03%), best:    9721/10000 (97.21%), error:       997.29932, best error:       880.12299 on epoch:    54, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 175.4355163574s, input_fired_time: 1.7584018707, output_fired_time: 1.5204911232, propagate_forward_time: 67.6085510254, propagate_backward_time: 100.1000137329, weight_update_time: 0.1635240614, other_time: 4.4480514526
epoch time: 14.4025220871s, input_fired_time: 0.2280997932, output_fired_time: 0.0000000000, propagate_forward_time: 13.5363273621, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6380949020
validation[          , genome  3433] predictions:    9714/  10000 (97.14%), best:    9721/10000 (97.21%), error:      1009.80157, best error:       880.12299 on epoch:    54, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 185.6470184326s, input_fired_time: 1.8464659452, output_fired_time: 1.6159802675, propagate_forward_time: 70.2811050415, propagate_backward_time: 108.2661514282, weight_update_time: 0.1701526046, other_time: 3.6373138428
epoch time: 14.2016849518s, input_fired_time: 0.2232655883, output_fired_time: 0.0000000000, propagate_forward_time: 13.3582105637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6202087402
validation[          , genome  3433] predictions:    9701/  10000 (97.01%), best:    9721/10000 (97.21%), error:       940.98096, best error:       880.12299 on epoch:    54, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 176.1491394043s, input_fired_time: 1.7755547762, output_fired_time: 1.5265250206, propagate_forward_time: 65.8227539063, propagate_backward_time: 103.5108871460, weight_update_time: 0.1641163528, other_time: 3.5134201050
epoch time: 13.1339178085s, input_fired_time: 0.2227660865, output_fired_time: 0.0000000000, propagate_forward_time: 12.2951927185, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6159591675
validation[          , genome  3433] predictions:    9711/  10000 (97.11%), best:    9721/10000 (97.21%), error:       963.44360, best error:       880.12299 on epoch:    54, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 175.3631896973s, input_fired_time: 2.7701094151, output_fired_time: 1.5126203299, propagate_forward_time: 64.4999313354, propagate_backward_time: 102.0771942139, weight_update_time: 1.1723953485, other_time: 4.5033340454
epoch time: 14.1755266190s, input_fired_time: 0.2257980257, output_fired_time: 0.0000000000, propagate_forward_time: 13.3241491318, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6255798340
validation[          , genome  3433] predictions:    9736/  10000 (97.36%), best:    9721/10000 (97.21%), error:       896.33008, best error:       880.12299 on epoch:    54, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 175.2917633057s, input_fired_time: 1.7741960287, output_fired_time: 1.5141671896, propagate_forward_time: 66.0784454346, propagate_backward_time: 102.3652954102, weight_update_time: 0.1643793285, other_time: 3.5596618652
epoch time: 13.2132396698s, input_fired_time: 0.2201266587, output_fired_time: 0.0000000000, propagate_forward_time: 12.3858604431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6072521210
validation[          , genome  3433] predictions:    9672/  10000 (96.72%), best:    9721/10000 (97.21%), error:      1066.97021, best error:       880.12299 on epoch:    54, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 178.5928039551s, input_fired_time: 1.7875851393, output_fired_time: 1.5463438034, propagate_forward_time: 65.8490524292, propagate_backward_time: 104.8516921997, weight_update_time: 0.1641084999, other_time: 4.5581359863
epoch time: 14.3574905396s, input_fired_time: 0.2275666445, output_fired_time: 0.0000000000, propagate_forward_time: 13.5035533905, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6263704300
validation[          , genome  3433] predictions:    9684/  10000 (96.84%), best:    9721/10000 (97.21%), error:      1065.15906, best error:       880.12299 on epoch:    54, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 182.0014648438s, input_fired_time: 1.8486962318, output_fired_time: 1.5443259478, propagate_forward_time: 70.1053390503, propagate_backward_time: 104.8885192871, weight_update_time: 0.1655175090, other_time: 3.6145858765
epoch time: 14.3052482605s, input_fired_time: 0.2285440266, output_fired_time: 0.0000000000, propagate_forward_time: 13.4485549927, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6281490326
validation[          , genome  3433] predictions:    9709/  10000 (97.09%), best:    9721/10000 (97.21%), error:       944.48907, best error:       880.12299 on epoch:    54, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 177.4580230713s, input_fired_time: 1.8024960756, output_fired_time: 1.5210292339, propagate_forward_time: 65.4100341797, propagate_backward_time: 105.1663360596, weight_update_time: 0.1634716392, other_time: 3.5581359863
epoch time: 13.1574001312s, input_fired_time: 0.2256573290, output_fired_time: 0.0000000000, propagate_forward_time: 12.3148450851, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6168975830
validation[          , genome  3433] predictions:    9683/  10000 (96.83%), best:    9721/10000 (97.21%), error:      1041.04260, best error:       880.12299 on epoch:    54, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 187.7010345459s, input_fired_time: 1.8659267426, output_fired_time: 2.6674740314, propagate_forward_time: 70.8216323853, propagate_backward_time: 108.5808334351, weight_update_time: 0.1647594720, other_time: 3.7651672363
epoch time: 15.6752853394s, input_fired_time: 0.2335057408, output_fired_time: 0.0000000000, propagate_forward_time: 14.8000364304, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6417427063
validation[          , genome  3433] predictions:    9707/  10000 (97.07%), best:    9721/10000 (97.21%), error:       998.19659, best error:       880.12299 on epoch:    54, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 173.7720336914s, input_fired_time: 1.7625999451, output_fired_time: 1.5089521408, propagate_forward_time: 66.2862548828, propagate_backward_time: 100.6804046631, weight_update_time: 0.1631741077, other_time: 3.5338134766
epoch time: 14.2074470520s, input_fired_time: 0.2255536169, output_fired_time: 0.0000000000, propagate_forward_time: 13.3772211075, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6046724319
validation[          , genome  3433] predictions:    9719/  10000 (97.19%), best:    9721/10000 (97.21%), error:       938.97485, best error:       880.12299 on epoch:    54, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 174.5758361816s, input_fired_time: 1.7603478432, output_fired_time: 1.5058075190, propagate_forward_time: 64.9943847656, propagate_backward_time: 102.8311996460, weight_update_time: 0.1623756140, other_time: 3.4840927124
epoch time: 13.0658636093s, input_fired_time: 0.2226738334, output_fired_time: 0.0000000000, propagate_forward_time: 12.2330989838, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6100912094
validation[          , genome  3433] predictions:    9685/  10000 (96.85%), best:    9721/10000 (97.21%), error:      1017.92798, best error:       880.12299 on epoch:    54, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 179.2800750732s, input_fired_time: 2.8091757298, output_fired_time: 2.5270476341, propagate_forward_time: 64.8503646851, propagate_backward_time: 105.4719467163, weight_update_time: 0.1675519198, other_time: 3.6215362549
epoch time: 14.3583202362s, input_fired_time: 0.2304631323, output_fired_time: 0.0000000000, propagate_forward_time: 13.4913606644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6364965439
validation[          , genome  3433] predictions:    9705/  10000 (97.05%), best:    9721/10000 (97.21%), error:       949.67010, best error:       880.12299 on epoch:    54, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 174.8820800781s, input_fired_time: 1.7663782835, output_fired_time: 1.5135202408, propagate_forward_time: 66.1717376709, propagate_backward_time: 101.9118499756, weight_update_time: 0.1630059481, other_time: 3.5186004639
epoch time: 17.1058750153s, input_fired_time: 0.2616615295, output_fired_time: 0.0000000000, propagate_forward_time: 16.0757656097, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7684478760
validation[          , genome  3433] predictions:    9720/  10000 (97.20%), best:    9721/10000 (97.21%), error:       932.49951, best error:       880.12299 on epoch:    54, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 203.6388702393s, input_fired_time: 3.0130085945, output_fired_time: 1.7167098522, propagate_forward_time: 79.5112686157, propagate_backward_time: 114.3431472778, weight_update_time: 0.2058427185, other_time: 5.0547332764
epoch time: 14.3466148376s, input_fired_time: 0.2300511599, output_fired_time: 0.0000000000, propagate_forward_time: 13.4883623123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6282014847
validation[          , genome  3433] predictions:    9681/  10000 (96.81%), best:    9721/10000 (97.21%), error:      1023.84058, best error:       880.12299 on epoch:    54, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 174.2951965332s, input_fired_time: 1.7651779652, output_fired_time: 1.5130014420, propagate_forward_time: 65.4604187012, propagate_backward_time: 102.0556030273, weight_update_time: 0.1632469147, other_time: 3.5009918213
epoch time: 14.5803270340s, input_fired_time: 0.2327599525, output_fired_time: 0.0000000000, propagate_forward_time: 13.7078332901, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6397333145
validation[          , genome  3433] predictions:    9689/  10000 (96.89%), best:    9721/10000 (97.21%), error:       970.40692, best error:       880.12299 on epoch:    54, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 175.8363800049s, input_fired_time: 1.7842438221, output_fired_time: 1.5211488008, propagate_forward_time: 65.6217803955, propagate_backward_time: 103.3973999023, weight_update_time: 0.1640443653, other_time: 3.5118103027
epoch time: 14.4495944977s, input_fired_time: 0.2331572920, output_fired_time: 0.0000000000, propagate_forward_time: 13.5814847946, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6349525452
validation[          , genome  3433] predictions:    9706/  10000 (97.06%), best:    9721/10000 (97.21%), error:       985.52734, best error:       880.12299 on epoch:    54, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 176.7550811768s, input_fired_time: 1.7952015400, output_fired_time: 1.5131301880, propagate_forward_time: 65.3239288330, propagate_backward_time: 103.5890579224, weight_update_time: 0.1710463166, other_time: 4.5337600708
epoch time: 13.2650718689s, input_fired_time: 0.2272083610, output_fired_time: 0.0000000000, propagate_forward_time: 12.4059419632, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6319217682
validation[          , genome  3433] predictions:    9690/  10000 (96.90%), best:    9721/10000 (97.21%), error:      1028.13232, best error:       880.12299 on epoch:    54, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 176.1886901855s, input_fired_time: 1.7993974686, output_fired_time: 1.5146613121, propagate_forward_time: 67.7801818848, propagate_backward_time: 101.5754852295, weight_update_time: 0.1630269140, other_time: 3.5189666748
epoch time: 14.5299530029s, input_fired_time: 0.2316022664, output_fired_time: 0.0000000000, propagate_forward_time: 13.6585798264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6397705078
validation[          , genome  3433] predictions:    9678/  10000 (96.78%), best:    9721/10000 (97.21%), error:      1033.30566, best error:       880.12299 on epoch:    54, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 176.8983459473s, input_fired_time: 2.7036581039, output_fired_time: 1.5359501839, propagate_forward_time: 68.1336059570, propagate_backward_time: 100.9678115845, weight_update_time: 0.1637459099, other_time: 3.5573196411
epoch time: 13.0542230606s, input_fired_time: 0.2267705351, output_fired_time: 0.0000000000, propagate_forward_time: 12.2044095993, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6230430603
validation[          , genome  3433] predictions:    9711/  10000 (97.11%), best:    9721/10000 (97.21%), error:       950.35760, best error:       880.12299 on epoch:    54, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 179.6327972412s, input_fired_time: 1.8129287958, output_fired_time: 1.5376420021, propagate_forward_time: 66.0179443359, propagate_backward_time: 106.6796875000, weight_update_time: 0.1637180746, other_time: 3.5845947266
epoch time: 14.4818382263s, input_fired_time: 0.2296914905, output_fired_time: 0.0000000000, propagate_forward_time: 13.6195755005, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6325712204
validation[          , genome  3433] predictions:    9717/  10000 (97.17%), best:    9721/10000 (97.21%), error:       906.64227, best error:       880.12299 on epoch:    54, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 185.6633605957s, input_fired_time: 1.8322514296, output_fired_time: 1.5816979408, propagate_forward_time: 71.2802581787, propagate_backward_time: 107.2862701416, weight_update_time: 0.1708949506, other_time: 3.6828918457
epoch time: 14.4445629120s, input_fired_time: 0.2312049270, output_fired_time: 0.0000000000, propagate_forward_time: 13.5759897232, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6373682022
validation[          , genome  3433] predictions:    9729/  10000 (97.29%), best:    9721/10000 (97.21%), error:       901.29529, best error:       880.12299 on epoch:    54, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 186.3992614746s, input_fired_time: 1.9943616390, output_fired_time: 1.6721754074, propagate_forward_time: 71.7105102539, propagate_backward_time: 107.4124908447, weight_update_time: 0.1620348841, other_time: 3.6097259521
epoch time: 14.4036560059s, input_fired_time: 0.2314497828, output_fired_time: 0.0000000000, propagate_forward_time: 13.5055313110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6666746140
validation[          , genome  3433] predictions:    9718/  10000 (97.18%), best:    9721/10000 (97.21%), error:       916.79382, best error:       880.12299 on epoch:    54, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 175.9900207520s, input_fired_time: 1.7816148996, output_fired_time: 1.5147985220, propagate_forward_time: 67.6835250854, propagate_backward_time: 100.4916458130, weight_update_time: 0.1633988470, other_time: 4.5184326172
epoch time: 14.3908224106s, input_fired_time: 0.2305110395, output_fired_time: 0.0000000000, propagate_forward_time: 13.5280151367, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6322965622
validation[          , genome  3433] predictions:    9681/  10000 (96.81%), best:    9721/10000 (97.21%), error:      1010.39624, best error:       880.12299 on epoch:    54, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 180.0708770752s, input_fired_time: 1.8456565142, output_fired_time: 1.5474846363, propagate_forward_time: 68.4063339233, propagate_backward_time: 104.7082672119, weight_update_time: 0.1629301906, other_time: 3.5631332397
epoch time: 14.1707096100s, input_fired_time: 0.2365576774, output_fired_time: 0.0000000000, propagate_forward_time: 13.2895135880, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6446380615
validation[          , genome  3433] predictions:    9754/  10000 (97.54%), best:    9721/10000 (97.21%), error:       891.70966, best error:       880.12299 on epoch:    54, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 203.8890533447s, input_fired_time: 2.0547659397, output_fired_time: 1.6839025021, propagate_forward_time: 73.9826354980, propagate_backward_time: 122.1567840576, weight_update_time: 0.1921372116, other_time: 4.0109710693
epoch time: 13.1492328644s, input_fired_time: 0.2247927338, output_fired_time: 0.0000000000, propagate_forward_time: 12.2968769073, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6275634766
validation[          , genome  3433] predictions:    9718/  10000 (97.18%), best:    9721/10000 (97.21%), error:       896.98511, best error:       880.12299 on epoch:    54, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 180.0994262695s, input_fired_time: 1.8340902328, output_fired_time: 1.5329023600, propagate_forward_time: 69.5744018555, propagate_backward_time: 103.5278854370, weight_update_time: 0.1639955640, other_time: 3.6301498413
epoch time: 14.3798589706s, input_fired_time: 0.2289628237, output_fired_time: 0.0000000000, propagate_forward_time: 13.5248880386, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6260080338
validation[          , genome  3433] predictions:    9726/  10000 (97.26%), best:    9721/10000 (97.21%), error:       929.87323, best error:       880.12299 on epoch:    54, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 178.5328063965s, input_fired_time: 1.8257286549, output_fired_time: 1.5342557430, propagate_forward_time: 69.0794448853, propagate_backward_time: 102.5658493042, weight_update_time: 0.1630998403, other_time: 3.5275268555
epoch time: 14.5811443329s, input_fired_time: 0.2345149517, output_fired_time: 0.0000000000, propagate_forward_time: 13.7047328949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6418962479
validation[          , genome  3433] predictions:    9686/  10000 (96.86%), best:    9721/10000 (97.21%), error:      1030.85645, best error:       880.12299 on epoch:    54, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 173.8662719727s, input_fired_time: 1.7732024193, output_fired_time: 2.5107069016, propagate_forward_time: 63.3729820251, propagate_backward_time: 102.7306671143, weight_update_time: 0.1632920355, other_time: 3.4786987305
epoch time: 14.6100845337s, input_fired_time: 0.2324965000, output_fired_time: 0.0000000000, propagate_forward_time: 13.7298564911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6477317810
validation[          , genome  3433] predictions:    9703/  10000 (97.03%), best:    9721/10000 (97.21%), error:       946.92664, best error:       880.12299 on epoch:    54, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 193.2958374023s, input_fired_time: 1.9616981745, output_fired_time: 1.7707905769, propagate_forward_time: 72.3680725098, propagate_backward_time: 113.3220748901, weight_update_time: 0.1745000780, other_time: 3.8731918335
epoch time: 12.9991550446s, input_fired_time: 0.2247273326, output_fired_time: 0.0000000000, propagate_forward_time: 12.1631793976, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6112480164
validation[          , genome  3433] predictions:    9721/  10000 (97.21%), best:    9721/10000 (97.21%), error:       956.17487, best error:       880.12299 on epoch:    54, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 183.2476348877s, input_fired_time: 1.8427760601, output_fired_time: 2.5953080654, propagate_forward_time: 66.3759384155, propagate_backward_time: 107.8006210327, weight_update_time: 0.1761275083, other_time: 4.6329956055
epoch time: 13.0636787415s, input_fired_time: 0.2242209911, output_fired_time: 0.0000000000, propagate_forward_time: 12.2289104462, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6105470657
validation[          , genome  3433] predictions:    9726/  10000 (97.26%), best:    9721/10000 (97.21%), error:       960.91846, best error:       880.12299 on epoch:    54, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 176.4877014160s, input_fired_time: 1.7794516087, output_fired_time: 1.5212131739, propagate_forward_time: 66.0237197876, propagate_backward_time: 103.6606750488, weight_update_time: 0.1637609601, other_time: 3.5026473999
epoch time: 14.2662191391s, input_fired_time: 0.2289388925, output_fired_time: 0.0000000000, propagate_forward_time: 12.3996000290, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6376800537
validation[          , genome  3433] predictions:    9719/  10000 (97.19%), best:    9721/10000 (97.21%), error:       939.18115, best error:       880.12299 on epoch:    54, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 175.2258453369s, input_fired_time: 1.7809281349, output_fired_time: 1.5151476860, propagate_forward_time: 65.2583999634, propagate_backward_time: 103.1511611938, weight_update_time: 0.1632591039, other_time: 3.5202026367
epoch time: 13.1147136688s, input_fired_time: 0.2400441021, output_fired_time: 0.0000000000, propagate_forward_time: 12.2535037994, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6211662292
validation[          , genome  3433] predictions:    9724/  10000 (97.24%), best:    9721/10000 (97.21%), error:       944.48029, best error:       880.12299 on epoch:    54, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 175.0968933105s, input_fired_time: 1.7800368071, output_fired_time: 2.5277097225, propagate_forward_time: 64.3180160522, propagate_backward_time: 102.9895935059, weight_update_time: 0.1634101719, other_time: 3.4815444946
epoch time: 14.5677461624s, input_fired_time: 0.2352449894, output_fired_time: 0.0000000000, propagate_forward_time: 13.7000408173, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6324605942
validation[          , genome  3433] predictions:    9714/  10000 (97.14%), best:    9721/10000 (97.21%), error:       943.08099, best error:       880.12299 on epoch:    54, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 176.8896789551s, input_fired_time: 1.7887653112, output_fired_time: 1.5323667526, propagate_forward_time: 68.2446594238, propagate_backward_time: 101.7698745728, weight_update_time: 0.1797683686, other_time: 3.5540084839
epoch time: 13.0253381729s, input_fired_time: 0.2263008356, output_fired_time: 0.0000000000, propagate_forward_time: 12.1800050735, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6190319061
validation[          , genome  3433] predictions:    9710/  10000 (97.10%), best:    9721/10000 (97.21%), error:       948.64117, best error:       880.12299 on epoch:    54, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 194.6847076416s, input_fired_time: 1.9968383312, output_fired_time: 1.6598352194, propagate_forward_time: 75.5706634521, propagate_backward_time: 110.6690902710, weight_update_time: 0.1816294938, other_time: 4.7882766724
epoch time: 14.3732557297s, input_fired_time: 0.2303946912, output_fired_time: 0.0000000000, propagate_forward_time: 13.5144462585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6284151077
validation[          , genome  3433] predictions:    9720/  10000 (97.20%), best:    9721/10000 (97.21%), error:       897.47437, best error:       880.12299 on epoch:    54, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 175.5225524902s, input_fired_time: 1.7802983522, output_fired_time: 1.5096372366, propagate_forward_time: 64.4773559570, propagate_backward_time: 104.2677307129, weight_update_time: 0.1633607149, other_time: 3.4875183105
epoch time: 13.2458486557s, input_fired_time: 0.2301254719, output_fired_time: 0.0000000000, propagate_forward_time: 12.3936929703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6220302582
validation[          , genome  3433] predictions:    9707/  10000 (97.07%), best:    9721/10000 (97.21%), error:       938.46484, best error:       880.12299 on epoch:    54, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 71.2262878418s, input_fired_time: 1.1241047382, output_fired_time: 0.0000000000, propagate_forward_time: 66.8462448120, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2559356689
best training[          , genome  3433] predictions:   49407/  50000 (98.81%), best:    9721/10000 (97.21%), error:      2234.60962, best error:       880.12299 on epoch:    54, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 14.3625917435s, input_fired_time: 0.2234943062, output_fired_time: 0.0000000000, propagate_forward_time: 13.5098094940, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6292877197
   testing[          , genome  3433] predictions:    9742/  10000 (97.42%), best:    9721/10000 (97.21%), error:       810.06390, best error:       880.12299 on epoch:    54, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
09:05:14 (1512): called boinc_finish(0)

</stderr_txt>
]]>