Nameexact_genome_1512568488_44_6228_0
Workunit2602476
Created7 Dec 2017, 18:42:39 UTC
Sent7 Dec 2017, 18:51:59 UTC
Report deadline15 Dec 2017, 3:33:33 UTC
Received9 Dec 2017, 11:13:38 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID62426
Run time4 hours 47 min 17 sec
CPU time4 hours 34 min 3 sec
Validate stateValid
Credit1,840.55
Device peak FLOPS2.98 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.62 MB
Peak swap size152.97 MB
Peak disk usage1.84 MB

Stderr output

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
0 (96.20%), best:    9679/10000 (96.79%), error:      1192.90332, best error:      1070.94177 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 160.9984283447s, input_fired_time: 2.2389028072, output_fired_time: 1.8565279245, propagate_forward_time: 60.5840568542, propagate_backward_time: 92.8521652222, weight_update_time: 0.1839670688, other_time: 3.4667739868
epoch time: 19.4793186188s, input_fired_time: 0.2697227299, output_fired_time: 0.0000000000, propagate_forward_time: 13.1163682938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.0932283401
validation[          , genome  6228] predictions:    9662/  10000 (96.62%), best:    9679/10000 (96.79%), error:      1075.69739, best error:      1070.94177 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 152.9207611084s, input_fired_time: 1.5672366619, output_fired_time: 1.7282278538, propagate_forward_time: 57.7887687683, propagate_backward_time: 88.6619262695, weight_update_time: 0.1851780564, other_time: 3.1746063232
epoch time: 14.4925909042s, input_fired_time: 0.2537924349, output_fired_time: 0.0000000000, propagate_forward_time: 13.6083431244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6304550171
validation[          , genome  6228] predictions:    9652/  10000 (96.52%), best:    9679/10000 (96.79%), error:      1204.99951, best error:      1070.94177 on epoch:    13, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 152.9910736084s, input_fired_time: 1.5735725164, output_fired_time: 1.7273118496, propagate_forward_time: 57.8540611267, propagate_backward_time: 88.6613311768, weight_update_time: 0.1852585971, other_time: 3.1747894287
epoch time: 15.1271581650s, input_fired_time: 0.2254855484, output_fired_time: 0.0000000000, propagate_forward_time: 14.1726293564, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7290430069
validation[          , genome  6228] predictions:    9693/  10000 (96.93%), best:    9693/10000 (96.93%), error:      1012.65576, best error:      1012.65576 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 153.1465606689s, input_fired_time: 1.5769906044, output_fired_time: 1.7625130415, propagate_forward_time: 57.8397026062, propagate_backward_time: 88.7151336670, weight_update_time: 0.1875708699, other_time: 3.2522125244
epoch time: 13.8621606827s, input_fired_time: 0.2254201621, output_fired_time: 0.0000000000, propagate_forward_time: 13.0258102417, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6109304428
validation[          , genome  6228] predictions:    9656/  10000 (96.56%), best:    9693/10000 (96.93%), error:      1132.98279, best error:      1012.65576 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 153.6430664063s, input_fired_time: 1.5944122076, output_fired_time: 1.7540930510, propagate_forward_time: 57.9712257385, propagate_backward_time: 89.1085891724, weight_update_time: 0.1841518432, other_time: 3.2147598267
epoch time: 12.0966348648s, input_fired_time: 0.1930092424, output_fired_time: 0.0000000000, propagate_forward_time: 11.3330011368, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5706243515
validation[          , genome  6228] predictions:    9688/  10000 (96.88%), best:    9693/10000 (96.93%), error:      1082.92944, best error:      1012.65576 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 150.7532806396s, input_fired_time: 1.5548251867, output_fired_time: 1.7142547369, propagate_forward_time: 57.0378036499, propagate_backward_time: 87.2981185913, weight_update_time: 0.1835809350, other_time: 3.1482849121
epoch time: 12.2354545593s, input_fired_time: 0.1963668019, output_fired_time: 0.0000000000, propagate_forward_time: 11.4627971649, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5762901306
validation[          , genome  6228] predictions:    9565/  10000 (95.65%), best:    9693/10000 (96.93%), error:      1435.78955, best error:      1012.65576 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 150.1313476563s, input_fired_time: 1.5563859940, output_fired_time: 1.7078993320, propagate_forward_time: 56.5885238647, propagate_backward_time: 87.1198196411, weight_update_time: 0.1838830262, other_time: 3.1587219238
epoch time: 12.1333751678s, input_fired_time: 0.1918570399, output_fired_time: 0.0000000000, propagate_forward_time: 11.3738613129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5676565170
validation[          , genome  6228] predictions:    9625/  10000 (96.25%), best:    9693/10000 (96.93%), error:      1229.41809, best error:      1012.65576 on epoch:    17, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 149.7620697021s, input_fired_time: 1.5510762930, output_fired_time: 1.7035046816, propagate_forward_time: 56.5004081726, propagate_backward_time: 86.8496551514, weight_update_time: 0.1834496260, other_time: 3.1574249268
epoch time: 12.6870603561s, input_fired_time: 0.1930384636, output_fired_time: 0.0000000000, propagate_forward_time: 11.8776807785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6163415909
validation[          , genome  6228] predictions:    9705/  10000 (97.05%), best:    9705/10000 (97.05%), error:       988.75549, best error:       988.75549 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 153.6195068359s, input_fired_time: 1.5773196220, output_fired_time: 1.7326380014, propagate_forward_time: 57.4225349426, propagate_backward_time: 89.2009735107, weight_update_time: 0.1849829853, other_time: 3.6860504150
epoch time: 12.3795957565s, input_fired_time: 0.1973261088, output_fired_time: 0.0000000000, propagate_forward_time: 11.6019229889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5803470612
validation[          , genome  6228] predictions:    9697/  10000 (96.97%), best:    9705/10000 (97.05%), error:      1017.00317, best error:       988.75549 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 151.1689147949s, input_fired_time: 1.5748921633, output_fired_time: 1.7259430885, propagate_forward_time: 57.1805152893, propagate_backward_time: 87.4789276123, weight_update_time: 0.1844373643, other_time: 3.2086486816
epoch time: 12.2160797119s, input_fired_time: 0.1932913810, output_fired_time: 0.0000000000, propagate_forward_time: 11.4534435272, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5693445206
validation[          , genome  6228] predictions:    9681/  10000 (96.81%), best:    9705/10000 (97.05%), error:      1052.31042, best error:       988.75549 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 152.2869720459s, input_fired_time: 1.5705015659, output_fired_time: 1.7292757034, propagate_forward_time: 57.5067176819, propagate_backward_time: 88.2988128662, weight_update_time: 0.1893670112, other_time: 3.1816711426
epoch time: 12.1117057800s, input_fired_time: 0.1908523589, output_fired_time: 0.0000000000, propagate_forward_time: 11.3548069000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5660467148
validation[          , genome  6228] predictions:    9649/  10000 (96.49%), best:    9705/10000 (97.05%), error:      1102.00000, best error:       988.75549 on epoch:    22, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 155.1068115234s, input_fired_time: 1.5934016705, output_fired_time: 1.7478775978, propagate_forward_time: 58.8555908203, propagate_backward_time: 89.7003936768, weight_update_time: 0.1864068508, other_time: 3.2095489502
epoch time: 12.2106094360s, input_fired_time: 0.1931277812, output_fired_time: 0.0000000000, propagate_forward_time: 11.4449014664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5725803375
validation[          , genome  6228] predictions:    9661/  10000 (96.61%), best:    9705/10000 (97.05%), error:      1146.55859, best error:       988.75549 on epoch:    22, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 151.5804443359s, input_fired_time: 1.5707385540, output_fired_time: 1.7243802547, propagate_forward_time: 57.2742576599, propagate_backward_time: 87.8502578735, weight_update_time: 0.1847889274, other_time: 3.1608047485
epoch time: 19.0192832947s, input_fired_time: 0.2613799274, output_fired_time: 0.0000000000, propagate_forward_time: 17.8630428314, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8948612213
validation[          , genome  6228] predictions:    9687/  10000 (96.87%), best:    9705/10000 (97.05%), error:      1053.75977, best error:       988.75549 on epoch:    22, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 154.5862274170s, input_fired_time: 1.5579020977, output_fired_time: 1.8321663141, propagate_forward_time: 58.3163986206, propagate_backward_time: 89.6120147705, weight_update_time: 0.1838723570, other_time: 3.2677383423
epoch time: 12.6447420120s, input_fired_time: 0.1928309947, output_fired_time: 0.0000000000, propagate_forward_time: 11.8191337585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6327772141
validation[          , genome  6228] predictions:    9696/  10000 (96.96%), best:    9696/10000 (96.96%), error:       978.53412, best error:       978.53412 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 150.8927612305s, input_fired_time: 1.5673596859, output_fired_time: 1.7092912197, propagate_forward_time: 56.9779472351, propagate_backward_time: 87.4748535156, weight_update_time: 0.1840601861, other_time: 3.1633148193
epoch time: 13.4819784164s, input_fired_time: 0.2289301902, output_fired_time: 0.0000000000, propagate_forward_time: 12.6174039841, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6356439590
validation[          , genome  6228] predictions:    9696/  10000 (96.96%), best:    9696/10000 (96.96%), error:       995.03833, best error:       978.53412 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 154.6293792725s, input_fired_time: 1.5822559595, output_fired_time: 1.7363908291, propagate_forward_time: 58.3472099304, propagate_backward_time: 89.7113265991, weight_update_time: 0.1853463799, other_time: 3.2521896362
epoch time: 12.4474601746s, input_fired_time: 0.1953558326, output_fired_time: 0.0000000000, propagate_forward_time: 11.6804285049, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5716762543
validation[          , genome  6228] predictions:    9700/  10000 (97.00%), best:    9696/10000 (96.96%), error:       986.96234, best error:       978.53412 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 151.5691375732s, input_fired_time: 1.5835678577, output_fired_time: 1.6976186037, propagate_forward_time: 57.0570983887, propagate_backward_time: 88.0503692627, weight_update_time: 0.1831105053, other_time: 3.1804809570
epoch time: 12.1543827057s, input_fired_time: 0.1952408105, output_fired_time: 0.0000000000, propagate_forward_time: 11.3912096024, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5679321289
validation[          , genome  6228] predictions:    9704/  10000 (97.04%), best:    9704/10000 (97.04%), error:       974.57343, best error:       974.57343 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 151.9905242920s, input_fired_time: 1.5763251781, output_fired_time: 1.7249904871, propagate_forward_time: 57.3854789734, propagate_backward_time: 88.1455688477, weight_update_time: 0.1855322421, other_time: 3.1581573486
epoch time: 12.7296047211s, input_fired_time: 0.1944189668, output_fired_time: 0.0000000000, propagate_forward_time: 11.9633436203, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5718421936
validation[          , genome  6228] predictions:    9662/  10000 (96.62%), best:    9704/10000 (97.04%), error:      1102.21741, best error:       974.57343 on epoch:    31, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 152.8828582764s, input_fired_time: 1.5763435364, output_fired_time: 1.7853192091, propagate_forward_time: 57.7978363037, propagate_backward_time: 88.5193176270, weight_update_time: 0.1861932725, other_time: 3.2040405273
epoch time: 14.5723447800s, input_fired_time: 0.2563600838, output_fired_time: 0.0000000000, propagate_forward_time: 13.5897083282, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7262763977
validation[          , genome  6228] predictions:    9693/  10000 (96.93%), best:    9704/10000 (97.04%), error:      1004.67700, best error:       974.57343 on epoch:    31, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 151.5968475342s, input_fired_time: 1.5812056065, output_fired_time: 1.7196260691, propagate_forward_time: 57.2685432434, propagate_backward_time: 87.8690338135, weight_update_time: 0.1850749552, other_time: 3.1584472656
epoch time: 12.1754589081s, input_fired_time: 0.1946587414, output_fired_time: 0.0000000000, propagate_forward_time: 11.4109849930, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5698156357
validation[          , genome  6228] predictions:    9670/  10000 (96.70%), best:    9704/10000 (97.04%), error:      1061.56799, best error:       974.57343 on epoch:    31, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 158.2174224854s, input_fired_time: 1.6395995617, output_fired_time: 1.8517041206, propagate_forward_time: 59.8599205017, propagate_backward_time: 91.5954208374, weight_update_time: 0.1840728223, other_time: 3.2707748413
epoch time: 15.4900522232s, input_fired_time: 0.2306074053, output_fired_time: 0.0000000000, propagate_forward_time: 14.5879497528, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6714954376
validation[          , genome  6228] predictions:    9726/  10000 (97.26%), best:    9726/10000 (97.26%), error:       947.68860, best error:       947.68860 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 154.3220672607s, input_fired_time: 1.5953289270, output_fired_time: 1.7484078407, propagate_forward_time: 58.4232101440, propagate_backward_time: 89.3749771118, weight_update_time: 0.1837979406, other_time: 3.1801452637
epoch time: 14.3069343567s, input_fired_time: 0.2041370720, output_fired_time: 0.0000000000, propagate_forward_time: 13.4205255508, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6822719574
validation[          , genome  6228] predictions:    9728/  10000 (97.28%), best:    9728/10000 (97.28%), error:       921.63922, best error:       921.63922 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 153.7782287598s, input_fired_time: 1.6171084642, output_fired_time: 1.7334811687, propagate_forward_time: 58.1771278381, propagate_backward_time: 89.0430374146, weight_update_time: 0.1850565076, other_time: 3.2074813843
epoch time: 14.3671483994s, input_fired_time: 0.1934034675, output_fired_time: 0.0000000000, propagate_forward_time: 13.4779005051, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6958446503
validation[          , genome  6228] predictions:    9700/  10000 (97.00%), best:    9728/10000 (97.28%), error:       957.28009, best error:       921.63922 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 152.6016235352s, input_fired_time: 1.5743767023, output_fired_time: 1.7556388378, propagate_forward_time: 57.6518936157, propagate_backward_time: 88.4303512573, weight_update_time: 0.1840812862, other_time: 3.1893615723
epoch time: 12.3762989044s, input_fired_time: 0.1952977926, output_fired_time: 0.0000000000, propagate_forward_time: 11.5764942169, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6045064926
validation[          , genome  6228] predictions:    9705/  10000 (97.05%), best:    9728/10000 (97.28%), error:       931.22650, best error:       921.63922 on epoch:    36, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 159.1088867188s, input_fired_time: 1.6131248474, output_fired_time: 1.7950741053, propagate_forward_time: 60.1055450439, propagate_backward_time: 92.1888961792, weight_update_time: 0.2817870378, other_time: 3.4062423706
epoch time: 19.3684806824s, input_fired_time: 0.2577143312, output_fired_time: 0.0000000000, propagate_forward_time: 18.2505493164, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8602161407
validation[          , genome  6228] predictions:    9704/  10000 (97.04%), best:    9728/10000 (97.28%), error:       976.83435, best error:       921.63922 on epoch:    36, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 161.8546600342s, input_fired_time: 1.7534042597, output_fired_time: 1.8467609882, propagate_forward_time: 61.0573234558, propagate_backward_time: 93.7646255493, weight_update_time: 0.2168547064, other_time: 3.4325485229
epoch time: 20.2778205872s, input_fired_time: 0.2267832458, output_fired_time: 0.0000000000, propagate_forward_time: 19.2180099487, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8330268860
validation[          , genome  6228] predictions:    9612/  10000 (96.12%), best:    9728/10000 (97.28%), error:      1256.47852, best error:       921.63922 on epoch:    36, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 152.2093353271s, input_fired_time: 1.6147286892, output_fired_time: 1.7214167118, propagate_forward_time: 57.4753990173, propagate_backward_time: 88.2097015381, weight_update_time: 0.1861119419, other_time: 3.1880798340
epoch time: 12.5160026550s, input_fired_time: 0.1976002306, output_fired_time: 0.0000000000, propagate_forward_time: 11.7148046494, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6035976410
validation[          , genome  6228] predictions:    9705/  10000 (97.05%), best:    9728/10000 (97.28%), error:       966.65503, best error:       921.63922 on epoch:    36, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 154.4830017090s, input_fired_time: 1.6124783754, output_fired_time: 1.7432695627, propagate_forward_time: 57.6754226685, propagate_backward_time: 90.0607147217, weight_update_time: 0.1798467338, other_time: 3.3911209106
epoch time: 14.6057014465s, input_fired_time: 0.1987881809, output_fired_time: 0.0000000000, propagate_forward_time: 13.6695985794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7373142242
validation[          , genome  6228] predictions:    9668/  10000 (96.68%), best:    9728/10000 (97.28%), error:      1094.36597, best error:       921.63922 on epoch:    36, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 153.6011505127s, input_fired_time: 1.6144286394, output_fired_time: 1.7559180260, propagate_forward_time: 58.0111045837, propagate_backward_time: 88.9830322266, weight_update_time: 0.1844150424, other_time: 3.2366638184
epoch time: 13.0945253372s, input_fired_time: 0.1950879544, output_fired_time: 0.0000000000, propagate_forward_time: 12.2874040604, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6120328903
validation[          , genome  6228] predictions:    9664/  10000 (96.64%), best:    9728/10000 (97.28%), error:      1080.28040, best error:       921.63922 on epoch:    36, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 152.2598114014s, input_fired_time: 1.6417866945, output_fired_time: 1.7129117250, propagate_forward_time: 57.4734725952, propagate_backward_time: 88.2646408081, weight_update_time: 0.1850222796, other_time: 3.1670074463
epoch time: 13.7995071411s, input_fired_time: 0.2598539889, output_fired_time: 0.0000000000, propagate_forward_time: 12.9036636353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6359891891
validation[          , genome  6228] predictions:    9713/  10000 (97.13%), best:    9728/10000 (97.28%), error:       984.97729, best error:       921.63922 on epoch:    36, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 152.3249359131s, input_fired_time: 1.6141632795, output_fired_time: 1.7261657715, propagate_forward_time: 57.5018615723, propagate_backward_time: 88.2518920898, weight_update_time: 0.1856338680, other_time: 3.2308502197
epoch time: 14.1511678696s, input_fired_time: 0.2255510092, output_fired_time: 0.0000000000, propagate_forward_time: 13.2283630371, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6972541809
validation[          , genome  6228] predictions:    9719/  10000 (97.19%), best:    9719/10000 (97.19%), error:       895.12311, best error:       895.12311 on epoch:    45, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 152.0069732666s, input_fired_time: 1.6505566835, output_fired_time: 1.7441670895, propagate_forward_time: 57.1647262573, propagate_backward_time: 88.2307968140, weight_update_time: 0.1829544753, other_time: 3.2167205811
epoch time: 18.5680789948s, input_fired_time: 0.2913649082, output_fired_time: 0.0000000000, propagate_forward_time: 17.4220676422, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8546466827
validation[          , genome  6228] predictions:    9688/  10000 (96.88%), best:    9719/10000 (97.19%), error:      1078.74561, best error:       895.12311 on epoch:    45, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 160.9484863281s, input_fired_time: 1.6263220310, output_fired_time: 1.7909778357, propagate_forward_time: 62.1633491516, propagate_backward_time: 91.9773712158, weight_update_time: 0.1868681014, other_time: 3.3904571533
epoch time: 14.3895778656s, input_fired_time: 0.1977172345, output_fired_time: 0.0000000000, propagate_forward_time: 13.5212469101, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6706132889
validation[          , genome  6228] predictions:    9674/  10000 (96.74%), best:    9719/10000 (97.19%), error:      1024.41980, best error:       895.12311 on epoch:    45, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 151.7853088379s, input_fired_time: 1.5855787992, output_fired_time: 1.7233067751, propagate_forward_time: 57.3844032288, propagate_backward_time: 87.9344253540, weight_update_time: 0.1850037128, other_time: 3.1576004028
epoch time: 17.5047950745s, input_fired_time: 0.2287457585, output_fired_time: 0.0000000000, propagate_forward_time: 16.4385509491, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8374977112
validation[          , genome  6228] predictions:    9730/  10000 (97.30%), best:    9719/10000 (97.19%), error:       929.81744, best error:       895.12311 on epoch:    45, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 150.9767150879s, input_fired_time: 1.5639247894, output_fired_time: 1.6979031563, propagate_forward_time: 56.7196464539, propagate_backward_time: 87.6275405884, weight_update_time: 0.1845382005, other_time: 3.3676986694
epoch time: 23.4408283234s, input_fired_time: 0.2429679185, output_fired_time: 0.0000000000, propagate_forward_time: 22.4997634888, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6980972290
validation[          , genome  6228] predictions:    9706/  10000 (97.06%), best:    9719/10000 (97.19%), error:       983.20398, best error:       895.12311 on epoch:    45, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 150.4965667725s, input_fired_time: 1.5774651766, output_fired_time: 1.7154800892, propagate_forward_time: 56.7955513000, propagate_backward_time: 87.2385330200, weight_update_time: 0.1838892996, other_time: 3.1695327759
epoch time: 11.8140144348s, input_fired_time: 0.1850464046, output_fired_time: 0.0000000000, propagate_forward_time: 11.0285005569, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6004676819
validation[          , genome  6228] predictions:    9717/  10000 (97.17%), best:    9719/10000 (97.19%), error:       923.50879, best error:       895.12311 on epoch:    45, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 152.4418792725s, input_fired_time: 1.5820127726, output_fired_time: 1.7246114016, propagate_forward_time: 57.5884513855, propagate_backward_time: 88.3671646118, weight_update_time: 0.1841067672, other_time: 3.1796340942
epoch time: 13.1884746552s, input_fired_time: 0.1943654418, output_fired_time: 0.0000000000, propagate_forward_time: 12.4302930832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5638160706
validation[          , genome  6228] predictions:    9693/  10000 (96.93%), best:    9719/10000 (97.19%), error:      1008.19104, best error:       895.12311 on epoch:    45, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 152.2205352783s, input_fired_time: 1.5989613533, output_fired_time: 1.7321696281, propagate_forward_time: 57.4436874390, propagate_backward_time: 88.2403640747, weight_update_time: 0.1850490868, other_time: 3.2053527832
epoch time: 12.7494716644s, input_fired_time: 0.1981386989, output_fired_time: 0.0000000000, propagate_forward_time: 11.9478130341, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6035203934
validation[          , genome  6228] predictions:    9725/  10000 (97.25%), best:    9725/10000 (97.25%), error:       892.49548, best error:       892.49548 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 151.2368774414s, input_fired_time: 1.6213179827, output_fired_time: 1.7271000147, propagate_forward_time: 57.0511817932, propagate_backward_time: 87.6493225098, weight_update_time: 0.1845673025, other_time: 3.1879577637
epoch time: 12.3194179535s, input_fired_time: 0.2008834928, output_fired_time: 0.0000000000, propagate_forward_time: 11.5101947784, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6083393097
validation[          , genome  6228] predictions:    9739/  10000 (97.39%), best:    9725/10000 (97.25%), error:       910.55420, best error:       892.49548 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 158.3514251709s, input_fired_time: 1.5887269974, output_fired_time: 1.8771396875, propagate_forward_time: 59.6884803772, propagate_backward_time: 91.8862304688, weight_update_time: 0.1849139780, other_time: 3.3108520508
epoch time: 16.2757339478s, input_fired_time: 0.2595085800, output_fired_time: 0.0000000000, propagate_forward_time: 15.1839971542, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8322286606
validation[          , genome  6228] predictions:    9721/  10000 (97.21%), best:    9725/10000 (97.25%), error:       957.41199, best error:       892.49548 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 151.2667388916s, input_fired_time: 1.5884472132, output_fired_time: 1.7236646414, propagate_forward_time: 57.1719589233, propagate_backward_time: 87.6400909424, weight_update_time: 0.1839388311, other_time: 3.1425857544
epoch time: 12.4163465500s, input_fired_time: 0.1978735179, output_fired_time: 0.0000000000, propagate_forward_time: 11.6119899750, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6064834595
validation[          , genome  6228] predictions:    9721/  10000 (97.21%), best:    9725/10000 (97.25%), error:       958.21045, best error:       892.49548 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 153.5293579102s, input_fired_time: 1.6230962276, output_fired_time: 1.7306723595, propagate_forward_time: 57.9857826233, propagate_backward_time: 89.0014724731, weight_update_time: 0.1842588782, other_time: 3.1883468628
epoch time: 15.1770582199s, input_fired_time: 0.2570599914, output_fired_time: 0.0000000000, propagate_forward_time: 14.1649122238, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7550859451
validation[          , genome  6228] predictions:    9742/  10000 (97.42%), best:    9742/10000 (97.42%), error:       855.97253, best error:       855.97253 on epoch:    56, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 161.2377777100s, input_fired_time: 1.6863384247, output_fired_time: 1.7919287682, propagate_forward_time: 60.7458763123, propagate_backward_time: 93.3846511841, weight_update_time: 0.2166744471, other_time: 3.6289749146
epoch time: 13.1115760803s, input_fired_time: 0.1952973753, output_fired_time: 0.0000000000, propagate_forward_time: 12.2723798752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6438989639
validation[          , genome  6228] predictions:    9689/  10000 (96.89%), best:    9742/10000 (97.42%), error:       983.34656, best error:       855.97253 on epoch:    56, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 152.1024017334s, input_fired_time: 1.5726442337, output_fired_time: 1.7146236897, propagate_forward_time: 57.6242485046, propagate_backward_time: 88.0344390869, weight_update_time: 0.1856314242, other_time: 3.1564331055
epoch time: 12.8272066116s, input_fired_time: 0.1980151534, output_fired_time: 0.0000000000, propagate_forward_time: 12.0160875320, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6131038666
validation[          , genome  6228] predictions:    9651/  10000 (96.51%), best:    9742/10000 (97.42%), error:      1175.93579, best error:       855.97253 on epoch:    56, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 157.5479888916s, input_fired_time: 1.6868385077, output_fired_time: 1.8164402246, propagate_forward_time: 59.5798454285, propagate_backward_time: 91.2198104858, weight_update_time: 0.1845255494, other_time: 3.2450485229
epoch time: 15.4992628098s, input_fired_time: 0.2560187280, output_fired_time: 0.0000000000, propagate_forward_time: 14.5088758469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7343683243
validation[          , genome  6228] predictions:    9721/  10000 (97.21%), best:    9742/10000 (97.42%), error:       924.82611, best error:       855.97253 on epoch:    56, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 153.3004455566s, input_fired_time: 1.6434582472, output_fired_time: 1.7179074287, propagate_forward_time: 57.9799995422, propagate_backward_time: 88.8053054810, weight_update_time: 0.1838573366, other_time: 3.1537704468
epoch time: 24.3220691681s, input_fired_time: 0.4221263826, output_fired_time: 0.0000000000, propagate_forward_time: 22.7848644257, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1150779724
validation[          , genome  6228] predictions:    9719/  10000 (97.19%), best:    9742/10000 (97.42%), error:       959.09357, best error:       855.97253 on epoch:    56, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 136.4877624512s, input_fired_time: 1.5032589436, output_fired_time: 1.5878274441, propagate_forward_time: 49.0238304138, propagate_backward_time: 81.1476211548, weight_update_time: 0.1787383407, other_time: 3.2252120972
epoch time: 17.7416400909s, input_fired_time: 0.3274393976, output_fired_time: 0.0000000000, propagate_forward_time: 16.6187553406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7954444885
validation[          , genome  6228] predictions:    9735/  10000 (97.35%), best:    9742/10000 (97.42%), error:       906.82935, best error:       855.97253 on epoch:    56, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 165.9871215820s, input_fired_time: 1.8114819527, output_fired_time: 1.8890310526, propagate_forward_time: 62.6963386536, propagate_backward_time: 96.1278686523, weight_update_time: 0.1849409789, other_time: 3.4624023438
epoch time: 16.1170597076s, input_fired_time: 0.1990090907, output_fired_time: 0.0000000000, propagate_forward_time: 15.1849308014, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7331199646
validation[          , genome  6228] predictions:    9678/  10000 (96.78%), best:    9742/10000 (97.42%), error:      1054.26831, best error:       855.97253 on epoch:    56, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 154.6122741699s, input_fired_time: 1.5919079781, output_fired_time: 1.7508003712, propagate_forward_time: 58.3016891479, propagate_backward_time: 89.7035522461, weight_update_time: 0.1842550039, other_time: 3.2643356323
epoch time: 16.9661197662s, input_fired_time: 0.2955411673, output_fired_time: 0.0000000000, propagate_forward_time: 15.9374380112, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7331399918
validation[          , genome  6228] predictions:    9697/  10000 (96.97%), best:    9742/10000 (97.42%), error:       982.81335, best error:       855.97253 on epoch:    56, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 151.2027435303s, input_fired_time: 1.6237714291, output_fired_time: 1.7160985470, propagate_forward_time: 57.0912895203, propagate_backward_time: 87.5912780762, weight_update_time: 0.1854462922, other_time: 3.1803131104
epoch time: 14.6852474213s, input_fired_time: 0.2002979517, output_fired_time: 0.0000000000, propagate_forward_time: 13.8110733032, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6738758087
validation[          , genome  6228] predictions:    9668/  10000 (96.68%), best:    9742/10000 (97.42%), error:      1019.18903, best error:       855.97253 on epoch:    56, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 150.9113006592s, input_fired_time: 1.5958125591, output_fired_time: 1.7277114391, propagate_forward_time: 56.9680404663, propagate_backward_time: 87.4518203735, weight_update_time: 0.1843099892, other_time: 3.1679229736
epoch time: 14.9816160202s, input_fired_time: 0.1982011199, output_fired_time: 0.0000000000, propagate_forward_time: 14.0538749695, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7295398712
validation[          , genome  6228] predictions:    9750/  10000 (97.50%), best:    9742/10000 (97.42%), error:       860.15204, best error:       855.97253 on epoch:    56, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 159.3527526855s, input_fired_time: 1.7212908268, output_fired_time: 1.7835812569, propagate_forward_time: 60.0410461426, propagate_backward_time: 92.3299484253, weight_update_time: 0.1850883812, other_time: 3.4768753052
epoch time: 21.6407890320s, input_fired_time: 0.1998267621, output_fired_time: 0.0000000000, propagate_forward_time: 20.4537429810, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9872188568
validation[          , genome  6228] predictions:    9703/  10000 (97.03%), best:    9742/10000 (97.42%), error:       965.27399, best error:       855.97253 on epoch:    56, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 153.7163848877s, input_fired_time: 1.5462336540, output_fired_time: 1.7418524027, propagate_forward_time: 60.5933418274, propagate_backward_time: 86.4113006592, weight_update_time: 0.1769036949, other_time: 3.4236602783
epoch time: 21.7192745209s, input_fired_time: 0.5867065191, output_fired_time: 0.0000000000, propagate_forward_time: 20.2007236481, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9318447113
validation[          , genome  6228] predictions:    9743/  10000 (97.43%), best:    9742/10000 (97.42%), error:       903.15253, best error:       855.97253 on epoch:    56, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 151.6576690674s, input_fired_time: 1.5990697145, output_fired_time: 1.7238169909, propagate_forward_time: 57.2956047058, propagate_backward_time: 87.8572540283, weight_update_time: 0.1841687411, other_time: 3.1819152832
epoch time: 18.4645500183s, input_fired_time: 0.3270063102, output_fired_time: 0.0000000000, propagate_forward_time: 17.2462348938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8913097382
validation[          , genome  6228] predictions:    9719/  10000 (97.19%), best:    9742/10000 (97.42%), error:       907.97125, best error:       855.97253 on epoch:    56, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 166.2186737061s, input_fired_time: 1.7354413271, output_fired_time: 1.9235843420, propagate_forward_time: 62.8223304749, propagate_backward_time: 96.2777481079, weight_update_time: 0.2174735963, other_time: 3.4595718384
epoch time: 14.6940298080s, input_fired_time: 0.2630541325, output_fired_time: 0.0000000000, propagate_forward_time: 13.6702775955, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7606983185
validation[          , genome  6228] predictions:    9735/  10000 (97.35%), best:    9742/10000 (97.42%), error:       895.12921, best error:       855.97253 on epoch:    56, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 179.9239044189s, input_fired_time: 1.7470971346, output_fired_time: 1.9670982361, propagate_forward_time: 72.0393829346, propagate_backward_time: 100.4332885742, weight_update_time: 0.1839003712, other_time: 3.7370300293
epoch time: 13.7996778488s, input_fired_time: 0.2637847364, output_fired_time: 0.0000000000, propagate_forward_time: 12.8646249771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6712684631
validation[          , genome  6228] predictions:    9733/  10000 (97.33%), best:    9733/10000 (97.33%), error:       854.50024, best error:       854.50024 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 152.5905914307s, input_fired_time: 1.6254611015, output_fired_time: 1.7146824598, propagate_forward_time: 57.6237792969, propagate_backward_time: 88.4144744873, weight_update_time: 0.1857289970, other_time: 3.2122039795
epoch time: 13.6487245560s, input_fired_time: 0.2313307971, output_fired_time: 0.0000000000, propagate_forward_time: 12.8100795746, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6073141098
validation[          , genome  6228] predictions:    9696/  10000 (96.96%), best:    9733/10000 (97.33%), error:      1005.78101, best error:       854.50024 on epoch:    70, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 156.5157928467s, input_fired_time: 1.5785940886, output_fired_time: 1.7133561373, propagate_forward_time: 57.1844139099, propagate_backward_time: 92.8902969360, weight_update_time: 0.1843957901, other_time: 3.1491165161
epoch time: 15.4566955566s, input_fired_time: 0.2613183558, output_fired_time: 0.0000000000, propagate_forward_time: 14.4681749344, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7272024155
validation[          , genome  6228] predictions:    9654/  10000 (96.54%), best:    9733/10000 (97.33%), error:      1119.06335, best error:       854.50024 on epoch:    70, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 159.3976593018s, input_fired_time: 1.7309029102, output_fired_time: 1.8221800327, propagate_forward_time: 60.2292404175, propagate_backward_time: 92.2479248047, weight_update_time: 0.1877122372, other_time: 3.3674240112
epoch time: 16.7727680206s, input_fired_time: 0.2333144397, output_fired_time: 0.0000000000, propagate_forward_time: 15.7749500275, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7645034790
validation[          , genome  6228] predictions:    9709/  10000 (97.09%), best:    9733/10000 (97.33%), error:       938.70496, best error:       854.50024 on epoch:    70, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 153.1286163330s, input_fired_time: 1.5997791290, output_fired_time: 1.7190399170, propagate_forward_time: 57.8195266724, propagate_backward_time: 88.7524032593, weight_update_time: 0.2170788646, other_time: 3.2378692627
epoch time: 22.5517082214s, input_fired_time: 0.2340311706, output_fired_time: 0.0000000000, propagate_forward_time: 21.6789703369, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6387062073
validation[          , genome  6228] predictions:    9708/  10000 (97.08%), best:    9733/10000 (97.33%), error:       985.74042, best error:       854.50024 on epoch:    70, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 157.8100738525s, input_fired_time: 1.6132644415, output_fired_time: 1.7334161997, propagate_forward_time: 59.6912956238, propagate_backward_time: 91.5138931274, weight_update_time: 0.1861293465, other_time: 3.2582015991
epoch time: 12.1042642593s, input_fired_time: 0.1963024884, output_fired_time: 0.0000000000, propagate_forward_time: 11.3470535278, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5609083176
validation[          , genome  6228] predictions:    9744/  10000 (97.44%), best:    9733/10000 (97.33%), error:       865.17175, best error:       854.50024 on epoch:    70, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 152.7810821533s, input_fired_time: 1.6371942759, output_fired_time: 1.7577533722, propagate_forward_time: 57.5971183777, propagate_backward_time: 88.5736236572, weight_update_time: 0.1849014312, other_time: 3.2153930664
epoch time: 14.8463363647s, input_fired_time: 0.2337636501, output_fired_time: 0.0000000000, propagate_forward_time: 13.9748058319, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6377668381
validation[          , genome  6228] predictions:    9674/  10000 (96.74%), best:    9733/10000 (97.33%), error:      1044.14514, best error:       854.50024 on epoch:    70, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 158.1608734131s, input_fired_time: 1.7607237101, output_fired_time: 1.8508780003, propagate_forward_time: 59.7787094116, propagate_backward_time: 91.5033035278, weight_update_time: 0.1847347021, other_time: 3.2672576904
epoch time: 15.1814947128s, input_fired_time: 0.2312668413, output_fired_time: 0.0000000000, propagate_forward_time: 14.2181224823, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7321052551
validation[          , genome  6228] predictions:    9669/  10000 (96.69%), best:    9733/10000 (97.33%), error:      1083.27881, best error:       854.50024 on epoch:    70, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 153.6032409668s, input_fired_time: 1.6165693998, output_fired_time: 1.7298907042, propagate_forward_time: 58.3074913025, propagate_backward_time: 88.7064743042, weight_update_time: 0.1936140805, other_time: 3.2428207397
epoch time: 14.1973724365s, input_fired_time: 0.2139169276, output_fired_time: 0.0000000000, propagate_forward_time: 13.3720722198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6113834381
validation[          , genome  6228] predictions:    9698/  10000 (96.98%), best:    9733/10000 (97.33%), error:      1024.95789, best error:       854.50024 on epoch:    70, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 150.7951354980s, input_fired_time: 1.5915665627, output_fired_time: 1.7170884609, propagate_forward_time: 56.9345207214, propagate_backward_time: 87.3851089478, weight_update_time: 0.1844898313, other_time: 3.1668472290
epoch time: 13.7612924576s, input_fired_time: 0.4118293524, output_fired_time: 0.0000000000, propagate_forward_time: 12.6981887817, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6512746811
validation[          , genome  6228] predictions:    9677/  10000 (96.77%), best:    9733/10000 (97.33%), error:      1065.46387, best error:       854.50024 on epoch:    70, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 158.0994873047s, input_fired_time: 1.6018025875, output_fired_time: 1.7814741135, propagate_forward_time: 59.4184684753, propagate_backward_time: 92.0570220947, weight_update_time: 0.1850245148, other_time: 3.2407073975
epoch time: 12.0831136703s, input_fired_time: 0.1938626468, output_fired_time: 0.0000000000, propagate_forward_time: 11.2786045074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6106462479
validation[          , genome  6228] predictions:    9671/  10000 (96.71%), best:    9733/10000 (97.33%), error:      1056.42200, best error:       854.50024 on epoch:    70, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 150.9256286621s, input_fired_time: 1.5906434059, output_fired_time: 1.7101541758, propagate_forward_time: 57.1726646423, propagate_backward_time: 87.2901916504, weight_update_time: 0.1836354882, other_time: 3.1619720459
epoch time: 12.1095752716s, input_fired_time: 0.1962917149, output_fired_time: 0.0000000000, propagate_forward_time: 11.3467988968, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5664844513
validation[          , genome  6228] predictions:    9688/  10000 (96.88%), best:    9733/10000 (97.33%), error:      1029.99536, best error:       854.50024 on epoch:    70, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 151.3403930664s, input_fired_time: 1.5967112780, output_fired_time: 1.7260353565, propagate_forward_time: 57.1235008240, propagate_backward_time: 87.7522201538, weight_update_time: 0.1842381209, other_time: 3.1419296265
epoch time: 12.6690692902s, input_fired_time: 0.2337205410, output_fired_time: 0.0000000000, propagate_forward_time: 11.8299703598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6053781509
validation[          , genome  6228] predictions:    9737/  10000 (97.37%), best:    9733/10000 (97.33%), error:       881.48950, best error:       854.50024 on epoch:    70, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 155.7284851074s, input_fired_time: 1.6433905363, output_fired_time: 1.7741123438, propagate_forward_time: 58.7203598022, propagate_backward_time: 90.3261260986, weight_update_time: 0.1858430207, other_time: 3.2645034790
epoch time: 14.4998989105s, input_fired_time: 0.2013577670, output_fired_time: 0.0000000000, propagate_forward_time: 13.6335792542, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6649618149
validation[          , genome  6228] predictions:    9751/  10000 (97.51%), best:    9751/10000 (97.51%), error:       841.64777, best error:       841.64777 on epoch:    83, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 154.5417785645s, input_fired_time: 1.6496511698, output_fired_time: 1.7223747969, propagate_forward_time: 58.8310165405, propagate_backward_time: 89.1361618042, weight_update_time: 0.1844705790, other_time: 3.2025604248
epoch time: 13.3908128738s, input_fired_time: 0.1963113248, output_fired_time: 0.0000000000, propagate_forward_time: 12.5676183701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6268835068
validation[          , genome  6228] predictions:    9716/  10000 (97.16%), best:    9751/10000 (97.51%), error:       935.72150, best error:       841.64777 on epoch:    83, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 152.3650817871s, input_fired_time: 1.6015881300, output_fired_time: 1.7533737421, propagate_forward_time: 57.5704650879, propagate_backward_time: 88.2397689819, weight_update_time: 0.1842753291, other_time: 3.1998825073
epoch time: 16.4647178650s, input_fired_time: 0.2653038800, output_fired_time: 0.0000000000, propagate_forward_time: 15.4054918289, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7939214706
validation[          , genome  6228] predictions:    9718/  10000 (97.18%), best:    9751/10000 (97.51%), error:       958.40338, best error:       841.64777 on epoch:    83, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 157.7788391113s, input_fired_time: 1.5944091082, output_fired_time: 1.7119493484, propagate_forward_time: 57.1186714172, propagate_backward_time: 94.1962051392, weight_update_time: 0.1837478131, other_time: 3.1576156616
epoch time: 12.4613418579s, input_fired_time: 0.1999399662, output_fired_time: 0.0000000000, propagate_forward_time: 11.6581811905, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6032209396
validation[          , genome  6228] predictions:    9674/  10000 (96.74%), best:    9751/10000 (97.51%), error:      1082.54932, best error:       841.64777 on epoch:    83, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 151.6634368896s, input_fired_time: 1.6019346714, output_fired_time: 1.7176976204, propagate_forward_time: 57.2267608643, propagate_backward_time: 87.9563140869, weight_update_time: 0.1842387915, other_time: 3.1607360840
epoch time: 12.8114194870s, input_fired_time: 0.2329759747, output_fired_time: 0.0000000000, propagate_forward_time: 11.9413862228, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6370573044
validation[          , genome  6228] predictions:    9723/  10000 (97.23%), best:    9751/10000 (97.51%), error:       903.97125, best error:       841.64777 on epoch:    83, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 154.9557342529s, input_fired_time: 1.6289664507, output_fired_time: 1.7489091158, propagate_forward_time: 58.5194511414, propagate_backward_time: 89.8345794678, weight_update_time: 0.1851670593, other_time: 3.2238159180
epoch time: 12.2945709229s, input_fired_time: 0.2025433779, output_fired_time: 0.0000000000, propagate_forward_time: 11.5224885941, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5695390701
validation[          , genome  6228] predictions:    9700/  10000 (97.00%), best:    9751/10000 (97.51%), error:       957.33087, best error:       841.64777 on epoch:    83, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 152.0077209473s, input_fired_time: 1.6138012409, output_fired_time: 1.7237142324, propagate_forward_time: 57.4357147217, propagate_backward_time: 88.0594100952, weight_update_time: 0.1856670380, other_time: 3.1750869751
epoch time: 12.3830146790s, input_fired_time: 0.2341875285, output_fired_time: 0.0000000000, propagate_forward_time: 11.5431680679, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6056594849
validation[          , genome  6228] predictions:    9657/  10000 (96.57%), best:    9751/10000 (97.51%), error:      1093.48108, best error:       841.64777 on epoch:    83, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 193.2270202637s, input_fired_time: 1.8265811205, output_fired_time: 2.0449140072, propagate_forward_time: 72.5154190063, propagate_backward_time: 113.0404586792, weight_update_time: 0.1907452345, other_time: 3.7996520996
epoch time: 12.2849874496s, input_fired_time: 0.2024471760, output_fired_time: 0.0000000000, propagate_forward_time: 11.4733791351, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6091613770
validation[          , genome  6228] predictions:    9625/  10000 (96.25%), best:    9751/10000 (97.51%), error:      1205.82593, best error:       841.64777 on epoch:    83, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 152.9937896729s, input_fired_time: 1.6061353683, output_fired_time: 1.7253388166, propagate_forward_time: 57.8400192261, propagate_backward_time: 88.6145935059, weight_update_time: 0.1834688634, other_time: 3.2076950073
epoch time: 12.7223606110s, input_fired_time: 0.2017288506, output_fired_time: 0.0000000000, propagate_forward_time: 11.9190587997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6015729904
validation[          , genome  6228] predictions:    9732/  10000 (97.32%), best:    9751/10000 (97.51%), error:       896.56299, best error:       841.64777 on epoch:    83, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 153.7191009521s, input_fired_time: 1.6145631075, output_fired_time: 1.7171295881, propagate_forward_time: 57.6485214233, propagate_backward_time: 89.4294738770, weight_update_time: 0.2279277444, other_time: 3.3094100952
epoch time: 12.2658185959s, input_fired_time: 0.2026254088, output_fired_time: 0.0000000000, propagate_forward_time: 11.4974079132, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5657854080
validation[          , genome  6228] predictions:    9739/  10000 (97.39%), best:    9751/10000 (97.51%), error:       868.70117, best error:       841.64777 on epoch:    83, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 145.0588836670s, input_fired_time: 1.5641237497, output_fired_time: 1.6712473631, propagate_forward_time: 53.9934043884, propagate_backward_time: 84.6734313965, weight_update_time: 0.1819872260, other_time: 3.1566772461
epoch time: 19.3850021362s, input_fired_time: 0.2676909268, output_fired_time: 0.0000000000, propagate_forward_time: 18.2222442627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8950672150
validation[          , genome  6228] predictions:    9728/  10000 (97.28%), best:    9751/10000 (97.51%), error:       944.62006, best error:       841.64777 on epoch:    83, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 153.4064636230s, input_fired_time: 1.6484686136, output_fired_time: 1.7569228411, propagate_forward_time: 57.9285888672, propagate_backward_time: 88.8643188477, weight_update_time: 0.1846857220, other_time: 3.2081604004
epoch time: 17.2780780792s, input_fired_time: 0.2362519801, output_fired_time: 0.0000000000, propagate_forward_time: 16.2393913269, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8024349213
validation[          , genome  6228] predictions:    9662/  10000 (96.62%), best:    9751/10000 (97.51%), error:      1063.30261, best error:       841.64777 on epoch:    83, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 151.2866516113s, input_fired_time: 1.6165571213, output_fired_time: 1.6970425844, propagate_forward_time: 56.4247703552, propagate_backward_time: 88.1877593994, weight_update_time: 0.1846608073, other_time: 3.3605194092
epoch time: 12.9135742188s, input_fired_time: 0.2004469186, output_fired_time: 0.0000000000, propagate_forward_time: 12.1145114899, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5986156464
validation[          , genome  6228] predictions:    9708/  10000 (97.08%), best:    9751/10000 (97.51%), error:       959.59424, best error:       841.64777 on epoch:    83, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 153.1318969727s, input_fired_time: 1.6699781418, output_fired_time: 1.7365388870, propagate_forward_time: 57.6972007751, propagate_backward_time: 88.8277435303, weight_update_time: 0.1837476194, other_time: 3.2004241943
epoch time: 12.1784105301s, input_fired_time: 0.2024047822, output_fired_time: 0.0000000000, propagate_forward_time: 11.4065446854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5694608688
validation[          , genome  6228] predictions:    9718/  10000 (97.18%), best:    9751/10000 (97.51%), error:       952.75000, best error:       841.64777 on epoch:    83, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 149.2414703369s, input_fired_time: 1.5981730223, output_fired_time: 1.6920299530, propagate_forward_time: 56.1212654114, propagate_backward_time: 86.6643753052, weight_update_time: 0.1844016463, other_time: 3.1656265259
epoch time: 12.7085676193s, input_fired_time: 0.1994175166, output_fired_time: 0.0000000000, propagate_forward_time: 11.8848381042, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6243124008
validation[          , genome  6228] predictions:    9700/  10000 (97.00%), best:    9751/10000 (97.51%), error:       960.70215, best error:       841.64777 on epoch:    83, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 153.4096679688s, input_fired_time: 1.6382428408, output_fired_time: 1.7630542517, propagate_forward_time: 57.9471473694, propagate_backward_time: 88.8727874756, weight_update_time: 0.1852150112, other_time: 3.1884307861
epoch time: 11.7670049667s, input_fired_time: 0.1886199862, output_fired_time: 0.0000000000, propagate_forward_time: 10.9413270950, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6370582581
validation[          , genome  6228] predictions:    9734/  10000 (97.34%), best:    9751/10000 (97.51%), error:       877.94232, best error:       841.64777 on epoch:    83, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 164.3353424072s, input_fired_time: 1.8289009333, output_fired_time: 1.8990033865, propagate_forward_time: 62.1899948120, propagate_backward_time: 94.9455795288, weight_update_time: 0.1837045699, other_time: 3.4718627930
epoch time: 18.4822158813s, input_fired_time: 0.2992795110, output_fired_time: 0.0000000000, propagate_forward_time: 17.2567539215, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9261817932
validation[          , genome  6228] predictions:    9729/  10000 (97.29%), best:    9751/10000 (97.51%), error:       850.52734, best error:       841.64777 on epoch:    83, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 147.8529205322s, input_fired_time: 1.5304756165, output_fired_time: 1.7013733387, propagate_forward_time: 55.5687255859, propagate_backward_time: 85.8090057373, weight_update_time: 0.2100604624, other_time: 3.2433471680
epoch time: 13.7932510376s, input_fired_time: 0.2645057142, output_fired_time: 0.0000000000, propagate_forward_time: 12.8636512756, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6650943756
validation[          , genome  6228] predictions:    9696/  10000 (96.96%), best:    9751/10000 (97.51%), error:       994.75848, best error:       841.64777 on epoch:    83, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 64.8130645752s, input_fired_time: 1.0323266983, output_fired_time: 0.0000000000, propagate_forward_time: 60.5611190796, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2196197510
best training[          , genome  6228] predictions:   49578/  50000 (99.16%), best:    9751/10000 (97.51%), error:      1862.19958, best error:       841.64777 on epoch:    83, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 15.3601856232s, input_fired_time: 0.2028040588, output_fired_time: 0.0000000000, propagate_forward_time: 14.3841886520, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7731933594
   testing[          , genome  6228] predictions:    9784/  10000 (97.84%), best:    9751/10000 (97.51%), error:       804.48352, best error:       841.64777 on epoch:    83, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
05:13:24 (3056): called boinc_finish(0)

</stderr_txt>
]]>