Nameexact_genome_1512568488_43_6412_0
Workunit2603358
Created7 Dec 2017, 19:42:26 UTC
Sent7 Dec 2017, 19:47:36 UTC
Report deadline18 Dec 2017, 0:43:34 UTC
Received8 Dec 2017, 14:41:57 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time5 hours 41 min 26 sec
CPU time5 hours 34 min 20 sec
Validate stateValid
Credit2,551.39
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.41 MB
Peak swap size158.71 MB
Peak disk usage2.03 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
94.01154 on epoch:    12, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 192.8737182617s, input_fired_time: 1.7784625292, output_fired_time: 1.5921684504, propagate_forward_time: 73.6099395752, propagate_backward_time: 112.3337783813, weight_update_time: 0.1747713089, other_time: 3.5593795776
epoch time: 15.6917753220s, input_fired_time: 0.2241862714, output_fired_time: 0.0000000000, propagate_forward_time: 14.8348598480, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6327295303
validation[          , genome  6412] predictions:    9704/  10000 (97.04%), best:    9701/10000 (97.01%), error:       997.13800, best error:       994.01154 on epoch:    12, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 192.3236541748s, input_fired_time: 1.7754466534, output_fired_time: 1.6161255836, propagate_forward_time: 71.3322830200, propagate_backward_time: 114.0511016846, weight_update_time: 0.1750279367, other_time: 3.5486984253
epoch time: 14.6329021454s, input_fired_time: 0.2239751965, output_fired_time: 0.0000000000, propagate_forward_time: 13.7778615952, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6310653687
validation[          , genome  6412] predictions:    9655/  10000 (96.55%), best:    9701/10000 (97.01%), error:      1163.78064, best error:       994.01154 on epoch:    12, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 193.2815246582s, input_fired_time: 1.7721179724, output_fired_time: 1.5581077337, propagate_forward_time: 71.6709747314, propagate_backward_time: 114.7197494507, weight_update_time: 0.1741296351, other_time: 3.5605697632
epoch time: 15.9773511887s, input_fired_time: 0.2258121818, output_fired_time: 0.0000000000, propagate_forward_time: 15.1247415543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6267976761
validation[          , genome  6412] predictions:    9691/  10000 (96.91%), best:    9701/10000 (97.01%), error:       995.74622, best error:       994.01154 on epoch:    12, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 192.5679626465s, input_fired_time: 1.8056223392, output_fired_time: 1.5653269291, propagate_forward_time: 72.9615554810, propagate_backward_time: 112.6318283081, weight_update_time: 0.1759994179, other_time: 3.6036376953
epoch time: 14.5297946930s, input_fired_time: 0.2214378715, output_fired_time: 0.0000000000, propagate_forward_time: 13.6749744415, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6333827972
validation[          , genome  6412] predictions:    9704/  10000 (97.04%), best:    9701/10000 (97.01%), error:      1021.85394, best error:       994.01154 on epoch:    12, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 195.1867828369s, input_fired_time: 1.8204649687, output_fired_time: 1.5844968557, propagate_forward_time: 75.4332275391, propagate_backward_time: 112.7849960327, weight_update_time: 0.1760541350, other_time: 3.5635910034
epoch time: 16.2961502075s, input_fired_time: 0.2249667346, output_fired_time: 0.0000000000, propagate_forward_time: 15.4173555374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6538286209
validation[          , genome  6412] predictions:    9736/  10000 (97.36%), best:    9736/10000 (97.36%), error:       922.27307, best error:       922.27307 on epoch:    19, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 194.6810760498s, input_fired_time: 1.7719726563, output_fired_time: 1.5761753321, propagate_forward_time: 72.3420562744, propagate_backward_time: 115.4738311768, weight_update_time: 0.1748637557, other_time: 3.5170440674
epoch time: 14.6131343842s, input_fired_time: 0.2215537429, output_fired_time: 0.0000000000, propagate_forward_time: 13.7732820511, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6182985306
validation[          , genome  6412] predictions:    9713/  10000 (97.13%), best:    9736/10000 (97.36%), error:       993.68677, best error:       922.27307 on epoch:    19, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 201.8577880859s, input_fired_time: 1.8449714184, output_fired_time: 1.6119155884, propagate_forward_time: 75.0793533325, propagate_backward_time: 117.6748886108, weight_update_time: 0.1830909103, other_time: 5.6466674805
epoch time: 18.7082633972s, input_fired_time: 0.2433891147, output_fired_time: 0.0000000000, propagate_forward_time: 17.7215042114, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7433700562
validation[          , genome  6412] predictions:    9687/  10000 (96.87%), best:    9736/10000 (97.36%), error:      1043.23364, best error:       922.27307 on epoch:    19, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 205.5958099365s, input_fired_time: 1.9024513960, output_fired_time: 1.6955761909, propagate_forward_time: 77.2922744751, propagate_backward_time: 120.9145202637, weight_update_time: 0.1849622577, other_time: 3.7909927368
epoch time: 22.3427791595s, input_fired_time: 0.3414911628, output_fired_time: 0.0000000000, propagate_forward_time: 21.1067848206, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8945026398
validation[          , genome  6412] predictions:    9715/  10000 (97.15%), best:    9736/10000 (97.36%), error:      1010.15686, best error:       922.27307 on epoch:    19, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 192.2564697266s, input_fired_time: 1.7782064676, output_fired_time: 1.5572974682, propagate_forward_time: 72.7788772583, propagate_backward_time: 112.6153182983, weight_update_time: 0.1749996543, other_time: 3.5267639160
epoch time: 15.8852052689s, input_fired_time: 0.2272924483, output_fired_time: 0.0000000000, propagate_forward_time: 15.0281047821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6298084259
validation[          , genome  6412] predictions:    9679/  10000 (96.79%), best:    9736/10000 (97.36%), error:      1089.90686, best error:       922.27307 on epoch:    19, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 194.1776275635s, input_fired_time: 1.7854403257, output_fired_time: 1.5558224916, propagate_forward_time: 74.9619598389, propagate_backward_time: 111.3817825317, weight_update_time: 0.1754818559, other_time: 4.4926223755
epoch time: 15.9812002182s, input_fired_time: 0.2293572277, output_fired_time: 0.0000000000, propagate_forward_time: 15.1161737442, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6356697083
validation[          , genome  6412] predictions:    9631/  10000 (96.31%), best:    9736/10000 (97.36%), error:      1172.29724, best error:       922.27307 on epoch:    19, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 197.9163665771s, input_fired_time: 1.8356244564, output_fired_time: 1.6432802677, propagate_forward_time: 73.4436264038, propagate_backward_time: 117.2910385132, weight_update_time: 0.1762321144, other_time: 3.7028045654
epoch time: 14.7242164612s, input_fired_time: 0.2263619602, output_fired_time: 0.0000000000, propagate_forward_time: 13.8697843552, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6280698776
validation[          , genome  6412] predictions:    9720/  10000 (97.20%), best:    9736/10000 (97.36%), error:       930.73401, best error:       922.27307 on epoch:    19, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 194.7549591064s, input_fired_time: 2.8191566467, output_fired_time: 1.5699182749, propagate_forward_time: 72.1514968872, propagate_backward_time: 114.5860137939, weight_update_time: 0.1822829545, other_time: 3.6283798218
epoch time: 15.9646615982s, input_fired_time: 0.2312171608, output_fired_time: 0.0000000000, propagate_forward_time: 15.0890083313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6444358826
validation[          , genome  6412] predictions:    9720/  10000 (97.20%), best:    9736/10000 (97.36%), error:       938.20270, best error:       922.27307 on epoch:    19, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 197.2031555176s, input_fired_time: 1.8278131485, output_fired_time: 1.6308164597, propagate_forward_time: 76.2553405762, propagate_backward_time: 113.8258743286, weight_update_time: 0.1772724986, other_time: 3.6633071899
epoch time: 15.9481582642s, input_fired_time: 0.2255023271, output_fired_time: 0.0000000000, propagate_forward_time: 15.0986766815, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6239795685
validation[          , genome  6412] predictions:    9711/  10000 (97.11%), best:    9736/10000 (97.36%), error:       924.10614, best error:       922.27307 on epoch:    19, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 191.9465942383s, input_fired_time: 1.7907313108, output_fired_time: 1.5637643337, propagate_forward_time: 72.6491546631, propagate_backward_time: 112.3722610474, weight_update_time: 0.1753298938, other_time: 3.5706863403
epoch time: 15.9527044296s, input_fired_time: 0.2296001017, output_fired_time: 0.0000000000, propagate_forward_time: 15.0934648514, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6296396255
validation[          , genome  6412] predictions:    9627/  10000 (96.27%), best:    9736/10000 (97.36%), error:      1242.20959, best error:       922.27307 on epoch:    19, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 193.6990051270s, input_fired_time: 1.7825733423, output_fired_time: 1.5859730244, propagate_forward_time: 74.8858718872, propagate_backward_time: 111.8786544800, weight_update_time: 0.1755019724, other_time: 3.5659332275
epoch time: 16.1087398529s, input_fired_time: 0.2296617180, output_fired_time: 0.0000000000, propagate_forward_time: 15.2434978485, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6355800629
validation[          , genome  6412] predictions:    9684/  10000 (96.84%), best:    9736/10000 (97.36%), error:      1004.24518, best error:       922.27307 on epoch:    19, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 192.3609619141s, input_fired_time: 1.7821503878, output_fired_time: 1.5631930828, propagate_forward_time: 71.7001495361, propagate_backward_time: 113.7235412598, weight_update_time: 0.1783671975, other_time: 3.5919342041
epoch time: 15.6163740158s, input_fired_time: 0.2270266265, output_fired_time: 0.0000000000, propagate_forward_time: 14.7656030655, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6237440109
validation[          , genome  6412] predictions:    9725/  10000 (97.25%), best:    9725/10000 (97.25%), error:       919.28925, best error:       919.28925 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 196.6237487793s, input_fired_time: 1.7855267525, output_fired_time: 1.6349117756, propagate_forward_time: 76.8260574341, propagate_backward_time: 112.8045654297, weight_update_time: 0.1752433926, other_time: 3.5726852417
epoch time: 15.6342592239s, input_fired_time: 0.2282610238, output_fired_time: 0.0000000000, propagate_forward_time: 14.7770118713, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6289863586
validation[          , genome  6412] predictions:    9659/  10000 (96.59%), best:    9725/10000 (97.25%), error:      1240.23438, best error:       919.28925 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 200.3184051514s, input_fired_time: 1.7926313877, output_fired_time: 1.6174950600, propagate_forward_time: 75.1147003174, propagate_backward_time: 118.1118240356, weight_update_time: 0.1837999821, other_time: 3.6817550659
epoch time: 14.3754587173s, input_fired_time: 0.2225960642, output_fired_time: 0.0000000000, propagate_forward_time: 13.5403203964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6125421524
validation[          , genome  6412] predictions:    9737/  10000 (97.37%), best:    9737/10000 (97.37%), error:       828.94525, best error:       828.94525 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 194.5727081299s, input_fired_time: 1.7892093658, output_fired_time: 1.5681689978, propagate_forward_time: 74.0068817139, propagate_backward_time: 113.5825424194, weight_update_time: 0.1758582741, other_time: 3.6258926392
epoch time: 16.5829582214s, input_fired_time: 0.2300462723, output_fired_time: 0.0000000000, propagate_forward_time: 15.7013769150, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6515359879
validation[          , genome  6412] predictions:    9686/  10000 (96.86%), best:    9737/10000 (97.37%), error:       999.50439, best error:       828.94525 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 193.8710021973s, input_fired_time: 1.7828803062, output_fired_time: 3.5865108967, propagate_forward_time: 74.8448486328, propagate_backward_time: 110.0829620361, weight_update_time: 0.1753787547, other_time: 3.5737915039
epoch time: 14.6388940811s, input_fired_time: 0.2272035033, output_fired_time: 0.0000000000, propagate_forward_time: 13.7879009247, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6237897873
validation[          , genome  6412] predictions:    9739/  10000 (97.39%), best:    9737/10000 (97.37%), error:       872.05627, best error:       828.94525 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 211.4044494629s, input_fired_time: 1.9761804342, output_fired_time: 1.6933555603, propagate_forward_time: 81.5150222778, propagate_backward_time: 122.3433151245, weight_update_time: 0.1943283528, other_time: 3.8765716553
epoch time: 16.0236473083s, input_fired_time: 0.2305153608, output_fired_time: 0.0000000000, propagate_forward_time: 14.1466550827, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6464767456
validation[          , genome  6412] predictions:    9687/  10000 (96.87%), best:    9737/10000 (97.37%), error:       954.39966, best error:       828.94525 on epoch:    32, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 197.6245880127s, input_fired_time: 1.8424698114, output_fired_time: 1.6091933250, propagate_forward_time: 74.4530563354, propagate_backward_time: 116.0778274536, weight_update_time: 0.1788662970, other_time: 3.6420440674
epoch time: 20.2490100861s, input_fired_time: 0.3342754841, output_fired_time: 0.0000000000, propagate_forward_time: 19.0872421265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8274917603
validation[          , genome  6412] predictions:    9724/  10000 (97.24%), best:    9737/10000 (97.37%), error:       958.03827, best error:       828.94525 on epoch:    32, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 200.3471832275s, input_fired_time: 1.8914117813, output_fired_time: 1.6855332851, propagate_forward_time: 75.5395126343, propagate_backward_time: 117.4692077637, weight_update_time: 0.1751925349, other_time: 3.7615127563
epoch time: 15.8396692276s, input_fired_time: 0.2296499014, output_fired_time: 0.0000000000, propagate_forward_time: 14.9831886292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6268310547
validation[          , genome  6412] predictions:    9751/  10000 (97.51%), best:    9737/10000 (97.37%), error:       851.68439, best error:       828.94525 on epoch:    32, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 194.6236114502s, input_fired_time: 1.8109095097, output_fired_time: 1.5833067894, propagate_forward_time: 74.5055999756, propagate_backward_time: 113.1333923340, weight_update_time: 0.1768235713, other_time: 3.5903930664
epoch time: 17.6126174927s, input_fired_time: 0.2307118326, output_fired_time: 0.0000000000, propagate_forward_time: 16.6894855499, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6924209595
validation[          , genome  6412] predictions:    9751/  10000 (97.51%), best:    9737/10000 (97.37%), error:       863.72821, best error:       828.94525 on epoch:    32, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 195.1611633301s, input_fired_time: 1.7959078550, output_fired_time: 1.5838952065, propagate_forward_time: 75.5447082520, propagate_backward_time: 111.6236038208, weight_update_time: 0.1759436876, other_time: 4.6130447388
epoch time: 15.6797637939s, input_fired_time: 0.2281545252, output_fired_time: 0.0000000000, propagate_forward_time: 14.8244934082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6271162033
validation[          , genome  6412] predictions:    9721/  10000 (97.21%), best:    9737/10000 (97.37%), error:       953.96198, best error:       828.94525 on epoch:    32, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 212.5363616943s, input_fired_time: 2.9962184429, output_fired_time: 1.7861764431, propagate_forward_time: 78.9743728638, propagate_backward_time: 124.9122238159, weight_update_time: 0.1831884086, other_time: 3.8673782349
epoch time: 15.8508462906s, input_fired_time: 0.2311663032, output_fired_time: 0.0000000000, propagate_forward_time: 14.9891796112, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6305007935
validation[          , genome  6412] predictions:    9745/  10000 (97.45%), best:    9737/10000 (97.37%), error:       832.64740, best error:       828.94525 on epoch:    32, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 196.6829833984s, input_fired_time: 1.8078263998, output_fired_time: 1.5799404383, propagate_forward_time: 74.8250656128, propagate_backward_time: 114.8553466797, weight_update_time: 0.1757858992, other_time: 3.6147994995
epoch time: 15.8798599243s, input_fired_time: 0.2304464877, output_fired_time: 0.0000000000, propagate_forward_time: 14.9944801331, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6549329758
validation[          , genome  6412] predictions:    9694/  10000 (96.94%), best:    9737/10000 (97.37%), error:      1041.24915, best error:       828.94525 on epoch:    32, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 195.4624176025s, input_fired_time: 1.7969675064, output_fired_time: 2.5874211788, propagate_forward_time: 75.4438323975, propagate_backward_time: 112.0050201416, weight_update_time: 0.1754155010, other_time: 3.6291809082
epoch time: 14.3538103104s, input_fired_time: 0.2236008346, output_fired_time: 0.0000000000, propagate_forward_time: 13.5172128677, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6129970551
validation[          , genome  6412] predictions:    9762/  10000 (97.62%), best:    9762/10000 (97.62%), error:       815.85864, best error:       815.85864 on epoch:    42, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 194.1505432129s, input_fired_time: 1.7871056795, output_fired_time: 1.5717352629, propagate_forward_time: 71.9772644043, propagate_backward_time: 114.2467727661, weight_update_time: 0.1762370020, other_time: 4.5676651001
epoch time: 16.2666072845s, input_fired_time: 0.2319941670, output_fired_time: 0.0000000000, propagate_forward_time: 15.3796081543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6550045013
validation[          , genome  6412] predictions:    9755/  10000 (97.55%), best:    9762/10000 (97.62%), error:       873.52216, best error:       815.85864 on epoch:    42, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 196.1540374756s, input_fired_time: 1.8671715260, output_fired_time: 1.5703479052, propagate_forward_time: 78.9151077271, propagate_backward_time: 110.2140350342, weight_update_time: 0.1750524044, other_time: 3.5873794556
epoch time: 16.0674362183s, input_fired_time: 0.2270471007, output_fired_time: 0.0000000000, propagate_forward_time: 15.2219867706, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6184024811
validation[          , genome  6412] predictions:    9749/  10000 (97.49%), best:    9762/10000 (97.62%), error:       821.81476, best error:       815.85864 on epoch:    42, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 199.9841308594s, input_fired_time: 1.8704586029, output_fired_time: 1.6222875118, propagate_forward_time: 78.4458618164, propagate_backward_time: 114.4776840210, weight_update_time: 0.1752723008, other_time: 3.5678482056
epoch time: 15.7394161224s, input_fired_time: 0.2422382534, output_fired_time: 0.0000000000, propagate_forward_time: 14.7893486023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7078294754
validation[          , genome  6412] predictions:    9753/  10000 (97.53%), best:    9762/10000 (97.62%), error:       819.07477, best error:       815.85864 on epoch:    42, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 195.2716827393s, input_fired_time: 1.7945532799, output_fired_time: 1.5690774918, propagate_forward_time: 75.2798385620, propagate_backward_time: 112.9887161255, weight_update_time: 0.1759579778, other_time: 3.6394958496
epoch time: 19.7980384827s, input_fired_time: 0.2645590007, output_fired_time: 0.0000000000, propagate_forward_time: 18.7497329712, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7837467194
validation[          , genome  6412] predictions:    9723/  10000 (97.23%), best:    9762/10000 (97.62%), error:       897.90033, best error:       815.85864 on epoch:    42, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 200.5711669922s, input_fired_time: 1.8425934315, output_fired_time: 1.6366977692, propagate_forward_time: 75.4679031372, propagate_backward_time: 117.9942016602, weight_update_time: 0.1760931760, other_time: 3.6297683716
epoch time: 15.7701015472s, input_fired_time: 0.2301449180, output_fired_time: 0.0000000000, propagate_forward_time: 14.8939704895, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6459865570
validation[          , genome  6412] predictions:    9771/  10000 (97.71%), best:    9771/10000 (97.71%), error:       789.75952, best error:       789.75952 on epoch:    47, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 192.6995697021s, input_fired_time: 1.7936342955, output_fired_time: 1.5497273207, propagate_forward_time: 72.5800247192, propagate_backward_time: 113.0999526978, weight_update_time: 0.1757130623, other_time: 3.6762237549
epoch time: 14.6394882202s, input_fired_time: 0.2277874649, output_fired_time: 0.0000000000, propagate_forward_time: 13.7906808853, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6210203171
validation[          , genome  6412] predictions:    9718/  10000 (97.18%), best:    9771/10000 (97.71%), error:       928.84790, best error:       789.75952 on epoch:    47, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 191.6762084961s, input_fired_time: 1.7879030704, output_fired_time: 1.5615301132, propagate_forward_time: 76.3329925537, propagate_backward_time: 108.4201202393, weight_update_time: 0.1742377281, other_time: 3.5736694336
epoch time: 16.0695724487s, input_fired_time: 0.2335159183, output_fired_time: 0.0000000000, propagate_forward_time: 15.2078285217, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6282281876
validation[          , genome  6412] predictions:    9742/  10000 (97.42%), best:    9771/10000 (97.71%), error:       848.40796, best error:       789.75952 on epoch:    47, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 191.8982696533s, input_fired_time: 1.7981350422, output_fired_time: 1.5620951653, propagate_forward_time: 71.0474166870, propagate_backward_time: 112.5297470093, weight_update_time: 0.1763121933, other_time: 4.9608764648
epoch time: 15.8493690491s, input_fired_time: 0.2435606122, output_fired_time: 0.0000000000, propagate_forward_time: 14.9815521240, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6242561340
validation[          , genome  6412] predictions:    9747/  10000 (97.47%), best:    9771/10000 (97.71%), error:       862.26312, best error:       789.75952 on epoch:    47, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 195.0057067871s, input_fired_time: 1.7956187725, output_fired_time: 1.5807012320, propagate_forward_time: 71.3255386353, propagate_backward_time: 114.7351989746, weight_update_time: 0.1755255014, other_time: 5.5686416626
epoch time: 18.3170738220s, input_fired_time: 0.2656204998, output_fired_time: 0.0000000000, propagate_forward_time: 17.2848701477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7665824890
validation[          , genome  6412] predictions:    9775/  10000 (97.75%), best:    9775/10000 (97.75%), error:       759.80518, best error:       759.80518 on epoch:    51, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 193.1586914063s, input_fired_time: 1.8205342293, output_fired_time: 1.5635337830, propagate_forward_time: 74.7094573975, propagate_backward_time: 111.5136337280, weight_update_time: 0.1751788855, other_time: 3.5515213013
epoch time: 14.6296167374s, input_fired_time: 0.2264693826, output_fired_time: 0.0000000000, propagate_forward_time: 13.7658624649, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6372852325
validation[          , genome  6412] predictions:    9736/  10000 (97.36%), best:    9775/10000 (97.75%), error:       866.16022, best error:       759.80518 on epoch:    51, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 203.7734832764s, input_fired_time: 2.8633005619, output_fired_time: 1.6327972412, propagate_forward_time: 76.3456802368, propagate_backward_time: 118.1907806396, weight_update_time: 0.1766988337, other_time: 4.7409286499
epoch time: 15.6976509094s, input_fired_time: 0.2270128429, output_fired_time: 0.0000000000, propagate_forward_time: 14.8590612411, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6115770340
validation[          , genome  6412] predictions:    9763/  10000 (97.63%), best:    9775/10000 (97.75%), error:       792.17627, best error:       759.80518 on epoch:    51, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 193.4175109863s, input_fired_time: 1.8024430275, output_fired_time: 1.5740426779, propagate_forward_time: 74.7604598999, propagate_backward_time: 111.6891174316, weight_update_time: 0.1754667312, other_time: 3.5914535522
epoch time: 16.0004043579s, input_fired_time: 0.2327316254, output_fired_time: 0.0000000000, propagate_forward_time: 15.1270799637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6405925751
validation[          , genome  6412] predictions:    9739/  10000 (97.39%), best:    9775/10000 (97.75%), error:       836.44806, best error:       759.80518 on epoch:    51, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 197.8540802002s, input_fired_time: 1.8333517313, output_fired_time: 1.5798147917, propagate_forward_time: 74.3670349121, propagate_backward_time: 116.3637161255, weight_update_time: 0.1840868890, other_time: 3.7101516724
epoch time: 16.2714042664s, input_fired_time: 0.2283675075, output_fired_time: 0.0000000000, propagate_forward_time: 15.3974952698, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6455421448
validation[          , genome  6412] predictions:    9736/  10000 (97.36%), best:    9775/10000 (97.75%), error:       849.28137, best error:       759.80518 on epoch:    51, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 192.8826751709s, input_fired_time: 1.8136434555, output_fired_time: 1.5639443398, propagate_forward_time: 69.7419128418, propagate_backward_time: 116.1904067993, weight_update_time: 0.1754794866, other_time: 3.5727615356
epoch time: 22.6787090302s, input_fired_time: 0.3584015071, output_fired_time: 0.0000000000, propagate_forward_time: 21.3544178009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9658889771
validation[          , genome  6412] predictions:    9737/  10000 (97.37%), best:    9775/10000 (97.75%), error:       922.04730, best error:       759.80518 on epoch:    51, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 194.6685638428s, input_fired_time: 1.7936285734, output_fired_time: 1.5732715130, propagate_forward_time: 75.2864151001, propagate_backward_time: 112.4237136841, weight_update_time: 0.1744722426, other_time: 3.5915374756
epoch time: 15.8050107956s, input_fired_time: 0.2296308577, output_fired_time: 0.0000000000, propagate_forward_time: 14.9412593842, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6341209412
validation[          , genome  6412] predictions:    9713/  10000 (97.13%), best:    9775/10000 (97.75%), error:       923.41425, best error:       759.80518 on epoch:    51, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 192.6182556152s, input_fired_time: 1.7959765196, output_fired_time: 1.5591405630, propagate_forward_time: 72.5354385376, propagate_backward_time: 113.1780090332, weight_update_time: 0.1750596762, other_time: 3.5496902466
epoch time: 14.8027048111s, input_fired_time: 0.2265442163, output_fired_time: 0.0000000000, propagate_forward_time: 13.9632606506, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6128997803
validation[          , genome  6412] predictions:    9734/  10000 (97.34%), best:    9775/10000 (97.75%), error:       891.59485, best error:       759.80518 on epoch:    51, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 193.4661254883s, input_fired_time: 1.8008261919, output_fired_time: 1.5648922920, propagate_forward_time: 74.6985626221, propagate_backward_time: 111.8127670288, weight_update_time: 0.1760668606, other_time: 3.5890731812
epoch time: 15.7932481766s, input_fired_time: 0.2304450572, output_fired_time: 0.0000000000, propagate_forward_time: 14.9353151321, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6274881363
validation[          , genome  6412] predictions:    9757/  10000 (97.57%), best:    9775/10000 (97.75%), error:       867.95331, best error:       759.80518 on epoch:    51, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 190.6105651855s, input_fired_time: 1.7947616577, output_fired_time: 1.5614837408, propagate_forward_time: 71.8128967285, propagate_backward_time: 111.8919754028, weight_update_time: 0.1752438098, other_time: 3.5494461060
epoch time: 15.8680114746s, input_fired_time: 0.2324921787, output_fired_time: 0.0000000000, propagate_forward_time: 15.0067224503, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6287965775
validation[          , genome  6412] predictions:    9755/  10000 (97.55%), best:    9775/10000 (97.75%), error:       854.13312, best error:       759.80518 on epoch:    51, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 193.1986083984s, input_fired_time: 1.8018538952, output_fired_time: 1.5568910837, propagate_forward_time: 73.4651794434, propagate_backward_time: 112.7536621094, weight_update_time: 0.1911998093, other_time: 3.6210327148
epoch time: 20.8187522888s, input_fired_time: 0.2991133034, output_fired_time: 0.0000000000, propagate_forward_time: 18.6854190826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8342189789
validation[          , genome  6412] predictions:    9769/  10000 (97.69%), best:    9775/10000 (97.75%), error:       770.16870, best error:       759.80518 on epoch:    51, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 193.6583251953s, input_fired_time: 1.8123841286, output_fired_time: 1.5571861267, propagate_forward_time: 73.8011474609, propagate_backward_time: 111.9122085571, weight_update_time: 0.1749181151, other_time: 4.5754013062
epoch time: 21.4176673889s, input_fired_time: 0.2826638222, output_fired_time: 0.0000000000, propagate_forward_time: 20.2886829376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8463211060
validation[          , genome  6412] predictions:    9759/  10000 (97.59%), best:    9775/10000 (97.75%), error:       804.15161, best error:       759.80518 on epoch:    51, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 200.1156463623s, input_fired_time: 1.8284286261, output_fired_time: 1.6395937204, propagate_forward_time: 74.8680801392, propagate_backward_time: 118.1782150269, weight_update_time: 0.1908228546, other_time: 3.6013336182
epoch time: 14.6980724335s, input_fired_time: 0.2290888876, output_fired_time: 0.0000000000, propagate_forward_time: 13.8501586914, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6188249588
validation[          , genome  6412] predictions:    9743/  10000 (97.43%), best:    9775/10000 (97.75%), error:       892.88196, best error:       759.80518 on epoch:    51, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 193.1110992432s, input_fired_time: 1.8420270681, output_fired_time: 2.5801873207, propagate_forward_time: 72.2895126343, propagate_backward_time: 111.7636108398, weight_update_time: 0.1749366075, other_time: 4.6357650757
epoch time: 15.9770326614s, input_fired_time: 0.2383580506, output_fired_time: 0.0000000000, propagate_forward_time: 15.0897026062, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6489715576
validation[          , genome  6412] predictions:    9697/  10000 (96.97%), best:    9775/10000 (97.75%), error:      1035.69727, best error:       759.80518 on epoch:    51, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 193.1340942383s, input_fired_time: 1.7994976044, output_fired_time: 1.5564525127, propagate_forward_time: 74.7417221069, propagate_backward_time: 110.4895401001, weight_update_time: 0.1746125221, other_time: 4.5468750000
epoch time: 14.9415493011s, input_fired_time: 0.2434038222, output_fired_time: 0.0000000000, propagate_forward_time: 14.0462255478, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6519203186
validation[          , genome  6412] predictions:    9764/  10000 (97.64%), best:    9775/10000 (97.75%), error:       781.65442, best error:       759.80518 on epoch:    51, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 212.4394836426s, input_fired_time: 1.9620864391, output_fired_time: 1.6643183231, propagate_forward_time: 79.8895416260, propagate_backward_time: 125.0546951294, weight_update_time: 0.1785916388, other_time: 3.8688430786
epoch time: 16.0386886597s, input_fired_time: 0.2335702032, output_fired_time: 0.0000000000, propagate_forward_time: 15.1656494141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6394691467
validation[          , genome  6412] predictions:    9741/  10000 (97.41%), best:    9775/10000 (97.75%), error:       872.24207, best error:       759.80518 on epoch:    51, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 197.1023559570s, input_fired_time: 1.8312267065, output_fired_time: 1.6336525679, propagate_forward_time: 76.4384841919, propagate_backward_time: 113.5630722046, weight_update_time: 0.1844744086, other_time: 3.6359252930
epoch time: 14.5013837814s, input_fired_time: 0.2264108658, output_fired_time: 0.0000000000, propagate_forward_time: 13.6529798508, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6219930649
validation[          , genome  6412] predictions:    9745/  10000 (97.45%), best:    9775/10000 (97.75%), error:       843.87195, best error:       759.80518 on epoch:    51, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 193.5804290771s, input_fired_time: 1.8078601360, output_fired_time: 1.5781987906, propagate_forward_time: 72.9532623291, propagate_backward_time: 113.6389541626, weight_update_time: 0.1752464324, other_time: 3.6021499634
epoch time: 15.8222255707s, input_fired_time: 0.2327295989, output_fired_time: 0.0000000000, propagate_forward_time: 14.9582643509, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6312313080
validation[          , genome  6412] predictions:    9755/  10000 (97.55%), best:    9775/10000 (97.75%), error:       796.56207, best error:       759.80518 on epoch:    51, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 193.9276275635s, input_fired_time: 1.8062187433, output_fired_time: 1.7204048634, propagate_forward_time: 73.9674835205, propagate_backward_time: 112.8475494385, weight_update_time: 0.1757659614, other_time: 3.5859832764
epoch time: 14.5948905945s, input_fired_time: 0.2274244279, output_fired_time: 0.0000000000, propagate_forward_time: 13.7553615570, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6121044159
validation[          , genome  6412] predictions:    9773/  10000 (97.73%), best:    9775/10000 (97.75%), error:       796.13184, best error:       759.80518 on epoch:    51, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 206.3908843994s, input_fired_time: 2.9792847633, output_fired_time: 1.6482131481, propagate_forward_time: 76.2216262817, propagate_backward_time: 121.7258300781, weight_update_time: 0.1823098361, other_time: 3.8159408569
epoch time: 14.5317678452s, input_fired_time: 0.2253265083, output_fired_time: 0.0000000000, propagate_forward_time: 13.6920957565, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6143455505
validation[          , genome  6412] predictions:    9762/  10000 (97.62%), best:    9775/10000 (97.75%), error:       805.89221, best error:       759.80518 on epoch:    51, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 193.9968719482s, input_fired_time: 1.8074436188, output_fired_time: 1.5686376095, propagate_forward_time: 74.0755004883, propagate_backward_time: 113.0004730225, weight_update_time: 0.1767084599, other_time: 3.5448150635
epoch time: 15.6523361206s, input_fired_time: 0.2299631983, output_fired_time: 0.0000000000, propagate_forward_time: 14.7993097305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6230630875
validation[          , genome  6412] predictions:    9742/  10000 (97.42%), best:    9775/10000 (97.75%), error:       879.56677, best error:       759.80518 on epoch:    51, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 192.3706817627s, input_fired_time: 1.8090325594, output_fired_time: 1.5551441908, propagate_forward_time: 72.4976959229, propagate_backward_time: 111.9176101685, weight_update_time: 0.1756496280, other_time: 4.5911941528
epoch time: 14.7411947250s, input_fired_time: 0.2297696918, output_fired_time: 0.0000000000, propagate_forward_time: 13.8857917786, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6256332397
validation[          , genome  6412] predictions:    9734/  10000 (97.34%), best:    9775/10000 (97.75%), error:       859.15192, best error:       759.80518 on epoch:    51, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 198.6264953613s, input_fired_time: 1.8465301991, output_fired_time: 1.5932836533, propagate_forward_time: 77.0320205688, propagate_backward_time: 113.6487197876, weight_update_time: 0.1753099412, other_time: 4.5059509277
epoch time: 15.9733476639s, input_fired_time: 0.2345579118, output_fired_time: 0.0000000000, propagate_forward_time: 15.1015806198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6372089386
validation[          , genome  6412] predictions:    9671/  10000 (96.71%), best:    9775/10000 (97.75%), error:      1117.63928, best error:       759.80518 on epoch:    51, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 203.2023773193s, input_fired_time: 1.8933578730, output_fired_time: 1.6467561722, propagate_forward_time: 75.5475006104, propagate_backward_time: 119.3234558105, weight_update_time: 0.1987033784, other_time: 4.7913055420
epoch time: 16.0765800476s, input_fired_time: 0.2300154865, output_fired_time: 0.0000000000, propagate_forward_time: 15.2255172729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6210470200
validation[          , genome  6412] predictions:    9757/  10000 (97.57%), best:    9775/10000 (97.75%), error:       832.18787, best error:       759.80518 on epoch:    51, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 198.7380218506s, input_fired_time: 1.8745748997, output_fired_time: 1.6131216288, propagate_forward_time: 77.0407943726, propagate_backward_time: 114.5926818848, weight_update_time: 0.1754363775, other_time: 3.6168441772
epoch time: 16.0184116364s, input_fired_time: 0.2322663814, output_fired_time: 0.0000000000, propagate_forward_time: 15.1622247696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6239204407
validation[          , genome  6412] predictions:    9768/  10000 (97.68%), best:    9775/10000 (97.75%), error:       793.24701, best error:       759.80518 on epoch:    51, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 200.6783752441s, input_fired_time: 1.9426354170, output_fired_time: 2.6187546253, propagate_forward_time: 73.2237167358, propagate_backward_time: 118.3621902466, weight_update_time: 0.1833546907, other_time: 4.5310668945
epoch time: 15.7333221436s, input_fired_time: 0.2319585681, output_fired_time: 0.0000000000, propagate_forward_time: 14.8767414093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6246223450
validation[          , genome  6412] predictions:    9768/  10000 (97.68%), best:    9775/10000 (97.75%), error:       787.52899, best error:       759.80518 on epoch:    51, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 194.0444641113s, input_fired_time: 1.8310084343, output_fired_time: 1.6284755468, propagate_forward_time: 73.2253646851, propagate_backward_time: 113.6404495239, weight_update_time: 0.1767105460, other_time: 3.7191619873
epoch time: 15.7715415955s, input_fired_time: 0.2344303727, output_fired_time: 0.0000000000, propagate_forward_time: 14.8910083771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6461029053
validation[          , genome  6412] predictions:    9729/  10000 (97.29%), best:    9775/10000 (97.75%), error:       873.66406, best error:       759.80518 on epoch:    51, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 197.1018066406s, input_fired_time: 1.8271522522, output_fired_time: 1.6090195179, propagate_forward_time: 73.2943191528, propagate_backward_time: 115.7690505981, weight_update_time: 0.1808191091, other_time: 4.6022644043
epoch time: 16.2243614197s, input_fired_time: 0.2381376177, output_fired_time: 0.0000000000, propagate_forward_time: 15.3174428940, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6687812805
validation[          , genome  6412] predictions:    9707/  10000 (97.07%), best:    9775/10000 (97.75%), error:       916.52039, best error:       759.80518 on epoch:    51, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 196.0567321777s, input_fired_time: 2.9039843082, output_fired_time: 1.5821182728, propagate_forward_time: 72.6753387451, propagate_backward_time: 114.2024002075, weight_update_time: 0.1774215847, other_time: 4.6928787231
epoch time: 15.4005174637s, input_fired_time: 0.2360000163, output_fired_time: 0.0000000000, propagate_forward_time: 14.4863996506, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6781177521
validation[          , genome  6412] predictions:    9772/  10000 (97.72%), best:    9775/10000 (97.75%), error:       803.91235, best error:       759.80518 on epoch:    51, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 193.6001281738s, input_fired_time: 1.8133034706, output_fired_time: 1.5651935339, propagate_forward_time: 73.6423797607, propagate_backward_time: 111.9177398682, weight_update_time: 0.1760620028, other_time: 4.6614990234
epoch time: 16.1269626617s, input_fired_time: 0.2433553487, output_fired_time: 0.0000000000, propagate_forward_time: 15.2275848389, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6560220718
validation[          , genome  6412] predictions:    9768/  10000 (97.68%), best:    9775/10000 (97.75%), error:       782.27972, best error:       759.80518 on epoch:    51, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 195.3145446777s, input_fired_time: 1.8248866796, output_fired_time: 1.5838568211, propagate_forward_time: 72.3414840698, propagate_backward_time: 115.9094390869, weight_update_time: 0.1779967248, other_time: 3.6548690796
epoch time: 14.7368059158s, input_fired_time: 0.2375360429, output_fired_time: 0.0000000000, propagate_forward_time: 13.8318595886, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6674098969
validation[          , genome  6412] predictions:    9697/  10000 (96.97%), best:    9775/10000 (97.75%), error:      1022.53662, best error:       759.80518 on epoch:    51, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 194.0832977295s, input_fired_time: 1.8337444067, output_fired_time: 1.6161931753, propagate_forward_time: 74.6196746826, propagate_backward_time: 111.3954696655, weight_update_time: 0.1883035898, other_time: 4.6182174683
epoch time: 15.8867435455s, input_fired_time: 0.2338434011, output_fired_time: 0.0000000000, propagate_forward_time: 15.0046577454, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6482419968
validation[          , genome  6412] predictions:    9726/  10000 (97.26%), best:    9775/10000 (97.75%), error:       891.30670, best error:       759.80518 on epoch:    51, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 192.5988159180s, input_fired_time: 1.8196700811, output_fired_time: 1.5594967604, propagate_forward_time: 71.3396530151, propagate_backward_time: 114.1993865967, weight_update_time: 0.1774016470, other_time: 3.6806106567
epoch time: 14.5646448135s, input_fired_time: 0.2333161533, output_fired_time: 0.0000000000, propagate_forward_time: 13.6753568649, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6559715271
validation[          , genome  6412] predictions:    9749/  10000 (97.49%), best:    9775/10000 (97.75%), error:       808.82770, best error:       759.80518 on epoch:    51, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 193.4788513184s, input_fired_time: 1.8198350668, output_fired_time: 1.6144311428, propagate_forward_time: 72.7858886719, propagate_backward_time: 113.6070938110, weight_update_time: 0.1760169566, other_time: 3.6516036987
epoch time: 15.5878391266s, input_fired_time: 0.2326582968, output_fired_time: 0.0000000000, propagate_forward_time: 14.7212448120, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6339359283
validation[          , genome  6412] predictions:    9734/  10000 (97.34%), best:    9775/10000 (97.75%), error:       891.04639, best error:       759.80518 on epoch:    51, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 190.9095153809s, input_fired_time: 2.8264009953, output_fired_time: 1.5593541861, propagate_forward_time: 71.8888778687, propagate_backward_time: 109.9865646362, weight_update_time: 0.1757693291, other_time: 4.6483154297
epoch time: 15.8987941742s, input_fired_time: 0.2367389202, output_fired_time: 0.0000000000, propagate_forward_time: 15.0163192749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6457357407
validation[          , genome  6412] predictions:    9777/  10000 (97.77%), best:    9775/10000 (97.75%), error:       777.51434, best error:       759.80518 on epoch:    51, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 198.6701049805s, input_fired_time: 1.8647053242, output_fired_time: 1.5941783190, propagate_forward_time: 76.7822799683, propagate_backward_time: 114.5639648438, weight_update_time: 0.1849327832, other_time: 3.8649826050
epoch time: 15.8971586227s, input_fired_time: 0.2372745574, output_fired_time: 0.0000000000, propagate_forward_time: 14.9755992889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6842851639
validation[          , genome  6412] predictions:    9785/  10000 (97.85%), best:    9775/10000 (97.75%), error:       763.94092, best error:       759.80518 on epoch:    51, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 198.8591918945s, input_fired_time: 1.9387845993, output_fired_time: 1.6463069916, propagate_forward_time: 74.5412979126, propagate_backward_time: 116.9132843018, weight_update_time: 0.1892584115, other_time: 3.8195266724
epoch time: 15.7122411728s, input_fired_time: 0.2343066782, output_fired_time: 0.0000000000, propagate_forward_time: 14.8213357925, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6565990448
validation[          , genome  6412] predictions:    9720/  10000 (97.20%), best:    9775/10000 (97.75%), error:       913.22607, best error:       759.80518 on epoch:    51, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 198.6465759277s, input_fired_time: 1.9207115173, output_fired_time: 1.6445910931, propagate_forward_time: 71.9765319824, propagate_backward_time: 119.1643524170, weight_update_time: 0.1787390858, other_time: 3.9403839111
epoch time: 14.5400648117s, input_fired_time: 0.2291680872, output_fired_time: 0.0000000000, propagate_forward_time: 13.6836957932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6272010803
validation[          , genome  6412] predictions:    9762/  10000 (97.62%), best:    9775/10000 (97.75%), error:       805.90808, best error:       759.80518 on epoch:    51, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 191.6338958740s, input_fired_time: 1.8221820593, output_fired_time: 1.5556391478, propagate_forward_time: 73.7244033813, propagate_backward_time: 110.7549133301, weight_update_time: 0.1787792295, other_time: 3.7767562866
epoch time: 15.7149953842s, input_fired_time: 0.2388648093, output_fired_time: 0.0000000000, propagate_forward_time: 14.8012857437, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6748447418
validation[          , genome  6412] predictions:    9761/  10000 (97.61%), best:    9775/10000 (97.75%), error:       776.75287, best error:       759.80518 on epoch:    51, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 190.0101623535s, input_fired_time: 1.8201718330, output_fired_time: 1.5545907021, propagate_forward_time: 71.5082321167, propagate_backward_time: 110.3320236206, weight_update_time: 0.1768561751, other_time: 4.7951354980
epoch time: 15.7349805832s, input_fired_time: 0.2355118692, output_fired_time: 0.0000000000, propagate_forward_time: 14.8111133575, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6883554459
validation[          , genome  6412] predictions:    9669/  10000 (96.69%), best:    9775/10000 (97.75%), error:      1094.72302, best error:       759.80518 on epoch:    51, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 192.6407470703s, input_fired_time: 1.8350021839, output_fired_time: 1.5671113729, propagate_forward_time: 74.2159423828, propagate_backward_time: 111.1781387329, weight_update_time: 0.1776489764, other_time: 3.8445510864
epoch time: 15.3712482452s, input_fired_time: 0.2289559841, output_fired_time: 0.0000000000, propagate_forward_time: 14.4701719284, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6721200943
validation[          , genome  6412] predictions:    9711/  10000 (97.11%), best:    9775/10000 (97.75%), error:       979.48041, best error:       759.80518 on epoch:    51, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 192.3774871826s, input_fired_time: 1.8272781372, output_fired_time: 1.5757662058, propagate_forward_time: 75.3638229370, propagate_backward_time: 109.8398590088, weight_update_time: 0.1776199788, other_time: 3.7707595825
epoch time: 15.6988019943s, input_fired_time: 0.2307025641, output_fired_time: 0.0000000000, propagate_forward_time: 13.7857446671, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6823549271
validation[          , genome  6412] predictions:    9663/  10000 (96.63%), best:    9775/10000 (97.75%), error:      1165.19177, best error:       759.80518 on epoch:    51, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 197.6601867676s, input_fired_time: 1.8649903536, output_fired_time: 1.6097245216, propagate_forward_time: 74.7216796875, propagate_backward_time: 115.3908691406, weight_update_time: 0.1907042414, other_time: 4.0729217529
epoch time: 16.4545440674s, input_fired_time: 0.2434849292, output_fired_time: 0.0000000000, propagate_forward_time: 14.4281225204, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7829370499
validation[          , genome  6412] predictions:    9751/  10000 (97.51%), best:    9775/10000 (97.75%), error:       835.71619, best error:       759.80518 on epoch:    51, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 193.7314910889s, input_fired_time: 1.8303146362, output_fired_time: 1.6130814552, propagate_forward_time: 75.0285949707, propagate_backward_time: 111.4501953125, weight_update_time: 0.1766817421, other_time: 3.8093109131
epoch time: 16.0317020416s, input_fired_time: 0.2372178584, output_fired_time: 0.0000000000, propagate_forward_time: 15.1545009613, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6399831772
validation[          , genome  6412] predictions:    9742/  10000 (97.42%), best:    9775/10000 (97.75%), error:       857.86157, best error:       759.80518 on epoch:    51, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 198.1453247070s, input_fired_time: 1.8963686228, output_fired_time: 2.6517379284, propagate_forward_time: 72.6341323853, propagate_backward_time: 116.1142120361, weight_update_time: 0.1772451848, other_time: 4.8488845825
epoch time: 15.8331413269s, input_fired_time: 0.2358671874, output_fired_time: 0.0000000000, propagate_forward_time: 14.9283781052, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6688957214
validation[          , genome  6412] predictions:    9727/  10000 (97.27%), best:    9775/10000 (97.75%), error:       953.61627, best error:       759.80518 on epoch:    51, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 193.5114288330s, input_fired_time: 1.8379790783, output_fired_time: 1.5645011663, propagate_forward_time: 73.6619033813, propagate_backward_time: 110.7287216187, weight_update_time: 0.1774196476, other_time: 5.7183227539
epoch time: 14.4920368195s, input_fired_time: 0.2308203578, output_fired_time: 0.0000000000, propagate_forward_time: 13.6008691788, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6603469849
validation[          , genome  6412] predictions:    9754/  10000 (97.54%), best:    9775/10000 (97.75%), error:       837.28564, best error:       759.80518 on epoch:    51, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 192.6451721191s, input_fired_time: 1.8319965601, output_fired_time: 1.5643649101, propagate_forward_time: 75.2473220825, propagate_backward_time: 110.2056884766, weight_update_time: 0.1777949631, other_time: 3.7957992554
epoch time: 15.9141883850s, input_fired_time: 0.2358255982, output_fired_time: 0.0000000000, propagate_forward_time: 14.9959917068, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6823711395
validation[          , genome  6412] predictions:    9723/  10000 (97.23%), best:    9775/10000 (97.75%), error:       904.01367, best error:       759.80518 on epoch:    51, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 194.8950042725s, input_fired_time: 1.8525581360, output_fired_time: 2.5148229599, propagate_forward_time: 72.7650985718, propagate_backward_time: 113.9020538330, weight_update_time: 0.1785236746, other_time: 3.8604812622
epoch time: 14.5219449997s, input_fired_time: 0.2321417630, output_fired_time: 0.0000000000, propagate_forward_time: 13.6006412506, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6891622543
validation[          , genome  6412] predictions:    9765/  10000 (97.65%), best:    9775/10000 (97.75%), error:       812.48358, best error:       759.80518 on epoch:    51, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 191.5130462646s, input_fired_time: 1.8926297426, output_fired_time: 1.5744907856, propagate_forward_time: 70.8416290283, propagate_backward_time: 113.4408645630, weight_update_time: 0.1774508804, other_time: 3.7634353638
epoch time: 15.8623294830s, input_fired_time: 0.2370941788, output_fired_time: 0.0000000000, propagate_forward_time: 14.9358654022, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6893701553
validation[          , genome  6412] predictions:    9748/  10000 (97.48%), best:    9775/10000 (97.75%), error:       853.17157, best error:       759.80518 on epoch:    51, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 191.6006774902s, input_fired_time: 1.8266762495, output_fired_time: 2.5967900753, propagate_forward_time: 73.2561645508, propagate_backward_time: 110.2118301392, weight_update_time: 0.1771792471, other_time: 3.7092208862
epoch time: 15.8680953979s, input_fired_time: 0.2361119092, output_fired_time: 0.0000000000, propagate_forward_time: 14.9462528229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6857309341
validation[          , genome  6412] predictions:    9749/  10000 (97.49%), best:    9775/10000 (97.75%), error:       841.38940, best error:       759.80518 on epoch:    51, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 77.2471923828s, input_fired_time: 1.1536806822, output_fired_time: 0.0000000000, propagate_forward_time: 72.6903305054, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4031829834
best training[          , genome  6412] predictions:   49486/  50000 (98.97%), best:    9775/10000 (97.75%), error:      1970.57715, best error:       759.80518 on epoch:    51, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 25.7213554382s, input_fired_time: 0.2309219539, output_fired_time: 0.0000000000, propagate_forward_time: 24.8386764526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6517562866
   testing[          , genome  6412] predictions:    9784/  10000 (97.84%), best:    9775/10000 (97.75%), error:       710.34973, best error:       759.80518 on epoch:    51, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
06:01:15 (11640): called boinc_finish(0)

</stderr_txt>
]]>