Nameexact_genome_1512568488_43_5357_1
Workunit2598063
Created7 Dec 2017, 14:27:17 UTC
Sent7 Dec 2017, 14:31:34 UTC
Report deadline15 Dec 2017, 13:49:43 UTC
Received9 Dec 2017, 8:57:49 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID62426
Run time5 hours 28 min 3 sec
CPU time5 hours 10 min 9 sec
Validate stateValid
Credit1,992.74
Device peak FLOPS2.98 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size153.85 MB
Peak swap size152.20 MB
Peak disk usage1.88 MB

Stderr output

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
t error:       983.50348 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 156.6291961670s, input_fired_time: 1.3578683138, output_fired_time: 1.4950671196, propagate_forward_time: 59.1426925659, propagate_backward_time: 91.5923919678, weight_update_time: 0.2007274926, other_time: 3.0411758423
epoch time: 14.2014961243s, input_fired_time: 0.1760018915, output_fired_time: 0.0000000000, propagate_forward_time: 13.4744386673, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5510559082
validation[          , genome  5357] predictions:    9677/  10000 (96.77%), best:    9697/10000 (96.97%), error:      1040.45544, best error:       983.50348 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 178.2258453369s, input_fired_time: 1.4902637005, output_fired_time: 1.6873873472, propagate_forward_time: 68.2470321655, propagate_backward_time: 103.5908279419, weight_update_time: 0.2104858011, other_time: 3.2103271484
epoch time: 12.2054128647s, input_fired_time: 0.1575729698, output_fired_time: 0.0000000000, propagate_forward_time: 11.5011720657, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5466680527
validation[          , genome  5357] predictions:    9667/  10000 (96.67%), best:    9697/10000 (96.97%), error:      1025.82153, best error:       983.50348 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 179.5860900879s, input_fired_time: 1.4742364883, output_fired_time: 1.6131296158, propagate_forward_time: 67.5783767700, propagate_backward_time: 105.7331008911, weight_update_time: 0.2095276713, other_time: 3.1872406006
epoch time: 15.4364538193s, input_fired_time: 0.1790558249, output_fired_time: 0.0000000000, propagate_forward_time: 14.6961050034, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5612926483
validation[          , genome  5357] predictions:    9663/  10000 (96.63%), best:    9697/10000 (96.97%), error:      1089.06738, best error:       983.50348 on epoch:    14, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 176.0123291016s, input_fired_time: 1.4875156879, output_fired_time: 1.6534447670, propagate_forward_time: 67.3528594971, propagate_backward_time: 102.3185958862, weight_update_time: 0.2243561894, other_time: 3.1999130249
epoch time: 16.8023262024s, input_fired_time: 0.2768998146, output_fired_time: 0.0000000000, propagate_forward_time: 15.8734378815, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6519889832
validation[          , genome  5357] predictions:    9658/  10000 (96.58%), best:    9697/10000 (96.97%), error:      1146.40710, best error:       983.50348 on epoch:    14, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 176.8024597168s, input_fired_time: 1.5351577997, output_fired_time: 1.8150129318, propagate_forward_time: 67.7521591187, propagate_backward_time: 102.3142089844, weight_update_time: 0.2162285298, other_time: 3.3859176636
epoch time: 15.5440359116s, input_fired_time: 0.1949640363, output_fired_time: 0.0000000000, propagate_forward_time: 14.5494203568, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7996511459
validation[          , genome  5357] predictions:    9703/  10000 (97.03%), best:    9703/10000 (97.03%), error:       963.91583, best error:       963.91583 on epoch:    19, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 175.8302764893s, input_fired_time: 1.4368703365, output_fired_time: 1.6259196997, propagate_forward_time: 67.4072418213, propagate_backward_time: 102.1201782227, weight_update_time: 0.2067648470, other_time: 3.2400665283
epoch time: 14.2115592957s, input_fired_time: 0.1785711199, output_fired_time: 0.0000000000, propagate_forward_time: 13.4502420425, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5827465057
validation[          , genome  5357] predictions:    9706/  10000 (97.06%), best:    9703/10000 (97.03%), error:      1060.05603, best error:       963.91583 on epoch:    19, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 188.5936737061s, input_fired_time: 1.4478074312, output_fired_time: 1.7214577198, propagate_forward_time: 72.8053436279, propagate_backward_time: 109.3862228394, weight_update_time: 0.2579659820, other_time: 3.2328414917
epoch time: 16.2681674957s, input_fired_time: 0.2185360342, output_fired_time: 0.0000000000, propagate_forward_time: 15.4713172913, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5783138275
validation[          , genome  5357] predictions:    9711/  10000 (97.11%), best:    9711/10000 (97.11%), error:       946.50049, best error:       946.50049 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 181.9925537109s, input_fired_time: 1.5319237709, output_fired_time: 1.5904171467, propagate_forward_time: 68.1078643799, propagate_backward_time: 107.5296630859, weight_update_time: 0.2071858943, other_time: 3.2326812744
epoch time: 17.2155704498s, input_fired_time: 0.2250309289, output_fired_time: 0.0000000000, propagate_forward_time: 16.3070087433, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6835308075
validation[          , genome  5357] predictions:    9654/  10000 (96.54%), best:    9711/10000 (97.11%), error:      1154.83386, best error:       946.50049 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 172.9195861816s, input_fired_time: 1.4815717936, output_fired_time: 1.6251944304, propagate_forward_time: 66.3370285034, propagate_backward_time: 100.2799224854, weight_update_time: 0.2067448348, other_time: 3.1958694458
epoch time: 15.4471092224s, input_fired_time: 0.1774450690, output_fired_time: 0.0000000000, propagate_forward_time: 14.7084865570, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5611772537
validation[          , genome  5357] predictions:    9702/  10000 (97.02%), best:    9702/10000 (97.02%), error:       932.63080, best error:       932.63080 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 173.6563110352s, input_fired_time: 1.4714030027, output_fired_time: 1.6031564474, propagate_forward_time: 66.1410827637, propagate_backward_time: 101.2822647095, weight_update_time: 0.2072659731, other_time: 3.1584091187
epoch time: 20.1638031006s, input_fired_time: 0.4700129330, output_fired_time: 0.0000000000, propagate_forward_time: 18.9547023773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7390880585
validation[          , genome  5357] predictions:    9724/  10000 (97.24%), best:    9724/10000 (97.24%), error:       928.12048, best error:       928.12048 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 186.7578887939s, input_fired_time: 1.4525343180, output_fired_time: 1.6754370928, propagate_forward_time: 71.8607711792, propagate_backward_time: 108.4212265015, weight_update_time: 0.2079620659, other_time: 3.3479309082
epoch time: 16.0815849304s, input_fired_time: 0.2099861652, output_fired_time: 0.0000000000, propagate_forward_time: 15.1291074753, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7424917221
validation[          , genome  5357] predictions:    9701/  10000 (97.01%), best:    9724/10000 (97.24%), error:       995.30969, best error:       928.12048 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 171.5545196533s, input_fired_time: 1.4429854155, output_fired_time: 1.5907480717, propagate_forward_time: 65.9859542847, propagate_backward_time: 99.4601135254, weight_update_time: 0.2066847384, other_time: 3.0747299194
epoch time: 13.8089418411s, input_fired_time: 0.1770755947, output_fired_time: 0.0000000000, propagate_forward_time: 13.0808601379, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5510063171
validation[          , genome  5357] predictions:    9709/  10000 (97.09%), best:    9724/10000 (97.24%), error:       995.22723, best error:       928.12048 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 173.5466766357s, input_fired_time: 1.4468597174, output_fired_time: 1.6359415054, propagate_forward_time: 66.6562728882, propagate_backward_time: 100.6655502319, weight_update_time: 0.2078093737, other_time: 3.1420593262
epoch time: 14.8579835892s, input_fired_time: 0.1823725402, output_fired_time: 0.0000000000, propagate_forward_time: 14.0726356506, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6029758453
validation[          , genome  5357] predictions:    9702/  10000 (97.02%), best:    9724/10000 (97.24%), error:       932.90955, best error:       928.12048 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 173.4787292480s, input_fired_time: 1.4439038038, output_fired_time: 1.5905210972, propagate_forward_time: 66.5734252930, propagate_backward_time: 100.7821350098, weight_update_time: 0.2065688521, other_time: 3.0887451172
epoch time: 14.1378707886s, input_fired_time: 0.1799712330, output_fired_time: 0.0000000000, propagate_forward_time: 13.3990316391, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5588674545
validation[          , genome  5357] predictions:    9692/  10000 (96.92%), best:    9724/10000 (97.24%), error:       997.41614, best error:       928.12048 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 173.1451568604s, input_fired_time: 1.4479868412, output_fired_time: 1.6234731674, propagate_forward_time: 66.3680725098, propagate_backward_time: 100.5796432495, weight_update_time: 0.2069946826, other_time: 3.1259841919
epoch time: 15.6231527328s, input_fired_time: 0.2270088047, output_fired_time: 0.0000000000, propagate_forward_time: 14.8071460724, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5889978409
validation[          , genome  5357] predictions:    9730/  10000 (97.30%), best:    9730/10000 (97.30%), error:       910.12323, best error:       910.12323 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 172.6689147949s, input_fired_time: 1.4495806694, output_fired_time: 1.6388421059, propagate_forward_time: 66.2719268799, propagate_backward_time: 100.1874542236, weight_update_time: 0.2069592327, other_time: 3.1211090088
epoch time: 17.7580776215s, input_fired_time: 0.2129906118, output_fired_time: 0.0000000000, propagate_forward_time: 16.9398155212, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6052722931
validation[          , genome  5357] predictions:    9733/  10000 (97.33%), best:    9733/10000 (97.33%), error:       886.15698, best error:       886.15698 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 172.1799316406s, input_fired_time: 1.4742977619, output_fired_time: 1.6234471798, propagate_forward_time: 65.7654190063, propagate_backward_time: 100.2080230713, weight_update_time: 0.2071875334, other_time: 3.1087417603
epoch time: 15.5225200653s, input_fired_time: 0.1790254265, output_fired_time: 0.0000000000, propagate_forward_time: 14.6823225021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6611719131
validation[          , genome  5357] predictions:    9733/  10000 (97.33%), best:    9733/10000 (97.33%), error:       849.73621, best error:       849.73621 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 172.1234588623s, input_fired_time: 1.4457789660, output_fired_time: 1.5952380896, propagate_forward_time: 65.9521179199, propagate_backward_time: 100.0070724487, weight_update_time: 0.2067413479, other_time: 3.1232376099
epoch time: 15.5917310715s, input_fired_time: 0.1784067899, output_fired_time: 0.0000000000, propagate_forward_time: 14.6716737747, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7416505814
validation[          , genome  5357] predictions:    9692/  10000 (96.92%), best:    9733/10000 (97.33%), error:      1014.14044, best error:       849.73621 on epoch:    31, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 174.5661468506s, input_fired_time: 1.4913151264, output_fired_time: 1.6245493889, propagate_forward_time: 66.2985229492, propagate_backward_time: 102.0583496094, weight_update_time: 0.2111291587, other_time: 3.0934143066
epoch time: 19.6268482208s, input_fired_time: 0.1808284670, output_fired_time: 0.0000000000, propagate_forward_time: 18.6086330414, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8373870850
validation[          , genome  5357] predictions:    9713/  10000 (97.13%), best:    9733/10000 (97.33%), error:       940.59644, best error:       849.73621 on epoch:    31, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 174.2354736328s, input_fired_time: 1.4980294704, output_fired_time: 1.6428753138, propagate_forward_time: 66.8421020508, propagate_backward_time: 101.1349792480, weight_update_time: 0.2074242234, other_time: 3.1174926758
epoch time: 16.9760513306s, input_fired_time: 0.2223261446, output_fired_time: 0.0000000000, propagate_forward_time: 16.0023937225, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7513313293
validation[          , genome  5357] predictions:    9741/  10000 (97.41%), best:    9741/10000 (97.41%), error:       846.44745, best error:       846.44745 on epoch:    34, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 172.7560577393s, input_fired_time: 1.5086698532, output_fired_time: 1.6338803768, propagate_forward_time: 66.1791000366, propagate_backward_time: 100.2515029907, weight_update_time: 0.2070901692, other_time: 3.1829071045
epoch time: 19.7773094177s, input_fired_time: 0.1786292642, output_fired_time: 0.0000000000, propagate_forward_time: 18.8599758148, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7387046814
validation[          , genome  5357] predictions:    9688/  10000 (96.88%), best:    9741/10000 (97.41%), error:      1002.56158, best error:       846.44745 on epoch:    34, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 171.3084564209s, input_fired_time: 1.4339524508, output_fired_time: 1.5840867758, propagate_forward_time: 65.4431304932, propagate_backward_time: 99.7275924683, weight_update_time: 0.2060799301, other_time: 3.1196823120
epoch time: 14.8989982605s, input_fired_time: 0.1794569343, output_fired_time: 0.0000000000, propagate_forward_time: 14.0673055649, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6522359848
validation[          , genome  5357] predictions:    9691/  10000 (96.91%), best:    9741/10000 (97.41%), error:       969.63812, best error:       846.44745 on epoch:    34, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 181.3353881836s, input_fired_time: 1.4476276636, output_fired_time: 1.6846928596, propagate_forward_time: 69.7192764282, propagate_backward_time: 105.2034149170, weight_update_time: 0.2066335976, other_time: 3.2803726196
epoch time: 17.0427112579s, input_fired_time: 0.2725594938, output_fired_time: 0.0000000000, propagate_forward_time: 16.1355838776, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6345672607
validation[          , genome  5357] predictions:    9715/  10000 (97.15%), best:    9741/10000 (97.41%), error:       880.47668, best error:       846.44745 on epoch:    34, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 181.8099822998s, input_fired_time: 1.5697803497, output_fired_time: 1.6291590929, propagate_forward_time: 69.7358398438, propagate_backward_time: 105.3602447510, weight_update_time: 0.2063783109, other_time: 3.5149536133
epoch time: 15.5312213898s, input_fired_time: 0.2261709422, output_fired_time: 0.0000000000, propagate_forward_time: 14.7504444122, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5546064377
validation[          , genome  5357] predictions:    9734/  10000 (97.34%), best:    9741/10000 (97.41%), error:       861.71460, best error:       846.44745 on epoch:    34, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 172.7049255371s, input_fired_time: 1.4389541149, output_fired_time: 1.5832293034, propagate_forward_time: 66.1090393066, propagate_backward_time: 100.4350128174, weight_update_time: 0.2065007389, other_time: 3.1386871338
epoch time: 13.8235263824s, input_fired_time: 0.1769711971, output_fired_time: 0.0000000000, propagate_forward_time: 13.0972976685, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5492572784
validation[          , genome  5357] predictions:    9707/  10000 (97.07%), best:    9741/10000 (97.41%), error:       987.86816, best error:       846.44745 on epoch:    34, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 174.9240112305s, input_fired_time: 1.5039490461, output_fired_time: 1.5942999125, propagate_forward_time: 67.0390167236, propagate_backward_time: 101.6181945801, weight_update_time: 0.2075301707, other_time: 3.1685485840
epoch time: 15.4203109741s, input_fired_time: 0.1821476966, output_fired_time: 0.0000000000, propagate_forward_time: 14.6800642014, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5580987930
validation[          , genome  5357] predictions:    9681/  10000 (96.81%), best:    9741/10000 (97.41%), error:       965.46295, best error:       846.44745 on epoch:    34, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 182.6114501953s, input_fired_time: 1.4867305756, output_fired_time: 1.6284394264, propagate_forward_time: 70.1915969849, propagate_backward_time: 106.1423721313, weight_update_time: 0.2064552754, other_time: 3.1623229980
epoch time: 15.3431072235s, input_fired_time: 0.1786488593, output_fired_time: 0.0000000000, propagate_forward_time: 14.5763530731, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5881052017
validation[          , genome  5357] predictions:    9710/  10000 (97.10%), best:    9741/10000 (97.41%), error:       960.04303, best error:       846.44745 on epoch:    34, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 184.2408447266s, input_fired_time: 1.5111215115, output_fired_time: 1.7260565758, propagate_forward_time: 70.2962722778, propagate_backward_time: 107.2104492188, weight_update_time: 0.2115235478, other_time: 3.4969406128
epoch time: 14.6229486465s, input_fired_time: 0.2265609652, output_fired_time: 0.0000000000, propagate_forward_time: 13.8506832123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5457048416
validation[          , genome  5357] predictions:    9707/  10000 (97.07%), best:    9741/10000 (97.41%), error:       880.44843, best error:       846.44745 on epoch:    34, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 176.6912841797s, input_fired_time: 1.4421315193, output_fired_time: 1.6318572760, propagate_forward_time: 66.4440460205, propagate_backward_time: 104.0957107544, weight_update_time: 0.2086237222, other_time: 3.0775375366
epoch time: 14.5661220551s, input_fired_time: 0.1809555739, output_fired_time: 0.0000000000, propagate_forward_time: 13.7323760986, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6527900696
validation[          , genome  5357] predictions:    9737/  10000 (97.37%), best:    9737/10000 (97.37%), error:       840.57886, best error:       840.57886 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 172.6178131104s, input_fired_time: 1.4978104830, output_fired_time: 1.6185332537, propagate_forward_time: 66.1695022583, propagate_backward_time: 100.2144088745, weight_update_time: 0.2072687149, other_time: 3.1175537109
epoch time: 14.2679500580s, input_fired_time: 0.1775644422, output_fired_time: 0.0000000000, propagate_forward_time: 13.4858665466, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6045188904
validation[          , genome  5357] predictions:    9706/  10000 (97.06%), best:    9737/10000 (97.37%), error:       919.47833, best error:       840.57886 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 177.3809356689s, input_fired_time: 1.5439748764, output_fired_time: 1.6081423759, propagate_forward_time: 67.9808349609, propagate_backward_time: 103.1017532349, weight_update_time: 0.2118982226, other_time: 3.1462326050
epoch time: 19.8479518890s, input_fired_time: 0.2619000673, output_fired_time: 0.0000000000, propagate_forward_time: 18.8026008606, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7834510803
validation[          , genome  5357] predictions:    9722/  10000 (97.22%), best:    9737/10000 (97.37%), error:       894.98718, best error:       840.57886 on epoch:    43, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 189.8270111084s, input_fired_time: 1.4988708496, output_fired_time: 1.8124032021, propagate_forward_time: 72.7860412598, propagate_backward_time: 110.2606658936, weight_update_time: 0.2551767230, other_time: 3.4690246582
epoch time: 14.7436571121s, input_fired_time: 0.1823706478, output_fired_time: 0.0000000000, propagate_forward_time: 14.0008983612, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5603885651
validation[          , genome  5357] predictions:    9723/  10000 (97.23%), best:    9737/10000 (97.37%), error:       892.42749, best error:       840.57886 on epoch:    43, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 200.3513336182s, input_fired_time: 1.6785885096, output_fired_time: 1.8466485739, propagate_forward_time: 73.1514663696, propagate_backward_time: 120.2278060913, weight_update_time: 0.2525513172, other_time: 3.4468231201
epoch time: 13.9255561829s, input_fired_time: 0.1806121320, output_fired_time: 0.0000000000, propagate_forward_time: 13.1863632202, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5585803986
validation[          , genome  5357] predictions:    9749/  10000 (97.49%), best:    9737/10000 (97.37%), error:       863.14276, best error:       840.57886 on epoch:    43, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 173.0110778809s, input_fired_time: 1.4514893293, output_fired_time: 1.5969052315, propagate_forward_time: 66.4147796631, propagate_backward_time: 100.4188079834, weight_update_time: 0.2067281455, other_time: 3.1290893555
epoch time: 13.7105646133s, input_fired_time: 0.1777519137, output_fired_time: 0.0000000000, propagate_forward_time: 12.9822912216, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5505218506
validation[          , genome  5357] predictions:    9724/  10000 (97.24%), best:    9737/10000 (97.37%), error:       905.45483, best error:       840.57886 on epoch:    43, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 184.4132537842s, input_fired_time: 1.4415655136, output_fired_time: 1.6684067249, propagate_forward_time: 68.7216796875, propagate_backward_time: 109.3708343506, weight_update_time: 0.2064865083, other_time: 3.2107696533
epoch time: 15.4945802689s, input_fired_time: 0.1802287400, output_fired_time: 0.0000000000, propagate_forward_time: 14.7114343643, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6029167175
validation[          , genome  5357] predictions:    9712/  10000 (97.12%), best:    9737/10000 (97.37%), error:       900.61975, best error:       840.57886 on epoch:    43, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 180.1618804932s, input_fired_time: 1.5484086275, output_fired_time: 1.5943133831, propagate_forward_time: 69.7856674194, propagate_backward_time: 104.0276412964, weight_update_time: 0.2070962638, other_time: 3.2058410645
epoch time: 17.1846351624s, input_fired_time: 0.2743071020, output_fired_time: 0.0000000000, propagate_forward_time: 16.3048896790, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6054382324
validation[          , genome  5357] predictions:    9713/  10000 (97.13%), best:    9737/10000 (97.37%), error:       961.52411, best error:       840.57886 on epoch:    43, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 171.8967132568s, input_fired_time: 1.5345499516, output_fired_time: 1.5649875402, propagate_forward_time: 67.0929641724, propagate_backward_time: 98.4594802856, weight_update_time: 0.2955855131, other_time: 3.2447357178
epoch time: 13.8718366623s, input_fired_time: 0.1810633391, output_fired_time: 0.0000000000, propagate_forward_time: 13.1324682236, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5583047867
validation[          , genome  5357] predictions:    9726/  10000 (97.26%), best:    9737/10000 (97.37%), error:       887.09039, best error:       840.57886 on epoch:    43, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 170.4184417725s, input_fired_time: 1.4755594730, output_fired_time: 1.6167142391, propagate_forward_time: 65.2281646729, propagate_backward_time: 98.9483566284, weight_update_time: 0.2064037472, other_time: 3.1496505737
epoch time: 15.2105779648s, input_fired_time: 0.1778127551, output_fired_time: 0.0000000000, propagate_forward_time: 14.3638210297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6689443588
validation[          , genome  5357] predictions:    9763/  10000 (97.63%), best:    9763/10000 (97.63%), error:       791.87274, best error:       791.87274 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 153.7124328613s, input_fired_time: 1.4048695564, output_fired_time: 1.4582644701, propagate_forward_time: 57.7888412476, propagate_backward_time: 89.9652099609, weight_update_time: 0.1986232400, other_time: 3.0952377319
epoch time: 18.3587398529s, input_fired_time: 0.2135565579, output_fired_time: 0.0000000000, propagate_forward_time: 17.3601646423, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7850189209
validation[          , genome  5357] predictions:    9704/  10000 (97.04%), best:    9763/10000 (97.63%), error:       945.98804, best error:       791.87274 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 173.6862640381s, input_fired_time: 1.4967197180, output_fired_time: 1.6338768005, propagate_forward_time: 66.6188354492, propagate_backward_time: 100.7502822876, weight_update_time: 0.2082080245, other_time: 3.1865463257
epoch time: 16.6660232544s, input_fired_time: 0.2132362276, output_fired_time: 0.0000000000, propagate_forward_time: 15.7867412567, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6660461426
validation[          , genome  5357] predictions:    9714/  10000 (97.14%), best:    9763/10000 (97.63%), error:      1022.41675, best error:       791.87274 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 195.2713012695s, input_fired_time: 1.4467712641, output_fired_time: 1.5687408447, propagate_forward_time: 90.6201629639, propagate_backward_time: 98.4547882080, weight_update_time: 0.2062501460, other_time: 3.1808319092
epoch time: 16.6153907776s, input_fired_time: 0.1832811236, output_fired_time: 0.0000000000, propagate_forward_time: 15.8735446930, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5585651398
validation[          , genome  5357] predictions:    9669/  10000 (96.69%), best:    9763/10000 (97.63%), error:      1031.10046, best error:       791.87274 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 178.0876159668s, input_fired_time: 1.4546834230, output_fired_time: 1.5937862396, propagate_forward_time: 70.8210906982, propagate_backward_time: 101.0266189575, weight_update_time: 0.2073438317, other_time: 3.1914443970
epoch time: 14.3177213669s, input_fired_time: 0.1819463521, output_fired_time: 0.0000000000, propagate_forward_time: 13.5744142532, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5613603592
validation[          , genome  5357] predictions:    9679/  10000 (96.79%), best:    9763/10000 (97.63%), error:      1012.52533, best error:       791.87274 on epoch:    52, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 178.4423675537s, input_fired_time: 1.4506244659, output_fired_time: 1.5824238062, propagate_forward_time: 65.8816528320, propagate_backward_time: 106.3955459595, weight_update_time: 0.2071929276, other_time: 3.1321182251
epoch time: 22.4194393158s, input_fired_time: 0.2133687586, output_fired_time: 0.0000000000, propagate_forward_time: 21.5187568665, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6873130798
validation[          , genome  5357] predictions:    9746/  10000 (97.46%), best:    9763/10000 (97.63%), error:       832.11188, best error:       791.87274 on epoch:    52, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 175.9144287109s, input_fired_time: 1.4979361296, output_fired_time: 1.6067194939, propagate_forward_time: 68.7889938354, propagate_backward_time: 100.8227157593, weight_update_time: 0.2065976560, other_time: 3.1980590820
epoch time: 14.6470737457s, input_fired_time: 0.1803419292, output_fired_time: 0.0000000000, propagate_forward_time: 13.8841638565, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5825681686
validation[          , genome  5357] predictions:    9702/  10000 (97.02%), best:    9763/10000 (97.63%), error:       891.45941, best error:       791.87274 on epoch:    52, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 171.9342346191s, input_fired_time: 1.4542344809, output_fired_time: 1.6280037165, propagate_forward_time: 65.8855133057, propagate_backward_time: 99.8275299072, weight_update_time: 0.2071898133, other_time: 3.1389465332
epoch time: 14.0743455887s, input_fired_time: 0.1821862757, output_fired_time: 0.0000000000, propagate_forward_time: 13.3153982162, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5767612457
validation[          , genome  5357] predictions:    9646/  10000 (96.46%), best:    9763/10000 (97.63%), error:      1117.78833, best error:       791.87274 on epoch:    52, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 175.2076873779s, input_fired_time: 1.4694012403, output_fired_time: 1.5864912271, propagate_forward_time: 67.1712417603, propagate_backward_time: 101.7109069824, weight_update_time: 0.2075547129, other_time: 3.2696456909
epoch time: 14.2245807648s, input_fired_time: 0.2146810740, output_fired_time: 0.0000000000, propagate_forward_time: 13.4502744675, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5596256256
validation[          , genome  5357] predictions:    9704/  10000 (97.04%), best:    9763/10000 (97.63%), error:       991.35693, best error:       791.87274 on epoch:    52, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 179.7966156006s, input_fired_time: 1.5877341032, output_fired_time: 1.6640958786, propagate_forward_time: 68.9226989746, propagate_backward_time: 104.3332901001, weight_update_time: 0.2399616092, other_time: 3.2887954712
epoch time: 14.0318279266s, input_fired_time: 0.1816045344, output_fired_time: 0.0000000000, propagate_forward_time: 13.2951059341, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5551176071
validation[          , genome  5357] predictions:    9732/  10000 (97.32%), best:    9763/10000 (97.63%), error:       865.61261, best error:       791.87274 on epoch:    52, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 173.0762939453s, input_fired_time: 1.4830471277, output_fired_time: 1.5868628025, propagate_forward_time: 65.8048553467, propagate_backward_time: 101.0526046753, weight_update_time: 0.2090660632, other_time: 3.1489181519
epoch time: 22.2089977264s, input_fired_time: 0.2148719877, output_fired_time: 0.0000000000, propagate_forward_time: 21.3796386719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6144866943
validation[          , genome  5357] predictions:    9727/  10000 (97.27%), best:    9763/10000 (97.63%), error:       885.44385, best error:       791.87274 on epoch:    52, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 182.7933654785s, input_fired_time: 1.5384664536, output_fired_time: 1.7943770885, propagate_forward_time: 69.7834625244, propagate_backward_time: 106.3631362915, weight_update_time: 0.2403466552, other_time: 3.3139266968
epoch time: 16.2112808228s, input_fired_time: 0.1799111664, output_fired_time: 0.0000000000, propagate_forward_time: 15.4627161026, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5686540604
validation[          , genome  5357] predictions:    9722/  10000 (97.22%), best:    9763/10000 (97.63%), error:       895.98602, best error:       791.87274 on epoch:    52, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 175.9320678711s, input_fired_time: 1.4713854790, output_fired_time: 1.5877504349, propagate_forward_time: 66.7581253052, propagate_backward_time: 102.9365310669, weight_update_time: 0.2158470899, other_time: 3.1782684326
epoch time: 15.0905780792s, input_fired_time: 0.2729324400, output_fired_time: 0.0000000000, propagate_forward_time: 14.2559328079, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5617132187
validation[          , genome  5357] predictions:    9722/  10000 (97.22%), best:    9763/10000 (97.63%), error:       903.93274, best error:       791.87274 on epoch:    52, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 181.3711853027s, input_fired_time: 1.6169360876, output_fired_time: 1.6306059361, propagate_forward_time: 69.5964126587, propagate_backward_time: 105.2573547363, weight_update_time: 0.2063066810, other_time: 3.2698745728
epoch time: 20.4834957123s, input_fired_time: 0.2160407454, output_fired_time: 0.0000000000, propagate_forward_time: 19.7031784058, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5642757416
validation[          , genome  5357] predictions:    9741/  10000 (97.41%), best:    9763/10000 (97.63%), error:       868.44061, best error:       791.87274 on epoch:    52, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 176.5056915283s, input_fired_time: 1.4991289377, output_fired_time: 1.6770126820, propagate_forward_time: 67.9148101807, propagate_backward_time: 102.1402435303, weight_update_time: 0.2066865712, other_time: 3.2744903564
epoch time: 17.0843143463s, input_fired_time: 0.2135447413, output_fired_time: 0.0000000000, propagate_forward_time: 16.2122402191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6585292816
validation[          , genome  5357] predictions:    9759/  10000 (97.59%), best:    9759/10000 (97.59%), error:       766.34778, best error:       766.34778 on epoch:    66, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 172.5792083740s, input_fired_time: 1.4776422977, output_fired_time: 1.5993456841, propagate_forward_time: 65.7636642456, propagate_backward_time: 100.5867385864, weight_update_time: 0.2065011114, other_time: 3.1518096924
epoch time: 32.6273880005s, input_fired_time: 0.2137706131, output_fired_time: 0.0000000000, propagate_forward_time: 13.5025348663, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 18.9110813141
validation[          , genome  5357] predictions:    9723/  10000 (97.23%), best:    9759/10000 (97.59%), error:       868.33435, best error:       766.34778 on epoch:    66, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 175.4238739014s, input_fired_time: 1.7977865934, output_fired_time: 1.6172040701, propagate_forward_time: 67.0653839111, propagate_backward_time: 101.6878433228, weight_update_time: 0.2445626855, other_time: 3.2556533813
epoch time: 14.0054788589s, input_fired_time: 0.1827016771, output_fired_time: 0.0000000000, propagate_forward_time: 13.2610425949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5617341995
validation[          , genome  5357] predictions:    9759/  10000 (97.59%), best:    9759/10000 (97.59%), error:       789.98627, best error:       766.34778 on epoch:    66, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 147.5321655273s, input_fired_time: 1.3267834187, output_fired_time: 1.4280986786, propagate_forward_time: 54.9036979675, propagate_backward_time: 86.8005065918, weight_update_time: 0.1970129758, other_time: 3.0730743408
epoch time: 15.6140527725s, input_fired_time: 0.1802060455, output_fired_time: 0.0000000000, propagate_forward_time: 14.8127374649, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6211090088
validation[          , genome  5357] predictions:    9724/  10000 (97.24%), best:    9759/10000 (97.59%), error:       876.62366, best error:       766.34778 on epoch:    66, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 178.3592376709s, input_fired_time: 1.5112435818, output_fired_time: 1.6277040243, propagate_forward_time: 68.2678909302, propagate_backward_time: 103.6528701782, weight_update_time: 0.2094397396, other_time: 3.2995300293
epoch time: 14.7605400085s, input_fired_time: 0.2133024633, output_fired_time: 0.0000000000, propagate_forward_time: 13.9547157288, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5925216675
validation[          , genome  5357] predictions:    9733/  10000 (97.33%), best:    9759/10000 (97.59%), error:       901.95490, best error:       766.34778 on epoch:    66, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 192.5438079834s, input_fired_time: 1.5313750505, output_fired_time: 1.7515590191, propagate_forward_time: 67.8819274902, propagate_backward_time: 118.1128997803, weight_update_time: 0.2080525756, other_time: 3.2660522461
epoch time: 14.4098377228s, input_fired_time: 0.1820291430, output_fired_time: 0.0000000000, propagate_forward_time: 13.6385974884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5892114639
validation[          , genome  5357] predictions:    9744/  10000 (97.44%), best:    9759/10000 (97.59%), error:       821.84094, best error:       766.34778 on epoch:    66, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 171.9565277100s, input_fired_time: 1.4900978804, output_fired_time: 1.6262681484, propagate_forward_time: 65.7860565186, propagate_backward_time: 99.9403839111, weight_update_time: 0.2068441808, other_time: 3.1137237549
epoch time: 13.8435249329s, input_fired_time: 0.1806460172, output_fired_time: 0.0000000000, propagate_forward_time: 13.1077079773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5551710129
validation[          , genome  5357] predictions:    9757/  10000 (97.57%), best:    9759/10000 (97.59%), error:       784.21936, best error:       766.34778 on epoch:    66, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 173.0039672852s, input_fired_time: 1.5239990950, output_fired_time: 1.6032770872, propagate_forward_time: 66.3334045410, propagate_backward_time: 100.4041976929, weight_update_time: 0.2088146806, other_time: 3.1390914917
epoch time: 13.6374444962s, input_fired_time: 0.1812181175, output_fired_time: 0.0000000000, propagate_forward_time: 12.8980722427, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5581541061
validation[          , genome  5357] predictions:    9705/  10000 (97.05%), best:    9759/10000 (97.59%), error:       946.04077, best error:       766.34778 on epoch:    66, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 171.8774108887s, input_fired_time: 1.4630409479, output_fired_time: 1.5839161873, propagate_forward_time: 65.4661865234, propagate_backward_time: 100.2256088257, weight_update_time: 0.2076786906, other_time: 3.1386489868
epoch time: 13.8120040894s, input_fired_time: 0.1859268099, output_fired_time: 0.0000000000, propagate_forward_time: 13.0685768127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5575008392
validation[          , genome  5357] predictions:    9747/  10000 (97.47%), best:    9759/10000 (97.59%), error:       857.07715, best error:       766.34778 on epoch:    66, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 174.0100555420s, input_fired_time: 1.4868938923, output_fired_time: 1.6311424971, propagate_forward_time: 66.6943054199, propagate_backward_time: 101.0250167847, weight_update_time: 0.2096051276, other_time: 3.1726913452
epoch time: 13.9236011505s, input_fired_time: 0.1840355694, output_fired_time: 0.0000000000, propagate_forward_time: 13.1771306992, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5624351501
validation[          , genome  5357] predictions:    9723/  10000 (97.23%), best:    9759/10000 (97.59%), error:       962.46954, best error:       766.34778 on epoch:    66, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 170.0945281982s, input_fired_time: 1.4627552032, output_fired_time: 1.5855776072, propagate_forward_time: 65.0960845947, propagate_backward_time: 98.7969894409, weight_update_time: 0.2072533369, other_time: 3.1531295776
epoch time: 13.9139986038s, input_fired_time: 0.1832925826, output_fired_time: 0.0000000000, propagate_forward_time: 13.1692419052, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5614643097
validation[          , genome  5357] predictions:    9748/  10000 (97.48%), best:    9759/10000 (97.59%), error:       837.29987, best error:       766.34778 on epoch:    66, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 170.1993255615s, input_fired_time: 1.4553264380, output_fired_time: 1.5779811144, propagate_forward_time: 65.0419235229, propagate_backward_time: 99.0103836060, weight_update_time: 0.2069434673, other_time: 3.1137084961
epoch time: 13.9262447357s, input_fired_time: 0.1842349023, output_fired_time: 0.0000000000, propagate_forward_time: 13.1802806854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5617294312
validation[          , genome  5357] predictions:    9746/  10000 (97.46%), best:    9759/10000 (97.59%), error:       835.12360, best error:       766.34778 on epoch:    66, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 160.1271972656s, input_fired_time: 1.3990675211, output_fired_time: 1.5035459995, propagate_forward_time: 60.1790847778, propagate_backward_time: 93.9327926636, weight_update_time: 0.2036696523, other_time: 3.1127166748
epoch time: 17.1770439148s, input_fired_time: 0.2472898662, output_fired_time: 0.0000000000, propagate_forward_time: 16.2389087677, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6908454895
validation[          , genome  5357] predictions:    9704/  10000 (97.04%), best:    9759/10000 (97.59%), error:       934.49243, best error:       766.34778 on epoch:    66, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 177.5975646973s, input_fired_time: 1.4949258566, output_fired_time: 1.6617625952, propagate_forward_time: 68.1563110352, propagate_backward_time: 103.1246719360, weight_update_time: 0.2071485668, other_time: 3.1599044800
epoch time: 24.1882801056s, input_fired_time: 0.2482510656, output_fired_time: 0.0000000000, propagate_forward_time: 22.9261817932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0138473511
validation[          , genome  5357] predictions:    9740/  10000 (97.40%), best:    9759/10000 (97.59%), error:       887.68774, best error:       766.34778 on epoch:    66, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 173.0281829834s, input_fired_time: 1.4583418369, output_fired_time: 1.6659275293, propagate_forward_time: 66.2992248535, propagate_backward_time: 100.4315567017, weight_update_time: 0.2066297233, other_time: 3.1731338501
epoch time: 16.8708496094s, input_fired_time: 0.2143954933, output_fired_time: 0.0000000000, propagate_forward_time: 15.9379177094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7185363770
validation[          , genome  5357] predictions:    9772/  10000 (97.72%), best:    9759/10000 (97.59%), error:       792.07745, best error:       766.34778 on epoch:    66, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 183.9002838135s, input_fired_time: 1.5533758402, output_fired_time: 1.6622624397, propagate_forward_time: 70.4793167114, propagate_backward_time: 106.7957763672, weight_update_time: 0.2071256042, other_time: 3.4095535278
epoch time: 17.2550678253s, input_fired_time: 0.1836987436, output_fired_time: 0.0000000000, propagate_forward_time: 16.5159263611, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5554428101
validation[          , genome  5357] predictions:    9727/  10000 (97.27%), best:    9759/10000 (97.59%), error:       882.14063, best error:       766.34778 on epoch:    66, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 175.3703155518s, input_fired_time: 1.4956990480, output_fired_time: 1.6006067991, propagate_forward_time: 66.7186813354, propagate_backward_time: 102.3260726929, weight_update_time: 0.2090702802, other_time: 3.2292633057
epoch time: 23.7119464874s, input_fired_time: 0.4380576015, output_fired_time: 0.0000000000, propagate_forward_time: 22.3235015869, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9503879547
validation[          , genome  5357] predictions:    9725/  10000 (97.25%), best:    9759/10000 (97.59%), error:       896.00793, best error:       766.34778 on epoch:    66, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 186.6022186279s, input_fired_time: 1.4829056263, output_fired_time: 1.6677654982, propagate_forward_time: 68.4666519165, propagate_backward_time: 111.7383651733, weight_update_time: 0.2059978396, other_time: 3.2465209961
epoch time: 14.5731210709s, input_fired_time: 0.1827559173, output_fired_time: 0.0000000000, propagate_forward_time: 13.8282728195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5620927811
validation[          , genome  5357] predictions:    9756/  10000 (97.56%), best:    9759/10000 (97.59%), error:       816.86591, best error:       766.34778 on epoch:    66, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 173.7736358643s, input_fired_time: 1.5256216526, output_fired_time: 1.6095516682, propagate_forward_time: 66.3881607056, propagate_backward_time: 100.9941329956, weight_update_time: 0.2070774287, other_time: 3.2561645508
epoch time: 14.4488134384s, input_fired_time: 0.1851769984, output_fired_time: 0.0000000000, propagate_forward_time: 13.6687126160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5949239731
validation[          , genome  5357] predictions:    9742/  10000 (97.42%), best:    9759/10000 (97.59%), error:       864.23041, best error:       766.34778 on epoch:    66, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 185.5424194336s, input_fired_time: 1.6009112597, output_fired_time: 1.7945666313, propagate_forward_time: 71.0174331665, propagate_backward_time: 107.5842666626, weight_update_time: 0.2778658867, other_time: 3.5452423096
epoch time: 14.1157503128s, input_fired_time: 0.1810555756, output_fired_time: 0.0000000000, propagate_forward_time: 13.3790597916, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5556344986
validation[          , genome  5357] predictions:    9739/  10000 (97.39%), best:    9759/10000 (97.59%), error:       821.09644, best error:       766.34778 on epoch:    66, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 179.9498291016s, input_fired_time: 1.5357832909, output_fired_time: 1.6870936155, propagate_forward_time: 69.5328369141, propagate_backward_time: 103.9072875977, weight_update_time: 0.2079074383, other_time: 3.2868347168
epoch time: 14.2743148804s, input_fired_time: 0.1901209354, output_fired_time: 0.0000000000, propagate_forward_time: 13.5223875046, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5618066788
validation[          , genome  5357] predictions:    9594/  10000 (95.94%), best:    9759/10000 (97.59%), error:      1456.37170, best error:       766.34778 on epoch:    66, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 178.9924316406s, input_fired_time: 1.5559135675, output_fired_time: 1.6199847460, propagate_forward_time: 68.6794128418, propagate_backward_time: 103.8294830322, weight_update_time: 0.2068440467, other_time: 3.3076477051
epoch time: 18.2288341522s, input_fired_time: 0.2473214269, output_fired_time: 0.0000000000, propagate_forward_time: 17.1989364624, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7825756073
validation[          , genome  5357] predictions:    9717/  10000 (97.17%), best:    9759/10000 (97.59%), error:       901.41943, best error:       766.34778 on epoch:    66, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 171.8773956299s, input_fired_time: 1.4775812626, output_fired_time: 1.5862836838, propagate_forward_time: 66.8603820801, propagate_backward_time: 98.8216323853, weight_update_time: 0.2071723938, other_time: 3.1315078735
epoch time: 17.2791385651s, input_fired_time: 0.2133537233, output_fired_time: 0.0000000000, propagate_forward_time: 16.4152927399, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6504917145
validation[          , genome  5357] predictions:    9763/  10000 (97.63%), best:    9759/10000 (97.59%), error:       804.71637, best error:       766.34778 on epoch:    66, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 176.4873352051s, input_fired_time: 1.5507339239, output_fired_time: 1.6298025846, propagate_forward_time: 67.7629089355, propagate_backward_time: 102.3615264893, weight_update_time: 0.2096685767, other_time: 3.1823577881
epoch time: 25.6437931061s, input_fired_time: 0.2161176652, output_fired_time: 0.0000000000, propagate_forward_time: 24.6691188812, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7585563660
validation[          , genome  5357] predictions:    9750/  10000 (97.50%), best:    9759/10000 (97.59%), error:       858.60736, best error:       766.34778 on epoch:    66, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 171.8486175537s, input_fired_time: 1.4592134953, output_fired_time: 1.6183910370, propagate_forward_time: 65.9372177124, propagate_backward_time: 99.7390518188, weight_update_time: 0.2063471526, other_time: 3.0947418213
epoch time: 18.8752803802s, input_fired_time: 0.2488327026, output_fired_time: 0.0000000000, propagate_forward_time: 17.8742675781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7521800995
validation[          , genome  5357] predictions:    9763/  10000 (97.63%), best:    9759/10000 (97.59%), error:       791.24249, best error:       766.34778 on epoch:    66, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 172.7912750244s, input_fired_time: 1.5300658941, output_fired_time: 1.6076388359, propagate_forward_time: 65.9618988037, propagate_backward_time: 100.4820022583, weight_update_time: 0.2072617710, other_time: 3.2096786499
epoch time: 16.4959411621s, input_fired_time: 0.2478087842, output_fired_time: 0.0000000000, propagate_forward_time: 15.5208883286, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7272443771
validation[          , genome  5357] predictions:    9759/  10000 (97.59%), best:    9759/10000 (97.59%), error:       833.65259, best error:       766.34778 on epoch:    66, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 172.7120056152s, input_fired_time: 1.4799791574, output_fired_time: 1.5917708874, propagate_forward_time: 66.0125656128, propagate_backward_time: 100.4556961060, weight_update_time: 0.2091792375, other_time: 3.1719970703
epoch time: 15.6877498627s, input_fired_time: 0.2164803743, output_fired_time: 0.0000000000, propagate_forward_time: 14.8498287201, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6214408875
validation[          , genome  5357] predictions:    9734/  10000 (97.34%), best:    9759/10000 (97.59%), error:       906.98132, best error:       766.34778 on epoch:    66, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 183.6002807617s, input_fired_time: 1.5012711287, output_fired_time: 1.6421273947, propagate_forward_time: 70.4132690430, propagate_backward_time: 106.5962448120, weight_update_time: 0.2389679551, other_time: 3.4473800659
epoch time: 13.9424695969s, input_fired_time: 0.1845671386, output_fired_time: 0.0000000000, propagate_forward_time: 13.1926527023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5652494431
validation[          , genome  5357] predictions:    9746/  10000 (97.46%), best:    9759/10000 (97.59%), error:       820.52502, best error:       766.34778 on epoch:    66, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 175.7975158691s, input_fired_time: 1.4678713083, output_fired_time: 1.5830515623, propagate_forward_time: 69.6113739014, propagate_backward_time: 99.9803314209, weight_update_time: 0.2067151517, other_time: 3.1548919678
epoch time: 15.2778100967s, input_fired_time: 0.2170493156, output_fired_time: 0.0000000000, propagate_forward_time: 14.4115047455, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6492557526
validation[          , genome  5357] predictions:    9728/  10000 (97.28%), best:    9759/10000 (97.59%), error:       898.87189, best error:       766.34778 on epoch:    66, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 183.3034973145s, input_fired_time: 1.5643031597, output_fired_time: 1.7699688673, propagate_forward_time: 70.4326553345, propagate_backward_time: 106.3283996582, weight_update_time: 0.2074974477, other_time: 3.2081680298
epoch time: 18.2808418274s, input_fired_time: 0.2160179615, output_fired_time: 0.0000000000, propagate_forward_time: 17.3032073975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7616157532
validation[          , genome  5357] predictions:    9745/  10000 (97.45%), best:    9759/10000 (97.59%), error:       817.70203, best error:       766.34778 on epoch:    66, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 179.4845733643s, input_fired_time: 1.4938527346, output_fired_time: 1.5938599110, propagate_forward_time: 71.1194915771, propagate_backward_time: 102.0084228516, weight_update_time: 0.2060599476, other_time: 3.2689514160
epoch time: 18.6498908997s, input_fired_time: 0.1853867173, output_fired_time: 0.0000000000, propagate_forward_time: 17.7119426727, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7525615692
validation[          , genome  5357] predictions:    9739/  10000 (97.39%), best:    9759/10000 (97.59%), error:       859.59808, best error:       766.34778 on epoch:    66, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 176.2262573242s, input_fired_time: 1.4619551897, output_fired_time: 1.6200308800, propagate_forward_time: 67.7225646973, propagate_backward_time: 102.2292480469, weight_update_time: 0.2066866457, other_time: 3.1924591064
epoch time: 16.8895664215s, input_fired_time: 0.1828141063, output_fired_time: 0.0000000000, propagate_forward_time: 16.1183681488, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5883846283
validation[          , genome  5357] predictions:    9764/  10000 (97.64%), best:    9759/10000 (97.59%), error:       798.16681, best error:       766.34778 on epoch:    66, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 178.4188385010s, input_fired_time: 1.5216276646, output_fired_time: 1.6846678257, propagate_forward_time: 68.6006546021, propagate_backward_time: 103.3822860718, weight_update_time: 0.2076294571, other_time: 3.2296142578
epoch time: 21.0414009094s, input_fired_time: 0.2464863807, output_fired_time: 0.0000000000, propagate_forward_time: 19.8861351013, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9087791443
validation[          , genome  5357] predictions:    9700/  10000 (97.00%), best:    9759/10000 (97.59%), error:       988.94220, best error:       766.34778 on epoch:    66, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 184.3182067871s, input_fired_time: 1.5986534357, output_fired_time: 1.7104324102, propagate_forward_time: 70.5313110352, propagate_backward_time: 107.0297698975, weight_update_time: 0.2712017000, other_time: 3.4480438232
epoch time: 15.1852703094s, input_fired_time: 0.1852666587, output_fired_time: 0.0000000000, propagate_forward_time: 14.4124450684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5875587463
validation[          , genome  5357] predictions:    9720/  10000 (97.20%), best:    9759/10000 (97.59%), error:       884.95782, best error:       766.34778 on epoch:    66, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 177.6799468994s, input_fired_time: 1.4743341208, output_fired_time: 1.5876520872, propagate_forward_time: 68.1100540161, propagate_backward_time: 103.2492904663, weight_update_time: 0.2077010423, other_time: 3.2586212158
epoch time: 21.5029602051s, input_fired_time: 0.2787266672, output_fired_time: 0.0000000000, propagate_forward_time: 20.5380725861, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6861610413
validation[          , genome  5357] predictions:    9747/  10000 (97.47%), best:    9759/10000 (97.59%), error:       865.30835, best error:       766.34778 on epoch:    66, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 69.3790740967s, input_fired_time: 0.9033860564, output_fired_time: 0.0000000000, propagate_forward_time: 65.6100540161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8656311035
best training[          , genome  5357] predictions:   49507/  50000 (99.01%), best:    9759/10000 (97.59%), error:      1857.42773, best error:       766.34778 on epoch:    66, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 14.2294101715s, input_fired_time: 0.1804392785, output_fired_time: 0.0000000000, propagate_forward_time: 13.4569749832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5919961929
   testing[          , genome  5357] predictions:    9773/  10000 (97.73%), best:    9759/10000 (97.59%), error:       751.77893, best error:       766.34778 on epoch:    66, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
02:57:37 (4180): called boinc_finish(0)

</stderr_txt>
]]>