Nameexact_genome_1512568488_43_6486_1
Workunit2603752
Created7 Dec 2017, 20:08:20 UTC
Sent7 Dec 2017, 20:14:34 UTC
Report deadline18 Dec 2017, 7:30:45 UTC
Received9 Dec 2017, 13:25:23 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID62426
Run time6 hours 41 min 47 sec
CPU time6 hours 24 min 35 sec
Validate stateValid
Credit2,617.39
Device peak FLOPS2.98 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.98 MB
Peak swap size154.33 MB
Peak disk usage2.22 MB

Stderr output

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
23.65991 on epoch:    12, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 217.0848388672s, input_fired_time: 2.1973335743, output_fired_time: 2.4954741001, propagate_forward_time: 83.2036895752, propagate_backward_time: 125.5004425049, weight_update_time: 0.2251701355, other_time: 3.6879119873
epoch time: 22.3249721527s, input_fired_time: 0.3992576301, output_fired_time: 0.0000000000, propagate_forward_time: 21.1345596313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7911548615
validation[          , genome  6486] predictions:    9662/  10000 (96.62%), best:    9690/10000 (96.90%), error:      1113.06140, best error:      1023.65991 on epoch:    12, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 239.7245025635s, input_fired_time: 2.5616171360, output_fired_time: 2.6867346764, propagate_forward_time: 91.9373474121, propagate_backward_time: 138.6853942871, weight_update_time: 0.2586120367, other_time: 3.8534088135
epoch time: 18.1414089203s, input_fired_time: 0.3055812716, output_fired_time: 0.0000000000, propagate_forward_time: 17.1908454895, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6449813843
validation[          , genome  6486] predictions:    9734/  10000 (97.34%), best:    9734/10000 (97.34%), error:       949.78320, best error:       949.78320 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 215.7001495361s, input_fired_time: 2.1634166241, output_fired_time: 2.3733468056, propagate_forward_time: 82.7393951416, propagate_backward_time: 124.8291244507, weight_update_time: 0.2271304280, other_time: 3.5948562622
epoch time: 21.7960700989s, input_fired_time: 0.3609535396, output_fired_time: 0.0000000000, propagate_forward_time: 20.6079597473, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8271560669
validation[          , genome  6486] predictions:    9648/  10000 (96.48%), best:    9734/10000 (97.34%), error:      1114.50354, best error:       949.78320 on epoch:    16, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 216.2325592041s, input_fired_time: 2.1895980835, output_fired_time: 2.3823721409, propagate_forward_time: 83.0280380249, propagate_backward_time: 125.0074005127, weight_update_time: 0.2268066108, other_time: 3.6251678467
epoch time: 27.4285964966s, input_fired_time: 0.4295679927, output_fired_time: 0.0000000000, propagate_forward_time: 26.2662963867, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7327327728
validation[          , genome  6486] predictions:    9666/  10000 (96.66%), best:    9734/10000 (97.34%), error:      1134.85986, best error:       949.78320 on epoch:    16, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 218.2502136230s, input_fired_time: 2.2202601433, output_fired_time: 2.4285554886, propagate_forward_time: 83.2876663208, propagate_backward_time: 126.6376190186, weight_update_time: 0.2265220433, other_time: 3.6761016846
epoch time: 17.9230842590s, input_fired_time: 0.3325897157, output_fired_time: 0.0000000000, propagate_forward_time: 16.9534339905, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6370601654
validation[          , genome  6486] predictions:    9520/  10000 (95.20%), best:    9734/10000 (97.34%), error:      1529.61328, best error:       949.78320 on epoch:    16, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 221.3263244629s, input_fired_time: 2.2754266262, output_fired_time: 2.4208173752, propagate_forward_time: 83.3959655762, propagate_backward_time: 129.6055908203, weight_update_time: 0.2286209464, other_time: 3.6285247803
epoch time: 21.3090038300s, input_fired_time: 0.3012197316, output_fired_time: 0.0000000000, propagate_forward_time: 20.1778984070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8298854828
validation[          , genome  6486] predictions:    9684/  10000 (96.84%), best:    9734/10000 (97.34%), error:      1096.75354, best error:       949.78320 on epoch:    16, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 229.9209899902s, input_fired_time: 2.2416357994, output_fired_time: 2.4191129208, propagate_forward_time: 96.3140869141, propagate_backward_time: 125.3751144409, weight_update_time: 0.2262588441, other_time: 3.5710372925
epoch time: 19.7225742340s, input_fired_time: 0.3092633486, output_fired_time: 0.0000000000, propagate_forward_time: 18.7102527618, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7030582428
validation[          , genome  6486] predictions:    9711/  10000 (97.11%), best:    9734/10000 (97.34%), error:      1035.54639, best error:       949.78320 on epoch:    16, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 217.9648895264s, input_fired_time: 2.2147309780, output_fired_time: 2.4477710724, propagate_forward_time: 83.6628723145, propagate_backward_time: 126.0029602051, weight_update_time: 0.2572307587, other_time: 3.6365509033
epoch time: 17.8046550751s, input_fired_time: 0.3124077618, output_fired_time: 0.0000000000, propagate_forward_time: 16.8647155762, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6275310516
validation[          , genome  6486] predictions:    9703/  10000 (97.03%), best:    9703/10000 (97.03%), error:       940.06183, best error:       940.06183 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 213.6945648193s, input_fired_time: 2.1667521000, output_fired_time: 2.3594148159, propagate_forward_time: 82.2884292603, propagate_backward_time: 123.2520141602, weight_update_time: 0.2246870100, other_time: 3.6279525757
epoch time: 16.3764934540s, input_fired_time: 0.2594636977, output_fired_time: 0.0000000000, propagate_forward_time: 15.4983148575, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6187143326
validation[          , genome  6486] predictions:    9708/  10000 (97.08%), best:    9703/10000 (97.03%), error:      1008.02161, best error:       940.06183 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 183.4897308350s, input_fired_time: 2.0107781887, output_fired_time: 2.1667511463, propagate_forward_time: 68.9903182983, propagate_backward_time: 106.7060546875, weight_update_time: 0.2488614023, other_time: 3.6158370972
epoch time: 35.6659812927s, input_fired_time: 0.4552713633, output_fired_time: 0.0000000000, propagate_forward_time: 33.9939384460, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2167701721
validation[          , genome  6486] predictions:    9719/  10000 (97.19%), best:    9703/10000 (97.03%), error:       960.96472, best error:       940.06183 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 217.4030456543s, input_fired_time: 2.2924532890, output_fired_time: 2.5058493614, propagate_forward_time: 83.2939834595, propagate_backward_time: 125.6798934937, weight_update_time: 0.2268525213, other_time: 3.6308670044
epoch time: 25.7720584869s, input_fired_time: 0.4518396258, output_fired_time: 0.0000000000, propagate_forward_time: 24.2706623077, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0495567322
validation[          , genome  6486] predictions:    9693/  10000 (96.93%), best:    9703/10000 (97.03%), error:      1000.47260, best error:       940.06183 on epoch:    22, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 225.3473052979s, input_fired_time: 2.2206695080, output_fired_time: 2.5684509277, propagate_forward_time: 85.3850708008, propagate_backward_time: 131.4606475830, weight_update_time: 0.2256340533, other_time: 3.7124633789
epoch time: 20.3461818695s, input_fired_time: 0.3024465144, output_fired_time: 0.0000000000, propagate_forward_time: 19.1188068390, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9249286652
validation[          , genome  6486] predictions:    9695/  10000 (96.95%), best:    9703/10000 (97.03%), error:      1023.34009, best error:       940.06183 on epoch:    22, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 179.4606475830s, input_fired_time: 1.9777804613, output_fired_time: 2.1219756603, propagate_forward_time: 67.5985183716, propagate_backward_time: 104.2132186890, weight_update_time: 0.2157494128, other_time: 3.5491485596
epoch time: 19.1824913025s, input_fired_time: 0.3659631312, output_fired_time: 0.0000000000, propagate_forward_time: 18.0279502869, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7885780334
validation[          , genome  6486] predictions:    9696/  10000 (96.96%), best:    9703/10000 (97.03%), error:      1046.92200, best error:       940.06183 on epoch:    22, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 196.6307373047s, input_fired_time: 2.0234186649, output_fired_time: 2.2199659348, propagate_forward_time: 71.6012954712, propagate_backward_time: 117.1960601807, weight_update_time: 0.2186076492, other_time: 3.5899887085
epoch time: 16.4546756744s, input_fired_time: 0.2395422310, output_fired_time: 0.0000000000, propagate_forward_time: 15.4946069717, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7205266953
validation[          , genome  6486] predictions:    9670/  10000 (96.70%), best:    9703/10000 (97.03%), error:      1069.39600, best error:       940.06183 on epoch:    22, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 182.8090667725s, input_fired_time: 2.0990769863, output_fired_time: 2.1845865250, propagate_forward_time: 68.6937179565, propagate_backward_time: 106.1754379272, weight_update_time: 0.2155160308, other_time: 3.6562500000
epoch time: 19.5210208893s, input_fired_time: 0.3266328573, output_fired_time: 0.0000000000, propagate_forward_time: 18.4637413025, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7306461334
validation[          , genome  6486] predictions:    9687/  10000 (96.87%), best:    9703/10000 (97.03%), error:      1018.01593, best error:       940.06183 on epoch:    22, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 199.8272857666s, input_fired_time: 2.1299364567, output_fired_time: 2.3069260120, propagate_forward_time: 76.0215072632, propagate_backward_time: 115.7777786255, weight_update_time: 0.2199763358, other_time: 3.5911254883
epoch time: 18.1782150269s, input_fired_time: 0.2690875530, output_fired_time: 0.0000000000, propagate_forward_time: 17.2422981262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6668300629
validation[          , genome  6486] predictions:    9726/  10000 (97.26%), best:    9726/10000 (97.26%), error:       910.38733, best error:       910.38733 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 219.0895538330s, input_fired_time: 2.2205486298, output_fired_time: 2.4433891773, propagate_forward_time: 84.1069107056, propagate_backward_time: 126.6200561523, weight_update_time: 0.2251486331, other_time: 3.6986389160
epoch time: 27.2416706085s, input_fired_time: 0.3251692951, output_fired_time: 0.0000000000, propagate_forward_time: 26.1262073517, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7902946472
validation[          , genome  6486] predictions:    9723/  10000 (97.23%), best:    9726/10000 (97.26%), error:       949.92572, best error:       910.38733 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 202.2843475342s, input_fired_time: 2.1348187923, output_fired_time: 2.2967617512, propagate_forward_time: 76.8750915527, propagate_backward_time: 117.1632614136, weight_update_time: 0.2597557604, other_time: 3.8144149780
epoch time: 28.1367988586s, input_fired_time: 0.4940299690, output_fired_time: 0.0000000000, propagate_forward_time: 26.5597915649, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0829772949
validation[          , genome  6486] predictions:    9716/  10000 (97.16%), best:    9726/10000 (97.26%), error:       944.13745, best error:       910.38733 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 203.9477386475s, input_fired_time: 2.1297302246, output_fired_time: 2.3500986099, propagate_forward_time: 77.6897583008, propagate_backward_time: 118.1706237793, weight_update_time: 0.2232791632, other_time: 3.6075286865
epoch time: 22.7673149109s, input_fired_time: 0.3331533372, output_fired_time: 0.0000000000, propagate_forward_time: 21.5717315674, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8624305725
validation[          , genome  6486] predictions:    9677/  10000 (96.77%), best:    9726/10000 (97.26%), error:      1103.35083, best error:       910.38733 on epoch:    30, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 218.6588287354s, input_fired_time: 2.2118897438, output_fired_time: 2.4064705372, propagate_forward_time: 83.9397888184, propagate_backward_time: 126.4106445313, weight_update_time: 0.2313226312, other_time: 3.6900482178
epoch time: 19.5264816284s, input_fired_time: 0.2704322338, output_fired_time: 0.0000000000, propagate_forward_time: 18.5861301422, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6699199677
validation[          , genome  6486] predictions:    9719/  10000 (97.19%), best:    9726/10000 (97.26%), error:       956.02771, best error:       910.38733 on epoch:    30, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 230.4835968018s, input_fired_time: 2.3728613853, output_fired_time: 2.5771803856, propagate_forward_time: 88.7327041626, propagate_backward_time: 132.9312744141, weight_update_time: 0.2280665785, other_time: 3.8695678711
epoch time: 17.7063465118s, input_fired_time: 0.2710107565, output_fired_time: 0.0000000000, propagate_forward_time: 16.8002853394, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6350498199
validation[          , genome  6486] predictions:    9641/  10000 (96.41%), best:    9726/10000 (97.26%), error:      1166.86609, best error:       910.38733 on epoch:    30, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 218.3438568115s, input_fired_time: 2.2291836739, output_fired_time: 2.4108073711, propagate_forward_time: 83.7165145874, propagate_backward_time: 126.3462677002, weight_update_time: 0.2259277850, other_time: 3.6410675049
epoch time: 20.4696331024s, input_fired_time: 0.2992009223, output_fired_time: 0.0000000000, propagate_forward_time: 19.4771537781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6932792664
validation[          , genome  6486] predictions:    9732/  10000 (97.32%), best:    9732/10000 (97.32%), error:       868.40503, best error:       868.40503 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 226.1910095215s, input_fired_time: 2.2692365646, output_fired_time: 2.4916248322, propagate_forward_time: 87.4694213867, propagate_backward_time: 130.2008666992, weight_update_time: 0.2287806422, other_time: 3.7598571777
epoch time: 20.8644294739s, input_fired_time: 0.3957929909, output_fired_time: 0.0000000000, propagate_forward_time: 19.7445545197, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7240810394
validation[          , genome  6486] predictions:    9736/  10000 (97.36%), best:    9736/10000 (97.36%), error:       857.65631, best error:       857.65631 on epoch:    37, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 231.7870483398s, input_fired_time: 2.4494304657, output_fired_time: 2.4430825710, propagate_forward_time: 86.2654876709, propagate_backward_time: 136.8814239502, weight_update_time: 0.2290693969, other_time: 3.7476196289
epoch time: 23.1058444977s, input_fired_time: 0.2710869610, output_fired_time: 0.0000000000, propagate_forward_time: 22.1727943420, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6619625092
validation[          , genome  6486] predictions:    9683/  10000 (96.83%), best:    9736/10000 (97.36%), error:      1008.83325, best error:       857.65631 on epoch:    37, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 211.0604095459s, input_fired_time: 2.1551868916, output_fired_time: 2.3571734428, propagate_forward_time: 80.7920303345, propagate_backward_time: 122.2066497803, weight_update_time: 0.2263571173, other_time: 3.5493698120
epoch time: 17.0991344452s, input_fired_time: 0.2675114870, output_fired_time: 0.0000000000, propagate_forward_time: 16.2004108429, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6312122345
validation[          , genome  6486] predictions:    9688/  10000 (96.88%), best:    9736/10000 (97.36%), error:      1038.79578, best error:       857.65631 on epoch:    37, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 222.9148254395s, input_fired_time: 2.3231425285, output_fired_time: 2.5869836807, propagate_forward_time: 85.5532836914, propagate_backward_time: 128.7526855469, weight_update_time: 0.2255697995, other_time: 3.6987304688
epoch time: 18.8901157379s, input_fired_time: 0.2697439194, output_fired_time: 0.0000000000, propagate_forward_time: 17.9479827881, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6723899841
validation[          , genome  6486] predictions:    9681/  10000 (96.81%), best:    9736/10000 (97.36%), error:      1064.00464, best error:       857.65631 on epoch:    37, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 223.0736541748s, input_fired_time: 2.3737883568, output_fired_time: 2.5175898075, propagate_forward_time: 85.5403900146, propagate_backward_time: 128.7867431641, weight_update_time: 0.2272568047, other_time: 3.8551330566
epoch time: 18.3148422241s, input_fired_time: 0.2722938359, output_fired_time: 0.0000000000, propagate_forward_time: 17.3704986572, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6720504761
validation[          , genome  6486] predictions:    9728/  10000 (97.28%), best:    9736/10000 (97.36%), error:       933.09094, best error:       857.65631 on epoch:    37, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 223.8182525635s, input_fired_time: 2.2974326611, output_fired_time: 2.4955956936, propagate_forward_time: 85.9233779907, propagate_backward_time: 129.3656463623, weight_update_time: 0.2282434106, other_time: 3.7361907959
epoch time: 18.4983978271s, input_fired_time: 0.2730298936, output_fired_time: 0.0000000000, propagate_forward_time: 17.5583419800, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6670265198
validation[          , genome  6486] predictions:    9692/  10000 (96.92%), best:    9736/10000 (97.36%), error:      1008.49738, best error:       857.65631 on epoch:    37, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 257.0901184082s, input_fired_time: 2.8407468796, output_fired_time: 2.7015938759, propagate_forward_time: 107.3132934570, propagate_backward_time: 140.0547027588, weight_update_time: 0.2259963155, other_time: 4.1797790527
epoch time: 17.5839099884s, input_fired_time: 0.2721056044, output_fired_time: 0.0000000000, propagate_forward_time: 16.6768608093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6349430084
validation[          , genome  6486] predictions:    9693/  10000 (96.93%), best:    9736/10000 (97.36%), error:       996.78961, best error:       857.65631 on epoch:    37, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 215.7268218994s, input_fired_time: 2.2097032070, output_fired_time: 2.4045028687, propagate_forward_time: 82.8230438232, propagate_backward_time: 124.7214431763, weight_update_time: 0.2263207734, other_time: 3.5681228638
epoch time: 22.0825653076s, input_fired_time: 0.4099105299, output_fired_time: 0.0000000000, propagate_forward_time: 20.7854251862, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8872299194
validation[          , genome  6486] predictions:    9724/  10000 (97.24%), best:    9736/10000 (97.36%), error:       949.46497, best error:       857.65631 on epoch:    37, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 226.7022857666s, input_fired_time: 2.2871308327, output_fired_time: 2.4277248383, propagate_forward_time: 90.8511962891, propagate_backward_time: 127.3966674805, weight_update_time: 0.2266363949, other_time: 3.7395782471
epoch time: 18.5667343140s, input_fired_time: 0.2717171907, output_fired_time: 0.0000000000, propagate_forward_time: 17.6294536591, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6655635834
validation[          , genome  6486] predictions:    9721/  10000 (97.21%), best:    9736/10000 (97.36%), error:       913.45062, best error:       857.65631 on epoch:    37, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 216.0459442139s, input_fired_time: 2.1907732487, output_fired_time: 2.3952970505, propagate_forward_time: 82.7880401611, propagate_backward_time: 125.0554122925, weight_update_time: 0.2274190485, other_time: 3.6164169312
epoch time: 24.3782234192s, input_fired_time: 0.3018121123, output_fired_time: 0.0000000000, propagate_forward_time: 23.0873222351, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9890899658
validation[          , genome  6486] predictions:    9744/  10000 (97.44%), best:    9744/10000 (97.44%), error:       841.85193, best error:       841.85193 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 230.5737609863s, input_fired_time: 2.2532193661, output_fired_time: 2.5534281731, propagate_forward_time: 87.8848571777, propagate_backward_time: 134.1507415771, weight_update_time: 0.2270342261, other_time: 3.7315216064
epoch time: 19.7876663208s, input_fired_time: 0.3010595739, output_fired_time: 0.0000000000, propagate_forward_time: 18.7599182129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7266883850
validation[          , genome  6486] predictions:    9664/  10000 (96.64%), best:    9744/10000 (97.44%), error:      1042.62207, best error:       841.85193 on epoch:    46, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 214.2564697266s, input_fired_time: 2.1806840897, output_fired_time: 2.3791952133, propagate_forward_time: 82.3046264648, propagate_backward_time: 123.8658523560, weight_update_time: 0.2261386514, other_time: 3.5261154175
epoch time: 19.2046661377s, input_fired_time: 0.3678604066, output_fired_time: 0.0000000000, propagate_forward_time: 18.1382846832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6985206604
validation[          , genome  6486] predictions:    9734/  10000 (97.34%), best:    9744/10000 (97.44%), error:       867.06122, best error:       841.85193 on epoch:    46, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 219.2229614258s, input_fired_time: 2.3125362396, output_fired_time: 2.4192183018, propagate_forward_time: 84.0728302002, propagate_backward_time: 126.7151565552, weight_update_time: 0.2271246314, other_time: 3.7032241821
epoch time: 17.2738265991s, input_fired_time: 0.2704820335, output_fired_time: 0.0000000000, propagate_forward_time: 16.3686771393, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6346683502
validation[          , genome  6486] predictions:    9732/  10000 (97.32%), best:    9744/10000 (97.44%), error:       900.40814, best error:       841.85193 on epoch:    46, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 214.6578979492s, input_fired_time: 2.1973650455, output_fired_time: 2.3890135288, propagate_forward_time: 82.3747711182, propagate_backward_time: 124.1198043823, weight_update_time: 0.2274649888, other_time: 3.5769424438
epoch time: 17.6698570251s, input_fired_time: 0.3054330051, output_fired_time: 0.0000000000, propagate_forward_time: 16.7284431458, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6359806061
validation[          , genome  6486] predictions:    9705/  10000 (97.05%), best:    9744/10000 (97.44%), error:       971.07520, best error:       841.85193 on epoch:    46, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 216.9725799561s, input_fired_time: 2.2211217880, output_fired_time: 2.3992309570, propagate_forward_time: 83.3168106079, propagate_backward_time: 125.3615722656, weight_update_time: 0.2292892784, other_time: 3.6738586426
epoch time: 24.2174816132s, input_fired_time: 0.4013858438, output_fired_time: 0.0000000000, propagate_forward_time: 22.9189643860, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8971309662
validation[          , genome  6486] predictions:    9735/  10000 (97.35%), best:    9744/10000 (97.44%), error:       925.80115, best error:       841.85193 on epoch:    46, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 225.5448150635s, input_fired_time: 2.2164084911, output_fired_time: 2.4265029430, propagate_forward_time: 87.1069107056, propagate_backward_time: 129.7456512451, weight_update_time: 0.2290243506, other_time: 4.0493316650
epoch time: 17.2585582733s, input_fired_time: 0.2715766430, output_fired_time: 0.0000000000, propagate_forward_time: 16.3541831970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6327991486
validation[          , genome  6486] predictions:    9665/  10000 (96.65%), best:    9744/10000 (97.44%), error:      1112.07422, best error:       841.85193 on epoch:    46, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 221.8563995361s, input_fired_time: 2.2244265079, output_fired_time: 2.3834457397, propagate_forward_time: 89.1464233398, propagate_backward_time: 124.5405502319, weight_update_time: 0.2267280817, other_time: 3.5615615845
epoch time: 17.3943157196s, input_fired_time: 0.2709126472, output_fired_time: 0.0000000000, propagate_forward_time: 16.4846839905, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6387195587
validation[          , genome  6486] predictions:    9724/  10000 (97.24%), best:    9744/10000 (97.44%), error:       899.48962, best error:       841.85193 on epoch:    46, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 213.4949035645s, input_fired_time: 2.1854550838, output_fired_time: 2.3556818962, propagate_forward_time: 81.9472961426, propagate_backward_time: 123.4263305664, weight_update_time: 0.2260425836, other_time: 3.5801391602
epoch time: 17.6681613922s, input_fired_time: 0.2739156783, output_fired_time: 0.0000000000, propagate_forward_time: 16.7468852997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6473598480
validation[          , genome  6486] predictions:    9723/  10000 (97.23%), best:    9744/10000 (97.44%), error:       942.43719, best error:       841.85193 on epoch:    46, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 235.0725097656s, input_fired_time: 2.2769327164, output_fired_time: 2.6188554764, propagate_forward_time: 91.5352783203, propagate_backward_time: 134.9846343994, weight_update_time: 0.2907201052, other_time: 3.6568145752
epoch time: 19.4092884064s, input_fired_time: 0.3695877194, output_fired_time: 0.0000000000, propagate_forward_time: 18.3104305267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7292709351
validation[          , genome  6486] predictions:    9742/  10000 (97.42%), best:    9744/10000 (97.44%), error:       870.77802, best error:       841.85193 on epoch:    46, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 212.4388427734s, input_fired_time: 2.1738202572, output_fired_time: 2.3628604412, propagate_forward_time: 81.4515304565, propagate_backward_time: 122.8835372925, weight_update_time: 0.2292264551, other_time: 3.5671081543
epoch time: 18.7974414825s, input_fired_time: 0.2750326693, output_fired_time: 0.0000000000, propagate_forward_time: 17.7915668488, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7308425903
validation[          , genome  6486] predictions:    9711/  10000 (97.11%), best:    9744/10000 (97.44%), error:       993.71008, best error:       841.85193 on epoch:    46, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 224.4113922119s, input_fired_time: 2.3340613842, output_fired_time: 2.4464042187, propagate_forward_time: 85.6525344849, propagate_backward_time: 130.0985717773, weight_update_time: 0.2272859812, other_time: 3.8798217773
epoch time: 17.6924743652s, input_fired_time: 0.2706346214, output_fired_time: 0.0000000000, propagate_forward_time: 16.7884788513, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6333618164
validation[          , genome  6486] predictions:    9690/  10000 (96.90%), best:    9744/10000 (97.44%), error:      1036.23767, best error:       841.85193 on epoch:    46, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 220.7577667236s, input_fired_time: 2.2860054970, output_fired_time: 2.3721482754, propagate_forward_time: 84.8197097778, propagate_backward_time: 127.5758743286, weight_update_time: 0.2284045815, other_time: 3.7040328979
epoch time: 19.0225448608s, input_fired_time: 0.3571370542, output_fired_time: 0.0000000000, propagate_forward_time: 17.9834613800, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6819458008
validation[          , genome  6486] predictions:    9732/  10000 (97.32%), best:    9744/10000 (97.44%), error:       884.65253, best error:       841.85193 on epoch:    46, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 214.6813812256s, input_fired_time: 2.1879775524, output_fired_time: 2.3804426193, propagate_forward_time: 82.3940811157, propagate_backward_time: 124.1564788818, weight_update_time: 0.2268027365, other_time: 3.5624008179
epoch time: 20.8376636505s, input_fired_time: 0.3342970014, output_fired_time: 0.0000000000, propagate_forward_time: 19.6819057465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8214607239
validation[          , genome  6486] predictions:    9726/  10000 (97.26%), best:    9744/10000 (97.44%), error:       893.82764, best error:       841.85193 on epoch:    46, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 216.4307708740s, input_fired_time: 2.2023952007, output_fired_time: 2.4188010693, propagate_forward_time: 83.1017303467, propagate_backward_time: 125.0614776611, weight_update_time: 0.2265591174, other_time: 3.6463623047
epoch time: 19.9944705963s, input_fired_time: 0.4331025779, output_fired_time: 0.0000000000, propagate_forward_time: 18.8287181854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7326507568
validation[          , genome  6486] predictions:    9734/  10000 (97.34%), best:    9744/10000 (97.44%), error:       877.67865, best error:       841.85193 on epoch:    46, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 214.4453887939s, input_fired_time: 2.2058730125, output_fired_time: 2.3844518661, propagate_forward_time: 82.2072067261, propagate_backward_time: 124.0358428955, weight_update_time: 0.2286445051, other_time: 3.6120223999
epoch time: 33.9185714722s, input_fired_time: 0.3067430854, output_fired_time: 0.0000000000, propagate_forward_time: 32.3586769104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2531509399
validation[          , genome  6486] predictions:    9682/  10000 (96.82%), best:    9744/10000 (97.44%), error:      1023.34576, best error:       841.85193 on epoch:    46, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 222.8897705078s, input_fired_time: 2.2686116695, output_fired_time: 2.4876255989, propagate_forward_time: 85.5702590942, propagate_backward_time: 128.7748260498, weight_update_time: 0.2300040722, other_time: 3.7884368896
epoch time: 19.5951290131s, input_fired_time: 0.3088441789, output_fired_time: 0.0000000000, propagate_forward_time: 18.6067943573, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6794910431
validation[          , genome  6486] predictions:    9725/  10000 (97.25%), best:    9744/10000 (97.44%), error:       879.53955, best error:       841.85193 on epoch:    46, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 231.4069976807s, input_fired_time: 2.2871844769, output_fired_time: 2.7434730530, propagate_forward_time: 88.6654586792, propagate_backward_time: 133.8816223145, weight_update_time: 0.2266676873, other_time: 3.8292541504
epoch time: 21.1003456116s, input_fired_time: 0.3373962939, output_fired_time: 0.0000000000, propagate_forward_time: 19.9384365082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8245124817
validation[          , genome  6486] predictions:    9754/  10000 (97.54%), best:    9744/10000 (97.44%), error:       845.24811, best error:       841.85193 on epoch:    46, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 216.3163146973s, input_fired_time: 2.2094326019, output_fired_time: 2.4123342037, propagate_forward_time: 83.0782928467, propagate_backward_time: 125.0734405518, weight_update_time: 0.2315104306, other_time: 3.5428161621
epoch time: 18.0062217712s, input_fired_time: 0.2734394073, output_fired_time: 0.0000000000, propagate_forward_time: 17.0739040375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6588783264
validation[          , genome  6486] predictions:    9691/  10000 (96.91%), best:    9744/10000 (97.44%), error:      1051.39771, best error:       841.85193 on epoch:    46, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 222.4861145020s, input_fired_time: 2.2638044357, output_fired_time: 2.4266037941, propagate_forward_time: 85.4073028564, propagate_backward_time: 128.5947570801, weight_update_time: 0.2275285125, other_time: 3.7936401367
epoch time: 18.7149219513s, input_fired_time: 0.3064374328, output_fired_time: 0.0000000000, propagate_forward_time: 17.7738780975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6346073151
validation[          , genome  6486] predictions:    9673/  10000 (96.73%), best:    9744/10000 (97.44%), error:      1060.35181, best error:       841.85193 on epoch:    46, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 217.4162902832s, input_fired_time: 2.3308033943, output_fired_time: 2.3317115307, propagate_forward_time: 82.9818115234, propagate_backward_time: 125.9105834961, weight_update_time: 0.2261029631, other_time: 3.8613739014
epoch time: 17.4340476990s, input_fired_time: 0.2768651545, output_fired_time: 0.0000000000, propagate_forward_time: 16.5206413269, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6365413666
validation[          , genome  6486] predictions:    9732/  10000 (97.32%), best:    9744/10000 (97.44%), error:       866.40497, best error:       841.85193 on epoch:    46, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 214.6425018311s, input_fired_time: 2.2320988178, output_fired_time: 2.3806200027, propagate_forward_time: 82.3664093018, propagate_backward_time: 124.0869445801, weight_update_time: 0.2272201627, other_time: 3.5764312744
epoch time: 18.4819355011s, input_fired_time: 0.2733104825, output_fired_time: 0.0000000000, propagate_forward_time: 17.5726776123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6359481812
validation[          , genome  6486] predictions:    9730/  10000 (97.30%), best:    9744/10000 (97.44%), error:       877.84918, best error:       841.85193 on epoch:    46, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 221.2275085449s, input_fired_time: 2.2247576714, output_fired_time: 2.4355521202, propagate_forward_time: 87.8211135864, propagate_backward_time: 125.0596618652, weight_update_time: 0.2928959429, other_time: 3.6864318848
epoch time: 23.8882961273s, input_fired_time: 0.3046868145, output_fired_time: 0.0000000000, propagate_forward_time: 22.8228149414, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7607936859
validation[          , genome  6486] predictions:    9721/  10000 (97.21%), best:    9744/10000 (97.44%), error:       894.73438, best error:       841.85193 on epoch:    46, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 226.2554473877s, input_fired_time: 2.2178025246, output_fired_time: 2.5417418480, propagate_forward_time: 86.6221923828, propagate_backward_time: 131.0541992188, weight_update_time: 0.2265587300, other_time: 3.8195037842
epoch time: 17.9767875671s, input_fired_time: 0.2759424150, output_fired_time: 0.0000000000, propagate_forward_time: 17.0636863708, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6371593475
validation[          , genome  6486] predictions:    9741/  10000 (97.41%), best:    9744/10000 (97.44%), error:       860.14264, best error:       841.85193 on epoch:    46, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 214.6208801270s, input_fired_time: 2.2219827175, output_fired_time: 2.3744869232, propagate_forward_time: 82.4277420044, propagate_backward_time: 124.0147781372, weight_update_time: 0.2264968157, other_time: 3.5818939209
epoch time: 21.4379959106s, input_fired_time: 0.4012294412, output_fired_time: 0.0000000000, propagate_forward_time: 20.3246231079, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7121429443
validation[          , genome  6486] predictions:    9712/  10000 (97.12%), best:    9744/10000 (97.44%), error:       965.64972, best error:       841.85193 on epoch:    46, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 214.2430267334s, input_fired_time: 2.2014796734, output_fired_time: 2.3766734600, propagate_forward_time: 82.2254714966, propagate_backward_time: 123.8605346680, weight_update_time: 0.2273147851, other_time: 3.5788650513
epoch time: 22.8014202118s, input_fired_time: 0.2735957205, output_fired_time: 0.0000000000, propagate_forward_time: 21.6983566284, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8294677734
validation[          , genome  6486] predictions:    9715/  10000 (97.15%), best:    9744/10000 (97.44%), error:       913.67560, best error:       841.85193 on epoch:    46, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 191.0611572266s, input_fired_time: 2.0749855042, output_fired_time: 2.2209539413, propagate_forward_time: 71.8570632935, propagate_backward_time: 111.3514938354, weight_update_time: 0.2491777837, other_time: 3.5566711426
epoch time: 21.0034332275s, input_fired_time: 0.3682515919, output_fired_time: 0.0000000000, propagate_forward_time: 19.9704017639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6647796631
validation[          , genome  6486] predictions:    9703/  10000 (97.03%), best:    9744/10000 (97.44%), error:       942.04517, best error:       841.85193 on epoch:    46, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 224.4581146240s, input_fired_time: 2.1954247952, output_fired_time: 2.4546992779, propagate_forward_time: 84.6641998291, propagate_backward_time: 131.3753967285, weight_update_time: 0.2264575511, other_time: 3.7684020996
epoch time: 17.8204612732s, input_fired_time: 0.3139309585, output_fired_time: 0.0000000000, propagate_forward_time: 16.8713359833, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6351947784
validation[          , genome  6486] predictions:    9741/  10000 (97.41%), best:    9744/10000 (97.44%), error:       861.85522, best error:       841.85193 on epoch:    46, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 216.1959075928s, input_fired_time: 2.1995937824, output_fired_time: 2.3996055126, propagate_forward_time: 83.0638122559, propagate_backward_time: 125.0019912720, weight_update_time: 0.2262261361, other_time: 3.5308914185
epoch time: 18.2006797791s, input_fired_time: 0.2753373384, output_fired_time: 0.0000000000, propagate_forward_time: 17.2555446625, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6697978973
validation[          , genome  6486] predictions:    9698/  10000 (96.98%), best:    9744/10000 (97.44%), error:       992.04565, best error:       841.85193 on epoch:    46, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 215.4517364502s, input_fired_time: 2.2008504868, output_fired_time: 2.3818371296, propagate_forward_time: 82.8039398193, propagate_backward_time: 124.5022659302, weight_update_time: 0.2267473340, other_time: 3.5628433228
epoch time: 17.8802032471s, input_fired_time: 0.2796779871, output_fired_time: 0.0000000000, propagate_forward_time: 16.9239273071, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6765975952
validation[          , genome  6486] predictions:    9583/  10000 (95.83%), best:    9744/10000 (97.44%), error:      1344.94604, best error:       841.85193 on epoch:    46, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 219.1997833252s, input_fired_time: 2.2810015678, output_fired_time: 2.4529297352, propagate_forward_time: 84.0642013550, propagate_backward_time: 126.7230606079, weight_update_time: 0.2295844555, other_time: 3.6785812378
epoch time: 17.5739212036s, input_fired_time: 0.2766222358, output_fired_time: 0.0000000000, propagate_forward_time: 16.6602344513, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6370639801
validation[          , genome  6486] predictions:    9758/  10000 (97.58%), best:    9744/10000 (97.44%), error:       860.50098, best error:       841.85193 on epoch:    46, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 215.7162475586s, input_fired_time: 2.2314403057, output_fired_time: 2.4276595116, propagate_forward_time: 82.5559310913, propagate_backward_time: 124.9269638062, weight_update_time: 0.2271489203, other_time: 3.5742568970
epoch time: 17.7795963287s, input_fired_time: 0.2779438198, output_fired_time: 0.0000000000, propagate_forward_time: 16.8624763489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6391754150
validation[          , genome  6486] predictions:    9702/  10000 (97.02%), best:    9744/10000 (97.44%), error:       973.98096, best error:       841.85193 on epoch:    46, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 219.6890258789s, input_fired_time: 2.2236452103, output_fired_time: 2.3883039951, propagate_forward_time: 84.3736495972, propagate_backward_time: 127.0487136841, weight_update_time: 0.2593248487, other_time: 3.6547164917
epoch time: 19.6928291321s, input_fired_time: 0.3098897040, output_fired_time: 0.0000000000, propagate_forward_time: 18.6779003143, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7050399780
validation[          , genome  6486] predictions:    9746/  10000 (97.46%), best:    9744/10000 (97.44%), error:       886.84314, best error:       841.85193 on epoch:    46, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 217.2230072021s, input_fired_time: 2.2067112923, output_fired_time: 2.4378440380, propagate_forward_time: 83.2356872559, propagate_backward_time: 125.6740036011, weight_update_time: 0.2269353122, other_time: 3.6687545776
epoch time: 18.1210403442s, input_fired_time: 0.2772700787, output_fired_time: 0.0000000000, propagate_forward_time: 17.2004394531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6433315277
validation[          , genome  6486] predictions:    9738/  10000 (97.38%), best:    9744/10000 (97.44%), error:       861.71759, best error:       841.85193 on epoch:    46, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 210.3792724609s, input_fired_time: 2.2103610039, output_fired_time: 2.3605515957, propagate_forward_time: 80.3622817993, propagate_backward_time: 121.7811584473, weight_update_time: 0.2251600325, other_time: 3.6649246216
epoch time: 16.5331344604s, input_fired_time: 0.2547867894, output_fired_time: 0.0000000000, propagate_forward_time: 15.6317167282, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6466302872
validation[          , genome  6486] predictions:    9683/  10000 (96.83%), best:    9744/10000 (97.44%), error:      1065.32825, best error:       841.85193 on epoch:    46, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 218.6009368896s, input_fired_time: 2.2565221786, output_fired_time: 2.3933687210, propagate_forward_time: 83.8943023682, propagate_backward_time: 126.3966064453, weight_update_time: 0.2613946497, other_time: 3.6601409912
epoch time: 27.3245773315s, input_fired_time: 0.5000430942, output_fired_time: 0.0000000000, propagate_forward_time: 25.8723068237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9522266388
validation[          , genome  6486] predictions:    9686/  10000 (96.86%), best:    9744/10000 (97.44%), error:      1044.17029, best error:       841.85193 on epoch:    46, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 213.3636322021s, input_fired_time: 2.2083616257, output_fired_time: 2.3831017017, propagate_forward_time: 81.7743835449, propagate_backward_time: 123.4602584839, weight_update_time: 0.2569000125, other_time: 3.5375289917
epoch time: 20.2709121704s, input_fired_time: 0.3461362422, output_fired_time: 0.0000000000, propagate_forward_time: 19.1901931763, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7345829010
validation[          , genome  6486] predictions:    9727/  10000 (97.27%), best:    9744/10000 (97.44%), error:       944.88556, best error:       841.85193 on epoch:    46, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 213.6974792480s, input_fired_time: 2.2043826580, output_fired_time: 2.3976218700, propagate_forward_time: 81.8246002197, propagate_backward_time: 123.5676040649, weight_update_time: 0.2261037678, other_time: 3.7032699585
epoch time: 19.2853546143s, input_fired_time: 0.2762992382, output_fired_time: 0.0000000000, propagate_forward_time: 18.2794075012, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7296485901
validation[          , genome  6486] predictions:    9744/  10000 (97.44%), best:    9744/10000 (97.44%), error:       850.64899, best error:       841.85193 on epoch:    46, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 235.7802429199s, input_fired_time: 2.3615934849, output_fired_time: 2.7072513103, propagate_forward_time: 90.5844192505, propagate_backward_time: 136.2581481934, weight_update_time: 0.2270584404, other_time: 3.8688354492
epoch time: 19.4161338806s, input_fired_time: 0.3100040555, output_fired_time: 0.0000000000, propagate_forward_time: 18.4700489044, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6360816956
validation[          , genome  6486] predictions:    9686/  10000 (96.86%), best:    9744/10000 (97.44%), error:      1007.97131, best error:       841.85193 on epoch:    46, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 215.7633361816s, input_fired_time: 2.2250342369, output_fired_time: 2.4048790932, propagate_forward_time: 83.0117111206, propagate_backward_time: 124.5255966187, weight_update_time: 0.2270283848, other_time: 3.5961074829
epoch time: 24.4585666656s, input_fired_time: 0.3101983964, output_fired_time: 0.0000000000, propagate_forward_time: 23.3178405762, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8305282593
validation[          , genome  6486] predictions:    9701/  10000 (97.01%), best:    9744/10000 (97.44%), error:       965.32837, best error:       841.85193 on epoch:    46, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 216.2019958496s, input_fired_time: 2.2490019798, output_fired_time: 2.4162116051, propagate_forward_time: 83.0105972290, propagate_backward_time: 124.9366378784, weight_update_time: 0.2271009237, other_time: 3.5895462036
epoch time: 24.9978713989s, input_fired_time: 0.3067395389, output_fired_time: 0.0000000000, propagate_forward_time: 23.8648586273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8262729645
validation[          , genome  6486] predictions:    9757/  10000 (97.57%), best:    9744/10000 (97.44%), error:       848.42059, best error:       841.85193 on epoch:    46, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 198.7754516602s, input_fired_time: 2.2086038589, output_fired_time: 2.3286931515, propagate_forward_time: 75.3734359741, propagate_backward_time: 115.1645126343, weight_update_time: 0.2338022292, other_time: 3.7002105713
epoch time: 17.9945907593s, input_fired_time: 0.2752664685, output_fired_time: 0.0000000000, propagate_forward_time: 17.0568828583, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6624412537
validation[          , genome  6486] predictions:    9709/  10000 (97.09%), best:    9744/10000 (97.44%), error:       944.65875, best error:       841.85193 on epoch:    46, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 216.2283935547s, input_fired_time: 2.2301530838, output_fired_time: 2.4102423191, propagate_forward_time: 82.9609451294, propagate_backward_time: 125.0187301636, weight_update_time: 0.2332677841, other_time: 3.6083145142
epoch time: 18.4618034363s, input_fired_time: 0.2769002318, output_fired_time: 0.0000000000, propagate_forward_time: 17.5481395721, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6367645264
validation[          , genome  6486] predictions:    9740/  10000 (97.40%), best:    9744/10000 (97.44%), error:       846.44757, best error:       841.85193 on epoch:    46, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 222.4107818604s, input_fired_time: 2.2330870628, output_fired_time: 2.4218027592, propagate_forward_time: 89.3024368286, propagate_backward_time: 124.8692626953, weight_update_time: 0.2274891585, other_time: 3.5841979980
epoch time: 17.7363185883s, input_fired_time: 0.2774591744, output_fired_time: 0.0000000000, propagate_forward_time: 16.8257350922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6331233978
validation[          , genome  6486] predictions:    9580/  10000 (95.80%), best:    9744/10000 (97.44%), error:      1298.20508, best error:       841.85193 on epoch:    46, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 218.1826934814s, input_fired_time: 2.2372906208, output_fired_time: 2.5251955986, propagate_forward_time: 83.9399032593, propagate_backward_time: 125.8455963135, weight_update_time: 0.2363018245, other_time: 3.6347198486
epoch time: 19.3478984833s, input_fired_time: 0.3112220466, output_fired_time: 0.0000000000, propagate_forward_time: 18.3392887115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6973876953
validation[          , genome  6486] predictions:    9732/  10000 (97.32%), best:    9744/10000 (97.44%), error:       878.13898, best error:       841.85193 on epoch:    46, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 227.9367523193s, input_fired_time: 2.3472905159, output_fired_time: 2.4772040844, propagate_forward_time: 87.5810470581, propagate_backward_time: 131.7545166016, weight_update_time: 0.2583873868, other_time: 3.7767028809
epoch time: 17.9714794159s, input_fired_time: 0.2793904841, output_fired_time: 0.0000000000, propagate_forward_time: 17.0591239929, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6329650879
validation[          , genome  6486] predictions:    9724/  10000 (97.24%), best:    9744/10000 (97.44%), error:       936.29944, best error:       841.85193 on epoch:    46, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 217.7587280273s, input_fired_time: 2.2399563789, output_fired_time: 2.4513685703, propagate_forward_time: 83.3875350952, propagate_backward_time: 126.0530700684, weight_update_time: 0.2590219378, other_time: 3.6268005371
epoch time: 19.4701480865s, input_fired_time: 0.2797613144, output_fired_time: 0.0000000000, propagate_forward_time: 18.4937572479, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6966304779
validation[          , genome  6486] predictions:    9744/  10000 (97.44%), best:    9744/10000 (97.44%), error:       932.10748, best error:       841.85193 on epoch:    46, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 214.5222320557s, input_fired_time: 2.2240655422, output_fired_time: 2.3815765381, propagate_forward_time: 82.3366317749, propagate_backward_time: 123.9995269775, weight_update_time: 0.2274392247, other_time: 3.5804367065
epoch time: 17.8165607452s, input_fired_time: 0.3091359138, output_fired_time: 0.0000000000, propagate_forward_time: 16.8761196136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6313056946
validation[          , genome  6486] predictions:    9737/  10000 (97.37%), best:    9744/10000 (97.44%), error:       866.11908, best error:       841.85193 on epoch:    46, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 205.4118652344s, input_fired_time: 2.2383108139, output_fired_time: 2.3399062157, propagate_forward_time: 78.1634140015, propagate_backward_time: 118.9866867065, weight_update_time: 0.2537272871, other_time: 3.6835479736
epoch time: 19.3575115204s, input_fired_time: 0.3127340376, output_fired_time: 0.0000000000, propagate_forward_time: 18.3777084351, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6670684814
validation[          , genome  6486] predictions:    9736/  10000 (97.36%), best:    9744/10000 (97.44%), error:       886.17377, best error:       841.85193 on epoch:    46, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 226.7927246094s, input_fired_time: 2.3379168510, output_fired_time: 2.5695762634, propagate_forward_time: 88.1020812988, propagate_backward_time: 130.0588531494, weight_update_time: 0.2286351025, other_time: 3.7242889404
epoch time: 19.9184284210s, input_fired_time: 0.3426482081, output_fired_time: 0.0000000000, propagate_forward_time: 18.8793106079, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6964702606
validation[          , genome  6486] predictions:    9718/  10000 (97.18%), best:    9744/10000 (97.44%), error:       934.31482, best error:       841.85193 on epoch:    46, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 220.5818023682s, input_fired_time: 2.2585194111, output_fired_time: 2.4766979218, propagate_forward_time: 84.1979827881, propagate_backward_time: 128.0077667236, weight_update_time: 0.2254203856, other_time: 3.6408386230
epoch time: 20.3530178070s, input_fired_time: 0.3757270575, output_fired_time: 0.0000000000, propagate_forward_time: 19.2167644501, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7605266571
validation[          , genome  6486] predictions:    9747/  10000 (97.47%), best:    9744/10000 (97.44%), error:       849.97687, best error:       841.85193 on epoch:    46, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 226.5658111572s, input_fired_time: 2.2821748257, output_fired_time: 2.4684140682, propagate_forward_time: 84.8631668091, propagate_backward_time: 133.1787414551, weight_update_time: 0.2583487630, other_time: 3.7733154297
epoch time: 17.3815689087s, input_fired_time: 0.2773097157, output_fired_time: 0.0000000000, propagate_forward_time: 16.4726696014, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6315898895
validation[          , genome  6486] predictions:    9743/  10000 (97.43%), best:    9744/10000 (97.44%), error:       863.56390, best error:       841.85193 on epoch:    46, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 217.7849426270s, input_fired_time: 2.2738642693, output_fired_time: 2.4067237377, propagate_forward_time: 83.6581954956, propagate_backward_time: 125.8272705078, weight_update_time: 0.2288484871, other_time: 3.6188964844
epoch time: 18.9885292053s, input_fired_time: 0.3467442393, output_fired_time: 0.0000000000, propagate_forward_time: 17.9722366333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6695480347
validation[          , genome  6486] predictions:    9749/  10000 (97.49%), best:    9749/10000 (97.49%), error:       838.97296, best error:       838.97296 on epoch:    98, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 216.8955993652s, input_fired_time: 2.2271745205, output_fired_time: 2.4855690002, propagate_forward_time: 83.3033370972, propagate_backward_time: 125.2835922241, weight_update_time: 0.2271186113, other_time: 3.5959243774
epoch time: 17.8775005341s, input_fired_time: 0.2790755630, output_fired_time: 0.0000000000, propagate_forward_time: 16.9671440125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6312808990
validation[          , genome  6486] predictions:    9730/  10000 (97.30%), best:    9749/10000 (97.49%), error:       921.46765, best error:       838.97296 on epoch:    98, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 215.4076690674s, input_fired_time: 2.2578978539, output_fired_time: 2.3915410042, propagate_forward_time: 82.6746673584, propagate_backward_time: 124.5219497681, weight_update_time: 0.2271913737, other_time: 3.5616073608
epoch time: 19.2186813354s, input_fired_time: 0.3084114492, output_fired_time: 0.0000000000, propagate_forward_time: 18.1838188171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7264518738
validation[          , genome  6486] predictions:    9731/  10000 (97.31%), best:    9749/10000 (97.49%), error:       877.04449, best error:       838.97296 on epoch:    98, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 86.1952209473s, input_fired_time: 1.4037215710, output_fired_time: 0.0000000000, propagate_forward_time: 81.5041809082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2873153687
best training[          , genome  6486] predictions:   49714/  50000 (99.43%), best:    9749/10000 (97.49%), error:      1406.71729, best error:       838.97296 on epoch:    98, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 19.6363468170s, input_fired_time: 0.2797307074, output_fired_time: 0.0000000000, propagate_forward_time: 18.5810127258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7756042480
   testing[          , genome  6486] predictions:    9774/  10000 (97.74%), best:    9749/10000 (97.49%), error:       770.55774, best error:       838.97296 on epoch:    98, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
07:25:05 (6784): called boinc_finish(0)

</stderr_txt>
]]>