Nameexact_genome_1512568488_45_6699_1
Workunit2604706
Created7 Dec 2017, 21:19:57 UTC
Sent7 Dec 2017, 21:24:19 UTC
Report deadline14 Dec 2017, 1:49:56 UTC
Received8 Dec 2017, 12:50:25 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID67052
Run time7 hours 14 min 24 sec
CPU time2 hours 36 min 38 sec
Validate stateValid
Credit1,546.12
Device peak FLOPS4.07 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size124.29 MB
Peak swap size152.46 MB
Peak disk usage2.14 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 334.1944885254s, input_fired_time: 2.9454178810, output_fired_time: 1.6181366444, propagate_forward_time: 42.4165191650, propagate_backward_time: 71.7316513062, weight_update_time: 0.2579609454, other_time: 215.4827575684
epoch time: 29.0626144409s, input_fired_time: 0.2290116698, output_fired_time: 0.0000000000, propagate_forward_time: 10.5885953903, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 18.2450065613
validation[          , genome  6699] predictions:    9643/  10000 (96.43%), best:    9677/10000 (96.77%), error:      1139.93091, best error:      1033.77869 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 264.6454162598s, input_fired_time: 1.6919327974, output_fired_time: 1.3637044430, propagate_forward_time: 36.8783760071, propagate_backward_time: 63.1440582275, weight_update_time: 0.2516931593, other_time: 161.5673522949
epoch time: 15.7591609955s, input_fired_time: 0.2501070499, output_fired_time: 0.0000000000, propagate_forward_time: 6.3505387306, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.1585159302
validation[          , genome  6699] predictions:    9680/  10000 (96.80%), best:    9677/10000 (96.77%), error:      1063.56677, best error:      1033.77869 on epoch:    13, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 151.1359710693s, input_fired_time: 1.8602968454, output_fired_time: 2.6063878536, propagate_forward_time: 37.4493942261, propagate_backward_time: 55.5518074036, weight_update_time: 0.3563212156, other_time: 53.6680946350
epoch time: 12.3405179977s, input_fired_time: 1.2108950615, output_fired_time: 0.0000000000, propagate_forward_time: 4.7952747345, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.3343486786
validation[          , genome  6699] predictions:    9637/  10000 (96.37%), best:    9677/10000 (96.77%), error:      1175.27930, best error:      1033.77869 on epoch:    13, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 144.7873382568s, input_fired_time: 1.4705218077, output_fired_time: 1.2261037827, propagate_forward_time: 27.3652820587, propagate_backward_time: 46.4990348816, weight_update_time: 0.2533929944, other_time: 68.2263946533
epoch time: 14.3565111160s, input_fired_time: 0.2351381481, output_fired_time: 0.0000000000, propagate_forward_time: 7.4566211700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.6647520065
validation[          , genome  6699] predictions:    9621/  10000 (96.21%), best:    9677/10000 (96.77%), error:      1172.41040, best error:      1033.77869 on epoch:    13, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 259.9037170410s, input_fired_time: 1.5792104006, output_fired_time: 2.2660558224, propagate_forward_time: 40.7236289978, propagate_backward_time: 63.6370239258, weight_update_time: 0.2992062569, other_time: 151.6977844238
epoch time: 12.0433416367s, input_fired_time: 0.2315787226, output_fired_time: 0.0000000000, propagate_forward_time: 6.3351554871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4766073227
validation[          , genome  6699] predictions:    9686/  10000 (96.86%), best:    9686/10000 (96.86%), error:      1001.24561, best error:      1001.24561 on epoch:    19, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 167.7486114502s, input_fired_time: 1.8407893181, output_fired_time: 1.4794023037, propagate_forward_time: 38.3574600220, propagate_backward_time: 59.0531234741, weight_update_time: 0.2962869406, other_time: 67.0178375244
epoch time: 23.2458419800s, input_fired_time: 0.2506262958, output_fired_time: 0.0000000000, propagate_forward_time: 9.4912471771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.5039691925
validation[          , genome  6699] predictions:    9687/  10000 (96.87%), best:    9686/10000 (96.86%), error:      1058.56079, best error:      1001.24561 on epoch:    19, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 305.0837402344s, input_fired_time: 1.9000117779, output_fired_time: 1.3666993380, propagate_forward_time: 48.0087661743, propagate_backward_time: 74.6123809814, weight_update_time: 0.2682012320, other_time: 179.1958770752
epoch time: 19.8196296692s, input_fired_time: 0.2293248028, output_fired_time: 0.0000000000, propagate_forward_time: 9.4376726151, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.1526327133
validation[          , genome  6699] predictions:    9669/  10000 (96.69%), best:    9686/10000 (96.86%), error:      1050.31873, best error:      1001.24561 on epoch:    19, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 251.6869964600s, input_fired_time: 1.7487264872, output_fired_time: 1.5652236938, propagate_forward_time: 40.9730834961, propagate_backward_time: 64.6384658813, weight_update_time: 0.2588007450, other_time: 142.7615051270
epoch time: 11.6969528198s, input_fired_time: 0.2591346204, output_fired_time: 0.0000000000, propagate_forward_time: 6.9219675064, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5158510208
validation[          , genome  6699] predictions:    9679/  10000 (96.79%), best:    9686/10000 (96.86%), error:      1023.01581, best error:      1001.24561 on epoch:    19, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 216.6132507324s, input_fired_time: 1.7530065775, output_fired_time: 1.3967833519, propagate_forward_time: 38.2576942444, propagate_backward_time: 57.0797424316, weight_update_time: 0.2647152245, other_time: 118.1260223389
epoch time: 22.3101902008s, input_fired_time: 0.2974978983, output_fired_time: 0.0000000000, propagate_forward_time: 8.9940729141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.0186185837
validation[          , genome  6699] predictions:    9704/  10000 (97.04%), best:    9704/10000 (97.04%), error:       968.28949, best error:       968.28949 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 320.5248107910s, input_fired_time: 3.9585673809, output_fired_time: 2.4138400555, propagate_forward_time: 45.1643867493, propagate_backward_time: 75.7840347290, weight_update_time: 0.2294238657, other_time: 193.2039794922
epoch time: 19.9540557861s, input_fired_time: 0.2486076653, output_fired_time: 0.0000000000, propagate_forward_time: 8.3700437546, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.3354043961
validation[          , genome  6699] predictions:    9671/  10000 (96.71%), best:    9704/10000 (97.04%), error:      1073.60461, best error:       968.28949 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 260.1813049316s, input_fired_time: 1.5989273787, output_fired_time: 2.3057322502, propagate_forward_time: 44.7628021240, propagate_backward_time: 69.6441879272, weight_update_time: 0.2336659729, other_time: 141.8696594238
epoch time: 22.3517093658s, input_fired_time: 0.2131758481, output_fired_time: 0.0000000000, propagate_forward_time: 7.7392206192, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.3993120193
validation[          , genome  6699] predictions:    9641/  10000 (96.41%), best:    9704/10000 (97.04%), error:      1086.91479, best error:       968.28949 on epoch:    23, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 234.3761138916s, input_fired_time: 1.6081526279, output_fired_time: 1.3356324434, propagate_forward_time: 39.3670234680, propagate_backward_time: 64.8747940063, weight_update_time: 1.2230700254, other_time: 127.1905136108
epoch time: 17.6741523743s, input_fired_time: 0.2073000222, output_fired_time: 0.0000000000, propagate_forward_time: 8.0280494690, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.4388027191
validation[          , genome  6699] predictions:    9670/  10000 (96.70%), best:    9704/10000 (97.04%), error:      1055.50781, best error:       968.28949 on epoch:    23, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 171.5775756836s, input_fired_time: 1.6014533043, output_fired_time: 2.2347164154, propagate_forward_time: 32.6095695496, propagate_backward_time: 50.1104736328, weight_update_time: 0.3054717779, other_time: 85.0213623047
epoch time: 18.7427272797s, input_fired_time: 0.2865332067, output_fired_time: 0.0000000000, propagate_forward_time: 6.8506388664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.6055545807
validation[          , genome  6699] predictions:    9700/  10000 (97.00%), best:    9704/10000 (97.04%), error:       984.98322, best error:       968.28949 on epoch:    23, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 228.3145599365s, input_fired_time: 1.4898960590, output_fired_time: 1.1918746233, propagate_forward_time: 38.7872962952, propagate_backward_time: 59.0899429321, weight_update_time: 0.2078224123, other_time: 127.7555465698
epoch time: 29.9375724792s, input_fired_time: 0.2766514122, output_fired_time: 0.0000000000, propagate_forward_time: 9.5746412277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 20.0862808228
validation[          , genome  6699] predictions:    9680/  10000 (96.80%), best:    9704/10000 (97.04%), error:      1040.78687, best error:       968.28949 on epoch:    23, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 189.6980438232s, input_fired_time: 1.8087316751, output_fired_time: 1.4262793064, propagate_forward_time: 35.6773681641, propagate_backward_time: 57.5297584534, weight_update_time: 0.2892796695, other_time: 93.2559051514
epoch time: 18.3542652130s, input_fired_time: 0.3399454951, output_fired_time: 0.0000000000, propagate_forward_time: 7.7178459167, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.2964744568
validation[          , genome  6699] predictions:    9700/  10000 (97.00%), best:    9700/10000 (97.00%), error:       947.84863, best error:       947.84863 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 353.0090942383s, input_fired_time: 1.8563305140, output_fired_time: 1.4602998495, propagate_forward_time: 46.0441932678, propagate_backward_time: 72.2058486938, weight_update_time: 0.3620576560, other_time: 231.4424438477
epoch time: 23.1566123962s, input_fired_time: 0.2708235979, output_fired_time: 0.0000000000, propagate_forward_time: 9.1447439194, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.7410440445
validation[          , genome  6699] predictions:    9704/  10000 (97.04%), best:    9700/10000 (97.00%), error:       996.54822, best error:       947.84863 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 358.7275695801s, input_fired_time: 1.9536008835, output_fired_time: 1.6364846230, propagate_forward_time: 42.8485336304, propagate_backward_time: 68.7015228271, weight_update_time: 0.2743516862, other_time: 243.5874176025
epoch time: 26.3139915466s, input_fired_time: 0.2485516667, output_fired_time: 0.0000000000, propagate_forward_time: 9.2274808884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.8379592896
validation[          , genome  6699] predictions:    9722/  10000 (97.22%), best:    9700/10000 (97.00%), error:       978.76093, best error:       947.84863 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 167.7257995605s, input_fired_time: 1.6047899723, output_fired_time: 1.3555969000, propagate_forward_time: 31.6038093567, propagate_backward_time: 52.1383743286, weight_update_time: 0.2840400934, other_time: 81.0232315063
epoch time: 12.9891777039s, input_fired_time: 0.2651629746, output_fired_time: 0.0000000000, propagate_forward_time: 9.2216959000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5023183823
validation[          , genome  6699] predictions:    9679/  10000 (96.79%), best:    9700/10000 (97.00%), error:      1016.44507, best error:       947.84863 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 132.7034759521s, input_fired_time: 1.6105233431, output_fired_time: 2.3132872581, propagate_forward_time: 31.5704593658, propagate_backward_time: 51.6162643433, weight_update_time: 0.2798618972, other_time: 45.5929412842
epoch time: 16.5895786285s, input_fired_time: 0.2855085433, output_fired_time: 0.0000000000, propagate_forward_time: 6.5982646942, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.7058048248
validation[          , genome  6699] predictions:    9621/  10000 (96.21%), best:    9700/10000 (97.00%), error:      1175.77417, best error:       947.84863 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 262.5743103027s, input_fired_time: 1.6712073088, output_fired_time: 1.2728674412, propagate_forward_time: 34.9730606079, propagate_backward_time: 59.5533180237, weight_update_time: 0.2659900188, other_time: 165.1038818359
epoch time: 13.5215320587s, input_fired_time: 0.2193967849, output_fired_time: 0.0000000000, propagate_forward_time: 6.1582274437, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.1439080238
validation[          , genome  6699] predictions:    9698/  10000 (96.98%), best:    9700/10000 (97.00%), error:      1001.23383, best error:       947.84863 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 139.7404022217s, input_fired_time: 1.6917035580, output_fired_time: 1.3625724316, propagate_forward_time: 36.3535270691, propagate_backward_time: 64.4175872803, weight_update_time: 0.2832992375, other_time: 35.9150085449
epoch time: 19.0855102539s, input_fired_time: 0.3086878359, output_fired_time: 0.0000000000, propagate_forward_time: 9.1749124527, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.6019105911
validation[          , genome  6699] predictions:    9551/  10000 (95.51%), best:    9700/10000 (97.00%), error:      1397.54150, best error:       947.84863 on epoch:    29, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 271.1150817871s, input_fired_time: 1.5638287067, output_fired_time: 1.3259598017, propagate_forward_time: 38.4285736084, propagate_backward_time: 60.4448127747, weight_update_time: 0.2529659569, other_time: 169.3518981934
epoch time: 15.2570276260s, input_fired_time: 0.2432975322, output_fired_time: 0.0000000000, propagate_forward_time: 6.8053689003, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.2083606720
validation[          , genome  6699] predictions:    9688/  10000 (96.88%), best:    9700/10000 (97.00%), error:       998.71454, best error:       947.84863 on epoch:    29, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 114.5650634766s, input_fired_time: 1.4826674461, output_fired_time: 1.2317699194, propagate_forward_time: 30.3171920776, propagate_backward_time: 53.6004447937, weight_update_time: 0.2547505796, other_time: 27.9329872131
epoch time: 15.0422325134s, input_fired_time: 0.2330928296, output_fired_time: 0.0000000000, propagate_forward_time: 6.7227673531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.0863723755
validation[          , genome  6699] predictions:    9711/  10000 (97.11%), best:    9700/10000 (97.00%), error:       972.84052, best error:       947.84863 on epoch:    29, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 296.8745117188s, input_fired_time: 1.7259789705, output_fired_time: 1.5361211300, propagate_forward_time: 41.2306671143, propagate_backward_time: 69.3152618408, weight_update_time: 0.2800965011, other_time: 183.0664672852
epoch time: 20.3895721436s, input_fired_time: 0.2128275186, output_fired_time: 0.0000000000, propagate_forward_time: 9.6568441391, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.5199003220
validation[          , genome  6699] predictions:    9711/  10000 (97.11%), best:    9711/10000 (97.11%), error:       923.12994, best error:       923.12994 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 347.5293884277s, input_fired_time: 1.6022728682, output_fired_time: 2.4096410275, propagate_forward_time: 40.4971199036, propagate_backward_time: 69.5776443481, weight_update_time: 0.3037510216, other_time: 233.4427185059
epoch time: 19.1296215057s, input_fired_time: 0.2523742616, output_fired_time: 0.0000000000, propagate_forward_time: 8.2104253769, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.6668214798
validation[          , genome  6699] predictions:    9704/  10000 (97.04%), best:    9711/10000 (97.11%), error:      1019.88190, best error:       923.12994 on epoch:    38, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 273.3898010254s, input_fired_time: 1.6618939638, output_fired_time: 2.3117272854, propagate_forward_time: 35.7070808411, propagate_backward_time: 61.3496017456, weight_update_time: 0.2911981344, other_time: 172.3594970703
epoch time: 18.0960521698s, input_fired_time: 1.2507880926, output_fired_time: 0.0000000000, propagate_forward_time: 6.7358684540, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.1093959808
validation[          , genome  6699] predictions:    9707/  10000 (97.07%), best:    9711/10000 (97.11%), error:       923.64307, best error:       923.12994 on epoch:    38, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 209.4708099365s, input_fired_time: 1.6349272728, output_fired_time: 1.4043633938, propagate_forward_time: 36.9938163757, propagate_backward_time: 57.1908187866, weight_update_time: 0.2710230350, other_time: 112.2468795776
epoch time: 20.5784282684s, input_fired_time: 0.2464389354, output_fired_time: 0.0000000000, propagate_forward_time: 7.8942608833, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.4377288818
validation[          , genome  6699] predictions:    9674/  10000 (96.74%), best:    9711/10000 (97.11%), error:      1038.50208, best error:       923.12994 on epoch:    38, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 324.4132690430s, input_fired_time: 1.6297868490, output_fired_time: 1.3353651762, propagate_forward_time: 43.7712249756, propagate_backward_time: 70.8143997192, weight_update_time: 0.2992957234, other_time: 206.8624877930
epoch time: 11.8379726410s, input_fired_time: 0.1581081003, output_fired_time: 0.0000000000, propagate_forward_time: 5.6368393898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.0430254936
validation[          , genome  6699] predictions:    9704/  10000 (97.04%), best:    9711/10000 (97.11%), error:       988.04785, best error:       923.12994 on epoch:    38, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 143.1235198975s, input_fired_time: 0.8041411638, output_fired_time: 0.7126675844, propagate_forward_time: 27.9973850250, propagate_backward_time: 42.3548355103, weight_update_time: 0.1356945932, other_time: 71.2545013428
epoch time: 14.4449529648s, input_fired_time: 0.0732384995, output_fired_time: 0.0000000000, propagate_forward_time: 4.4794487953, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.8922653198
validation[          , genome  6699] predictions:    9722/  10000 (97.22%), best:    9722/10000 (97.22%), error:       903.48279, best error:       903.48279 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 205.1867675781s, input_fired_time: 1.5548758507, output_fired_time: 1.3911863565, propagate_forward_time: 35.4973182678, propagate_backward_time: 60.6290321350, weight_update_time: 0.2427632362, other_time: 106.1143646240
epoch time: 20.9235363007s, input_fired_time: 0.2665227950, output_fired_time: 0.0000000000, propagate_forward_time: 9.5112142563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.1457986832
validation[          , genome  6699] predictions:    9744/  10000 (97.44%), best:    9744/10000 (97.44%), error:       862.04095, best error:       862.04095 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 362.7323913574s, input_fired_time: 1.8720872402, output_fired_time: 1.4010448456, propagate_forward_time: 40.9813308716, propagate_backward_time: 73.0486450195, weight_update_time: 0.3184974194, other_time: 245.4292907715
epoch time: 28.1281261444s, input_fired_time: 0.2784339786, output_fired_time: 0.0000000000, propagate_forward_time: 8.7881498337, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 19.0615425110
validation[          , genome  6699] predictions:    9716/  10000 (97.16%), best:    9744/10000 (97.44%), error:       925.46234, best error:       862.04095 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 355.3260192871s, input_fired_time: 1.7386182547, output_fired_time: 1.8027415276, propagate_forward_time: 44.3351402283, propagate_backward_time: 75.5412063599, weight_update_time: 0.2603704035, other_time: 231.9083251953
epoch time: 26.9462432861s, input_fired_time: 0.3065163195, output_fired_time: 0.0000000000, propagate_forward_time: 9.1503782272, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 17.4893493652
validation[          , genome  6699] predictions:    9690/  10000 (96.90%), best:    9744/10000 (97.44%), error:       950.35742, best error:       862.04095 on epoch:    44, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 321.7092895508s, input_fired_time: 1.8976383209, output_fired_time: 1.4387158155, propagate_forward_time: 45.0173454285, propagate_backward_time: 65.9742355347, weight_update_time: 1.3483905792, other_time: 207.3813476563
epoch time: 22.1716156006s, input_fired_time: 0.2938496172, output_fired_time: 0.0000000000, propagate_forward_time: 8.5432462692, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.3345193863
validation[          , genome  6699] predictions:    9692/  10000 (96.92%), best:    9744/10000 (97.44%), error:       998.38129, best error:       862.04095 on epoch:    44, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 347.3318481445s, input_fired_time: 1.8094382286, output_fired_time: 1.5768488646, propagate_forward_time: 41.6397857666, propagate_backward_time: 71.1281127930, weight_update_time: 0.2539570928, other_time: 231.1776733398
epoch time: 21.3124980927s, input_fired_time: 0.2713436782, output_fired_time: 0.0000000000, propagate_forward_time: 9.8192253113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.2219295502
validation[          , genome  6699] predictions:    9675/  10000 (96.75%), best:    9744/10000 (97.44%), error:      1019.61127, best error:       862.04095 on epoch:    44, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 387.7446289063s, input_fired_time: 1.8530868292, output_fired_time: 1.7534738779, propagate_forward_time: 48.0973739624, propagate_backward_time: 73.3939590454, weight_update_time: 0.3203959167, other_time: 262.6467285156
epoch time: 25.6825065613s, input_fired_time: 0.2332222015, output_fired_time: 0.0000000000, propagate_forward_time: 9.0248374939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.4244461060
validation[          , genome  6699] predictions:    9690/  10000 (96.90%), best:    9744/10000 (97.44%), error:       966.39929, best error:       862.04095 on epoch:    44, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 373.0103454590s, input_fired_time: 1.8181425333, output_fired_time: 1.4211055040, propagate_forward_time: 49.4040145874, propagate_backward_time: 70.5241241455, weight_update_time: 0.2822906971, other_time: 249.8429412842
epoch time: 22.6493263245s, input_fired_time: 0.2574301958, output_fired_time: 0.0000000000, propagate_forward_time: 9.1172828674, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.2746124268
validation[          , genome  6699] predictions:    9640/  10000 (96.40%), best:    9744/10000 (97.44%), error:      1108.08093, best error:       862.04095 on epoch:    44, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 355.5054931641s, input_fired_time: 1.7475552559, output_fired_time: 1.6047154665, propagate_forward_time: 48.9594764709, propagate_backward_time: 71.1611175537, weight_update_time: 0.2672284842, other_time: 232.0326385498
epoch time: 20.9767303467s, input_fired_time: 0.2266092300, output_fired_time: 0.0000000000, propagate_forward_time: 7.8861255646, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.8639965057
validation[          , genome  6699] predictions:    9714/  10000 (97.14%), best:    9744/10000 (97.44%), error:       901.78754, best error:       862.04095 on epoch:    44, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 353.3512878418s, input_fired_time: 1.7031676769, output_fired_time: 1.4193269014, propagate_forward_time: 40.1974105835, propagate_backward_time: 72.4945983887, weight_update_time: 0.3330839574, other_time: 237.5367736816
epoch time: 28.6604557037s, input_fired_time: 1.3470647335, output_fired_time: 0.0000000000, propagate_forward_time: 8.6108160019, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 18.7025756836
validation[          , genome  6699] predictions:    9677/  10000 (96.77%), best:    9744/10000 (97.44%), error:      1030.15735, best error:       862.04095 on epoch:    44, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 201.4231719971s, input_fired_time: 1.6576507092, output_fired_time: 1.3668725491, propagate_forward_time: 36.9340591431, propagate_backward_time: 60.7963829041, weight_update_time: 0.2567653656, other_time: 100.6682128906
epoch time: 14.0509729385s, input_fired_time: 0.2453507483, output_fired_time: 0.0000000000, propagate_forward_time: 7.0729188919, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.7327032089
validation[          , genome  6699] predictions:    9611/  10000 (96.11%), best:    9744/10000 (97.44%), error:      1212.66553, best error:       862.04095 on epoch:    44, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 301.6944885254s, input_fired_time: 2.5777204037, output_fired_time: 1.3346996307, propagate_forward_time: 39.7644004822, propagate_backward_time: 66.2689971924, weight_update_time: 0.2602046132, other_time: 191.7486724854
epoch time: 23.6981830597s, input_fired_time: 0.2546595931, output_fired_time: 0.0000000000, propagate_forward_time: 7.9194259644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.5240974426
validation[          , genome  6699] predictions:    9689/  10000 (96.89%), best:    9744/10000 (97.44%), error:       944.89911, best error:       862.04095 on epoch:    44, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 271.8744201660s, input_fired_time: 1.7760126591, output_fired_time: 1.2987580299, propagate_forward_time: 40.4328308105, propagate_backward_time: 64.4876480103, weight_update_time: 0.2546536624, other_time: 163.8791809082
epoch time: 22.5036029816s, input_fired_time: 0.3028838933, output_fired_time: 0.0000000000, propagate_forward_time: 9.7139625549, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.4867572784
validation[          , genome  6699] predictions:    9704/  10000 (97.04%), best:    9744/10000 (97.44%), error:       947.96600, best error:       862.04095 on epoch:    44, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 317.8488159180s, input_fired_time: 2.6578350067, output_fired_time: 1.3388947248, propagate_forward_time: 47.1741294861, propagate_backward_time: 69.1139602661, weight_update_time: 0.2676194906, other_time: 197.5639953613
epoch time: 22.5859737396s, input_fired_time: 0.1772772521, output_fired_time: 0.0000000000, propagate_forward_time: 9.0280065536, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.3806905746
validation[          , genome  6699] predictions:    9680/  10000 (96.80%), best:    9744/10000 (97.44%), error:      1009.29858, best error:       862.04095 on epoch:    44, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 321.5182495117s, input_fired_time: 1.6642138958, output_fired_time: 1.4340441227, propagate_forward_time: 46.9757270813, propagate_backward_time: 67.7948532104, weight_update_time: 0.2405185401, other_time: 203.6493835449
epoch time: 23.5396270752s, input_fired_time: 0.2477299273, output_fired_time: 0.0000000000, propagate_forward_time: 8.3201265335, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.9717702866
validation[          , genome  6699] predictions:    9695/  10000 (96.95%), best:    9744/10000 (97.44%), error:      1016.97717, best error:       862.04095 on epoch:    44, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 275.4417419434s, input_fired_time: 2.6078994274, output_fired_time: 1.4064512253, propagate_forward_time: 45.0799980164, propagate_backward_time: 65.7657546997, weight_update_time: 0.2780634165, other_time: 160.5816040039
epoch time: 18.1621990204s, input_fired_time: 0.2366383523, output_fired_time: 0.0000000000, propagate_forward_time: 8.3600282669, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.5655317307
validation[          , genome  6699] predictions:    9714/  10000 (97.14%), best:    9744/10000 (97.44%), error:       905.57990, best error:       862.04095 on epoch:    44, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 210.1450958252s, input_fired_time: 2.5143196583, output_fired_time: 2.1230170727, propagate_forward_time: 31.6073951721, propagate_backward_time: 50.7586898804, weight_update_time: 0.2417955101, other_time: 123.1416854858
epoch time: 16.6191024780s, input_fired_time: 0.2799196839, output_fired_time: 0.0000000000, propagate_forward_time: 8.5488243103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.7903575897
validation[          , genome  6699] predictions:    9655/  10000 (96.55%), best:    9744/10000 (97.44%), error:      1120.28149, best error:       862.04095 on epoch:    44, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 258.2202758789s, input_fired_time: 1.6569550037, output_fired_time: 2.5170879364, propagate_forward_time: 42.2896499634, propagate_backward_time: 65.9417953491, weight_update_time: 0.2562933266, other_time: 145.8147888184
epoch time: 23.4661083221s, input_fired_time: 0.2100664675, output_fired_time: 0.0000000000, propagate_forward_time: 9.6220893860, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.6339530945
validation[          , genome  6699] predictions:    9703/  10000 (97.03%), best:    9744/10000 (97.44%), error:       968.51581, best error:       862.04095 on epoch:    44, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 232.3494567871s, input_fired_time: 1.5971430540, output_fired_time: 1.3660420179, propagate_forward_time: 42.1547279358, propagate_backward_time: 62.2889213562, weight_update_time: 0.2733078897, other_time: 124.9426269531
epoch time: 12.9811716080s, input_fired_time: 0.2278598249, output_fired_time: 0.0000000000, propagate_forward_time: 6.7378659248, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.0154461861
validation[          , genome  6699] predictions:    9687/  10000 (96.87%), best:    9744/10000 (97.44%), error:      1006.50787, best error:       862.04095 on epoch:    44, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 219.1174774170s, input_fired_time: 2.6473741531, output_fired_time: 1.3189011812, propagate_forward_time: 40.1941680908, propagate_backward_time: 61.3187446594, weight_update_time: 0.2747476101, other_time: 113.6382904053
epoch time: 22.9272937775s, input_fired_time: 0.2075710893, output_fired_time: 0.0000000000, propagate_forward_time: 9.0656309128, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.6540918350
validation[          , genome  6699] predictions:    9719/  10000 (97.19%), best:    9744/10000 (97.44%), error:       923.08545, best error:       862.04095 on epoch:    44, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 284.8929748535s, input_fired_time: 1.5470439196, output_fired_time: 1.3653290272, propagate_forward_time: 43.0524978638, propagate_backward_time: 73.8502655029, weight_update_time: 0.2511838377, other_time: 165.0778350830
epoch time: 18.3422603607s, input_fired_time: 0.2241977453, output_fired_time: 0.0000000000, propagate_forward_time: 7.5278887749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.5901737213
validation[          , genome  6699] predictions:    9722/  10000 (97.22%), best:    9744/10000 (97.44%), error:       886.74213, best error:       862.04095 on epoch:    44, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 223.6871032715s, input_fired_time: 2.4921729565, output_fired_time: 1.4541174173, propagate_forward_time: 39.2456741333, propagate_backward_time: 59.2580375671, weight_update_time: 0.2227884680, other_time: 121.2371063232
epoch time: 16.6545429230s, input_fired_time: 0.1836850494, output_fired_time: 0.0000000000, propagate_forward_time: 4.5776219368, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.8932361603
validation[          , genome  6699] predictions:    9731/  10000 (97.31%), best:    9744/10000 (97.44%), error:       915.94672, best error:       862.04095 on epoch:    44, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 157.4071807861s, input_fired_time: 1.5073548555, output_fired_time: 1.2674885988, propagate_forward_time: 36.7491760254, propagate_backward_time: 61.3984870911, weight_update_time: 0.2546923757, other_time: 56.4846763611
epoch time: 22.8765449524s, input_fired_time: 0.2750025094, output_fired_time: 0.0000000000, propagate_forward_time: 9.4097642899, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.1917772293
validation[          , genome  6699] predictions:    9701/  10000 (97.01%), best:    9744/10000 (97.44%), error:       970.85803, best error:       862.04095 on epoch:    44, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 218.2968444824s, input_fired_time: 1.5255459547, output_fired_time: 2.3717010021, propagate_forward_time: 38.3575744629, propagate_backward_time: 64.8422775269, weight_update_time: 0.2327600121, other_time: 111.1997451782
epoch time: 13.4531984329s, input_fired_time: 0.1898739636, output_fired_time: 0.0000000000, propagate_forward_time: 4.9145750999, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.3487491608
validation[          , genome  6699] predictions:    9703/  10000 (97.03%), best:    9744/10000 (97.44%), error:       909.35187, best error:       862.04095 on epoch:    44, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 158.9950866699s, input_fired_time: 1.6412380934, output_fired_time: 2.2448875904, propagate_forward_time: 33.7462921143, propagate_backward_time: 56.0428924561, weight_update_time: 0.2618030906, other_time: 65.3197784424
epoch time: 21.4043827057s, input_fired_time: 0.2008131295, output_fired_time: 0.0000000000, propagate_forward_time: 8.4955606461, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.7080087662
validation[          , genome  6699] predictions:    9731/  10000 (97.31%), best:    9744/10000 (97.44%), error:       890.74408, best error:       862.04095 on epoch:    44, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 244.9669494629s, input_fired_time: 1.5204603672, output_fired_time: 1.2489464283, propagate_forward_time: 34.7065582275, propagate_backward_time: 57.8580436707, weight_update_time: 0.2286467850, other_time: 149.6329345703
epoch time: 15.3736324310s, input_fired_time: 0.2630418837, output_fired_time: 0.0000000000, propagate_forward_time: 7.5429205894, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5676703453
validation[          , genome  6699] predictions:    9689/  10000 (96.89%), best:    9744/10000 (97.44%), error:      1061.17896, best error:       862.04095 on epoch:    44, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 249.1985321045s, input_fired_time: 2.8230156898, output_fired_time: 1.3986690044, propagate_forward_time: 42.1951713562, propagate_backward_time: 63.9330215454, weight_update_time: 0.2452718019, other_time: 138.8486633301
epoch time: 19.7168331146s, input_fired_time: 0.2436724901, output_fired_time: 0.0000000000, propagate_forward_time: 7.6926217079, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.7805385590
validation[          , genome  6699] predictions:    9701/  10000 (97.01%), best:    9744/10000 (97.44%), error:       979.86914, best error:       862.04095 on epoch:    44, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 143.9170684814s, input_fired_time: 1.4287549257, output_fired_time: 1.1697555780, propagate_forward_time: 37.3433456421, propagate_backward_time: 53.5682830811, weight_update_time: 0.2499405295, other_time: 50.4069290161
epoch time: 11.7788267136s, input_fired_time: 0.2097323388, output_fired_time: 0.0000000000, propagate_forward_time: 6.8902935982, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6788010597
validation[          , genome  6699] predictions:    9681/  10000 (96.81%), best:    9744/10000 (97.44%), error:      1051.17163, best error:       862.04095 on epoch:    44, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 312.9555664063s, input_fired_time: 1.8344235420, output_fired_time: 1.6364685297, propagate_forward_time: 48.4971923828, propagate_backward_time: 83.8717422485, weight_update_time: 0.2232965082, other_time: 177.1157531738
epoch time: 24.8641834259s, input_fired_time: 0.2072076350, output_fired_time: 0.0000000000, propagate_forward_time: 9.7522211075, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.9047555923
validation[          , genome  6699] predictions:    9623/  10000 (96.23%), best:    9744/10000 (97.44%), error:      1259.39087, best error:       862.04095 on epoch:    44, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 210.3558807373s, input_fired_time: 1.5462958813, output_fired_time: 1.5904446840, propagate_forward_time: 52.8899459839, propagate_backward_time: 73.4939422607, weight_update_time: 0.2786369026, other_time: 80.8352508545
epoch time: 21.7725505829s, input_fired_time: 0.2316344976, output_fired_time: 0.0000000000, propagate_forward_time: 9.5587530136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.9821634293
validation[          , genome  6699] predictions:    9691/  10000 (96.91%), best:    9744/10000 (97.44%), error:      1013.91034, best error:       862.04095 on epoch:    44, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 213.0711822510s, input_fired_time: 2.8602197170, output_fired_time: 1.2863944769, propagate_forward_time: 49.1326293945, propagate_backward_time: 84.1691741943, weight_update_time: 0.3118436337, other_time: 75.6227722168
epoch time: 18.9134273529s, input_fired_time: 0.2560400069, output_fired_time: 0.0000000000, propagate_forward_time: 12.3961019516, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2612848282
validation[          , genome  6699] predictions:    9673/  10000 (96.73%), best:    9744/10000 (97.44%), error:      1056.30652, best error:       862.04095 on epoch:    44, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 212.5702514648s, input_fired_time: 1.6491917372, output_fired_time: 1.5703265667, propagate_forward_time: 48.1183815002, propagate_backward_time: 75.9002685547, weight_update_time: 0.2342973500, other_time: 85.3320922852
epoch time: 22.4376258850s, input_fired_time: 0.2292529196, output_fired_time: 0.0000000000, propagate_forward_time: 9.0713443756, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.1370277405
validation[          , genome  6699] predictions:    9713/  10000 (97.13%), best:    9744/10000 (97.44%), error:       944.35120, best error:       862.04095 on epoch:    44, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 255.3541564941s, input_fired_time: 1.8290696144, output_fired_time: 1.4150626659, propagate_forward_time: 58.1933860779, propagate_backward_time: 89.1149749756, weight_update_time: 0.4979837537, other_time: 104.8016510010
epoch time: 22.5740032196s, input_fired_time: 0.2379153520, output_fired_time: 0.0000000000, propagate_forward_time: 12.9104213715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.4256668091
validation[          , genome  6699] predictions:    9685/  10000 (96.85%), best:    9744/10000 (97.44%), error:      1015.21802, best error:       862.04095 on epoch:    44, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 258.6439819336s, input_fired_time: 1.6021375656, output_fired_time: 1.4774498940, propagate_forward_time: 59.2109985352, propagate_backward_time: 89.1322937012, weight_update_time: 1.1740051508, other_time: 107.2210998535
epoch time: 20.3802242279s, input_fired_time: 0.1985522211, output_fired_time: 0.0000000000, propagate_forward_time: 6.9024634361, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.2792072296
validation[          , genome  6699] predictions:    9723/  10000 (97.23%), best:    9744/10000 (97.44%), error:       901.59003, best error:       862.04095 on epoch:    44, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 242.5607604980s, input_fired_time: 1.4563915730, output_fired_time: 1.2564601898, propagate_forward_time: 47.6788673401, propagate_backward_time: 85.6952285767, weight_update_time: 0.3219415247, other_time: 106.4738235474
epoch time: 25.3970317841s, input_fired_time: 0.1694200039, output_fired_time: 0.0000000000, propagate_forward_time: 10.5700654984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.6575460434
validation[          , genome  6699] predictions:    9703/  10000 (97.03%), best:    9744/10000 (97.44%), error:       971.73590, best error:       862.04095 on epoch:    44, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 279.2603454590s, input_fired_time: 1.5056656599, output_fired_time: 2.2955741882, propagate_forward_time: 49.7508850098, propagate_backward_time: 81.4425735474, weight_update_time: 0.2548542619, other_time: 144.2656555176
epoch time: 21.6872539520s, input_fired_time: 0.2535599470, output_fired_time: 0.0000000000, propagate_forward_time: 8.0372104645, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.3964843750
validation[          , genome  6699] predictions:    9693/  10000 (96.93%), best:    9744/10000 (97.44%), error:       999.65649, best error:       862.04095 on epoch:    44, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 285.6823120117s, input_fired_time: 1.7118593454, output_fired_time: 2.3409633636, propagate_forward_time: 54.4597167969, propagate_backward_time: 96.0008087158, weight_update_time: 0.2973816395, other_time: 131.1689605713
epoch time: 28.1498527527s, input_fired_time: 0.1596994400, output_fired_time: 0.0000000000, propagate_forward_time: 9.7312793732, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 18.2588748932
validation[          , genome  6699] predictions:    9692/  10000 (96.92%), best:    9744/10000 (97.44%), error:       962.17792, best error:       862.04095 on epoch:    44, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 257.9806518555s, input_fired_time: 1.7065097094, output_fired_time: 1.4394735098, propagate_forward_time: 55.4490661621, propagate_backward_time: 98.7227325439, weight_update_time: 0.3922768235, other_time: 100.6628723145
epoch time: 26.6652812958s, input_fired_time: 0.2055670172, output_fired_time: 0.0000000000, propagate_forward_time: 7.1994853020, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 19.2602291107
validation[          , genome  6699] predictions:    9711/  10000 (97.11%), best:    9744/10000 (97.44%), error:       908.90686, best error:       862.04095 on epoch:    44, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 240.1193389893s, input_fired_time: 2.6832535267, output_fired_time: 2.1478540897, propagate_forward_time: 52.7474632263, propagate_backward_time: 99.5865707397, weight_update_time: 0.1946794540, other_time: 82.9541854858
epoch time: 24.2727622986s, input_fired_time: 0.2120324373, output_fired_time: 0.0000000000, propagate_forward_time: 7.5732426643, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.4874877930
validation[          , genome  6699] predictions:    9718/  10000 (97.18%), best:    9744/10000 (97.44%), error:       934.04303, best error:       862.04095 on epoch:    44, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 270.7388000488s, input_fired_time: 1.5211688280, output_fired_time: 1.2103605270, propagate_forward_time: 52.8667564392, propagate_backward_time: 91.5284729004, weight_update_time: 0.3335824013, other_time: 123.6120300293
epoch time: 20.9915904999s, input_fired_time: 0.1443546265, output_fired_time: 0.0000000000, propagate_forward_time: 8.9159698486, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.9312667847
validation[          , genome  6699] predictions:    9717/  10000 (97.17%), best:    9744/10000 (97.44%), error:       900.06744, best error:       862.04095 on epoch:    44, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 282.6662292480s, input_fired_time: 1.8644552231, output_fired_time: 2.1594948769, propagate_forward_time: 52.0046615601, propagate_backward_time: 95.2738342285, weight_update_time: 0.1848041564, other_time: 131.3638000488
epoch time: 22.2220230103s, input_fired_time: 0.2250093222, output_fired_time: 0.0000000000, propagate_forward_time: 13.5201520920, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.4768610001
validation[          , genome  6699] predictions:    9692/  10000 (96.92%), best:    9744/10000 (97.44%), error:       998.76373, best error:       862.04095 on epoch:    44, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 297.5827331543s, input_fired_time: 1.6691254377, output_fired_time: 1.4144023657, propagate_forward_time: 58.8079109192, propagate_backward_time: 100.1758575439, weight_update_time: 0.2535443902, other_time: 135.5154418945
epoch time: 22.7199611664s, input_fired_time: 0.3854402304, output_fired_time: 0.0000000000, propagate_forward_time: 13.7773475647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.5571727753
validation[          , genome  6699] predictions:    9667/  10000 (96.67%), best:    9744/10000 (97.44%), error:      1067.70837, best error:       862.04095 on epoch:    44, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 248.0587463379s, input_fired_time: 1.7892100811, output_fired_time: 1.5080397129, propagate_forward_time: 54.0385742188, propagate_backward_time: 89.8494644165, weight_update_time: 0.2552488446, other_time: 100.8734512329
epoch time: 18.9632186890s, input_fired_time: 0.2563174069, output_fired_time: 0.0000000000, propagate_forward_time: 12.2423276901, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4645738602
validation[          , genome  6699] predictions:    9692/  10000 (96.92%), best:    9744/10000 (97.44%), error:       967.22131, best error:       862.04095 on epoch:    44, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 263.3703613281s, input_fired_time: 1.7478563786, output_fired_time: 1.5413895845, propagate_forward_time: 58.7377243042, propagate_backward_time: 96.0318984985, weight_update_time: 0.3373077810, other_time: 105.3114852905
epoch time: 24.1083087921s, input_fired_time: 0.2540963292, output_fired_time: 0.0000000000, propagate_forward_time: 12.4194231033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.4347887039
validation[          , genome  6699] predictions:    9715/  10000 (97.15%), best:    9744/10000 (97.44%), error:       926.07825, best error:       862.04095 on epoch:    44, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 235.8665771484s, input_fired_time: 3.2188990116, output_fired_time: 2.5377783775, propagate_forward_time: 57.7469978333, propagate_backward_time: 98.0997467041, weight_update_time: 0.2357167751, other_time: 74.2631530762
epoch time: 24.3896121979s, input_fired_time: 0.2228481174, output_fired_time: 0.0000000000, propagate_forward_time: 12.9302167892, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.2365465164
validation[          , genome  6699] predictions:    9654/  10000 (96.54%), best:    9744/10000 (97.44%), error:      1095.58386, best error:       862.04095 on epoch:    44, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 264.1743774414s, input_fired_time: 1.9476170540, output_fired_time: 1.5432478189, propagate_forward_time: 54.0244026184, propagate_backward_time: 87.7813262939, weight_update_time: 0.2250031233, other_time: 118.8777770996
epoch time: 18.3846473694s, input_fired_time: 0.3337755501, output_fired_time: 0.0000000000, propagate_forward_time: 8.3754882813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.6753826141
validation[          , genome  6699] predictions:    9722/  10000 (97.22%), best:    9744/10000 (97.44%), error:       893.03522, best error:       862.04095 on epoch:    44, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 277.1099853516s, input_fired_time: 1.7689696550, output_fired_time: 1.6306496859, propagate_forward_time: 54.4337959290, propagate_backward_time: 85.9359588623, weight_update_time: 0.2701481879, other_time: 133.3406066895
epoch time: 21.6987915039s, input_fired_time: 0.2674290240, output_fired_time: 0.0000000000, propagate_forward_time: 11.1047372818, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.3266248703
validation[          , genome  6699] predictions:    9711/  10000 (97.11%), best:    9744/10000 (97.44%), error:       967.85992, best error:       862.04095 on epoch:    44, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 242.2254638672s, input_fired_time: 1.6910014153, output_fired_time: 1.4714261293, propagate_forward_time: 48.4235572815, propagate_backward_time: 77.6820144653, weight_update_time: 0.3064904213, other_time: 112.9574813843
epoch time: 18.0248432159s, input_fired_time: 0.1825863272, output_fired_time: 0.0000000000, propagate_forward_time: 9.4622545242, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.3800020218
validation[          , genome  6699] predictions:    9716/  10000 (97.16%), best:    9744/10000 (97.44%), error:       940.08386, best error:       862.04095 on epoch:    44, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 263.4775390625s, input_fired_time: 1.7127074003, output_fired_time: 1.4068388939, propagate_forward_time: 48.9181861877, propagate_backward_time: 83.7131347656, weight_update_time: 0.3650961816, other_time: 127.7266845703
epoch time: 19.9800472260s, input_fired_time: 0.3713581860, output_fired_time: 0.0000000000, propagate_forward_time: 9.2510108948, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.3576774597
validation[          , genome  6699] predictions:    9571/  10000 (95.71%), best:    9744/10000 (97.44%), error:      1377.67932, best error:       862.04095 on epoch:    44, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 260.9592590332s, input_fired_time: 1.3753848076, output_fired_time: 1.3342257738, propagate_forward_time: 48.1089973450, propagate_backward_time: 81.6639709473, weight_update_time: 0.2874793708, other_time: 128.4766693115
epoch time: 19.5758972168s, input_fired_time: 0.2587033510, output_fired_time: 0.0000000000, propagate_forward_time: 7.0418429375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.2753505707
validation[          , genome  6699] predictions:    9726/  10000 (97.26%), best:    9744/10000 (97.44%), error:       901.44733, best error:       862.04095 on epoch:    44, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 257.8651428223s, input_fired_time: 1.6310919523, output_fired_time: 1.2785682678, propagate_forward_time: 54.3542823792, propagate_backward_time: 100.7591476440, weight_update_time: 0.4851703644, other_time: 99.8420486450
epoch time: 24.0481243134s, input_fired_time: 0.2092575133, output_fired_time: 0.0000000000, propagate_forward_time: 7.5528845787, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.2859821320
validation[          , genome  6699] predictions:    9679/  10000 (96.79%), best:    9744/10000 (97.44%), error:      1096.80615, best error:       862.04095 on epoch:    44, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 284.7169494629s, input_fired_time: 1.7703446150, output_fired_time: 1.4323443174, propagate_forward_time: 52.9022102356, propagate_backward_time: 92.5236206055, weight_update_time: 0.4047751129, other_time: 136.0884246826
epoch time: 23.1320133209s, input_fired_time: 0.2216205597, output_fired_time: 0.0000000000, propagate_forward_time: 8.6317186356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.2786741257
validation[          , genome  6699] predictions:    9716/  10000 (97.16%), best:    9744/10000 (97.44%), error:       965.79913, best error:       862.04095 on epoch:    44, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 270.7409667969s, input_fired_time: 1.7833533287, output_fired_time: 1.4548361301, propagate_forward_time: 53.5985946655, propagate_backward_time: 92.8407821655, weight_update_time: 0.2410703897, other_time: 121.0633926392
epoch time: 34.7781639099s, input_fired_time: 0.1685325205, output_fired_time: 0.0000000000, propagate_forward_time: 9.0219793320, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 25.5876502991
validation[          , genome  6699] predictions:    9694/  10000 (96.94%), best:    9744/10000 (97.44%), error:       980.67657, best error:       862.04095 on epoch:    44, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 294.8038940430s, input_fired_time: 1.7702164650, output_fired_time: 1.4226145744, propagate_forward_time: 53.4067153931, propagate_backward_time: 90.1631317139, weight_update_time: 0.2746995687, other_time: 148.0412445068
epoch time: 26.4098110199s, input_fired_time: 0.2408670038, output_fired_time: 0.0000000000, propagate_forward_time: 9.7381172180, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.4308261871
validation[          , genome  6699] predictions:    9726/  10000 (97.26%), best:    9744/10000 (97.44%), error:       889.47369, best error:       862.04095 on epoch:    44, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 407.1339111328s, input_fired_time: 1.8009703159, output_fired_time: 1.6962492466, propagate_forward_time: 55.4830741882, propagate_backward_time: 89.5087356567, weight_update_time: 0.2854095399, other_time: 258.6448974609
epoch time: 26.9025535583s, input_fired_time: 0.2205081880, output_fired_time: 0.0000000000, propagate_forward_time: 9.3705768585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 17.3114681244
validation[          , genome  6699] predictions:    9666/  10000 (96.66%), best:    9744/10000 (97.44%), error:      1086.08984, best error:       862.04095 on epoch:    44, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 376.6127624512s, input_fired_time: 1.9004164934, output_fired_time: 1.2823235989, propagate_forward_time: 55.9182929993, propagate_backward_time: 92.6113891602, weight_update_time: 0.3409640193, other_time: 224.9003295898
epoch time: 20.9319458008s, input_fired_time: 0.3062485158, output_fired_time: 0.0000000000, propagate_forward_time: 13.7614326477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.8642654419
validation[          , genome  6699] predictions:    9716/  10000 (97.16%), best:    9744/10000 (97.44%), error:       961.93805, best error:       862.04095 on epoch:    44, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 363.9588317871s, input_fired_time: 2.6130361557, output_fired_time: 1.5769525766, propagate_forward_time: 48.8029174805, propagate_backward_time: 89.2012176514, weight_update_time: 0.2412371039, other_time: 221.7646942139
epoch time: 25.7098140717s, input_fired_time: 0.2981353402, output_fired_time: 0.0000000000, propagate_forward_time: 12.5461416245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.8655366898
validation[          , genome  6699] predictions:    9696/  10000 (96.96%), best:    9744/10000 (97.44%), error:       955.96765, best error:       862.04095 on epoch:    44, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 270.5801696777s, input_fired_time: 1.6569504738, output_fired_time: 1.6478333473, propagate_forward_time: 44.9781761169, propagate_backward_time: 74.6541366577, weight_update_time: 0.2676053643, other_time: 147.6430664063
epoch time: 26.6707096100s, input_fired_time: 0.2695642114, output_fired_time: 0.0000000000, propagate_forward_time: 12.4986820221, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.9024639130
validation[          , genome  6699] predictions:    9730/  10000 (97.30%), best:    9744/10000 (97.44%), error:       895.72125, best error:       862.04095 on epoch:    44, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 182.5317535400s, input_fired_time: 2.2536213398, output_fired_time: 0.0000000000, propagate_forward_time: 51.8756370544, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 128.4024963379
best training[          , genome  6699] predictions:   49252/  50000 (98.50%), best:    9744/10000 (97.44%), error:      2543.19116, best error:       862.04095 on epoch:    44, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 27.3255062103s, input_fired_time: 0.2108188868, output_fired_time: 0.0000000000, propagate_forward_time: 13.0299568176, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.0847301483
   testing[          , genome  6699] predictions:    9764/  10000 (97.64%), best:    9744/10000 (97.44%), error:       814.47504, best error:       862.04095 on epoch:    44, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
05:49:14 (8432): called boinc_finish(0)

</stderr_txt>
]]>