Nameexact_genome_1512568488_45_2515_0
Workunit2583802
Created7 Dec 2017, 0:04:36 UTC
Sent7 Dec 2017, 0:05:37 UTC
Report deadline9 Dec 2017, 23:49:52 UTC
Received8 Dec 2017, 0:04:31 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID65413
Run time1 hours 13 min 45 sec
CPU time1 hours 13 min 42 sec
Validate stateValid
Credit747.27
Device peak FLOPS3.77 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size148.69 MB
Peak swap size150.19 MB
Peak disk usage0.90 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
, epoch:   13/100, mu: 0.7384625077, learning_rate: 0.0064167744, weight_decay: 0.0002566710

epoch time: 38.6210250854s, input_fired_time: 0.3316511214, output_fired_time: 0.2271152437, propagate_forward_time: 15.0655364990, propagate_backward_time: 21.4860744476, weight_update_time: 0.0665680915, other_time: 1.5106487274
epoch time: 3.3403751850s, input_fired_time: 0.0357301719, output_fired_time: 0.0000000000, propagate_forward_time: 3.0355441570, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2691009045
validation[          , genome  2515] predictions:    9417/  10000 (94.17%), best:    9491/10000 (94.91%), error:      1896.40967, best error:      1747.10693 on epoch:    12, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 39.2850723267s, input_fired_time: 0.3323006630, output_fired_time: 0.2292586565, propagate_forward_time: 15.3271198273, propagate_backward_time: 21.8532485962, weight_update_time: 0.0675505251, other_time: 1.5431423187
epoch time: 3.6533617973s, input_fired_time: 0.0386899449, output_fired_time: 0.0000000000, propagate_forward_time: 3.3229076862, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2917642593
validation[          , genome  2515] predictions:    9512/  10000 (95.12%), best:    9512/10000 (95.12%), error:      1682.19055, best error:      1682.19055 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 48.5434226990s, input_fired_time: 0.3822407126, output_fired_time: 0.2747965455, propagate_forward_time: 19.0899772644, propagate_backward_time: 26.9270992279, weight_update_time: 0.0824460536, other_time: 1.8693103790
epoch time: 3.6397690773s, input_fired_time: 0.0438028127, output_fired_time: 0.0000000000, propagate_forward_time: 3.3037271500, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2922391891
validation[          , genome  2515] predictions:    9483/  10000 (94.83%), best:    9512/10000 (95.12%), error:      1761.41870, best error:      1682.19055 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 44.0787124634s, input_fired_time: 0.3592951894, output_fired_time: 0.2527583241, propagate_forward_time: 17.2951488495, propagate_backward_time: 24.4377307892, weight_update_time: 0.0754362643, other_time: 1.7337799072
epoch time: 3.8508732319s, input_fired_time: 0.0404826142, output_fired_time: 0.0000000000, propagate_forward_time: 3.5041797161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3062109947
validation[          , genome  2515] predictions:    9495/  10000 (94.95%), best:    9512/10000 (95.12%), error:      1755.70398, best error:      1682.19055 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 40.9371414185s, input_fired_time: 0.3435224295, output_fired_time: 0.2540981770, propagate_forward_time: 16.0176162720, propagate_backward_time: 22.7066535950, weight_update_time: 0.0699850172, other_time: 1.6152534485
epoch time: 3.3060555458s, input_fired_time: 0.0358893387, output_fired_time: 0.0000000000, propagate_forward_time: 2.9994316101, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2707345486
validation[          , genome  2515] predictions:    9508/  10000 (95.08%), best:    9508/10000 (95.08%), error:      1678.75916, best error:      1678.75916 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 44.7621612549s, input_fired_time: 0.3644849062, output_fired_time: 0.2562048435, propagate_forward_time: 17.5736827850, propagate_backward_time: 24.8248138428, weight_update_time: 0.0763708651, other_time: 1.7429714203
epoch time: 3.7802305222s, input_fired_time: 0.0421784036, output_fired_time: 0.0000000000, propagate_forward_time: 3.4349818230, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3030703068
validation[          , genome  2515] predictions:    9507/  10000 (95.07%), best:    9507/10000 (95.07%), error:      1632.47290, best error:      1632.47290 on epoch:    19, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 39.1301536560s, input_fired_time: 0.3337818980, output_fired_time: 0.2294815630, propagate_forward_time: 15.2981662750, propagate_backward_time: 21.7404708862, weight_update_time: 0.0672007054, other_time: 1.5282535553
epoch time: 3.1818792820s, input_fired_time: 0.0350276418, output_fired_time: 0.0000000000, propagate_forward_time: 2.8867912292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2600603104
validation[          , genome  2515] predictions:    9497/  10000 (94.97%), best:    9507/10000 (95.07%), error:      1768.11877, best error:      1632.47290 on epoch:    19, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 47.2814254761s, input_fired_time: 0.3810437620, output_fired_time: 0.2683611512, propagate_forward_time: 18.6009521484, propagate_backward_time: 26.2040805817, weight_update_time: 0.0819715336, other_time: 1.8269901276
epoch time: 3.9287207127s, input_fired_time: 0.0425444357, output_fired_time: 0.0000000000, propagate_forward_time: 3.5720493793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3141269684
validation[          , genome  2515] predictions:    9472/  10000 (94.72%), best:    9507/10000 (95.07%), error:      1858.16064, best error:      1632.47290 on epoch:    19, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 41.2064781189s, input_fired_time: 0.3454559445, output_fired_time: 0.2385809720, propagate_forward_time: 16.2016410828, propagate_backward_time: 22.8251819611, weight_update_time: 0.0708096251, other_time: 1.5956172943
epoch time: 3.3417356014s, input_fired_time: 0.0365334786, output_fired_time: 0.0000000000, propagate_forward_time: 3.0373053551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2678966522
validation[          , genome  2515] predictions:    9464/  10000 (94.64%), best:    9507/10000 (95.07%), error:      1832.24829, best error:      1632.47290 on epoch:    19, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 46.2843055725s, input_fired_time: 0.3705103695, output_fired_time: 0.2636634111, propagate_forward_time: 18.1950321198, propagate_backward_time: 25.6953544617, weight_update_time: 0.0790913627, other_time: 1.7597446442
epoch time: 4.3460068703s, input_fired_time: 0.0448805541, output_fired_time: 0.0000000000, propagate_forward_time: 3.9652192593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3359072208
validation[          , genome  2515] predictions:    9507/  10000 (95.07%), best:    9507/10000 (95.07%), error:      1683.21277, best error:      1632.47290 on epoch:    19, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 36.9817504883s, input_fired_time: 0.3297977448, output_fired_time: 0.2216647565, propagate_forward_time: 14.3987894058, propagate_backward_time: 20.5204086304, weight_update_time: 0.0663419291, other_time: 1.5110931396
epoch time: 3.4452557564s, input_fired_time: 0.0393204130, output_fired_time: 0.0000000000, propagate_forward_time: 3.1250231266, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2809121609
validation[          , genome  2515] predictions:    9495/  10000 (94.95%), best:    9507/10000 (95.07%), error:      1701.77417, best error:      1632.47290 on epoch:    19, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 37.4029998779s, input_fired_time: 0.3349396586, output_fired_time: 0.2213409841, propagate_forward_time: 14.6488780975, propagate_backward_time: 20.6573352814, weight_update_time: 0.0672903806, other_time: 1.5405082703
epoch time: 2.9643721581s, input_fired_time: 0.0340070873, output_fired_time: 0.0000000000, propagate_forward_time: 2.6847543716, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2456107140
validation[          , genome  2515] predictions:    9502/  10000 (95.02%), best:    9507/10000 (95.07%), error:      1673.35864, best error:      1632.47290 on epoch:    19, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 41.3657569885s, input_fired_time: 0.3499138653, output_fired_time: 0.2401166260, propagate_forward_time: 16.2048225403, propagate_backward_time: 22.9306449890, weight_update_time: 0.0725370198, other_time: 1.6402587891
epoch time: 3.0576126575s, input_fired_time: 0.0348859578, output_fired_time: 0.0000000000, propagate_forward_time: 2.7708456516, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2518811226
validation[          , genome  2515] predictions:    9498/  10000 (94.98%), best:    9507/10000 (95.07%), error:      1668.08252, best error:      1632.47290 on epoch:    19, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 40.3324089050s, input_fired_time: 0.3483920991, output_fired_time: 0.2355104983, propagate_forward_time: 15.8281936646, propagate_backward_time: 22.2926101685, weight_update_time: 0.0717533529, other_time: 1.6277008057
epoch time: 3.2540442944s, input_fired_time: 0.0363122076, output_fired_time: 0.0000000000, propagate_forward_time: 2.9550492764, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2626829147
validation[          , genome  2515] predictions:    9525/  10000 (95.25%), best:    9525/10000 (95.25%), error:      1622.53784, best error:      1622.53784 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 38.9293403625s, input_fired_time: 0.3383172750, output_fired_time: 0.2294171304, propagate_forward_time: 15.3011960983, propagate_backward_time: 21.5270805359, weight_update_time: 0.0675331652, other_time: 1.5333290100
epoch time: 3.3003365993s, input_fired_time: 0.0361001827, output_fired_time: 0.0000000000, propagate_forward_time: 2.9984667301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2657697201
validation[          , genome  2515] predictions:    9536/  10000 (95.36%), best:    9536/10000 (95.36%), error:      1621.20435, best error:      1621.20435 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 38.2974700928s, input_fired_time: 0.3317611516, output_fired_time: 0.2258099020, propagate_forward_time: 15.0322256088, propagate_backward_time: 21.2253684998, weight_update_time: 0.0654608533, other_time: 1.4823036194
epoch time: 3.3394002914s, input_fired_time: 0.0365824513, output_fired_time: 0.0000000000, propagate_forward_time: 3.0358505249, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2669672966
validation[          , genome  2515] predictions:    9528/  10000 (95.28%), best:    9528/10000 (95.28%), error:      1610.19214, best error:      1610.19214 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 40.4084854126s, input_fired_time: 0.3425364792, output_fired_time: 0.2355340123, propagate_forward_time: 15.7942228317, propagate_backward_time: 22.4676952362, weight_update_time: 0.0697695687, other_time: 1.5684947968
epoch time: 3.6055929661s, input_fired_time: 0.0394764058, output_fired_time: 0.0000000000, propagate_forward_time: 3.2783141136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2878024578
validation[          , genome  2515] predictions:    9481/  10000 (94.81%), best:    9528/10000 (95.28%), error:      1750.22217, best error:      1610.19214 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 38.1008872986s, input_fired_time: 0.3314915299, output_fired_time: 0.2238492966, propagate_forward_time: 14.9432334900, propagate_backward_time: 21.1097888947, weight_update_time: 0.0659126565, other_time: 1.4925212860
epoch time: 3.3190889359s, input_fired_time: 0.0368182287, output_fired_time: 0.0000000000, propagate_forward_time: 3.0143084526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2679622173
validation[          , genome  2515] predictions:    9490/  10000 (94.90%), best:    9528/10000 (95.28%), error:      1702.71606, best error:      1610.19214 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 38.1628456116s, input_fired_time: 0.3326719701, output_fired_time: 0.2260015011, propagate_forward_time: 14.9679718018, propagate_backward_time: 21.1454811096, weight_update_time: 0.0656981245, other_time: 1.4907188416
epoch time: 3.3474235535s, input_fired_time: 0.0370132625, output_fired_time: 0.0000000000, propagate_forward_time: 3.0425248146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2678854465
validation[          , genome  2515] predictions:    9581/  10000 (95.81%), best:    9581/10000 (95.81%), error:      1536.12708, best error:      1536.12708 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 37.8577957153s, input_fired_time: 0.3313085139, output_fired_time: 0.2253127098, propagate_forward_time: 14.7865247726, propagate_backward_time: 21.0354766846, weight_update_time: 0.0652542636, other_time: 1.4791717529
epoch time: 3.3420922756s, input_fired_time: 0.0367175788, output_fired_time: 0.0000000000, propagate_forward_time: 3.0356299877, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2697446346
validation[          , genome  2515] predictions:    9550/  10000 (95.50%), best:    9581/10000 (95.81%), error:      1555.88281, best error:      1536.12708 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 37.6239280701s, input_fired_time: 0.3289141357, output_fired_time: 0.2220943719, propagate_forward_time: 14.7475709915, propagate_backward_time: 20.8437309265, weight_update_time: 0.0652335882, other_time: 1.4816169739
epoch time: 3.3419926167s, input_fired_time: 0.0371865593, output_fired_time: 0.0000000000, propagate_forward_time: 3.0332405567, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2715654373
validation[          , genome  2515] predictions:    9489/  10000 (94.89%), best:    9581/10000 (95.81%), error:      1719.02563, best error:      1536.12708 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 37.8962440491s, input_fired_time: 0.3294739425, output_fired_time: 0.2229535133, propagate_forward_time: 14.7933330536, propagate_backward_time: 21.0648708344, weight_update_time: 0.0653330162, other_time: 1.4856109619
epoch time: 3.2192852497s, input_fired_time: 0.0354742110, output_fired_time: 0.0000000000, propagate_forward_time: 2.9271030426, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2567079067
validation[          , genome  2515] predictions:    9486/  10000 (94.86%), best:    9581/10000 (95.81%), error:      1755.47900, best error:      1536.12708 on epoch:    32, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 43.2574729919s, input_fired_time: 0.3576298058, output_fired_time: 0.2508717477, propagate_forward_time: 17.0362987518, propagate_backward_time: 23.9573402405, weight_update_time: 0.0742798150, other_time: 1.6553287506
epoch time: 3.3273694515s, input_fired_time: 0.0368668064, output_fired_time: 0.0000000000, propagate_forward_time: 3.0240697861, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2664327621
validation[          , genome  2515] predictions:    9540/  10000 (95.40%), best:    9581/10000 (95.81%), error:      1610.53210, best error:      1536.12708 on epoch:    32, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 38.1716499329s, input_fired_time: 0.3323369324, output_fired_time: 0.2255605459, propagate_forward_time: 14.9636974335, propagate_backward_time: 21.1633625031, weight_update_time: 0.0656198487, other_time: 1.4866943359
epoch time: 3.3119547367s, input_fired_time: 0.0364475995, output_fired_time: 0.0000000000, propagate_forward_time: 3.0080854893, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2674217224
validation[          , genome  2515] predictions:    9533/  10000 (95.33%), best:    9581/10000 (95.81%), error:      1640.85388, best error:      1536.12708 on epoch:    32, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 38.1154594421s, input_fired_time: 0.3314304948, output_fired_time: 0.2255691141, propagate_forward_time: 14.9049625397, propagate_backward_time: 21.1629848480, weight_update_time: 0.0657686293, other_time: 1.4905090332
epoch time: 3.2817962170s, input_fired_time: 0.0366028510, output_fired_time: 0.0000000000, propagate_forward_time: 2.9805560112, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2646374702
validation[          , genome  2515] predictions:    9471/  10000 (94.71%), best:    9581/10000 (95.81%), error:      1803.41040, best error:      1536.12708 on epoch:    32, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 37.8486785889s, input_fired_time: 0.3292402625, output_fired_time: 0.2245915383, propagate_forward_time: 14.7180871964, propagate_backward_time: 21.1040802002, weight_update_time: 0.0650098845, other_time: 1.4726829529
epoch time: 3.2911355495s, input_fired_time: 0.0369627438, output_fired_time: 0.0000000000, propagate_forward_time: 2.9905631542, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2636096478
validation[          , genome  2515] predictions:    9495/  10000 (94.95%), best:    9581/10000 (95.81%), error:      1686.59485, best error:      1536.12708 on epoch:    32, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 37.6514167786s, input_fired_time: 0.3316330314, output_fired_time: 0.2249094993, propagate_forward_time: 14.7979106903, propagate_backward_time: 20.8311100006, weight_update_time: 0.0644826367, other_time: 1.4658508301
epoch time: 3.2861940861s, input_fired_time: 0.0367232822, output_fired_time: 0.0000000000, propagate_forward_time: 2.9827938080, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2666769028
validation[          , genome  2515] predictions:    9532/  10000 (95.32%), best:    9581/10000 (95.81%), error:      1597.91272, best error:      1536.12708 on epoch:    32, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 38.3309211731s, input_fired_time: 0.3390213549, output_fired_time: 0.2268341035, propagate_forward_time: 15.0726728439, propagate_backward_time: 21.1628398895, weight_update_time: 0.0675245374, other_time: 1.5295543671
epoch time: 2.8669083118s, input_fired_time: 0.0336994156, output_fired_time: 0.0000000000, propagate_forward_time: 2.5939705372, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2392382622
validation[          , genome  2515] predictions:    9529/  10000 (95.29%), best:    9581/10000 (95.81%), error:      1615.88770, best error:      1536.12708 on epoch:    32, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 42.4595451355s, input_fired_time: 0.3585988879, output_fired_time: 0.2448749393, propagate_forward_time: 16.6858844757, propagate_backward_time: 23.4906578064, weight_update_time: 0.0739702880, other_time: 1.6795291901
epoch time: 4.3559861183s, input_fired_time: 0.0472775139, output_fired_time: 0.0000000000, propagate_forward_time: 3.9633951187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3453135490
validation[          , genome  2515] predictions:    9491/  10000 (94.91%), best:    9581/10000 (95.81%), error:      1722.82849, best error:      1536.12708 on epoch:    32, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 41.1486892700s, input_fired_time: 0.3548941016, output_fired_time: 0.2388917506, propagate_forward_time: 16.0464820862, propagate_backward_time: 22.8578166962, weight_update_time: 0.0731439814, other_time: 1.6506061554
epoch time: 4.2623543739s, input_fired_time: 0.0456854105, output_fired_time: 0.0000000000, propagate_forward_time: 3.8837454319, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3329236507
validation[          , genome  2515] predictions:    9528/  10000 (95.28%), best:    9581/10000 (95.81%), error:      1641.76001, best error:      1536.12708 on epoch:    32, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 43.3763771057s, input_fired_time: 0.3616898656, output_fired_time: 0.2505142689, propagate_forward_time: 17.0162830353, propagate_backward_time: 24.0601749420, weight_update_time: 0.0746325478, other_time: 1.6877136230
epoch time: 3.3514876366s, input_fired_time: 0.0377766825, output_fired_time: 0.0000000000, propagate_forward_time: 3.0400252342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2736856937
validation[          , genome  2515] predictions:    9522/  10000 (95.22%), best:    9581/10000 (95.81%), error:      1607.41663, best error:      1536.12708 on epoch:    32, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 44.3065147400s, input_fired_time: 0.3696027100, output_fired_time: 0.2539466918, propagate_forward_time: 17.4079208374, propagate_backward_time: 24.5532588959, weight_update_time: 0.0758039653, other_time: 1.7217845917
epoch time: 4.1679458618s, input_fired_time: 0.0447044931, output_fired_time: 0.0000000000, propagate_forward_time: 3.7913215160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3319199085
validation[          , genome  2515] predictions:    9548/  10000 (95.48%), best:    9581/10000 (95.81%), error:      1569.96484, best error:      1536.12708 on epoch:    32, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 45.2718276978s, input_fired_time: 0.3701534271, output_fired_time: 0.2578428686, propagate_forward_time: 17.7712631226, propagate_backward_time: 25.1093940735, weight_update_time: 0.0775026679, other_time: 1.7631721497
epoch time: 4.0648221970s, input_fired_time: 0.0439139158, output_fired_time: 0.0000000000, propagate_forward_time: 3.6988835335, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3220248222
validation[          , genome  2515] predictions:    9532/  10000 (95.32%), best:    9581/10000 (95.81%), error:      1626.85107, best error:      1536.12708 on epoch:    32, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 39.0598793030s, input_fired_time: 0.3381320834, output_fired_time: 0.2283893228, propagate_forward_time: 15.2847042084, propagate_backward_time: 21.6396884918, weight_update_time: 0.0669415668, other_time: 1.5689659119
epoch time: 3.3121817112s, input_fired_time: 0.0370215513, output_fired_time: 0.0000000000, propagate_forward_time: 3.0043532848, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2708067894
validation[          , genome  2515] predictions:    9540/  10000 (95.40%), best:    9581/10000 (95.81%), error:      1549.87305, best error:      1536.12708 on epoch:    32, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 40.5713500977s, input_fired_time: 0.3438918293, output_fired_time: 0.2460696697, propagate_forward_time: 15.8668861389, propagate_backward_time: 22.5241851807, weight_update_time: 0.0693060681, other_time: 1.5903167725
epoch time: 3.9926254749s, input_fired_time: 0.0428349674, output_fired_time: 0.0000000000, propagate_forward_time: 3.6311190128, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3186714649
validation[          , genome  2515] predictions:    9534/  10000 (95.34%), best:    9581/10000 (95.81%), error:      1552.95886, best error:      1536.12708 on epoch:    32, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 43.4273567200s, input_fired_time: 0.3623458743, output_fired_time: 0.2502113283, propagate_forward_time: 17.0469341278, propagate_backward_time: 24.0769214630, weight_update_time: 0.0744212717, other_time: 1.6909446716
epoch time: 3.2868504524s, input_fired_time: 0.0373557061, output_fired_time: 0.0000000000, propagate_forward_time: 2.9775440693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2719507217
validation[          , genome  2515] predictions:    9578/  10000 (95.78%), best:    9578/10000 (95.78%), error:      1493.67200, best error:      1493.67200 on epoch:    49, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 40.5899314880s, input_fired_time: 0.3469362557, output_fired_time: 0.2364127338, propagate_forward_time: 15.9040241241, propagate_backward_time: 22.5445594788, weight_update_time: 0.0677673891, other_time: 1.5580005646
epoch time: 3.1077277660s, input_fired_time: 0.0354768485, output_fired_time: 0.0000000000, propagate_forward_time: 2.8174088001, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2548420429
validation[          , genome  2515] predictions:    9424/  10000 (94.24%), best:    9578/10000 (95.78%), error:      1955.44617, best error:      1493.67200 on epoch:    49, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 43.9136238098s, input_fired_time: 0.3711913824, output_fired_time: 0.2536419034, propagate_forward_time: 17.2725028992, propagate_backward_time: 24.2946090698, weight_update_time: 0.0749204829, other_time: 1.7216758728
epoch time: 3.0940237045s, input_fired_time: 0.0366474055, output_fired_time: 0.0000000000, propagate_forward_time: 2.8005964756, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2567799091
validation[          , genome  2515] predictions:    9582/  10000 (95.82%), best:    9578/10000 (95.78%), error:      1515.33264, best error:      1493.67200 on epoch:    49, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 39.8339500427s, input_fired_time: 0.3476461470, output_fired_time: 0.2352854311, propagate_forward_time: 15.5876588821, propagate_backward_time: 22.0963954926, weight_update_time: 0.0680241808, other_time: 1.5669651031
epoch time: 3.6597712040s, input_fired_time: 0.0407188646, output_fired_time: 0.0000000000, propagate_forward_time: 3.3257944584, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2932579517
validation[          , genome  2515] predictions:    9514/  10000 (95.14%), best:    9578/10000 (95.78%), error:      1715.97620, best error:      1493.67200 on epoch:    49, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 40.1944580078s, input_fired_time: 0.3470512927, output_fired_time: 0.2354750037, propagate_forward_time: 15.7238817215, propagate_backward_time: 22.3420562744, weight_update_time: 0.0668680444, other_time: 1.5459976196
epoch time: 3.3712770939s, input_fired_time: 0.0372677185, output_fired_time: 0.0000000000, propagate_forward_time: 3.0655238628, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2684855461
validation[          , genome  2515] predictions:    9556/  10000 (95.56%), best:    9578/10000 (95.78%), error:      1567.31836, best error:      1493.67200 on epoch:    49, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 38.6452980042s, input_fired_time: 0.3366220593, output_fired_time: 0.2290336192, propagate_forward_time: 15.1385421753, propagate_backward_time: 21.4570407867, weight_update_time: 0.0650690943, other_time: 1.4840602875
epoch time: 3.3957989216s, input_fired_time: 0.0377724767, output_fired_time: 0.0000000000, propagate_forward_time: 3.0886247158, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2694017887
validation[          , genome  2515] predictions:    9565/  10000 (95.65%), best:    9578/10000 (95.78%), error:      1534.71252, best error:      1493.67200 on epoch:    49, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 38.8305206299s, input_fired_time: 0.3379156590, output_fired_time: 0.2270437479, propagate_forward_time: 15.2191181183, propagate_backward_time: 21.5634002686, weight_update_time: 0.0650648624, other_time: 1.4830417633
epoch time: 3.2300610542s, input_fired_time: 0.0366813056, output_fired_time: 0.0000000000, propagate_forward_time: 2.9326515198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2607281208
validation[          , genome  2515] predictions:    9567/  10000 (95.67%), best:    9567/10000 (95.67%), error:      1487.07239, best error:      1487.07239 on epoch:    55, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 44.6729125977s, input_fired_time: 0.3697780669, output_fired_time: 0.2566776872, propagate_forward_time: 17.5513000488, propagate_backward_time: 24.8103694916, weight_update_time: 0.0742716864, other_time: 1.6847858429
epoch time: 3.9738407135s, input_fired_time: 0.0424407311, output_fired_time: 0.0000000000, propagate_forward_time: 3.6192951202, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3121049404
validation[          , genome  2515] predictions:    9528/  10000 (95.28%), best:    9567/10000 (95.67%), error:      1636.58411, best error:      1487.07239 on epoch:    55, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 46.3327026367s, input_fired_time: 0.3814890981, output_fired_time: 0.2639519572, propagate_forward_time: 18.2174739838, propagate_backward_time: 25.6771087646, weight_update_time: 0.0782389939, other_time: 1.7926807404
epoch time: 3.0387349129s, input_fired_time: 0.0368629657, output_fired_time: 0.0000000000, propagate_forward_time: 2.7494006157, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2524714470
validation[          , genome  2515] predictions:    9541/  10000 (95.41%), best:    9567/10000 (95.67%), error:      1623.29883, best error:      1487.07239 on epoch:    55, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 35.2837562561s, input_fired_time: 0.3280027211, output_fired_time: 0.2126697302, propagate_forward_time: 13.6941642761, propagate_backward_time: 19.6201114655, weight_update_time: 0.0619126670, other_time: 1.4288082123
epoch time: 3.0426051617s, input_fired_time: 0.0355615318, output_fired_time: 0.0000000000, propagate_forward_time: 2.7580556870, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2489879131
validation[          , genome  2515] predictions:    9570/  10000 (95.70%), best:    9570/10000 (95.70%), error:      1483.39197, best error:      1483.39197 on epoch:    58, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 43.6570701599s, input_fired_time: 0.3711323440, output_fired_time: 0.2513411343, propagate_forward_time: 17.2071056366, propagate_backward_time: 24.1073741913, weight_update_time: 0.0749767199, other_time: 1.7201156616
epoch time: 3.4842233658s, input_fired_time: 0.0417044684, output_fired_time: 0.0000000000, propagate_forward_time: 3.1538031101, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2887158394
validation[          , genome  2515] predictions:    9522/  10000 (95.22%), best:    9570/10000 (95.70%), error:      1630.36108, best error:      1483.39197 on epoch:    58, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 35.5439605713s, input_fired_time: 0.3293120563, output_fired_time: 0.2141909897, propagate_forward_time: 13.8985338211, propagate_backward_time: 19.6539897919, weight_update_time: 0.0623337403, other_time: 1.4479351044
epoch time: 2.9960081577s, input_fired_time: 0.0354173481, output_fired_time: 0.0000000000, propagate_forward_time: 2.7155015469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2450892925
validation[          , genome  2515] predictions:    9531/  10000 (95.31%), best:    9570/10000 (95.70%), error:      1651.81470, best error:      1483.39197 on epoch:    58, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 39.0952796936s, input_fired_time: 0.3402683437, output_fired_time: 0.2300225645, propagate_forward_time: 15.3340387344, propagate_backward_time: 21.6918048859, weight_update_time: 0.0658323839, other_time: 1.4991474152
epoch time: 3.1882753372s, input_fired_time: 0.0365598872, output_fired_time: 0.0000000000, propagate_forward_time: 2.8946695328, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2570459843
validation[          , genome  2515] predictions:    9508/  10000 (95.08%), best:    9570/10000 (95.70%), error:      1753.39038, best error:      1483.39197 on epoch:    58, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 44.0209693909s, input_fired_time: 0.3685404658, output_fired_time: 0.2528818250, propagate_forward_time: 17.2958984375, propagate_backward_time: 24.4184226990, weight_update_time: 0.0742276832, other_time: 1.6852264404
epoch time: 4.3152723312s, input_fired_time: 0.0460918956, output_fired_time: 0.0000000000, propagate_forward_time: 3.9336483479, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3355319500
validation[          , genome  2515] predictions:    9510/  10000 (95.10%), best:    9570/10000 (95.70%), error:      1610.41724, best error:      1483.39197 on epoch:    58, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 45.8519668579s, input_fired_time: 0.3794959784, output_fired_time: 0.2624878585, propagate_forward_time: 18.0288009644, propagate_backward_time: 25.4404983521, weight_update_time: 0.0768223032, other_time: 1.7406806946
epoch time: 3.6875479221s, input_fired_time: 0.0433006734, output_fired_time: 0.0000000000, propagate_forward_time: 3.3443820477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2998652458
validation[          , genome  2515] predictions:    9498/  10000 (94.98%), best:    9570/10000 (95.70%), error:      1711.05762, best error:      1483.39197 on epoch:    58, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 39.7224540710s, input_fired_time: 0.3487038314, output_fired_time: 0.2337451577, propagate_forward_time: 15.6480617523, propagate_backward_time: 21.9444255829, weight_update_time: 0.0675675273, other_time: 1.5475158691
epoch time: 3.2014751434s, input_fired_time: 0.0367608704, output_fired_time: 0.0000000000, propagate_forward_time: 2.9070055485, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2577087879
validation[          , genome  2515] predictions:    9546/  10000 (95.46%), best:    9570/10000 (95.70%), error:      1589.75464, best error:      1483.39197 on epoch:    58, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 38.0580444336s, input_fired_time: 0.3363825977, output_fired_time: 0.2248776704, propagate_forward_time: 14.9423065186, propagate_backward_time: 21.0999069214, weight_update_time: 0.0635949597, other_time: 1.4545707703
epoch time: 3.2847328186s, input_fired_time: 0.0371499956, output_fired_time: 0.0000000000, propagate_forward_time: 2.9844307899, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2631521225
validation[          , genome  2515] predictions:    9547/  10000 (95.47%), best:    9570/10000 (95.70%), error:      1526.72778, best error:      1483.39197 on epoch:    58, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 38.3157539368s, input_fired_time: 0.3367093205, output_fired_time: 0.2227150202, propagate_forward_time: 15.0610256195, propagate_backward_time: 21.2202243805, weight_update_time: 0.0650751889, other_time: 1.4750823975
epoch time: 3.1522557735s, input_fired_time: 0.0364003889, output_fired_time: 0.0000000000, propagate_forward_time: 2.8616671562, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2541882992
validation[          , genome  2515] predictions:    9566/  10000 (95.66%), best:    9570/10000 (95.70%), error:      1510.64648, best error:      1483.39197 on epoch:    58, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 43.5628852844s, input_fired_time: 0.3653549254, output_fired_time: 0.2500904799, propagate_forward_time: 17.1310806274, propagate_backward_time: 24.1759243011, weight_update_time: 0.0730463788, other_time: 1.6404323578
epoch time: 4.3451571465s, input_fired_time: 0.0468856357, output_fired_time: 0.0000000000, propagate_forward_time: 3.9607779980, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3374936581
validation[          , genome  2515] predictions:    9575/  10000 (95.75%), best:    9570/10000 (95.70%), error:      1489.01147, best error:      1483.39197 on epoch:    58, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 47.3979949951s, input_fired_time: 0.3883775771, output_fired_time: 0.2688334584, propagate_forward_time: 18.6318397522, propagate_backward_time: 26.3018112183, weight_update_time: 0.0797371715, other_time: 1.8071327209
epoch time: 4.3523888588s, input_fired_time: 0.0479794443, output_fired_time: 0.0000000000, propagate_forward_time: 3.9620845318, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3423249722
validation[          , genome  2515] predictions:    9546/  10000 (95.46%), best:    9570/10000 (95.70%), error:      1545.33191, best error:      1483.39197 on epoch:    58, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 40.4947433472s, input_fired_time: 0.3533562422, output_fired_time: 0.2372822165, propagate_forward_time: 15.7980661392, propagate_backward_time: 22.5297870636, weight_update_time: 0.0693080872, other_time: 1.5762538910
epoch time: 3.6360595226s, input_fired_time: 0.0417013429, output_fired_time: 0.0000000000, propagate_forward_time: 3.3025681973, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2917900085
validation[          , genome  2515] predictions:    9543/  10000 (95.43%), best:    9570/10000 (95.70%), error:      1559.20459, best error:      1483.39197 on epoch:    58, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 43.5580596924s, input_fired_time: 0.3657783568, output_fired_time: 0.2498146892, propagate_forward_time: 17.1261787415, propagate_backward_time: 24.1489582062, weight_update_time: 0.0728328079, other_time: 1.6673297882
epoch time: 3.5408082008s, input_fired_time: 0.0393792875, output_fired_time: 0.0000000000, propagate_forward_time: 3.2193989754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2820298672
validation[          , genome  2515] predictions:    9518/  10000 (95.18%), best:    9570/10000 (95.70%), error:      1610.53101, best error:      1483.39197 on epoch:    58, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 44.0933532715s, input_fired_time: 0.3676798344, output_fired_time: 0.2527778745, propagate_forward_time: 17.2937107086, propagate_backward_time: 24.4917488098, weight_update_time: 0.0734529495, other_time: 1.6874370575
epoch time: 3.3844382763s, input_fired_time: 0.0381118618, output_fired_time: 0.0000000000, propagate_forward_time: 3.0727584362, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2735679150
validation[          , genome  2515] predictions:    9526/  10000 (95.26%), best:    9570/10000 (95.70%), error:      1583.30896, best error:      1483.39197 on epoch:    58, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 44.0565109253s, input_fired_time: 0.3669448495, output_fired_time: 0.2515734732, propagate_forward_time: 17.3412055969, propagate_backward_time: 24.4169597626, weight_update_time: 0.0733988732, other_time: 1.6798305511
epoch time: 3.2970895767s, input_fired_time: 0.0375661403, output_fired_time: 0.0000000000, propagate_forward_time: 2.9883260727, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2711973190
validation[          , genome  2515] predictions:    9567/  10000 (95.67%), best:    9567/10000 (95.67%), error:      1476.50671, best error:      1476.50671 on epoch:    72, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 43.1007652283s, input_fired_time: 0.3635990024, output_fired_time: 0.2465955913, propagate_forward_time: 16.8923263550, propagate_backward_time: 23.9441223145, weight_update_time: 0.0716640651, other_time: 1.6541213989
epoch time: 4.0329456329s, input_fired_time: 0.0440460108, output_fired_time: 0.0000000000, propagate_forward_time: 3.6684763432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3204233646
validation[          , genome  2515] predictions:    9579/  10000 (95.79%), best:    9579/10000 (95.79%), error:      1471.20349, best error:      1471.20349 on epoch:    73, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 45.8803558350s, input_fired_time: 0.3819917738, output_fired_time: 0.2610170841, propagate_forward_time: 18.0469570160, propagate_backward_time: 25.4570941925, weight_update_time: 0.0759578794, other_time: 1.7332954407
epoch time: 3.3797574043s, input_fired_time: 0.0381379128, output_fired_time: 0.0000000000, propagate_forward_time: 3.0689167976, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2727026939
validation[          , genome  2515] predictions:    9552/  10000 (95.52%), best:    9579/10000 (95.79%), error:      1525.68555, best error:      1471.20349 on epoch:    73, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 39.3550872803s, input_fired_time: 0.3432872891, output_fired_time: 0.2292242646, propagate_forward_time: 15.3747520447, propagate_backward_time: 21.8854770660, weight_update_time: 0.0660327077, other_time: 1.5223445892
epoch time: 3.3264615536s, input_fired_time: 0.0381464884, output_fired_time: 0.0000000000, propagate_forward_time: 3.0227098465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2656052113
validation[          , genome  2515] predictions:    9518/  10000 (95.18%), best:    9579/10000 (95.79%), error:      1571.73499, best error:      1471.20349 on epoch:    73, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 36.6161079407s, input_fired_time: 0.3343490660, output_fired_time: 0.2205991745, propagate_forward_time: 14.2450456619, propagate_backward_time: 20.3431358337, weight_update_time: 0.0630445480, other_time: 1.4729766846
epoch time: 2.9959387779s, input_fired_time: 0.0356805325, output_fired_time: 0.0000000000, propagate_forward_time: 2.7097582817, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2504999638
validation[          , genome  2515] predictions:    9562/  10000 (95.62%), best:    9579/10000 (95.79%), error:      1480.45715, best error:      1471.20349 on epoch:    73, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 35.0772781372s, input_fired_time: 0.3289229274, output_fired_time: 0.2092196643, propagate_forward_time: 13.6971349716, propagate_backward_time: 19.4113788605, weight_update_time: 0.0620751046, other_time: 1.4306201935
epoch time: 3.0254242420s, input_fired_time: 0.0368540548, output_fired_time: 0.0000000000, propagate_forward_time: 2.7391307354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2494394779
validation[          , genome  2515] predictions:    9567/  10000 (95.67%), best:    9579/10000 (95.79%), error:      1512.24304, best error:      1471.20349 on epoch:    73, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 34.6109962463s, input_fired_time: 0.3331716657, output_fired_time: 0.2079787999, propagate_forward_time: 13.4747247696, propagate_backward_time: 19.1787967682, weight_update_time: 0.0609075762, other_time: 1.4163265228
epoch time: 2.9175114632s, input_fired_time: 0.0357362404, output_fired_time: 0.0000000000, propagate_forward_time: 2.6345028877, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2472722530
validation[          , genome  2515] predictions:    9563/  10000 (95.63%), best:    9579/10000 (95.79%), error:      1520.47192, best error:      1471.20349 on epoch:    73, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 35.1096229553s, input_fired_time: 0.3293386996, output_fired_time: 0.2105681598, propagate_forward_time: 13.6606149673, propagate_backward_time: 19.4691238403, weight_update_time: 0.0611803159, other_time: 1.4399795532
epoch time: 3.1685552597s, input_fired_time: 0.0376406945, output_fired_time: 0.0000000000, propagate_forward_time: 2.8707544804, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2601599693
validation[          , genome  2515] predictions:    9555/  10000 (95.55%), best:    9579/10000 (95.79%), error:      1537.28113, best error:      1471.20349 on epoch:    73, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 34.8910140991s, input_fired_time: 0.3297707736, output_fired_time: 0.2100289762, propagate_forward_time: 13.5476284027, propagate_backward_time: 19.3660984039, weight_update_time: 0.0617414303, other_time: 1.4374885559
epoch time: 2.8774251938s, input_fired_time: 0.0355051979, output_fired_time: 0.0000000000, propagate_forward_time: 2.6031651497, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2387547493
validation[          , genome  2515] predictions:    9541/  10000 (95.41%), best:    9579/10000 (95.79%), error:      1558.56580, best error:      1471.20349 on epoch:    73, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 36.2489891052s, input_fired_time: 0.3382843733, output_fired_time: 0.2153848857, propagate_forward_time: 14.1385278702, propagate_backward_time: 20.0457077026, weight_update_time: 0.0643085390, other_time: 1.5110855103
epoch time: 2.9788367748s, input_fired_time: 0.0386450104, output_fired_time: 0.0000000000, propagate_forward_time: 2.6846845150, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2555072308
validation[          , genome  2515] predictions:    9545/  10000 (95.45%), best:    9579/10000 (95.79%), error:      1525.98975, best error:      1471.20349 on epoch:    73, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 40.8844146729s, input_fired_time: 0.3627351224, output_fired_time: 0.2394491732, propagate_forward_time: 16.0216732025, propagate_backward_time: 22.5900802612, weight_update_time: 0.0707558915, other_time: 1.6704769135
epoch time: 3.0138120651s, input_fired_time: 0.0372737534, output_fired_time: 0.0000000000, propagate_forward_time: 2.7238564491, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2526819706
validation[          , genome  2515] predictions:    9562/  10000 (95.62%), best:    9579/10000 (95.79%), error:      1498.88989, best error:      1471.20349 on epoch:    73, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 35.5966682434s, input_fired_time: 0.3383367062, output_fired_time: 0.2137428224, propagate_forward_time: 13.9480848312, propagate_backward_time: 19.5840396881, weight_update_time: 0.0628071427, other_time: 1.5124645233
epoch time: 2.9820005894s, input_fired_time: 0.0370946303, output_fired_time: 0.0000000000, propagate_forward_time: 2.6968367100, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2480692863
validation[          , genome  2515] predictions:    9571/  10000 (95.71%), best:    9579/10000 (95.79%), error:      1494.38538, best error:      1471.20349 on epoch:    73, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 35.5222206116s, input_fired_time: 0.3347523808, output_fired_time: 0.2120104730, propagate_forward_time: 13.7909574509, propagate_backward_time: 19.7054557800, weight_update_time: 0.0626886263, other_time: 1.4790458679
epoch time: 3.1446599960s, input_fired_time: 0.0393310227, output_fired_time: 0.0000000000, propagate_forward_time: 2.8392119408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2661170959
validation[          , genome  2515] predictions:    9519/  10000 (95.19%), best:    9579/10000 (95.79%), error:      1698.84802, best error:      1471.20349 on epoch:    73, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 40.6664009094s, input_fired_time: 0.3593517244, output_fired_time: 0.2348216325, propagate_forward_time: 15.8858194351, propagate_backward_time: 22.5721206665, weight_update_time: 0.0704901740, other_time: 1.6142883301
epoch time: 4.3480191231s, input_fired_time: 0.0483853742, output_fired_time: 0.0000000000, propagate_forward_time: 3.9566326141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3430013657
validation[          , genome  2515] predictions:    9551/  10000 (95.51%), best:    9579/10000 (95.79%), error:      1545.30188, best error:      1471.20349 on epoch:    73, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 39.3870315552s, input_fired_time: 0.3539069295, output_fired_time: 0.2323829085, propagate_forward_time: 15.4296569824, propagate_backward_time: 21.8003482819, weight_update_time: 0.0686995909, other_time: 1.5707340240
epoch time: 3.1174633503s, input_fired_time: 0.0392791927, output_fired_time: 0.0000000000, propagate_forward_time: 2.8181633949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2600207329
validation[          , genome  2515] predictions:    9554/  10000 (95.54%), best:    9579/10000 (95.79%), error:      1515.26685, best error:      1471.20349 on epoch:    73, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 35.6770896912s, input_fired_time: 0.3331443369, output_fired_time: 0.2153476775, propagate_forward_time: 13.8327465057, propagate_backward_time: 19.8531799316, weight_update_time: 0.0621693395, other_time: 1.4426708221
epoch time: 3.0913970470s, input_fired_time: 0.0373003185, output_fired_time: 0.0000000000, propagate_forward_time: 2.8032119274, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2508847713
validation[          , genome  2515] predictions:    9519/  10000 (95.19%), best:    9579/10000 (95.79%), error:      1597.59180, best error:      1471.20349 on epoch:    73, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 35.3988304138s, input_fired_time: 0.3334169090, output_fired_time: 0.2127568722, propagate_forward_time: 13.8045902252, propagate_backward_time: 19.6035194397, weight_update_time: 0.0620445758, other_time: 1.4445476532
epoch time: 3.0311129093s, input_fired_time: 0.0365341082, output_fired_time: 0.0000000000, propagate_forward_time: 2.7459127903, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2486660480
validation[          , genome  2515] predictions:    9535/  10000 (95.35%), best:    9579/10000 (95.79%), error:      1580.28857, best error:      1471.20349 on epoch:    73, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 37.2266616821s, input_fired_time: 0.3429791331, output_fired_time: 0.2207134366, propagate_forward_time: 14.4969596863, propagate_backward_time: 20.6710376740, weight_update_time: 0.0650500283, other_time: 1.4949703217
epoch time: 3.0446128845s, input_fired_time: 0.0371375121, output_fired_time: 0.0000000000, propagate_forward_time: 2.7566785812, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2507967949
validation[          , genome  2515] predictions:    9531/  10000 (95.31%), best:    9579/10000 (95.79%), error:      1603.74841, best error:      1471.20349 on epoch:    73, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 35.4399070740s, input_fired_time: 0.3331492841, output_fired_time: 0.2120670080, propagate_forward_time: 13.8201875687, propagate_backward_time: 19.6200523376, weight_update_time: 0.0624971390, other_time: 1.4544525146
epoch time: 2.9061677456s, input_fired_time: 0.0358408168, output_fired_time: 0.0000000000, propagate_forward_time: 2.6300303936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2402966022
validation[          , genome  2515] predictions:    9565/  10000 (95.65%), best:    9579/10000 (95.79%), error:      1483.18652, best error:      1471.20349 on epoch:    73, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 35.3926200867s, input_fired_time: 0.3313876390, output_fired_time: 0.2122596502, propagate_forward_time: 13.6807947159, propagate_backward_time: 19.7282543182, weight_update_time: 0.0625271127, other_time: 1.4399242401
epoch time: 3.0311367512s, input_fired_time: 0.0368583240, output_fired_time: 0.0000000000, propagate_forward_time: 2.7455019951, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2487764359
validation[          , genome  2515] predictions:    9560/  10000 (95.60%), best:    9579/10000 (95.79%), error:      1490.87109, best error:      1471.20349 on epoch:    73, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 36.9770660400s, input_fired_time: 0.3414807618, output_fired_time: 0.2185346782, propagate_forward_time: 14.3971891403, propagate_backward_time: 20.5305938721, weight_update_time: 0.0646759570, other_time: 1.4892654419
epoch time: 3.0878021717s, input_fired_time: 0.0373142324, output_fired_time: 0.0000000000, propagate_forward_time: 2.7951827049, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2553052902
validation[          , genome  2515] predictions:    9540/  10000 (95.40%), best:    9579/10000 (95.79%), error:      1579.81494, best error:      1471.20349 on epoch:    73, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 39.4047813416s, input_fired_time: 0.3554781675, output_fired_time: 0.2305951715, propagate_forward_time: 15.3973293304, propagate_backward_time: 21.8441276550, weight_update_time: 0.0682989806, other_time: 1.5772533417
epoch time: 2.9903683662s, input_fired_time: 0.0365694836, output_fired_time: 0.0000000000, propagate_forward_time: 2.7087814808, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2450172901
validation[          , genome  2515] predictions:    9545/  10000 (95.45%), best:    9579/10000 (95.79%), error:      1548.70068, best error:      1471.20349 on epoch:    73, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 35.3469009399s, input_fired_time: 0.3319238722, output_fired_time: 0.2101004869, propagate_forward_time: 13.6777410507, propagate_backward_time: 19.6773796082, weight_update_time: 0.0628299117, other_time: 1.4497528076
epoch time: 3.2831830978s, input_fired_time: 0.0390542559, output_fired_time: 0.0000000000, propagate_forward_time: 2.9773101807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2668187618
validation[          , genome  2515] predictions:    9562/  10000 (95.62%), best:    9579/10000 (95.79%), error:      1488.96985, best error:      1471.20349 on epoch:    73, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 48.0299682617s, input_fired_time: 0.4022448659, output_fired_time: 0.2721415758, propagate_forward_time: 18.9003067017, propagate_backward_time: 26.5917549133, weight_update_time: 0.0815217420, other_time: 1.8635215759
epoch time: 3.9518735409s, input_fired_time: 0.0458315760, output_fired_time: 0.0000000000, propagate_forward_time: 3.5904603004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3155815601
validation[          , genome  2515] predictions:    9559/  10000 (95.59%), best:    9579/10000 (95.79%), error:      1497.60303, best error:      1471.20349 on epoch:    73, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 40.1637992859s, input_fired_time: 0.3622193336, output_fired_time: 0.2353730649, propagate_forward_time: 15.7786827087, propagate_backward_time: 22.1925601959, weight_update_time: 0.0691011995, other_time: 1.5949611664
epoch time: 3.0099737644s, input_fired_time: 0.0369480997, output_fired_time: 0.0000000000, propagate_forward_time: 2.7244927883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2485327721
validation[          , genome  2515] predictions:    9536/  10000 (95.36%), best:    9579/10000 (95.79%), error:      1624.99500, best error:      1471.20349 on epoch:    73, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 36.7815437317s, input_fired_time: 0.3443730474, output_fired_time: 0.2187952846, propagate_forward_time: 14.3492555618, propagate_backward_time: 20.3748817444, weight_update_time: 0.0639683604, other_time: 1.4942398071
epoch time: 3.1415400505s, input_fired_time: 0.0400127172, output_fired_time: 0.0000000000, propagate_forward_time: 2.8372814655, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2642457485
validation[          , genome  2515] predictions:    9569/  10000 (95.69%), best:    9579/10000 (95.79%), error:      1493.62085, best error:      1471.20349 on epoch:    73, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 35.8926391602s, input_fired_time: 0.3392700553, output_fired_time: 0.2134637684, propagate_forward_time: 13.9383935928, propagate_backward_time: 19.9376468658, weight_update_time: 0.0632282123, other_time: 1.4638652802
epoch time: 3.0085396767s, input_fired_time: 0.0369020551, output_fired_time: 0.0000000000, propagate_forward_time: 2.7258148193, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2458229065
validation[          , genome  2515] predictions:    9559/  10000 (95.59%), best:    9579/10000 (95.79%), error:      1527.99524, best error:      1471.20349 on epoch:    73, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 35.6470260620s, input_fired_time: 0.3365839422, output_fired_time: 0.2135178000, propagate_forward_time: 13.9301166534, propagate_backward_time: 19.7061042786, weight_update_time: 0.0626049042, other_time: 1.4607067108
epoch time: 2.9662942886s, input_fired_time: 0.0364519097, output_fired_time: 0.0000000000, propagate_forward_time: 2.6846115589, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2452309132
validation[          , genome  2515] predictions:    9557/  10000 (95.57%), best:    9579/10000 (95.79%), error:      1520.96082, best error:      1471.20349 on epoch:    73, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 35.7424201965s, input_fired_time: 0.3377542198, output_fired_time: 0.2136493623, propagate_forward_time: 13.9361295700, propagate_backward_time: 19.8087711334, weight_update_time: 0.0626844764, other_time: 1.4461154938
epoch time: 3.1012749672s, input_fired_time: 0.0387896821, output_fired_time: 0.0000000000, propagate_forward_time: 2.8084607124, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2540245056
validation[          , genome  2515] predictions:    9570/  10000 (95.70%), best:    9579/10000 (95.79%), error:      1540.97009, best error:      1471.20349 on epoch:    73, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 15.2482109070s, input_fired_time: 0.1876760721, output_fired_time: 0.0000000000, propagate_forward_time: 13.7400484085, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3204860687
best training[          , genome  2515] predictions:   48611/  50000 (97.22%), best:    9579/10000 (95.79%), error:      5033.12451, best error:      1471.20349 on epoch:    73, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 3.4187655449s, input_fired_time: 0.0379280560, output_fired_time: 0.0000000000, propagate_forward_time: 3.0912754536, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2895619869
   testing[          , genome  2515] predictions:    9635/  10000 (96.35%), best:    9579/10000 (95.79%), error:      1264.88147, best error:      1471.20349 on epoch:    73, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
00:04:21 (40550): called boinc_finish(0)

</stderr_txt>
]]>