Nameexact_genome_1512568488_45_2504_0
Workunit2583791
Created7 Dec 2017, 0:04:36 UTC
Sent7 Dec 2017, 0:05:37 UTC
Report deadline9 Dec 2017, 14:34:10 UTC
Received7 Dec 2017, 23:48:51 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID65413
Run time1 hours 11 min 52 sec
CPU time1 hours 11 min 50 sec
Validate stateValid
Credit650.79
Device peak FLOPS3.77 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size148.55 MB
Peak swap size149.97 MB
Peak disk usage0.88 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
, epoch:   13/100, mu: 0.7384625077, learning_rate: 0.0064167744, weight_decay: 0.0002566710

epoch time: 40.5082550049s, input_fired_time: 0.2706754506, output_fired_time: 0.1875227392, propagate_forward_time: 16.7515106201, propagate_backward_time: 21.7177963257, weight_update_time: 0.0705486163, other_time: 1.5807495117
epoch time: 3.9784710407s, input_fired_time: 0.0334802158, output_fired_time: 0.0000000000, propagate_forward_time: 3.6285922527, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3163986206
validation[          , genome  2504] predictions:    9373/  10000 (93.73%), best:    9395/10000 (93.95%), error:      2106.04956, best error:      2002.45886 on epoch:    10, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 45.7701568604s, input_fired_time: 0.2938431501, output_fired_time: 0.2082445323, propagate_forward_time: 18.9189071655, propagate_backward_time: 24.5526618958, weight_update_time: 0.0800146461, other_time: 1.7965011597
epoch time: 4.2751083374s, input_fired_time: 0.0352769718, output_fired_time: 0.0000000000, propagate_forward_time: 3.9132289886, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3266024590
validation[          , genome  2504] predictions:    9349/  10000 (93.49%), best:    9395/10000 (93.95%), error:      2168.82666, best error:      2002.45886 on epoch:    10, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 39.2047920227s, input_fired_time: 0.2662194073, output_fired_time: 0.1832223982, propagate_forward_time: 16.1705131531, propagate_backward_time: 21.0302734375, weight_update_time: 0.0685313642, other_time: 1.5545616150
epoch time: 2.9816629887s, input_fired_time: 0.0271552745, output_fired_time: 0.0000000000, propagate_forward_time: 2.7090063095, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2455015182
validation[          , genome  2504] predictions:    9394/  10000 (93.94%), best:    9395/10000 (93.95%), error:      2028.45703, best error:      2002.45886 on epoch:    10, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 41.4854812622s, input_fired_time: 0.2756600380, output_fired_time: 0.1925110817, propagate_forward_time: 17.1804962158, propagate_backward_time: 22.2165832520, weight_update_time: 0.0721107423, other_time: 1.6202278137
epoch time: 3.9467680454s, input_fired_time: 0.0320872590, output_fired_time: 0.0000000000, propagate_forward_time: 3.6126785278, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3020021915
validation[          , genome  2504] predictions:    9402/  10000 (94.02%), best:    9402/10000 (94.02%), error:      1999.19067, best error:      1999.19067 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 36.8017349243s, input_fired_time: 0.2570370734, output_fired_time: 0.1725088805, propagate_forward_time: 15.1495704651, propagate_backward_time: 19.7529373169, weight_update_time: 0.0648886561, other_time: 1.4696807861
epoch time: 3.2323579788s, input_fired_time: 0.0274846349, output_fired_time: 0.0000000000, propagate_forward_time: 2.9500699043, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2548034191
validation[          , genome  2504] predictions:    9404/  10000 (94.04%), best:    9402/10000 (94.02%), error:      2000.58984, best error:      1999.19067 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 40.4883575439s, input_fired_time: 0.2736710012, output_fired_time: 0.1882769763, propagate_forward_time: 16.7260055542, propagate_backward_time: 21.6970233917, weight_update_time: 0.0712703019, other_time: 1.6033802032
epoch time: 3.6863384247s, input_fired_time: 0.0306622349, output_fired_time: 0.0000000000, propagate_forward_time: 3.3703532219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2853229046
validation[          , genome  2504] predictions:    9421/  10000 (94.21%), best:    9421/10000 (94.21%), error:      1961.87537, best error:      1961.87537 on epoch:    19, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 43.4780769348s, input_fired_time: 0.2827376723, output_fired_time: 0.1984132230, propagate_forward_time: 17.9675102234, propagate_backward_time: 23.3455429077, weight_update_time: 0.0756277740, other_time: 1.6838722229
epoch time: 3.2883923054s, input_fired_time: 0.0277454704, output_fired_time: 0.0000000000, propagate_forward_time: 3.0052652359, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2553815842
validation[          , genome  2504] predictions:    9434/  10000 (94.34%), best:    9434/10000 (94.34%), error:      1902.34143, best error:      1902.34143 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 35.6621742249s, input_fired_time: 0.2524717152, output_fired_time: 0.1699331850, propagate_forward_time: 14.7256460190, propagate_backward_time: 19.1077232361, weight_update_time: 0.0622661300, other_time: 1.4063987732
epoch time: 3.1684479713s, input_fired_time: 0.0267762728, output_fired_time: 0.0000000000, propagate_forward_time: 2.8926033974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2490682602
validation[          , genome  2504] predictions:    9402/  10000 (94.02%), best:    9434/10000 (94.34%), error:      2031.00000, best error:      1902.34143 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 35.6214103699s, input_fired_time: 0.2526955903, output_fired_time: 0.1691863090, propagate_forward_time: 14.6762933731, propagate_backward_time: 19.1121654510, weight_update_time: 0.0626247674, other_time: 1.4110698700
epoch time: 3.0835776329s, input_fired_time: 0.0269444473, output_fired_time: 0.0000000000, propagate_forward_time: 2.8110294342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2456037998
validation[          , genome  2504] predictions:    9353/  10000 (93.53%), best:    9434/10000 (94.34%), error:      2204.47729, best error:      1902.34143 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 35.4219322205s, input_fired_time: 0.2503768504, output_fired_time: 0.1669608802, propagate_forward_time: 14.5200462341, propagate_backward_time: 19.0705718994, weight_update_time: 0.0627507791, other_time: 1.4139747620
epoch time: 3.0531394482s, input_fired_time: 0.0265564527, output_fired_time: 0.0000000000, propagate_forward_time: 2.7848186493, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2417643070
validation[          , genome  2504] predictions:    9405/  10000 (94.05%), best:    9434/10000 (94.34%), error:      1970.04504, best error:      1902.34143 on epoch:    20, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 35.6616706848s, input_fired_time: 0.2560894191, output_fired_time: 0.1694226712, propagate_forward_time: 14.7391099930, propagate_backward_time: 19.0538234711, weight_update_time: 0.0635503531, other_time: 1.4432277679
epoch time: 2.7902193069s, input_fired_time: 0.0266747028, output_fired_time: 0.0000000000, propagate_forward_time: 2.5291125774, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2344319820
validation[          , genome  2504] predictions:    9434/  10000 (94.34%), best:    9434/10000 (94.34%), error:      1936.66040, best error:      1902.34143 on epoch:    20, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 36.2858657837s, input_fired_time: 0.2585501075, output_fired_time: 0.1711302251, propagate_forward_time: 14.7949552536, propagate_backward_time: 19.5705928802, weight_update_time: 0.0657868907, other_time: 1.4906368256
epoch time: 4.2881703377s, input_fired_time: 0.0360510536, output_fired_time: 0.0000000000, propagate_forward_time: 3.9229500294, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3291690350
validation[          , genome  2504] predictions:    9373/  10000 (93.73%), best:    9434/10000 (94.34%), error:      2074.41992, best error:      1902.34143 on epoch:    20, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 37.6667404175s, input_fired_time: 0.2641869187, output_fired_time: 0.1771729589, propagate_forward_time: 15.4579763412, propagate_backward_time: 20.2407722473, weight_update_time: 0.0670288950, other_time: 1.5266304016
epoch time: 2.9686956406s, input_fired_time: 0.0266599096, output_fired_time: 0.0000000000, propagate_forward_time: 2.7009665966, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2410690784
validation[          , genome  2504] predictions:    9418/  10000 (94.18%), best:    9434/10000 (94.34%), error:      1999.79578, best error:      1902.34143 on epoch:    20, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 36.4205207825s, input_fired_time: 0.2603927553, output_fired_time: 0.1720966995, propagate_forward_time: 15.0159940720, propagate_backward_time: 19.4817276001, weight_update_time: 0.0652910173, other_time: 1.4903106689
epoch time: 2.9168479443s, input_fired_time: 0.0276343934, output_fired_time: 0.0000000000, propagate_forward_time: 2.6449496746, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2442638874
validation[          , genome  2504] predictions:    9434/  10000 (94.34%), best:    9434/10000 (94.34%), error:      1932.96777, best error:      1902.34143 on epoch:    20, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 45.5397834778s, input_fired_time: 0.2970136106, output_fired_time: 0.2086935639, propagate_forward_time: 18.7676925659, propagate_backward_time: 24.4826221466, weight_update_time: 0.0795087293, other_time: 1.7837619781
epoch time: 3.8877861500s, input_fired_time: 0.0327740274, output_fired_time: 0.0000000000, propagate_forward_time: 3.5568604469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2981517315
validation[          , genome  2504] predictions:    9421/  10000 (94.21%), best:    9434/10000 (94.34%), error:      1997.22302, best error:      1902.34143 on epoch:    20, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 42.4923667908s, input_fired_time: 0.2828377783, output_fired_time: 0.1956973076, propagate_forward_time: 17.6216087341, propagate_backward_time: 22.7420539856, weight_update_time: 0.0739006698, other_time: 1.6501693726
epoch time: 4.2719912529s, input_fired_time: 0.0346966647, output_fired_time: 0.0000000000, propagate_forward_time: 3.9134571552, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3238375187
validation[          , genome  2504] predictions:    9436/  10000 (94.36%), best:    9436/10000 (94.36%), error:      1843.53394, best error:      1843.53394 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 39.6640663147s, input_fired_time: 0.2706442177, output_fired_time: 0.1847741902, propagate_forward_time: 16.3686962128, propagate_backward_time: 21.2761287689, weight_update_time: 0.0694241226, other_time: 1.5638237000
epoch time: 3.0071148872s, input_fired_time: 0.0272758920, output_fired_time: 0.0000000000, propagate_forward_time: 2.7380759716, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2417631149
validation[          , genome  2504] predictions:    9430/  10000 (94.30%), best:    9436/10000 (94.36%), error:      1911.45691, best error:      1843.53394 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 34.0150794983s, input_fired_time: 0.2521185875, output_fired_time: 0.1633343548, propagate_forward_time: 13.9706859589, propagate_backward_time: 18.2043209076, weight_update_time: 0.0624043420, other_time: 1.4246215820
epoch time: 3.3007361889s, input_fired_time: 0.0283751469, output_fired_time: 0.0000000000, propagate_forward_time: 3.0129587650, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2594022751
validation[          , genome  2504] predictions:    9418/  10000 (94.18%), best:    9436/10000 (94.36%), error:      1934.62866, best error:      1843.53394 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 34.8562393188s, input_fired_time: 0.2517817616, output_fired_time: 0.1650703251, propagate_forward_time: 14.3418874741, propagate_backward_time: 18.6889934540, weight_update_time: 0.0616118014, other_time: 1.4085063934
epoch time: 3.0488157272s, input_fired_time: 0.0269882400, output_fired_time: 0.0000000000, propagate_forward_time: 2.7809832096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2408442497
validation[          , genome  2504] predictions:    9431/  10000 (94.31%), best:    9436/10000 (94.36%), error:      1926.11475, best error:      1843.53394 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 37.3173637390s, input_fired_time: 0.2612684369, output_fired_time: 0.1751452535, propagate_forward_time: 15.3434238434, propagate_backward_time: 20.0456295013, weight_update_time: 0.0657352805, other_time: 1.4918975830
epoch time: 3.0789752007s, input_fired_time: 0.0267718788, output_fired_time: 0.0000000000, propagate_forward_time: 2.8091821671, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2430212498
validation[          , genome  2504] predictions:    9407/  10000 (94.07%), best:    9436/10000 (94.36%), error:      1976.61560, best error:      1843.53394 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 36.2263755798s, input_fired_time: 0.2587882280, output_fired_time: 0.1706652790, propagate_forward_time: 15.0259475708, propagate_backward_time: 19.3328552246, weight_update_time: 0.0634925812, other_time: 1.4381179810
epoch time: 3.2716886997s, input_fired_time: 0.0278952140, output_fired_time: 0.0000000000, propagate_forward_time: 2.9869537354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2568397522
validation[          , genome  2504] predictions:    9398/  10000 (93.98%), best:    9436/10000 (94.36%), error:      1949.46216, best error:      1843.53394 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 37.9717025757s, input_fired_time: 0.2636715770, output_fired_time: 0.1771605909, propagate_forward_time: 15.6597299576, propagate_backward_time: 20.3740234375, weight_update_time: 0.0659298748, other_time: 1.4971160889
epoch time: 3.8644270897s, input_fired_time: 0.0322115645, output_fired_time: 0.0000000000, propagate_forward_time: 3.5338325500, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2983829975
validation[          , genome  2504] predictions:    9417/  10000 (94.17%), best:    9436/10000 (94.36%), error:      1943.20703, best error:      1843.53394 on epoch:    29, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 38.8706588745s, input_fired_time: 0.2728047073, output_fired_time: 0.1821743995, propagate_forward_time: 16.1214294434, propagate_backward_time: 20.7555694580, weight_update_time: 0.0676549077, other_time: 1.5386810303
epoch time: 3.1737487316s, input_fired_time: 0.0276782531, output_fired_time: 0.0000000000, propagate_forward_time: 2.8926413059, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2534291744
validation[          , genome  2504] predictions:    9436/  10000 (94.36%), best:    9436/10000 (94.36%), error:      1882.16492, best error:      1843.53394 on epoch:    29, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 36.4567451477s, input_fired_time: 0.2571115494, output_fired_time: 0.1713260114, propagate_forward_time: 15.0997619629, propagate_backward_time: 19.4532966614, weight_update_time: 0.0639925227, other_time: 1.4752502441
epoch time: 3.2264921665s, input_fired_time: 0.0279090442, output_fired_time: 0.0000000000, propagate_forward_time: 2.9418873787, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2566957474
validation[          , genome  2504] predictions:    9420/  10000 (94.20%), best:    9436/10000 (94.36%), error:      1939.29199, best error:      1843.53394 on epoch:    29, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 36.6634864807s, input_fired_time: 0.2578790486, output_fired_time: 0.1761133820, propagate_forward_time: 15.1185884476, propagate_backward_time: 19.6461982727, weight_update_time: 0.0635760799, other_time: 1.4647102356
epoch time: 3.1083104610s, input_fired_time: 0.0271861218, output_fired_time: 0.0000000000, propagate_forward_time: 2.8329987526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2481255531
validation[          , genome  2504] predictions:    9377/  10000 (93.77%), best:    9436/10000 (94.36%), error:      2038.10278, best error:      1843.53394 on epoch:    29, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 36.3778076172s, input_fired_time: 0.2570726275, output_fired_time: 0.1721630245, propagate_forward_time: 15.0059242249, propagate_backward_time: 19.4661235809, weight_update_time: 0.0633726642, other_time: 1.4765224457
epoch time: 3.2407438755s, input_fired_time: 0.0280592982, output_fired_time: 0.0000000000, propagate_forward_time: 2.9557518959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2569327354
validation[          , genome  2504] predictions:    9438/  10000 (94.38%), best:    9436/10000 (94.36%), error:      1918.78027, best error:      1843.53394 on epoch:    29, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 36.5143852234s, input_fired_time: 0.2579559982, output_fired_time: 0.1732576340, propagate_forward_time: 15.0364360809, propagate_backward_time: 19.5761508942, weight_update_time: 0.0638772622, other_time: 1.4705848694
epoch time: 3.2867212296s, input_fired_time: 0.0285489466, output_fired_time: 0.0000000000, propagate_forward_time: 2.9961183071, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2620539665
validation[          , genome  2504] predictions:    9381/  10000 (93.81%), best:    9436/10000 (94.36%), error:      2026.39612, best error:      1843.53394 on epoch:    29, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 37.0735015869s, input_fired_time: 0.2605507374, output_fired_time: 0.1749385297, propagate_forward_time: 15.3531465530, propagate_backward_time: 19.8039779663, weight_update_time: 0.0649774075, other_time: 1.4808883667
epoch time: 3.2742457390s, input_fired_time: 0.0282692723, output_fired_time: 0.0000000000, propagate_forward_time: 2.9898886681, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2560877800
validation[          , genome  2504] predictions:    9423/  10000 (94.23%), best:    9436/10000 (94.36%), error:      1924.60010, best error:      1843.53394 on epoch:    29, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 36.1973266602s, input_fired_time: 0.2559278309, output_fired_time: 0.1701938808, propagate_forward_time: 14.8808069229, propagate_backward_time: 19.4507675171, weight_update_time: 0.0640627444, other_time: 1.4396324158
epoch time: 3.0927925110s, input_fired_time: 0.0269741677, output_fired_time: 0.0000000000, propagate_forward_time: 2.8209917545, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2448265553
validation[          , genome  2504] predictions:    9427/  10000 (94.27%), best:    9436/10000 (94.36%), error:      1871.97998, best error:      1843.53394 on epoch:    29, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 36.7888565063s, input_fired_time: 0.2603013217, output_fired_time: 0.1730973721, propagate_forward_time: 15.1528520584, propagate_backward_time: 19.7276897430, weight_update_time: 0.0653056204, other_time: 1.4749202728
epoch time: 4.2934784889s, input_fired_time: 0.0381179899, output_fired_time: 0.0000000000, propagate_forward_time: 3.9227793217, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3325812817
validation[          , genome  2504] predictions:    9411/  10000 (94.11%), best:    9436/10000 (94.36%), error:      1910.19019, best error:      1843.53394 on epoch:    29, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 41.6994438171s, input_fired_time: 0.2795700133, output_fired_time: 0.1930696517, propagate_forward_time: 17.1892700195, propagate_backward_time: 22.4045715332, weight_update_time: 0.0726162940, other_time: 1.6329612732
epoch time: 4.2089505196s, input_fired_time: 0.0354749560, output_fired_time: 0.0000000000, propagate_forward_time: 3.8515498638, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3219258785
validation[          , genome  2504] predictions:    9428/  10000 (94.28%), best:    9436/10000 (94.36%), error:      1888.54431, best error:      1843.53394 on epoch:    29, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 40.9818496704s, input_fired_time: 0.2765276432, output_fired_time: 0.1906639189, propagate_forward_time: 16.9631576538, propagate_backward_time: 21.9478263855, weight_update_time: 0.0715821907, other_time: 1.6036758423
epoch time: 4.2599086761s, input_fired_time: 0.0348143727, output_fired_time: 0.0000000000, propagate_forward_time: 3.9034559727, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3216383457
validation[          , genome  2504] predictions:    9422/  10000 (94.22%), best:    9436/10000 (94.36%), error:      1989.89758, best error:      1843.53394 on epoch:    29, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 40.2650718689s, input_fired_time: 0.2773595154, output_fired_time: 0.1877743900, propagate_forward_time: 16.5443935394, propagate_backward_time: 21.6329841614, weight_update_time: 0.0716319680, other_time: 1.6225605011
epoch time: 3.6548588276s, input_fired_time: 0.0311408173, output_fired_time: 0.0000000000, propagate_forward_time: 3.3413691521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2823488712
validation[          , genome  2504] predictions:    9465/  10000 (94.65%), best:    9465/10000 (94.65%), error:      1796.78918, best error:      1796.78918 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 36.0643959045s, input_fired_time: 0.2612364590, output_fired_time: 0.1714521050, propagate_forward_time: 14.8589429855, propagate_backward_time: 19.2873172760, weight_update_time: 0.0648868307, other_time: 1.4854450226
epoch time: 3.0062224865s, input_fired_time: 0.0269635469, output_fired_time: 0.0000000000, propagate_forward_time: 2.7398228645, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2394361496
validation[          , genome  2504] predictions:    9447/  10000 (94.47%), best:    9465/10000 (94.65%), error:      1868.39575, best error:      1796.78918 on epoch:    46, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 34.7828750610s, input_fired_time: 0.2572911084, output_fired_time: 0.1673864275, propagate_forward_time: 14.2673454285, propagate_backward_time: 18.6409397125, weight_update_time: 0.0633634999, other_time: 1.4499149323
epoch time: 3.2128465176s, input_fired_time: 0.0295683742, output_fired_time: 0.0000000000, propagate_forward_time: 2.9257447720, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2575333118
validation[          , genome  2504] predictions:    9418/  10000 (94.18%), best:    9465/10000 (94.65%), error:      1905.56372, best error:      1796.78918 on epoch:    46, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 36.3585510254s, input_fired_time: 0.2637766302, output_fired_time: 0.1728876531, propagate_forward_time: 14.9306554794, propagate_backward_time: 19.4738292694, weight_update_time: 0.0657475069, other_time: 1.5174045563
epoch time: 3.4965851307s, input_fired_time: 0.0310171023, output_fired_time: 0.0000000000, propagate_forward_time: 3.1892457008, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2763223648
validation[          , genome  2504] predictions:    9410/  10000 (94.10%), best:    9465/10000 (94.65%), error:      1961.52576, best error:      1796.78918 on epoch:    46, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 38.0473327637s, input_fired_time: 0.2721500695, output_fired_time: 0.1795500219, propagate_forward_time: 15.6913909912, propagate_backward_time: 20.3334808350, weight_update_time: 0.0685466230, other_time: 1.5707588196
epoch time: 2.9254963398s, input_fired_time: 0.0266587399, output_fired_time: 0.0000000000, propagate_forward_time: 2.6614129543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2374246120
validation[          , genome  2504] predictions:    9412/  10000 (94.12%), best:    9465/10000 (94.65%), error:      1942.47522, best error:      1796.78918 on epoch:    46, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 34.0321769714s, input_fired_time: 0.2552751899, output_fired_time: 0.1650516838, propagate_forward_time: 13.9458065033, propagate_backward_time: 18.2379646301, weight_update_time: 0.0621570200, other_time: 1.4280796051
epoch time: 2.9836335182s, input_fired_time: 0.0287387744, output_fired_time: 0.0000000000, propagate_forward_time: 2.7076582909, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2472364902
validation[          , genome  2504] predictions:    9452/  10000 (94.52%), best:    9465/10000 (94.65%), error:      1831.74646, best error:      1796.78918 on epoch:    46, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 35.1406135559s, input_fired_time: 0.2605282962, output_fired_time: 0.1678310335, propagate_forward_time: 14.3529052734, propagate_backward_time: 18.8696022034, weight_update_time: 0.0644146129, other_time: 1.4897460938
epoch time: 4.2901973724s, input_fired_time: 0.0364825167, output_fired_time: 0.0000000000, propagate_forward_time: 3.9233593941, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3303556442
validation[          , genome  2504] predictions:    9369/  10000 (93.69%), best:    9465/10000 (94.65%), error:      2070.92163, best error:      1796.78918 on epoch:    46, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 43.5286788940s, input_fired_time: 0.2901055515, output_fired_time: 0.1995874941, propagate_forward_time: 17.9655799866, propagate_backward_time: 23.3597106934, weight_update_time: 0.0760717690, other_time: 1.7136955261
epoch time: 4.2810125351s, input_fired_time: 0.0379510522, output_fired_time: 0.0000000000, propagate_forward_time: 3.9129407406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3301208019
validation[          , genome  2504] predictions:    9454/  10000 (94.54%), best:    9454/10000 (94.54%), error:      1789.08057, best error:      1789.08057 on epoch:    53, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 45.0367813110s, input_fired_time: 0.2959967256, output_fired_time: 0.2065700591, propagate_forward_time: 18.5665550232, propagate_backward_time: 24.2148799896, weight_update_time: 0.0782809779, other_time: 1.7527790070
epoch time: 4.2777233124s, input_fired_time: 0.0353408232, output_fired_time: 0.0000000000, propagate_forward_time: 3.9179198742, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3244626522
validation[          , genome  2504] predictions:    9441/  10000 (94.41%), best:    9454/10000 (94.54%), error:      1858.10425, best error:      1789.08057 on epoch:    53, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 37.6977233887s, input_fired_time: 0.2649305463, output_fired_time: 0.1771318167, propagate_forward_time: 15.5307216644, propagate_backward_time: 20.2421989441, weight_update_time: 0.0657309592, other_time: 1.4827404022
epoch time: 3.1723637581s, input_fired_time: 0.0282010194, output_fired_time: 0.0000000000, propagate_forward_time: 2.8912563324, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2529063225
validation[          , genome  2504] predictions:    9407/  10000 (94.07%), best:    9454/10000 (94.54%), error:      1978.81812, best error:      1789.08057 on epoch:    53, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 36.0634078979s, input_fired_time: 0.2579756975, output_fired_time: 0.1718120277, propagate_forward_time: 14.8318471909, propagate_backward_time: 19.3701133728, weight_update_time: 0.0632533506, other_time: 1.4316596985
epoch time: 4.2805032730s, input_fired_time: 0.0365297981, output_fired_time: 0.0000000000, propagate_forward_time: 3.9163432121, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3276300430
validation[          , genome  2504] predictions:    9440/  10000 (94.40%), best:    9454/10000 (94.54%), error:      1827.98438, best error:      1789.08057 on epoch:    53, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 46.4057273865s, input_fired_time: 0.3038858771, output_fired_time: 0.2112620473, propagate_forward_time: 19.1929740906, propagate_backward_time: 24.8659954071, weight_update_time: 0.0815092325, other_time: 1.8316097260
epoch time: 4.2705578804s, input_fired_time: 0.0378147550, output_fired_time: 0.0000000000, propagate_forward_time: 3.9028074741, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3299357891
validation[          , genome  2504] predictions:    9449/  10000 (94.49%), best:    9454/10000 (94.54%), error:      1829.19116, best error:      1789.08057 on epoch:    53, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 39.1310501099s, input_fired_time: 0.2695920765, output_fired_time: 0.1823860407, propagate_forward_time: 16.1306095123, propagate_backward_time: 21.0177364349, weight_update_time: 0.0681729540, other_time: 1.5307273865
epoch time: 3.2108840942s, input_fired_time: 0.0283708088, output_fired_time: 0.0000000000, propagate_forward_time: 2.9309401512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2515730858
validation[          , genome  2504] predictions:    9444/  10000 (94.44%), best:    9454/10000 (94.54%), error:      1836.91235, best error:      1789.08057 on epoch:    53, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 35.6245040894s, input_fired_time: 0.2556766272, output_fired_time: 0.1701020896, propagate_forward_time: 14.6433639526, propagate_backward_time: 19.1432476044, weight_update_time: 0.0626515001, other_time: 1.4121150970
epoch time: 3.2607018948s, input_fired_time: 0.0284948200, output_fired_time: 0.0000000000, propagate_forward_time: 2.9788706303, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2533364296
validation[          , genome  2504] predictions:    9437/  10000 (94.37%), best:    9454/10000 (94.54%), error:      1875.73499, best error:      1789.08057 on epoch:    53, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 40.0147056580s, input_fired_time: 0.2756988108, output_fired_time: 0.1854920536, propagate_forward_time: 16.5411109924, propagate_backward_time: 21.4442043304, weight_update_time: 0.0699107423, other_time: 1.5681972504
epoch time: 4.2603597641s, input_fired_time: 0.0367997177, output_fired_time: 0.0000000000, propagate_forward_time: 3.8959352970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3276245594
validation[          , genome  2504] predictions:    9427/  10000 (94.27%), best:    9454/10000 (94.54%), error:      1871.06042, best error:      1789.08057 on epoch:    53, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 38.1516609192s, input_fired_time: 0.2690646350, output_fired_time: 0.1783287227, propagate_forward_time: 15.7292757034, propagate_backward_time: 20.4676589966, weight_update_time: 0.0672251061, other_time: 1.5073318481
epoch time: 2.9351758957s, input_fired_time: 0.0272042174, output_fired_time: 0.0000000000, propagate_forward_time: 2.6729311943, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2350404263
validation[          , genome  2504] predictions:    9446/  10000 (94.46%), best:    9454/10000 (94.54%), error:      1913.93726, best error:      1789.08057 on epoch:    53, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 40.8449134827s, input_fired_time: 0.2825028300, output_fired_time: 0.1903378069, propagate_forward_time: 16.8395881653, propagate_backward_time: 21.8924751282, weight_update_time: 0.0722746104, other_time: 1.6400108337
epoch time: 2.9346048832s, input_fired_time: 0.0284715779, output_fired_time: 0.0000000000, propagate_forward_time: 2.6601080894, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2460253239
validation[          , genome  2504] predictions:    9434/  10000 (94.34%), best:    9454/10000 (94.54%), error:      1852.03870, best error:      1789.08057 on epoch:    53, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 35.3971290588s, input_fired_time: 0.2624494731, output_fired_time: 0.1699926406, propagate_forward_time: 14.6226272583, propagate_backward_time: 18.8697357178, weight_update_time: 0.0640787035, other_time: 1.4723205566
epoch time: 4.2723536491s, input_fired_time: 0.0356725231, output_fired_time: 0.0000000000, propagate_forward_time: 3.9122953415, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3243856430
validation[          , genome  2504] predictions:    9416/  10000 (94.16%), best:    9454/10000 (94.54%), error:      1964.34399, best error:      1789.08057 on epoch:    53, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 42.3468132019s, input_fired_time: 0.2861665785, output_fired_time: 0.1965908259, propagate_forward_time: 17.4974288940, propagate_backward_time: 22.7041702271, weight_update_time: 0.0737938508, other_time: 1.6624565125
epoch time: 3.2859773636s, input_fired_time: 0.0288052522, output_fired_time: 0.0000000000, propagate_forward_time: 2.9987673759, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2584047318
validation[          , genome  2504] predictions:    9464/  10000 (94.64%), best:    9454/10000 (94.54%), error:      1793.30530, best error:      1789.08057 on epoch:    53, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 36.5472526550s, input_fired_time: 0.2610892653, output_fired_time: 0.1718274057, propagate_forward_time: 15.0614032745, propagate_backward_time: 19.5959262848, weight_update_time: 0.0644973367, other_time: 1.4570045471
epoch time: 3.3203804493s, input_fired_time: 0.0291065965, output_fired_time: 0.0000000000, propagate_forward_time: 3.0288250446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2624487877
validation[          , genome  2504] predictions:    9435/  10000 (94.35%), best:    9454/10000 (94.54%), error:      1830.87134, best error:      1789.08057 on epoch:    53, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 36.5536613464s, input_fired_time: 0.2602078319, output_fired_time: 0.1719082743, propagate_forward_time: 15.0626153946, propagate_backward_time: 19.5839347839, weight_update_time: 0.0646477863, other_time: 1.4749946594
epoch time: 3.3094615936s, input_fired_time: 0.0291301198, output_fired_time: 0.0000000000, propagate_forward_time: 3.0196783543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2606530190
validation[          , genome  2504] predictions:    9380/  10000 (93.80%), best:    9454/10000 (94.54%), error:      2028.78027, best error:      1789.08057 on epoch:    53, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 41.0034217834s, input_fired_time: 0.2786213756, output_fired_time: 0.1896354109, propagate_forward_time: 16.9323272705, propagate_backward_time: 21.9982776642, weight_update_time: 0.0714055225, other_time: 1.6045589447
epoch time: 4.2810916901s, input_fired_time: 0.0355218276, output_fired_time: 0.0000000000, propagate_forward_time: 3.9231505394, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3224191666
validation[          , genome  2504] predictions:    9422/  10000 (94.22%), best:    9454/10000 (94.54%), error:      1894.48035, best error:      1789.08057 on epoch:    53, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 41.8559036255s, input_fired_time: 0.2866566479, output_fired_time: 0.1922616065, propagate_forward_time: 17.2379703522, propagate_backward_time: 22.5081806183, weight_update_time: 0.0727778152, other_time: 1.6308364868
epoch time: 4.1059174538s, input_fired_time: 0.0343935229, output_fired_time: 0.0000000000, propagate_forward_time: 3.7560193539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3155047894
validation[          , genome  2504] predictions:    9425/  10000 (94.25%), best:    9454/10000 (94.54%), error:      1889.93811, best error:      1789.08057 on epoch:    53, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 39.7763557434s, input_fired_time: 0.2753139138, output_fired_time: 0.1929693818, propagate_forward_time: 16.4049320221, propagate_backward_time: 21.3501014709, weight_update_time: 0.0693442076, other_time: 1.5530376434
epoch time: 3.3704047203s, input_fired_time: 0.0294419006, output_fired_time: 0.0000000000, propagate_forward_time: 3.0802769661, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2606859207
validation[          , genome  2504] predictions:    9470/  10000 (94.70%), best:    9470/10000 (94.70%), error:      1774.91772, best error:      1774.91772 on epoch:    69, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 36.4341812134s, input_fired_time: 0.2605112493, output_fired_time: 0.1723423600, propagate_forward_time: 14.9331045151, propagate_backward_time: 19.6156387329, weight_update_time: 0.0643301904, other_time: 1.4525833130
epoch time: 3.1841464043s, input_fired_time: 0.0285000447, output_fired_time: 0.0000000000, propagate_forward_time: 2.9057679176, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2498784065
validation[          , genome  2504] predictions:    9440/  10000 (94.40%), best:    9470/10000 (94.70%), error:      1836.84521, best error:      1774.91772 on epoch:    69, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 43.1682891846s, input_fired_time: 0.2984986007, output_fired_time: 0.1990934312, propagate_forward_time: 17.7862625122, propagate_backward_time: 23.2207450867, weight_update_time: 0.0746491700, other_time: 1.6636886597
epoch time: 4.2499618530s, input_fired_time: 0.0453776903, output_fired_time: 0.0000000000, propagate_forward_time: 3.8819220066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3226621151
validation[          , genome  2504] predictions:    9448/  10000 (94.48%), best:    9470/10000 (94.70%), error:      1827.34216, best error:      1774.91772 on epoch:    69, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 40.1111946106s, input_fired_time: 0.2772230506, output_fired_time: 0.1868941337, propagate_forward_time: 16.5420169830, propagate_backward_time: 21.5232391357, weight_update_time: 0.0719073936, other_time: 1.5818233490
epoch time: 4.2881603241s, input_fired_time: 0.0375672989, output_fired_time: 0.0000000000, propagate_forward_time: 3.9289369583, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3216562271
validation[          , genome  2504] predictions:    9454/  10000 (94.54%), best:    9470/10000 (94.70%), error:      1809.29333, best error:      1774.91772 on epoch:    69, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 40.4076995850s, input_fired_time: 0.2789896429, output_fired_time: 0.1876504868, propagate_forward_time: 16.7171421051, propagate_backward_time: 21.6393108368, weight_update_time: 0.0714329407, other_time: 1.5846099854
epoch time: 2.9700498581s, input_fired_time: 0.0275602825, output_fired_time: 0.0000000000, propagate_forward_time: 2.7038612366, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2386283875
validation[          , genome  2504] predictions:    9425/  10000 (94.25%), best:    9470/10000 (94.70%), error:      1905.59924, best error:      1774.91772 on epoch:    69, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 40.7935256958s, input_fired_time: 0.2820260525, output_fired_time: 0.1892114133, propagate_forward_time: 16.8958930969, propagate_backward_time: 21.8194980621, weight_update_time: 0.0722192824, other_time: 1.6068973541
epoch time: 3.7225708961s, input_fired_time: 0.0327236652, output_fired_time: 0.0000000000, propagate_forward_time: 3.3979728222, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2918744087
validation[          , genome  2504] predictions:    9456/  10000 (94.56%), best:    9470/10000 (94.70%), error:      1781.83960, best error:      1774.91772 on epoch:    69, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 43.7095260620s, input_fired_time: 0.2907583714, output_fired_time: 0.2008018792, propagate_forward_time: 18.0577392578, propagate_backward_time: 23.4783306122, weight_update_time: 0.0758596137, other_time: 1.6818943024
epoch time: 3.8581268787s, input_fired_time: 0.0332027636, output_fired_time: 0.0000000000, propagate_forward_time: 3.5261564255, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2987678051
validation[          , genome  2504] predictions:    9422/  10000 (94.22%), best:    9470/10000 (94.70%), error:      1880.47766, best error:      1774.91772 on epoch:    69, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 34.1902275085s, input_fired_time: 0.2603324056, output_fired_time: 0.1640581936, propagate_forward_time: 14.1233215332, propagate_backward_time: 18.2128238678, weight_update_time: 0.0626774654, other_time: 1.4296894073
epoch time: 2.9853987694s, input_fired_time: 0.0288220365, output_fired_time: 0.0000000000, propagate_forward_time: 2.7131245136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2434523106
validation[          , genome  2504] predictions:    9438/  10000 (94.38%), best:    9470/10000 (94.70%), error:      1832.64197, best error:      1774.91772 on epoch:    69, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 43.4490890503s, input_fired_time: 0.2965345979, output_fired_time: 0.1999534965, propagate_forward_time: 17.9241371155, propagate_backward_time: 23.3056983948, weight_update_time: 0.0772615448, other_time: 1.7227630615
epoch time: 2.9061825275s, input_fired_time: 0.0277428608, output_fired_time: 0.0000000000, propagate_forward_time: 2.6403181553, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2381215096
validation[          , genome  2504] predictions:    9457/  10000 (94.57%), best:    9457/10000 (94.57%), error:      1768.36890, best error:      1768.36890 on epoch:    77, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 33.0723800659s, input_fired_time: 0.2540932298, output_fired_time: 0.1593414247, propagate_forward_time: 13.5645408630, propagate_backward_time: 17.6914691925, weight_update_time: 0.0614818968, other_time: 1.4029369354
epoch time: 4.0707840919s, input_fired_time: 0.0363611020, output_fired_time: 0.0000000000, propagate_forward_time: 3.7169446945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3174781799
validation[          , genome  2504] predictions:    9443/  10000 (94.43%), best:    9457/10000 (94.57%), error:      1846.98071, best error:      1768.36890 on epoch:    77, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 35.6155395508s, input_fired_time: 0.2597066760, output_fired_time: 0.1687486470, propagate_forward_time: 14.6187334061, propagate_backward_time: 19.1346988678, weight_update_time: 0.0633711964, other_time: 1.4336528778
epoch time: 3.1267511845s, input_fired_time: 0.0283488482, output_fired_time: 0.0000000000, propagate_forward_time: 2.8510456085, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2473566532
validation[          , genome  2504] predictions:    9454/  10000 (94.54%), best:    9457/10000 (94.57%), error:      1793.76782, best error:      1768.36890 on epoch:    77, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 35.6199493408s, input_fired_time: 0.2587141395, output_fired_time: 0.1678795069, propagate_forward_time: 14.7196760178, propagate_backward_time: 19.0627727509, weight_update_time: 0.0629596412, other_time: 1.4109058380
epoch time: 3.1643264294s, input_fired_time: 0.0287476238, output_fired_time: 0.0000000000, propagate_forward_time: 2.8873796463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2481992245
validation[          , genome  2504] predictions:    9450/  10000 (94.50%), best:    9457/10000 (94.57%), error:      1795.19604, best error:      1768.36890 on epoch:    77, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 35.5859947205s, input_fired_time: 0.2586170733, output_fired_time: 0.1697198302, propagate_forward_time: 14.6200265884, propagate_backward_time: 19.1352729797, weight_update_time: 0.0624634884, other_time: 1.4023590088
epoch time: 3.2340803146s, input_fired_time: 0.0287953187, output_fired_time: 0.0000000000, propagate_forward_time: 2.9532678127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2520172596
validation[          , genome  2504] predictions:    9459/  10000 (94.59%), best:    9457/10000 (94.57%), error:      1814.35278, best error:      1768.36890 on epoch:    77, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 41.6791267395s, input_fired_time: 0.2848216295, output_fired_time: 0.1927937716, propagate_forward_time: 17.1903476715, propagate_backward_time: 22.3878898621, weight_update_time: 0.0730581135, other_time: 1.6232738495
epoch time: 3.8107371330s, input_fired_time: 0.0326020159, output_fired_time: 0.0000000000, propagate_forward_time: 3.4856755733, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2924594879
validation[          , genome  2504] predictions:    9453/  10000 (94.53%), best:    9457/10000 (94.57%), error:      1776.83008, best error:      1768.36890 on epoch:    77, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 45.3377532959s, input_fired_time: 0.2986685932, output_fired_time: 0.2069719136, propagate_forward_time: 18.7238426208, propagate_backward_time: 24.3592929840, weight_update_time: 0.0793273300, other_time: 1.7489795685
epoch time: 3.0129771233s, input_fired_time: 0.0290118679, output_fired_time: 0.0000000000, propagate_forward_time: 2.7325088978, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2514562607
validation[          , genome  2504] predictions:    9465/  10000 (94.65%), best:    9465/10000 (94.65%), error:      1760.89661, best error:      1760.89661 on epoch:    83, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 40.8649215698s, input_fired_time: 0.2841184139, output_fired_time: 0.1898409128, propagate_forward_time: 16.8741741180, propagate_backward_time: 21.8826560974, weight_update_time: 0.0727446526, other_time: 1.6341304779
epoch time: 3.8687973022s, input_fired_time: 0.0333019644, output_fired_time: 0.0000000000, propagate_forward_time: 3.5387504101, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2967448235
validation[          , genome  2504] predictions:    9451/  10000 (94.51%), best:    9465/10000 (94.65%), error:      1810.64551, best error:      1760.89661 on epoch:    83, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 45.1049308777s, input_fired_time: 0.2977587879, output_fired_time: 0.2058416158, propagate_forward_time: 18.6555137634, propagate_backward_time: 24.2215461731, weight_update_time: 0.0783660263, other_time: 1.7242698669
epoch time: 3.8254814148s, input_fired_time: 0.0336079225, output_fired_time: 0.0000000000, propagate_forward_time: 3.4990518093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2928216457
validation[          , genome  2504] predictions:    9464/  10000 (94.64%), best:    9465/10000 (94.65%), error:      1784.29138, best error:      1760.89661 on epoch:    83, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 37.4139289856s, input_fired_time: 0.2660634220, output_fired_time: 0.1759591401, propagate_forward_time: 15.3945550919, propagate_backward_time: 20.1127796173, weight_update_time: 0.0658969358, other_time: 1.4645709991
epoch time: 3.3188645840s, input_fired_time: 0.0297557730, output_fired_time: 0.0000000000, propagate_forward_time: 3.0307059288, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2584028244
validation[          , genome  2504] predictions:    9464/  10000 (94.64%), best:    9465/10000 (94.65%), error:      1789.48950, best error:      1760.89661 on epoch:    83, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 37.2546958923s, input_fired_time: 0.2686837018, output_fired_time: 0.1746597737, propagate_forward_time: 15.3194570541, propagate_backward_time: 19.9910774231, weight_update_time: 0.0671179518, other_time: 1.5008163452
epoch time: 2.9323530197s, input_fired_time: 0.0277544018, output_fired_time: 0.0000000000, propagate_forward_time: 2.6672322750, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2373664379
validation[          , genome  2504] predictions:    9420/  10000 (94.20%), best:    9465/10000 (94.65%), error:      1867.15930, best error:      1760.89661 on epoch:    83, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 33.1367797852s, input_fired_time: 0.2540877461, output_fired_time: 0.1594250798, propagate_forward_time: 13.5804729462, propagate_backward_time: 17.7686958313, weight_update_time: 0.0601528436, other_time: 1.3740978241
epoch time: 3.0713646412s, input_fired_time: 0.0302390829, output_fired_time: 0.0000000000, propagate_forward_time: 2.7881679535, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2529575825
validation[          , genome  2504] predictions:    9463/  10000 (94.63%), best:    9465/10000 (94.65%), error:      1829.19690, best error:      1760.89661 on epoch:    83, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 43.3098526001s, input_fired_time: 0.2925305367, output_fired_time: 0.1989479363, propagate_forward_time: 17.9081401825, propagate_backward_time: 23.2415466309, weight_update_time: 0.0755427405, other_time: 1.6686878204
epoch time: 2.9656965733s, input_fired_time: 0.0278601609, output_fired_time: 0.0000000000, propagate_forward_time: 2.7026193142, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2352170944
validation[          , genome  2504] predictions:    9458/  10000 (94.58%), best:    9465/10000 (94.65%), error:      1805.82117, best error:      1760.89661 on epoch:    83, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 42.2914581299s, input_fired_time: 0.2923485637, output_fired_time: 0.1954116076, propagate_forward_time: 17.4664134979, propagate_backward_time: 22.6492156982, weight_update_time: 0.0751087889, other_time: 1.6880702972
epoch time: 2.9237349033s, input_fired_time: 0.0288553461, output_fired_time: 0.0000000000, propagate_forward_time: 2.6485261917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2463533878
validation[          , genome  2504] predictions:    9469/  10000 (94.69%), best:    9465/10000 (94.65%), error:      1762.66406, best error:      1760.89661 on epoch:    83, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 32.9967956543s, input_fired_time: 0.2540161908, output_fired_time: 0.1593374163, propagate_forward_time: 13.5651941299, propagate_backward_time: 17.6352634430, weight_update_time: 0.0609532036, other_time: 1.3829860687
epoch time: 2.9984703064s, input_fired_time: 0.0283336248, output_fired_time: 0.0000000000, propagate_forward_time: 2.7296078205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2405288219
validation[          , genome  2504] predictions:    9400/  10000 (94.00%), best:    9465/10000 (94.65%), error:      1945.37048, best error:      1760.89661 on epoch:    83, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 38.2912216187s, input_fired_time: 0.2729798853, output_fired_time: 0.1799688786, propagate_forward_time: 15.8321332932, propagate_backward_time: 20.4924106598, weight_update_time: 0.0676571503, other_time: 1.5137271881
epoch time: 4.2796154022s, input_fired_time: 0.0362874418, output_fired_time: 0.0000000000, propagate_forward_time: 3.9199531078, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3233749866
validation[          , genome  2504] predictions:    9469/  10000 (94.69%), best:    9465/10000 (94.65%), error:      1775.75732, best error:      1760.89661 on epoch:    83, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 42.7493400574s, input_fired_time: 0.2909857929, output_fired_time: 0.1974166036, propagate_forward_time: 17.6957435608, propagate_backward_time: 22.9202690125, weight_update_time: 0.0743128359, other_time: 1.6449241638
epoch time: 4.2780175209s, input_fired_time: 0.0359934233, output_fired_time: 0.0000000000, propagate_forward_time: 3.9211008549, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3209230900
validation[          , genome  2504] predictions:    9462/  10000 (94.62%), best:    9465/10000 (94.65%), error:      1780.39233, best error:      1760.89661 on epoch:    83, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 42.2279777527s, input_fired_time: 0.2860823572, output_fired_time: 0.1951554120, propagate_forward_time: 17.4087371826, propagate_backward_time: 22.6803321838, weight_update_time: 0.0733524784, other_time: 1.6576690674
epoch time: 4.2700939178s, input_fired_time: 0.0356773846, output_fired_time: 0.0000000000, propagate_forward_time: 3.9018974304, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3325190544
validation[          , genome  2504] predictions:    9445/  10000 (94.45%), best:    9465/10000 (94.65%), error:      1848.29199, best error:      1760.89661 on epoch:    83, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 40.6321258545s, input_fired_time: 0.2792399824, output_fired_time: 0.1884354502, propagate_forward_time: 16.7732772827, propagate_backward_time: 21.8029918671, weight_update_time: 0.0704318210, other_time: 1.5881824493
epoch time: 4.1398582458s, input_fired_time: 0.0353665091, output_fired_time: 0.0000000000, propagate_forward_time: 3.7922489643, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3122427464
validation[          , genome  2504] predictions:    9472/  10000 (94.72%), best:    9465/10000 (94.65%), error:      1784.33289, best error:      1760.89661 on epoch:    83, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 40.3528251648s, input_fired_time: 0.2798102498, output_fired_time: 0.1864977032, propagate_forward_time: 16.6765708923, propagate_backward_time: 21.6290016174, weight_update_time: 0.0703937933, other_time: 1.5809440613
epoch time: 3.4473869801s, input_fired_time: 0.0305424090, output_fired_time: 0.0000000000, propagate_forward_time: 3.1484975815, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2683470249
validation[          , genome  2504] predictions:    9458/  10000 (94.58%), best:    9465/10000 (94.65%), error:      1821.59387, best error:      1760.89661 on epoch:    83, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 38.0952377319s, input_fired_time: 0.2695055306, output_fired_time: 0.1784660220, propagate_forward_time: 15.7177677155, propagate_backward_time: 20.4409370422, weight_update_time: 0.0668958724, other_time: 1.4885616302
epoch time: 4.2957763672s, input_fired_time: 0.0366689302, output_fired_time: 0.0000000000, propagate_forward_time: 3.9302415848, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3288660049
validation[          , genome  2504] predictions:    9460/  10000 (94.60%), best:    9465/10000 (94.65%), error:      1808.69507, best error:      1760.89661 on epoch:    83, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 39.7403373718s, input_fired_time: 0.2780496478, output_fired_time: 0.1846665889, propagate_forward_time: 16.3819580078, propagate_backward_time: 21.3441314697, weight_update_time: 0.0688741654, other_time: 1.5515327454
epoch time: 3.0770397186s, input_fired_time: 0.0285818875, output_fired_time: 0.0000000000, propagate_forward_time: 2.8001661301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2482917309
validation[          , genome  2504] predictions:    9439/  10000 (94.39%), best:    9465/10000 (94.65%), error:      1880.91858, best error:      1760.89661 on epoch:    83, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 41.3947448730s, input_fired_time: 0.2824185193, output_fired_time: 0.1909872890, propagate_forward_time: 17.1335201263, propagate_backward_time: 22.1792030334, weight_update_time: 0.0719242170, other_time: 1.6086177826
epoch time: 3.3152399063s, input_fired_time: 0.0300435163, output_fired_time: 0.0000000000, propagate_forward_time: 3.0272791386, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2579171658
validation[          , genome  2504] predictions:    9461/  10000 (94.61%), best:    9465/10000 (94.65%), error:      1779.03052, best error:      1760.89661 on epoch:    83, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 36.2192115784s, input_fired_time: 0.2618632913, output_fired_time: 0.1712683290, propagate_forward_time: 14.8573226929, propagate_backward_time: 19.5137920380, weight_update_time: 0.0631451309, other_time: 1.4149646759
epoch time: 3.2141559124s, input_fired_time: 0.0287429858, output_fired_time: 0.0000000000, propagate_forward_time: 2.9344203472, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2509925365
validation[          , genome  2504] predictions:    9435/  10000 (94.35%), best:    9465/10000 (94.65%), error:      1858.70850, best error:      1760.89661 on epoch:    83, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 17.1244983673s, input_fired_time: 0.1538508385, output_fired_time: 0.0000000000, propagate_forward_time: 15.5838365555, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3868112564
best training[          , genome  2504] predictions:   48224/  50000 (96.45%), best:    9465/10000 (94.65%), error:      6209.84033, best error:      1760.89661 on epoch:    83, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 4.0127758980s, input_fired_time: 0.0336820744, output_fired_time: 0.0000000000, propagate_forward_time: 3.6594731808, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3196206093
   testing[          , genome  2504] predictions:    9546/  10000 (95.46%), best:    9465/10000 (94.65%), error:      1501.21826, best error:      1760.89661 on epoch:    83, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
23:48:37 (40534): called boinc_finish(0)

</stderr_txt>
]]>