Nameexact_genome_1512568488_45_2508_0
Workunit2583795
Created7 Dec 2017, 0:04:36 UTC
Sent7 Dec 2017, 0:05:37 UTC
Report deadline10 Dec 2017, 20:50:13 UTC
Received8 Dec 2017, 0:03:26 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID65413
Run time1 hours 33 min 34 sec
CPU time1 hours 33 min 30 sec
Validate stateValid
Credit966.08
Device peak FLOPS3.77 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size149.40 MB
Peak swap size150.56 MB
Peak disk usage0.93 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
, epoch:   13/100, mu: 0.7384625077, learning_rate: 0.0064167744, weight_decay: 0.0002566710

epoch time: 45.3833961487s, input_fired_time: 0.4522584379, output_fired_time: 0.2981629968, propagate_forward_time: 17.7905559540, propagate_backward_time: 25.1444683075, weight_update_time: 0.0747606307, other_time: 1.6979484558
epoch time: 5.1691737175s, input_fired_time: 0.0632698759, output_fired_time: 0.0000000000, propagate_forward_time: 4.7422060966, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3636975288
validation[          , genome  2508] predictions:    9508/  10000 (95.08%), best:    9504/10000 (95.04%), error:      1721.15601, best error:      1706.03992 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 48.2459754944s, input_fired_time: 0.4698624313, output_fired_time: 0.3147417903, propagate_forward_time: 19.0598354340, propagate_backward_time: 26.6507072449, weight_update_time: 0.0722879767, other_time: 1.7508258820
epoch time: 3.6849837303s, input_fired_time: 0.0466596223, output_fired_time: 0.0000000000, propagate_forward_time: 3.3708701134, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2674539089
validation[          , genome  2508] predictions:    9490/  10000 (94.90%), best:    9504/10000 (95.04%), error:      1742.57690, best error:      1706.03992 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 50.7695770264s, input_fired_time: 0.4887290001, output_fired_time: 0.3267597556, propagate_forward_time: 20.1038322449, propagate_backward_time: 28.0605640411, weight_update_time: 0.0757849365, other_time: 1.7896938324
epoch time: 5.1598076820s, input_fired_time: 0.0610431135, output_fired_time: 0.0000000000, propagate_forward_time: 4.7511677742, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3475966454
validation[          , genome  2508] predictions:    9482/  10000 (94.82%), best:    9504/10000 (95.04%), error:      1768.68298, best error:      1706.03992 on epoch:    13, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 49.9565200806s, input_fired_time: 0.4729533792, output_fired_time: 0.3226886988, propagate_forward_time: 19.7397003174, propagate_backward_time: 27.7042446136, weight_update_time: 0.0747484714, other_time: 1.7169322968
epoch time: 4.0223407745s, input_fired_time: 0.0493690781, output_fired_time: 0.0000000000, propagate_forward_time: 3.6867086887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2862629890
validation[          , genome  2508] predictions:    9497/  10000 (94.97%), best:    9497/10000 (94.97%), error:      1693.74744, best error:      1693.74744 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 59.1044540405s, input_fired_time: 0.5279585123, output_fired_time: 0.3740854561, propagate_forward_time: 23.5383243561, propagate_backward_time: 32.6627578735, weight_update_time: 0.0871010497, other_time: 2.0013275146
epoch time: 5.2752718925s, input_fired_time: 0.0613243803, output_fired_time: 0.0000000000, propagate_forward_time: 4.8613028526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3526444435
validation[          , genome  2508] predictions:    9305/  10000 (93.05%), best:    9497/10000 (94.97%), error:      2338.68335, best error:      1693.74744 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 48.8477935791s, input_fired_time: 0.4641210735, output_fired_time: 0.3206896186, propagate_forward_time: 19.2534103394, propagate_backward_time: 27.1614952087, weight_update_time: 0.0725175291, other_time: 1.6480751038
epoch time: 3.8214614391s, input_fired_time: 0.0469759814, output_fired_time: 0.0000000000, propagate_forward_time: 3.5047333241, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2697520256
validation[          , genome  2508] predictions:    9488/  10000 (94.88%), best:    9497/10000 (94.97%), error:      1715.16980, best error:      1693.74744 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 51.0517807007s, input_fired_time: 0.4822286367, output_fired_time: 0.3294656575, propagate_forward_time: 20.2077331543, propagate_backward_time: 28.2964076996, weight_update_time: 0.0758008063, other_time: 1.7359485626
epoch time: 3.9099705219s, input_fired_time: 0.0503814779, output_fired_time: 0.0000000000, propagate_forward_time: 3.5757932663, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2837958336
validation[          , genome  2508] predictions:    9514/  10000 (95.14%), best:    9497/10000 (94.97%), error:      1733.82263, best error:      1693.74744 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 50.1751403809s, input_fired_time: 0.4735619426, output_fired_time: 0.3251936436, propagate_forward_time: 19.9024314880, propagate_backward_time: 27.7895393372, weight_update_time: 0.0742618069, other_time: 1.6844139099
epoch time: 3.8198242188s, input_fired_time: 0.0498592257, output_fired_time: 0.0000000000, propagate_forward_time: 3.4906353951, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2793295383
validation[          , genome  2508] predictions:    9526/  10000 (95.26%), best:    9526/10000 (95.26%), error:      1636.80225, best error:      1636.80225 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 46.5399360657s, input_fired_time: 0.4574285448, output_fired_time: 0.3049557507, propagate_forward_time: 18.2847194672, propagate_backward_time: 25.8649578094, weight_update_time: 0.0705678612, other_time: 1.6278762817
epoch time: 3.7848076820s, input_fired_time: 0.0481192358, output_fired_time: 0.0000000000, propagate_forward_time: 3.4667351246, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2699532509
validation[          , genome  2508] predictions:    9430/  10000 (94.30%), best:    9526/10000 (95.26%), error:      1897.24255, best error:      1636.80225 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 57.6986808777s, input_fired_time: 0.5190539956, output_fired_time: 0.3650270104, propagate_forward_time: 22.9964790344, propagate_backward_time: 31.9002609253, weight_update_time: 0.0850217640, other_time: 1.9178581238
epoch time: 4.9344868660s, input_fired_time: 0.0584598407, output_fired_time: 0.0000000000, propagate_forward_time: 4.5437331200, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3322939873
validation[          , genome  2508] predictions:    9492/  10000 (94.92%), best:    9526/10000 (95.26%), error:      1693.51428, best error:      1636.80225 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 51.0254211426s, input_fired_time: 0.4861622155, output_fired_time: 0.3302149177, propagate_forward_time: 20.1711997986, propagate_backward_time: 28.2613029480, weight_update_time: 0.0763156191, other_time: 1.7765388489
epoch time: 3.8488106728s, input_fired_time: 0.0489189103, output_fired_time: 0.0000000000, propagate_forward_time: 3.5240099430, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2758817673
validation[          , genome  2508] predictions:    9523/  10000 (95.23%), best:    9523/10000 (95.23%), error:      1594.32117, best error:      1594.32117 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 50.0798683167s, input_fired_time: 0.4806780815, output_fired_time: 0.3235094547, propagate_forward_time: 19.8595676422, propagate_backward_time: 27.7098350525, weight_update_time: 0.0746948272, other_time: 1.7062778473
epoch time: 5.5552687645s, input_fired_time: 0.0649736002, output_fired_time: 0.0000000000, propagate_forward_time: 5.1268758774, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3634190559
validation[          , genome  2508] predictions:    9486/  10000 (94.86%), best:    9523/10000 (95.23%), error:      1690.90076, best error:      1594.32117 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 53.1996803284s, input_fired_time: 0.5018076301, output_fired_time: 0.3421704769, propagate_forward_time: 21.1373348236, propagate_backward_time: 29.3677253723, weight_update_time: 0.0800863579, other_time: 1.8506412506
epoch time: 3.8746931553s, input_fired_time: 0.0499783680, output_fired_time: 0.0000000000, propagate_forward_time: 3.5433564186, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2813584805
validation[          , genome  2508] predictions:    9471/  10000 (94.71%), best:    9523/10000 (95.23%), error:      1793.15051, best error:      1594.32117 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 48.7932739258s, input_fired_time: 0.4667970836, output_fired_time: 0.3164651096, propagate_forward_time: 19.2495727539, propagate_backward_time: 27.1075382233, weight_update_time: 0.0735114217, other_time: 1.6529026031
epoch time: 4.1691236496s, input_fired_time: 0.0516202934, output_fired_time: 0.0000000000, propagate_forward_time: 3.8309442997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2865588665
validation[          , genome  2508] predictions:    9422/  10000 (94.22%), best:    9523/10000 (95.23%), error:      1923.88635, best error:      1594.32117 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 51.9767532349s, input_fired_time: 0.4893655777, output_fired_time: 0.3354231715, propagate_forward_time: 20.5354213715, propagate_backward_time: 28.8274059296, weight_update_time: 0.0775640234, other_time: 1.7891387939
epoch time: 4.9413833618s, input_fired_time: 0.0624816380, output_fired_time: 0.0000000000, propagate_forward_time: 4.5376687050, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3412332535
validation[          , genome  2508] predictions:    9517/  10000 (95.17%), best:    9523/10000 (95.23%), error:      1680.19739, best error:      1594.32117 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 56.2113723755s, input_fired_time: 0.5111134648, output_fired_time: 0.3572113812, propagate_forward_time: 22.3969612122, propagate_backward_time: 31.0948982239, weight_update_time: 0.0828148201, other_time: 1.8511886597
epoch time: 4.0739011765s, input_fired_time: 0.0511771441, output_fired_time: 0.0000000000, propagate_forward_time: 3.7377033234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2850208282
validation[          , genome  2508] predictions:    9540/  10000 (95.40%), best:    9523/10000 (95.23%), error:      1605.33850, best error:      1594.32117 on epoch:    24, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 48.7160568237s, input_fired_time: 0.4687142372, output_fired_time: 0.3162748516, propagate_forward_time: 19.1994915009, propagate_backward_time: 27.1049118042, weight_update_time: 0.0723237395, other_time: 1.6266613007
epoch time: 4.1318731308s, input_fired_time: 0.0508092791, output_fired_time: 0.0000000000, propagate_forward_time: 3.7947854996, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2862782478
validation[          , genome  2508] predictions:    9500/  10000 (95.00%), best:    9523/10000 (95.23%), error:      1641.32520, best error:      1594.32117 on epoch:    24, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 48.2189178467s, input_fired_time: 0.4655916691, output_fired_time: 0.3148711026, propagate_forward_time: 19.0263099670, propagate_backward_time: 26.7966499329, weight_update_time: 0.0717656687, other_time: 1.6154937744
epoch time: 4.1873254776s, input_fired_time: 0.0516814850, output_fired_time: 0.0000000000, propagate_forward_time: 3.8440945148, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2915494442
validation[          , genome  2508] predictions:    9528/  10000 (95.28%), best:    9523/10000 (95.23%), error:      1599.28955, best error:      1594.32117 on epoch:    24, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 51.9997978210s, input_fired_time: 0.4915212095, output_fired_time: 0.3334936798, propagate_forward_time: 20.6312198639, propagate_backward_time: 28.7618598938, weight_update_time: 0.0774942413, other_time: 1.7817058563
epoch time: 5.4220261574s, input_fired_time: 0.0634576455, output_fired_time: 0.0000000000, propagate_forward_time: 5.0010023117, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3575663567
validation[          , genome  2508] predictions:    9471/  10000 (94.71%), best:    9523/10000 (95.23%), error:      1712.74341, best error:      1594.32117 on epoch:    24, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 45.6440963745s, input_fired_time: 0.4607158601, output_fired_time: 0.2985352576, propagate_forward_time: 17.9502944946, propagate_backward_time: 25.3130474091, weight_update_time: 0.0691701025, other_time: 1.6215038300
epoch time: 3.7308623791s, input_fired_time: 0.0506122708, output_fired_time: 0.0000000000, propagate_forward_time: 3.3938615322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2863886356
validation[          , genome  2508] predictions:    9529/  10000 (95.29%), best:    9529/10000 (95.29%), error:      1572.50378, best error:      1572.50378 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 54.8953666687s, input_fired_time: 0.5051443577, output_fired_time: 0.3492767215, propagate_forward_time: 21.8068008423, propagate_backward_time: 30.3865776062, weight_update_time: 0.0809441954, other_time: 1.8475646973
epoch time: 5.3436431885s, input_fired_time: 0.0647586957, output_fired_time: 0.0000000000, propagate_forward_time: 4.9192519188, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3596324921
validation[          , genome  2508] predictions:    9513/  10000 (95.13%), best:    9529/10000 (95.29%), error:      1637.62354, best error:      1572.50378 on epoch:    33, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 58.1107902527s, input_fired_time: 0.5277539492, output_fired_time: 0.3673383594, propagate_forward_time: 23.1615257263, propagate_backward_time: 32.0747413635, weight_update_time: 0.0857956037, other_time: 1.9794273376
epoch time: 5.4297294617s, input_fired_time: 0.0646089539, output_fired_time: 0.0000000000, propagate_forward_time: 5.0016393661, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3634810448
validation[          , genome  2508] predictions:    9497/  10000 (94.97%), best:    9529/10000 (95.29%), error:      1650.26794, best error:      1572.50378 on epoch:    33, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 58.6514129639s, input_fired_time: 0.5281519294, output_fired_time: 0.3699023724, propagate_forward_time: 23.3299961090, propagate_backward_time: 32.4108772278, weight_update_time: 0.0863864794, other_time: 2.0124855042
epoch time: 4.9719023705s, input_fired_time: 0.0594779663, output_fired_time: 0.0000000000, propagate_forward_time: 4.5680956841, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3443288803
validation[          , genome  2508] predictions:    9447/  10000 (94.47%), best:    9529/10000 (95.29%), error:      1815.02527, best error:      1572.50378 on epoch:    33, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 60.7777099609s, input_fired_time: 0.5418845415, output_fired_time: 0.3822823167, propagate_forward_time: 24.2491550446, propagate_backward_time: 33.5316429138, weight_update_time: 0.0890077874, other_time: 2.0727424622
epoch time: 5.4888854027s, input_fired_time: 0.0656868890, output_fired_time: 0.0000000000, propagate_forward_time: 5.0486083031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3745903969
validation[          , genome  2508] predictions:    9545/  10000 (95.45%), best:    9529/10000 (95.29%), error:      1605.23438, best error:      1572.50378 on epoch:    33, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 58.7096023560s, input_fired_time: 0.5309417844, output_fired_time: 0.3708316088, propagate_forward_time: 23.3835926056, propagate_backward_time: 32.3971557617, weight_update_time: 0.0867609233, other_time: 2.0270843506
epoch time: 4.7727346420s, input_fired_time: 0.0666207373, output_fired_time: 0.0000000000, propagate_forward_time: 4.3749837875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3311300278
validation[          , genome  2508] predictions:    9502/  10000 (95.02%), best:    9529/10000 (95.29%), error:      1691.34290, best error:      1572.50378 on epoch:    33, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 58.6186714172s, input_fired_time: 0.5304945111, output_fired_time: 0.3691879213, propagate_forward_time: 23.4011573792, propagate_backward_time: 32.3463211060, weight_update_time: 0.0862579569, other_time: 1.9715118408
epoch time: 4.5900382996s, input_fired_time: 0.0556138493, output_fired_time: 0.0000000000, propagate_forward_time: 4.2217330933, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3126912117
validation[          , genome  2508] predictions:    9540/  10000 (95.40%), best:    9540/10000 (95.40%), error:      1568.61682, best error:      1568.61682 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 52.7887954712s, input_fired_time: 0.4979446530, output_fired_time: 0.3389456272, propagate_forward_time: 20.9326839447, propagate_backward_time: 29.2293109894, weight_update_time: 0.0782964751, other_time: 1.7899093628
epoch time: 4.2697873116s, input_fired_time: 0.0529425070, output_fired_time: 0.0000000000, propagate_forward_time: 3.9218144417, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2950305939
validation[          , genome  2508] predictions:    9474/  10000 (94.74%), best:    9540/10000 (95.40%), error:      1730.97119, best error:      1568.61682 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 54.4966354370s, input_fired_time: 0.5048135519, output_fired_time: 0.3473757803, propagate_forward_time: 21.6630725861, propagate_backward_time: 30.1554775238, weight_update_time: 0.0806818753, other_time: 1.8258972168
epoch time: 5.4190316200s, input_fired_time: 0.0648922548, output_fired_time: 0.0000000000, propagate_forward_time: 4.9902620316, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3638772964
validation[          , genome  2508] predictions:    9522/  10000 (95.22%), best:    9540/10000 (95.40%), error:      1615.73730, best error:      1568.61682 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 60.3944969177s, input_fired_time: 0.5390009880, output_fired_time: 0.3825015128, propagate_forward_time: 24.1180839539, propagate_backward_time: 33.3570060730, weight_update_time: 0.0886979699, other_time: 1.9979057312
epoch time: 5.4385347366s, input_fired_time: 0.0644602403, output_fired_time: 0.0000000000, propagate_forward_time: 5.0142793655, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3597950935
validation[          , genome  2508] predictions:    9446/  10000 (94.46%), best:    9540/10000 (95.40%), error:      1839.01135, best error:      1568.61682 on epoch:    39, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 53.4133224487s, input_fired_time: 0.4987198710, output_fired_time: 0.3426730633, propagate_forward_time: 21.1643276215, propagate_backward_time: 29.6030426025, weight_update_time: 0.0795202702, other_time: 1.8045597076
epoch time: 3.8353383541s, input_fired_time: 0.0486853309, output_fired_time: 0.0000000000, propagate_forward_time: 3.5149507523, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2717022896
validation[          , genome  2508] predictions:    9525/  10000 (95.25%), best:    9525/10000 (95.25%), error:      1565.37292, best error:      1565.37292 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 47.0765724182s, input_fired_time: 0.4638528824, output_fired_time: 0.3073956370, propagate_forward_time: 18.5387477875, propagate_backward_time: 26.1390323639, weight_update_time: 0.0708477572, other_time: 1.6275444031
epoch time: 4.1672692299s, input_fired_time: 0.0523956940, output_fired_time: 0.0000000000, propagate_forward_time: 3.8258581161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2890152931
validation[          , genome  2508] predictions:    9529/  10000 (95.29%), best:    9525/10000 (95.25%), error:      1586.73108, best error:      1565.37292 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 57.1777114868s, input_fired_time: 0.5219563246, output_fired_time: 0.3629241288, propagate_forward_time: 22.7959117889, propagate_backward_time: 31.6257534027, weight_update_time: 0.0840901360, other_time: 1.8711643219
epoch time: 4.1795387268s, input_fired_time: 0.0530633293, output_fired_time: 0.0000000000, propagate_forward_time: 3.8332717419, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2932035923
validation[          , genome  2508] predictions:    9479/  10000 (94.79%), best:    9525/10000 (95.25%), error:      1681.92175, best error:      1565.37292 on epoch:    43, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 52.1994590759s, input_fired_time: 0.4950622320, output_fired_time: 0.3363000751, propagate_forward_time: 20.6667690277, propagate_backward_time: 28.9394149780, weight_update_time: 0.0780190155, other_time: 1.7619113922
epoch time: 4.1747465134s, input_fired_time: 0.0533660688, output_fired_time: 0.0000000000, propagate_forward_time: 3.8356802464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2857000828
validation[          , genome  2508] predictions:    9516/  10000 (95.16%), best:    9525/10000 (95.25%), error:      1606.07666, best error:      1565.37292 on epoch:    43, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 61.5117378235s, input_fired_time: 0.5459102392, output_fired_time: 0.3854879737, propagate_forward_time: 24.5930480957, propagate_backward_time: 33.9575424194, weight_update_time: 0.0903891847, other_time: 2.0297508240
epoch time: 5.5476155281s, input_fired_time: 0.0665202513, output_fired_time: 0.0000000000, propagate_forward_time: 5.1108465195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3702487946
validation[          , genome  2508] predictions:    9539/  10000 (95.39%), best:    9539/10000 (95.39%), error:      1547.39172, best error:      1547.39172 on epoch:    47, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 47.1819381714s, input_fired_time: 0.4683135152, output_fired_time: 0.3082451224, propagate_forward_time: 18.5634708405, propagate_backward_time: 26.1647834778, weight_update_time: 0.0706125200, other_time: 1.6771221161
epoch time: 3.7471711636s, input_fired_time: 0.0486756526, output_fired_time: 0.0000000000, propagate_forward_time: 3.4331986904, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2652969360
validation[          , genome  2508] predictions:    9553/  10000 (95.53%), best:    9553/10000 (95.53%), error:      1525.99731, best error:      1525.99731 on epoch:    48, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 48.0014152527s, input_fired_time: 0.4734816849, output_fired_time: 0.3131462932, propagate_forward_time: 18.9545688629, propagate_backward_time: 26.5815773010, weight_update_time: 0.0720636621, other_time: 1.6786441803
epoch time: 3.8605101109s, input_fired_time: 0.0518639237, output_fired_time: 0.0000000000, propagate_forward_time: 3.5254304409, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2832157612
validation[          , genome  2508] predictions:    9551/  10000 (95.51%), best:    9553/10000 (95.53%), error:      1573.12695, best error:      1525.99731 on epoch:    48, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 56.7730865479s, input_fired_time: 0.5185769200, output_fired_time: 0.3615444005, propagate_forward_time: 22.5845260620, propagate_backward_time: 31.4394493103, weight_update_time: 0.0833218917, other_time: 1.8689880371
epoch time: 5.5618610382s, input_fired_time: 0.0681444108, output_fired_time: 0.0000000000, propagate_forward_time: 5.1152806282, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3784360886
validation[          , genome  2508] predictions:    9568/  10000 (95.68%), best:    9568/10000 (95.68%), error:      1498.15747, best error:      1498.15747 on epoch:    50, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 51.7265205383s, input_fired_time: 0.4856818914, output_fired_time: 0.3330377936, propagate_forward_time: 20.4853000641, propagate_backward_time: 28.7219772339, weight_update_time: 0.0761346519, other_time: 1.7005214691
epoch time: 4.0376963615s, input_fired_time: 0.0513162054, output_fired_time: 0.0000000000, propagate_forward_time: 3.7045056820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2818744183
validation[          , genome  2508] predictions:    9499/  10000 (94.99%), best:    9568/10000 (95.68%), error:      1700.54932, best error:      1498.15747 on epoch:    50, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 49.0231971741s, input_fired_time: 0.4706614614, output_fired_time: 0.3178309798, propagate_forward_time: 19.4012222290, propagate_backward_time: 27.2099304199, weight_update_time: 0.0724996775, other_time: 1.6235542297
epoch time: 4.1361708641s, input_fired_time: 0.0518155396, output_fired_time: 0.0000000000, propagate_forward_time: 3.7955091000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2888462543
validation[          , genome  2508] predictions:    9540/  10000 (95.40%), best:    9568/10000 (95.68%), error:      1569.15527, best error:      1498.15747 on epoch:    50, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 49.0583724976s, input_fired_time: 0.4721926749, output_fired_time: 0.3175792098, propagate_forward_time: 19.4095764160, propagate_backward_time: 27.2205486298, weight_update_time: 0.0732157230, other_time: 1.6384792328
epoch time: 4.1727519035s, input_fired_time: 0.0534446873, output_fired_time: 0.0000000000, propagate_forward_time: 3.8281576633, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2911493778
validation[          , genome  2508] predictions:    9543/  10000 (95.43%), best:    9568/10000 (95.68%), error:      1557.33594, best error:      1498.15747 on epoch:    50, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 49.0425682068s, input_fired_time: 0.4787110388, output_fired_time: 0.3158870935, propagate_forward_time: 19.3430881500, propagate_backward_time: 27.2070560455, weight_update_time: 0.0737513453, other_time: 1.6978263855
epoch time: 3.8473572731s, input_fired_time: 0.0497411937, output_fired_time: 0.0000000000, propagate_forward_time: 3.5265004635, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2711155415
validation[          , genome  2508] predictions:    9543/  10000 (95.43%), best:    9568/10000 (95.68%), error:      1552.45129, best error:      1498.15747 on epoch:    50, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 52.6206474304s, input_fired_time: 0.4960944653, output_fired_time: 0.3364210129, propagate_forward_time: 20.8780021667, propagate_backward_time: 29.1475276947, weight_update_time: 0.0772837624, other_time: 1.7626018524
epoch time: 4.6610236168s, input_fired_time: 0.0562318526, output_fired_time: 0.0000000000, propagate_forward_time: 4.2929048538, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3118867874
validation[          , genome  2508] predictions:    9559/  10000 (95.59%), best:    9568/10000 (95.68%), error:      1514.86084, best error:      1498.15747 on epoch:    50, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 61.1093063354s, input_fired_time: 0.5455450416, output_fired_time: 0.3810409606, propagate_forward_time: 24.4552726746, propagate_backward_time: 33.7488098145, weight_update_time: 0.0868028700, other_time: 1.9786376953
epoch time: 3.7948069572s, input_fired_time: 0.0501507930, output_fired_time: 0.0000000000, propagate_forward_time: 3.4764547348, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2682013512
validation[          , genome  2508] predictions:    9517/  10000 (95.17%), best:    9568/10000 (95.68%), error:      1612.14856, best error:      1498.15747 on epoch:    50, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 58.5743560791s, input_fired_time: 0.5476768613, output_fired_time: 0.3664436042, propagate_forward_time: 23.3683986664, propagate_backward_time: 32.3546409607, weight_update_time: 0.0845993459, other_time: 1.9371986389
epoch time: 4.4390006065s, input_fired_time: 0.0558415055, output_fired_time: 0.0000000000, propagate_forward_time: 4.0764155388, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3067436218
validation[          , genome  2508] predictions:    9515/  10000 (95.15%), best:    9568/10000 (95.68%), error:      1633.55029, best error:      1498.15747 on epoch:    50, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 58.8845405579s, input_fired_time: 0.5399575830, output_fired_time: 0.3689495921, propagate_forward_time: 23.4956932068, propagate_backward_time: 32.5313644409, weight_update_time: 0.0851727128, other_time: 1.9485740662
epoch time: 5.4861164093s, input_fired_time: 0.0664772466, output_fired_time: 0.0000000000, propagate_forward_time: 5.0518660545, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3677730560
validation[          , genome  2508] predictions:    9529/  10000 (95.29%), best:    9568/10000 (95.68%), error:      1578.38831, best error:      1498.15747 on epoch:    50, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 53.4828109741s, input_fired_time: 0.5118182302, output_fired_time: 0.3403242528, propagate_forward_time: 21.2279796600, propagate_backward_time: 29.5980606079, weight_update_time: 0.0786238164, other_time: 1.8046283722
epoch time: 4.4204854965s, input_fired_time: 0.0560545586, output_fired_time: 0.0000000000, propagate_forward_time: 4.0582494736, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3061814308
validation[          , genome  2508] predictions:    9535/  10000 (95.35%), best:    9568/10000 (95.68%), error:      1538.36841, best error:      1498.15747 on epoch:    50, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 50.7136421204s, input_fired_time: 0.4958239794, output_fired_time: 0.3250773847, propagate_forward_time: 20.0975379944, propagate_backward_time: 28.0596466064, weight_update_time: 0.0765637308, other_time: 1.7355575562
epoch time: 4.0402913094s, input_fired_time: 0.0509774275, output_fired_time: 0.0000000000, propagate_forward_time: 3.7055444717, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2837693691
validation[          , genome  2508] predictions:    9490/  10000 (94.90%), best:    9568/10000 (95.68%), error:      1679.96692, best error:      1498.15747 on epoch:    50, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 58.4751472473s, input_fired_time: 0.5371592045, output_fired_time: 0.3659690917, propagate_forward_time: 23.3962783813, propagate_backward_time: 32.2548942566, weight_update_time: 0.0838571340, other_time: 1.9208450317
epoch time: 3.6174542904s, input_fired_time: 0.0481642075, output_fired_time: 0.0000000000, propagate_forward_time: 3.3101725578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2591176033
validation[          , genome  2508] predictions:    9459/  10000 (94.59%), best:    9568/10000 (95.68%), error:      1780.58862, best error:      1498.15747 on epoch:    50, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 45.1643409729s, input_fired_time: 0.4649360776, output_fired_time: 0.2993695736, propagate_forward_time: 17.7834053040, propagate_backward_time: 25.0524768829, weight_update_time: 0.0682508498, other_time: 1.5641536713
epoch time: 3.8715023994s, input_fired_time: 0.0521247014, output_fired_time: 0.0000000000, propagate_forward_time: 3.5387625694, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2806150913
validation[          , genome  2508] predictions:    9552/  10000 (95.52%), best:    9552/10000 (95.52%), error:      1491.38330, best error:      1491.38330 on epoch:    62, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 44.8767013550s, input_fired_time: 0.4610660076, output_fired_time: 0.2965795398, propagate_forward_time: 17.6445808411, propagate_backward_time: 24.9070396423, weight_update_time: 0.0681544244, other_time: 1.5674324036
epoch time: 3.6636347771s, input_fired_time: 0.0485874899, output_fired_time: 0.0000000000, propagate_forward_time: 3.3538639545, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2611832619
validation[          , genome  2508] predictions:    9502/  10000 (95.02%), best:    9552/10000 (95.52%), error:      1637.71545, best error:      1491.38330 on epoch:    62, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 45.9781150818s, input_fired_time: 0.4716676772, output_fired_time: 0.3006456196, propagate_forward_time: 18.1417160034, propagate_backward_time: 25.4494915009, weight_update_time: 0.0699962974, other_time: 1.6145954132
epoch time: 5.5434823036s, input_fired_time: 0.0669039264, output_fired_time: 0.0000000000, propagate_forward_time: 5.1072988510, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3692793846
validation[          , genome  2508] predictions:    9565/  10000 (95.65%), best:    9552/10000 (95.52%), error:      1521.68982, best error:      1491.38330 on epoch:    62, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 48.4071273804s, input_fired_time: 0.4836658537, output_fired_time: 0.3137299120, propagate_forward_time: 19.0998821259, propagate_backward_time: 26.8507118225, weight_update_time: 0.0726926476, other_time: 1.6591396332
epoch time: 5.5500054359s, input_fired_time: 0.0658026114, output_fired_time: 0.0000000000, propagate_forward_time: 5.1177434921, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3664593697
validation[          , genome  2508] predictions:    9534/  10000 (95.34%), best:    9552/10000 (95.52%), error:      1550.13965, best error:      1491.38330 on epoch:    62, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 49.0101814270s, input_fired_time: 0.4831474423, output_fired_time: 0.3155907393, propagate_forward_time: 19.3850097656, propagate_backward_time: 27.1637401581, weight_update_time: 0.0724056959, other_time: 1.6626949310
epoch time: 4.2392330170s, input_fired_time: 0.0530048758, output_fired_time: 0.0000000000, propagate_forward_time: 3.8944959641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2917323112
validation[          , genome  2508] predictions:    9557/  10000 (95.57%), best:    9552/10000 (95.52%), error:      1494.34143, best error:      1491.38330 on epoch:    62, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 48.4872856140s, input_fired_time: 0.4851491451, output_fired_time: 0.3135022521, propagate_forward_time: 19.1065883636, propagate_backward_time: 26.9125041962, weight_update_time: 0.0724697560, other_time: 1.6695404053
epoch time: 3.7529408932s, input_fired_time: 0.0494902655, output_fired_time: 0.0000000000, propagate_forward_time: 3.4366822243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2667684555
validation[          , genome  2508] predictions:    9531/  10000 (95.31%), best:    9552/10000 (95.52%), error:      1531.58862, best error:      1491.38330 on epoch:    62, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 48.2380867004s, input_fired_time: 0.4846308827, output_fired_time: 0.3130996823, propagate_forward_time: 19.0063076019, propagate_backward_time: 26.7532672882, weight_update_time: 0.0727712959, other_time: 1.6807823181
epoch time: 3.8967425823s, input_fired_time: 0.0516866297, output_fired_time: 0.0000000000, propagate_forward_time: 3.5696437359, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2754123211
validation[          , genome  2508] predictions:    9493/  10000 (94.93%), best:    9552/10000 (95.52%), error:      1649.60107, best error:      1491.38330 on epoch:    62, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 56.8959236145s, input_fired_time: 0.5270216465, output_fired_time: 0.3588042855, propagate_forward_time: 22.6828460693, propagate_backward_time: 31.4960708618, weight_update_time: 0.0813437030, other_time: 1.8311805725
epoch time: 5.5580029488s, input_fired_time: 0.0647358298, output_fired_time: 0.0000000000, propagate_forward_time: 5.1303615570, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3629055023
validation[          , genome  2508] predictions:    9541/  10000 (95.41%), best:    9552/10000 (95.52%), error:      1524.29822, best error:      1491.38330 on epoch:    62, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 51.3800430298s, input_fired_time: 0.5009860396, output_fired_time: 0.3275476098, propagate_forward_time: 20.3322601318, propagate_backward_time: 28.4827613831, weight_update_time: 0.0763647035, other_time: 1.7364883423
epoch time: 3.8307769299s, input_fired_time: 0.0503498800, output_fired_time: 0.0000000000, propagate_forward_time: 3.5102019310, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2702250481
validation[          , genome  2508] predictions:    9520/  10000 (95.20%), best:    9552/10000 (95.52%), error:      1622.86450, best error:      1491.38330 on epoch:    62, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 47.5924491882s, input_fired_time: 0.4786305726, output_fired_time: 0.3125477135, propagate_forward_time: 18.7976036072, propagate_backward_time: 26.3665199280, weight_update_time: 0.0713843182, other_time: 1.6371459961
epoch time: 4.2000613213s, input_fired_time: 0.0526995622, output_fired_time: 0.0000000000, propagate_forward_time: 3.8590490818, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2883126736
validation[          , genome  2508] predictions:    9520/  10000 (95.20%), best:    9552/10000 (95.52%), error:      1645.91052, best error:      1491.38330 on epoch:    62, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 48.1084251404s, input_fired_time: 0.4727559686, output_fired_time: 0.3106201291, propagate_forward_time: 19.1016139984, propagate_backward_time: 26.6372890472, weight_update_time: 0.0693576485, other_time: 1.5861473083
epoch time: 4.1780071259s, input_fired_time: 0.0523334891, output_fired_time: 0.0000000000, propagate_forward_time: 3.8395514488, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2861223221
validation[          , genome  2508] predictions:    9517/  10000 (95.17%), best:    9552/10000 (95.52%), error:      1593.13403, best error:      1491.38330 on epoch:    62, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 52.5536346436s, input_fired_time: 0.4980855584, output_fired_time: 0.3360694647, propagate_forward_time: 20.8747291565, propagate_backward_time: 29.1436901093, weight_update_time: 0.0751611590, other_time: 1.7010593414
epoch time: 5.5358929634s, input_fired_time: 0.0652840436, output_fired_time: 0.0000000000, propagate_forward_time: 5.1095142365, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3610944748
validation[          , genome  2508] predictions:    9554/  10000 (95.54%), best:    9552/10000 (95.52%), error:      1506.20496, best error:      1491.38330 on epoch:    62, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 50.4157257080s, input_fired_time: 0.4889235198, output_fired_time: 0.3228393793, propagate_forward_time: 19.9600524902, propagate_backward_time: 27.9932174683, weight_update_time: 0.0723055899, other_time: 1.6506958008
epoch time: 4.1568312645s, input_fired_time: 0.0529707298, output_fired_time: 0.0000000000, propagate_forward_time: 3.8192858696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2845745087
validation[          , genome  2508] predictions:    9520/  10000 (95.20%), best:    9552/10000 (95.52%), error:      1564.95312, best error:      1491.38330 on epoch:    62, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 52.4053840637s, input_fired_time: 0.5026979446, output_fired_time: 0.3351108730, propagate_forward_time: 20.7815341949, propagate_backward_time: 29.0591430664, weight_update_time: 0.0760073215, other_time: 1.7269001007
epoch time: 4.2589130402s, input_fired_time: 0.0545521863, output_fired_time: 0.0000000000, propagate_forward_time: 3.9120779037, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2922830582
validation[          , genome  2508] predictions:    9531/  10000 (95.31%), best:    9552/10000 (95.52%), error:      1606.16174, best error:      1491.38330 on epoch:    62, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 50.5949859619s, input_fired_time: 0.4874083102, output_fired_time: 0.3252535462, propagate_forward_time: 20.0579872131, propagate_backward_time: 28.0689983368, weight_update_time: 0.0727644265, other_time: 1.6553401947
epoch time: 5.3302650452s, input_fired_time: 0.0634458885, output_fired_time: 0.0000000000, propagate_forward_time: 4.9153084755, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3515105247
validation[          , genome  2508] predictions:    9535/  10000 (95.35%), best:    9552/10000 (95.52%), error:      1554.12756, best error:      1491.38330 on epoch:    62, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 51.2734107971s, input_fired_time: 0.5040802956, output_fired_time: 0.3292238116, propagate_forward_time: 20.2691383362, propagate_backward_time: 28.4122676849, weight_update_time: 0.0759785026, other_time: 1.7586994171
epoch time: 3.9395322800s, input_fired_time: 0.0521729812, output_fired_time: 0.0000000000, propagate_forward_time: 3.6076982021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2796611786
validation[          , genome  2508] predictions:    9512/  10000 (95.12%), best:    9552/10000 (95.52%), error:      1602.73218, best error:      1491.38330 on epoch:    62, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 51.1801452637s, input_fired_time: 0.4996576011, output_fired_time: 0.3288198113, propagate_forward_time: 20.3032512665, propagate_backward_time: 28.3089694977, weight_update_time: 0.0753607899, other_time: 1.7394485474
epoch time: 4.5074615479s, input_fired_time: 0.0583908930, output_fired_time: 0.0000000000, propagate_forward_time: 4.1288504601, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3202199936
validation[          , genome  2508] predictions:    9514/  10000 (95.14%), best:    9552/10000 (95.52%), error:      1602.44324, best error:      1491.38330 on epoch:    62, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 52.5855827332s, input_fired_time: 0.5082948208, output_fired_time: 0.3359664977, propagate_forward_time: 20.8445453644, propagate_backward_time: 29.0807056427, weight_update_time: 0.0777199343, other_time: 1.8160705566
epoch time: 3.7754979134s, input_fired_time: 0.0530540459, output_fired_time: 0.0000000000, propagate_forward_time: 3.4405019283, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2819418907
validation[          , genome  2508] predictions:    9488/  10000 (94.88%), best:    9552/10000 (95.52%), error:      1668.13879, best error:      1491.38330 on epoch:    62, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 51.4706916809s, input_fired_time: 0.5074057579, output_fired_time: 0.3293851018, propagate_forward_time: 20.3548412323, propagate_backward_time: 28.4815483093, weight_update_time: 0.0761417598, other_time: 1.7975139618
epoch time: 5.1085371971s, input_fired_time: 0.0645150691, output_fired_time: 0.0000000000, propagate_forward_time: 4.6964912415, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3475308418
validation[          , genome  2508] predictions:    9511/  10000 (95.11%), best:    9552/10000 (95.52%), error:      1712.23633, best error:      1491.38330 on epoch:    62, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 47.9467048645s, input_fired_time: 0.4853287339, output_fired_time: 0.3224941790, propagate_forward_time: 18.8914928436, propagate_backward_time: 26.5682392120, weight_update_time: 0.0723979324, other_time: 1.6791496277
epoch time: 4.5907664299s, input_fired_time: 0.0584460311, output_fired_time: 0.0000000000, propagate_forward_time: 4.2070517540, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3252687454
validation[          , genome  2508] predictions:    9535/  10000 (95.35%), best:    9552/10000 (95.52%), error:      1533.51562, best error:      1491.38330 on epoch:    62, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 51.1312980652s, input_fired_time: 0.5073148012, output_fired_time: 0.3276594877, propagate_forward_time: 20.2400455475, propagate_backward_time: 28.2804031372, weight_update_time: 0.0758476555, other_time: 1.7758731842
epoch time: 4.4105997086s, input_fired_time: 0.0566630289, output_fired_time: 0.0000000000, propagate_forward_time: 4.0484910011, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3054456711
validation[          , genome  2508] predictions:    9559/  10000 (95.59%), best:    9552/10000 (95.52%), error:      1535.86353, best error:      1491.38330 on epoch:    62, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 46.4442634583s, input_fired_time: 0.4784301519, output_fired_time: 0.3041547537, propagate_forward_time: 18.2670078278, propagate_backward_time: 25.7634124756, weight_update_time: 0.0703492314, other_time: 1.6312580109
epoch time: 3.8316187859s, input_fired_time: 0.0527738631, output_fired_time: 0.0000000000, propagate_forward_time: 3.5064229965, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2724218369
validation[          , genome  2508] predictions:    9380/  10000 (93.80%), best:    9552/10000 (95.52%), error:      2137.44775, best error:      1491.38330 on epoch:    62, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 47.6125411987s, input_fired_time: 0.4823978543, output_fired_time: 0.3074080348, propagate_forward_time: 18.8108463287, propagate_backward_time: 26.3748245239, weight_update_time: 0.0717266798, other_time: 1.6370639801
epoch time: 3.8089771271s, input_fired_time: 0.0506105386, output_fired_time: 0.0000000000, propagate_forward_time: 3.4860444069, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2723221779
validation[          , genome  2508] predictions:    9534/  10000 (95.34%), best:    9552/10000 (95.52%), error:      1523.34106, best error:      1491.38330 on epoch:    62, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 48.4683456421s, input_fired_time: 0.4910522401, output_fired_time: 0.3136361837, propagate_forward_time: 19.1714534760, propagate_backward_time: 26.7851848602, weight_update_time: 0.0727715269, other_time: 1.7070198059
epoch time: 3.8539075851s, input_fired_time: 0.0516143553, output_fired_time: 0.0000000000, propagate_forward_time: 3.5358133316, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2664799690
validation[          , genome  2508] predictions:    9546/  10000 (95.46%), best:    9552/10000 (95.52%), error:      1570.76880, best error:      1491.38330 on epoch:    62, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 44.9578323364s, input_fired_time: 0.4707514942, output_fired_time: 0.2979657352, propagate_forward_time: 17.6026973724, propagate_backward_time: 25.0006561279, weight_update_time: 0.0679938793, other_time: 1.5857601166
epoch time: 3.7587366104s, input_fired_time: 0.0505320020, output_fired_time: 0.0000000000, propagate_forward_time: 3.4436817169, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2645227909
validation[          , genome  2508] predictions:    9539/  10000 (95.39%), best:    9552/10000 (95.52%), error:      1550.13989, best error:      1491.38330 on epoch:    62, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 48.2053108215s, input_fired_time: 0.4859643579, output_fired_time: 0.3123484254, propagate_forward_time: 18.9809207916, propagate_backward_time: 26.7656631470, weight_update_time: 0.0725497752, other_time: 1.6604137421
epoch time: 3.9098429680s, input_fired_time: 0.0540595874, output_fired_time: 0.0000000000, propagate_forward_time: 3.5757546425, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2800288200
validation[          , genome  2508] predictions:    9532/  10000 (95.32%), best:    9552/10000 (95.52%), error:      1563.88892, best error:      1491.38330 on epoch:    62, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 44.5504531860s, input_fired_time: 0.4749003351, output_fired_time: 0.2931052446, propagate_forward_time: 17.5041961670, propagate_backward_time: 24.7156105042, weight_update_time: 0.0676855594, other_time: 1.5626411438
epoch time: 3.8304564953s, input_fired_time: 0.0526225567, output_fired_time: 0.0000000000, propagate_forward_time: 3.5023827553, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2754511833
validation[          , genome  2508] predictions:    9532/  10000 (95.32%), best:    9552/10000 (95.52%), error:      1544.77490, best error:      1491.38330 on epoch:    62, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 51.1422195435s, input_fired_time: 0.5092366934, output_fired_time: 0.3269167840, propagate_forward_time: 20.2567596436, propagate_backward_time: 28.3093109131, weight_update_time: 0.0760247111, other_time: 1.7399978638
epoch time: 3.6951825619s, input_fired_time: 0.0502391234, output_fired_time: 0.0000000000, propagate_forward_time: 3.3823950291, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2625484467
validation[          , genome  2508] predictions:    9542/  10000 (95.42%), best:    9552/10000 (95.52%), error:      1560.76062, best error:      1491.38330 on epoch:    62, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 44.4196281433s, input_fired_time: 0.4630230367, output_fired_time: 0.2918155789, propagate_forward_time: 17.4383258820, propagate_backward_time: 24.6741561890, weight_update_time: 0.0672666281, other_time: 1.5523052216
epoch time: 3.8828830719s, input_fired_time: 0.0545595065, output_fired_time: 0.0000000000, propagate_forward_time: 3.5394482613, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2888753414
validation[          , genome  2508] predictions:    9546/  10000 (95.46%), best:    9552/10000 (95.52%), error:      1527.98230, best error:      1491.38330 on epoch:    62, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 53.8429946899s, input_fired_time: 0.5134789944, output_fired_time: 0.3420384824, propagate_forward_time: 21.3768005371, propagate_backward_time: 29.8532733917, weight_update_time: 0.0776475519, other_time: 1.7574062347
epoch time: 4.6550049782s, input_fired_time: 0.0591038391, output_fired_time: 0.0000000000, propagate_forward_time: 4.2833857536, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3125152588
validation[          , genome  2508] predictions:    9549/  10000 (95.49%), best:    9552/10000 (95.52%), error:      1516.75073, best error:      1491.38330 on epoch:    62, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 50.0480003357s, input_fired_time: 0.4984006286, output_fired_time: 0.3205941617, propagate_forward_time: 19.8480110168, propagate_backward_time: 27.6834163666, weight_update_time: 0.0736462846, other_time: 1.6975765228
epoch time: 3.8535904884s, input_fired_time: 0.0509990975, output_fired_time: 0.0000000000, propagate_forward_time: 3.5323417187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2702496052
validation[          , genome  2508] predictions:    9545/  10000 (95.45%), best:    9552/10000 (95.52%), error:      1497.82092, best error:      1491.38330 on epoch:    62, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 46.0446815491s, input_fired_time: 0.4757106304, output_fired_time: 0.3019777834, propagate_forward_time: 18.0824890137, propagate_backward_time: 25.5940818787, weight_update_time: 0.0690954775, other_time: 1.5904197693
epoch time: 3.7935843468s, input_fired_time: 0.0515236109, output_fired_time: 0.0000000000, propagate_forward_time: 3.4736313820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2684292793
validation[          , genome  2508] predictions:    9553/  10000 (95.53%), best:    9552/10000 (95.52%), error:      1505.01135, best error:      1491.38330 on epoch:    62, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 45.4386138916s, input_fired_time: 0.4752378762, output_fired_time: 0.2993896902, propagate_forward_time: 17.8414821625, propagate_backward_time: 25.2248382568, weight_update_time: 0.0693672821, other_time: 1.5976657867
epoch time: 3.9575171471s, input_fired_time: 0.0555836149, output_fired_time: 0.0000000000, propagate_forward_time: 3.6188757420, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2830576897
validation[          , genome  2508] predictions:    9528/  10000 (95.28%), best:    9552/10000 (95.52%), error:      1593.32874, best error:      1491.38330 on epoch:    62, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 47.8517227173s, input_fired_time: 0.4873881042, output_fired_time: 0.3102622032, propagate_forward_time: 18.8686103821, propagate_backward_time: 26.5315952301, weight_update_time: 0.0720507354, other_time: 1.6538677216
epoch time: 3.8369181156s, input_fired_time: 0.0522518232, output_fired_time: 0.0000000000, propagate_forward_time: 3.5122857094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2723805904
validation[          , genome  2508] predictions:    9549/  10000 (95.49%), best:    9552/10000 (95.52%), error:      1494.73022, best error:      1491.38330 on epoch:    62, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 46.4990158081s, input_fired_time: 0.4789749086, output_fired_time: 0.3026269376, propagate_forward_time: 18.2759132385, propagate_backward_time: 25.8014431000, weight_update_time: 0.0705263987, other_time: 1.6400585175
epoch time: 3.9112069607s, input_fired_time: 0.0528213456, output_fired_time: 0.0000000000, propagate_forward_time: 3.5798692703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2785162926
validation[          , genome  2508] predictions:    9542/  10000 (95.42%), best:    9552/10000 (95.52%), error:      1548.45496, best error:      1491.38330 on epoch:    62, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 45.6570243835s, input_fired_time: 0.4776940942, output_fired_time: 0.2987363636, propagate_forward_time: 17.9446697235, propagate_backward_time: 25.3180961609, weight_update_time: 0.0695810914, other_time: 1.6178264618
epoch time: 3.9704611301s, input_fired_time: 0.0541991405, output_fired_time: 0.0000000000, propagate_forward_time: 3.6306612492, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2856006622
validation[          , genome  2508] predictions:    9503/  10000 (95.03%), best:    9552/10000 (95.52%), error:      1639.15540, best error:      1491.38330 on epoch:    62, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 45.0325813293s, input_fired_time: 0.4734045565, output_fired_time: 0.2962103784, propagate_forward_time: 17.7173233032, propagate_backward_time: 24.9695529938, weight_update_time: 0.0684457347, other_time: 1.5760898590
epoch time: 3.9618408680s, input_fired_time: 0.0535212755, output_fired_time: 0.0000000000, propagate_forward_time: 3.6323480606, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2759714127
validation[          , genome  2508] predictions:    9506/  10000 (95.06%), best:    9552/10000 (95.52%), error:      1623.12769, best error:      1491.38330 on epoch:    62, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 50.0296669006s, input_fired_time: 0.4925044477, output_fired_time: 0.3217493296, propagate_forward_time: 19.8016433716, propagate_backward_time: 27.7662906647, weight_update_time: 0.0721757263, other_time: 1.6474781036
epoch time: 4.0795259476s, input_fired_time: 0.0529140308, output_fired_time: 0.0000000000, propagate_forward_time: 3.7485773563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2780344486
validation[          , genome  2508] predictions:    9510/  10000 (95.10%), best:    9552/10000 (95.52%), error:      1624.51001, best error:      1491.38330 on epoch:    62, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 51.5246734619s, input_fired_time: 0.5028263927, output_fired_time: 0.3304924965, propagate_forward_time: 20.4103965759, propagate_backward_time: 28.5737972260, weight_update_time: 0.0747238994, other_time: 1.7071590424
epoch time: 3.8398959637s, input_fired_time: 0.0515172370, output_fired_time: 0.0000000000, propagate_forward_time: 3.5176229477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2707557678
validation[          , genome  2508] predictions:    9478/  10000 (94.78%), best:    9552/10000 (95.52%), error:      1699.48975, best error:      1491.38330 on epoch:    62, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 20.7091407776s, input_fired_time: 0.2655999064, output_fired_time: 0.0000000000, propagate_forward_time: 18.9619846344, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4815559387
best training[          , genome  2508] predictions:   48466/  50000 (96.93%), best:    9552/10000 (95.52%), error:      5476.74414, best error:      1491.38330 on epoch:    62, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 4.6806006432s, input_fired_time: 0.0560664870, output_fired_time: 0.0000000000, propagate_forward_time: 4.3031697273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3213644028
   testing[          , genome  2508] predictions:    9577/  10000 (95.77%), best:    9552/10000 (95.52%), error:      1431.71973, best error:      1491.38330 on epoch:    62, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
00:03:14 (40528): called boinc_finish(0)

</stderr_txt>
]]>