Nameexact_genome_1512568488_43_3428_1
Workunit2588454
Created7 Dec 2017, 4:47:27 UTC
Sent7 Dec 2017, 4:53:54 UTC
Report deadline11 Dec 2017, 13:10:52 UTC
Received7 Dec 2017, 14:17:22 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time2 hours 32 min 11 sec
CPU time2 hours 27 min 19 sec
Validate stateValid
Credit1,086.28
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size153.38 MB
Peak swap size156.63 MB
Peak disk usage1.60 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
d_time: 0.0914474055, output_fired_time: 0.0000000000, propagate_forward_time: 7.1555423737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4776868820
validation[          , genome  3428] predictions:    9540/  10000 (95.40%), best:    9540/10000 (95.40%), error:      1589.18042, best error:      1589.18042 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 84.2781753540s, input_fired_time: 0.7015725374, output_fired_time: 0.6072554588, propagate_forward_time: 32.2513313293, propagate_backward_time: 47.0408935547, weight_update_time: 0.1215266436, other_time: 3.6771202087
epoch time: 6.6235671043s, input_fired_time: 0.0888162553, output_fired_time: 0.0000000000, propagate_forward_time: 6.0692162514, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4655346870
validation[          , genome  3428] predictions:    9541/  10000 (95.41%), best:    9540/10000 (95.40%), error:      1594.71191, best error:      1589.18042 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 84.4597167969s, input_fired_time: 0.7003129125, output_fired_time: 0.6065451503, propagate_forward_time: 31.4759674072, propagate_backward_time: 46.9941368103, weight_update_time: 0.1215843484, other_time: 4.6827583313
epoch time: 12.5151996613s, input_fired_time: 0.1451029330, output_fired_time: 0.0000000000, propagate_forward_time: 11.5318460464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8382511139
validation[          , genome  3428] predictions:    9539/  10000 (95.39%), best:    9540/10000 (95.40%), error:      1608.72546, best error:      1589.18042 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 85.2683334351s, input_fired_time: 0.7029252052, output_fired_time: 0.6160488725, propagate_forward_time: 31.6184597015, propagate_backward_time: 49.6316375732, weight_update_time: 0.1221927777, other_time: 2.6992568970
epoch time: 7.6802659035s, input_fired_time: 0.0909015089, output_fired_time: 0.0000000000, propagate_forward_time: 7.1112785339, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4780859947
validation[          , genome  3428] predictions:    9544/  10000 (95.44%), best:    9544/10000 (95.44%), error:      1543.84460, best error:      1543.84460 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 84.0483093262s, input_fired_time: 0.6998785734, output_fired_time: 0.6030620933, propagate_forward_time: 30.1906147003, propagate_backward_time: 49.8806724548, weight_update_time: 0.1212539822, other_time: 2.6740837097
epoch time: 6.5458312035s, input_fired_time: 0.0896021053, output_fired_time: 0.0000000000, propagate_forward_time: 5.9879350662, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4682941437
validation[          , genome  3428] predictions:    9528/  10000 (95.28%), best:    9544/10000 (95.44%), error:      1670.54578, best error:      1543.84460 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 85.0930709839s, input_fired_time: 0.7013911605, output_fired_time: 0.6049072742, propagate_forward_time: 33.1540718079, propagate_backward_time: 47.9269561768, weight_update_time: 0.1205682307, other_time: 2.7057456970
epoch time: 6.5988306999s, input_fired_time: 0.0890024453, output_fired_time: 0.0000000000, propagate_forward_time: 6.0440039635, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4658241272
validation[          , genome  3428] predictions:    9517/  10000 (95.17%), best:    9544/10000 (95.44%), error:      1650.99341, best error:      1543.84460 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 84.8950881958s, input_fired_time: 0.7056101561, output_fired_time: 0.6095008850, propagate_forward_time: 30.4905509949, propagate_backward_time: 50.3932495117, weight_update_time: 0.1225309595, other_time: 2.6961708069
epoch time: 7.7707176208s, input_fired_time: 0.0910989717, output_fired_time: 0.0000000000, propagate_forward_time: 7.2051334381, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4744853973
validation[          , genome  3428] predictions:    9535/  10000 (95.35%), best:    9544/10000 (95.44%), error:      1598.36682, best error:      1543.84460 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 84.5714569092s, input_fired_time: 0.7072021365, output_fired_time: 0.6079552174, propagate_forward_time: 33.3926391602, propagate_backward_time: 47.1881523132, weight_update_time: 0.1214763373, other_time: 2.6755104065
epoch time: 6.6056203842s, input_fired_time: 0.0899099633, output_fired_time: 0.0000000000, propagate_forward_time: 6.0440382957, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4716720581
validation[          , genome  3428] predictions:    9507/  10000 (95.07%), best:    9544/10000 (95.44%), error:      1644.68237, best error:      1543.84460 on epoch:    17, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 84.2870788574s, input_fired_time: 0.7028445601, output_fired_time: 0.6060946584, propagate_forward_time: 32.3061523438, propagate_backward_time: 48.0010719299, weight_update_time: 0.1211616397, other_time: 2.6709175110
epoch time: 7.8818674088s, input_fired_time: 0.0924472734, output_fired_time: 0.0000000000, propagate_forward_time: 7.3039116859, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4855084419
validation[          , genome  3428] predictions:    9542/  10000 (95.42%), best:    9544/10000 (95.44%), error:      1551.72778, best error:      1543.84460 on epoch:    17, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 84.7998733521s, input_fired_time: 0.7135416865, output_fired_time: 0.6101443172, propagate_forward_time: 31.5095176697, propagate_backward_time: 49.2574005127, weight_update_time: 0.1225896105, other_time: 2.7092704773
epoch time: 6.5000014305s, input_fired_time: 0.0878398195, output_fired_time: 0.0000000000, propagate_forward_time: 5.9564208984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4557409286
validation[          , genome  3428] predictions:    9539/  10000 (95.39%), best:    9544/10000 (95.44%), error:      1584.16345, best error:      1543.84460 on epoch:    17, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 85.2473754883s, input_fired_time: 0.7039725780, output_fired_time: 0.6075053215, propagate_forward_time: 31.2165241241, propagate_backward_time: 49.0429458618, weight_update_time: 0.1214689389, other_time: 3.6764297485
epoch time: 6.5571761131s, input_fired_time: 0.0891827494, output_fired_time: 0.0000000000, propagate_forward_time: 6.0009703636, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4670228958
validation[          , genome  3428] predictions:    9517/  10000 (95.17%), best:    9544/10000 (95.44%), error:      1645.21094, best error:      1543.84460 on epoch:    17, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 84.1915283203s, input_fired_time: 0.7026648521, output_fired_time: 0.6065840125, propagate_forward_time: 31.2428817749, propagate_backward_time: 48.9693336487, weight_update_time: 0.1218497753, other_time: 2.6700630188
epoch time: 7.7767210007s, input_fired_time: 0.0932888314, output_fired_time: 0.0000000000, propagate_forward_time: 7.1934866905, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4899454117
validation[          , genome  3428] predictions:    9524/  10000 (95.24%), best:    9544/10000 (95.44%), error:      1585.97510, best error:      1543.84460 on epoch:    17, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 85.6210784912s, input_fired_time: 0.7231047153, output_fired_time: 0.6146898270, propagate_forward_time: 31.8577423096, propagate_backward_time: 49.7153930664, weight_update_time: 0.1224121749, other_time: 2.7101440430
epoch time: 6.4910392761s, input_fired_time: 0.0877836496, output_fired_time: 0.0000000000, propagate_forward_time: 5.9417672157, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4614882469
validation[          , genome  3428] predictions:    9542/  10000 (95.42%), best:    9542/10000 (95.42%), error:      1515.75562, best error:      1515.75562 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 84.6395492554s, input_fired_time: 0.7038702369, output_fired_time: 0.6065897942, propagate_forward_time: 32.9040374756, propagate_backward_time: 47.7556343079, weight_update_time: 0.1210384518, other_time: 2.6694145203
epoch time: 6.9126620293s, input_fired_time: 0.0952651054, output_fired_time: 0.0000000000, propagate_forward_time: 6.3237524033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4936447144
validation[          , genome  3428] predictions:    9522/  10000 (95.22%), best:    9542/10000 (95.42%), error:      1596.26563, best error:      1515.75562 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 83.4897842407s, input_fired_time: 0.7046529055, output_fired_time: 0.6012166739, propagate_forward_time: 29.9180679321, propagate_backward_time: 49.5823974609, weight_update_time: 0.1204667389, other_time: 2.6834487915
epoch time: 6.5023989677s, input_fired_time: 0.0879816115, output_fired_time: 0.0000000000, propagate_forward_time: 5.9506301880, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4637870789
validation[          , genome  3428] predictions:    9565/  10000 (95.65%), best:    9542/10000 (95.42%), error:      1534.80347, best error:      1515.75562 on epoch:    26, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 85.5250244141s, input_fired_time: 0.7027468681, output_fired_time: 0.6160076261, propagate_forward_time: 33.4448242188, propagate_backward_time: 48.0931205750, weight_update_time: 0.1327968389, other_time: 2.6683311462
epoch time: 6.5471911430s, input_fired_time: 0.0898703486, output_fired_time: 0.0000000000, propagate_forward_time: 5.9887909889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4685297012
validation[          , genome  3428] predictions:    9527/  10000 (95.27%), best:    9542/10000 (95.42%), error:      1639.14819, best error:      1515.75562 on epoch:    26, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 96.6302490234s, input_fired_time: 0.8096197248, output_fired_time: 0.6814938784, propagate_forward_time: 36.5609169006, propagate_backward_time: 54.5412597656, weight_update_time: 0.1224713475, other_time: 4.0369606018
epoch time: 6.5906867981s, input_fired_time: 0.0904597715, output_fired_time: 0.0000000000, propagate_forward_time: 6.0267539024, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4734730721
validation[          , genome  3428] predictions:    9562/  10000 (95.62%), best:    9562/10000 (95.62%), error:      1455.17175, best error:      1455.17175 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 86.0847244263s, input_fired_time: 0.7129187584, output_fired_time: 0.6103026271, propagate_forward_time: 31.5514240265, propagate_backward_time: 50.4956245422, weight_update_time: 0.1226785332, other_time: 2.7144508362
epoch time: 9.8085479736s, input_fired_time: 0.1308358610, output_fired_time: 0.0000000000, propagate_forward_time: 8.8845767975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7931356430
validation[          , genome  3428] predictions:    9533/  10000 (95.33%), best:    9562/10000 (95.62%), error:      1558.82251, best error:      1455.17175 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 86.9018020630s, input_fired_time: 0.7261749506, output_fired_time: 0.6265255809, propagate_forward_time: 33.4132919312, propagate_backward_time: 48.3885536194, weight_update_time: 0.1219524518, other_time: 3.7472572327
epoch time: 7.7023019791s, input_fired_time: 0.0933342427, output_fired_time: 0.0000000000, propagate_forward_time: 7.1264901161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4824776649
validation[          , genome  3428] predictions:    9565/  10000 (95.65%), best:    9562/10000 (95.62%), error:      1480.21619, best error:      1455.17175 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 84.3443527222s, input_fired_time: 0.7086066604, output_fired_time: 0.6100367308, propagate_forward_time: 33.2148475647, propagate_backward_time: 47.1191673279, weight_update_time: 0.1217266396, other_time: 2.6916961670
epoch time: 6.6031270027s, input_fired_time: 0.0928221047, output_fired_time: 0.0000000000, propagate_forward_time: 6.0303602219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4799447060
validation[          , genome  3428] predictions:    9550/  10000 (95.50%), best:    9562/10000 (95.62%), error:      1534.09766, best error:      1455.17175 on epoch:    30, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 85.2877731323s, input_fired_time: 1.7155818939, output_fired_time: 0.6076427102, propagate_forward_time: 32.3098258972, propagate_backward_time: 47.9894332886, weight_update_time: 0.1212593541, other_time: 2.6652870178
epoch time: 6.5265536308s, input_fired_time: 0.0906928331, output_fired_time: 0.0000000000, propagate_forward_time: 5.9652380943, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4706225395
validation[          , genome  3428] predictions:    9519/  10000 (95.19%), best:    9562/10000 (95.62%), error:      1581.83203, best error:      1455.17175 on epoch:    30, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 84.4964904785s, input_fired_time: 0.7200794220, output_fired_time: 0.6065223813, propagate_forward_time: 32.4151153564, propagate_backward_time: 48.0603523254, weight_update_time: 0.1221327186, other_time: 2.6944236755
epoch time: 7.8585324287s, input_fired_time: 0.0936348066, output_fired_time: 0.0000000000, propagate_forward_time: 6.2673354149, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4975624084
validation[          , genome  3428] predictions:    9496/  10000 (94.96%), best:    9562/10000 (95.62%), error:      1658.50500, best error:      1455.17175 on epoch:    30, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 84.5898818970s, input_fired_time: 0.7066219449, output_fired_time: 0.6041513085, propagate_forward_time: 32.4236907959, propagate_backward_time: 48.1869392395, weight_update_time: 0.1214147434, other_time: 2.6684837341
epoch time: 6.5032997131s, input_fired_time: 0.0895097330, output_fired_time: 0.0000000000, propagate_forward_time: 5.9459915161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4677982330
validation[          , genome  3428] predictions:    9549/  10000 (95.49%), best:    9562/10000 (95.62%), error:      1525.65222, best error:      1455.17175 on epoch:    30, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 83.9937133789s, input_fired_time: 0.7023435831, output_fired_time: 0.6048798561, propagate_forward_time: 32.1542625427, propagate_backward_time: 47.8726158142, weight_update_time: 0.1201696098, other_time: 2.6596069336
epoch time: 7.9408698082s, input_fired_time: 0.0947558805, output_fired_time: 0.0000000000, propagate_forward_time: 7.3554763794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4906377792
validation[          , genome  3428] predictions:    9486/  10000 (94.86%), best:    9562/10000 (95.62%), error:      1693.61890, best error:      1455.17175 on epoch:    30, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 84.4071502686s, input_fired_time: 0.7091830969, output_fired_time: 0.6064469814, propagate_forward_time: 31.3902664185, propagate_backward_time: 49.0456809998, weight_update_time: 0.1213111430, other_time: 2.6555747986
epoch time: 6.6398115158s, input_fired_time: 0.0899158120, output_fired_time: 0.0000000000, propagate_forward_time: 6.0846447945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4652509689
validation[          , genome  3428] predictions:    9563/  10000 (95.63%), best:    9563/10000 (95.63%), error:      1454.14917, best error:      1454.14917 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 85.4518661499s, input_fired_time: 0.7085047960, output_fired_time: 0.6075841188, propagate_forward_time: 32.3714523315, propagate_backward_time: 49.0777854919, weight_update_time: 0.1219624802, other_time: 2.6865425110
epoch time: 6.5129675865s, input_fired_time: 0.0881712064, output_fired_time: 0.0000000000, propagate_forward_time: 5.9629807472, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4618158340
validation[          , genome  3428] predictions:    9565/  10000 (95.65%), best:    9565/10000 (95.65%), error:      1439.23389, best error:      1439.23389 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 83.5853271484s, input_fired_time: 0.7035961151, output_fired_time: 0.6023015976, propagate_forward_time: 31.0414505005, propagate_backward_time: 48.5853347778, weight_update_time: 0.1207833737, other_time: 2.6526412964
epoch time: 7.7495007515s, input_fired_time: 0.0921863094, output_fired_time: 0.0000000000, propagate_forward_time: 7.1816349030, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4756793976
validation[          , genome  3428] predictions:    9499/  10000 (94.99%), best:    9565/10000 (95.65%), error:      1651.96985, best error:      1439.23389 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 83.8925704956s, input_fired_time: 0.7073928714, output_fired_time: 0.6039251089, propagate_forward_time: 30.2939739227, propagate_backward_time: 48.7054634094, weight_update_time: 0.1213942096, other_time: 3.5818138123
epoch time: 6.6500349045s, input_fired_time: 0.0911893547, output_fired_time: 0.0000000000, propagate_forward_time: 6.0797352791, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4791102409
validation[          , genome  3428] predictions:    9560/  10000 (95.60%), best:    9565/10000 (95.65%), error:      1512.68579, best error:      1439.23389 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 83.9337158203s, input_fired_time: 0.7156148553, output_fired_time: 0.6050617099, propagate_forward_time: 32.9711227417, propagate_backward_time: 46.9933586121, weight_update_time: 0.1207110435, other_time: 2.6485557556
epoch time: 7.8848090172s, input_fired_time: 0.0945002735, output_fired_time: 0.0000000000, propagate_forward_time: 7.2953658104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4949431419
validation[          , genome  3428] predictions:    9508/  10000 (95.08%), best:    9565/10000 (95.65%), error:      1624.15002, best error:      1439.23389 on epoch:    39, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 84.5631408691s, input_fired_time: 0.7177026868, output_fired_time: 0.6070768237, propagate_forward_time: 33.4458465576, propagate_backward_time: 47.1339492798, weight_update_time: 0.1211235523, other_time: 2.6585617065
epoch time: 6.6152129173s, input_fired_time: 0.0898264274, output_fired_time: 0.0000000000, propagate_forward_time: 6.0631799698, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4622063637
validation[          , genome  3428] predictions:    9562/  10000 (95.62%), best:    9565/10000 (95.65%), error:      1453.32300, best error:      1439.23389 on epoch:    39, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 84.9810638428s, input_fired_time: 0.7098944783, output_fired_time: 0.6037780643, propagate_forward_time: 32.0396614075, propagate_backward_time: 48.9842453003, weight_update_time: 0.1199539974, other_time: 2.6434898376
epoch time: 6.6028914452s, input_fired_time: 0.0909606814, output_fired_time: 0.0000000000, propagate_forward_time: 6.0376081467, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4743227959
validation[          , genome  3428] predictions:    9546/  10000 (95.46%), best:    9565/10000 (95.65%), error:      1484.70959, best error:      1439.23389 on epoch:    39, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 84.5083847046s, input_fired_time: 0.7085770369, output_fired_time: 0.6069400907, propagate_forward_time: 31.4137153625, propagate_backward_time: 49.1082725525, weight_update_time: 0.1216528043, other_time: 2.6708755493
epoch time: 7.8619112968s, input_fired_time: 0.0945608914, output_fired_time: 0.0000000000, propagate_forward_time: 7.2829456329, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4844045639
validation[          , genome  3428] predictions:    9552/  10000 (95.52%), best:    9565/10000 (95.65%), error:      1483.07703, best error:      1439.23389 on epoch:    39, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 93.6856079102s, input_fired_time: 0.7571427226, output_fired_time: 0.6851487160, propagate_forward_time: 34.9003677368, propagate_backward_time: 53.4287109375, weight_update_time: 0.1309755445, other_time: 3.9142379761
epoch time: 8.6601047516s, input_fired_time: 0.1082028896, output_fired_time: 0.0000000000, propagate_forward_time: 8.0387744904, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5131273270
validation[          , genome  3428] predictions:    9575/  10000 (95.75%), best:    9575/10000 (95.75%), error:      1422.58313, best error:      1422.58313 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 85.7167358398s, input_fired_time: 0.7064753175, output_fired_time: 0.6251075268, propagate_forward_time: 30.8550910950, propagate_backward_time: 49.8385429382, weight_update_time: 0.1223599538, other_time: 3.6915206909
epoch time: 6.5082821846s, input_fired_time: 0.0890234783, output_fired_time: 0.0000000000, propagate_forward_time: 5.9584589005, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4607996941
validation[          , genome  3428] predictions:    9562/  10000 (95.62%), best:    9575/10000 (95.75%), error:      1452.90369, best error:      1422.58313 on epoch:    46, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 85.7996749878s, input_fired_time: 0.7105854154, output_fired_time: 0.6102983952, propagate_forward_time: 31.5079040527, propagate_backward_time: 50.2904739380, weight_update_time: 0.1221443862, other_time: 2.6804122925
epoch time: 6.5984506607s, input_fired_time: 0.0911282748, output_fired_time: 0.0000000000, propagate_forward_time: 6.0369439125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4703783989
validation[          , genome  3428] predictions:    9511/  10000 (95.11%), best:    9575/10000 (95.75%), error:      1612.65039, best error:      1422.58313 on epoch:    46, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 84.6820831299s, input_fired_time: 0.7113276720, output_fired_time: 0.6285153627, propagate_forward_time: 32.5154724121, propagate_backward_time: 48.1459846497, weight_update_time: 0.1222710684, other_time: 2.6807823181
epoch time: 7.8809895515s, input_fired_time: 0.0943639427, output_fired_time: 0.0000000000, propagate_forward_time: 7.3011136055, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4855117798
validation[          , genome  3428] predictions:    9538/  10000 (95.38%), best:    9575/10000 (95.75%), error:      1508.61743, best error:      1422.58313 on epoch:    46, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 84.6180496216s, input_fired_time: 0.7105734348, output_fired_time: 0.6073057652, propagate_forward_time: 31.4362163544, propagate_backward_time: 48.1747474670, weight_update_time: 0.1215873510, other_time: 3.6892051697
epoch time: 6.4345645905s, input_fired_time: 0.0875343904, output_fired_time: 0.0000000000, propagate_forward_time: 5.8992290497, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4478011131
validation[          , genome  3428] predictions:    9492/  10000 (94.92%), best:    9575/10000 (95.75%), error:      1618.01660, best error:      1422.58313 on epoch:    46, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 85.4717254639s, input_fired_time: 0.7067465186, output_fired_time: 0.6073092818, propagate_forward_time: 32.3250579834, propagate_backward_time: 49.1745071411, weight_update_time: 0.1220178157, other_time: 2.6581039429
epoch time: 6.7774887085s, input_fired_time: 0.0929403603, output_fired_time: 0.0000000000, propagate_forward_time: 6.1995344162, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4850139618
validation[          , genome  3428] predictions:    9586/  10000 (95.86%), best:    9575/10000 (95.75%), error:      1462.27258, best error:      1422.58313 on epoch:    46, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 83.9013595581s, input_fired_time: 0.7049284577, output_fired_time: 0.6042127013, propagate_forward_time: 31.1298580170, propagate_backward_time: 48.8055191040, weight_update_time: 0.1207061782, other_time: 2.6568450928
epoch time: 6.6361699104s, input_fired_time: 0.0903424919, output_fired_time: 0.0000000000, propagate_forward_time: 6.0755491257, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4702782631
validation[          , genome  3428] predictions:    9556/  10000 (95.56%), best:    9575/10000 (95.75%), error:      1459.85828, best error:      1422.58313 on epoch:    46, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 88.9363861084s, input_fired_time: 0.7504363060, output_fired_time: 0.6121665239, propagate_forward_time: 34.7359313965, propagate_backward_time: 49.9968490601, weight_update_time: 0.1351911575, other_time: 2.8410034180
epoch time: 6.5184102058s, input_fired_time: 0.0906385779, output_fired_time: 0.0000000000, propagate_forward_time: 5.9598345757, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4679369926
validation[          , genome  3428] predictions:    9519/  10000 (95.19%), best:    9575/10000 (95.75%), error:      1627.66797, best error:      1422.58313 on epoch:    46, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 89.5090713501s, input_fired_time: 0.7819885015, output_fired_time: 0.6409001350, propagate_forward_time: 35.1093597412, propagate_backward_time: 50.1496238708, weight_update_time: 0.1216351613, other_time: 2.8271980286
epoch time: 6.7115979195s, input_fired_time: 0.0924385116, output_fired_time: 0.0000000000, propagate_forward_time: 6.1419420242, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4772171974
validation[          , genome  3428] predictions:    9573/  10000 (95.73%), best:    9575/10000 (95.75%), error:      1463.37048, best error:      1422.58313 on epoch:    46, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 84.2120971680s, input_fired_time: 0.7101642489, output_fired_time: 0.6037980318, propagate_forward_time: 31.2614574432, propagate_backward_time: 48.9526824951, weight_update_time: 0.1222231537, other_time: 2.6839904785
epoch time: 7.8158850670s, input_fired_time: 0.0922816098, output_fired_time: 0.0000000000, propagate_forward_time: 7.2417669296, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4818363190
validation[          , genome  3428] predictions:    9520/  10000 (95.20%), best:    9575/10000 (95.75%), error:      1637.00342, best error:      1422.58313 on epoch:    46, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 84.3160934448s, input_fired_time: 0.7068256140, output_fired_time: 0.6024808288, propagate_forward_time: 32.3959045410, propagate_backward_time: 47.9491310120, weight_update_time: 0.1210106611, other_time: 2.6617546082
epoch time: 6.5876212120s, input_fired_time: 0.0897466838, output_fired_time: 0.0000000000, propagate_forward_time: 6.0357255936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4621491432
validation[          , genome  3428] predictions:    9555/  10000 (95.55%), best:    9575/10000 (95.75%), error:      1496.31738, best error:      1422.58313 on epoch:    46, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 86.3955993652s, input_fired_time: 0.7158158422, output_fired_time: 0.6130477190, propagate_forward_time: 31.7073631287, propagate_backward_time: 50.6695785522, weight_update_time: 0.1226346120, other_time: 2.6898002625
epoch time: 6.5975685120s, input_fired_time: 0.0910901651, output_fired_time: 0.0000000000, propagate_forward_time: 6.0354876518, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4709906578
validation[          , genome  3428] predictions:    9575/  10000 (95.75%), best:    9575/10000 (95.75%), error:      1457.11353, best error:      1422.58313 on epoch:    46, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 95.4480972290s, input_fired_time: 0.7566060424, output_fired_time: 0.6711321473, propagate_forward_time: 37.1441345215, propagate_backward_time: 53.9353752136, weight_update_time: 0.1307758093, other_time: 2.9408454895
epoch time: 6.6505885124s, input_fired_time: 0.0912846476, output_fired_time: 0.0000000000, propagate_forward_time: 6.0758957863, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4834079742
validation[          , genome  3428] predictions:    9562/  10000 (95.62%), best:    9575/10000 (95.75%), error:      1527.97205, best error:      1422.58313 on epoch:    46, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 84.4536209106s, input_fired_time: 0.7129117250, output_fired_time: 1.6172577143, propagate_forward_time: 32.3145751953, propagate_backward_time: 46.1194229126, weight_update_time: 0.1218956932, other_time: 3.6894531250
epoch time: 7.6549787521s, input_fired_time: 0.0939373150, output_fired_time: 0.0000000000, propagate_forward_time: 7.0785260201, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4825153351
validation[          , genome  3428] predictions:    9572/  10000 (95.72%), best:    9575/10000 (95.75%), error:      1498.80188, best error:      1422.58313 on epoch:    46, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 87.8172607422s, input_fired_time: 0.7290422320, output_fired_time: 0.6260815859, propagate_forward_time: 32.6902351379, propagate_backward_time: 51.0184783936, weight_update_time: 0.1221151426, other_time: 2.7534217834
epoch time: 9.5696811676s, input_fired_time: 0.1149756536, output_fired_time: 0.0000000000, propagate_forward_time: 8.8151025772, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6396026611
validation[          , genome  3428] predictions:    9562/  10000 (95.62%), best:    9575/10000 (95.75%), error:      1430.53918, best error:      1422.58313 on epoch:    46, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 84.4734497070s, input_fired_time: 0.7108252645, output_fired_time: 0.6062479019, propagate_forward_time: 31.4669475555, propagate_backward_time: 49.0413017273, weight_update_time: 0.1203904301, other_time: 2.6481285095
epoch time: 6.5829992294s, input_fired_time: 0.0915510207, output_fired_time: 0.0000000000, propagate_forward_time: 6.0176286697, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4738197327
validation[          , genome  3428] predictions:    9557/  10000 (95.57%), best:    9575/10000 (95.75%), error:      1527.28735, best error:      1422.58313 on epoch:    46, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 90.7797927856s, input_fired_time: 0.7312775850, output_fired_time: 0.6738196611, propagate_forward_time: 33.3563232422, propagate_backward_time: 53.2291717529, weight_update_time: 0.1221150309, other_time: 2.7891998291
epoch time: 6.5165352821s, input_fired_time: 0.0894921347, output_fired_time: 0.0000000000, propagate_forward_time: 5.9647498131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4622931480
validation[          , genome  3428] predictions:    9556/  10000 (95.56%), best:    9575/10000 (95.75%), error:      1532.95361, best error:      1422.58313 on epoch:    46, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 93.2524642944s, input_fired_time: 0.7853368521, output_fired_time: 0.6498034596, propagate_forward_time: 34.3137474060, propagate_backward_time: 53.6503257751, weight_update_time: 0.1210018098, other_time: 3.8532485962
epoch time: 10.8336048126s, input_fired_time: 0.1247080937, output_fired_time: 0.0000000000, propagate_forward_time: 9.9849357605, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7239608765
validation[          , genome  3428] predictions:    9583/  10000 (95.83%), best:    9583/10000 (95.83%), error:      1412.64490, best error:      1412.64490 on epoch:    63, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 93.3676452637s, input_fired_time: 0.7512392402, output_fired_time: 0.6606994867, propagate_forward_time: 35.4746475220, propagate_backward_time: 53.6078605652, weight_update_time: 0.1312471181, other_time: 2.8732032776
epoch time: 11.2234544754s, input_fired_time: 0.1303877234, output_fired_time: 0.0000000000, propagate_forward_time: 10.3238048553, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7692623138
validation[          , genome  3428] predictions:    9556/  10000 (95.56%), best:    9583/10000 (95.83%), error:      1561.68530, best error:      1412.64490 on epoch:    63, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 85.7786865234s, input_fired_time: 0.7325610518, output_fired_time: 0.6195637584, propagate_forward_time: 30.7593154907, propagate_backward_time: 49.9216308594, weight_update_time: 0.1207203642, other_time: 3.7456207275
epoch time: 6.5613107681s, input_fired_time: 0.0904885530, output_fired_time: 0.0000000000, propagate_forward_time: 6.0128436089, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4579787254
validation[          , genome  3428] predictions:    9539/  10000 (95.39%), best:    9583/10000 (95.83%), error:      1561.18726, best error:      1412.64490 on epoch:    63, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 84.4365844727s, input_fired_time: 0.7100598812, output_fired_time: 0.6088598967, propagate_forward_time: 33.3924102783, propagate_backward_time: 47.0689086914, weight_update_time: 0.1215966195, other_time: 2.6563491821
epoch time: 7.7101826668s, input_fired_time: 0.0932570249, output_fired_time: 0.0000000000, propagate_forward_time: 7.1401548386, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4767708778
validation[          , genome  3428] predictions:    9579/  10000 (95.79%), best:    9583/10000 (95.83%), error:      1435.10291, best error:      1412.64490 on epoch:    63, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 84.1620635986s, input_fired_time: 0.7120167613, output_fired_time: 0.6047438979, propagate_forward_time: 31.2945690155, propagate_backward_time: 47.8671455383, weight_update_time: 0.1206553802, other_time: 3.6835899353
epoch time: 6.6367573738s, input_fired_time: 0.0912846401, output_fired_time: 0.0000000000, propagate_forward_time: 6.0767202377, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4687523842
validation[          , genome  3428] predictions:    9508/  10000 (95.08%), best:    9583/10000 (95.83%), error:      1642.11975, best error:      1412.64490 on epoch:    63, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 93.1608734131s, input_fired_time: 1.7052930593, output_fired_time: 0.7093752623, propagate_forward_time: 36.4535369873, propagate_backward_time: 51.3600845337, weight_update_time: 0.1434123814, other_time: 2.9325866699
epoch time: 6.4389891624s, input_fired_time: 0.0898899063, output_fired_time: 0.0000000000, propagate_forward_time: 5.8821463585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4669528008
validation[          , genome  3428] predictions:    9575/  10000 (95.75%), best:    9583/10000 (95.83%), error:      1427.55725, best error:      1412.64490 on epoch:    63, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 87.3719635010s, input_fired_time: 0.7236149311, output_fired_time: 0.6200870275, propagate_forward_time: 33.2205276489, propagate_backward_time: 50.0569190979, weight_update_time: 0.1232201010, other_time: 2.7508125305
epoch time: 6.5576734543s, input_fired_time: 0.0912118554, output_fired_time: 0.0000000000, propagate_forward_time: 5.9927306175, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4737310410
validation[          , genome  3428] predictions:    9575/  10000 (95.75%), best:    9575/10000 (95.75%), error:      1396.05249, best error:      1396.05249 on epoch:    69, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 83.3200607300s, input_fired_time: 0.7143544555, output_fired_time: 0.6081315875, propagate_forward_time: 31.3814716339, propagate_backward_time: 47.9444160461, weight_update_time: 0.1210541353, other_time: 2.6716880798
epoch time: 7.2656869888s, input_fired_time: 0.0931353942, output_fired_time: 0.0000000000, propagate_forward_time: 6.6917510033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4808006287
validation[          , genome  3428] predictions:    9538/  10000 (95.38%), best:    9575/10000 (95.75%), error:      1541.43213, best error:      1396.05249 on epoch:    69, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 84.5989990234s, input_fired_time: 0.7124974132, output_fired_time: 0.6072943211, propagate_forward_time: 32.4614143372, propagate_backward_time: 48.1499595642, weight_update_time: 0.1216010228, other_time: 2.6678390503
epoch time: 6.4625372887s, input_fired_time: 0.0885020345, output_fired_time: 0.0000000000, propagate_forward_time: 5.9240331650, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4500021935
validation[          , genome  3428] predictions:    9583/  10000 (95.83%), best:    9575/10000 (95.75%), error:      1418.52844, best error:      1396.05249 on epoch:    69, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 85.8834304810s, input_fired_time: 0.7246180177, output_fired_time: 0.6103026271, propagate_forward_time: 32.4064102173, propagate_backward_time: 49.4571952820, weight_update_time: 0.1214959249, other_time: 2.6849021912
epoch time: 6.5515604019s, input_fired_time: 0.0917362273, output_fired_time: 0.0000000000, propagate_forward_time: 5.9861526489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4736714363
validation[          , genome  3428] predictions:    9566/  10000 (95.66%), best:    9575/10000 (95.75%), error:      1450.78625, best error:      1396.05249 on epoch:    69, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 95.0494155884s, input_fired_time: 0.7736083865, output_fired_time: 0.7175694108, propagate_forward_time: 36.8053894043, propagate_backward_time: 53.8317413330, weight_update_time: 0.1310894936, other_time: 2.9211120605
epoch time: 8.8410520554s, input_fired_time: 0.1394238323, output_fired_time: 0.0000000000, propagate_forward_time: 8.0910339355, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6105947495
validation[          , genome  3428] predictions:    9566/  10000 (95.66%), best:    9575/10000 (95.75%), error:      1471.33582, best error:      1396.05249 on epoch:    69, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 91.3502120972s, input_fired_time: 0.7445515394, output_fired_time: 0.6332756877, propagate_forward_time: 37.0369224548, propagate_backward_time: 50.1403846741, weight_update_time: 0.1376614422, other_time: 2.7950744629
epoch time: 6.5710420609s, input_fired_time: 0.0924873278, output_fired_time: 0.0000000000, propagate_forward_time: 5.9975733757, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4809813499
validation[          , genome  3428] predictions:    9576/  10000 (95.76%), best:    9575/10000 (95.75%), error:      1421.55298, best error:      1396.05249 on epoch:    69, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 84.6901321411s, input_fired_time: 0.7157596350, output_fired_time: 0.6085844636, propagate_forward_time: 31.4719924927, propagate_backward_time: 49.2384757996, weight_update_time: 0.1217877641, other_time: 2.6553230286
epoch time: 7.8630385399s, input_fired_time: 0.0962317437, output_fired_time: 0.0000000000, propagate_forward_time: 7.2766304016, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4901762009
validation[          , genome  3428] predictions:    9589/  10000 (95.89%), best:    9575/10000 (95.75%), error:      1435.47314, best error:      1396.05249 on epoch:    69, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 84.8970260620s, input_fired_time: 0.7195569873, output_fired_time: 0.6091583967, propagate_forward_time: 31.5992851257, propagate_backward_time: 49.2910003662, weight_update_time: 0.1216157004, other_time: 2.6780204773
epoch time: 6.5110182762s, input_fired_time: 0.0923539475, output_fired_time: 0.0000000000, propagate_forward_time: 5.9598836899, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4587807655
validation[          , genome  3428] predictions:    9587/  10000 (95.87%), best:    9575/10000 (95.75%), error:      1427.14819, best error:      1396.05249 on epoch:    69, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 90.2181777954s, input_fired_time: 0.7513745427, output_fired_time: 0.6521139145, propagate_forward_time: 34.1329269409, propagate_backward_time: 51.8067855835, weight_update_time: 0.1298112422, other_time: 2.8749771118
epoch time: 6.5800719261s, input_fired_time: 0.0920568332, output_fired_time: 0.0000000000, propagate_forward_time: 6.0234456062, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4645695686
validation[          , genome  3428] predictions:    9599/  10000 (95.99%), best:    9599/10000 (95.99%), error:      1376.03845, best error:      1376.03845 on epoch:    77, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 84.1374588013s, input_fired_time: 0.7161689401, output_fired_time: 0.6042583585, propagate_forward_time: 30.2282600403, propagate_backward_time: 49.9228744507, weight_update_time: 0.1208938584, other_time: 2.6658973694
epoch time: 9.8093738556s, input_fired_time: 0.1012780517, output_fired_time: 0.0000000000, propagate_forward_time: 9.1203126907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5877828598
validation[          , genome  3428] predictions:    9593/  10000 (95.93%), best:    9599/10000 (95.99%), error:      1423.63037, best error:      1376.03845 on epoch:    77, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 90.7555541992s, input_fired_time: 0.7475768328, output_fired_time: 1.6973073483, propagate_forward_time: 34.1085128784, propagate_backward_time: 51.3379478455, weight_update_time: 0.1374744028, other_time: 2.8642158508
epoch time: 7.7779393196s, input_fired_time: 0.0996374786, output_fired_time: 0.0000000000, propagate_forward_time: 7.1956934929, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4826083183
validation[          , genome  3428] predictions:    9572/  10000 (95.72%), best:    9599/10000 (95.99%), error:      1473.56592, best error:      1376.03845 on epoch:    77, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 84.1235504150s, input_fired_time: 0.7152572870, output_fired_time: 0.6078451276, propagate_forward_time: 34.1932449341, propagate_backward_time: 45.9416847229, weight_update_time: 0.1215936840, other_time: 2.6655235291
epoch time: 6.6301121712s, input_fired_time: 0.0946190804, output_fired_time: 0.0000000000, propagate_forward_time: 6.0668768883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4686160088
validation[          , genome  3428] predictions:    9581/  10000 (95.81%), best:    9599/10000 (95.99%), error:      1417.21606, best error:      1376.03845 on epoch:    77, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 91.9583969116s, input_fired_time: 0.7533221245, output_fired_time: 0.6743410826, propagate_forward_time: 33.7469863892, propagate_backward_time: 53.8618888855, weight_update_time: 0.1383701414, other_time: 2.9218635559
epoch time: 6.4747357368s, input_fired_time: 0.0907153189, output_fired_time: 0.0000000000, propagate_forward_time: 5.9228978157, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4611225128
validation[          , genome  3428] predictions:    9551/  10000 (95.51%), best:    9599/10000 (95.99%), error:      1507.15295, best error:      1376.03845 on epoch:    77, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 86.1869812012s, input_fired_time: 1.7454329729, output_fired_time: 0.6123061776, propagate_forward_time: 32.5450782776, propagate_backward_time: 48.5990486145, weight_update_time: 0.1220559031, other_time: 2.6851196289
epoch time: 6.5149540901s, input_fired_time: 0.0917396843, output_fired_time: 0.0000000000, propagate_forward_time: 5.9570040703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4662103653
validation[          , genome  3428] predictions:    9545/  10000 (95.45%), best:    9599/10000 (95.99%), error:      1501.12610, best error:      1376.03845 on epoch:    77, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 84.0948181152s, input_fired_time: 0.7169258595, output_fired_time: 0.6146547794, propagate_forward_time: 31.1379547119, propagate_backward_time: 48.9643440247, weight_update_time: 0.1223370507, other_time: 2.6609382629
epoch time: 7.8339238167s, input_fired_time: 0.0959340855, output_fired_time: 0.0000000000, propagate_forward_time: 7.2530016899, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4849882126
validation[          , genome  3428] predictions:    9555/  10000 (95.55%), best:    9599/10000 (95.99%), error:      1472.82739, best error:      1376.03845 on epoch:    77, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 84.1819381714s, input_fired_time: 0.7118859291, output_fired_time: 0.6084166765, propagate_forward_time: 32.2026710510, propagate_backward_time: 46.9987411499, weight_update_time: 0.1207403168, other_time: 3.6602287292
epoch time: 6.6427412033s, input_fired_time: 0.0932550952, output_fired_time: 0.0000000000, propagate_forward_time: 6.0783023834, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4711837769
validation[          , genome  3428] predictions:    9591/  10000 (95.91%), best:    9599/10000 (95.99%), error:      1416.21167, best error:      1376.03845 on epoch:    77, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 85.9612426758s, input_fired_time: 0.7192340493, output_fired_time: 0.6105732918, propagate_forward_time: 32.6070022583, propagate_backward_time: 49.3751945496, weight_update_time: 0.1219801530, other_time: 2.6492424011
epoch time: 6.6691651344s, input_fired_time: 0.0936099142, output_fired_time: 0.0000000000, propagate_forward_time: 6.0989923477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4765629768
validation[          , genome  3428] predictions:    9543/  10000 (95.43%), best:    9599/10000 (95.99%), error:      1526.01025, best error:      1376.03845 on epoch:    77, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 84.6965866089s, input_fired_time: 0.7287343144, output_fired_time: 0.6096872687, propagate_forward_time: 32.3973197937, propagate_backward_time: 48.2999267578, weight_update_time: 0.1211537421, other_time: 2.6609153748
epoch time: 6.5437636375s, input_fired_time: 0.0902735889, output_fired_time: 0.0000000000, propagate_forward_time: 5.9972000122, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4562902451
validation[          , genome  3428] predictions:    9602/  10000 (96.02%), best:    9602/10000 (96.02%), error:      1366.01550, best error:      1366.01550 on epoch:    86, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 90.1668090820s, input_fired_time: 0.7479884028, output_fired_time: 0.6536381245, propagate_forward_time: 32.9229888916, propagate_backward_time: 53.0683860779, weight_update_time: 0.1309258491, other_time: 2.7738075256
epoch time: 7.9743127823s, input_fired_time: 0.1015658304, output_fired_time: 0.0000000000, propagate_forward_time: 7.3180270195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5547199249
validation[          , genome  3428] predictions:    9600/  10000 (96.00%), best:    9602/10000 (96.02%), error:      1374.12219, best error:      1366.01550 on epoch:    86, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 94.3253936768s, input_fired_time: 1.7836204767, output_fired_time: 0.6780495048, propagate_forward_time: 34.8982734680, propagate_backward_time: 54.0900459290, weight_update_time: 0.1369806677, other_time: 2.8754043579
epoch time: 7.7408337593s, input_fired_time: 0.0931451172, output_fired_time: 0.0000000000, propagate_forward_time: 7.1789407730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4687480927
validation[          , genome  3428] predictions:    9596/  10000 (95.96%), best:    9602/10000 (96.02%), error:      1404.72888, best error:      1366.01550 on epoch:    86, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 84.5809478760s, input_fired_time: 0.7225041986, output_fired_time: 0.6041623950, propagate_forward_time: 31.4442329407, propagate_backward_time: 49.1660270691, weight_update_time: 0.1205308214, other_time: 2.6440200806
epoch time: 6.5207347870s, input_fired_time: 0.0916434154, output_fired_time: 0.0000000000, propagate_forward_time: 5.9572119713, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4718794823
validation[          , genome  3428] predictions:    9592/  10000 (95.92%), best:    9602/10000 (96.02%), error:      1404.14819, best error:      1366.01550 on epoch:    86, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 92.3921051025s, input_fired_time: 0.7634434700, output_fired_time: 0.7044164538, propagate_forward_time: 35.1399688721, propagate_backward_time: 51.9122390747, weight_update_time: 0.1212969273, other_time: 3.8720397949
epoch time: 6.3394703865s, input_fired_time: 0.0893919766, output_fired_time: 0.0000000000, propagate_forward_time: 5.7985029221, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4515752792
validation[          , genome  3428] predictions:    9549/  10000 (95.49%), best:    9602/10000 (96.02%), error:      1511.68909, best error:      1366.01550 on epoch:    86, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 91.6519470215s, input_fired_time: 0.7812204361, output_fired_time: 0.6398003697, propagate_forward_time: 34.6666870117, propagate_backward_time: 51.6949996948, weight_update_time: 0.1407086104, other_time: 3.8692398071
epoch time: 6.5839867592s, input_fired_time: 0.0932379961, output_fired_time: 0.0000000000, propagate_forward_time: 6.0193223953, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4714264870
validation[          , genome  3428] predictions:    9596/  10000 (95.96%), best:    9602/10000 (96.02%), error:      1400.78711, best error:      1366.01550 on epoch:    86, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 93.6318359375s, input_fired_time: 1.7887674570, output_fired_time: 1.7046965361, propagate_forward_time: 36.4059982300, propagate_backward_time: 50.8141098022, weight_update_time: 0.1389521062, other_time: 2.9182662964
epoch time: 6.4552774429s, input_fired_time: 0.0903409719, output_fired_time: 0.0000000000, propagate_forward_time: 5.9075269699, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4574093819
validation[          , genome  3428] predictions:    9584/  10000 (95.84%), best:    9602/10000 (96.02%), error:      1415.94971, best error:      1366.01550 on epoch:    86, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 91.2195358276s, input_fired_time: 0.7603886127, output_fired_time: 0.6393793225, propagate_forward_time: 35.5905761719, propagate_backward_time: 51.3460960388, weight_update_time: 0.1368538141, other_time: 2.8830909729
epoch time: 6.6406722069s, input_fired_time: 0.0940438807, output_fired_time: 0.0000000000, propagate_forward_time: 6.0729794502, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4736490250
validation[          , genome  3428] predictions:    9575/  10000 (95.75%), best:    9602/10000 (96.02%), error:      1408.07104, best error:      1366.01550 on epoch:    86, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 93.4650344849s, input_fired_time: 0.7363978624, output_fired_time: 0.6495396495, propagate_forward_time: 34.3414306641, propagate_backward_time: 54.8763809204, weight_update_time: 0.1232043579, other_time: 2.8612899780
epoch time: 10.0900774002s, input_fired_time: 0.1074659154, output_fired_time: 0.0000000000, propagate_forward_time: 9.2368993759, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7457122803
validation[          , genome  3428] predictions:    9566/  10000 (95.66%), best:    9602/10000 (96.02%), error:      1456.88647, best error:      1366.01550 on epoch:    86, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 84.6038818359s, input_fired_time: 0.7164127827, output_fired_time: 0.6043988466, propagate_forward_time: 31.4448909760, propagate_backward_time: 48.1794776917, weight_update_time: 0.1206689924, other_time: 3.6586952209
epoch time: 7.9284954071s, input_fired_time: 0.0975111574, output_fired_time: 0.0000000000, propagate_forward_time: 6.3236055374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5073785782
validation[          , genome  3428] predictions:    9586/  10000 (95.86%), best:    9602/10000 (96.02%), error:      1404.51379, best error:      1366.01550 on epoch:    86, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 84.6687545776s, input_fired_time: 0.7181555033, output_fired_time: 0.6065309048, propagate_forward_time: 31.4919033051, propagate_backward_time: 49.1977806091, weight_update_time: 0.1212046221, other_time: 2.6543846130
epoch time: 6.6154012680s, input_fired_time: 0.0928817764, output_fired_time: 0.0000000000, propagate_forward_time: 6.0523462296, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4701733589
validation[          , genome  3428] predictions:    9598/  10000 (95.98%), best:    9602/10000 (96.02%), error:      1413.32507, best error:      1366.01550 on epoch:    86, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 86.1295013428s, input_fired_time: 0.7233194113, output_fired_time: 0.6126911640, propagate_forward_time: 31.6300830841, propagate_backward_time: 50.4906272888, weight_update_time: 0.1219386458, other_time: 2.6727790833
epoch time: 6.4379162788s, input_fired_time: 0.0912749469, output_fired_time: 0.0000000000, propagate_forward_time: 5.8897500038, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4568915367
validation[          , genome  3428] predictions:    9585/  10000 (95.85%), best:    9602/10000 (96.02%), error:      1367.64917, best error:      1366.01550 on epoch:    86, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 84.0875854492s, input_fired_time: 0.7180709839, output_fired_time: 0.6015663147, propagate_forward_time: 30.2705993652, propagate_backward_time: 49.8473854065, weight_update_time: 0.1209412441, other_time: 2.6499595642
epoch time: 7.9291501045s, input_fired_time: 0.0992983356, output_fired_time: 0.0000000000, propagate_forward_time: 7.3305125237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4993391037
validation[          , genome  3428] predictions:    9606/  10000 (96.06%), best:    9606/10000 (96.06%), error:      1343.39148, best error:      1343.39148 on epoch:    98, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 91.2074661255s, input_fired_time: 0.7785602212, output_fired_time: 0.6420375705, propagate_forward_time: 34.9854469299, propagate_backward_time: 51.9669036865, weight_update_time: 0.1344400048, other_time: 2.8345222473
epoch time: 8.0364646912s, input_fired_time: 0.0954293162, output_fired_time: 0.0000000000, propagate_forward_time: 7.4414329529, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4996023178
validation[          , genome  3428] predictions:    9545/  10000 (95.45%), best:    9606/10000 (96.06%), error:      1550.69250, best error:      1343.39148 on epoch:    98, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 92.0658493042s, input_fired_time: 0.7664358020, output_fired_time: 0.6773558855, propagate_forward_time: 34.2788238525, propagate_backward_time: 53.4989051819, weight_update_time: 0.1209006459, other_time: 2.8443336487
epoch time: 7.7667522430s, input_fired_time: 0.0959702879, output_fired_time: 0.0000000000, propagate_forward_time: 6.1762161255, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4945659637
validation[          , genome  3428] predictions:    9555/  10000 (95.55%), best:    9606/10000 (96.06%), error:      1491.18359, best error:      1343.39148 on epoch:    98, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 33.7894325256s, input_fired_time: 0.4714554548, output_fired_time: 0.0000000000, propagate_forward_time: 30.8645458221, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4534320831
best training[          , genome  3428] predictions:   48823/  50000 (97.65%), best:    9606/10000 (96.06%), error:      4420.47412, best error:      1343.39148 on epoch:    98, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 7.2413625717s, input_fired_time: 0.0965938568, output_fired_time: 0.0000000000, propagate_forward_time: 6.3424801826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8022885323
   testing[          , genome  3428] predictions:    9655/  10000 (96.55%), best:    9606/10000 (96.06%), error:      1204.77820, best error:      1343.39148 on epoch:    98, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
06:11:35 (1460): called boinc_finish(0)

</stderr_txt>
]]>