Nameexact_genome_1512568488_44_6197_0
Workunit2602285
Created7 Dec 2017, 18:31:07 UTC
Sent7 Dec 2017, 18:39:18 UTC
Report deadline15 Dec 2017, 5:09:46 UTC
Received8 Dec 2017, 11:28:29 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time4 hours 7 min 55 sec
CPU time3 hours 59 min 29 sec
Validate stateValid
Credit1,859.46
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.35 MB
Peak swap size158.66 MB
Peak disk usage1.79 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
 genome  6197] predictions:    9621/  10000 (96.21%), best:    9670/10000 (96.70%), error:      1319.28894, best error:      1146.80579 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 138.4412536621s, input_fired_time: 1.7130544186, output_fired_time: 1.5333237648, propagate_forward_time: 50.7585449219, propagate_backward_time: 79.8874053955, weight_update_time: 0.1503178179, other_time: 4.5489196777
epoch time: 10.4912509918s, input_fired_time: 0.2153570503, output_fired_time: 0.0000000000, propagate_forward_time: 9.6575155258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6183786392
validation[          , genome  6197] predictions:    9617/  10000 (96.17%), best:    9670/10000 (96.70%), error:      1265.80066, best error:      1146.80579 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 137.3203735352s, input_fired_time: 1.7126957178, output_fired_time: 1.5165848732, propagate_forward_time: 50.2339477539, propagate_backward_time: 80.3504180908, weight_update_time: 0.1483820975, other_time: 3.5067291260
epoch time: 11.7561702728s, input_fired_time: 0.2201970518, output_fired_time: 0.0000000000, propagate_forward_time: 10.8918485641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6441249847
validation[          , genome  6197] predictions:    9690/  10000 (96.90%), best:    9690/10000 (96.90%), error:      1106.54553, best error:      1106.54553 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 137.3219299316s, input_fired_time: 1.7118650675, output_fired_time: 1.5213379860, propagate_forward_time: 50.4012374878, propagate_backward_time: 80.1689987183, weight_update_time: 0.1492994577, other_time: 3.5184936523
epoch time: 12.6798801422s, input_fired_time: 0.2237039953, output_fired_time: 0.0000000000, propagate_forward_time: 11.7004985809, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7556772232
validation[          , genome  6197] predictions:    9661/  10000 (96.61%), best:    9690/10000 (96.90%), error:      1147.24500, best error:      1106.54553 on epoch:    16, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 167.4307250977s, input_fired_time: 2.0066256523, output_fired_time: 1.7711725235, propagate_forward_time: 60.0274581909, propagate_backward_time: 98.4918746948, weight_update_time: 0.1894210279, other_time: 5.1335906982
epoch time: 10.4972639084s, input_fired_time: 0.2141435742, output_fired_time: 0.0000000000, propagate_forward_time: 9.6520957947, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6310243607
validation[          , genome  6197] predictions:    9457/  10000 (94.57%), best:    9690/10000 (96.90%), error:      1827.17480, best error:      1106.54553 on epoch:    16, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 140.3454437256s, input_fired_time: 2.7768952847, output_fired_time: 1.5414675474, propagate_forward_time: 52.5720214844, propagate_backward_time: 79.8744812012, weight_update_time: 0.1511970907, other_time: 3.5805664063
epoch time: 17.5053653717s, input_fired_time: 0.3654567897, output_fired_time: 0.0000000000, propagate_forward_time: 16.2147750854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9251327515
validation[          , genome  6197] predictions:    9646/  10000 (96.46%), best:    9690/10000 (96.90%), error:      1179.78430, best error:      1106.54553 on epoch:    16, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 147.7970886230s, input_fired_time: 1.8120493889, output_fired_time: 1.6492900848, propagate_forward_time: 57.1752662659, propagate_backward_time: 83.4459228516, weight_update_time: 0.1525068730, other_time: 3.7145690918
epoch time: 10.4859046936s, input_fired_time: 0.2160822749, output_fired_time: 0.0000000000, propagate_forward_time: 9.6508512497, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6189708710
validation[          , genome  6197] predictions:    9646/  10000 (96.46%), best:    9690/10000 (96.90%), error:      1181.89661, best error:      1106.54553 on epoch:    16, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 148.2789154053s, input_fired_time: 1.7920886278, output_fired_time: 1.6322903633, propagate_forward_time: 55.8738975525, propagate_backward_time: 85.1957702637, weight_update_time: 0.1693122983, other_time: 3.7848663330
epoch time: 17.3322429657s, input_fired_time: 0.3471159339, output_fired_time: 0.0000000000, propagate_forward_time: 15.9578905106, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0272359848
validation[          , genome  6197] predictions:    9522/  10000 (95.22%), best:    9690/10000 (96.90%), error:      1550.12756, best error:      1106.54553 on epoch:    16, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 138.0116882324s, input_fired_time: 1.7199712992, output_fired_time: 1.5437769890, propagate_forward_time: 49.9864768982, propagate_backward_time: 81.2577667236, weight_update_time: 0.1491650790, other_time: 3.5036926270
epoch time: 11.5940065384s, input_fired_time: 0.2215918154, output_fired_time: 0.0000000000, propagate_forward_time: 10.7368354797, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6355791092
validation[          , genome  6197] predictions:    9618/  10000 (96.18%), best:    9690/10000 (96.90%), error:      1278.00635, best error:      1106.54553 on epoch:    16, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 137.9055175781s, input_fired_time: 1.7478996515, output_fired_time: 1.5253493786, propagate_forward_time: 51.5720024109, propagate_backward_time: 77.5004272461, weight_update_time: 0.1495052576, other_time: 5.5598449707
epoch time: 10.5005073547s, input_fired_time: 0.2152861804, output_fired_time: 0.0000000000, propagate_forward_time: 9.6598663330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6253547668
validation[          , genome  6197] predictions:    9604/  10000 (96.04%), best:    9690/10000 (96.90%), error:      1294.09741, best error:      1106.54553 on epoch:    16, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 138.2033691406s, input_fired_time: 1.7283357382, output_fired_time: 1.5641156435, propagate_forward_time: 53.0229759216, propagate_backward_time: 78.3501586914, weight_update_time: 0.1503282785, other_time: 3.5377807617
epoch time: 12.0563411713s, input_fired_time: 0.2230652273, output_fired_time: 0.0000000000, propagate_forward_time: 11.1919240952, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6413516998
validation[          , genome  6197] predictions:    9679/  10000 (96.79%), best:    9679/10000 (96.79%), error:      1099.63843, best error:      1099.63843 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 144.1570892334s, input_fired_time: 1.7964217663, output_fired_time: 1.5808520317, propagate_forward_time: 54.1116485596, propagate_backward_time: 82.9572143555, weight_update_time: 0.1489856988, other_time: 3.7109527588
epoch time: 11.6227588654s, input_fired_time: 0.2198158950, output_fired_time: 0.0000000000, propagate_forward_time: 10.7700004578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6329421997
validation[          , genome  6197] predictions:    9644/  10000 (96.44%), best:    9679/10000 (96.79%), error:      1218.62341, best error:      1099.63843 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 138.9402160645s, input_fired_time: 1.7501528263, output_fired_time: 1.5483844280, propagate_forward_time: 52.9326400757, propagate_backward_time: 79.1728515625, weight_update_time: 0.1492603868, other_time: 3.5361862183
epoch time: 14.3233270645s, input_fired_time: 0.2571006119, output_fired_time: 0.0000000000, propagate_forward_time: 13.2501592636, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8160667419
validation[          , genome  6197] predictions:    9690/  10000 (96.90%), best:    9690/10000 (96.90%), error:      1063.70044, best error:      1063.70044 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 139.2564544678s, input_fired_time: 1.7301694155, output_fired_time: 1.5434677601, propagate_forward_time: 53.0158576965, propagate_backward_time: 79.3890075684, weight_update_time: 0.1514439285, other_time: 3.5779571533
epoch time: 15.1035165787s, input_fired_time: 0.2800239027, output_fired_time: 0.0000000000, propagate_forward_time: 13.8499002457, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9735927582
validation[          , genome  6197] predictions:    9690/  10000 (96.90%), best:    9690/10000 (96.90%), error:      1083.12463, best error:      1063.70044 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 139.3272552490s, input_fired_time: 1.7682282925, output_fired_time: 1.5374701023, propagate_forward_time: 53.0942153931, propagate_backward_time: 79.4270629883, weight_update_time: 0.1491992623, other_time: 3.5002670288
epoch time: 11.7342834473s, input_fired_time: 0.2192554176, output_fired_time: 0.0000000000, propagate_forward_time: 10.8814735413, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6335544586
validation[          , genome  6197] predictions:    9720/  10000 (97.20%), best:    9720/10000 (97.20%), error:       999.34821, best error:       999.34821 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 138.0714874268s, input_fired_time: 1.7223871946, output_fired_time: 1.5296071768, propagate_forward_time: 50.6879844666, propagate_backward_time: 80.6198501587, weight_update_time: 0.1487026960, other_time: 3.5116653442
epoch time: 10.5600605011s, input_fired_time: 0.2142677158, output_fired_time: 0.0000000000, propagate_forward_time: 9.7344188690, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6113739014
validation[          , genome  6197] predictions:    9698/  10000 (96.98%), best:    9720/10000 (97.20%), error:      1034.09717, best error:       999.34821 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 137.1266174316s, input_fired_time: 1.7126410007, output_fired_time: 1.5224515200, propagate_forward_time: 51.1511001587, propagate_backward_time: 79.2253570557, weight_update_time: 0.1563092917, other_time: 3.5150680542
epoch time: 11.6572628021s, input_fired_time: 0.2192513943, output_fired_time: 0.0000000000, propagate_forward_time: 10.8057746887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6322364807
validation[          , genome  6197] predictions:    9701/  10000 (97.01%), best:    9720/10000 (97.20%), error:      1000.87311, best error:       999.34821 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 138.2979736328s, input_fired_time: 1.7185715437, output_fired_time: 1.5266201496, propagate_forward_time: 52.6475486755, propagate_backward_time: 78.8659667969, weight_update_time: 0.1500530839, other_time: 3.5392608643
epoch time: 10.4119129181s, input_fired_time: 0.2135591209, output_fired_time: 0.0000000000, propagate_forward_time: 9.5742168427, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6241369247
validation[          , genome  6197] predictions:    9688/  10000 (96.88%), best:    9720/10000 (97.20%), error:      1029.61243, best error:       999.34821 on epoch:    28, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 144.2172851563s, input_fired_time: 1.8329170942, output_fired_time: 1.6068537235, propagate_forward_time: 53.7127876282, propagate_backward_time: 83.4820098877, weight_update_time: 0.1564717591, other_time: 3.5827178955
epoch time: 10.3920154572s, input_fired_time: 0.2161023021, output_fired_time: 0.0000000000, propagate_forward_time: 9.5513505936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6245622635
validation[          , genome  6197] predictions:    9660/  10000 (96.60%), best:    9720/10000 (97.20%), error:      1139.66199, best error:       999.34821 on epoch:    28, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 138.2599792480s, input_fired_time: 1.7422517538, output_fired_time: 1.5334590673, propagate_forward_time: 50.8024101257, propagate_backward_time: 80.6507568359, weight_update_time: 0.1496205032, other_time: 3.5310974121
epoch time: 11.5966262817s, input_fired_time: 0.2171241641, output_fired_time: 0.0000000000, propagate_forward_time: 10.7609901428, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6185121536
validation[          , genome  6197] predictions:    9676/  10000 (96.76%), best:    9720/10000 (97.20%), error:      1095.36792, best error:       999.34821 on epoch:    28, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 136.5767211914s, input_fired_time: 1.7204279900, output_fired_time: 1.5366642475, propagate_forward_time: 50.9571075439, propagate_backward_time: 78.8545455933, weight_update_time: 0.1498390287, other_time: 3.5079727173
epoch time: 11.7251386642s, input_fired_time: 0.2201789767, output_fired_time: 0.0000000000, propagate_forward_time: 10.8685874939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6363725662
validation[          , genome  6197] predictions:    9693/  10000 (96.93%), best:    9720/10000 (97.20%), error:      1067.92310, best error:       999.34821 on epoch:    28, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 138.2383270264s, input_fired_time: 1.7225855589, output_fired_time: 1.5313420296, propagate_forward_time: 51.6798858643, propagate_backward_time: 79.7863922119, weight_update_time: 0.1491875499, other_time: 3.5181274414
epoch time: 10.2780447006s, input_fired_time: 0.2118383795, output_fired_time: 0.0000000000, propagate_forward_time: 9.4540262222, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6121797562
validation[          , genome  6197] predictions:    9696/  10000 (96.96%), best:    9720/10000 (97.20%), error:      1072.72290, best error:       999.34821 on epoch:    28, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 136.4324188232s, input_fired_time: 1.7218252420, output_fired_time: 1.5598030090, propagate_forward_time: 52.1467704773, propagate_backward_time: 77.5004119873, weight_update_time: 0.1486998796, other_time: 3.5036010742
epoch time: 11.7808656693s, input_fired_time: 0.2230368555, output_fired_time: 0.0000000000, propagate_forward_time: 10.9114236832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6464052200
validation[          , genome  6197] predictions:    9699/  10000 (96.99%), best:    9720/10000 (97.20%), error:      1031.69226, best error:       999.34821 on epoch:    28, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 160.0075683594s, input_fired_time: 1.9680247307, output_fired_time: 1.7765643597, propagate_forward_time: 60.0961799622, propagate_backward_time: 91.1656341553, weight_update_time: 0.1490297168, other_time: 5.0011749268
epoch time: 11.5475997925s, input_fired_time: 0.2170117348, output_fired_time: 0.0000000000, propagate_forward_time: 10.7082719803, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6223163605
validation[          , genome  6197] predictions:    9692/  10000 (96.92%), best:    9720/10000 (97.20%), error:      1074.97546, best error:       999.34821 on epoch:    28, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 145.6202392578s, input_fired_time: 1.8030276299, output_fired_time: 1.5544378757, propagate_forward_time: 54.7638626099, propagate_backward_time: 82.7624130249, weight_update_time: 0.1522000879, other_time: 4.7364959717
epoch time: 11.1350812912s, input_fired_time: 0.2224210948, output_fired_time: 0.0000000000, propagate_forward_time: 10.2697725296, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6428880692
validation[          , genome  6197] predictions:    9635/  10000 (96.35%), best:    9720/10000 (97.20%), error:      1256.60400, best error:       999.34821 on epoch:    28, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 150.4405670166s, input_fired_time: 2.8624172211, output_fired_time: 1.6854869127, propagate_forward_time: 55.1508865356, propagate_backward_time: 85.0954132080, weight_update_time: 0.1541799307, other_time: 5.6463699341
epoch time: 11.6174612045s, input_fired_time: 0.2168280184, output_fired_time: 0.0000000000, propagate_forward_time: 10.7751712799, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6254615784
validation[          , genome  6197] predictions:    9702/  10000 (97.02%), best:    9720/10000 (97.20%), error:      1042.28467, best error:       999.34821 on epoch:    28, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 145.3500061035s, input_fired_time: 1.7843477726, output_fired_time: 1.6309294701, propagate_forward_time: 53.2559509277, propagate_backward_time: 84.8930969238, weight_update_time: 0.1659180969, other_time: 3.7856750488
epoch time: 10.3873739243s, input_fired_time: 0.2132331580, output_fired_time: 0.0000000000, propagate_forward_time: 9.5675554276, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6065855026
validation[          , genome  6197] predictions:    9713/  10000 (97.13%), best:    9720/10000 (97.20%), error:      1033.68396, best error:       999.34821 on epoch:    28, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 146.2993469238s, input_fired_time: 2.8530378342, output_fired_time: 1.6644437313, propagate_forward_time: 54.8572387695, propagate_backward_time: 83.2978591919, weight_update_time: 0.1567463130, other_time: 3.6267623901
epoch time: 10.7996196747s, input_fired_time: 0.2207033634, output_fired_time: 0.0000000000, propagate_forward_time: 9.9293203354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6495962143
validation[          , genome  6197] predictions:    9721/  10000 (97.21%), best:    9721/10000 (97.21%), error:       962.45166, best error:       962.45166 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 138.0628356934s, input_fired_time: 1.7502795458, output_fired_time: 1.5282434225, propagate_forward_time: 53.6096458435, propagate_backward_time: 77.6347808838, weight_update_time: 0.1496420652, other_time: 3.5398864746
epoch time: 11.4915800095s, input_fired_time: 0.2180488110, output_fired_time: 0.0000000000, propagate_forward_time: 10.6484022141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6251287460
validation[          , genome  6197] predictions:    9696/  10000 (96.96%), best:    9721/10000 (97.21%), error:      1101.03918, best error:       962.45166 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 153.6837921143s, input_fired_time: 2.9792375565, output_fired_time: 1.6920731068, propagate_forward_time: 55.5420837402, propagate_backward_time: 89.6696090698, weight_update_time: 0.1575191170, other_time: 3.8007888794
epoch time: 10.9512996674s, input_fired_time: 0.2091173530, output_fired_time: 0.0000000000, propagate_forward_time: 10.1317386627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6104440689
validation[          , genome  6197] predictions:    9653/  10000 (96.53%), best:    9721/10000 (97.21%), error:      1182.32385, best error:       962.45166 on epoch:    41, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 139.2050628662s, input_fired_time: 2.7415022850, output_fired_time: 1.5430513620, propagate_forward_time: 49.9663429260, propagate_backward_time: 81.3362197876, weight_update_time: 0.1501410455, other_time: 3.6179580688
epoch time: 11.7507419586s, input_fired_time: 0.2198550701, output_fired_time: 0.0000000000, propagate_forward_time: 10.8955745697, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6353120804
validation[          , genome  6197] predictions:    9730/  10000 (97.30%), best:    9730/10000 (97.30%), error:       951.13782, best error:       951.13782 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 149.3650360107s, input_fired_time: 1.9326385260, output_fired_time: 1.6591885090, propagate_forward_time: 53.5955734253, propagate_backward_time: 88.3644409180, weight_update_time: 0.1653777510, other_time: 3.8131942749
epoch time: 11.6013669968s, input_fired_time: 0.2210244238, output_fired_time: 0.0000000000, propagate_forward_time: 10.7484760284, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6318664551
validation[          , genome  6197] predictions:    9674/  10000 (96.74%), best:    9730/10000 (97.30%), error:      1110.88257, best error:       951.13782 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 149.3787384033s, input_fired_time: 1.9220076799, output_fired_time: 1.6456494331, propagate_forward_time: 53.8060760498, propagate_backward_time: 88.2464447021, weight_update_time: 0.1616706699, other_time: 3.7585601807
epoch time: 11.6303930283s, input_fired_time: 0.2188389897, output_fired_time: 0.0000000000, propagate_forward_time: 10.7709894180, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6405649185
validation[          , genome  6197] predictions:    9724/  10000 (97.24%), best:    9730/10000 (97.30%), error:       973.93909, best error:       951.13782 on epoch:    44, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 138.3774108887s, input_fired_time: 1.7318626642, output_fired_time: 1.5348812342, propagate_forward_time: 49.7028961182, propagate_backward_time: 81.8443908691, weight_update_time: 0.1502079964, other_time: 3.5633850098
epoch time: 10.3171873093s, input_fired_time: 0.2110325247, output_fired_time: 0.0000000000, propagate_forward_time: 9.4865045547, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6196498871
validation[          , genome  6197] predictions:    9710/  10000 (97.10%), best:    9730/10000 (97.30%), error:       980.91034, best error:       951.13782 on epoch:    44, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 138.3459167480s, input_fired_time: 1.7291486263, output_fired_time: 2.5329377651, propagate_forward_time: 50.7027435303, propagate_backward_time: 78.8468093872, weight_update_time: 0.1499201655, other_time: 4.5342788696
epoch time: 11.6830816269s, input_fired_time: 0.2227827460, output_fired_time: 0.0000000000, propagate_forward_time: 10.8218145370, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6384840012
validation[          , genome  6197] predictions:    9704/  10000 (97.04%), best:    9730/10000 (97.30%), error:      1047.79993, best error:       951.13782 on epoch:    44, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 138.6495208740s, input_fired_time: 1.7208689451, output_fired_time: 1.5235754251, propagate_forward_time: 52.8161926270, propagate_backward_time: 79.0784225464, weight_update_time: 0.1488107592, other_time: 3.5104598999
epoch time: 10.7860031128s, input_fired_time: 0.2209467143, output_fired_time: 0.0000000000, propagate_forward_time: 9.9252185822, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6398382187
validation[          , genome  6197] predictions:    9688/  10000 (96.88%), best:    9730/10000 (97.30%), error:      1103.34338, best error:       951.13782 on epoch:    44, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 138.0750122070s, input_fired_time: 2.7492036819, output_fired_time: 1.5304826498, propagate_forward_time: 51.6048851013, propagate_backward_time: 78.6147384644, weight_update_time: 0.1498497128, other_time: 3.5756912231
epoch time: 11.8044443130s, input_fired_time: 0.2236458361, output_fired_time: 0.0000000000, propagate_forward_time: 9.9296693802, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6511287689
validation[          , genome  6197] predictions:    9721/  10000 (97.21%), best:    9730/10000 (97.30%), error:       985.41003, best error:       951.13782 on epoch:    44, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 137.9329681396s, input_fired_time: 1.7243422270, output_fired_time: 1.5263791084, propagate_forward_time: 51.4088516235, propagate_backward_time: 79.7563018799, weight_update_time: 0.1487961113, other_time: 3.5170974731
epoch time: 10.3412847519s, input_fired_time: 0.2131827474, output_fired_time: 0.0000000000, propagate_forward_time: 9.5219583511, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6061439514
validation[          , genome  6197] predictions:    9684/  10000 (96.84%), best:    9730/10000 (97.30%), error:      1085.25977, best error:       951.13782 on epoch:    44, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 138.5453948975s, input_fired_time: 1.7630863190, output_fired_time: 1.5314532518, propagate_forward_time: 52.7950553894, propagate_backward_time: 78.9217147827, weight_update_time: 0.1505011618, other_time: 3.5340805054
epoch time: 11.5616245270s, input_fired_time: 0.2185794562, output_fired_time: 0.0000000000, propagate_forward_time: 10.7223644257, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6206808090
validation[          , genome  6197] predictions:    9689/  10000 (96.89%), best:    9730/10000 (97.30%), error:      1023.36761, best error:       951.13782 on epoch:    44, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 138.4092254639s, input_fired_time: 1.7631645203, output_fired_time: 1.5290189981, propagate_forward_time: 51.8610992432, propagate_backward_time: 79.7355194092, weight_update_time: 0.1487491578, other_time: 3.5204162598
epoch time: 10.2656726837s, input_fired_time: 0.2125128359, output_fired_time: 0.0000000000, propagate_forward_time: 9.4399976730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6131620407
validation[          , genome  6197] predictions:    9706/  10000 (97.06%), best:    9730/10000 (97.30%), error:      1008.15552, best error:       951.13782 on epoch:    44, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 139.9819793701s, input_fired_time: 2.7538990974, output_fired_time: 1.5489095449, propagate_forward_time: 51.2844009399, propagate_backward_time: 80.7916717529, weight_update_time: 0.1494755596, other_time: 3.6030960083
epoch time: 11.4177341461s, input_fired_time: 0.2231311798, output_fired_time: 0.0000000000, propagate_forward_time: 10.5684852600, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6261177063
validation[          , genome  6197] predictions:    9689/  10000 (96.89%), best:    9730/10000 (97.30%), error:      1070.91260, best error:       951.13782 on epoch:    44, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 142.1301727295s, input_fired_time: 1.8133097887, output_fired_time: 1.5483307838, propagate_forward_time: 53.8975334167, propagate_backward_time: 81.2334747314, weight_update_time: 0.1498767287, other_time: 3.6375274658
epoch time: 10.4343986511s, input_fired_time: 0.2157850862, output_fired_time: 0.0000000000, propagate_forward_time: 9.6051187515, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6134948730
validation[          , genome  6197] predictions:    9708/  10000 (97.08%), best:    9730/10000 (97.30%), error:      1031.20325, best error:       951.13782 on epoch:    44, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 145.4832916260s, input_fired_time: 1.7977408171, output_fired_time: 1.6060893536, propagate_forward_time: 56.3552627563, propagate_backward_time: 82.0867462158, weight_update_time: 0.1607573628, other_time: 3.6374435425
epoch time: 10.7378473282s, input_fired_time: 0.2150447369, output_fired_time: 0.0000000000, propagate_forward_time: 9.9205713272, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6022310257
validation[          , genome  6197] predictions:    9730/  10000 (97.30%), best:    9730/10000 (97.30%), error:       968.43488, best error:       951.13782 on epoch:    44, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 147.5458526611s, input_fired_time: 1.8241933584, output_fired_time: 1.6367975473, propagate_forward_time: 55.8038063049, propagate_backward_time: 84.5438537598, weight_update_time: 0.1642048508, other_time: 3.7372131348
epoch time: 9.9178619385s, input_fired_time: 0.2105462998, output_fired_time: 0.0000000000, propagate_forward_time: 9.1098327637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5974826813
validation[          , genome  6197] predictions:    9686/  10000 (96.86%), best:    9730/10000 (97.30%), error:      1067.90417, best error:       951.13782 on epoch:    44, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 138.5351867676s, input_fired_time: 1.7327681780, output_fired_time: 1.5349839926, propagate_forward_time: 52.8896865845, propagate_backward_time: 78.8992996216, weight_update_time: 0.1483000070, other_time: 3.4784393311
epoch time: 12.2914876938s, input_fired_time: 0.2451910377, output_fired_time: 0.0000000000, propagate_forward_time: 11.3769531250, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6693439484
validation[          , genome  6197] predictions:    9694/  10000 (96.94%), best:    9730/10000 (97.30%), error:      1062.58264, best error:       951.13782 on epoch:    44, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 152.4020385742s, input_fired_time: 1.8697403669, output_fired_time: 1.8533365726, propagate_forward_time: 55.9215049744, propagate_backward_time: 88.8369216919, weight_update_time: 0.1593655646, other_time: 3.9205398560
epoch time: 12.1759281158s, input_fired_time: 0.2280963808, output_fired_time: 0.0000000000, propagate_forward_time: 11.2767677307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6710643768
validation[          , genome  6197] predictions:    9696/  10000 (96.96%), best:    9730/10000 (97.30%), error:      1001.15320, best error:       951.13782 on epoch:    44, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 138.0623321533s, input_fired_time: 1.7300627232, output_fired_time: 1.5242811441, propagate_forward_time: 51.7375259399, propagate_backward_time: 79.5607147217, weight_update_time: 0.1482126564, other_time: 3.5097579956
epoch time: 10.5580615997s, input_fired_time: 0.2198374271, output_fired_time: 0.0000000000, propagate_forward_time: 9.7122888565, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6259355545
validation[          , genome  6197] predictions:    9722/  10000 (97.22%), best:    9722/10000 (97.22%), error:       908.87817, best error:       908.87817 on epoch:    60, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 145.6752166748s, input_fired_time: 1.7765543461, output_fired_time: 2.6172311306, propagate_forward_time: 56.0482482910, propagate_backward_time: 81.5257186890, weight_update_time: 0.1536949277, other_time: 3.7074661255
epoch time: 10.4146013260s, input_fired_time: 0.2174192667, output_fired_time: 0.0000000000, propagate_forward_time: 9.5813608170, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6158208847
validation[          , genome  6197] predictions:    9676/  10000 (96.76%), best:    9722/10000 (97.22%), error:      1112.16541, best error:       908.87817 on epoch:    60, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 137.6698608398s, input_fired_time: 1.7345221043, output_fired_time: 1.5308319330, propagate_forward_time: 53.3698158264, propagate_backward_time: 77.5366592407, weight_update_time: 0.1503184587, other_time: 3.4980239868
epoch time: 11.7232208252s, input_fired_time: 0.2260433584, output_fired_time: 0.0000000000, propagate_forward_time: 10.8582859039, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6388912201
validation[          , genome  6197] predictions:    9711/  10000 (97.11%), best:    9722/10000 (97.22%), error:       995.91962, best error:       908.87817 on epoch:    60, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 139.3491363525s, input_fired_time: 1.7477201223, output_fired_time: 1.5364885330, propagate_forward_time: 54.1382980347, propagate_backward_time: 77.3460235596, weight_update_time: 0.1488303393, other_time: 4.5806045532
epoch time: 10.0800342560s, input_fired_time: 0.2158281505, output_fired_time: 0.0000000000, propagate_forward_time: 9.2476167679, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6165895462
validation[          , genome  6197] predictions:    9642/  10000 (96.42%), best:    9722/10000 (97.22%), error:      1189.18201, best error:       908.87817 on epoch:    60, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 140.4371032715s, input_fired_time: 1.7894487381, output_fired_time: 1.5514215231, propagate_forward_time: 52.4186172485, propagate_backward_time: 81.1348876953, weight_update_time: 0.1493532956, other_time: 3.5427322388
epoch time: 11.8726654053s, input_fired_time: 0.2175825238, output_fired_time: 0.0000000000, propagate_forward_time: 11.0398225784, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6152601242
validation[          , genome  6197] predictions:    9718/  10000 (97.18%), best:    9722/10000 (97.22%), error:       970.13177, best error:       908.87817 on epoch:    60, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 140.2619171143s, input_fired_time: 1.8133506775, output_fired_time: 1.5608131886, propagate_forward_time: 52.5022773743, propagate_backward_time: 80.8086395264, weight_update_time: 0.1495100707, other_time: 3.5768432617
epoch time: 10.4896068573s, input_fired_time: 0.2192997783, output_fired_time: 0.0000000000, propagate_forward_time: 9.6556844711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6146230698
validation[          , genome  6197] predictions:    9605/  10000 (96.05%), best:    9722/10000 (97.22%), error:      1444.97034, best error:       908.87817 on epoch:    60, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 139.0549011230s, input_fired_time: 1.7449382544, output_fired_time: 1.5413246155, propagate_forward_time: 53.9235115051, propagate_backward_time: 77.2579116821, weight_update_time: 0.1489467472, other_time: 4.5872268677
epoch time: 11.7287740707s, input_fired_time: 0.2261499166, output_fired_time: 0.0000000000, propagate_forward_time: 10.8651380539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6374864578
validation[          , genome  6197] predictions:    9711/  10000 (97.11%), best:    9722/10000 (97.22%), error:      1018.64105, best error:       908.87817 on epoch:    60, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 141.6264495850s, input_fired_time: 1.7467570305, output_fired_time: 2.6069006920, propagate_forward_time: 49.8864898682, propagate_backward_time: 83.7851791382, weight_update_time: 0.1494592726, other_time: 3.6011276245
epoch time: 11.9247627258s, input_fired_time: 0.2239874452, output_fired_time: 0.0000000000, propagate_forward_time: 11.0681972504, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6325778961
validation[          , genome  6197] predictions:    9658/  10000 (96.58%), best:    9722/10000 (97.22%), error:      1085.23022, best error:       908.87817 on epoch:    60, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 138.6261749268s, input_fired_time: 1.7380061150, output_fired_time: 1.5377298594, propagate_forward_time: 51.9023323059, propagate_backward_time: 79.9488983154, weight_update_time: 0.1481514424, other_time: 3.4992065430
epoch time: 10.5779256821s, input_fired_time: 0.2217154503, output_fired_time: 0.0000000000, propagate_forward_time: 9.7287874222, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6274232864
validation[          , genome  6197] predictions:    9625/  10000 (96.25%), best:    9722/10000 (97.22%), error:      1274.81934, best error:       908.87817 on epoch:    60, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 137.7304534912s, input_fired_time: 1.7284549475, output_fired_time: 1.5930820704, propagate_forward_time: 51.4173431396, propagate_backward_time: 78.4791641235, weight_update_time: 0.1481418312, other_time: 4.5124130249
epoch time: 11.6534872055s, input_fired_time: 0.2234220058, output_fired_time: 0.0000000000, propagate_forward_time: 10.8016300201, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6284351349
validation[          , genome  6197] predictions:    9661/  10000 (96.61%), best:    9722/10000 (97.22%), error:      1124.30676, best error:       908.87817 on epoch:    60, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 142.6016693115s, input_fired_time: 1.8021802902, output_fired_time: 1.6362193823, propagate_forward_time: 53.4098014832, propagate_backward_time: 82.1788635254, weight_update_time: 0.1570570171, other_time: 3.5746002197
epoch time: 10.4132699966s, input_fired_time: 0.2187602967, output_fired_time: 0.0000000000, propagate_forward_time: 9.5796394348, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6148700714
validation[          , genome  6197] predictions:    9704/  10000 (97.04%), best:    9722/10000 (97.22%), error:      1021.16418, best error:       908.87817 on epoch:    60, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 138.3934326172s, input_fired_time: 1.7669517994, output_fired_time: 1.5309089422, propagate_forward_time: 50.8688545227, propagate_backward_time: 79.7192306519, weight_update_time: 0.1484252810, other_time: 4.5074844360
epoch time: 11.7305603027s, input_fired_time: 0.2236872762, output_fired_time: 0.0000000000, propagate_forward_time: 10.8770513535, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6298217773
validation[          , genome  6197] predictions:    9657/  10000 (96.57%), best:    9722/10000 (97.22%), error:      1182.36133, best error:       908.87817 on epoch:    60, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 138.5529174805s, input_fired_time: 1.7464573383, output_fired_time: 1.5309745073, propagate_forward_time: 51.7825660706, propagate_backward_time: 79.9603347778, weight_update_time: 0.1494627446, other_time: 3.5325851440
epoch time: 10.5612869263s, input_fired_time: 0.2213694751, output_fired_time: 0.0000000000, propagate_forward_time: 9.7166185379, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6232986450
validation[          , genome  6197] predictions:    9720/  10000 (97.20%), best:    9722/10000 (97.22%), error:       958.40332, best error:       908.87817 on epoch:    60, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 147.3025970459s, input_fired_time: 1.8231416941, output_fired_time: 1.6465184689, propagate_forward_time: 56.8645362854, propagate_backward_time: 83.2394866943, weight_update_time: 0.1495408714, other_time: 3.7289276123
epoch time: 10.5049467087s, input_fired_time: 0.2215390503, output_fired_time: 0.0000000000, propagate_forward_time: 9.6698846817, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6135225296
validation[          , genome  6197] predictions:    9681/  10000 (96.81%), best:    9722/10000 (97.22%), error:      1046.81042, best error:       908.87817 on epoch:    60, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 148.4983367920s, input_fired_time: 3.8987276554, output_fired_time: 2.6485693455, propagate_forward_time: 55.9802436829, propagate_backward_time: 82.1963500977, weight_update_time: 0.1661502868, other_time: 3.7744445801
epoch time: 10.4284820557s, input_fired_time: 0.2183282822, output_fired_time: 0.0000000000, propagate_forward_time: 9.5870571136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6230964661
validation[          , genome  6197] predictions:    9729/  10000 (97.29%), best:    9722/10000 (97.22%), error:       965.80878, best error:       908.87817 on epoch:    60, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 138.6469268799s, input_fired_time: 1.7457001209, output_fired_time: 1.5329264402, propagate_forward_time: 50.9194755554, propagate_backward_time: 80.9254531860, weight_update_time: 0.1488846391, other_time: 3.5233688354
epoch time: 12.3316030502s, input_fired_time: 0.2279399633, output_fired_time: 0.0000000000, propagate_forward_time: 11.4455432892, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6581201553
validation[          , genome  6197] predictions:    9701/  10000 (97.01%), best:    9722/10000 (97.22%), error:      1032.07397, best error:       908.87817 on epoch:    60, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 139.3441314697s, input_fired_time: 1.7616634369, output_fired_time: 2.5999519825, propagate_forward_time: 49.1660079956, propagate_backward_time: 81.3352508545, weight_update_time: 0.1506223083, other_time: 4.4812698364
epoch time: 10.4844417572s, input_fired_time: 0.2211534381, output_fired_time: 0.0000000000, propagate_forward_time: 9.6440191269, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6192693710
validation[          , genome  6197] predictions:    9668/  10000 (96.68%), best:    9722/10000 (97.22%), error:      1123.16858, best error:       908.87817 on epoch:    60, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 145.5403289795s, input_fired_time: 1.8537347317, output_fired_time: 1.6002862453, propagate_forward_time: 53.3093910217, propagate_backward_time: 85.0084533691, weight_update_time: 0.1566147953, other_time: 3.7684783936
epoch time: 11.4250173569s, input_fired_time: 0.2393339425, output_fired_time: 0.0000000000, propagate_forward_time: 10.5079813004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6777019501
validation[          , genome  6197] predictions:    9723/  10000 (97.23%), best:    9722/10000 (97.22%), error:       934.65649, best error:       908.87817 on epoch:    60, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 140.4118957520s, input_fired_time: 1.7859194279, output_fired_time: 1.5552366972, propagate_forward_time: 51.4565544128, propagate_backward_time: 82.0440063477, weight_update_time: 0.1502377689, other_time: 3.5701751709
epoch time: 14.6577987671s, input_fired_time: 0.2475308031, output_fired_time: 0.0000000000, propagate_forward_time: 13.4631042480, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9471635818
validation[          , genome  6197] predictions:    9708/  10000 (97.08%), best:    9722/10000 (97.22%), error:      1019.47388, best error:       908.87817 on epoch:    60, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 145.9227294922s, input_fired_time: 1.8383283615, output_fired_time: 1.5697087049, propagate_forward_time: 51.3761367798, propagate_backward_time: 87.3358383179, weight_update_time: 0.1569395512, other_time: 3.8027191162
epoch time: 11.5419464111s, input_fired_time: 0.2250361145, output_fired_time: 0.0000000000, propagate_forward_time: 10.6917104721, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6252002716
validation[          , genome  6197] predictions:    9735/  10000 (97.35%), best:    9722/10000 (97.22%), error:       948.97583, best error:       908.87817 on epoch:    60, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 149.6656799316s, input_fired_time: 1.8747189045, output_fired_time: 1.6749048233, propagate_forward_time: 55.8225440979, propagate_backward_time: 86.4560623169, weight_update_time: 0.1579116732, other_time: 3.8374404907
epoch time: 11.4697961807s, input_fired_time: 0.2254070789, output_fired_time: 0.0000000000, propagate_forward_time: 10.6257734299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6186161041
validation[          , genome  6197] predictions:    9615/  10000 (96.15%), best:    9722/10000 (97.22%), error:      1275.99768, best error:       908.87817 on epoch:    60, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 144.7943267822s, input_fired_time: 1.8195749521, output_fired_time: 1.5736917257, propagate_forward_time: 55.3776741028, propagate_backward_time: 82.3395538330, weight_update_time: 0.1498824358, other_time: 3.6838378906
epoch time: 11.8285264969s, input_fired_time: 0.2301034629, output_fired_time: 0.0000000000, propagate_forward_time: 10.9596138000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6388092041
validation[          , genome  6197] predictions:    9677/  10000 (96.77%), best:    9722/10000 (97.22%), error:      1070.10913, best error:       908.87817 on epoch:    60, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 139.4763946533s, input_fired_time: 1.7566094398, output_fired_time: 1.5444687605, propagate_forward_time: 49.1521949768, propagate_backward_time: 83.4307327271, weight_update_time: 0.1498977542, other_time: 3.5923995972
epoch time: 11.2773180008s, input_fired_time: 0.2217218131, output_fired_time: 0.0000000000, propagate_forward_time: 10.4119997025, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6435966492
validation[          , genome  6197] predictions:    9716/  10000 (97.16%), best:    9722/10000 (97.22%), error:       984.53674, best error:       908.87817 on epoch:    60, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 143.5986480713s, input_fired_time: 1.7754702568, output_fired_time: 1.5606399775, propagate_forward_time: 54.9517250061, propagate_backward_time: 81.7147979736, weight_update_time: 0.1490073651, other_time: 3.5960235596
epoch time: 10.5910387039s, input_fired_time: 0.2222315371, output_fired_time: 0.0000000000, propagate_forward_time: 9.7461633682, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6226434708
validation[          , genome  6197] predictions:    9700/  10000 (97.00%), best:    9722/10000 (97.22%), error:       984.25226, best error:       908.87817 on epoch:    60, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 140.4534912109s, input_fired_time: 2.7571966648, output_fired_time: 1.5954147577, propagate_forward_time: 51.5330314636, propagate_backward_time: 81.0461273193, weight_update_time: 0.1501367390, other_time: 3.5217132568
epoch time: 12.1380548477s, input_fired_time: 0.2235778570, output_fired_time: 0.0000000000, propagate_forward_time: 11.2730321884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6414451599
validation[          , genome  6197] predictions:    9699/  10000 (96.99%), best:    9722/10000 (97.22%), error:      1017.32013, best error:       908.87817 on epoch:    60, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 160.8070678711s, input_fired_time: 2.0968308449, output_fired_time: 1.7747396231, propagate_forward_time: 59.5999641418, propagate_backward_time: 93.0473022461, weight_update_time: 0.1672452837, other_time: 4.2882385254
epoch time: 10.4599313736s, input_fired_time: 0.2222329676, output_fired_time: 0.0000000000, propagate_forward_time: 9.6099481583, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6277503967
validation[          , genome  6197] predictions:    9696/  10000 (96.96%), best:    9722/10000 (97.22%), error:      1051.13440, best error:       908.87817 on epoch:    60, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 139.1144409180s, input_fired_time: 1.7442753315, output_fired_time: 1.5827271938, propagate_forward_time: 50.0829315186, propagate_backward_time: 81.1577529907, weight_update_time: 0.1483538598, other_time: 4.5467453003
epoch time: 12.0870828629s, input_fired_time: 0.2281452417, output_fired_time: 0.0000000000, propagate_forward_time: 11.2145309448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6444063187
validation[          , genome  6197] predictions:    9725/  10000 (97.25%), best:    9722/10000 (97.22%), error:       939.33423, best error:       908.87817 on epoch:    60, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 141.8770446777s, input_fired_time: 1.7903690338, output_fired_time: 1.7767889500, propagate_forward_time: 53.8078346252, propagate_backward_time: 80.9807434082, weight_update_time: 0.1497413069, other_time: 3.5213012695
epoch time: 11.8317546844s, input_fired_time: 0.2275563627, output_fired_time: 0.0000000000, propagate_forward_time: 10.9661369324, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6380615234
validation[          , genome  6197] predictions:    9707/  10000 (97.07%), best:    9722/10000 (97.22%), error:       985.28638, best error:       908.87817 on epoch:    60, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 142.3978729248s, input_fired_time: 1.8147716522, output_fired_time: 1.5726748705, propagate_forward_time: 55.2327766418, propagate_backward_time: 80.2051162720, weight_update_time: 0.1500379592, other_time: 3.5725326538
epoch time: 10.5343875885s, input_fired_time: 0.2230095714, output_fired_time: 0.0000000000, propagate_forward_time: 9.6954946518, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6158838272
validation[          , genome  6197] predictions:    9714/  10000 (97.14%), best:    9722/10000 (97.22%), error:       995.60089, best error:       908.87817 on epoch:    60, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 140.5876464844s, input_fired_time: 1.8452650309, output_fired_time: 1.5471988916, propagate_forward_time: 53.7518882751, propagate_backward_time: 79.8818206787, weight_update_time: 0.1498923600, other_time: 3.5614776611
epoch time: 11.8624763489s, input_fired_time: 0.2282146066, output_fired_time: 0.0000000000, propagate_forward_time: 10.9889936447, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6452684402
validation[          , genome  6197] predictions:    9703/  10000 (97.03%), best:    9722/10000 (97.22%), error:      1013.34937, best error:       908.87817 on epoch:    60, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 140.5404663086s, input_fired_time: 2.7907330990, output_fired_time: 1.5587781668, propagate_forward_time: 50.6219520569, propagate_backward_time: 81.9712600708, weight_update_time: 0.1516432315, other_time: 3.5977554321
epoch time: 11.7408704758s, input_fired_time: 0.2293123156, output_fired_time: 0.0000000000, propagate_forward_time: 10.8708162308, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6407423019
validation[          , genome  6197] predictions:    9688/  10000 (96.88%), best:    9722/10000 (97.22%), error:      1044.12585, best error:       908.87817 on epoch:    60, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 141.1549530029s, input_fired_time: 1.7983945608, output_fired_time: 1.5458967686, propagate_forward_time: 51.9140510559, propagate_backward_time: 82.2675018311, weight_update_time: 0.1555910558, other_time: 3.6291046143
epoch time: 10.9635343552s, input_fired_time: 0.2227940410, output_fired_time: 0.0000000000, propagate_forward_time: 10.0988035202, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6419372559
validation[          , genome  6197] predictions:    9698/  10000 (96.98%), best:    9722/10000 (97.22%), error:      1073.61731, best error:       908.87817 on epoch:    60, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 151.6200714111s, input_fired_time: 2.0324234962, output_fired_time: 1.6146001816, propagate_forward_time: 57.0661315918, propagate_backward_time: 87.1366882324, weight_update_time: 0.1815319806, other_time: 3.7702331543
epoch time: 10.7344512939s, input_fired_time: 0.2194404900, output_fired_time: 0.0000000000, propagate_forward_time: 9.9167327881, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5982780457
validation[          , genome  6197] predictions:    9707/  10000 (97.07%), best:    9722/10000 (97.22%), error:      1024.23120, best error:       908.87817 on epoch:    60, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 149.6649169922s, input_fired_time: 1.9396727085, output_fired_time: 1.6538791656, propagate_forward_time: 54.7092094421, propagate_backward_time: 87.6544570923, weight_update_time: 0.1650388688, other_time: 3.7076950073
epoch time: 10.4271306992s, input_fired_time: 0.2227138877, output_fired_time: 0.0000000000, propagate_forward_time: 9.5807371140, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6236801147
validation[          , genome  6197] predictions:    9683/  10000 (96.83%), best:    9722/10000 (97.22%), error:      1042.87354, best error:       908.87817 on epoch:    60, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 149.3318023682s, input_fired_time: 1.8607851267, output_fired_time: 1.6662619114, propagate_forward_time: 56.3254508972, propagate_backward_time: 85.6527709961, weight_update_time: 0.1510339230, other_time: 3.8265380859
epoch time: 11.4756793976s, input_fired_time: 0.2350666523, output_fired_time: 0.0000000000, propagate_forward_time: 10.5913276672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6492853165
validation[          , genome  6197] predictions:    9716/  10000 (97.16%), best:    9722/10000 (97.22%), error:       944.37524, best error:       908.87817 on epoch:    60, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 145.0679779053s, input_fired_time: 2.8308098316, output_fired_time: 2.6055142879, propagate_forward_time: 52.4253196716, propagate_backward_time: 83.4849243164, weight_update_time: 0.1612498164, other_time: 3.7214050293
epoch time: 10.3777360916s, input_fired_time: 0.2217188925, output_fired_time: 0.0000000000, propagate_forward_time: 9.5257873535, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6302299500
validation[          , genome  6197] predictions:    9715/  10000 (97.15%), best:    9722/10000 (97.22%), error:       978.02106, best error:       908.87817 on epoch:    60, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 139.0052185059s, input_fired_time: 1.7661391497, output_fired_time: 1.5325253010, propagate_forward_time: 52.0036697388, propagate_backward_time: 80.1265563965, weight_update_time: 0.1529824585, other_time: 3.5763168335
epoch time: 11.4235982895s, input_fired_time: 0.2292741388, output_fired_time: 0.0000000000, propagate_forward_time: 10.5628557205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6314687729
validation[          , genome  6197] predictions:    9700/  10000 (97.00%), best:    9722/10000 (97.22%), error:      1042.82288, best error:       908.87817 on epoch:    60, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 138.1337585449s, input_fired_time: 1.7581353188, output_fired_time: 1.5284144878, propagate_forward_time: 49.5859107971, propagate_backward_time: 81.7685852051, weight_update_time: 0.1492828429, other_time: 3.4927215576
epoch time: 10.4708881378s, input_fired_time: 0.2240020633, output_fired_time: 0.0000000000, propagate_forward_time: 9.6127510071, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6341352463
validation[          , genome  6197] predictions:    9659/  10000 (96.59%), best:    9722/10000 (97.22%), error:      1150.70435, best error:       908.87817 on epoch:    60, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 138.3919219971s, input_fired_time: 1.7648354769, output_fired_time: 1.5308086872, propagate_forward_time: 51.3291206360, propagate_backward_time: 79.2340240479, weight_update_time: 0.1499392837, other_time: 4.5331420898
epoch time: 11.6431331635s, input_fired_time: 0.2291543931, output_fired_time: 0.0000000000, propagate_forward_time: 10.7759552002, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6380233765
validation[          , genome  6197] predictions:    9710/  10000 (97.10%), best:    9722/10000 (97.22%), error:       963.16663, best error:       908.87817 on epoch:    60, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 137.8621520996s, input_fired_time: 1.7798765898, output_fired_time: 1.5301539898, propagate_forward_time: 50.4857025146, propagate_backward_time: 80.5469512939, weight_update_time: 0.1487091333, other_time: 3.5194702148
epoch time: 10.4079837799s, input_fired_time: 0.2207170427, output_fired_time: 0.0000000000, propagate_forward_time: 9.5780229568, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6092433929
validation[          , genome  6197] predictions:    9603/  10000 (96.03%), best:    9722/10000 (97.22%), error:      1302.29150, best error:       908.87817 on epoch:    60, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 139.4869232178s, input_fired_time: 1.7499371767, output_fired_time: 1.5463287830, propagate_forward_time: 52.1056289673, propagate_backward_time: 80.4686813354, weight_update_time: 0.1496699452, other_time: 3.6163482666
epoch time: 19.5161170959s, input_fired_time: 0.3454427719, output_fired_time: 0.0000000000, propagate_forward_time: 18.0828990936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0877742767
validation[          , genome  6197] predictions:    9690/  10000 (96.90%), best:    9722/10000 (97.22%), error:      1040.50903, best error:       908.87817 on epoch:    60, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 58.8422775269s, input_fired_time: 1.1515802145, output_fired_time: 0.0000000000, propagate_forward_time: 54.2488288879, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4418678284
best training[          , genome  6197] predictions:   49261/  50000 (98.52%), best:    9722/10000 (97.22%), error:      2718.49902, best error:       908.87817 on epoch:    60, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 11.9238023758s, input_fired_time: 0.2403660268, output_fired_time: 0.0000000000, propagate_forward_time: 11.0450220108, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6384143829
   testing[          , genome  6197] predictions:    9743/  10000 (97.43%), best:    9722/10000 (97.22%), error:       827.07648, best error:       908.87817 on epoch:    60, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
03:07:05 (8): called boinc_finish(0)

</stderr_txt>
]]>