Nameexact_genome_1512568488_44_6546_0
Workunit2604074
Created7 Dec 2017, 20:30:21 UTC
Sent7 Dec 2017, 20:40:59 UTC
Report deadline15 Dec 2017, 2:10:20 UTC
Received8 Dec 2017, 21:31:55 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID4230
Run time3 hours 49 min 37 sec
CPU time3 hours 27 min 26 sec
Validate stateValid
Credit1,807.18
Device peak FLOPS2.72 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.69 MB
Peak swap size157.63 MB
Peak disk usage1.65 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
update_time: 0.0000000000, other_time: 0.4420070648
validation[          , genome  6546] predictions:    9686/  10000 (96.86%), best:    9699/10000 (96.99%), error:      1168.95044, best error:      1089.85181 on epoch:    12, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 119.8858642578s, input_fired_time: 1.4210971594, output_fired_time: 1.2311339378, propagate_forward_time: 45.1663894653, propagate_backward_time: 69.5533676147, weight_update_time: 0.1281893402, other_time: 2.5138778687
epoch time: 9.0988607407s, input_fired_time: 0.1469589621, output_fired_time: 0.0000000000, propagate_forward_time: 8.5113525391, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4405488968
validation[          , genome  6546] predictions:    9677/  10000 (96.77%), best:    9677/10000 (96.77%), error:      1045.28662, best error:      1045.28662 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 119.8927001953s, input_fired_time: 1.4397246838, output_fired_time: 1.3030425310, propagate_forward_time: 44.8439064026, propagate_backward_time: 69.6840209961, weight_update_time: 0.1240378469, other_time: 2.6220092773
epoch time: 9.1566295624s, input_fired_time: 0.1498905271, output_fired_time: 0.0000000000, propagate_forward_time: 8.5693044662, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4374341965
validation[          , genome  6546] predictions:    9645/  10000 (96.45%), best:    9677/10000 (96.77%), error:      1191.41272, best error:      1045.28662 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 120.0764999390s, input_fired_time: 1.3549371958, output_fired_time: 1.2632323503, propagate_forward_time: 45.0605621338, propagate_backward_time: 69.8341140747, weight_update_time: 0.1392716765, other_time: 2.5636596680
epoch time: 8.1299486160s, input_fired_time: 0.1381956041, output_fired_time: 0.0000000000, propagate_forward_time: 7.5854201317, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4063329697
validation[          , genome  6546] predictions:    9677/  10000 (96.77%), best:    9677/10000 (96.77%), error:      1064.75293, best error:      1045.28662 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 120.2324905396s, input_fired_time: 1.4222829342, output_fired_time: 1.2744287252, propagate_forward_time: 45.0303192139, propagate_backward_time: 69.9440536499, weight_update_time: 0.1289438903, other_time: 2.5614089966
epoch time: 11.5167446136s, input_fired_time: 0.1802811921, output_fired_time: 0.0000000000, propagate_forward_time: 10.7102184296, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6262445450
validation[          , genome  6546] predictions:    9627/  10000 (96.27%), best:    9677/10000 (96.77%), error:      1195.54724, best error:      1045.28662 on epoch:    15, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 142.9709930420s, input_fired_time: 1.6227159500, output_fired_time: 1.5066243410, propagate_forward_time: 53.6101150513, propagate_backward_time: 83.2896652222, weight_update_time: 0.1303110123, other_time: 2.9418792725
epoch time: 9.5257463455s, input_fired_time: 0.1623692811, output_fired_time: 0.0000000000, propagate_forward_time: 8.8882350922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4751415253
validation[          , genome  6546] predictions:    9679/  10000 (96.79%), best:    9677/10000 (96.77%), error:      1052.77148, best error:      1045.28662 on epoch:    15, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 146.9641876221s, input_fired_time: 1.7847526073, output_fired_time: 1.6300573349, propagate_forward_time: 55.0025825500, propagate_backward_time: 85.4157714844, weight_update_time: 0.1505972594, other_time: 3.1310272217
epoch time: 12.0623102188s, input_fired_time: 0.3085005581, output_fired_time: 0.0000000000, propagate_forward_time: 11.1530208588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6007890701
validation[          , genome  6546] predictions:    9646/  10000 (96.46%), best:    9677/10000 (96.77%), error:      1162.99988, best error:      1045.28662 on epoch:    15, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 133.7039947510s, input_fired_time: 1.6349624395, output_fired_time: 1.4477227926, propagate_forward_time: 49.6084976196, propagate_backward_time: 78.1755599976, weight_update_time: 0.1556446850, other_time: 2.8372497559
epoch time: 12.9719944000s, input_fired_time: 0.2040793747, output_fired_time: 0.0000000000, propagate_forward_time: 12.1477403641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6201744080
validation[          , genome  6546] predictions:    9710/  10000 (97.10%), best:    9710/10000 (97.10%), error:      1003.64423, best error:      1003.64423 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 146.5011596680s, input_fired_time: 2.2610037327, output_fired_time: 1.5579547882, propagate_forward_time: 53.9689102173, propagate_backward_time: 85.4911956787, weight_update_time: 0.1699991077, other_time: 3.2220993042
epoch time: 13.0155649185s, input_fired_time: 0.2717231214, output_fired_time: 0.0000000000, propagate_forward_time: 12.0777015686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6661405563
validation[          , genome  6546] predictions:    9642/  10000 (96.42%), best:    9710/10000 (97.10%), error:      1219.98193, best error:      1003.64423 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 125.4423522949s, input_fired_time: 1.4472203255, output_fired_time: 1.3611484766, propagate_forward_time: 47.2694625854, propagate_backward_time: 72.6722869873, weight_update_time: 0.1311549544, other_time: 2.6922378540
epoch time: 9.4942169189s, input_fired_time: 0.1645879596, output_fired_time: 0.0000000000, propagate_forward_time: 8.8703842163, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4592447281
validation[          , genome  6546] predictions:    9679/  10000 (96.79%), best:    9679/10000 (96.79%), error:       995.70801, best error:       995.70801 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 130.1624755859s, input_fired_time: 1.4138449430, output_fired_time: 1.3382668495, propagate_forward_time: 49.1516113281, propagate_backward_time: 75.3376464844, weight_update_time: 0.1317355782, other_time: 2.9211044312
epoch time: 10.4728584290s, input_fired_time: 0.1527846754, output_fired_time: 0.0000000000, propagate_forward_time: 9.8355226517, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4845514297
validation[          , genome  6546] predictions:    9669/  10000 (96.69%), best:    9679/10000 (96.79%), error:      1079.54956, best error:       995.70801 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 141.0046691895s, input_fired_time: 1.7914499044, output_fired_time: 1.5556050539, propagate_forward_time: 52.1943092346, propagate_backward_time: 82.1581649780, weight_update_time: 0.1796326935, other_time: 3.3051528931
epoch time: 9.8353586197s, input_fired_time: 0.1584499329, output_fired_time: 0.0000000000, propagate_forward_time: 9.1845111847, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4923973083
validation[          , genome  6546] predictions:    9710/  10000 (97.10%), best:    9710/10000 (97.10%), error:       973.63989, best error:       973.63989 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 130.2184600830s, input_fired_time: 1.4630470276, output_fired_time: 1.3561300039, propagate_forward_time: 49.1061286926, propagate_backward_time: 75.4368667603, weight_update_time: 0.1535560489, other_time: 2.8562850952
epoch time: 9.4065418243s, input_fired_time: 0.1541367471, output_fired_time: 0.0000000000, propagate_forward_time: 8.7934942245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4589109421
validation[          , genome  6546] predictions:    9705/  10000 (97.05%), best:    9710/10000 (97.10%), error:       992.28729, best error:       973.63989 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 124.8487701416s, input_fired_time: 1.5331664085, output_fired_time: 1.3633227348, propagate_forward_time: 46.9356765747, propagate_backward_time: 72.3010177612, weight_update_time: 0.1294146627, other_time: 2.7155914307
epoch time: 12.6917600632s, input_fired_time: 0.2025548816, output_fired_time: 0.0000000000, propagate_forward_time: 11.8331241608, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6560811996
validation[          , genome  6546] predictions:    9678/  10000 (96.78%), best:    9710/10000 (97.10%), error:      1052.77075, best error:       973.63989 on epoch:    25, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 125.3536071777s, input_fired_time: 1.4652667046, output_fired_time: 1.4607722759, propagate_forward_time: 46.7349395752, propagate_backward_time: 72.9520339966, weight_update_time: 0.1399950534, other_time: 2.7406005859
epoch time: 9.3805236816s, input_fired_time: 0.1583108157, output_fired_time: 0.0000000000, propagate_forward_time: 8.7700242996, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4521884918
validation[          , genome  6546] predictions:    9714/  10000 (97.14%), best:    9710/10000 (97.10%), error:       984.08014, best error:       973.63989 on epoch:    25, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 124.2932968140s, input_fired_time: 1.4912717342, output_fired_time: 1.3456060886, propagate_forward_time: 46.3532676697, propagate_backward_time: 72.3538665771, weight_update_time: 0.1734051853, other_time: 2.7492828369
epoch time: 9.4207038879s, input_fired_time: 0.1549619138, output_fired_time: 0.0000000000, propagate_forward_time: 8.7765884399, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4891538620
validation[          , genome  6546] predictions:    9691/  10000 (96.91%), best:    9710/10000 (97.10%), error:      1040.90125, best error:       973.63989 on epoch:    25, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 159.0429382324s, input_fired_time: 1.9875651598, output_fired_time: 1.6202652454, propagate_forward_time: 60.1980018616, propagate_backward_time: 91.5770645142, weight_update_time: 0.1406861693, other_time: 3.6600418091
epoch time: 12.9751663208s, input_fired_time: 0.2464801818, output_fired_time: 0.0000000000, propagate_forward_time: 12.0688467026, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6598396301
validation[          , genome  6546] predictions:    9599/  10000 (95.99%), best:    9710/10000 (97.10%), error:      1243.71082, best error:       973.63989 on epoch:    25, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 168.4559631348s, input_fired_time: 2.1655516624, output_fired_time: 1.7084529400, propagate_forward_time: 62.5625038147, propagate_backward_time: 98.3089141846, weight_update_time: 0.1705395728, other_time: 3.7105407715
epoch time: 12.1425180435s, input_fired_time: 0.1822276264, output_fired_time: 0.0000000000, propagate_forward_time: 11.3328256607, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6274642944
validation[          , genome  6546] predictions:    9674/  10000 (96.74%), best:    9710/10000 (97.10%), error:      1045.03223, best error:       973.63989 on epoch:    25, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 142.1722106934s, input_fired_time: 1.7235854864, output_fired_time: 1.4905927181, propagate_forward_time: 52.9995689392, propagate_backward_time: 82.9114379883, weight_update_time: 0.1404779404, other_time: 3.0470275879
epoch time: 13.6368694305s, input_fired_time: 0.2617586851, output_fired_time: 0.0000000000, propagate_forward_time: 12.6151638031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7599468231
validation[          , genome  6546] predictions:    9649/  10000 (96.49%), best:    9710/10000 (97.10%), error:      1169.00073, best error:       973.63989 on epoch:    25, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 145.2196655273s, input_fired_time: 1.7705553770, output_fired_time: 1.6620879173, propagate_forward_time: 53.5080261230, propagate_backward_time: 85.1274490356, weight_update_time: 0.2169289440, other_time: 3.1515426636
epoch time: 10.4635314941s, input_fired_time: 0.1651596427, output_fired_time: 0.0000000000, propagate_forward_time: 9.7507352829, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5476369858
validation[          , genome  6546] predictions:    9680/  10000 (96.80%), best:    9710/10000 (97.10%), error:      1051.32031, best error:       973.63989 on epoch:    25, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 137.1604614258s, input_fired_time: 1.6566255093, output_fired_time: 1.5157365799, propagate_forward_time: 50.8773651123, propagate_backward_time: 80.1088790894, weight_update_time: 0.1381210685, other_time: 3.0018539429
epoch time: 14.0189285278s, input_fired_time: 0.3413845003, output_fired_time: 0.0000000000, propagate_forward_time: 12.9610881805, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7164554596
validation[          , genome  6546] predictions:    9681/  10000 (96.81%), best:    9710/10000 (97.10%), error:      1036.34521, best error:       973.63989 on epoch:    25, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 149.0905761719s, input_fired_time: 1.8316277266, output_fired_time: 1.5105109215, propagate_forward_time: 55.2236480713, propagate_backward_time: 87.0881576538, weight_update_time: 0.1725721657, other_time: 3.4366226196
epoch time: 10.2261705399s, input_fired_time: 0.1689441800, output_fired_time: 0.0000000000, propagate_forward_time: 9.5635566711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4936695099
validation[          , genome  6546] predictions:    9679/  10000 (96.79%), best:    9710/10000 (97.10%), error:      1099.33118, best error:       973.63989 on epoch:    25, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 122.5553894043s, input_fired_time: 1.3575925827, output_fired_time: 1.3020682335, propagate_forward_time: 45.9511222839, propagate_backward_time: 71.3527832031, weight_update_time: 0.1237540841, other_time: 2.5918273926
epoch time: 12.1079463959s, input_fired_time: 0.1915421784, output_fired_time: 0.0000000000, propagate_forward_time: 11.2469444275, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6694593430
validation[          , genome  6546] predictions:    9701/  10000 (97.01%), best:    9701/10000 (97.01%), error:       953.08936, best error:       953.08936 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 120.2553405762s, input_fired_time: 1.3775346279, output_fired_time: 1.2649887800, propagate_forward_time: 45.3669395447, propagate_backward_time: 69.7647399902, weight_update_time: 0.1235153079, other_time: 2.4811401367
epoch time: 9.1573219299s, input_fired_time: 0.1506956518, output_fired_time: 0.0000000000, propagate_forward_time: 8.5665349960, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4400911331
validation[          , genome  6546] predictions:    9679/  10000 (96.79%), best:    9701/10000 (97.01%), error:      1076.40051, best error:       953.08936 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 120.0834655762s, input_fired_time: 1.3717292547, output_fired_time: 1.3059352636, propagate_forward_time: 45.0203933716, propagate_backward_time: 69.7772369385, weight_update_time: 0.1581671536, other_time: 2.6081695557
epoch time: 9.1520996094s, input_fired_time: 0.1508612484, output_fired_time: 0.0000000000, propagate_forward_time: 8.5549983978, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4462404251
validation[          , genome  6546] predictions:    9712/  10000 (97.12%), best:    9701/10000 (97.01%), error:       977.56677, best error:       953.08936 on epoch:    36, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 120.1054687500s, input_fired_time: 1.4271099567, output_fired_time: 1.2807722092, propagate_forward_time: 45.1385879517, propagate_backward_time: 69.7204055786, weight_update_time: 0.1499098986, other_time: 2.5385971069
epoch time: 9.1537122726s, input_fired_time: 0.1513305604, output_fired_time: 0.0000000000, propagate_forward_time: 8.5568399429, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4455413818
validation[          , genome  6546] predictions:    9728/  10000 (97.28%), best:    9728/10000 (97.28%), error:       910.39691, best error:       910.39691 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 119.7596740723s, input_fired_time: 1.4383192062, output_fired_time: 1.2442649603, propagate_forward_time: 45.0928421021, propagate_backward_time: 69.4661026001, weight_update_time: 0.1236854345, other_time: 2.5181503296
epoch time: 9.1343126297s, input_fired_time: 0.1519850194, output_fired_time: 0.0000000000, propagate_forward_time: 8.5363502502, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4459772110
validation[          , genome  6546] predictions:    9695/  10000 (96.95%), best:    9728/10000 (97.28%), error:       941.86688, best error:       910.39691 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 120.0829010010s, input_fired_time: 1.3693470955, output_fired_time: 1.3057206869, propagate_forward_time: 45.2215042114, propagate_backward_time: 69.6684341431, weight_update_time: 0.1304192841, other_time: 2.5178985596
epoch time: 9.1393880844s, input_fired_time: 0.1519304514, output_fired_time: 0.0000000000, propagate_forward_time: 8.5475616455, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4398956299
validation[          , genome  6546] predictions:    9741/  10000 (97.41%), best:    9741/10000 (97.41%), error:       865.04004, best error:       865.04004 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 119.8816223145s, input_fired_time: 1.3988050222, output_fired_time: 1.2566301823, propagate_forward_time: 45.1362457275, propagate_backward_time: 69.5563201904, weight_update_time: 0.1335559040, other_time: 2.5336227417
epoch time: 12.0693721771s, input_fired_time: 0.2103180438, output_fired_time: 0.0000000000, propagate_forward_time: 11.3234634399, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5355911255
validation[          , genome  6546] predictions:    9718/  10000 (97.18%), best:    9741/10000 (97.41%), error:       931.24780, best error:       865.04004 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 120.5536422729s, input_fired_time: 1.4221053123, output_fired_time: 1.2367610931, propagate_forward_time: 45.1820449829, propagate_backward_time: 70.1316604614, weight_update_time: 0.1237315238, other_time: 2.5810699463
epoch time: 9.1475400925s, input_fired_time: 0.1525312066, output_fired_time: 0.0000000000, propagate_forward_time: 8.5557613373, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4392471313
validation[          , genome  6546] predictions:    9726/  10000 (97.26%), best:    9741/10000 (97.41%), error:       903.16772, best error:       865.04004 on epoch:    41, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 120.1313323975s, input_fired_time: 1.4280146360, output_fired_time: 1.3072434664, propagate_forward_time: 45.3828735352, propagate_backward_time: 69.5603637695, weight_update_time: 0.1227959096, other_time: 2.4528350830
epoch time: 9.1497640610s, input_fired_time: 0.1534182280, output_fired_time: 0.0000000000, propagate_forward_time: 8.5598926544, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4364528656
validation[          , genome  6546] predictions:    9715/  10000 (97.15%), best:    9741/10000 (97.41%), error:       998.93195, best error:       865.04004 on epoch:    41, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 119.9904022217s, input_fired_time: 1.4093174934, output_fired_time: 1.2331181765, propagate_forward_time: 45.1475257874, propagate_backward_time: 69.6642913818, weight_update_time: 0.1352724135, other_time: 2.5361480713
epoch time: 9.0952501297s, input_fired_time: 0.1520089209, output_fired_time: 0.0000000000, propagate_forward_time: 8.5091485977, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4340925217
validation[          , genome  6546] predictions:    9737/  10000 (97.37%), best:    9741/10000 (97.41%), error:       881.20990, best error:       865.04004 on epoch:    41, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 120.3760223389s, input_fired_time: 1.4065399170, output_fired_time: 1.2519571781, propagate_forward_time: 45.4379463196, propagate_backward_time: 69.7675552368, weight_update_time: 0.1434805989, other_time: 2.5120162964
epoch time: 9.2380342484s, input_fired_time: 0.1518327892, output_fired_time: 0.0000000000, propagate_forward_time: 8.6221752167, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4640264511
validation[          , genome  6546] predictions:    9676/  10000 (96.76%), best:    9741/10000 (97.41%), error:      1031.65271, best error:       865.04004 on epoch:    41, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 120.1035079956s, input_fired_time: 1.4107749462, output_fired_time: 1.2170813084, propagate_forward_time: 44.9012565613, propagate_backward_time: 70.0291595459, weight_update_time: 0.1516969949, other_time: 2.5452423096
epoch time: 9.1463270187s, input_fired_time: 0.1557218432, output_fired_time: 0.0000000000, propagate_forward_time: 8.5443067551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4462985992
validation[          , genome  6546] predictions:    9728/  10000 (97.28%), best:    9741/10000 (97.41%), error:       916.98773, best error:       865.04004 on epoch:    41, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 120.0458602905s, input_fired_time: 1.4071094990, output_fired_time: 1.2668945789, propagate_forward_time: 45.2139205933, propagate_backward_time: 69.6256942749, weight_update_time: 0.1234932840, other_time: 2.5322418213
epoch time: 12.2271461487s, input_fired_time: 0.2004143447, output_fired_time: 0.0000000000, propagate_forward_time: 11.4428281784, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5839033127
validation[          , genome  6546] predictions:    9720/  10000 (97.20%), best:    9741/10000 (97.41%), error:       888.85217, best error:       865.04004 on epoch:    41, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 120.0297164917s, input_fired_time: 1.3953138590, output_fired_time: 1.2973967791, propagate_forward_time: 45.1331863403, propagate_backward_time: 69.6861724854, weight_update_time: 0.1242452189, other_time: 2.5176467896
epoch time: 9.1361045837s, input_fired_time: 0.1523972303, output_fired_time: 0.0000000000, propagate_forward_time: 8.5300197601, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4536876678
validation[          , genome  6546] predictions:    9724/  10000 (97.24%), best:    9741/10000 (97.41%), error:       940.16882, best error:       865.04004 on epoch:    41, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 120.1662139893s, input_fired_time: 1.4156516790, output_fired_time: 1.2417788506, propagate_forward_time: 45.0807723999, propagate_backward_time: 69.9530334473, weight_update_time: 0.1236006245, other_time: 2.4749832153
epoch time: 9.1713781357s, input_fired_time: 0.1531835347, output_fired_time: 0.0000000000, propagate_forward_time: 8.5748195648, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4433746338
validation[          , genome  6546] predictions:    9716/  10000 (97.16%), best:    9741/10000 (97.41%), error:       947.37433, best error:       865.04004 on epoch:    41, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 120.0708694458s, input_fired_time: 1.3860404491, output_fired_time: 1.2572715282, propagate_forward_time: 45.1742744446, propagate_backward_time: 69.7593231201, weight_update_time: 0.1403522193, other_time: 2.4939575195
epoch time: 9.1517667770s, input_fired_time: 0.1590494066, output_fired_time: 0.0000000000, propagate_forward_time: 8.5462884903, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4464292526
validation[          , genome  6546] predictions:    9718/  10000 (97.18%), best:    9741/10000 (97.41%), error:       937.49774, best error:       865.04004 on epoch:    41, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 119.8922576904s, input_fired_time: 1.3847396374, output_fired_time: 1.2045676708, propagate_forward_time: 45.2075004578, propagate_backward_time: 69.5112686157, weight_update_time: 0.1423991472, other_time: 2.5841751099
epoch time: 9.1774787903s, input_fired_time: 0.1569352150, output_fired_time: 0.0000000000, propagate_forward_time: 8.5847482681, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4357957840
validation[          , genome  6546] predictions:    9688/  10000 (96.88%), best:    9741/10000 (97.41%), error:      1082.40088, best error:       865.04004 on epoch:    41, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 119.8776321411s, input_fired_time: 1.4000432491, output_fired_time: 1.2386426926, propagate_forward_time: 45.1541786194, propagate_backward_time: 69.6085815430, weight_update_time: 0.1262892038, other_time: 2.4761962891
epoch time: 9.1658296585s, input_fired_time: 0.1533355117, output_fired_time: 0.0000000000, propagate_forward_time: 8.5525054932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4599885941
validation[          , genome  6546] predictions:    9638/  10000 (96.38%), best:    9741/10000 (97.41%), error:      1091.60535, best error:       865.04004 on epoch:    41, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 124.0020217896s, input_fired_time: 1.4824761152, output_fired_time: 1.3022083044, propagate_forward_time: 46.2777404785, propagate_backward_time: 72.3202743530, weight_update_time: 0.1511769444, other_time: 2.6193237305
epoch time: 11.9886293411s, input_fired_time: 0.1726041585, output_fired_time: 0.0000000000, propagate_forward_time: 11.2665195465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5495052338
validation[          , genome  6546] predictions:    9743/  10000 (97.43%), best:    9741/10000 (97.41%), error:       889.04834, best error:       865.04004 on epoch:    41, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 121.0157928467s, input_fired_time: 1.4619705677, output_fired_time: 1.2535140514, propagate_forward_time: 45.2346687317, propagate_backward_time: 70.4364013672, weight_update_time: 0.1305847317, other_time: 2.6292419434
epoch time: 9.1179180145s, input_fired_time: 0.1532680392, output_fired_time: 0.0000000000, propagate_forward_time: 8.5316629410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4329872131
validation[          , genome  6546] predictions:    9728/  10000 (97.28%), best:    9741/10000 (97.41%), error:       874.32947, best error:       865.04004 on epoch:    41, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 120.2228393555s, input_fired_time: 1.3931607008, output_fired_time: 1.2304654121, propagate_forward_time: 45.1963348389, propagate_backward_time: 69.8633346558, weight_update_time: 0.1262305081, other_time: 2.5395431519
epoch time: 9.2135744095s, input_fired_time: 0.1540697813, output_fired_time: 0.0000000000, propagate_forward_time: 8.6247224808, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4347820282
validation[          , genome  6546] predictions:    9664/  10000 (96.64%), best:    9741/10000 (97.41%), error:      1042.29858, best error:       865.04004 on epoch:    41, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 119.9886703491s, input_fired_time: 1.4827125072, output_fired_time: 1.3528833389, propagate_forward_time: 44.9739303589, propagate_backward_time: 69.6840667725, weight_update_time: 0.1288469136, other_time: 2.4950790405
epoch time: 9.1354379654s, input_fired_time: 0.1553015262, output_fired_time: 0.0000000000, propagate_forward_time: 8.5420742035, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4380626678
validation[          , genome  6546] predictions:    9717/  10000 (97.17%), best:    9741/10000 (97.41%), error:      1011.43127, best error:       865.04004 on epoch:    41, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 119.9316253662s, input_fired_time: 1.4258843660, output_fired_time: 1.2799971104, propagate_forward_time: 44.9890251160, propagate_backward_time: 69.6660308838, weight_update_time: 0.1300008893, other_time: 2.5706787109
epoch time: 9.1049299240s, input_fired_time: 0.1548087150, output_fired_time: 0.0000000000, propagate_forward_time: 8.5075120926, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4426088333
validation[          , genome  6546] predictions:    9725/  10000 (97.25%), best:    9741/10000 (97.41%), error:       885.05066, best error:       865.04004 on epoch:    41, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 120.0675735474s, input_fired_time: 1.3681834936, output_fired_time: 1.3234224319, propagate_forward_time: 45.2373085022, propagate_backward_time: 69.6578521729, weight_update_time: 0.1270560622, other_time: 2.4808044434
epoch time: 10.3461599350s, input_fired_time: 0.1585775316, output_fired_time: 0.0000000000, propagate_forward_time: 9.7093343735, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4782476425
validation[          , genome  6546] predictions:    9618/  10000 (96.18%), best:    9741/10000 (97.41%), error:      1187.08179, best error:       865.04004 on epoch:    41, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 120.1189041138s, input_fired_time: 1.3809748888, output_fired_time: 1.2588214874, propagate_forward_time: 45.3301048279, propagate_backward_time: 69.6135940552, weight_update_time: 0.1232988983, other_time: 2.5354080200
epoch time: 10.9355745316s, input_fired_time: 0.1795921177, output_fired_time: 0.0000000000, propagate_forward_time: 10.2092876434, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5466947556
validation[          , genome  6546] predictions:    9697/  10000 (96.97%), best:    9741/10000 (97.41%), error:       929.87878, best error:       865.04004 on epoch:    41, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 120.1440887451s, input_fired_time: 1.4312877655, output_fired_time: 1.2684779167, propagate_forward_time: 45.2117881775, propagate_backward_time: 69.6914901733, weight_update_time: 0.1234118342, other_time: 2.5410385132
epoch time: 9.1298818588s, input_fired_time: 0.1555354148, output_fired_time: 0.0000000000, propagate_forward_time: 8.5329122543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4414339066
validation[          , genome  6546] predictions:    9708/  10000 (97.08%), best:    9741/10000 (97.41%), error:       926.55200, best error:       865.04004 on epoch:    41, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 120.0823211670s, input_fired_time: 1.3660699129, output_fired_time: 1.2378413677, propagate_forward_time: 45.2040176392, propagate_backward_time: 69.7519989014, weight_update_time: 0.1230692640, other_time: 2.5223922729
epoch time: 9.1408147812s, input_fired_time: 0.1559223533, output_fired_time: 0.0000000000, propagate_forward_time: 8.5416870117, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4432058334
validation[          , genome  6546] predictions:    9726/  10000 (97.26%), best:    9741/10000 (97.41%), error:       945.28705, best error:       865.04004 on epoch:    41, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 120.3146591187s, input_fired_time: 1.4797936678, output_fired_time: 1.2508651018, propagate_forward_time: 45.1591110229, propagate_backward_time: 69.8621520996, weight_update_time: 0.1267390847, other_time: 2.5627365112
epoch time: 9.1683940887s, input_fired_time: 0.1576934606, output_fired_time: 0.0000000000, propagate_forward_time: 8.5725955963, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4381046295
validation[          , genome  6546] predictions:    9653/  10000 (96.53%), best:    9741/10000 (97.41%), error:      1108.66931, best error:       865.04004 on epoch:    41, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 120.0595626831s, input_fired_time: 1.3719450235, output_fired_time: 1.2303394079, propagate_forward_time: 45.2437286377, propagate_backward_time: 69.7070693970, weight_update_time: 0.1351710558, other_time: 2.5064773560
epoch time: 9.1368341446s, input_fired_time: 0.1630655825, output_fired_time: 0.0000000000, propagate_forward_time: 8.5255451202, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4482231140
validation[          , genome  6546] predictions:    9726/  10000 (97.26%), best:    9741/10000 (97.41%), error:       882.73010, best error:       865.04004 on epoch:    41, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 119.8665390015s, input_fired_time: 1.3932908773, output_fired_time: 1.3001700640, propagate_forward_time: 45.0006866455, propagate_backward_time: 69.6279296875, weight_update_time: 0.1249269545, other_time: 2.5444641113
epoch time: 10.3404312134s, input_fired_time: 0.1654844433, output_fired_time: 0.0000000000, propagate_forward_time: 9.7019834518, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4729633331
validation[          , genome  6546] predictions:    9745/  10000 (97.45%), best:    9741/10000 (97.41%), error:       918.82141, best error:       865.04004 on epoch:    41, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 120.0769958496s, input_fired_time: 1.4196481705, output_fired_time: 1.2301809788, propagate_forward_time: 45.1104736328, propagate_backward_time: 69.7935104370, weight_update_time: 0.1343359947, other_time: 2.5231857300
epoch time: 10.9743814468s, input_fired_time: 0.1930645704, output_fired_time: 0.0000000000, propagate_forward_time: 10.2365989685, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5447177887
validation[          , genome  6546] predictions:    9715/  10000 (97.15%), best:    9741/10000 (97.41%), error:       987.86353, best error:       865.04004 on epoch:    41, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 120.6624374390s, input_fired_time: 1.4340386391, output_fired_time: 1.2545033693, propagate_forward_time: 45.3012733459, propagate_backward_time: 70.1515884399, weight_update_time: 0.1483027041, other_time: 2.5210342407
epoch time: 9.0968198776s, input_fired_time: 0.1558442563, output_fired_time: 0.0000000000, propagate_forward_time: 8.4901924133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4507827759
validation[          , genome  6546] predictions:    9733/  10000 (97.33%), best:    9741/10000 (97.41%), error:       911.66235, best error:       865.04004 on epoch:    41, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 120.1369781494s, input_fired_time: 1.4478421211, output_fired_time: 1.3003554344, propagate_forward_time: 45.1382560730, propagate_backward_time: 69.7752532959, weight_update_time: 0.1243006662, other_time: 2.4752655029
epoch time: 9.1746997833s, input_fired_time: 0.1560174525, output_fired_time: 0.0000000000, propagate_forward_time: 8.5752105713, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4434719086
validation[          , genome  6546] predictions:    9730/  10000 (97.30%), best:    9741/10000 (97.41%), error:       941.01752, best error:       865.04004 on epoch:    41, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 119.4275588989s, input_fired_time: 1.4229978323, output_fired_time: 1.2693723440, propagate_forward_time: 44.8766746521, propagate_backward_time: 69.3050460815, weight_update_time: 0.1521933526, other_time: 2.5534744263
epoch time: 9.1649951935s, input_fired_time: 0.1544089466, output_fired_time: 0.0000000000, propagate_forward_time: 8.5745468140, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4360389709
validation[          , genome  6546] predictions:    9723/  10000 (97.23%), best:    9741/10000 (97.41%), error:       894.74121, best error:       865.04004 on epoch:    41, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 120.0321578979s, input_fired_time: 1.4885333776, output_fired_time: 1.3186042309, propagate_forward_time: 45.0661926270, propagate_backward_time: 69.6138000488, weight_update_time: 0.1233077794, other_time: 2.5450286865
epoch time: 9.1656732559s, input_fired_time: 0.1554572731, output_fired_time: 0.0000000000, propagate_forward_time: 8.5732259750, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4369897842
validation[          , genome  6546] predictions:    9684/  10000 (96.84%), best:    9741/10000 (97.41%), error:      1048.95984, best error:       865.04004 on epoch:    41, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 120.0183029175s, input_fired_time: 1.3725610971, output_fired_time: 1.2663564682, propagate_forward_time: 45.0586853027, propagate_backward_time: 69.7576370239, weight_update_time: 0.1356413662, other_time: 2.5630645752
epoch time: 10.2409887314s, input_fired_time: 0.1754061133, output_fired_time: 0.0000000000, propagate_forward_time: 9.5780220032, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4875602722
validation[          , genome  6546] predictions:    9669/  10000 (96.69%), best:    9741/10000 (97.41%), error:      1069.29272, best error:       865.04004 on epoch:    41, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 119.8404388428s, input_fired_time: 1.3602108955, output_fired_time: 1.2721847296, propagate_forward_time: 44.9349594116, propagate_backward_time: 69.7526931763, weight_update_time: 0.1419519484, other_time: 2.5203857422
epoch time: 11.2219686508s, input_fired_time: 0.2313544899, output_fired_time: 0.0000000000, propagate_forward_time: 10.4899187088, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5006952286
validation[          , genome  6546] predictions:    9704/  10000 (97.04%), best:    9741/10000 (97.41%), error:       941.70197, best error:       865.04004 on epoch:    41, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 130.4162750244s, input_fired_time: 1.6692802906, output_fired_time: 1.3717190027, propagate_forward_time: 48.4893074036, propagate_backward_time: 76.1529235840, weight_update_time: 0.1352243125, other_time: 2.7330474854
epoch time: 11.2161970139s, input_fired_time: 0.2113723159, output_fired_time: 0.0000000000, propagate_forward_time: 10.4464988708, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5583257675
validation[          , genome  6546] predictions:    9686/  10000 (96.86%), best:    9741/10000 (97.41%), error:      1019.35950, best error:       865.04004 on epoch:    41, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 154.5694580078s, input_fired_time: 1.9512903690, output_fired_time: 1.6070768833, propagate_forward_time: 57.1407165527, propagate_backward_time: 90.6801147461, weight_update_time: 0.2418166101, other_time: 3.1902618408
epoch time: 11.8760442734s, input_fired_time: 0.2107976079, output_fired_time: 0.0000000000, propagate_forward_time: 11.1138219833, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5514249802
validation[          , genome  6546] predictions:    9728/  10000 (97.28%), best:    9741/10000 (97.41%), error:       884.20929, best error:       865.04004 on epoch:    41, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 149.9841766357s, input_fired_time: 1.7273563147, output_fired_time: 1.7353883982, propagate_forward_time: 55.0509033203, propagate_backward_time: 88.0710678101, weight_update_time: 0.1788073331, other_time: 3.3994674683
epoch time: 11.9723091125s, input_fired_time: 0.2006894946, output_fired_time: 0.0000000000, propagate_forward_time: 11.1873722076, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5842475891
validation[          , genome  6546] predictions:    9689/  10000 (96.89%), best:    9741/10000 (97.41%), error:      1030.07654, best error:       865.04004 on epoch:    41, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 139.0831146240s, input_fired_time: 1.7423013449, output_fired_time: 1.6119720936, propagate_forward_time: 51.6704597473, propagate_backward_time: 80.9021224976, weight_update_time: 0.2060445547, other_time: 3.1562728882
epoch time: 10.3129997253s, input_fired_time: 0.1774638444, output_fired_time: 0.0000000000, propagate_forward_time: 9.6282157898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5073204041
validation[          , genome  6546] predictions:    9695/  10000 (96.95%), best:    9741/10000 (97.41%), error:       938.31146, best error:       865.04004 on epoch:    41, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 130.2053680420s, input_fired_time: 1.5244417191, output_fired_time: 1.3642487526, propagate_forward_time: 48.7650566101, propagate_backward_time: 75.7363052368, weight_update_time: 0.1332775652, other_time: 2.8153152466
epoch time: 9.1866092682s, input_fired_time: 0.1559223980, output_fired_time: 0.0000000000, propagate_forward_time: 8.5906963348, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4399909973
validation[          , genome  6546] predictions:    9732/  10000 (97.32%), best:    9741/10000 (97.41%), error:       892.11981, best error:       865.04004 on epoch:    41, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 120.5026855469s, input_fired_time: 1.4401499033, output_fired_time: 1.2340085506, propagate_forward_time: 45.1815299988, propagate_backward_time: 70.1062316895, weight_update_time: 0.1340651363, other_time: 2.5407714844
epoch time: 11.1118688583s, input_fired_time: 0.1608968377, output_fired_time: 0.0000000000, propagate_forward_time: 10.3198337555, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6311378479
validation[          , genome  6546] predictions:    9692/  10000 (96.92%), best:    9741/10000 (97.41%), error:       986.79565, best error:       865.04004 on epoch:    41, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 120.2332611084s, input_fired_time: 1.4771646261, output_fired_time: 1.3255785704, propagate_forward_time: 45.1557731628, propagate_backward_time: 69.7328948975, weight_update_time: 0.1397546530, other_time: 2.5418548584
epoch time: 10.2379541397s, input_fired_time: 0.1742784232, output_fired_time: 0.0000000000, propagate_forward_time: 9.6001329422, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4635429382
validation[          , genome  6546] predictions:    9719/  10000 (97.19%), best:    9741/10000 (97.41%), error:       911.52057, best error:       865.04004 on epoch:    41, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 120.0962829590s, input_fired_time: 1.3781960011, output_fired_time: 1.2234734297, propagate_forward_time: 44.9744796753, propagate_backward_time: 69.9243240356, weight_update_time: 0.1348301321, other_time: 2.5958099365
epoch time: 9.1303224564s, input_fired_time: 0.1572659016, output_fired_time: 0.0000000000, propagate_forward_time: 8.5308952332, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4421615601
validation[          , genome  6546] predictions:    9721/  10000 (97.21%), best:    9741/10000 (97.41%), error:       871.83405, best error:       865.04004 on epoch:    41, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 120.0184097290s, input_fired_time: 1.4283859730, output_fired_time: 1.3103866577, propagate_forward_time: 45.1055908203, propagate_backward_time: 69.6103057861, weight_update_time: 0.1316229403, other_time: 2.5637435913
epoch time: 9.1563358307s, input_fired_time: 0.1570671052, output_fired_time: 0.0000000000, propagate_forward_time: 8.5589599609, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4403085709
validation[          , genome  6546] predictions:    9709/  10000 (97.09%), best:    9741/10000 (97.41%), error:       999.54694, best error:       865.04004 on epoch:    41, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 123.8801498413s, input_fired_time: 1.5168403387, output_fired_time: 1.3470324278, propagate_forward_time: 46.4880981445, propagate_backward_time: 71.9746398926, weight_update_time: 0.1251484603, other_time: 2.5535430908
epoch time: 9.1541013718s, input_fired_time: 0.1625979841, output_fired_time: 0.0000000000, propagate_forward_time: 8.5459623337, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4455413818
validation[          , genome  6546] predictions:    9728/  10000 (97.28%), best:    9741/10000 (97.41%), error:       876.71198, best error:       865.04004 on epoch:    41, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 120.2875518799s, input_fired_time: 1.5297826529, output_fired_time: 1.2557420731, propagate_forward_time: 45.1504859924, propagate_backward_time: 69.8163604736, weight_update_time: 0.1236983165, other_time: 2.5351715088
epoch time: 9.2617988586s, input_fired_time: 0.1575952768, output_fired_time: 0.0000000000, propagate_forward_time: 8.6609058380, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4432973862
validation[          , genome  6546] predictions:    9697/  10000 (96.97%), best:    9741/10000 (97.41%), error:       951.30768, best error:       865.04004 on epoch:    41, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 120.0731201172s, input_fired_time: 1.3980388641, output_fired_time: 1.2515826225, propagate_forward_time: 45.1112785339, propagate_backward_time: 69.7601394653, weight_update_time: 0.1448994279, other_time: 2.5520858765
epoch time: 12.1430206299s, input_fired_time: 0.2166775167, output_fired_time: 0.0000000000, propagate_forward_time: 11.3629198074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5634231567
validation[          , genome  6546] predictions:    9653/  10000 (96.53%), best:    9741/10000 (97.41%), error:      1140.38538, best error:       865.04004 on epoch:    41, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 120.0216751099s, input_fired_time: 1.3693945408, output_fired_time: 1.2363715172, propagate_forward_time: 45.1482467651, propagate_backward_time: 69.7825393677, weight_update_time: 0.1278344542, other_time: 2.4851226807
epoch time: 9.1396484375s, input_fired_time: 0.1557828039, output_fired_time: 0.0000000000, propagate_forward_time: 8.5340204239, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4498453140
validation[          , genome  6546] predictions:    9674/  10000 (96.74%), best:    9741/10000 (97.41%), error:      1017.44049, best error:       865.04004 on epoch:    41, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 120.0485839844s, input_fired_time: 1.4089288712, output_fired_time: 1.2708826065, propagate_forward_time: 45.0429229736, propagate_backward_time: 69.7237014771, weight_update_time: 0.1283334345, other_time: 2.6021499634
epoch time: 9.1697254181s, input_fired_time: 0.1607035995, output_fired_time: 0.0000000000, propagate_forward_time: 8.5471286774, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4618930817
validation[          , genome  6546] predictions:    9745/  10000 (97.45%), best:    9741/10000 (97.41%), error:       876.26758, best error:       865.04004 on epoch:    41, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 120.1806945801s, input_fired_time: 1.3563187122, output_fired_time: 1.2592459917, propagate_forward_time: 45.3762474060, propagate_backward_time: 69.5501251221, weight_update_time: 0.1528128684, other_time: 2.6387634277
epoch time: 9.1842641830s, input_fired_time: 0.1570483446, output_fired_time: 0.0000000000, propagate_forward_time: 8.5821876526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4450283051
validation[          , genome  6546] predictions:    9680/  10000 (96.80%), best:    9741/10000 (97.41%), error:      1019.18018, best error:       865.04004 on epoch:    41, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 120.4842071533s, input_fired_time: 1.4731469154, output_fired_time: 1.2220381498, propagate_forward_time: 45.3416442871, propagate_backward_time: 69.8673934937, weight_update_time: 0.1326342523, other_time: 2.5799865723
epoch time: 9.1758222580s, input_fired_time: 0.1581495404, output_fired_time: 0.0000000000, propagate_forward_time: 8.5737638474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4439086914
validation[          , genome  6546] predictions:    9717/  10000 (97.17%), best:    9741/10000 (97.41%), error:       899.05579, best error:       865.04004 on epoch:    41, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 119.9996414185s, input_fired_time: 1.5228207111, output_fired_time: 1.3004385233, propagate_forward_time: 44.8870811462, propagate_backward_time: 69.7068481445, weight_update_time: 0.1277929246, other_time: 2.5824584961
epoch time: 9.3768711090s, input_fired_time: 0.1632768363, output_fired_time: 0.0000000000, propagate_forward_time: 8.7765026093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4370918274
validation[          , genome  6546] predictions:    9731/  10000 (97.31%), best:    9731/10000 (97.31%), error:       848.09222, best error:       848.09222 on epoch:    89, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 120.2271347046s, input_fired_time: 1.3778561354, output_fired_time: 1.2748395205, propagate_forward_time: 45.0833435059, propagate_backward_time: 69.9347381592, weight_update_time: 0.1243138015, other_time: 2.5563583374
epoch time: 12.0219421387s, input_fired_time: 0.2354521602, output_fired_time: 0.0000000000, propagate_forward_time: 11.2505044937, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5359859467
validation[          , genome  6546] predictions:    9740/  10000 (97.40%), best:    9731/10000 (97.31%), error:       875.93024, best error:       848.09222 on epoch:    89, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 119.9302062988s, input_fired_time: 1.4367384911, output_fired_time: 1.2478199005, propagate_forward_time: 45.2671356201, propagate_backward_time: 69.3777542114, weight_update_time: 0.1572103798, other_time: 2.6007614136
epoch time: 9.1412687302s, input_fired_time: 0.1579289287, output_fired_time: 0.0000000000, propagate_forward_time: 8.5390586853, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4442815781
validation[          , genome  6546] predictions:    9739/  10000 (97.39%), best:    9731/10000 (97.31%), error:       864.82300, best error:       848.09222 on epoch:    89, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 120.3019790649s, input_fired_time: 1.4700605869, output_fired_time: 1.2816834450, propagate_forward_time: 45.2073593140, propagate_backward_time: 69.8103027344, weight_update_time: 0.1346978694, other_time: 2.5325698853
epoch time: 9.1614799500s, input_fired_time: 0.1587221324, output_fired_time: 0.0000000000, propagate_forward_time: 8.5631771088, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4395809174
validation[          , genome  6546] predictions:    9704/  10000 (97.04%), best:    9731/10000 (97.31%), error:       968.90393, best error:       848.09222 on epoch:    89, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 119.9606552124s, input_fired_time: 1.4062043428, output_fired_time: 1.2703990936, propagate_forward_time: 45.2579841614, propagate_backward_time: 69.4600601196, weight_update_time: 0.1274013966, other_time: 2.5660018921
epoch time: 9.1924180984s, input_fired_time: 0.1603737324, output_fired_time: 0.0000000000, propagate_forward_time: 8.5943622589, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4376821518
validation[          , genome  6546] predictions:    9697/  10000 (96.97%), best:    9731/10000 (97.31%), error:       995.77753, best error:       848.09222 on epoch:    89, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 154.7132720947s, input_fired_time: 1.9740617275, output_fired_time: 1.9381755590, propagate_forward_time: 57.7827873230, propagate_backward_time: 89.7376174927, weight_update_time: 0.2436166108, other_time: 3.2806320190
epoch time: 10.4268770218s, input_fired_time: 0.1777979285, output_fired_time: 0.0000000000, propagate_forward_time: 9.7160120010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5330667496
validation[          , genome  6546] predictions:    9730/  10000 (97.30%), best:    9731/10000 (97.31%), error:       860.07269, best error:       848.09222 on epoch:    89, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 147.2903900146s, input_fired_time: 1.8457849026, output_fired_time: 1.5711814165, propagate_forward_time: 54.8969802856, propagate_backward_time: 85.6351394653, weight_update_time: 0.1493134499, other_time: 3.3413085938
epoch time: 15.8944005966s, input_fired_time: 0.2602568567, output_fired_time: 0.0000000000, propagate_forward_time: 14.9112844467, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7228593826
validation[          , genome  6546] predictions:    9691/  10000 (96.91%), best:    9731/10000 (97.31%), error:       988.44104, best error:       848.09222 on epoch:    89, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 143.3528442383s, input_fired_time: 1.8029776812, output_fired_time: 1.5229067802, propagate_forward_time: 54.4566154480, propagate_backward_time: 82.6069259644, weight_update_time: 0.1620941311, other_time: 2.9634170532
epoch time: 10.6718606949s, input_fired_time: 0.2002721876, output_fired_time: 0.0000000000, propagate_forward_time: 9.9077548981, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5638332367
validation[          , genome  6546] predictions:    9730/  10000 (97.30%), best:    9731/10000 (97.31%), error:       865.05457, best error:       848.09222 on epoch:    89, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 132.2266845703s, input_fired_time: 1.6318398714, output_fired_time: 1.3861954212, propagate_forward_time: 49.5188980103, propagate_backward_time: 76.8676452637, weight_update_time: 0.1466066092, other_time: 2.8221054077
epoch time: 11.2006530762s, input_fired_time: 0.2193108946, output_fired_time: 0.0000000000, propagate_forward_time: 10.4623088837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5190334320
validation[          , genome  6546] predictions:    9693/  10000 (96.93%), best:    9731/10000 (97.31%), error:       922.17322, best error:       848.09222 on epoch:    89, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 120.3805694580s, input_fired_time: 1.3908822536, output_fired_time: 1.2753713131, propagate_forward_time: 45.3936500549, propagate_backward_time: 69.7261047363, weight_update_time: 0.1246429160, other_time: 2.5945587158
epoch time: 10.0778732300s, input_fired_time: 0.1748006791, output_fired_time: 0.0000000000, propagate_forward_time: 9.4295568466, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4735155106
validation[          , genome  6546] predictions:    9722/  10000 (97.22%), best:    9731/10000 (97.31%), error:       908.52264, best error:       848.09222 on epoch:    89, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 120.3781051636s, input_fired_time: 1.4085526466, output_fired_time: 1.2739384174, propagate_forward_time: 45.4524574280, propagate_backward_time: 69.7249526978, weight_update_time: 0.1232685596, other_time: 2.5181961060
epoch time: 9.2008457184s, input_fired_time: 0.1610060483, output_fired_time: 0.0000000000, propagate_forward_time: 8.6010160446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4388237000
validation[          , genome  6546] predictions:    9668/  10000 (96.68%), best:    9731/10000 (97.31%), error:      1054.40210, best error:       848.09222 on epoch:    89, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 120.3808517456s, input_fired_time: 1.4377341270, output_fired_time: 1.3154486418, propagate_forward_time: 45.2890243530, propagate_backward_time: 69.7217025757, weight_update_time: 0.1634767205, other_time: 2.6169433594
epoch time: 9.2040214539s, input_fired_time: 0.1593459249, output_fired_time: 0.0000000000, propagate_forward_time: 8.6029891968, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4416866302
validation[          , genome  6546] predictions:    9664/  10000 (96.64%), best:    9731/10000 (97.31%), error:      1092.11621, best error:       848.09222 on epoch:    89, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 49.2376480103s, input_fired_time: 0.8913779855, output_fired_time: 0.0000000000, propagate_forward_time: 45.9668884277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3793830872
best training[          , genome  6546] predictions:   49463/  50000 (98.93%), best:    9731/10000 (97.31%), error:      2067.33350, best error:       848.09222 on epoch:    89, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 9.2545642853s, input_fired_time: 0.1595861465, output_fired_time: 0.0000000000, propagate_forward_time: 8.5949440002, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5000343323
   testing[          , genome  6546] predictions:    9762/  10000 (97.62%), best:    9731/10000 (97.31%), error:       796.15442, best error:       848.09222 on epoch:    89, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
21:31:37 (8180): called boinc_finish(0)

</stderr_txt>
]]>