Nameexact_genome_1512568488_43_6409_1
Workunit2603355
Created7 Dec 2017, 19:42:21 UTC
Sent7 Dec 2017, 19:47:36 UTC
Report deadline14 Dec 2017, 19:41:46 UTC
Received8 Dec 2017, 12:33:01 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time4 hours 1 min 54 sec
CPU time3 hours 52 min 51 sec
Validate stateValid
Credit1,748.99
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.09 MB
Peak swap size158.41 MB
Peak disk usage1.99 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
   , genome  6409] predictions:    9678/  10000 (96.78%), best:    9732/10000 (97.32%), error:      1058.94910, best error:       942.90912 on epoch:     8, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 136.0926818848s, input_fired_time: 1.4482595921, output_fired_time: 1.3219214678, propagate_forward_time: 52.9813156128, propagate_backward_time: 77.0474700928, weight_update_time: 0.1624899358, other_time: 3.2937240601
epoch time: 10.1475419998s, input_fired_time: 0.1801376641, output_fired_time: 0.0000000000, propagate_forward_time: 9.4015598297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5658445358
validation[          , genome  6409] predictions:    9723/  10000 (97.23%), best:    9732/10000 (97.32%), error:       966.97345, best error:       942.90912 on epoch:     8, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 141.8661499023s, input_fired_time: 1.4802854061, output_fired_time: 1.4165484905, propagate_forward_time: 54.3500480652, propagate_backward_time: 81.2455902100, weight_update_time: 0.1611266285, other_time: 3.3736724854
epoch time: 11.2879076004s, input_fired_time: 0.1828748733, output_fired_time: 0.0000000000, propagate_forward_time: 10.5249700546, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5800628662
validation[          , genome  6409] predictions:    9599/  10000 (95.99%), best:    9732/10000 (97.32%), error:      1269.96899, best error:       942.90912 on epoch:     8, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 135.1747589111s, input_fired_time: 1.4462413788, output_fired_time: 1.2985612154, propagate_forward_time: 48.8255233765, propagate_backward_time: 80.3452606201, weight_update_time: 0.1644725949, other_time: 3.2591629028
epoch time: 10.1640949249s, input_fired_time: 0.1801146567, output_fired_time: 0.0000000000, propagate_forward_time: 9.4256477356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5583324432
validation[          , genome  6409] predictions:    9741/  10000 (97.41%), best:    9741/10000 (97.41%), error:       904.78229, best error:       904.78229 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 135.0683593750s, input_fired_time: 1.4455915689, output_fired_time: 1.3050404787, propagate_forward_time: 49.9090042114, propagate_backward_time: 79.1874923706, weight_update_time: 0.1615574509, other_time: 3.2212371826
epoch time: 9.9853973389s, input_fired_time: 0.1777586192, output_fired_time: 0.0000000000, propagate_forward_time: 9.2448854446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5627536774
validation[          , genome  6409] predictions:    9688/  10000 (96.88%), best:    9741/10000 (97.41%), error:      1047.84729, best error:       904.78229 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 135.9752349854s, input_fired_time: 1.4440606833, output_fired_time: 1.3014395237, propagate_forward_time: 50.2062683105, propagate_backward_time: 78.7525177002, weight_update_time: 0.1624954343, other_time: 4.2709503174
epoch time: 11.4071807861s, input_fired_time: 0.1865219474, output_fired_time: 0.0000000000, propagate_forward_time: 10.6393165588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5813426971
validation[          , genome  6409] predictions:    9696/  10000 (96.96%), best:    9741/10000 (97.41%), error:      1034.92590, best error:       904.78229 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 134.1891632080s, input_fired_time: 1.4436206818, output_fired_time: 1.2902966738, propagate_forward_time: 50.3598442078, propagate_backward_time: 77.8391799927, weight_update_time: 0.1626937538, other_time: 3.2562179565
epoch time: 10.1993598938s, input_fired_time: 0.1820660084, output_fired_time: 0.0000000000, propagate_forward_time: 9.4504966736, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5667972565
validation[          , genome  6409] predictions:    9750/  10000 (97.50%), best:    9750/10000 (97.50%), error:       892.95819, best error:       892.95819 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 134.4764556885s, input_fired_time: 1.4403072596, output_fired_time: 1.2938213348, propagate_forward_time: 50.7152633667, propagate_backward_time: 77.7989044189, weight_update_time: 0.1613225341, other_time: 3.2281570435
epoch time: 10.1053609848s, input_fired_time: 0.1815157533, output_fired_time: 0.0000000000, propagate_forward_time: 9.3555755615, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5682697296
validation[          , genome  6409] predictions:    9697/  10000 (96.97%), best:    9750/10000 (97.50%), error:       987.12122, best error:       892.95819 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 134.8480987549s, input_fired_time: 1.4454219341, output_fired_time: 1.2909501791, propagate_forward_time: 51.7136344910, propagate_backward_time: 77.1500320435, weight_update_time: 0.1623629481, other_time: 3.2480545044
epoch time: 11.1997137070s, input_fired_time: 0.1830590516, output_fired_time: 0.0000000000, propagate_forward_time: 10.4421339035, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5745210648
validation[          , genome  6409] predictions:    9722/  10000 (97.22%), best:    9750/10000 (97.50%), error:       951.29694, best error:       892.95819 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 132.9478149414s, input_fired_time: 1.4435120821, output_fired_time: 1.3062760830, propagate_forward_time: 50.5118942261, propagate_backward_time: 76.4097061157, weight_update_time: 0.1618556827, other_time: 3.2764282227
epoch time: 11.2994422913s, input_fired_time: 0.1826602668, output_fired_time: 0.0000000000, propagate_forward_time: 10.5478630066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5689191818
validation[          , genome  6409] predictions:    9633/  10000 (96.33%), best:    9750/10000 (97.50%), error:      1222.01147, best error:       892.95819 on epoch:    20, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 134.9463348389s, input_fired_time: 1.4452657700, output_fired_time: 1.2886763811, propagate_forward_time: 50.8668823242, propagate_backward_time: 77.0508117676, weight_update_time: 0.1620540470, other_time: 4.2946929932
epoch time: 10.0079603195s, input_fired_time: 0.1767880619, output_fired_time: 0.0000000000, propagate_forward_time: 9.2640447617, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5671272278
validation[          , genome  6409] predictions:    9745/  10000 (97.45%), best:    9750/10000 (97.50%), error:       898.59833, best error:       892.95819 on epoch:    20, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 146.0330963135s, input_fired_time: 1.5564852953, output_fired_time: 1.6021569967, propagate_forward_time: 54.5442543030, propagate_backward_time: 84.7853775024, weight_update_time: 0.1820702553, other_time: 3.5448226929
epoch time: 10.2972602844s, input_fired_time: 0.1834118664, output_fired_time: 0.0000000000, propagate_forward_time: 9.5266017914, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5872468948
validation[          , genome  6409] predictions:    9756/  10000 (97.56%), best:    9756/10000 (97.56%), error:       876.97858, best error:       876.97858 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 134.7266998291s, input_fired_time: 2.4809188843, output_fired_time: 1.2942806482, propagate_forward_time: 47.5844230652, propagate_backward_time: 79.0600509644, weight_update_time: 0.1625364274, other_time: 4.3070297241
epoch time: 17.5907726288s, input_fired_time: 0.2729826272, output_fired_time: 0.0000000000, propagate_forward_time: 16.4315624237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8862266541
validation[          , genome  6409] predictions:    9632/  10000 (96.32%), best:    9756/10000 (97.56%), error:      1235.45898, best error:       876.97858 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 141.2974395752s, input_fired_time: 1.4947693348, output_fired_time: 1.3870707750, propagate_forward_time: 53.0070343018, propagate_backward_time: 81.9407196045, weight_update_time: 0.1711450368, other_time: 3.4678497314
epoch time: 10.0840606689s, input_fired_time: 0.1809532344, output_fired_time: 0.0000000000, propagate_forward_time: 9.3354892731, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5676183701
validation[          , genome  6409] predictions:    9742/  10000 (97.42%), best:    9756/10000 (97.56%), error:       903.74561, best error:       876.97858 on epoch:    25, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 134.6950531006s, input_fired_time: 1.4459618330, output_fired_time: 1.2986559868, propagate_forward_time: 51.6917915344, propagate_backward_time: 77.0123672485, weight_update_time: 0.1620271653, other_time: 3.2462692261
epoch time: 11.3794870377s, input_fired_time: 0.1858749390, output_fired_time: 0.0000000000, propagate_forward_time: 10.6105327606, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5830793381
validation[          , genome  6409] predictions:    9758/  10000 (97.58%), best:    9758/10000 (97.58%), error:       813.41656, best error:       813.41656 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 142.6318664551s, input_fired_time: 1.4853162766, output_fired_time: 2.3675935268, propagate_forward_time: 52.4444046021, propagate_backward_time: 81.8243713379, weight_update_time: 0.1631478071, other_time: 4.5101699829
epoch time: 12.7885351181s, input_fired_time: 0.2243378162, output_fired_time: 0.0000000000, propagate_forward_time: 11.8334674835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7307300568
validation[          , genome  6409] predictions:    9714/  10000 (97.14%), best:    9758/10000 (97.58%), error:       955.99481, best error:       813.41656 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 143.1548309326s, input_fired_time: 1.5700659752, output_fired_time: 1.3480106592, propagate_forward_time: 53.6048774719, propagate_backward_time: 82.1999359131, weight_update_time: 0.1701139659, other_time: 4.4319458008
epoch time: 10.1634120941s, input_fired_time: 0.1808867902, output_fired_time: 0.0000000000, propagate_forward_time: 9.4223165512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5602083206
validation[          , genome  6409] predictions:    9674/  10000 (96.74%), best:    9758/10000 (97.58%), error:      1114.90295, best error:       813.41656 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 136.1226196289s, input_fired_time: 1.4871520996, output_fired_time: 1.3147419691, propagate_forward_time: 50.1661834717, propagate_backward_time: 78.8679733276, weight_update_time: 0.1630808711, other_time: 4.2865676880
epoch time: 11.4835128784s, input_fired_time: 0.1875281781, output_fired_time: 0.0000000000, propagate_forward_time: 10.7135467529, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5824375153
validation[          , genome  6409] predictions:    9692/  10000 (96.92%), best:    9758/10000 (97.58%), error:       998.86914, best error:       813.41656 on epoch:    28, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 133.2421112061s, input_fired_time: 1.4454933405, output_fired_time: 1.2952126265, propagate_forward_time: 49.6004409790, propagate_backward_time: 77.6481704712, weight_update_time: 0.1623023450, other_time: 3.2527923584
epoch time: 11.3609342575s, input_fired_time: 0.1849453896, output_fired_time: 0.0000000000, propagate_forward_time: 10.5978899002, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5780992508
validation[          , genome  6409] predictions:    9750/  10000 (97.50%), best:    9758/10000 (97.58%), error:       846.62445, best error:       813.41656 on epoch:    28, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 143.7608032227s, input_fired_time: 1.5301854610, output_fired_time: 1.3715209961, propagate_forward_time: 51.0869674683, propagate_backward_time: 86.3606948853, weight_update_time: 0.1618395448, other_time: 3.4114379883
epoch time: 11.7074108124s, input_fired_time: 0.1984319985, output_fired_time: 0.0000000000, propagate_forward_time: 10.9171094894, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5918693542
validation[          , genome  6409] predictions:    9735/  10000 (97.35%), best:    9758/10000 (97.58%), error:       885.51300, best error:       813.41656 on epoch:    28, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 133.1002044678s, input_fired_time: 1.4484820366, output_fired_time: 1.2838464975, propagate_forward_time: 48.3871688843, propagate_backward_time: 78.7316818237, weight_update_time: 0.1621835530, other_time: 3.2490234375
epoch time: 11.3599739075s, input_fired_time: 0.1861852258, output_fired_time: 0.0000000000, propagate_forward_time: 10.6011791229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5726099014
validation[          , genome  6409] predictions:    9755/  10000 (97.55%), best:    9758/10000 (97.58%), error:       863.11938, best error:       813.41656 on epoch:    28, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 147.8262329102s, input_fired_time: 1.5876923800, output_fired_time: 1.4005733728, propagate_forward_time: 53.3607902527, propagate_backward_time: 87.9579391479, weight_update_time: 0.1692796946, other_time: 3.5192337036
epoch time: 11.5142297745s, input_fired_time: 0.1846243590, output_fired_time: 0.0000000000, propagate_forward_time: 10.7588500977, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5707550049
validation[          , genome  6409] predictions:    9630/  10000 (96.30%), best:    9758/10000 (97.58%), error:      1217.66980, best error:       813.41656 on epoch:    28, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 135.5107269287s, input_fired_time: 1.4592156410, output_fired_time: 1.2953538895, propagate_forward_time: 49.9197998047, propagate_backward_time: 78.5361175537, weight_update_time: 0.1639530808, other_time: 4.3002471924
epoch time: 10.1159229279s, input_fired_time: 0.1814394742, output_fired_time: 0.0000000000, propagate_forward_time: 9.3778648376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5566186905
validation[          , genome  6409] predictions:    9734/  10000 (97.34%), best:    9758/10000 (97.58%), error:       931.53918, best error:       813.41656 on epoch:    28, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 137.9425964355s, input_fired_time: 1.4932972193, output_fired_time: 1.3216298819, propagate_forward_time: 50.1101226807, propagate_backward_time: 81.6878128052, weight_update_time: 0.1698428392, other_time: 3.3297348022
epoch time: 11.4084186554s, input_fired_time: 0.1863421798, output_fired_time: 0.0000000000, propagate_forward_time: 10.6459846497, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5760917664
validation[          , genome  6409] predictions:    9739/  10000 (97.39%), best:    9758/10000 (97.58%), error:       884.31415, best error:       813.41656 on epoch:    28, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 133.3842773438s, input_fired_time: 1.4988089800, output_fired_time: 1.2857117653, propagate_forward_time: 48.5448150635, propagate_backward_time: 78.8532562256, weight_update_time: 0.1614447385, other_time: 3.2016906738
epoch time: 11.2472715378s, input_fired_time: 0.1860225201, output_fired_time: 0.0000000000, propagate_forward_time: 10.4820222855, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5792264938
validation[          , genome  6409] predictions:    9719/  10000 (97.19%), best:    9758/10000 (97.58%), error:       989.75452, best error:       813.41656 on epoch:    28, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 134.2659606934s, input_fired_time: 1.4624437094, output_fired_time: 1.2828301191, propagate_forward_time: 47.4580688477, propagate_backward_time: 80.8219299316, weight_update_time: 0.1628437638, other_time: 3.2406768799
epoch time: 10.0136594772s, input_fired_time: 0.1793053895, output_fired_time: 0.0000000000, propagate_forward_time: 9.2790393829, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5553150177
validation[          , genome  6409] predictions:    9719/  10000 (97.19%), best:    9758/10000 (97.58%), error:       905.96045, best error:       813.41656 on epoch:    28, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 135.5604858398s, input_fired_time: 1.4848413467, output_fired_time: 1.2940853834, propagate_forward_time: 50.0498085022, propagate_backward_time: 79.4313659668, weight_update_time: 0.1628677994, other_time: 3.3003845215
epoch time: 12.8476257324s, input_fired_time: 0.1935054511, output_fired_time: 0.0000000000, propagate_forward_time: 12.0148868561, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6392335892
validation[          , genome  6409] predictions:    9715/  10000 (97.15%), best:    9758/10000 (97.58%), error:       961.45081, best error:       813.41656 on epoch:    28, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 134.0575714111s, input_fired_time: 1.4672718048, output_fired_time: 1.3088790178, propagate_forward_time: 50.6560935974, propagate_backward_time: 77.3479156494, weight_update_time: 0.1624674350, other_time: 3.2774047852
epoch time: 11.4299058914s, input_fired_time: 0.1855557710, output_fired_time: 0.0000000000, propagate_forward_time: 10.6685314178, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5758190155
validation[          , genome  6409] predictions:    9758/  10000 (97.58%), best:    9758/10000 (97.58%), error:       874.57605, best error:       813.41656 on epoch:    28, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 134.3166961670s, input_fired_time: 1.4592679739, output_fired_time: 1.2905690670, propagate_forward_time: 47.5844650269, propagate_backward_time: 80.7376403809, weight_update_time: 0.1622993499, other_time: 3.2447433472
epoch time: 10.1001558304s, input_fired_time: 0.1808491945, output_fired_time: 0.0000000000, propagate_forward_time: 9.3618831635, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5574235916
validation[          , genome  6409] predictions:    9767/  10000 (97.67%), best:    9758/10000 (97.58%), error:       847.12054, best error:       813.41656 on epoch:    28, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 148.9167633057s, input_fired_time: 1.5989871025, output_fired_time: 1.5939490795, propagate_forward_time: 53.9633522034, propagate_backward_time: 88.1569442749, weight_update_time: 0.1715870053, other_time: 3.6035385132
epoch time: 10.3282051086s, input_fired_time: 0.1791337878, output_fired_time: 0.0000000000, propagate_forward_time: 9.5593566895, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5897150040
validation[          , genome  6409] predictions:    9714/  10000 (97.14%), best:    9758/10000 (97.58%), error:       943.54926, best error:       813.41656 on epoch:    28, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 135.9509277344s, input_fired_time: 1.5309163332, output_fired_time: 1.3037130833, propagate_forward_time: 51.2065696716, propagate_backward_time: 78.6367187500, weight_update_time: 0.1632723808, other_time: 3.2730102539
epoch time: 10.0573558807s, input_fired_time: 0.1889590621, output_fired_time: 0.0000000000, propagate_forward_time: 9.3069658279, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5614309311
validation[          , genome  6409] predictions:    9759/  10000 (97.59%), best:    9758/10000 (97.58%), error:       853.02246, best error:       813.41656 on epoch:    28, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 150.5485382080s, input_fired_time: 2.6066930294, output_fired_time: 2.4358117580, propagate_forward_time: 56.3599548340, propagate_backward_time: 85.5121917725, weight_update_time: 0.1805439144, other_time: 3.6338958740
epoch time: 11.1267299652s, input_fired_time: 0.1824594587, output_fired_time: 0.0000000000, propagate_forward_time: 10.3766736984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5675964355
validation[          , genome  6409] predictions:    9771/  10000 (97.71%), best:    9758/10000 (97.58%), error:       821.85718, best error:       813.41656 on epoch:    28, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 134.8638763428s, input_fired_time: 1.4577283859, output_fired_time: 1.3494467735, propagate_forward_time: 52.2985305786, propagate_backward_time: 76.5322418213, weight_update_time: 0.1624578238, other_time: 3.2259292603
epoch time: 11.6555166245s, input_fired_time: 0.1867624074, output_fired_time: 0.0000000000, propagate_forward_time: 9.8877582550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5809955597
validation[          , genome  6409] predictions:    9707/  10000 (97.07%), best:    9758/10000 (97.58%), error:       952.59058, best error:       813.41656 on epoch:    28, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 134.7350769043s, input_fired_time: 1.4553805590, output_fired_time: 1.2834746838, propagate_forward_time: 51.6816978455, propagate_backward_time: 77.0886001587, weight_update_time: 0.1618317217, other_time: 3.2259140015
epoch time: 10.2307472229s, input_fired_time: 0.2022799402, output_fired_time: 0.0000000000, propagate_forward_time: 9.4611358643, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5673313141
validation[          , genome  6409] predictions:    9757/  10000 (97.57%), best:    9758/10000 (97.58%), error:       832.64337, best error:       813.41656 on epoch:    28, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 146.8915100098s, input_fired_time: 1.6656606197, output_fired_time: 1.3763818741, propagate_forward_time: 54.8408775330, propagate_backward_time: 85.4602813721, weight_update_time: 0.1946790665, other_time: 3.5482940674
epoch time: 10.0778236389s, input_fired_time: 0.1842856407, output_fired_time: 0.0000000000, propagate_forward_time: 9.3242759705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5692615509
validation[          , genome  6409] predictions:    9772/  10000 (97.72%), best:    9772/10000 (97.72%), error:       794.18671, best error:       794.18671 on epoch:    48, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 145.7973022461s, input_fired_time: 1.6092727184, output_fired_time: 1.3847352266, propagate_forward_time: 53.8679389954, propagate_backward_time: 85.3885040283, weight_update_time: 0.1727475524, other_time: 3.5468597412
epoch time: 12.2483711243s, input_fired_time: 0.2188702375, output_fired_time: 0.0000000000, propagate_forward_time: 11.4096965790, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6198043823
validation[          , genome  6409] predictions:    9689/  10000 (96.89%), best:    9772/10000 (97.72%), error:      1062.84827, best error:       794.18671 on epoch:    48, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 139.2235870361s, input_fired_time: 1.4872022867, output_fired_time: 1.4123264551, propagate_forward_time: 50.5119972229, propagate_backward_time: 82.4556427002, weight_update_time: 0.1710927635, other_time: 3.3564300537
epoch time: 14.9358339310s, input_fired_time: 0.2781491578, output_fired_time: 0.0000000000, propagate_forward_time: 13.7770280838, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8806562424
validation[          , genome  6409] predictions:    9735/  10000 (97.35%), best:    9772/10000 (97.72%), error:       890.47272, best error:       794.18671 on epoch:    48, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 138.7033691406s, input_fired_time: 1.5394095182, output_fired_time: 1.3276047707, propagate_forward_time: 51.1711997986, propagate_backward_time: 80.3434295654, weight_update_time: 0.1701300442, other_time: 4.3217163086
epoch time: 10.1184663773s, input_fired_time: 0.1836230606, output_fired_time: 0.0000000000, propagate_forward_time: 9.3753128052, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5595302582
validation[          , genome  6409] predictions:    9755/  10000 (97.55%), best:    9772/10000 (97.72%), error:       827.33435, best error:       794.18671 on epoch:    48, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 136.1943817139s, input_fired_time: 1.4879754782, output_fired_time: 1.3059482574, propagate_forward_time: 50.9283370972, propagate_backward_time: 79.1393280029, weight_update_time: 0.1650332510, other_time: 3.3327865601
epoch time: 11.5590295792s, input_fired_time: 0.1939549595, output_fired_time: 0.0000000000, propagate_forward_time: 10.7762756348, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5887985229
validation[          , genome  6409] predictions:    9734/  10000 (97.34%), best:    9772/10000 (97.72%), error:       936.49249, best error:       794.18671 on epoch:    48, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 141.5337219238s, input_fired_time: 1.5702143908, output_fired_time: 1.3896454573, propagate_forward_time: 51.0730628967, propagate_backward_time: 84.1493377686, weight_update_time: 0.1677149832, other_time: 3.3514556885
epoch time: 10.3651142120s, input_fired_time: 0.1830257922, output_fired_time: 0.0000000000, propagate_forward_time: 9.5905427933, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5915460587
validation[          , genome  6409] predictions:    9754/  10000 (97.54%), best:    9772/10000 (97.72%), error:       867.34589, best error:       794.18671 on epoch:    48, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 136.2420196533s, input_fired_time: 1.4698756933, output_fired_time: 1.3181906939, propagate_forward_time: 52.0097808838, propagate_backward_time: 78.0815887451, weight_update_time: 0.1625950634, other_time: 3.3625793457
epoch time: 11.7636804581s, input_fired_time: 0.1957197338, output_fired_time: 0.0000000000, propagate_forward_time: 10.9454975128, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6224632263
validation[          , genome  6409] predictions:    9723/  10000 (97.23%), best:    9772/10000 (97.72%), error:       979.58734, best error:       794.18671 on epoch:    48, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 136.9727630615s, input_fired_time: 2.4786009789, output_fired_time: 1.3147609234, propagate_forward_time: 50.5828552246, propagate_backward_time: 78.3094635010, weight_update_time: 0.1622480899, other_time: 4.2870788574
epoch time: 14.1884603500s, input_fired_time: 0.2321359515, output_fired_time: 0.0000000000, propagate_forward_time: 13.1951189041, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7612056732
validation[          , genome  6409] predictions:    9730/  10000 (97.30%), best:    9772/10000 (97.72%), error:       932.49451, best error:       794.18671 on epoch:    48, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 161.1311645508s, input_fired_time: 1.6997870207, output_fired_time: 1.5311346054, propagate_forward_time: 60.8911933899, propagate_backward_time: 93.1325378418, weight_update_time: 0.1716322899, other_time: 3.8765258789
epoch time: 11.5013780594s, input_fired_time: 0.1906113774, output_fired_time: 0.0000000000, propagate_forward_time: 10.7361869812, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5745792389
validation[          , genome  6409] predictions:    9729/  10000 (97.29%), best:    9772/10000 (97.72%), error:       906.74823, best error:       794.18671 on epoch:    48, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 137.5928955078s, input_fired_time: 1.5058559179, output_fired_time: 1.3297709227, propagate_forward_time: 51.8568763733, propagate_backward_time: 79.5800323486, weight_update_time: 0.1802153140, other_time: 3.3203582764
epoch time: 14.6280546188s, input_fired_time: 0.2592220306, output_fired_time: 0.0000000000, propagate_forward_time: 13.6272315979, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7416009903
validation[          , genome  6409] predictions:    9740/  10000 (97.40%), best:    9772/10000 (97.72%), error:       899.58569, best error:       794.18671 on epoch:    48, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 134.1755981445s, input_fired_time: 1.4739784002, output_fired_time: 1.2973401546, propagate_forward_time: 50.7063598633, propagate_backward_time: 77.4262390137, weight_update_time: 0.1628736109, other_time: 3.2716827393
epoch time: 12.0888442993s, input_fired_time: 0.1946734488, output_fired_time: 0.0000000000, propagate_forward_time: 11.2909793854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6031913757
validation[          , genome  6409] predictions:    9726/  10000 (97.26%), best:    9772/10000 (97.72%), error:       920.84003, best error:       794.18671 on epoch:    48, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 143.0396881104s, input_fired_time: 1.6020839214, output_fired_time: 1.3697798252, propagate_forward_time: 54.8362464905, propagate_backward_time: 81.7857131958, weight_update_time: 0.1713208854, other_time: 3.4458694458
epoch time: 11.7770776749s, input_fired_time: 0.1946650743, output_fired_time: 0.0000000000, propagate_forward_time: 10.9963083267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5861043930
validation[          , genome  6409] predictions:    9689/  10000 (96.89%), best:    9772/10000 (97.72%), error:      1047.15479, best error:       794.18671 on epoch:    48, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 134.6605377197s, input_fired_time: 1.4857751131, output_fired_time: 1.3109612465, propagate_forward_time: 49.1405715942, propagate_backward_time: 79.4126129150, weight_update_time: 0.1627832353, other_time: 3.3106155396
epoch time: 10.5869798660s, input_fired_time: 0.1940845549, output_fired_time: 0.0000000000, propagate_forward_time: 9.7997941971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5931015015
validation[          , genome  6409] predictions:    9725/  10000 (97.25%), best:    9772/10000 (97.72%), error:       879.91284, best error:       794.18671 on epoch:    48, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 142.7266235352s, input_fired_time: 1.5666170120, output_fired_time: 1.3782641888, propagate_forward_time: 52.6532669067, propagate_backward_time: 83.6406555176, weight_update_time: 0.1720549613, other_time: 3.4878158569
epoch time: 11.3782777786s, input_fired_time: 0.2129608989, output_fired_time: 0.0000000000, propagate_forward_time: 10.5987787247, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5665378571
validation[          , genome  6409] predictions:    9776/  10000 (97.76%), best:    9772/10000 (97.72%), error:       805.05939, best error:       794.18671 on epoch:    48, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 143.3956298828s, input_fired_time: 1.5526205301, output_fired_time: 1.3565369844, propagate_forward_time: 53.5611495972, propagate_backward_time: 83.4428405762, weight_update_time: 0.1632107645, other_time: 3.4824752808
epoch time: 17.1840744019s, input_fired_time: 0.3105307817, output_fired_time: 0.0000000000, propagate_forward_time: 15.9374904633, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9360523224
validation[          , genome  6409] predictions:    9695/  10000 (96.95%), best:    9772/10000 (97.72%), error:      1040.30212, best error:       794.18671 on epoch:    48, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 154.1004486084s, input_fired_time: 1.7887208462, output_fired_time: 1.4215893745, propagate_forward_time: 57.0593795776, propagate_backward_time: 87.0237884521, weight_update_time: 0.1789019853, other_time: 6.8069686890
epoch time: 10.2178115845s, input_fired_time: 0.1838028282, output_fired_time: 0.0000000000, propagate_forward_time: 9.4725503922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5614585876
validation[          , genome  6409] predictions:    9714/  10000 (97.14%), best:    9772/10000 (97.72%), error:       936.53754, best error:       794.18671 on epoch:    48, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 142.7447509766s, input_fired_time: 1.5617095232, output_fired_time: 1.3833031654, propagate_forward_time: 54.4175300598, propagate_backward_time: 81.9413681030, weight_update_time: 0.1707735509, other_time: 3.4408493042
epoch time: 11.6791410446s, input_fired_time: 0.1934424043, output_fired_time: 0.0000000000, propagate_forward_time: 10.8844146729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6012840271
validation[          , genome  6409] predictions:    9776/  10000 (97.76%), best:    9776/10000 (97.76%), error:       769.68542, best error:       769.68542 on epoch:    64, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 149.1148376465s, input_fired_time: 1.6132485867, output_fired_time: 1.4872059822, propagate_forward_time: 56.0231552124, propagate_backward_time: 85.3941421509, weight_update_time: 0.1810711622, other_time: 4.5970764160
epoch time: 11.5162744522s, input_fired_time: 0.1930197030, output_fired_time: 0.0000000000, propagate_forward_time: 10.7471036911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5761508942
validation[          , genome  6409] predictions:    9778/  10000 (97.78%), best:    9776/10000 (97.76%), error:       780.70593, best error:       769.68542 on epoch:    64, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 134.6588287354s, input_fired_time: 1.4815236330, output_fired_time: 1.2924100161, propagate_forward_time: 49.6680030823, propagate_backward_time: 78.9450836182, weight_update_time: 0.1631106436, other_time: 3.2718200684
epoch time: 10.2000970840s, input_fired_time: 0.1876972616, output_fired_time: 0.0000000000, propagate_forward_time: 9.4422922134, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5701074600
validation[          , genome  6409] predictions:    9764/  10000 (97.64%), best:    9776/10000 (97.76%), error:       814.92340, best error:       769.68542 on epoch:    64, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 134.2971801758s, input_fired_time: 1.4701406956, output_fired_time: 1.2862535715, propagate_forward_time: 48.4744873047, propagate_backward_time: 79.8211441040, weight_update_time: 0.1623385251, other_time: 3.2451553345
epoch time: 10.0236558914s, input_fired_time: 0.1852165610, output_fired_time: 0.0000000000, propagate_forward_time: 9.2714977264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5669412613
validation[          , genome  6409] predictions:    9735/  10000 (97.35%), best:    9776/10000 (97.76%), error:       886.45245, best error:       769.68542 on epoch:    64, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 132.8305358887s, input_fired_time: 1.4665154219, output_fired_time: 2.2967078686, propagate_forward_time: 47.3167419434, propagate_backward_time: 77.5160140991, weight_update_time: 0.1605659723, other_time: 4.2345504761
epoch time: 11.2346210480s, input_fired_time: 0.1847713739, output_fired_time: 0.0000000000, propagate_forward_time: 10.4898796082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5599699020
validation[          , genome  6409] predictions:    9745/  10000 (97.45%), best:    9776/10000 (97.76%), error:       832.47302, best error:       769.68542 on epoch:    64, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 133.2814178467s, input_fired_time: 1.4793418646, output_fired_time: 1.2988713980, propagate_forward_time: 48.7957878113, propagate_backward_time: 78.4498825073, weight_update_time: 0.1622270942, other_time: 3.2575302124
epoch time: 11.4614343643s, input_fired_time: 0.1907701790, output_fired_time: 0.0000000000, propagate_forward_time: 10.6944522858, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5762119293
validation[          , genome  6409] predictions:    9729/  10000 (97.29%), best:    9776/10000 (97.76%), error:       920.44550, best error:       769.68542 on epoch:    64, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 134.1499786377s, input_fired_time: 1.4707859755, output_fired_time: 1.2898060083, propagate_forward_time: 49.5419464111, propagate_backward_time: 78.6214141846, weight_update_time: 0.1616709232, other_time: 3.2260284424
epoch time: 10.2173013687s, input_fired_time: 0.1868567169, output_fired_time: 0.0000000000, propagate_forward_time: 9.4642915726, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5661535263
validation[          , genome  6409] predictions:    9756/  10000 (97.56%), best:    9776/10000 (97.76%), error:       864.07574, best error:       769.68542 on epoch:    64, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 146.7966918945s, input_fired_time: 1.5294387341, output_fired_time: 1.4382014275, propagate_forward_time: 53.1355285645, propagate_backward_time: 85.0771331787, weight_update_time: 0.1625002772, other_time: 5.6163940430
epoch time: 12.5868387222s, input_fired_time: 0.2553500533, output_fired_time: 0.0000000000, propagate_forward_time: 11.6146116257, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7168769836
validation[          , genome  6409] predictions:    9754/  10000 (97.54%), best:    9776/10000 (97.76%), error:       825.92078, best error:       769.68542 on epoch:    64, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 135.5658569336s, input_fired_time: 1.4996666908, output_fired_time: 1.3033814430, propagate_forward_time: 51.0652236938, propagate_backward_time: 78.4014053345, weight_update_time: 0.1624646187, other_time: 3.2961883545
epoch time: 11.1655511856s, input_fired_time: 0.1866499633, output_fired_time: 0.0000000000, propagate_forward_time: 10.3889465332, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5899543762
validation[          , genome  6409] predictions:    9740/  10000 (97.40%), best:    9776/10000 (97.76%), error:       860.21790, best error:       769.68542 on epoch:    64, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 133.4963989258s, input_fired_time: 1.4739588499, output_fired_time: 1.2942833900, propagate_forward_time: 47.5847930908, propagate_backward_time: 77.8389053345, weight_update_time: 0.1614494920, other_time: 5.3044662476
epoch time: 18.2016105652s, input_fired_time: 0.2717355788, output_fired_time: 0.0000000000, propagate_forward_time: 16.9698581696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9600162506
validation[          , genome  6409] predictions:    9755/  10000 (97.55%), best:    9776/10000 (97.76%), error:       835.05200, best error:       769.68542 on epoch:    64, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 145.7988891602s, input_fired_time: 1.5594213009, output_fired_time: 1.3283500671, propagate_forward_time: 52.5212898254, propagate_backward_time: 85.8698730469, weight_update_time: 0.1696944535, other_time: 4.5199584961
epoch time: 10.8449497223s, input_fired_time: 0.1984328777, output_fired_time: 0.0000000000, propagate_forward_time: 10.0325546265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6139621735
validation[          , genome  6409] predictions:    9750/  10000 (97.50%), best:    9776/10000 (97.76%), error:       855.37268, best error:       769.68542 on epoch:    64, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 134.3308715820s, input_fired_time: 1.4756220579, output_fired_time: 1.2913937569, propagate_forward_time: 49.5518035889, propagate_backward_time: 78.7681427002, weight_update_time: 0.1617403924, other_time: 3.2439117432
epoch time: 10.0863437653s, input_fired_time: 0.1859472096, output_fired_time: 0.0000000000, propagate_forward_time: 9.3306217194, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5697746277
validation[          , genome  6409] predictions:    9766/  10000 (97.66%), best:    9776/10000 (97.76%), error:       826.51971, best error:       769.68542 on epoch:    64, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 135.6350555420s, input_fired_time: 1.4897218943, output_fired_time: 1.3020437956, propagate_forward_time: 51.9912834167, propagate_backward_time: 77.5818023682, weight_update_time: 0.1625950634, other_time: 3.2702026367
epoch time: 11.4955883026s, input_fired_time: 0.1930099130, output_fired_time: 0.0000000000, propagate_forward_time: 10.7203035355, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5822744370
validation[          , genome  6409] predictions:    9741/  10000 (97.41%), best:    9776/10000 (97.76%), error:       877.24951, best error:       769.68542 on epoch:    64, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 138.9503936768s, input_fired_time: 2.5057673454, output_fired_time: 1.3397401571, propagate_forward_time: 52.3272094727, propagate_backward_time: 79.4479980469, weight_update_time: 0.1718030423, other_time: 3.3296813965
epoch time: 9.2220449448s, input_fired_time: 0.1741862595, output_fired_time: 0.0000000000, propagate_forward_time: 8.5186071396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5292510986
validation[          , genome  6409] predictions:    9771/  10000 (97.71%), best:    9776/10000 (97.76%), error:       808.60846, best error:       769.68542 on epoch:    64, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 134.4823150635s, input_fired_time: 1.4823859930, output_fired_time: 2.3120307922, propagate_forward_time: 51.6358337402, propagate_backward_time: 75.7788543701, weight_update_time: 0.1617769897, other_time: 3.2732086182
epoch time: 10.0892314911s, input_fired_time: 0.1866602600, output_fired_time: 0.0000000000, propagate_forward_time: 9.3518457413, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5507259369
validation[          , genome  6409] predictions:    9764/  10000 (97.64%), best:    9776/10000 (97.76%), error:       782.32733, best error:       769.68542 on epoch:    64, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 137.5493316650s, input_fired_time: 1.5233486891, output_fired_time: 1.3825560808, propagate_forward_time: 52.6155929565, propagate_backward_time: 77.6548843384, weight_update_time: 0.1637469530, other_time: 4.3729553223
epoch time: 11.4190158844s, input_fired_time: 0.1890758425, output_fired_time: 0.0000000000, propagate_forward_time: 10.6517715454, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5781688690
validation[          , genome  6409] predictions:    9668/  10000 (96.68%), best:    9776/10000 (97.76%), error:      1168.69397, best error:       769.68542 on epoch:    64, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 134.6992492676s, input_fired_time: 1.4791158438, output_fired_time: 1.2905226946, propagate_forward_time: 51.5677871704, propagate_backward_time: 77.1053466797, weight_update_time: 0.1620911956, other_time: 3.2564773560
epoch time: 9.8670110703s, input_fired_time: 0.1824354529, output_fired_time: 0.0000000000, propagate_forward_time: 9.1313190460, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5532569885
validation[          , genome  6409] predictions:    9733/  10000 (97.33%), best:    9776/10000 (97.76%), error:       958.39319, best error:       769.68542 on epoch:    64, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 134.5454559326s, input_fired_time: 1.5041800737, output_fired_time: 1.3038079739, propagate_forward_time: 49.4956703186, propagate_backward_time: 78.9625396729, weight_update_time: 0.1630124897, other_time: 3.2792663574
epoch time: 10.2373294830s, input_fired_time: 0.1903020293, output_fired_time: 0.0000000000, propagate_forward_time: 9.4769515991, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5700759888
validation[          , genome  6409] predictions:    9726/  10000 (97.26%), best:    9776/10000 (97.76%), error:       897.49023, best error:       769.68542 on epoch:    64, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 135.0658721924s, input_fired_time: 1.4824237823, output_fired_time: 1.2882746458, propagate_forward_time: 51.7916526794, propagate_backward_time: 77.2391586304, weight_update_time: 0.1807342619, other_time: 3.2643661499
epoch time: 11.4597787857s, input_fired_time: 0.1953977197, output_fired_time: 0.0000000000, propagate_forward_time: 10.6722049713, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5921764374
validation[          , genome  6409] predictions:    9664/  10000 (96.64%), best:    9776/10000 (97.76%), error:      1050.78967, best error:       769.68542 on epoch:    64, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 134.6559448242s, input_fired_time: 1.4869042635, output_fired_time: 1.2912563086, propagate_forward_time: 50.7646026611, propagate_backward_time: 77.8488082886, weight_update_time: 0.1626771688, other_time: 3.2643661499
epoch time: 10.2115621567s, input_fired_time: 0.1900552809, output_fired_time: 0.0000000000, propagate_forward_time: 9.4401531219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5813541412
validation[          , genome  6409] predictions:    9721/  10000 (97.21%), best:    9776/10000 (97.76%), error:       944.03192, best error:       769.68542 on epoch:    64, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 134.2657012939s, input_fired_time: 1.4802719355, output_fired_time: 1.3011132479, propagate_forward_time: 50.7068405151, propagate_backward_time: 77.5436096191, weight_update_time: 0.1614143550, other_time: 3.2338638306
epoch time: 10.0343770981s, input_fired_time: 0.1857952625, output_fired_time: 0.0000000000, propagate_forward_time: 9.2914094925, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5571727753
validation[          , genome  6409] predictions:    9764/  10000 (97.64%), best:    9776/10000 (97.76%), error:       829.41779, best error:       769.68542 on epoch:    64, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 135.3220825195s, input_fired_time: 1.4835438728, output_fired_time: 1.3119513988, propagate_forward_time: 50.0016021729, propagate_backward_time: 78.2676467896, weight_update_time: 0.1621351540, other_time: 4.2573318481
epoch time: 11.4985809326s, input_fired_time: 0.1924644262, output_fired_time: 0.0000000000, propagate_forward_time: 10.7230119705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5831041336
validation[          , genome  6409] predictions:    9685/  10000 (96.85%), best:    9776/10000 (97.76%), error:      1042.82678, best error:       769.68542 on epoch:    64, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 141.4299774170s, input_fired_time: 1.5900437832, output_fired_time: 1.3299670219, propagate_forward_time: 53.1620292664, propagate_backward_time: 81.8938522339, weight_update_time: 0.1702020317, other_time: 3.4540786743
epoch time: 10.1503219604s, input_fired_time: 0.1841985881, output_fired_time: 0.0000000000, propagate_forward_time: 9.4098634720, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5562601089
validation[          , genome  6409] predictions:    9755/  10000 (97.55%), best:    9776/10000 (97.76%), error:       839.42212, best error:       769.68542 on epoch:    64, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 138.7196350098s, input_fired_time: 2.5213239193, output_fired_time: 1.2931206226, propagate_forward_time: 52.5959320068, propagate_backward_time: 78.9246902466, weight_update_time: 0.1784324646, other_time: 3.3845748901
epoch time: 11.6594791412s, input_fired_time: 0.1958404630, output_fired_time: 0.0000000000, propagate_forward_time: 10.8791484833, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5844898224
validation[          , genome  6409] predictions:    9758/  10000 (97.58%), best:    9776/10000 (97.76%), error:       850.89215, best error:       769.68542 on epoch:    64, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 137.8621520996s, input_fired_time: 1.5759720802, output_fired_time: 1.3219748735, propagate_forward_time: 49.7936668396, propagate_backward_time: 81.8169097900, weight_update_time: 0.1644115895, other_time: 3.3536224365
epoch time: 10.0213041306s, input_fired_time: 0.1847377568, output_fired_time: 0.0000000000, propagate_forward_time: 9.2825117111, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5540542603
validation[          , genome  6409] predictions:    9734/  10000 (97.34%), best:    9776/10000 (97.76%), error:       865.46466, best error:       769.68542 on epoch:    64, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 135.5490875244s, input_fired_time: 1.4860451221, output_fired_time: 1.2961025238, propagate_forward_time: 53.1939888000, propagate_backward_time: 76.3240432739, weight_update_time: 0.1617016941, other_time: 3.2489242554
epoch time: 11.5892543793s, input_fired_time: 0.1928741038, output_fired_time: 0.0000000000, propagate_forward_time: 10.8242712021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5721092224
validation[          , genome  6409] predictions:    9736/  10000 (97.36%), best:    9776/10000 (97.76%), error:       881.90125, best error:       769.68542 on epoch:    64, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 132.6921997070s, input_fired_time: 1.4974650145, output_fired_time: 1.2878401279, propagate_forward_time: 49.8346672058, propagate_backward_time: 75.8375625610, weight_update_time: 0.1625182927, other_time: 4.2346572876
epoch time: 11.3155364990s, input_fired_time: 0.1933221966, output_fired_time: 0.0000000000, propagate_forward_time: 10.5498065948, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5724077225
validation[          , genome  6409] predictions:    9730/  10000 (97.30%), best:    9776/10000 (97.76%), error:       914.21130, best error:       769.68542 on epoch:    64, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 134.4824676514s, input_fired_time: 1.4829785824, output_fired_time: 1.2885752916, propagate_forward_time: 49.5080795288, propagate_backward_time: 78.9405975342, weight_update_time: 0.1618457735, other_time: 3.2622451782
epoch time: 10.1425275803s, input_fired_time: 0.1885035932, output_fired_time: 0.0000000000, propagate_forward_time: 9.3899917603, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5640325546
validation[          , genome  6409] predictions:    9779/  10000 (97.79%), best:    9776/10000 (97.76%), error:       799.56104, best error:       769.68542 on epoch:    64, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 150.8034667969s, input_fired_time: 1.6627594233, output_fired_time: 1.5187236071, propagate_forward_time: 56.4563674927, propagate_backward_time: 87.6211013794, weight_update_time: 0.1784244031, other_time: 3.5445098877
epoch time: 10.8270521164s, input_fired_time: 0.1870805174, output_fired_time: 0.0000000000, propagate_forward_time: 9.7579565048, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8820152283
validation[          , genome  6409] predictions:    9731/  10000 (97.31%), best:    9776/10000 (97.76%), error:       956.72711, best error:       769.68542 on epoch:    64, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 141.6426086426s, input_fired_time: 1.5485962629, output_fired_time: 1.3937320709, propagate_forward_time: 51.0578918457, propagate_backward_time: 84.3162918091, weight_update_time: 0.1625080705, other_time: 3.3260879517
epoch time: 11.6944808960s, input_fired_time: 0.1949138343, output_fired_time: 0.0000000000, propagate_forward_time: 9.9088315964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5907354355
validation[          , genome  6409] predictions:    9750/  10000 (97.50%), best:    9776/10000 (97.76%), error:       882.34314, best error:       769.68542 on epoch:    64, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 147.5646209717s, input_fired_time: 1.6199485064, output_fired_time: 1.4312351942, propagate_forward_time: 56.3181915283, propagate_backward_time: 83.7263259888, weight_update_time: 0.1692292094, other_time: 4.4689254761
epoch time: 12.0906238556s, input_fired_time: 0.1956043690, output_fired_time: 0.0000000000, propagate_forward_time: 11.2921161652, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6029033661
validation[          , genome  6409] predictions:    9763/  10000 (97.63%), best:    9776/10000 (97.76%), error:       822.19232, best error:       769.68542 on epoch:    64, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 142.4846649170s, input_fired_time: 1.5471067429, output_fired_time: 1.3614385128, propagate_forward_time: 54.4162864685, propagate_backward_time: 81.7313690186, weight_update_time: 0.1690500379, other_time: 3.4284667969
epoch time: 11.2694597244s, input_fired_time: 0.1932791770, output_fired_time: 0.0000000000, propagate_forward_time: 10.4981594086, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5780210495
validation[          , genome  6409] predictions:    9757/  10000 (97.57%), best:    9776/10000 (97.76%), error:       848.32080, best error:       769.68542 on epoch:    64, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 132.9256896973s, input_fired_time: 1.4951820374, output_fired_time: 1.2842376232, propagate_forward_time: 49.3780326843, propagate_backward_time: 76.5316085815, weight_update_time: 0.1611827463, other_time: 4.2366256714
epoch time: 11.4878244400s, input_fired_time: 0.1947618127, output_fired_time: 0.0000000000, propagate_forward_time: 10.7042045593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5888576508
validation[          , genome  6409] predictions:    9756/  10000 (97.56%), best:    9776/10000 (97.76%), error:       801.76953, best error:       769.68542 on epoch:    64, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 139.4958801270s, input_fired_time: 1.5215051174, output_fired_time: 1.3386006355, propagate_forward_time: 52.3461990356, propagate_backward_time: 79.9445724487, weight_update_time: 0.1615501791, other_time: 4.3450012207
epoch time: 10.6959609985s, input_fired_time: 0.2012981921, output_fired_time: 0.0000000000, propagate_forward_time: 9.8905992508, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6040639877
validation[          , genome  6409] predictions:    9748/  10000 (97.48%), best:    9776/10000 (97.76%), error:       862.92120, best error:       769.68542 on epoch:    64, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 148.4961090088s, input_fired_time: 1.6602103710, output_fired_time: 2.4176447392, propagate_forward_time: 55.7465629578, propagate_backward_time: 85.0773315430, weight_update_time: 0.1761096716, other_time: 3.5943450928
epoch time: 10.1284618378s, input_fired_time: 0.1889811158, output_fired_time: 0.0000000000, propagate_forward_time: 9.3662242889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5732564926
validation[          , genome  6409] predictions:    9685/  10000 (96.85%), best:    9776/10000 (97.76%), error:      1013.25854, best error:       769.68542 on epoch:    64, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 139.6712951660s, input_fired_time: 1.5216474533, output_fired_time: 1.3132444620, propagate_forward_time: 51.0261421204, propagate_backward_time: 81.4675521851, weight_update_time: 0.1620138884, other_time: 4.3427047729
epoch time: 11.5555706024s, input_fired_time: 0.2090308368, output_fired_time: 0.0000000000, propagate_forward_time: 9.7567625046, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5897769928
validation[          , genome  6409] predictions:    9764/  10000 (97.64%), best:    9776/10000 (97.76%), error:       810.85339, best error:       769.68542 on epoch:    64, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 134.1549224854s, input_fired_time: 1.4845294952, output_fired_time: 1.2865508795, propagate_forward_time: 48.4773521423, propagate_backward_time: 79.6333694458, weight_update_time: 0.1611004323, other_time: 3.2731246948
epoch time: 10.1503372192s, input_fired_time: 0.1900122315, output_fired_time: 0.0000000000, propagate_forward_time: 9.3952960968, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5650291443
validation[          , genome  6409] predictions:    9752/  10000 (97.52%), best:    9776/10000 (97.76%), error:       843.71906, best error:       769.68542 on epoch:    64, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 54.1006851196s, input_fired_time: 0.9473389387, output_fired_time: 0.0000000000, propagate_forward_time: 49.1343498230, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0189971924
best training[          , genome  6409] predictions:   49598/  50000 (99.20%), best:    9776/10000 (97.76%), error:      1561.76001, best error:       769.68542 on epoch:    64, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 10.0960330963s, input_fired_time: 0.1849761903, output_fired_time: 0.0000000000, propagate_forward_time: 9.3417587280, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5692977905
   testing[          , genome  6409] predictions:    9774/  10000 (97.74%), best:    9776/10000 (97.76%), error:       742.01373, best error:       769.68542 on epoch:    64, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
04:19:38 (3332): called boinc_finish(0)

</stderr_txt>
]]>