Nameexact_genome_1512568488_43_3438_1
Workunit2588464
Created7 Dec 2017, 4:47:27 UTC
Sent7 Dec 2017, 4:53:54 UTC
Report deadline12 Dec 2017, 10:28:18 UTC
Received7 Dec 2017, 15:20:04 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time3 hours 1 min 23 sec
CPU time2 hours 55 min 56 sec
Validate stateValid
Credit1,308.06
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.77 MB
Peak swap size158.02 MB
Peak disk usage1.85 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
opagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5565876961
validation[          , genome  3438] predictions:    9616/  10000 (96.16%), best:    9672/10000 (96.72%), error:      1223.57458, best error:      1101.96851 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 101.0559463501s, input_fired_time: 1.2245181799, output_fired_time: 1.0831120014, propagate_forward_time: 36.7995109558, propagate_backward_time: 58.8122367859, weight_update_time: 0.1450507939, other_time: 3.1365661621
epoch time: 7.7082142830s, input_fired_time: 0.1516632289, output_fired_time: 0.0000000000, propagate_forward_time: 7.0181231499, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5384278297
validation[          , genome  3438] predictions:    9654/  10000 (96.54%), best:    9672/10000 (96.72%), error:      1128.42578, best error:      1101.96851 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 101.0432891846s, input_fired_time: 1.2319178581, output_fired_time: 1.0894892216, propagate_forward_time: 36.9258270264, propagate_backward_time: 57.6513290405, weight_update_time: 0.1460207999, other_time: 4.1447219849
epoch time: 9.0129985809s, input_fired_time: 0.1586496234, output_fired_time: 0.0000000000, propagate_forward_time: 8.2973194122, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5570297241
validation[          , genome  3438] predictions:    9668/  10000 (96.68%), best:    9672/10000 (96.72%), error:      1111.38745, best error:      1101.96851 on epoch:    13, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 101.0565185547s, input_fired_time: 1.2252672911, output_fired_time: 1.0813465118, propagate_forward_time: 36.8478698730, propagate_backward_time: 58.7993850708, weight_update_time: 0.1450546533, other_time: 3.1026535034
epoch time: 7.8420720100s, input_fired_time: 0.1511441767, output_fired_time: 0.0000000000, propagate_forward_time: 7.1544418335, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5364861488
validation[          , genome  3438] predictions:    9682/  10000 (96.82%), best:    9682/10000 (96.82%), error:      1071.85657, best error:      1071.85657 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 101.2051162720s, input_fired_time: 1.2271928787, output_fired_time: 1.0830760002, propagate_forward_time: 38.8580589294, propagate_backward_time: 56.8702278137, weight_update_time: 0.1457139105, other_time: 3.1665573120
epoch time: 8.9600248337s, input_fired_time: 0.1574860364, output_fired_time: 0.0000000000, propagate_forward_time: 8.2438116074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5587272644
validation[          , genome  3438] predictions:    9665/  10000 (96.65%), best:    9682/10000 (96.82%), error:      1181.19104, best error:      1071.85657 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 100.8391952515s, input_fired_time: 1.2348380089, output_fired_time: 1.0798985958, propagate_forward_time: 39.9016304016, propagate_backward_time: 55.5125312805, weight_update_time: 0.1436969191, other_time: 3.1102981567
epoch time: 7.7614932060s, input_fired_time: 0.1527895480, output_fired_time: 0.0000000000, propagate_forward_time: 7.0630636215, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5456399918
validation[          , genome  3438] predictions:    9632/  10000 (96.32%), best:    9682/10000 (96.82%), error:      1255.12915, best error:      1071.85657 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 117.9082412720s, input_fired_time: 1.4306532145, output_fired_time: 1.2481594086, propagate_forward_time: 44.1384544373, propagate_backward_time: 66.5133132935, weight_update_time: 0.1563985944, other_time: 4.5776596069
epoch time: 9.1150207520s, input_fired_time: 0.1576384604, output_fired_time: 0.0000000000, propagate_forward_time: 8.3941125870, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5632696152
validation[          , genome  3438] predictions:    9666/  10000 (96.66%), best:    9682/10000 (96.82%), error:      1094.08203, best error:      1071.85657 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 101.0907058716s, input_fired_time: 1.2255033255, output_fired_time: 1.0805165768, propagate_forward_time: 36.8673324585, propagate_backward_time: 58.7876205444, weight_update_time: 0.1456010342, other_time: 3.1297378540
epoch time: 7.8733267784s, input_fired_time: 0.1554525197, output_fired_time: 0.0000000000, propagate_forward_time: 7.1729874611, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5448865891
validation[          , genome  3438] predictions:    9700/  10000 (97.00%), best:    9700/10000 (97.00%), error:      1035.90833, best error:      1035.90833 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 101.1278381348s, input_fired_time: 1.2252013683, output_fired_time: 1.0768229961, propagate_forward_time: 35.7943687439, propagate_backward_time: 59.9123954773, weight_update_time: 0.1450039446, other_time: 3.1190490723
epoch time: 8.9364919662s, input_fired_time: 0.1594862193, output_fired_time: 0.0000000000, propagate_forward_time: 8.2137527466, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5632534027
validation[          , genome  3438] predictions:    9700/  10000 (97.00%), best:    9700/10000 (97.00%), error:      1033.21997, best error:      1033.21997 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 101.3446578979s, input_fired_time: 1.2346314192, output_fired_time: 1.0911206007, propagate_forward_time: 39.0011596680, propagate_backward_time: 56.8915214539, weight_update_time: 0.1456855237, other_time: 3.1262245178
epoch time: 7.6564879417s, input_fired_time: 0.1520234495, output_fired_time: 0.0000000000, propagate_forward_time: 6.9704403877, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5340242386
validation[          , genome  3438] predictions:    9690/  10000 (96.90%), best:    9690/10000 (96.90%), error:      1025.85986, best error:      1025.85986 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 101.2486953735s, input_fired_time: 1.2295855284, output_fired_time: 1.0813884735, propagate_forward_time: 36.0165901184, propagate_backward_time: 58.7884635925, weight_update_time: 0.1443343014, other_time: 4.1326675415
epoch time: 9.1335458755s, input_fired_time: 0.1594354063, output_fired_time: 0.0000000000, propagate_forward_time: 8.4122543335, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5618562698
validation[          , genome  3438] predictions:    9664/  10000 (96.64%), best:    9690/10000 (96.90%), error:      1124.17749, best error:      1025.85986 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 113.7874526978s, input_fired_time: 1.3541018963, output_fired_time: 1.2131687403, propagate_forward_time: 41.9906044006, propagate_backward_time: 65.8079910278, weight_update_time: 0.1448586732, other_time: 3.4215927124
epoch time: 9.1404876709s, input_fired_time: 0.1635684222, output_fired_time: 0.0000000000, propagate_forward_time: 8.4007043839, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5762147903
validation[          , genome  3438] predictions:    9707/  10000 (97.07%), best:    9707/10000 (97.07%), error:      1013.07581, best error:      1013.07581 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 102.6477661133s, input_fired_time: 1.2614270449, output_fired_time: 1.1039198637, propagate_forward_time: 37.4737548828, propagate_backward_time: 59.6443023682, weight_update_time: 0.1549833119, other_time: 3.1643600464
epoch time: 13.7077875137s, input_fired_time: 0.2865235507, output_fired_time: 0.0000000000, propagate_forward_time: 12.5206937790, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9005699158
validation[          , genome  3438] predictions:    9695/  10000 (96.95%), best:    9695/10000 (96.95%), error:      1010.52814, best error:      1010.52814 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 101.0951919556s, input_fired_time: 1.2323552370, output_fired_time: 1.0867874622, propagate_forward_time: 36.9070968628, propagate_backward_time: 56.6867942810, weight_update_time: 0.1464332044, other_time: 5.1821632385
epoch time: 7.6528611183s, input_fired_time: 0.1540289521, output_fired_time: 0.0000000000, propagate_forward_time: 6.9593906403, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5394415855
validation[          , genome  3438] predictions:    9655/  10000 (96.55%), best:    9695/10000 (96.95%), error:      1249.87256, best error:      1010.52814 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 101.1124801636s, input_fired_time: 1.2472989559, output_fired_time: 1.0802258253, propagate_forward_time: 38.8870735168, propagate_backward_time: 55.7642784119, weight_update_time: 0.1447868496, other_time: 4.1336059570
epoch time: 9.0244884491s, input_fired_time: 0.1614771783, output_fired_time: 0.0000000000, propagate_forward_time: 7.2993793488, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5636320114
validation[          , genome  3438] predictions:    9649/  10000 (96.49%), best:    9695/10000 (96.95%), error:      1205.71497, best error:      1010.52814 on epoch:    26, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 101.2690353394s, input_fired_time: 1.2297459841, output_fired_time: 1.0819005966, propagate_forward_time: 40.0131912231, propagate_backward_time: 55.8478050232, weight_update_time: 0.1440264136, other_time: 3.0963935852
epoch time: 7.8471808434s, input_fired_time: 0.1542938799, output_fired_time: 0.0000000000, propagate_forward_time: 7.1455969810, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5472898483
validation[          , genome  3438] predictions:    9701/  10000 (97.01%), best:    9701/10000 (97.01%), error:      1010.48871, best error:      1010.48871 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 110.7031860352s, input_fired_time: 1.3869543076, output_fired_time: 1.1769305468, propagate_forward_time: 40.1100311279, propagate_backward_time: 63.6560058594, weight_update_time: 0.1617622077, other_time: 4.3732604980
epoch time: 7.8776512146s, input_fired_time: 0.1578168571, output_fired_time: 0.0000000000, propagate_forward_time: 7.1649050713, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5549292564
validation[          , genome  3438] predictions:    9687/  10000 (96.87%), best:    9687/10000 (96.87%), error:      1006.11804, best error:      1006.11804 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 101.9317474365s, input_fired_time: 1.2414207458, output_fired_time: 1.0909947157, propagate_forward_time: 39.1788291931, propagate_backward_time: 57.2558898926, weight_update_time: 0.1464220732, other_time: 3.1646080017
epoch time: 10.8781270981s, input_fired_time: 0.2356731296, output_fired_time: 0.0000000000, propagate_forward_time: 9.9869403839, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6555137634
validation[          , genome  3438] predictions:    9740/  10000 (97.40%), best:    9740/10000 (97.40%), error:       961.81073, best error:       961.81073 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 102.2466278076s, input_fired_time: 1.2498944998, output_fired_time: 1.0870498419, propagate_forward_time: 39.4911041260, propagate_backward_time: 57.2656288147, weight_update_time: 0.1443518996, other_time: 3.1529502869
epoch time: 7.7939462662s, input_fired_time: 0.1544712037, output_fired_time: 0.0000000000, propagate_forward_time: 7.1014676094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5380072594
validation[          , genome  3438] predictions:    9662/  10000 (96.62%), best:    9740/10000 (97.40%), error:      1079.85547, best error:       961.81073 on epoch:    31, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 107.1628112793s, input_fired_time: 1.3213412762, output_fired_time: 1.1606161594, propagate_forward_time: 38.7310943604, propagate_backward_time: 62.6178588867, weight_update_time: 0.1479912251, other_time: 3.3319015503
epoch time: 10.1617727280s, input_fired_time: 0.2174236923, output_fired_time: 0.0000000000, propagate_forward_time: 9.2984437943, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6459054947
validation[          , genome  3438] predictions:    9707/  10000 (97.07%), best:    9740/10000 (97.40%), error:      1042.81653, best error:       961.81073 on epoch:    31, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 108.3707504272s, input_fired_time: 1.3011037111, output_fired_time: 1.1418045759, propagate_forward_time: 40.3679161072, propagate_backward_time: 62.2486534119, weight_update_time: 0.1620544791, other_time: 3.3112678528
epoch time: 10.5857620239s, input_fired_time: 0.1769302636, output_fired_time: 0.0000000000, propagate_forward_time: 9.7066555023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7021760941
validation[          , genome  3438] predictions:    9641/  10000 (96.41%), best:    9740/10000 (97.40%), error:      1184.66797, best error:       961.81073 on epoch:    31, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 114.1205139160s, input_fired_time: 1.3748172522, output_fired_time: 2.2136631012, propagate_forward_time: 41.6714286804, propagate_backward_time: 65.4486846924, weight_update_time: 0.1679473221, other_time: 3.4119262695
epoch time: 7.8020715714s, input_fired_time: 0.1546359211, output_fired_time: 0.0000000000, propagate_forward_time: 7.1002068520, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5472288132
validation[          , genome  3438] predictions:    9629/  10000 (96.29%), best:    9740/10000 (97.40%), error:      1118.46350, best error:       961.81073 on epoch:    31, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 100.6462402344s, input_fired_time: 1.2266219854, output_fired_time: 2.0915379524, propagate_forward_time: 37.6861534119, propagate_backward_time: 56.5545005798, weight_update_time: 0.1435255557, other_time: 3.0874252319
epoch time: 9.0427350998s, input_fired_time: 0.1604362577, output_fired_time: 0.0000000000, propagate_forward_time: 8.3226947784, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5596036911
validation[          , genome  3438] predictions:    9698/  10000 (96.98%), best:    9740/10000 (97.40%), error:      1023.29584, best error:       961.81073 on epoch:    31, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 100.7346801758s, input_fired_time: 1.2312566042, output_fired_time: 1.0799815655, propagate_forward_time: 37.7498130798, propagate_backward_time: 57.5634460449, weight_update_time: 0.1444192976, other_time: 3.1101875305
epoch time: 7.8318815231s, input_fired_time: 0.1552165449, output_fired_time: 0.0000000000, propagate_forward_time: 7.1382169724, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5384478569
validation[          , genome  3438] predictions:    9716/  10000 (97.16%), best:    9740/10000 (97.40%), error:       969.71552, best error:       961.81073 on epoch:    31, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 104.5257492065s, input_fired_time: 1.2627936602, output_fired_time: 1.1241182089, propagate_forward_time: 42.0098648071, propagate_backward_time: 56.9657630920, weight_update_time: 0.1448757946, other_time: 3.1632118225
epoch time: 7.8065319061s, input_fired_time: 0.1552184522, output_fired_time: 0.0000000000, propagate_forward_time: 7.0979580879, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5533552170
validation[          , genome  3438] predictions:    9669/  10000 (96.69%), best:    9740/10000 (97.40%), error:      1085.40039, best error:       961.81073 on epoch:    31, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 111.8197555542s, input_fired_time: 1.3695888519, output_fired_time: 1.2645334005, propagate_forward_time: 39.6382637024, propagate_backward_time: 65.1705017090, weight_update_time: 0.1460920423, other_time: 4.3768615723
epoch time: 7.7894663811s, input_fired_time: 0.1544228345, output_fired_time: 0.0000000000, propagate_forward_time: 7.0939722061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5410714149
validation[          , genome  3438] predictions:    9644/  10000 (96.44%), best:    9740/10000 (97.40%), error:      1144.50098, best error:       961.81073 on epoch:    31, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 100.3034515381s, input_fired_time: 1.2289987803, output_fired_time: 1.0753623247, propagate_forward_time: 36.7269668579, propagate_backward_time: 58.1513099670, weight_update_time: 0.1447027922, other_time: 3.1208152771
epoch time: 7.7738451958s, input_fired_time: 0.1561963260, output_fired_time: 0.0000000000, propagate_forward_time: 7.0785632133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5390858650
validation[          , genome  3438] predictions:    9681/  10000 (96.81%), best:    9740/10000 (97.40%), error:      1035.29749, best error:       961.81073 on epoch:    31, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 101.8671340942s, input_fired_time: 1.2356979847, output_fired_time: 1.0797004700, propagate_forward_time: 40.7585639954, propagate_backward_time: 55.7016410828, weight_update_time: 0.1447086185, other_time: 3.0915374756
epoch time: 7.7486610413s, input_fired_time: 0.1561347395, output_fired_time: 0.0000000000, propagate_forward_time: 7.0476021767, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5449242592
validation[          , genome  3438] predictions:    9731/  10000 (97.31%), best:    9731/10000 (97.31%), error:       911.77405, best error:       911.77405 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 104.3857192993s, input_fired_time: 1.3010979891, output_fired_time: 1.1241261959, propagate_forward_time: 38.2750740051, propagate_backward_time: 59.3883934021, weight_update_time: 0.1458053440, other_time: 4.2970275879
epoch time: 8.9386396408s, input_fired_time: 0.1594637185, output_fired_time: 0.0000000000, propagate_forward_time: 7.2184758186, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5606999397
validation[          , genome  3438] predictions:    9678/  10000 (96.78%), best:    9731/10000 (97.31%), error:      1024.78442, best error:       911.77405 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 104.5808181763s, input_fired_time: 1.2686923742, output_fired_time: 1.1289683580, propagate_forward_time: 40.1698150635, propagate_backward_time: 58.7760658264, weight_update_time: 0.1533324271, other_time: 3.2372779846
epoch time: 7.6841344833s, input_fired_time: 0.1548617333, output_fired_time: 0.0000000000, propagate_forward_time: 6.9916763306, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5375962257
validation[          , genome  3438] predictions:    9710/  10000 (97.10%), best:    9731/10000 (97.31%), error:       986.42194, best error:       911.77405 on epoch:    41, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 100.7812118530s, input_fired_time: 1.2443141937, output_fired_time: 1.0818138123, propagate_forward_time: 38.8029136658, propagate_backward_time: 56.5094947815, weight_update_time: 0.1463277638, other_time: 3.1426696777
epoch time: 9.2043571472s, input_fired_time: 0.1617581695, output_fired_time: 0.0000000000, propagate_forward_time: 8.4823265076, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5602722168
validation[          , genome  3438] predictions:    9699/  10000 (96.99%), best:    9731/10000 (97.31%), error:      1000.01392, best error:       911.77405 on epoch:    41, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 101.1823425293s, input_fired_time: 1.2340673208, output_fired_time: 1.0927835703, propagate_forward_time: 38.9197578430, propagate_backward_time: 56.8323707581, weight_update_time: 0.1442971975, other_time: 3.1033630371
epoch time: 13.2508516312s, input_fired_time: 0.2563098669, output_fired_time: 0.0000000000, propagate_forward_time: 12.1303606033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8641815186
validation[          , genome  3438] predictions:    9708/  10000 (97.08%), best:    9731/10000 (97.31%), error:       990.15009, best error:       911.77405 on epoch:    41, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 110.7086944580s, input_fired_time: 1.3671262264, output_fired_time: 1.1863594055, propagate_forward_time: 41.4220237732, propagate_backward_time: 63.3161964417, weight_update_time: 0.1529560387, other_time: 3.4169883728
epoch time: 8.9340925217s, input_fired_time: 0.1579512507, output_fired_time: 0.0000000000, propagate_forward_time: 8.2254180908, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5507230759
validation[          , genome  3438] predictions:    9680/  10000 (96.80%), best:    9731/10000 (97.31%), error:      1049.40027, best error:       911.77405 on epoch:    41, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 103.2167739868s, input_fired_time: 1.2778561115, output_fired_time: 1.1452844143, propagate_forward_time: 37.5191612244, propagate_backward_time: 60.0504417419, weight_update_time: 0.1513537019, other_time: 3.2240295410
epoch time: 7.6654691696s, input_fired_time: 0.1559857279, output_fired_time: 0.0000000000, propagate_forward_time: 6.9686822891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5408010483
validation[          , genome  3438] predictions:    9706/  10000 (97.06%), best:    9731/10000 (97.31%), error:       981.94635, best error:       911.77405 on epoch:    41, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 101.7433166504s, input_fired_time: 1.2437418699, output_fired_time: 1.0929389000, propagate_forward_time: 38.0631294250, propagate_backward_time: 57.2013626099, weight_update_time: 0.1454343647, other_time: 4.1421394348
epoch time: 14.2335739136s, input_fired_time: 1.3324059248, output_fired_time: 0.0000000000, propagate_forward_time: 11.9706392288, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9305286407
validation[          , genome  3438] predictions:    9700/  10000 (97.00%), best:    9731/10000 (97.31%), error:      1025.97546, best error:       911.77405 on epoch:    41, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 103.5760269165s, input_fired_time: 1.3078588247, output_fired_time: 1.1327100992, propagate_forward_time: 36.8183670044, propagate_backward_time: 61.1452178955, weight_update_time: 0.1445585936, other_time: 3.1718673706
epoch time: 9.0920505524s, input_fired_time: 0.1611869484, output_fired_time: 0.0000000000, propagate_forward_time: 8.3689260483, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5619373322
validation[          , genome  3438] predictions:    9705/  10000 (97.05%), best:    9731/10000 (97.31%), error:       960.81488, best error:       911.77405 on epoch:    41, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 100.8488082886s, input_fired_time: 1.2365590334, output_fired_time: 1.0858749151, propagate_forward_time: 37.7119331360, propagate_backward_time: 57.7395820618, weight_update_time: 0.1442033052, other_time: 3.0748596191
epoch time: 7.8611721992s, input_fired_time: 0.1525057256, output_fired_time: 0.0000000000, propagate_forward_time: 7.1703486443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5383176804
validation[          , genome  3438] predictions:    9621/  10000 (96.21%), best:    9731/10000 (97.31%), error:      1253.81714, best error:       911.77405 on epoch:    41, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 101.3701934814s, input_fired_time: 1.2404900789, output_fired_time: 2.0943462849, propagate_forward_time: 39.0167655945, propagate_backward_time: 55.9123191833, weight_update_time: 0.1443670392, other_time: 3.1062698364
epoch time: 8.9269952774s, input_fired_time: 0.1587889194, output_fired_time: 0.0000000000, propagate_forward_time: 8.2111415863, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5570650101
validation[          , genome  3438] predictions:    9694/  10000 (96.94%), best:    9731/10000 (97.31%), error:      1007.24689, best error:       911.77405 on epoch:    41, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 100.7473526001s, input_fired_time: 1.2448230982, output_fired_time: 1.0768376589, propagate_forward_time: 37.6369972229, propagate_backward_time: 57.6868629456, weight_update_time: 0.1446005255, other_time: 3.1018371582
epoch time: 7.8596081734s, input_fired_time: 0.1580192149, output_fired_time: 0.0000000000, propagate_forward_time: 7.1563200951, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5452690125
validation[          , genome  3438] predictions:    9697/  10000 (96.97%), best:    9731/10000 (97.31%), error:       978.46210, best error:       911.77405 on epoch:    41, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 101.2605514526s, input_fired_time: 1.2398802042, output_fired_time: 1.0872021914, propagate_forward_time: 37.0103569031, propagate_backward_time: 58.8402252197, weight_update_time: 0.1439570338, other_time: 3.0828819275
epoch time: 8.9616050720s, input_fired_time: 0.1651581228, output_fired_time: 0.0000000000, propagate_forward_time: 7.2214694023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5749773979
validation[          , genome  3438] predictions:    9705/  10000 (97.05%), best:    9731/10000 (97.31%), error:       975.82629, best error:       911.77405 on epoch:    41, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 109.6153182983s, input_fired_time: 1.3268399239, output_fired_time: 2.1884422302, propagate_forward_time: 40.1117706299, propagate_backward_time: 62.5940856934, weight_update_time: 0.1542230397, other_time: 3.3941802979
epoch time: 9.1805715561s, input_fired_time: 0.1606322676, output_fired_time: 0.0000000000, propagate_forward_time: 8.4636516571, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5562877655
validation[          , genome  3438] predictions:    9674/  10000 (96.74%), best:    9731/10000 (97.31%), error:      1115.10217, best error:       911.77405 on epoch:    41, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 106.5712356567s, input_fired_time: 1.2950859070, output_fired_time: 1.1856949329, propagate_forward_time: 41.0118827820, propagate_backward_time: 58.7810096741, weight_update_time: 0.1547975093, other_time: 4.2975692749
epoch time: 7.7629647255s, input_fired_time: 0.1566229314, output_fired_time: 0.0000000000, propagate_forward_time: 7.0683860779, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5379557610
validation[          , genome  3438] predictions:    9718/  10000 (97.18%), best:    9731/10000 (97.31%), error:       935.48779, best error:       911.77405 on epoch:    41, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 107.7705841064s, input_fired_time: 1.3949731588, output_fired_time: 2.1996157169, propagate_forward_time: 39.5131912231, propagate_backward_time: 61.4297714233, weight_update_time: 0.1520580649, other_time: 3.2330322266
epoch time: 7.6825542450s, input_fired_time: 0.1544385105, output_fired_time: 0.0000000000, propagate_forward_time: 6.9989128113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5292029381
validation[          , genome  3438] predictions:    9718/  10000 (97.18%), best:    9731/10000 (97.31%), error:       942.53937, best error:       911.77405 on epoch:    41, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 109.7239074707s, input_fired_time: 1.3445374966, output_fired_time: 1.1939326525, propagate_forward_time: 40.9120941162, propagate_backward_time: 63.0472984314, weight_update_time: 0.1486141086, other_time: 3.2260475159
epoch time: 7.6001987457s, input_fired_time: 0.1555722803, output_fired_time: 0.0000000000, propagate_forward_time: 6.9184918404, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5261344910
validation[          , genome  3438] predictions:    9652/  10000 (96.52%), best:    9731/10000 (97.31%), error:      1122.44531, best error:       911.77405 on epoch:    41, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 108.0498580933s, input_fired_time: 1.3470175266, output_fired_time: 1.2015058994, propagate_forward_time: 41.9027214050, propagate_backward_time: 60.3372344971, weight_update_time: 0.1463581026, other_time: 3.2613792419
epoch time: 9.1127424240s, input_fired_time: 0.1617313474, output_fired_time: 0.0000000000, propagate_forward_time: 8.3956155777, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5553951263
validation[          , genome  3438] predictions:    9687/  10000 (96.87%), best:    9731/10000 (97.31%), error:      1017.33069, best error:       911.77405 on epoch:    41, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 113.0527343750s, input_fired_time: 1.3381544352, output_fired_time: 1.1896120310, propagate_forward_time: 40.1079444885, propagate_backward_time: 67.0065078735, weight_update_time: 0.1668768227, other_time: 3.4105148315
epoch time: 7.9972138405s, input_fired_time: 0.1559730023, output_fired_time: 0.0000000000, propagate_forward_time: 7.3043956757, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5368452072
validation[          , genome  3438] predictions:    9696/  10000 (96.96%), best:    9731/10000 (97.31%), error:       990.28912, best error:       911.77405 on epoch:    41, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 109.3262329102s, input_fired_time: 1.2933290005, output_fired_time: 1.1790986061, propagate_forward_time: 38.9748001099, propagate_backward_time: 64.5269165039, weight_update_time: 0.1625055373, other_time: 3.3520889282
epoch time: 9.0966701508s, input_fired_time: 0.1625909656, output_fired_time: 0.0000000000, propagate_forward_time: 8.3682432175, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5658359528
validation[          , genome  3438] predictions:    9699/  10000 (96.99%), best:    9731/10000 (97.31%), error:      1036.68713, best error:       911.77405 on epoch:    41, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 101.2084121704s, input_fired_time: 1.2548326254, output_fired_time: 1.0840057135, propagate_forward_time: 37.9103889465, propagate_backward_time: 57.8671035767, weight_update_time: 0.1446129829, other_time: 3.0920829773
epoch time: 7.7567257881s, input_fired_time: 0.1555624902, output_fired_time: 0.0000000000, propagate_forward_time: 7.0564041138, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5447592735
validation[          , genome  3438] predictions:    9688/  10000 (96.88%), best:    9731/10000 (97.31%), error:      1069.76990, best error:       911.77405 on epoch:    41, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 101.3163528442s, input_fired_time: 1.2442681789, output_fired_time: 1.0800888538, propagate_forward_time: 35.9568138123, propagate_backward_time: 59.9425735474, weight_update_time: 0.1439130902, other_time: 3.0926094055
epoch time: 9.1820764542s, input_fired_time: 0.1632336378, output_fired_time: 0.0000000000, propagate_forward_time: 8.4474992752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5713434219
validation[          , genome  3438] predictions:    9631/  10000 (96.31%), best:    9731/10000 (97.31%), error:      1197.37463, best error:       911.77405 on epoch:    41, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 101.0682373047s, input_fired_time: 1.2412883043, output_fired_time: 1.0842854977, propagate_forward_time: 36.8263015747, propagate_backward_time: 57.7975578308, weight_update_time: 0.1442702413, other_time: 4.1188087463
epoch time: 7.4468050003s, input_fired_time: 0.1504600644, output_fired_time: 0.0000000000, propagate_forward_time: 6.7657270432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5306177139
validation[          , genome  3438] predictions:    9706/  10000 (97.06%), best:    9731/10000 (97.31%), error:       928.11102, best error:       911.77405 on epoch:    41, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 101.3887634277s, input_fired_time: 1.2474756241, output_fired_time: 1.0849345922, propagate_forward_time: 37.9583396912, propagate_backward_time: 56.9547195435, weight_update_time: 1.1548743248, other_time: 4.1432914734
epoch time: 8.9904155731s, input_fired_time: 0.1640663594, output_fired_time: 0.0000000000, propagate_forward_time: 8.2717657089, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5545835495
validation[          , genome  3438] predictions:    9690/  10000 (96.90%), best:    9731/10000 (97.31%), error:      1002.97681, best error:       911.77405 on epoch:    41, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 115.4347076416s, input_fired_time: 2.4200181961, output_fired_time: 1.2139984369, propagate_forward_time: 45.0282936096, propagate_backward_time: 63.2615051270, weight_update_time: 0.1752969027, other_time: 3.5108947754
epoch time: 7.8105092049s, input_fired_time: 0.1580368280, output_fired_time: 0.0000000000, propagate_forward_time: 7.1121129990, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5403594971
validation[          , genome  3438] predictions:    9715/  10000 (97.15%), best:    9731/10000 (97.31%), error:       963.21857, best error:       911.77405 on epoch:    41, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 103.8901290894s, input_fired_time: 1.2800079584, output_fired_time: 1.1201744080, propagate_forward_time: 39.2710075378, propagate_backward_time: 59.0375442505, weight_update_time: 0.1525180191, other_time: 3.1813926697
epoch time: 12.9256181717s, input_fired_time: 1.2808341980, output_fired_time: 0.0000000000, propagate_forward_time: 10.8446187973, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8001651764
validation[          , genome  3438] predictions:    9715/  10000 (97.15%), best:    9731/10000 (97.31%), error:       932.59180, best error:       911.77405 on epoch:    41, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 103.7539138794s, input_fired_time: 1.3028169870, output_fired_time: 1.1046477556, propagate_forward_time: 38.0011901855, propagate_backward_time: 60.1507339478, weight_update_time: 0.1458755881, other_time: 3.1945266724
epoch time: 9.6641473770s, input_fired_time: 0.1631192565, output_fired_time: 0.0000000000, propagate_forward_time: 8.9089107513, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5921173096
validation[          , genome  3438] predictions:    9725/  10000 (97.25%), best:    9731/10000 (97.31%), error:       947.16235, best error:       911.77405 on epoch:    41, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 104.8475570679s, input_fired_time: 1.2800866365, output_fired_time: 1.1469819546, propagate_forward_time: 40.0713882446, propagate_backward_time: 58.0962600708, weight_update_time: 0.1446641535, other_time: 4.2528381348
epoch time: 7.8018918037s, input_fired_time: 0.1578506380, output_fired_time: 0.0000000000, propagate_forward_time: 7.0930719376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5509691238
validation[          , genome  3438] predictions:    9639/  10000 (96.39%), best:    9731/10000 (97.31%), error:      1181.28308, best error:       911.77405 on epoch:    41, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 101.2669982910s, input_fired_time: 1.2499842644, output_fired_time: 1.0855048895, propagate_forward_time: 39.0067214966, propagate_backward_time: 56.8132553101, weight_update_time: 0.1446788162, other_time: 3.1115341187
epoch time: 8.9714269638s, input_fired_time: 0.1610011756, output_fired_time: 0.0000000000, propagate_forward_time: 8.2505626678, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5598630905
validation[          , genome  3438] predictions:    9600/  10000 (96.00%), best:    9731/10000 (97.31%), error:      1283.95300, best error:       911.77405 on epoch:    41, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 100.5789108276s, input_fired_time: 2.2496380806, output_fired_time: 1.0762736797, propagate_forward_time: 37.6327400208, propagate_backward_time: 56.4895057678, weight_update_time: 0.1441617757, other_time: 3.1307525635
epoch time: 7.8573656082s, input_fired_time: 0.1603072286, output_fired_time: 0.0000000000, propagate_forward_time: 7.1538367271, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5432214737
validation[          , genome  3438] predictions:    9713/  10000 (97.13%), best:    9731/10000 (97.31%), error:      1012.36389, best error:       911.77405 on epoch:    41, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 100.7708892822s, input_fired_time: 1.2448339462, output_fired_time: 1.0781321526, propagate_forward_time: 36.8352127075, propagate_backward_time: 58.5269660950, weight_update_time: 0.1435196251, other_time: 3.0857429504
epoch time: 8.9764041901s, input_fired_time: 0.1624546051, output_fired_time: 0.0000000000, propagate_forward_time: 8.2549819946, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5589675903
validation[          , genome  3438] predictions:    9724/  10000 (97.24%), best:    9731/10000 (97.31%), error:       981.45239, best error:       911.77405 on epoch:    41, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 105.5252456665s, input_fired_time: 1.3055392504, output_fired_time: 1.1198694706, propagate_forward_time: 40.7071342468, propagate_backward_time: 59.1708145142, weight_update_time: 0.1483417600, other_time: 3.2218818665
epoch time: 8.8955125809s, input_fired_time: 0.1627937406, output_fired_time: 0.0000000000, propagate_forward_time: 8.1715383530, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5611801147
validation[          , genome  3438] predictions:    9733/  10000 (97.33%), best:    9731/10000 (97.31%), error:       934.23657, best error:       911.77405 on epoch:    41, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 101.4156494141s, input_fired_time: 1.2482478619, output_fired_time: 1.0883640051, propagate_forward_time: 40.0382080078, propagate_backward_time: 55.9345779419, weight_update_time: 0.1449891478, other_time: 3.1062545776
epoch time: 7.6669201851s, input_fired_time: 0.1585967839, output_fired_time: 0.0000000000, propagate_forward_time: 6.9652209282, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5431022644
validation[          , genome  3438] predictions:    9676/  10000 (96.76%), best:    9731/10000 (97.31%), error:      1055.48853, best error:       911.77405 on epoch:    41, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 105.2201690674s, input_fired_time: 1.3029916286, output_fired_time: 2.1395108700, propagate_forward_time: 38.6233825684, propagate_backward_time: 59.9274902344, weight_update_time: 0.1569388062, other_time: 3.2267913818
epoch time: 9.1676120758s, input_fired_time: 0.1630517691, output_fired_time: 0.0000000000, propagate_forward_time: 8.4433526993, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5612077713
validation[          , genome  3438] predictions:    9695/  10000 (96.95%), best:    9731/10000 (97.31%), error:       987.87421, best error:       911.77405 on epoch:    41, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 101.2506256104s, input_fired_time: 1.2488000393, output_fired_time: 1.0931363106, propagate_forward_time: 37.0250930786, propagate_backward_time: 58.7619552612, weight_update_time: 0.1455599964, other_time: 3.1216354370
epoch time: 7.7868499756s, input_fired_time: 0.1581057310, output_fired_time: 0.0000000000, propagate_forward_time: 7.0856618881, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5430822372
validation[          , genome  3438] predictions:    9694/  10000 (96.94%), best:    9731/10000 (97.31%), error:       996.59338, best error:       911.77405 on epoch:    41, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 107.5936279297s, input_fired_time: 1.3113136292, output_fired_time: 1.1357771158, propagate_forward_time: 38.9073944092, propagate_backward_time: 62.9466857910, weight_update_time: 0.1521508843, other_time: 3.2924575806
epoch time: 8.3072490692s, input_fired_time: 0.1612094790, output_fired_time: 0.0000000000, propagate_forward_time: 7.5469479561, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5990920067
validation[          , genome  3438] predictions:    9682/  10000 (96.82%), best:    9731/10000 (97.31%), error:      1055.25635, best error:       911.77405 on epoch:    41, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 106.8522415161s, input_fired_time: 1.3268023729, output_fired_time: 1.1569527388, propagate_forward_time: 41.1612777710, propagate_backward_time: 59.9462471008, weight_update_time: 0.1446211934, other_time: 3.2609596252
epoch time: 8.8822488785s, input_fired_time: 0.1610676944, output_fired_time: 0.0000000000, propagate_forward_time: 8.1744413376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5467395782
validation[          , genome  3438] predictions:    9713/  10000 (97.13%), best:    9731/10000 (97.31%), error:       983.99420, best error:       911.77405 on epoch:    41, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 101.5984420776s, input_fired_time: 1.2542999983, output_fired_time: 1.0874902010, propagate_forward_time: 38.1000785828, propagate_backward_time: 58.0358085632, weight_update_time: 0.1462055147, other_time: 3.1207580566
epoch time: 7.8740000725s, input_fired_time: 0.1622875035, output_fired_time: 0.0000000000, propagate_forward_time: 7.1581573486, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5535550117
validation[          , genome  3438] predictions:    9672/  10000 (96.72%), best:    9731/10000 (97.31%), error:      1023.27289, best error:       911.77405 on epoch:    41, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 104.1316604614s, input_fired_time: 1.2833385468, output_fired_time: 1.1138188839, propagate_forward_time: 39.7146186829, propagate_backward_time: 58.8638076782, weight_update_time: 0.1472850889, other_time: 3.1560783386
epoch time: 7.8071928024s, input_fired_time: 0.1592834592, output_fired_time: 0.0000000000, propagate_forward_time: 7.1054916382, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5424175262
validation[          , genome  3438] predictions:    9714/  10000 (97.14%), best:    9731/10000 (97.31%), error:       968.75403, best error:       911.77405 on epoch:    41, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 100.5567779541s, input_fired_time: 1.2458689213, output_fired_time: 1.0701729059, propagate_forward_time: 35.6237068176, propagate_backward_time: 58.4839057922, weight_update_time: 1.1538674831, other_time: 4.1331176758
epoch time: 7.8943223953s, input_fired_time: 0.1587639749, output_fired_time: 0.0000000000, propagate_forward_time: 7.1909656525, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5445928574
validation[          , genome  3438] predictions:    9720/  10000 (97.20%), best:    9731/10000 (97.31%), error:       972.39923, best error:       911.77405 on epoch:    41, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 101.8249969482s, input_fired_time: 1.2477537394, output_fired_time: 1.0772560835, propagate_forward_time: 37.7287139893, propagate_backward_time: 58.6658401489, weight_update_time: 0.1443905085, other_time: 3.1054306030
epoch time: 7.8476309776s, input_fired_time: 0.1584003419, output_fired_time: 0.0000000000, propagate_forward_time: 7.1417608261, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5474696159
validation[          , genome  3438] predictions:    9664/  10000 (96.64%), best:    9731/10000 (97.31%), error:      1127.27844, best error:       911.77405 on epoch:    41, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 101.0562744141s, input_fired_time: 1.2433224916, output_fired_time: 1.0856304169, propagate_forward_time: 38.9130172729, propagate_backward_time: 56.6886329651, weight_update_time: 0.1453825384, other_time: 3.1256675720
epoch time: 7.8028035164s, input_fired_time: 0.1560316086, output_fired_time: 0.0000000000, propagate_forward_time: 7.1098151207, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5369567871
validation[          , genome  3438] predictions:    9656/  10000 (96.56%), best:    9731/10000 (97.31%), error:      1160.48645, best error:       911.77405 on epoch:    41, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 102.2930755615s, input_fired_time: 1.2505816221, output_fired_time: 1.0940815210, propagate_forward_time: 38.3628692627, propagate_backward_time: 58.4521369934, weight_update_time: 0.1458757818, other_time: 3.1334114075
epoch time: 7.8103966713s, input_fired_time: 0.1597785503, output_fired_time: 0.0000000000, propagate_forward_time: 7.0878934860, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5627245903
validation[          , genome  3438] predictions:    9691/  10000 (96.91%), best:    9731/10000 (97.31%), error:      1019.98523, best error:       911.77405 on epoch:    41, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 101.0873489380s, input_fired_time: 1.2590903044, output_fired_time: 1.0916396379, propagate_forward_time: 38.6757621765, propagate_backward_time: 56.9268684387, weight_update_time: 0.1451997906, other_time: 3.1339950562
epoch time: 7.8326559067s, input_fired_time: 0.1557800174, output_fired_time: 0.0000000000, propagate_forward_time: 7.1299066544, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5469694138
validation[          , genome  3438] predictions:    9575/  10000 (95.75%), best:    9731/10000 (97.31%), error:      1328.89160, best error:       911.77405 on epoch:    41, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 102.9211502075s, input_fired_time: 1.2592395544, output_fired_time: 1.0934667587, propagate_forward_time: 39.1428451538, propagate_backward_time: 58.2535514832, weight_update_time: 0.1457495242, other_time: 3.1720466614
epoch time: 7.8562512398s, input_fired_time: 0.1603243649, output_fired_time: 0.0000000000, propagate_forward_time: 7.1455211639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5504055023
validation[          , genome  3438] predictions:    9722/  10000 (97.22%), best:    9731/10000 (97.31%), error:       936.84869, best error:       911.77405 on epoch:    41, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 103.0803298950s, input_fired_time: 2.2732303143, output_fired_time: 1.1021157503, propagate_forward_time: 38.5872459412, propagate_backward_time: 56.9466743469, weight_update_time: 0.1530693769, other_time: 4.1710586548
epoch time: 11.2764987946s, input_fired_time: 0.2063640058, output_fired_time: 0.0000000000, propagate_forward_time: 10.3907499313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6793851852
validation[          , genome  3438] predictions:    9682/  10000 (96.82%), best:    9731/10000 (97.31%), error:      1051.13220, best error:       911.77405 on epoch:    41, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 107.6794738770s, input_fired_time: 1.3272533417, output_fired_time: 1.1434458494, propagate_forward_time: 41.5123634338, propagate_backward_time: 60.4164199829, weight_update_time: 0.1532488763, other_time: 3.2799873352
epoch time: 9.1537580490s, input_fired_time: 0.1683956683, output_fired_time: 0.0000000000, propagate_forward_time: 8.4185104370, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5668516159
validation[          , genome  3438] predictions:    9717/  10000 (97.17%), best:    9731/10000 (97.31%), error:       976.50513, best error:       911.77405 on epoch:    41, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 101.7223815918s, input_fired_time: 2.2638149261, output_fired_time: 1.0889526606, propagate_forward_time: 38.1591720581, propagate_backward_time: 57.0866661072, weight_update_time: 0.1461249292, other_time: 3.1237754822
epoch time: 7.8493657112s, input_fired_time: 0.1555688381, output_fired_time: 0.0000000000, propagate_forward_time: 7.1588697433, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5349273682
validation[          , genome  3438] predictions:    9647/  10000 (96.47%), best:    9731/10000 (97.31%), error:      1147.07800, best error:       911.77405 on epoch:    41, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 100.4233245850s, input_fired_time: 1.2472335100, output_fired_time: 1.0743829012, propagate_forward_time: 37.6638946533, propagate_backward_time: 57.3366432190, weight_update_time: 0.1442913711, other_time: 3.1011695862
epoch time: 9.0870552063s, input_fired_time: 0.1648560613, output_fired_time: 0.0000000000, propagate_forward_time: 8.3597803116, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5624189377
validation[          , genome  3438] predictions:    9675/  10000 (96.75%), best:    9731/10000 (97.31%), error:      1046.43835, best error:       911.77405 on epoch:    41, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 100.8786468506s, input_fired_time: 1.2506029606, output_fired_time: 1.0823018551, propagate_forward_time: 35.8537368774, propagate_backward_time: 59.5852928162, weight_update_time: 0.1446494758, other_time: 3.1067161560
epoch time: 7.8498468399s, input_fired_time: 0.1602847874, output_fired_time: 0.0000000000, propagate_forward_time: 7.1414580345, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5481038094
validation[          , genome  3438] predictions:    9702/  10000 (97.02%), best:    9731/10000 (97.31%), error:       996.15723, best error:       911.77405 on epoch:    41, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 101.5836944580s, input_fired_time: 1.2539254427, output_fired_time: 1.0897940397, propagate_forward_time: 38.0111808777, propagate_backward_time: 58.1180801392, weight_update_time: 0.1565804631, other_time: 3.1107139587
epoch time: 9.1936883926s, input_fired_time: 0.1669794619, output_fired_time: 0.0000000000, propagate_forward_time: 8.4610786438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5656299591
validation[          , genome  3438] predictions:    9695/  10000 (96.95%), best:    9731/10000 (97.31%), error:       944.97894, best error:       911.77405 on epoch:    41, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 108.9600906372s, input_fired_time: 1.3781245947, output_fired_time: 1.1865905523, propagate_forward_time: 40.9224433899, propagate_backward_time: 62.1910743713, weight_update_time: 0.1583262384, other_time: 3.2818565369
epoch time: 9.0965681076s, input_fired_time: 0.1633826643, output_fired_time: 0.0000000000, propagate_forward_time: 8.3822431564, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5509424210
validation[          , genome  3438] predictions:    9695/  10000 (96.95%), best:    9731/10000 (97.31%), error:       997.57587, best error:       911.77405 on epoch:    41, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 101.3612976074s, input_fired_time: 1.2576959133, output_fired_time: 1.0853323936, propagate_forward_time: 37.9637489319, propagate_backward_time: 57.9388542175, weight_update_time: 0.1458487809, other_time: 3.1156616211
epoch time: 7.7359662056s, input_fired_time: 0.1588998288, output_fired_time: 0.0000000000, propagate_forward_time: 7.0335879326, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5434784889
validation[          , genome  3438] predictions:    9714/  10000 (97.14%), best:    9731/10000 (97.31%), error:       957.90338, best error:       911.77405 on epoch:    41, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 111.9645996094s, input_fired_time: 1.4115079641, output_fired_time: 1.1504089832, propagate_forward_time: 41.6517028809, propagate_backward_time: 64.3835372925, weight_update_time: 0.1540457606, other_time: 3.3674468994
epoch time: 8.9052715302s, input_fired_time: 0.1684142947, output_fired_time: 0.0000000000, propagate_forward_time: 8.1225395203, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6143178940
validation[          , genome  3438] predictions:    9710/  10000 (97.10%), best:    9731/10000 (97.31%), error:       955.79120, best error:       911.77405 on epoch:    41, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 101.5299911499s, input_fired_time: 1.2638934851, output_fired_time: 1.0865801573, propagate_forward_time: 39.0919113159, propagate_backward_time: 56.9559631348, weight_update_time: 0.1456470340, other_time: 3.1316452026
epoch time: 9.0369653702s, input_fired_time: 0.1647568792, output_fired_time: 0.0000000000, propagate_forward_time: 8.3020753860, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5701332092
validation[          , genome  3438] predictions:    9700/  10000 (97.00%), best:    9731/10000 (97.31%), error:       998.40686, best error:       911.77405 on epoch:    41, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 101.3100280762s, input_fired_time: 1.2599554062, output_fired_time: 1.0823044777, propagate_forward_time: 38.0033912659, propagate_backward_time: 57.8410301208, weight_update_time: 0.1454625875, other_time: 3.1233444214
epoch time: 7.8157167435s, input_fired_time: 0.1568610072, output_fired_time: 0.0000000000, propagate_forward_time: 7.1187629700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5400929451
validation[          , genome  3438] predictions:    9703/  10000 (97.03%), best:    9731/10000 (97.31%), error:       973.22070, best error:       911.77405 on epoch:    41, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 101.3175506592s, input_fired_time: 1.2555675507, output_fired_time: 1.0861886740, propagate_forward_time: 36.9690895081, propagate_backward_time: 58.8872108459, weight_update_time: 0.1460286826, other_time: 3.1194915771
epoch time: 9.1565980911s, input_fired_time: 0.1655060649, output_fired_time: 0.0000000000, propagate_forward_time: 7.4197573662, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5713343620
validation[          , genome  3438] predictions:    9718/  10000 (97.18%), best:    9731/10000 (97.31%), error:       954.58221, best error:       911.77405 on epoch:    41, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 107.3655776978s, input_fired_time: 1.2963656187, output_fired_time: 1.1391519308, propagate_forward_time: 40.4927406311, propagate_backward_time: 61.1441230774, weight_update_time: 0.1462183148, other_time: 3.2931938171
epoch time: 9.0642871857s, input_fired_time: 0.1640956551, output_fired_time: 0.0000000000, propagate_forward_time: 8.3335781097, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5666131973
validation[          , genome  3438] predictions:    9668/  10000 (96.68%), best:    9731/10000 (97.31%), error:      1125.06799, best error:       911.77405 on epoch:    41, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 101.1786499023s, input_fired_time: 1.2700798512, output_fired_time: 1.0960199833, propagate_forward_time: 37.9769477844, propagate_backward_time: 57.7163162231, weight_update_time: 0.1517204344, other_time: 3.1192817688
epoch time: 12.1084928513s, input_fired_time: 0.2484095395, output_fired_time: 0.0000000000, propagate_forward_time: 11.0291757584, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8309078217
validation[          , genome  3438] predictions:    9612/  10000 (96.12%), best:    9731/10000 (97.31%), error:      1268.81750, best error:       911.77405 on epoch:    41, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 105.5059432983s, input_fired_time: 1.2892024517, output_fired_time: 1.1241068840, propagate_forward_time: 38.3057174683, propagate_backward_time: 60.6899909973, weight_update_time: 0.1440449953, other_time: 4.0969276428
epoch time: 7.8489356041s, input_fired_time: 0.1602604091, output_fired_time: 0.0000000000, propagate_forward_time: 7.1404628754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5482125282
validation[          , genome  3438] predictions:    9731/  10000 (97.31%), best:    9731/10000 (97.31%), error:       920.96100, best error:       911.77405 on epoch:    41, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 40.9751091003s, input_fired_time: 0.7834448814, output_fired_time: 0.0000000000, propagate_forward_time: 37.3588142395, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8328514099
best training[          , genome  3438] predictions:   49243/  50000 (98.49%), best:    9731/10000 (97.31%), error:      2756.24780, best error:       911.77405 on epoch:    41, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 7.8082356453s, input_fired_time: 0.1561685205, output_fired_time: 0.0000000000, propagate_forward_time: 7.1037306786, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5483365059
   testing[          , genome  3438] predictions:    9747/  10000 (97.47%), best:    9731/10000 (97.31%), error:       815.73035, best error:       911.77405 on epoch:    41, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
07:17:50 (6820): called boinc_finish(0)

</stderr_txt>
]]>