Nameexact_genome_1512568488_42_7117_1
Workunit2606834
Created7 Dec 2017, 23:55:24 UTC
Sent8 Dec 2017, 0:01:15 UTC
Report deadline16 Dec 2017, 15:22:31 UTC
Received8 Dec 2017, 14:22:30 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID65413
Run time3 hours 28 min 2 sec
CPU time3 hours 27 min 57 sec
Validate stateValid
Credit2,159.94
Device peak FLOPS3.73 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size153.78 MB
Peak swap size155.42 MB
Peak disk usage1.41 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
307007, propagate_backward_time: 59.1279373169, weight_update_time: 0.1143227741, other_time: 2.5157394409
epoch time: 8.6451931000s, input_fired_time: 0.1425944716, output_fired_time: 0.0000000000, propagate_forward_time: 8.0871553421, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4154434204
validation[          , genome  7117] predictions:    9716/  10000 (97.16%), best:    9716/10000 (97.16%), error:       974.61169, best error:       974.61169 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 112.0912322998s, input_fired_time: 1.4520233870, output_fired_time: 1.0007616282, propagate_forward_time: 45.8069038391, propagate_backward_time: 61.2722740173, weight_update_time: 0.1112924889, other_time: 2.5592651367
epoch time: 10.2829904556s, input_fired_time: 0.1632062197, output_fired_time: 0.0000000000, propagate_forward_time: 9.6406631470, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4791212082
validation[          , genome  7117] predictions:    9690/  10000 (96.90%), best:    9716/10000 (97.16%), error:      1065.02966, best error:       974.61169 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 109.7068328857s, input_fired_time: 1.4281749725, output_fired_time: 0.9830024838, propagate_forward_time: 44.4852333069, propagate_backward_time: 60.3041534424, weight_update_time: 0.1092551127, other_time: 2.5062675476
epoch time: 8.6916522980s, input_fired_time: 0.1427526325, output_fired_time: 0.0000000000, propagate_forward_time: 8.1257667542, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4231328964
validation[          , genome  7117] predictions:    9539/  10000 (95.39%), best:    9716/10000 (97.16%), error:      1504.20337, best error:       974.61169 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 115.9560165405s, input_fired_time: 1.4794534445, output_fired_time: 1.0295125246, propagate_forward_time: 47.2999382019, propagate_backward_time: 63.5389480591, weight_update_time: 0.1140765622, other_time: 2.6081619263
epoch time: 8.4619607925s, input_fired_time: 0.1466007382, output_fired_time: 0.0000000000, propagate_forward_time: 7.9104070663, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4049530029
validation[          , genome  7117] predictions:    9624/  10000 (96.24%), best:    9716/10000 (97.16%), error:      1196.99231, best error:       974.61169 on epoch:    14, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 115.2191925049s, input_fired_time: 1.4844957590, output_fired_time: 1.0231834650, propagate_forward_time: 46.9001655579, propagate_backward_time: 63.2220306396, weight_update_time: 0.1130946130, other_time: 2.5893096924
epoch time: 10.2435226440s, input_fired_time: 0.1634239554, output_fired_time: 0.0000000000, propagate_forward_time: 9.6075067520, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4725923538
validation[          , genome  7117] predictions:    9704/  10000 (97.04%), best:    9704/10000 (97.04%), error:       915.63446, best error:       915.63446 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 107.2007980347s, input_fired_time: 1.4196959734, output_fired_time: 0.9727404118, propagate_forward_time: 43.3965377808, propagate_backward_time: 58.9955177307, weight_update_time: 0.1061289534, other_time: 2.4163093567
epoch time: 8.4305315018s, input_fired_time: 0.1441042274, output_fired_time: 0.0000000000, propagate_forward_time: 7.8796167374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4068107605
validation[          , genome  7117] predictions:    9689/  10000 (96.89%), best:    9704/10000 (97.04%), error:       989.43451, best error:       915.63446 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 116.9192504883s, input_fired_time: 1.5068818331, output_fired_time: 1.0463070869, propagate_forward_time: 47.5459327698, propagate_backward_time: 64.2323760986, weight_update_time: 0.1144710332, other_time: 2.5877532959
epoch time: 10.9454307556s, input_fired_time: 0.1781664193, output_fired_time: 0.0000000000, propagate_forward_time: 10.2697620392, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4975023270
validation[          , genome  7117] predictions:    9722/  10000 (97.22%), best:    9722/10000 (97.22%), error:       886.48212, best error:       886.48212 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 119.8369445801s, input_fired_time: 1.5325415134, output_fired_time: 1.0623339415, propagate_forward_time: 48.7361488342, propagate_backward_time: 65.8372573853, weight_update_time: 0.1205979586, other_time: 2.6686630249
epoch time: 12.1389179230s, input_fired_time: 0.1971771866, output_fired_time: 0.0000000000, propagate_forward_time: 11.4077939987, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5339469910
validation[          , genome  7117] predictions:    9722/  10000 (97.22%), best:    9722/10000 (97.22%), error:       931.83374, best error:       886.48212 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 124.8202285767s, input_fired_time: 1.5774797201, output_fired_time: 1.1024291515, propagate_forward_time: 50.7501029968, propagate_backward_time: 68.6377258301, weight_update_time: 0.1246899590, other_time: 2.7524871826
epoch time: 12.0896558762s, input_fired_time: 0.1924092025, output_fired_time: 0.0000000000, propagate_forward_time: 11.3603563309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5368900299
validation[          , genome  7117] predictions:    9703/  10000 (97.03%), best:    9722/10000 (97.22%), error:      1012.10382, best error:       886.48212 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 114.6226806641s, input_fired_time: 1.5159893036, output_fired_time: 1.0062059164, propagate_forward_time: 46.8321380615, propagate_backward_time: 62.5861129761, weight_update_time: 0.1216635779, other_time: 2.6822357178
epoch time: 9.4054241180s, input_fired_time: 0.1635039002, output_fired_time: 0.0000000000, propagate_forward_time: 8.7923364639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4495840073
validation[          , genome  7117] predictions:    9734/  10000 (97.34%), best:    9734/10000 (97.34%), error:       810.93854, best error:       810.93854 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 109.0957946777s, input_fired_time: 1.4557098150, output_fired_time: 0.9787991643, propagate_forward_time: 44.0487327576, propagate_backward_time: 60.0934524536, weight_update_time: 0.1120710149, other_time: 2.5191001892
epoch time: 10.6806926727s, input_fired_time: 0.1746894121, output_fired_time: 0.0000000000, propagate_forward_time: 10.0314149857, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4745883942
validation[          , genome  7117] predictions:    9705/  10000 (97.05%), best:    9734/10000 (97.34%), error:       940.63635, best error:       810.93854 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 118.2026901245s, input_fired_time: 1.5348384380, output_fired_time: 1.0469702482, propagate_forward_time: 48.1194725037, propagate_backward_time: 64.8446426392, weight_update_time: 0.1186581925, other_time: 2.6567764282
epoch time: 11.1406469345s, input_fired_time: 0.1859487891, output_fired_time: 0.0000000000, propagate_forward_time: 10.4513921738, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5033063889
validation[          , genome  7117] predictions:    9729/  10000 (97.29%), best:    9734/10000 (97.34%), error:       843.85797, best error:       810.93854 on epoch:    23, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 128.4033660889s, input_fired_time: 1.6240410805, output_fired_time: 1.1240478754, propagate_forward_time: 52.4898414612, propagate_backward_time: 70.3438644409, weight_update_time: 0.1271730065, other_time: 2.8215713501
epoch time: 9.8390722275s, input_fired_time: 0.1637110859, output_fired_time: 0.0000000000, propagate_forward_time: 9.2173252106, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4580354691
validation[          , genome  7117] predictions:    9730/  10000 (97.30%), best:    9734/10000 (97.34%), error:       907.24390, best error:       810.93854 on epoch:    23, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 126.6891326904s, input_fired_time: 1.5969775915, output_fired_time: 1.1077151299, propagate_forward_time: 51.7427024841, propagate_backward_time: 69.4529037476, weight_update_time: 0.1252137572, other_time: 2.7888412476
epoch time: 9.3388748169s, input_fired_time: 0.1585535556, output_fired_time: 0.0000000000, propagate_forward_time: 8.7439260483, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4363956451
validation[          , genome  7117] predictions:    9719/  10000 (97.19%), best:    9734/10000 (97.34%), error:       927.63342, best error:       810.93854 on epoch:    23, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 130.0217590332s, input_fired_time: 1.6094285250, output_fired_time: 1.1382502317, propagate_forward_time: 53.1493759155, propagate_backward_time: 71.2863998413, weight_update_time: 0.1279444695, other_time: 2.8382949829
epoch time: 9.4752693176s, input_fired_time: 0.1574413925, output_fired_time: 0.0000000000, propagate_forward_time: 8.8806352615, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4371929169
validation[          , genome  7117] predictions:    9740/  10000 (97.40%), best:    9734/10000 (97.34%), error:       898.32123, best error:       810.93854 on epoch:    23, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 122.6921157837s, input_fired_time: 1.5541641712, output_fired_time: 1.0779626369, propagate_forward_time: 50.1113090515, propagate_backward_time: 67.2294769287, weight_update_time: 0.1214700937, other_time: 2.7192077637
epoch time: 9.8756265640s, input_fired_time: 0.1605033726, output_fired_time: 0.0000000000, propagate_forward_time: 9.2594814301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4556417465
validation[          , genome  7117] predictions:    9719/  10000 (97.19%), best:    9734/10000 (97.34%), error:       941.26672, best error:       810.93854 on epoch:    23, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 109.0737838745s, input_fired_time: 1.4434368610, output_fired_time: 0.9808448553, propagate_forward_time: 44.1466484070, propagate_backward_time: 60.0503425598, weight_update_time: 0.1084808633, other_time: 2.4525146484
epoch time: 12.4905214310s, input_fired_time: 0.1911103874, output_fired_time: 0.0000000000, propagate_forward_time: 11.7671098709, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5323009491
validation[          , genome  7117] predictions:    9724/  10000 (97.24%), best:    9734/10000 (97.34%), error:       913.10590, best error:       810.93854 on epoch:    23, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 116.3968811035s, input_fired_time: 1.5044697523, output_fired_time: 1.0292406082, propagate_forward_time: 47.4507179260, propagate_backward_time: 63.7914390564, weight_update_time: 0.1162214726, other_time: 2.6210060120
epoch time: 10.1953964233s, input_fired_time: 0.1671498418, output_fired_time: 0.0000000000, propagate_forward_time: 9.5652618408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4629850388
validation[          , genome  7117] predictions:    9743/  10000 (97.43%), best:    9734/10000 (97.34%), error:       896.93549, best error:       810.93854 on epoch:    23, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 111.3124618530s, input_fired_time: 1.4679378271, output_fired_time: 1.0071716309, propagate_forward_time: 45.3996353149, propagate_backward_time: 60.9474868774, weight_update_time: 0.1099477783, other_time: 2.4902267456
epoch time: 8.6054754257s, input_fired_time: 0.1532040685, output_fired_time: 0.0000000000, propagate_forward_time: 8.0409107208, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4113607407
validation[          , genome  7117] predictions:    9392/  10000 (93.92%), best:    9734/10000 (97.34%), error:      2083.58887, best error:       810.93854 on epoch:    23, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

resetting weights to those on epoch: 23
epoch time: 116.2827987671s, input_fired_time: 1.4963921309, output_fired_time: 1.0431287289, propagate_forward_time: 47.2117691040, propagate_backward_time: 63.9556999207, weight_update_time: 0.1149114743, other_time: 2.5758094788
epoch time: 12.4016332626s, input_fired_time: 0.1981434822, output_fired_time: 0.0000000000, propagate_forward_time: 11.6568956375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5465936661
validation[          , genome  7117] predictions:    9737/  10000 (97.37%), best:    9734/10000 (97.34%), error:       833.07452, best error:       810.93854 on epoch:    23, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 111.6999740601s, input_fired_time: 1.4564421177, output_fired_time: 1.0000292063, propagate_forward_time: 45.5447044373, propagate_backward_time: 61.2112083435, weight_update_time: 0.1107997820, other_time: 2.4875869751
epoch time: 8.6255369186s, input_fired_time: 0.1510231346, output_fired_time: 0.0000000000, propagate_forward_time: 8.0573320389, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4171819687
validation[          , genome  7117] predictions:    9687/  10000 (96.87%), best:    9734/10000 (97.34%), error:      1045.06531, best error:       810.93854 on epoch:    23, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 113.4310302734s, input_fired_time: 1.5007197857, output_fired_time: 1.0258532763, propagate_forward_time: 46.0940589905, propagate_backward_time: 62.2180786133, weight_update_time: 0.1155863255, other_time: 2.5923156738
epoch time: 8.6885356903s, input_fired_time: 0.1514846832, output_fired_time: 0.0000000000, propagate_forward_time: 8.1149673462, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4220838547
validation[          , genome  7117] predictions:    9749/  10000 (97.49%), best:    9734/10000 (97.34%), error:       854.49713, best error:       810.93854 on epoch:    23, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 126.3548431396s, input_fired_time: 1.5777283907, output_fired_time: 1.1098489761, propagate_forward_time: 51.4701881409, propagate_backward_time: 69.4409332275, weight_update_time: 0.1261582226, other_time: 2.7561492920
epoch time: 8.3795413971s, input_fired_time: 0.1418090016, output_fired_time: 0.0000000000, propagate_forward_time: 7.8333740234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4043579102
validation[          , genome  7117] predictions:    9702/  10000 (97.02%), best:    9734/10000 (97.34%), error:       998.04382, best error:       810.93854 on epoch:    23, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 109.7708282471s, input_fired_time: 1.4419394732, output_fired_time: 0.9848595858, propagate_forward_time: 44.7378578186, propagate_backward_time: 60.1224250793, weight_update_time: 0.1088526547, other_time: 2.4837417603
epoch time: 10.2400903702s, input_fired_time: 0.1828281432, output_fired_time: 0.0000000000, propagate_forward_time: 9.5883140564, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4689483643
validation[          , genome  7117] predictions:    9718/  10000 (97.18%), best:    9734/10000 (97.34%), error:       878.72754, best error:       810.93854 on epoch:    23, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 104.4277725220s, input_fired_time: 1.3968393803, output_fired_time: 0.9476029873, propagate_forward_time: 42.3813018799, propagate_backward_time: 57.2873764038, weight_update_time: 0.1039667726, other_time: 2.4146499634
epoch time: 8.5913124084s, input_fired_time: 0.1461470127, output_fired_time: 0.0000000000, propagate_forward_time: 8.0346326828, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4105329514
validation[          , genome  7117] predictions:    9684/  10000 (96.84%), best:    9734/10000 (97.34%), error:      1022.55542, best error:       810.93854 on epoch:    23, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 104.4828948975s, input_fired_time: 1.4090930223, output_fired_time: 0.9517160058, propagate_forward_time: 42.3979148865, propagate_backward_time: 57.3098068237, weight_update_time: 0.1048693582, other_time: 2.4143638611
epoch time: 8.6845731735s, input_fired_time: 0.1496064365, output_fired_time: 0.0000000000, propagate_forward_time: 8.1145229340, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4204435349
validation[          , genome  7117] predictions:    9753/  10000 (97.53%), best:    9734/10000 (97.34%), error:       892.72620, best error:       810.93854 on epoch:    23, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 105.9031677246s, input_fired_time: 1.4194626808, output_fired_time: 0.9594690800, propagate_forward_time: 43.0139808655, propagate_backward_time: 58.0746459961, weight_update_time: 0.1056028679, other_time: 2.4356040955
epoch time: 9.6427803040s, input_fired_time: 0.1619426310, output_fired_time: 0.0000000000, propagate_forward_time: 9.0350713730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4457664490
validation[          , genome  7117] predictions:    9751/  10000 (97.51%), best:    9734/10000 (97.34%), error:       821.26825, best error:       810.93854 on epoch:    23, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 105.0207672119s, input_fired_time: 1.4074600935, output_fired_time: 0.9550478458, propagate_forward_time: 42.4481773376, propagate_backward_time: 57.7903862000, weight_update_time: 0.1057070643, other_time: 2.4196929932
epoch time: 8.6772289276s, input_fired_time: 0.1529309005, output_fired_time: 0.0000000000, propagate_forward_time: 8.1080818176, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4162158966
validation[          , genome  7117] predictions:    9339/  10000 (93.39%), best:    9734/10000 (97.34%), error:      2219.33643, best error:       810.93854 on epoch:    23, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

resetting weights to those on epoch: 23
epoch time: 100.9425277710s, input_fired_time: 1.3611973524, output_fired_time: 0.9251137972, propagate_forward_time: 40.6822395325, propagate_backward_time: 55.6410331726, weight_update_time: 0.1012933627, other_time: 2.3329391479
epoch time: 8.5694684982s, input_fired_time: 0.1432873756, output_fired_time: 0.0000000000, propagate_forward_time: 8.0183658600, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4078149796
validation[          , genome  7117] predictions:    9748/  10000 (97.48%), best:    9734/10000 (97.34%), error:       826.77979, best error:       810.93854 on epoch:    23, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 106.1863098145s, input_fired_time: 1.4012628794, output_fired_time: 0.9645613432, propagate_forward_time: 43.0338172913, propagate_backward_time: 58.3843078613, weight_update_time: 0.1057928205, other_time: 2.4023628235
epoch time: 11.5161113739s, input_fired_time: 0.1793896705, output_fired_time: 0.0000000000, propagate_forward_time: 10.8350696564, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5016517639
validation[          , genome  7117] predictions:    9675/  10000 (96.75%), best:    9734/10000 (97.34%), error:      1080.86084, best error:       810.93854 on epoch:    23, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 103.8978195190s, input_fired_time: 1.3786315918, output_fired_time: 0.9420564771, propagate_forward_time: 41.8129158020, propagate_backward_time: 57.3939056396, weight_update_time: 0.1051941961, other_time: 2.3703117371
epoch time: 11.2827625275s, input_fired_time: 0.1794677526, output_fired_time: 0.0000000000, propagate_forward_time: 10.6079063416, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4953880310
validation[          , genome  7117] predictions:    9746/  10000 (97.46%), best:    9734/10000 (97.34%), error:       838.22864, best error:       810.93854 on epoch:    23, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 122.9141769409s, input_fired_time: 1.5572854280, output_fired_time: 1.0701421499, propagate_forward_time: 50.0522041321, propagate_backward_time: 67.4714202881, weight_update_time: 0.1260143071, other_time: 2.7631225586
epoch time: 9.0431175232s, input_fired_time: 0.1555530131, output_fired_time: 0.0000000000, propagate_forward_time: 8.4551391602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4324254990
validation[          , genome  7117] predictions:    9745/  10000 (97.45%), best:    9745/10000 (97.45%), error:       797.89447, best error:       797.89447 on epoch:    45, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 109.0764389038s, input_fired_time: 1.4274461269, output_fired_time: 0.9850844741, propagate_forward_time: 43.9742279053, propagate_backward_time: 60.2403411865, weight_update_time: 0.1082786098, other_time: 2.4493408203
epoch time: 8.8838338852s, input_fired_time: 0.1523672342, output_fired_time: 0.0000000000, propagate_forward_time: 8.3069658279, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4245004654
validation[          , genome  7117] predictions:    9749/  10000 (97.49%), best:    9745/10000 (97.45%), error:       802.29382, best error:       797.89447 on epoch:    45, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 106.0726547241s, input_fired_time: 1.4131261110, output_fired_time: 0.9629724026, propagate_forward_time: 42.9437255859, propagate_backward_time: 58.3310585022, weight_update_time: 0.1066303402, other_time: 2.4217720032
epoch time: 8.7264709473s, input_fired_time: 0.1513114572, output_fired_time: 0.0000000000, propagate_forward_time: 8.1558723450, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4192867279
validation[          , genome  7117] predictions:    9722/  10000 (97.22%), best:    9745/10000 (97.45%), error:       884.95276, best error:       797.89447 on epoch:    45, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 115.5943145752s, input_fired_time: 1.4940115213, output_fired_time: 1.0278103352, propagate_forward_time: 46.9567489624, propagate_backward_time: 63.5504302979, weight_update_time: 0.1151375100, other_time: 2.5653152466
epoch time: 8.6381616592s, input_fired_time: 0.1534839123, output_fired_time: 0.0000000000, propagate_forward_time: 8.0765686035, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4081087112
validation[          , genome  7117] predictions:    9751/  10000 (97.51%), best:    9745/10000 (97.45%), error:       823.49231, best error:       797.89447 on epoch:    45, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 108.2321166992s, input_fired_time: 1.4274728298, output_fired_time: 0.9812343717, propagate_forward_time: 43.8373184204, propagate_backward_time: 59.5494308472, weight_update_time: 0.1059111133, other_time: 2.4366607666
epoch time: 12.4572515488s, input_fired_time: 0.1931362897, output_fired_time: 0.0000000000, propagate_forward_time: 11.7227745056, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5413408279
validation[          , genome  7117] predictions:    9742/  10000 (97.42%), best:    9745/10000 (97.45%), error:       819.04785, best error:       797.89447 on epoch:    45, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 105.5942535400s, input_fired_time: 1.4094772339, output_fired_time: 0.9607669711, propagate_forward_time: 42.8993759155, propagate_backward_time: 57.9110031128, weight_update_time: 0.1053155810, other_time: 2.4136276245
epoch time: 9.7318229675s, input_fired_time: 0.1618468910, output_fired_time: 0.0000000000, propagate_forward_time: 9.1212940216, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4486818314
validation[          , genome  7117] predictions:    9721/  10000 (97.21%), best:    9745/10000 (97.45%), error:       904.70551, best error:       797.89447 on epoch:    45, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 104.2550582886s, input_fired_time: 1.4006859064, output_fired_time: 0.9428942204, propagate_forward_time: 42.2076530457, propagate_backward_time: 57.3078804016, weight_update_time: 0.1046343073, other_time: 2.3959426880
epoch time: 11.4640798569s, input_fired_time: 0.1781275868, output_fired_time: 0.0000000000, propagate_forward_time: 10.7832031250, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5027494431
validation[          , genome  7117] predictions:    9727/  10000 (97.27%), best:    9745/10000 (97.45%), error:       887.34705, best error:       797.89447 on epoch:    45, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 100.6937408447s, input_fired_time: 1.3717787266, output_fired_time: 0.9207082987, propagate_forward_time: 40.9643211365, propagate_backward_time: 55.0850601196, weight_update_time: 0.1010542065, other_time: 2.3518714905
epoch time: 8.5104312897s, input_fired_time: 0.1479664892, output_fired_time: 0.0000000000, propagate_forward_time: 7.9576482773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4048166275
validation[          , genome  7117] predictions:    9756/  10000 (97.56%), best:    9756/10000 (97.56%), error:       778.97266, best error:       778.97266 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 107.2302169800s, input_fired_time: 1.4240512848, output_fired_time: 0.9685519934, propagate_forward_time: 43.4576873779, propagate_backward_time: 58.9770698547, weight_update_time: 0.1061785817, other_time: 2.4028587341
epoch time: 9.8462390900s, input_fired_time: 0.1621737927, output_fired_time: 0.0000000000, propagate_forward_time: 9.2304830551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4535818100
validation[          , genome  7117] predictions:    9696/  10000 (96.96%), best:    9756/10000 (97.56%), error:       953.59039, best error:       778.97266 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 103.2677154541s, input_fired_time: 1.3968397379, output_fired_time: 0.9420295358, propagate_forward_time: 41.7408103943, propagate_backward_time: 56.8059310913, weight_update_time: 0.1035486460, other_time: 2.3820991516
epoch time: 8.4314155579s, input_fired_time: 0.1430335939, output_fired_time: 0.0000000000, propagate_forward_time: 7.8770651817, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4113163948
validation[          , genome  7117] predictions:    9771/  10000 (97.71%), best:    9756/10000 (97.56%), error:       795.99304, best error:       778.97266 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 114.9726104736s, input_fired_time: 1.4881223440, output_fired_time: 1.0262159109, propagate_forward_time: 46.8726310730, propagate_backward_time: 63.0528564453, weight_update_time: 0.1136967763, other_time: 2.5327911377
epoch time: 11.6825847626s, input_fired_time: 0.1822223514, output_fired_time: 0.0000000000, propagate_forward_time: 10.9887933731, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5115690231
validation[          , genome  7117] predictions:    9755/  10000 (97.55%), best:    9756/10000 (97.56%), error:       851.36743, best error:       778.97266 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 105.4119567871s, input_fired_time: 1.4106431007, output_fired_time: 0.9578583241, propagate_forward_time: 42.8034667969, propagate_backward_time: 57.8461303711, weight_update_time: 0.1059161499, other_time: 2.3938598633
epoch time: 8.6165027618s, input_fired_time: 0.1499059945, output_fired_time: 0.0000000000, propagate_forward_time: 8.0590391159, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4075574875
validation[          , genome  7117] predictions:    9759/  10000 (97.59%), best:    9756/10000 (97.56%), error:       779.08344, best error:       778.97266 on epoch:    52, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 109.4033126831s, input_fired_time: 1.4239585400, output_fired_time: 0.9811802506, propagate_forward_time: 44.1671714783, propagate_backward_time: 60.3954200745, weight_update_time: 0.1088973358, other_time: 2.4355850220
epoch time: 9.5647182465s, input_fired_time: 0.1731647551, output_fired_time: 0.0000000000, propagate_forward_time: 8.9303903580, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4611635208
validation[          , genome  7117] predictions:    9646/  10000 (96.46%), best:    9756/10000 (97.56%), error:      1152.40234, best error:       778.97266 on epoch:    52, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 106.8428649902s, input_fired_time: 1.4289858341, output_fired_time: 0.9633949399, propagate_forward_time: 43.3142623901, propagate_backward_time: 58.6975212097, weight_update_time: 0.1081041545, other_time: 2.4387016296
epoch time: 8.6917247772s, input_fired_time: 0.1508141607, output_fired_time: 0.0000000000, propagate_forward_time: 8.1328649521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4080457687
validation[          , genome  7117] predictions:    9770/  10000 (97.70%), best:    9770/10000 (97.70%), error:       772.03851, best error:       772.03851 on epoch:    58, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 118.3849182129s, input_fired_time: 1.5121146441, output_fired_time: 1.0479696989, propagate_forward_time: 47.9509696960, propagate_backward_time: 65.2567214966, weight_update_time: 0.1178396493, other_time: 2.6171493530
epoch time: 11.2444448471s, input_fired_time: 0.1808628589, output_fired_time: 0.0000000000, propagate_forward_time: 10.5657882690, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4977941513
validation[          , genome  7117] predictions:    9723/  10000 (97.23%), best:    9770/10000 (97.70%), error:       934.33331, best error:       772.03851 on epoch:    58, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 126.5092010498s, input_fired_time: 1.5811547041, output_fired_time: 1.1137773991, propagate_forward_time: 51.6212921143, propagate_backward_time: 69.4454956055, weight_update_time: 0.1255549192, other_time: 2.7474822998
epoch time: 8.6945333481s, input_fired_time: 0.1543046236, output_fired_time: 0.0000000000, propagate_forward_time: 8.1166629791, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4235658646
validation[          , genome  7117] predictions:    9665/  10000 (96.65%), best:    9770/10000 (97.70%), error:      1070.55017, best error:       772.03851 on epoch:    58, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 105.2912292480s, input_fired_time: 1.4133284092, output_fired_time: 0.9499729872, propagate_forward_time: 42.6128692627, propagate_backward_time: 57.8935966492, weight_update_time: 0.1050010473, other_time: 2.4214591980
epoch time: 8.7128582001s, input_fired_time: 0.1522417367, output_fired_time: 0.0000000000, propagate_forward_time: 8.1343574524, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4262590408
validation[          , genome  7117] predictions:    9770/  10000 (97.70%), best:    9770/10000 (97.70%), error:       778.31952, best error:       772.03851 on epoch:    58, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 100.0329818726s, input_fired_time: 1.3733222485, output_fired_time: 0.9105407000, propagate_forward_time: 40.4503898621, propagate_backward_time: 54.9797859192, weight_update_time: 0.1006378382, other_time: 2.3189468384
epoch time: 8.7599296570s, input_fired_time: 0.1505087167, output_fired_time: 0.0000000000, propagate_forward_time: 8.1878576279, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4215631485
validation[          , genome  7117] predictions:    9758/  10000 (97.58%), best:    9770/10000 (97.70%), error:       827.97589, best error:       772.03851 on epoch:    58, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 110.1371383667s, input_fired_time: 1.4606293440, output_fired_time: 0.9854419231, propagate_forward_time: 44.5787506104, propagate_backward_time: 60.6031837463, weight_update_time: 0.1095723957, other_time: 2.5091285706
epoch time: 8.4495897293s, input_fired_time: 0.1486086845, output_fired_time: 0.0000000000, propagate_forward_time: 7.8943772316, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4066042900
validation[          , genome  7117] predictions:    9780/  10000 (97.80%), best:    9780/10000 (97.80%), error:       763.43756, best error:       763.43756 on epoch:    63, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 105.3916168213s, input_fired_time: 1.4245234728, output_fired_time: 0.9489319921, propagate_forward_time: 42.7136611938, propagate_backward_time: 57.8893814087, weight_update_time: 0.1059010923, other_time: 2.4151229858
epoch time: 8.5738754272s, input_fired_time: 0.1514026523, output_fired_time: 0.0000000000, propagate_forward_time: 8.0131626129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4093103409
validation[          , genome  7117] predictions:    9760/  10000 (97.60%), best:    9780/10000 (97.80%), error:       786.49585, best error:       763.43756 on epoch:    63, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 110.6344528198s, input_fired_time: 1.4623631239, output_fired_time: 0.9939398766, propagate_forward_time: 44.8759765625, propagate_backward_time: 60.8219490051, weight_update_time: 0.1110052764, other_time: 2.4802207947
epoch time: 8.4159870148s, input_fired_time: 0.1489672661, output_fired_time: 0.0000000000, propagate_forward_time: 7.8553957939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4116234779
validation[          , genome  7117] predictions:    9761/  10000 (97.61%), best:    9780/10000 (97.80%), error:       790.46289, best error:       763.43756 on epoch:    63, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 111.5087051392s, input_fired_time: 1.4819597006, output_fired_time: 0.9950102568, propagate_forward_time: 45.4433403015, propagate_backward_time: 61.0457496643, weight_update_time: 0.1124393865, other_time: 2.5426483154
epoch time: 11.3638668060s, input_fired_time: 0.1863368303, output_fired_time: 0.0000000000, propagate_forward_time: 10.6703567505, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5071735382
validation[          , genome  7117] predictions:    9750/  10000 (97.50%), best:    9780/10000 (97.80%), error:       818.92773, best error:       763.43756 on epoch:    63, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 104.8083496094s, input_fired_time: 1.4380292892, output_fired_time: 0.9510704279, propagate_forward_time: 42.2919273376, propagate_backward_time: 57.7118721008, weight_update_time: 0.1059601158, other_time: 2.4154510498
epoch time: 8.5614671707s, input_fired_time: 0.1514836401, output_fired_time: 0.0000000000, propagate_forward_time: 7.9919590950, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4180245399
validation[          , genome  7117] predictions:    9735/  10000 (97.35%), best:    9780/10000 (97.80%), error:       835.20288, best error:       763.43756 on epoch:    63, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 119.1335372925s, input_fired_time: 1.5330331326, output_fired_time: 1.0577936172, propagate_forward_time: 48.5788688660, propagate_backward_time: 65.3553619385, weight_update_time: 0.1173994169, other_time: 2.6084747314
epoch time: 8.7139301300s, input_fired_time: 0.1519855857, output_fired_time: 0.0000000000, propagate_forward_time: 8.1429395676, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4190053940
validation[          , genome  7117] predictions:    9756/  10000 (97.56%), best:    9780/10000 (97.80%), error:       783.73566, best error:       763.43756 on epoch:    63, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 110.0550613403s, input_fired_time: 1.4623395205, output_fired_time: 0.9851594567, propagate_forward_time: 44.6927795410, propagate_backward_time: 60.4343757629, weight_update_time: 0.1105413511, other_time: 2.4804039001
epoch time: 9.9377546310s, input_fired_time: 0.1697715968, output_fired_time: 0.0000000000, propagate_forward_time: 9.3155536652, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4524297714
validation[          , genome  7117] predictions:    9651/  10000 (96.51%), best:    9780/10000 (97.80%), error:      1174.65613, best error:       763.43756 on epoch:    63, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 114.5930175781s, input_fired_time: 1.5029102564, output_fired_time: 1.0226373672, propagate_forward_time: 46.5590896606, propagate_backward_time: 62.9525718689, weight_update_time: 0.1136394069, other_time: 2.5558128357
epoch time: 8.7733821869s, input_fired_time: 0.1536564231, output_fired_time: 0.0000000000, propagate_forward_time: 8.1995992661, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4201269150
validation[          , genome  7117] predictions:    9776/  10000 (97.76%), best:    9776/10000 (97.76%), error:       760.31879, best error:       760.31879 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 104.6570892334s, input_fired_time: 1.4186866283, output_fired_time: 0.9585686922, propagate_forward_time: 42.1494598389, propagate_backward_time: 57.7401313782, weight_update_time: 0.1053199396, other_time: 2.3902397156
epoch time: 8.5567617416s, input_fired_time: 0.1502965987, output_fired_time: 0.0000000000, propagate_forward_time: 7.9975566864, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4089088440
validation[          , genome  7117] predictions:    9742/  10000 (97.42%), best:    9776/10000 (97.76%), error:       845.28223, best error:       760.31879 on epoch:    70, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 100.1505966187s, input_fired_time: 1.3844821453, output_fired_time: 0.9151755571, propagate_forward_time: 40.4273452759, propagate_backward_time: 55.1085586548, weight_update_time: 0.1010626405, other_time: 2.3150329590
epoch time: 8.5600328445s, input_fired_time: 0.1499257833, output_fired_time: 0.0000000000, propagate_forward_time: 7.9959111214, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4141955376
validation[          , genome  7117] predictions:    9723/  10000 (97.23%), best:    9776/10000 (97.76%), error:       884.49396, best error:       760.31879 on epoch:    70, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 100.8541183472s, input_fired_time: 1.3981848955, output_fired_time: 0.9236236811, propagate_forward_time: 40.9093322754, propagate_backward_time: 55.2686309814, weight_update_time: 0.1009854302, other_time: 2.3543472290
epoch time: 8.4992990494s, input_fired_time: 0.1493003219, output_fired_time: 0.0000000000, propagate_forward_time: 7.9389195442, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4110789299
validation[          , genome  7117] predictions:    9754/  10000 (97.54%), best:    9776/10000 (97.76%), error:       795.08124, best error:       760.31879 on epoch:    70, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 97.7221832275s, input_fired_time: 1.3707427979, output_fired_time: 0.9026920795, propagate_forward_time: 39.1895103455, propagate_backward_time: 53.9655761719, weight_update_time: 0.0986725688, other_time: 2.2936592102
epoch time: 8.5767869949s, input_fired_time: 0.1518055350, output_fired_time: 0.0000000000, propagate_forward_time: 8.0163955688, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4085855484
validation[          , genome  7117] predictions:    9754/  10000 (97.54%), best:    9776/10000 (97.76%), error:       816.29932, best error:       760.31879 on epoch:    70, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 104.2096633911s, input_fired_time: 1.4251644611, output_fired_time: 0.9460111260, propagate_forward_time: 42.0195922852, propagate_backward_time: 57.4245452881, weight_update_time: 0.1038890630, other_time: 2.3943481445
epoch time: 9.7738199234s, input_fired_time: 0.1658915728, output_fired_time: 0.0000000000, propagate_forward_time: 9.1527633667, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4551649094
validation[          , genome  7117] predictions:    9734/  10000 (97.34%), best:    9776/10000 (97.76%), error:       858.37799, best error:       760.31879 on epoch:    70, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 102.7848587036s, input_fired_time: 1.4088791609, output_fired_time: 0.9309676886, propagate_forward_time: 41.5193328857, propagate_backward_time: 56.5250968933, weight_update_time: 0.1042794287, other_time: 2.4005775452
epoch time: 8.4918375015s, input_fired_time: 0.1499150097, output_fired_time: 0.0000000000, propagate_forward_time: 7.9391264915, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4027962685
validation[          , genome  7117] predictions:    9770/  10000 (97.70%), best:    9776/10000 (97.76%), error:       770.99622, best error:       760.31879 on epoch:    70, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 103.5855255127s, input_fired_time: 1.4215698242, output_fired_time: 0.9416955709, propagate_forward_time: 41.7178688049, propagate_backward_time: 57.1299514771, weight_update_time: 0.1041423306, other_time: 2.3744392395
epoch time: 10.2805824280s, input_fired_time: 0.1723923236, output_fired_time: 0.0000000000, propagate_forward_time: 9.6448507309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4633398056
validation[          , genome  7117] predictions:    9756/  10000 (97.56%), best:    9776/10000 (97.76%), error:       848.89642, best error:       760.31879 on epoch:    70, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 102.1471786499s, input_fired_time: 1.4158676863, output_fired_time: 0.9303989410, propagate_forward_time: 41.3701057434, propagate_backward_time: 56.0656547546, weight_update_time: 0.1029240340, other_time: 2.3651504517
epoch time: 8.5965595245s, input_fired_time: 0.1534209251, output_fired_time: 0.0000000000, propagate_forward_time: 8.0285663605, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4145717621
validation[          , genome  7117] predictions:    9741/  10000 (97.41%), best:    9776/10000 (97.76%), error:       803.65985, best error:       760.31879 on epoch:    70, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 100.9476089478s, input_fired_time: 1.4033827782, output_fired_time: 0.9212614894, propagate_forward_time: 40.7871284485, propagate_backward_time: 55.5040092468, weight_update_time: 0.1025409549, other_time: 2.3318252563
epoch time: 8.6443901062s, input_fired_time: 0.1526851207, output_fired_time: 0.0000000000, propagate_forward_time: 8.0799217224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4117832184
validation[          , genome  7117] predictions:    9738/  10000 (97.38%), best:    9776/10000 (97.76%), error:       853.68042, best error:       760.31879 on epoch:    70, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 105.6569519043s, input_fired_time: 1.4365248680, output_fired_time: 0.9603828192, propagate_forward_time: 42.6525917053, propagate_backward_time: 58.2247924805, weight_update_time: 0.1055954173, other_time: 2.3826637268
epoch time: 9.7371473312s, input_fired_time: 0.1688174754, output_fired_time: 0.0000000000, propagate_forward_time: 9.1202192307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4481105804
validation[          , genome  7117] predictions:    9719/  10000 (97.19%), best:    9776/10000 (97.76%), error:       923.59753, best error:       760.31879 on epoch:    70, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 102.3404388428s, input_fired_time: 1.4130637646, output_fired_time: 0.9290998578, propagate_forward_time: 41.3411636353, propagate_backward_time: 56.3297805786, weight_update_time: 0.1026286259, other_time: 2.3273315430
epoch time: 8.5253124237s, input_fired_time: 0.1520217806, output_fired_time: 0.0000000000, propagate_forward_time: 7.9663767815, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4069142342
validation[          , genome  7117] predictions:    9758/  10000 (97.58%), best:    9776/10000 (97.76%), error:       852.76782, best error:       760.31879 on epoch:    70, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 110.1916351318s, input_fired_time: 1.4640510082, output_fired_time: 0.9929274917, propagate_forward_time: 44.5762367249, propagate_backward_time: 60.6873512268, weight_update_time: 0.1105182916, other_time: 2.4710693359
epoch time: 11.8708839417s, input_fired_time: 0.1908326000, output_fired_time: 0.0000000000, propagate_forward_time: 11.1617813110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5182704926
validation[          , genome  7117] predictions:    9777/  10000 (97.77%), best:    9777/10000 (97.77%), error:       724.32703, best error:       724.32703 on epoch:    82, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 129.3937072754s, input_fired_time: 1.6331661940, output_fired_time: 1.1433117390, propagate_forward_time: 53.0477104187, propagate_backward_time: 70.7648468018, weight_update_time: 0.1281362027, other_time: 2.8046722412
epoch time: 11.0813169479s, input_fired_time: 0.1875366271, output_fired_time: 0.0000000000, propagate_forward_time: 10.3907337189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5030469894
validation[          , genome  7117] predictions:    9699/  10000 (96.99%), best:    9777/10000 (97.77%), error:      1009.12378, best error:       724.32703 on epoch:    82, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 106.0753402710s, input_fired_time: 1.4363123178, output_fired_time: 0.9595825672, propagate_forward_time: 42.8173980713, propagate_backward_time: 58.4622001648, weight_update_time: 0.1059441939, other_time: 2.3998527527
epoch time: 10.0092458725s, input_fired_time: 0.1752334088, output_fired_time: 0.0000000000, propagate_forward_time: 9.3606786728, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4733333588
validation[          , genome  7117] predictions:    9775/  10000 (97.75%), best:    9777/10000 (97.77%), error:       786.81763, best error:       724.32703 on epoch:    82, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 121.2612915039s, input_fired_time: 1.5955250263, output_fired_time: 1.0731068850, propagate_forward_time: 49.1018905640, propagate_backward_time: 66.6778564453, weight_update_time: 0.1253700852, other_time: 2.8129119873
epoch time: 9.8711929321s, input_fired_time: 0.1776712984, output_fired_time: 0.0000000000, propagate_forward_time: 9.2191400528, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4743814468
validation[          , genome  7117] predictions:    9773/  10000 (97.73%), best:    9777/10000 (97.77%), error:       749.49939, best error:       724.32703 on epoch:    82, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 111.9942550659s, input_fired_time: 1.5352526903, output_fired_time: 1.0106512308, propagate_forward_time: 45.3909492493, propagate_backward_time: 61.4131698608, weight_update_time: 0.1169795319, other_time: 2.6442337036
epoch time: 9.6202621460s, input_fired_time: 0.1713599265, output_fired_time: 0.0000000000, propagate_forward_time: 8.9836177826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4652843475
validation[          , genome  7117] predictions:    9754/  10000 (97.54%), best:    9777/10000 (97.77%), error:       813.60504, best error:       724.32703 on epoch:    82, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 119.3173904419s, input_fired_time: 1.5855537653, output_fired_time: 1.0565600395, propagate_forward_time: 48.6959381104, propagate_backward_time: 65.1914672852, weight_update_time: 0.1243726313, other_time: 2.7878723145
epoch time: 9.4620428085s, input_fired_time: 0.1724385917, output_fired_time: 0.0000000000, propagate_forward_time: 8.8305931091, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4590110779
validation[          , genome  7117] predictions:    9764/  10000 (97.64%), best:    9777/10000 (97.77%), error:       761.42053, best error:       724.32703 on epoch:    82, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 121.4511566162s, input_fired_time: 1.6008993387, output_fired_time: 1.0740268230, propagate_forward_time: 49.5483741760, propagate_backward_time: 66.4175720215, weight_update_time: 0.1258071214, other_time: 2.8102874756
epoch time: 11.9302129745s, input_fired_time: 0.2010704279, output_fired_time: 0.0000000000, propagate_forward_time: 11.1981554031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5309867859
validation[          , genome  7117] predictions:    9706/  10000 (97.06%), best:    9777/10000 (97.77%), error:       968.11212, best error:       724.32703 on epoch:    82, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 112.8456649780s, input_fired_time: 1.5156178474, output_fired_time: 1.0021761656, propagate_forward_time: 45.3008651733, propagate_backward_time: 62.3816070557, weight_update_time: 0.1176633015, other_time: 2.6454010010
epoch time: 9.5327882767s, input_fired_time: 0.1717179269, output_fired_time: 0.0000000000, propagate_forward_time: 8.9030237198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4580469131
validation[          , genome  7117] predictions:    9769/  10000 (97.69%), best:    9777/10000 (97.77%), error:       762.13892, best error:       724.32703 on epoch:    82, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 115.3083114624s, input_fired_time: 1.5514136553, output_fired_time: 1.0371403694, propagate_forward_time: 46.8829002380, propagate_backward_time: 63.1571350098, weight_update_time: 0.1198959947, other_time: 2.6797180176
epoch time: 11.5241537094s, input_fired_time: 0.1958373934, output_fired_time: 0.0000000000, propagate_forward_time: 10.8115377426, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5167789459
validation[          , genome  7117] predictions:    9777/  10000 (97.77%), best:    9777/10000 (97.77%), error:       749.23096, best error:       724.32703 on epoch:    82, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 113.1561965942s, input_fired_time: 1.5117098093, output_fired_time: 1.0129518509, propagate_forward_time: 45.9027214050, propagate_backward_time: 62.1477394104, weight_update_time: 0.1154486164, other_time: 2.5810661316
epoch time: 8.7914352417s, input_fired_time: 0.1543415040, output_fired_time: 0.0000000000, propagate_forward_time: 8.2213125229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4157810211
validation[          , genome  7117] predictions:    9769/  10000 (97.69%), best:    9777/10000 (97.77%), error:       775.84253, best error:       724.32703 on epoch:    82, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 135.6812438965s, input_fired_time: 1.7058675289, output_fired_time: 1.1761968136, propagate_forward_time: 55.4114379883, propagate_backward_time: 74.4028778076, weight_update_time: 0.1379510760, other_time: 2.9848632812
epoch time: 12.4854679108s, input_fired_time: 0.1981228590, output_fired_time: 0.0000000000, propagate_forward_time: 11.7528982162, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5344467163
validation[          , genome  7117] predictions:    9765/  10000 (97.65%), best:    9777/10000 (97.77%), error:       790.83264, best error:       724.32703 on epoch:    82, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 123.8379592896s, input_fired_time: 1.6051721573, output_fired_time: 1.0864442587, propagate_forward_time: 50.4315872192, propagate_backward_time: 67.9118804932, weight_update_time: 0.1277993470, other_time: 2.8028793335
epoch time: 12.5356321335s, input_fired_time: 0.2090327740, output_fired_time: 0.0000000000, propagate_forward_time: 11.7745132446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5520858765
validation[          , genome  7117] predictions:    9746/  10000 (97.46%), best:    9777/10000 (97.77%), error:       786.14282, best error:       724.32703 on epoch:    82, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 122.7800140381s, input_fired_time: 1.6013522148, output_fired_time: 1.0847184658, propagate_forward_time: 50.0299568176, propagate_backward_time: 67.2886352539, weight_update_time: 0.1265418977, other_time: 2.7753601074
epoch time: 10.0151729584s, input_fired_time: 0.1792603284, output_fired_time: 0.0000000000, propagate_forward_time: 9.3672647476, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4686479568
validation[          , genome  7117] predictions:    9770/  10000 (97.70%), best:    9777/10000 (97.77%), error:       767.31940, best error:       724.32703 on epoch:    82, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 109.9171142578s, input_fired_time: 1.4962935448, output_fired_time: 0.9800297618, propagate_forward_time: 44.4095497131, propagate_backward_time: 60.4700279236, weight_update_time: 0.1143153459, other_time: 2.5612182617
epoch time: 8.5720701218s, input_fired_time: 0.1548642665, output_fired_time: 0.0000000000, propagate_forward_time: 8.0044517517, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4127540588
validation[          , genome  7117] predictions:    9672/  10000 (96.72%), best:    9777/10000 (97.77%), error:      1034.02234, best error:       724.32703 on epoch:    82, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 125.0222854614s, input_fired_time: 1.6233239174, output_fired_time: 1.0947334766, propagate_forward_time: 50.6805572510, propagate_backward_time: 68.6884613037, weight_update_time: 0.1289507151, other_time: 2.9352111816
epoch time: 12.5591564178s, input_fired_time: 0.2042140514, output_fired_time: 0.0000000000, propagate_forward_time: 11.7863826752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5685596466
validation[          , genome  7117] predictions:    9746/  10000 (97.46%), best:    9777/10000 (97.77%), error:       802.67926, best error:       724.32703 on epoch:    82, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 130.6181945801s, input_fired_time: 1.6687427759, output_fired_time: 1.1511116028, propagate_forward_time: 53.2612342834, propagate_backward_time: 71.5835113525, weight_update_time: 0.1316585243, other_time: 2.9535980225
epoch time: 9.6704463959s, input_fired_time: 0.1726702452, output_fired_time: 0.0000000000, propagate_forward_time: 9.0238542557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4739217758
validation[          , genome  7117] predictions:    9759/  10000 (97.59%), best:    9777/10000 (97.77%), error:       792.47168, best error:       724.32703 on epoch:    82, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 122.6376342773s, input_fired_time: 1.5820600986, output_fired_time: 1.0799524784, propagate_forward_time: 50.0701408386, propagate_backward_time: 67.0871734619, weight_update_time: 0.1217625663, other_time: 2.8182983398
epoch time: 11.2706842422s, input_fired_time: 0.1888218373, output_fired_time: 0.0000000000, propagate_forward_time: 10.5630912781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5187711716
validation[          , genome  7117] predictions:    9758/  10000 (97.58%), best:    9777/10000 (97.77%), error:       785.59174, best error:       724.32703 on epoch:    82, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 121.7295303345s, input_fired_time: 1.5799413919, output_fired_time: 1.0695856810, propagate_forward_time: 49.9805412292, propagate_backward_time: 66.3796844482, weight_update_time: 0.1207705066, other_time: 2.7197723389
epoch time: 10.9473791122s, input_fired_time: 0.1826672554, output_fired_time: 0.0000000000, propagate_forward_time: 10.2744379044, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4902734756
validation[          , genome  7117] predictions:    9775/  10000 (97.75%), best:    9777/10000 (97.77%), error:       754.92261, best error:       724.32703 on epoch:    82, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 113.9286727905s, input_fired_time: 1.4925845861, output_fired_time: 1.0097219944, propagate_forward_time: 45.8932495117, propagate_backward_time: 62.9445724487, weight_update_time: 0.1142347902, other_time: 2.5885467529
epoch time: 9.3901815414s, input_fired_time: 0.1610024869, output_fired_time: 0.0000000000, propagate_forward_time: 8.7910175323, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4381618500
validation[          , genome  7117] predictions:    9718/  10000 (97.18%), best:    9777/10000 (97.77%), error:       973.76324, best error:       724.32703 on epoch:    82, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 48.5885925293s, input_fired_time: 0.8270826340, output_fired_time: 0.0000000000, propagate_forward_time: 45.4742622375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2872467041
best training[          , genome  7117] predictions:   49676/  50000 (99.35%), best:    9777/10000 (97.77%), error:      1359.99402, best error:       724.32703 on epoch:    82, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 9.6487350464s, input_fired_time: 0.1621795893, output_fired_time: 0.0000000000, propagate_forward_time: 9.0353355408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4512195587
   testing[          , genome  7117] predictions:    9808/  10000 (98.08%), best:    9777/10000 (97.77%), error:       626.89606, best error:       724.32703 on epoch:    82, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
13:31:55 (37372): called boinc_finish(0)

</stderr_txt>
]]>