Nameexact_genome_1512568488_44_6937_1
Workunit2605985
Created7 Dec 2017, 22:50:42 UTC
Sent7 Dec 2017, 22:57:47 UTC
Report deadline14 Dec 2017, 13:00:18 UTC
Received8 Dec 2017, 14:41:57 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time3 hours 41 min 37 sec
CPU time3 hours 34 min 13 sec
Validate stateValid
Credit1,646.27
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.71 MB
Peak swap size158.89 MB
Peak disk usage1.87 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
e_time: 0.0000000000, other_time: 0.6295795441
validation[          , genome  6937] predictions:    9674/  10000 (96.74%), best:    9667/10000 (96.67%), error:      1156.83826, best error:      1134.11560 on epoch:    11, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 123.6920623779s, input_fired_time: 1.5289528370, output_fired_time: 1.3567049503, propagate_forward_time: 45.8246383667, propagate_backward_time: 71.5964431763, weight_update_time: 0.1484602094, other_time: 3.3853225708
epoch time: 10.6364774704s, input_fired_time: 0.1950310916, output_fired_time: 0.0000000000, propagate_forward_time: 9.8327569962, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6086893082
validation[          , genome  6937] predictions:    9696/  10000 (96.96%), best:    9696/10000 (96.96%), error:      1053.45801, best error:      1053.45801 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 139.3377685547s, input_fired_time: 1.7272871733, output_fired_time: 1.5118601322, propagate_forward_time: 49.9049453735, propagate_backward_time: 80.6943740845, weight_update_time: 0.1642911732, other_time: 5.4993133545
epoch time: 9.2878494263s, input_fired_time: 0.1926975995, output_fired_time: 0.0000000000, propagate_forward_time: 8.5007448196, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5944070816
validation[          , genome  6937] predictions:    9530/  10000 (95.30%), best:    9696/10000 (96.96%), error:      1541.33508, best error:      1053.45801 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 125.4730606079s, input_fired_time: 1.5301315784, output_fired_time: 1.3679808378, propagate_forward_time: 47.8809127808, propagate_backward_time: 71.3305892944, weight_update_time: 0.1479188949, other_time: 3.3634490967
epoch time: 9.7109193802s, input_fired_time: 0.1931305826, output_fired_time: 0.0000000000, propagate_forward_time: 8.9133834839, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6044054031
validation[          , genome  6937] predictions:    9708/  10000 (97.08%), best:    9708/10000 (97.08%), error:       997.52179, best error:       997.52179 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 140.1037597656s, input_fired_time: 1.7521469593, output_fired_time: 1.5309870243, propagate_forward_time: 52.4387626648, propagate_backward_time: 80.6073226929, weight_update_time: 0.1720956564, other_time: 3.7745285034
epoch time: 10.7758922577s, input_fired_time: 0.1924375892, output_fired_time: 0.0000000000, propagate_forward_time: 9.9256505966, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6578044891
validation[          , genome  6937] predictions:    9682/  10000 (96.82%), best:    9708/10000 (97.08%), error:      1026.97583, best error:       997.52179 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 128.3189544678s, input_fired_time: 1.5928825140, output_fired_time: 1.4459177256, propagate_forward_time: 47.3023300171, propagate_backward_time: 74.4645156860, weight_update_time: 0.1479544491, other_time: 3.5133132935
epoch time: 10.6271982193s, input_fired_time: 0.1957173198, output_fired_time: 0.0000000000, propagate_forward_time: 9.8256959915, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6057853699
validation[          , genome  6937] predictions:    9666/  10000 (96.66%), best:    9708/10000 (97.08%), error:      1092.62488, best error:       997.52179 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 125.1297683716s, input_fired_time: 1.5446168184, output_fired_time: 1.3876997232, propagate_forward_time: 45.0780982971, propagate_backward_time: 73.7032165527, weight_update_time: 0.1497988254, other_time: 3.4161376953
epoch time: 9.2961711884s, input_fired_time: 0.1912276000, output_fired_time: 0.0000000000, propagate_forward_time: 8.4923305511, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6126127243
validation[          , genome  6937] predictions:    9632/  10000 (96.32%), best:    9708/10000 (97.08%), error:      1262.32617, best error:       997.52179 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 134.9123840332s, input_fired_time: 1.6469759941, output_fired_time: 1.5220484734, propagate_forward_time: 52.0076103210, propagate_backward_time: 75.9900436401, weight_update_time: 0.1480131298, other_time: 3.7457046509
epoch time: 10.7672767639s, input_fired_time: 0.1960862577, output_fired_time: 0.0000000000, propagate_forward_time: 9.9598255157, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6113653183
validation[          , genome  6937] predictions:    9660/  10000 (96.60%), best:    9708/10000 (97.08%), error:      1126.93750, best error:       997.52179 on epoch:    17, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 124.2424163818s, input_fired_time: 1.5562690496, output_fired_time: 1.3711916208, propagate_forward_time: 45.8909683228, propagate_backward_time: 72.0181884766, weight_update_time: 0.1480923295, other_time: 3.4057998657
epoch time: 9.5373220444s, input_fired_time: 0.1929493248, output_fired_time: 0.0000000000, propagate_forward_time: 8.7469978333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5973749161
validation[          , genome  6937] predictions:    9657/  10000 (96.57%), best:    9708/10000 (97.08%), error:      1119.00281, best error:       997.52179 on epoch:    17, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 136.9892272949s, input_fired_time: 1.6604211330, output_fired_time: 1.5092154741, propagate_forward_time: 49.2223091125, propagate_backward_time: 79.6934204102, weight_update_time: 0.1823156029, other_time: 4.9038696289
epoch time: 10.8259820938s, input_fired_time: 0.1932894289, output_fired_time: 0.0000000000, propagate_forward_time: 10.0179882050, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6147041321
validation[          , genome  6937] predictions:    9584/  10000 (95.84%), best:    9708/10000 (97.08%), error:      1395.87744, best error:       997.52179 on epoch:    17, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 130.5821075439s, input_fired_time: 1.5832434893, output_fired_time: 1.4683606625, propagate_forward_time: 47.1171913147, propagate_backward_time: 76.8229675293, weight_update_time: 0.1514429450, other_time: 3.5903472900
epoch time: 10.4707088470s, input_fired_time: 0.1995212734, output_fired_time: 0.0000000000, propagate_forward_time: 9.6663246155, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6048631668
validation[          , genome  6937] predictions:    9695/  10000 (96.95%), best:    9708/10000 (97.08%), error:      1035.41235, best error:       997.52179 on epoch:    17, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 130.7440948486s, input_fired_time: 1.6717154980, output_fired_time: 1.4663225412, propagate_forward_time: 47.8256874084, propagate_backward_time: 75.2597198486, weight_update_time: 0.1558691114, other_time: 4.5206451416
epoch time: 10.5796289444s, input_fired_time: 0.1954050213, output_fired_time: 0.0000000000, propagate_forward_time: 9.7814941406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6027297974
validation[          , genome  6937] predictions:    9632/  10000 (96.32%), best:    9708/10000 (97.08%), error:      1234.89136, best error:       997.52179 on epoch:    17, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 136.5867309570s, input_fired_time: 1.7133816481, output_fired_time: 1.5052270889, propagate_forward_time: 51.3596496582, propagate_backward_time: 78.4123992920, weight_update_time: 0.1584491432, other_time: 3.5960693359
epoch time: 11.4101905823s, input_fired_time: 0.2544308007, output_fired_time: 0.0000000000, propagate_forward_time: 10.4195575714, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7362022400
validation[          , genome  6937] predictions:    9691/  10000 (96.91%), best:    9708/10000 (97.08%), error:      1013.20972, best error:       997.52179 on epoch:    17, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 124.6805648804s, input_fired_time: 1.5381543636, output_fired_time: 1.3627012968, propagate_forward_time: 44.6116409302, propagate_backward_time: 73.8087158203, weight_update_time: 0.1476827413, other_time: 3.3593521118
epoch time: 9.4275569916s, input_fired_time: 0.1935587078, output_fired_time: 0.0000000000, propagate_forward_time: 8.6444272995, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5895709991
validation[          , genome  6937] predictions:    9690/  10000 (96.90%), best:    9708/10000 (97.08%), error:      1074.55371, best error:       997.52179 on epoch:    17, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 123.4595184326s, input_fired_time: 1.5474723577, output_fired_time: 1.3571527004, propagate_forward_time: 43.6006660461, propagate_backward_time: 73.5515213013, weight_update_time: 0.1473373175, other_time: 3.4027023315
epoch time: 10.6621809006s, input_fired_time: 0.2026626468, output_fired_time: 0.0000000000, propagate_forward_time: 9.8560886383, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6034297943
validation[          , genome  6937] predictions:    9701/  10000 (97.01%), best:    9708/10000 (97.08%), error:      1033.61487, best error:       997.52179 on epoch:    17, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 123.7356262207s, input_fired_time: 1.5412373543, output_fired_time: 1.3609676361, propagate_forward_time: 45.6325836182, propagate_backward_time: 71.8489151001, weight_update_time: 0.1478675008, other_time: 3.3519210815
epoch time: 10.6029024124s, input_fired_time: 0.1951811165, output_fired_time: 0.0000000000, propagate_forward_time: 9.8080224991, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5996990204
validation[          , genome  6937] predictions:    9716/  10000 (97.16%), best:    9716/10000 (97.16%), error:       957.79944, best error:       957.79944 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 123.4568481445s, input_fired_time: 1.5471860170, output_fired_time: 1.3649827242, propagate_forward_time: 45.1174468994, propagate_backward_time: 72.0638504028, weight_update_time: 0.1476769298, other_time: 3.3633804321
epoch time: 9.2099485397s, input_fired_time: 0.1947629005, output_fired_time: 0.0000000000, propagate_forward_time: 8.4285049438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5866804123
validation[          , genome  6937] predictions:    9717/  10000 (97.17%), best:    9716/10000 (97.16%), error:       957.92609, best error:       957.79944 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 123.2957458496s, input_fired_time: 1.5346398354, output_fired_time: 1.3581343889, propagate_forward_time: 45.3283882141, propagate_backward_time: 71.7608871460, weight_update_time: 0.1466340423, other_time: 3.3136978149
epoch time: 10.7879190445s, input_fired_time: 0.2069260627, output_fired_time: 0.0000000000, propagate_forward_time: 9.9567317963, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6242609024
validation[          , genome  6937] predictions:    9692/  10000 (96.92%), best:    9716/10000 (97.16%), error:      1043.11389, best error:       957.79944 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 123.6664199829s, input_fired_time: 1.5433692932, output_fired_time: 1.3702358007, propagate_forward_time: 46.6013183594, propagate_backward_time: 70.8160781860, weight_update_time: 0.1476070732, other_time: 3.3354110718
epoch time: 10.4253368378s, input_fired_time: 0.1999117732, output_fired_time: 0.0000000000, propagate_forward_time: 9.6273097992, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5981149673
validation[          , genome  6937] predictions:    9690/  10000 (96.90%), best:    9716/10000 (97.16%), error:      1053.00110, best error:       957.79944 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 127.0617675781s, input_fired_time: 1.6062691212, output_fired_time: 1.3763048649, propagate_forward_time: 48.1173591614, propagate_backward_time: 72.5064544678, weight_update_time: 0.1491561979, other_time: 3.4553833008
epoch time: 10.6701002121s, input_fired_time: 0.2028141469, output_fired_time: 0.0000000000, propagate_forward_time: 9.8585586548, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6087274551
validation[          , genome  6937] predictions:    9733/  10000 (97.33%), best:    9733/10000 (97.33%), error:       922.17188, best error:       922.17188 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 123.5811462402s, input_fired_time: 1.5714030266, output_fired_time: 1.3567693233, propagate_forward_time: 46.5940513611, propagate_backward_time: 70.6771926880, weight_update_time: 0.1474627554, other_time: 3.3817367554
epoch time: 9.3679065704s, input_fired_time: 0.1925568581, output_fired_time: 0.0000000000, propagate_forward_time: 8.5670509338, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6082992554
validation[          , genome  6937] predictions:    9604/  10000 (96.04%), best:    9733/10000 (97.33%), error:      1344.11670, best error:       922.17188 on epoch:    33, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 123.7698211670s, input_fired_time: 1.5367889404, output_fired_time: 1.3740590811, propagate_forward_time: 46.6242408752, propagate_backward_time: 70.8857116699, weight_update_time: 0.1469559968, other_time: 3.3490142822
epoch time: 14.6243600845s, input_fired_time: 0.3083843291, output_fired_time: 0.0000000000, propagate_forward_time: 13.4476633072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8683128357
validation[          , genome  6937] predictions:    9645/  10000 (96.45%), best:    9733/10000 (97.33%), error:      1174.54871, best error:       922.17188 on epoch:    33, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 135.3545684814s, input_fired_time: 1.6868609190, output_fired_time: 1.4716428518, propagate_forward_time: 48.8213386536, propagate_backward_time: 79.7622756958, weight_update_time: 0.1648541540, other_time: 3.6124496460
epoch time: 15.1335372925s, input_fired_time: 0.3212909102, output_fired_time: 0.0000000000, propagate_forward_time: 13.9840745926, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8281717300
validation[          , genome  6937] predictions:    9717/  10000 (97.17%), best:    9733/10000 (97.33%), error:      1000.74786, best error:       922.17188 on epoch:    33, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 123.9949264526s, input_fired_time: 1.5432780981, output_fired_time: 1.3741152287, propagate_forward_time: 43.7764511108, propagate_backward_time: 73.9242935181, weight_update_time: 0.1468822956, other_time: 3.3767852783
epoch time: 9.3636560440s, input_fired_time: 0.1909583360, output_fired_time: 0.0000000000, propagate_forward_time: 8.5839815140, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5887165070
validation[          , genome  6937] predictions:    9686/  10000 (96.86%), best:    9733/10000 (97.33%), error:      1079.92700, best error:       922.17188 on epoch:    33, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 124.7061080933s, input_fired_time: 1.5534051657, output_fired_time: 1.3730514050, propagate_forward_time: 45.6133575439, propagate_backward_time: 72.7946319580, weight_update_time: 0.1494181603, other_time: 3.3716583252
epoch time: 9.2724266052s, input_fired_time: 0.1913908720, output_fired_time: 0.0000000000, propagate_forward_time: 8.4982328415, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5828027725
validation[          , genome  6937] predictions:    9728/  10000 (97.28%), best:    9728/10000 (97.28%), error:       891.36157, best error:       891.36157 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 130.5856018066s, input_fired_time: 1.5927838087, output_fired_time: 2.4604282379, propagate_forward_time: 48.8921966553, propagate_backward_time: 74.1735839844, weight_update_time: 0.1484616846, other_time: 3.4666061401
epoch time: 12.1137504578s, input_fired_time: 0.2610829175, output_fired_time: 0.0000000000, propagate_forward_time: 11.1038770676, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7487907410
validation[          , genome  6937] predictions:    9687/  10000 (96.87%), best:    9728/10000 (97.28%), error:      1046.42505, best error:       891.36157 on epoch:    38, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 124.6554107666s, input_fired_time: 1.5560771227, output_fired_time: 1.3732850552, propagate_forward_time: 45.3365783691, propagate_backward_time: 73.0055618286, weight_update_time: 0.1478978992, other_time: 3.3839111328
epoch time: 9.3964405060s, input_fired_time: 0.1918135285, output_fired_time: 0.0000000000, propagate_forward_time: 8.6151189804, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5895080566
validation[          , genome  6937] predictions:    9743/  10000 (97.43%), best:    9728/10000 (97.28%), error:       895.08331, best error:       891.36157 on epoch:    38, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 134.0773620605s, input_fired_time: 1.6242721081, output_fired_time: 1.4568586349, propagate_forward_time: 49.1950416565, propagate_backward_time: 78.2280731201, weight_update_time: 0.1559661031, other_time: 3.5731201172
epoch time: 9.2795362473s, input_fired_time: 0.1962201595, output_fired_time: 0.0000000000, propagate_forward_time: 8.4896945953, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5936212540
validation[          , genome  6937] predictions:    9726/  10000 (97.26%), best:    9728/10000 (97.28%), error:       970.93719, best error:       891.36157 on epoch:    38, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 124.1357116699s, input_fired_time: 1.5439429283, output_fired_time: 1.3709378242, propagate_forward_time: 46.4051971436, propagate_backward_time: 71.4515914917, weight_update_time: 0.1479059756, other_time: 3.3640365601
epoch time: 9.5242729187s, input_fired_time: 0.2001301646, output_fired_time: 0.0000000000, propagate_forward_time: 8.7201480865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6039943695
validation[          , genome  6937] predictions:    9705/  10000 (97.05%), best:    9728/10000 (97.28%), error:      1025.70203, best error:       891.36157 on epoch:    38, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 122.3274154663s, input_fired_time: 1.5400165319, output_fired_time: 1.3487685919, propagate_forward_time: 45.9909744263, propagate_backward_time: 70.0971298218, weight_update_time: 0.1468084604, other_time: 3.3505249023
epoch time: 10.9423866272s, input_fired_time: 0.2068977058, output_fired_time: 0.0000000000, propagate_forward_time: 10.1185455322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6169433594
validation[          , genome  6937] predictions:    9695/  10000 (96.95%), best:    9728/10000 (97.28%), error:       996.68011, best error:       891.36157 on epoch:    38, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 124.0040588379s, input_fired_time: 1.5561012030, output_fired_time: 1.3629105091, propagate_forward_time: 46.7919845581, propagate_backward_time: 70.9064636230, weight_update_time: 0.1479252130, other_time: 3.3866043091
epoch time: 9.4374427795s, input_fired_time: 0.1977156103, output_fired_time: 0.0000000000, propagate_forward_time: 8.6305646896, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6091623306
validation[          , genome  6937] predictions:    9678/  10000 (96.78%), best:    9728/10000 (97.28%), error:      1083.95801, best error:       891.36157 on epoch:    38, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 124.1288909912s, input_fired_time: 1.5475862026, output_fired_time: 1.4051018953, propagate_forward_time: 45.4004592896, propagate_backward_time: 72.4121856689, weight_update_time: 0.1478453577, other_time: 3.3635559082
epoch time: 9.3257942200s, input_fired_time: 0.1943988204, output_fired_time: 0.0000000000, propagate_forward_time: 8.5462303162, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5851650238
validation[          , genome  6937] predictions:    9730/  10000 (97.30%), best:    9728/10000 (97.28%), error:       925.35736, best error:       891.36157 on epoch:    38, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 123.4022216797s, input_fired_time: 1.5448491573, output_fired_time: 1.3577890396, propagate_forward_time: 45.6959571838, propagate_backward_time: 70.4560012817, weight_update_time: 0.1475395709, other_time: 4.3476333618
epoch time: 10.5427131653s, input_fired_time: 0.1997612119, output_fired_time: 0.0000000000, propagate_forward_time: 9.7381505966, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6048011780
validation[          , genome  6937] predictions:    9698/  10000 (96.98%), best:    9728/10000 (97.28%), error:      1063.04858, best error:       891.36157 on epoch:    38, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 122.4997177124s, input_fired_time: 1.5465348959, output_fired_time: 1.7614779472, propagate_forward_time: 44.3789176941, propagate_backward_time: 71.4743804932, weight_update_time: 0.1474379599, other_time: 3.3384094238
epoch time: 9.3580532074s, input_fired_time: 0.1920666993, output_fired_time: 0.0000000000, propagate_forward_time: 8.5838766098, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5821094513
validation[          , genome  6937] predictions:    9632/  10000 (96.32%), best:    9728/10000 (97.28%), error:      1174.91406, best error:       891.36157 on epoch:    38, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 124.4788513184s, input_fired_time: 1.5628588200, output_fired_time: 1.3692882061, propagate_forward_time: 47.4392776489, propagate_backward_time: 70.7236557007, weight_update_time: 0.1498134881, other_time: 3.3837738037
epoch time: 9.4531564713s, input_fired_time: 0.1926150620, output_fired_time: 0.0000000000, propagate_forward_time: 8.6732463837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5872945786
validation[          , genome  6937] predictions:    9694/  10000 (96.94%), best:    9728/10000 (97.28%), error:      1056.30896, best error:       891.36157 on epoch:    38, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 128.6239929199s, input_fired_time: 1.6100924015, output_fired_time: 1.4284081459, propagate_forward_time: 46.3927192688, propagate_backward_time: 74.6676559448, weight_update_time: 0.1490141004, other_time: 4.5251235962
epoch time: 9.4543609619s, input_fired_time: 0.1981074214, output_fired_time: 0.0000000000, propagate_forward_time: 8.6388149261, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6174383163
validation[          , genome  6937] predictions:    9727/  10000 (97.27%), best:    9728/10000 (97.28%), error:       925.60046, best error:       891.36157 on epoch:    38, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 124.1148071289s, input_fired_time: 1.5573935509, output_fired_time: 1.3603676558, propagate_forward_time: 45.5944480896, propagate_backward_time: 72.2373886108, weight_update_time: 0.1473963410, other_time: 3.3652114868
epoch time: 13.6608619690s, input_fired_time: 0.2525830269, output_fired_time: 0.0000000000, propagate_forward_time: 12.6570577621, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7512216568
validation[          , genome  6937] predictions:    9699/  10000 (96.99%), best:    9728/10000 (97.28%), error:       986.36945, best error:       891.36157 on epoch:    38, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 126.7168197632s, input_fired_time: 1.5692902803, output_fired_time: 1.4556356668, propagate_forward_time: 46.7581443787, propagate_backward_time: 73.5202636719, weight_update_time: 0.1481381804, other_time: 3.4134826660
epoch time: 10.6421785355s, input_fired_time: 0.2013353109, output_fired_time: 0.0000000000, propagate_forward_time: 9.8247356415, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6161079407
validation[          , genome  6937] predictions:    9682/  10000 (96.82%), best:    9728/10000 (97.28%), error:      1067.94885, best error:       891.36157 on epoch:    38, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 122.5472717285s, input_fired_time: 1.5483034849, output_fired_time: 1.3534399271, propagate_forward_time: 45.0607604980, propagate_backward_time: 71.2565994263, weight_update_time: 0.1459791064, other_time: 3.3281707764
epoch time: 10.7429904938s, input_fired_time: 0.2033449113, output_fired_time: 0.0000000000, propagate_forward_time: 9.9271097183, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6125354767
validation[          , genome  6937] predictions:    9757/  10000 (97.57%), best:    9757/10000 (97.57%), error:       882.49493, best error:       882.49493 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 121.4203872681s, input_fired_time: 1.5659404993, output_fired_time: 1.3560993671, propagate_forward_time: 44.1515350342, propagate_backward_time: 70.8809432983, weight_update_time: 0.1474418193, other_time: 3.4658660889
epoch time: 9.1247329712s, input_fired_time: 0.1913850158, output_fired_time: 0.0000000000, propagate_forward_time: 8.3569250107, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5764226913
validation[          , genome  6937] predictions:    9708/  10000 (97.08%), best:    9757/10000 (97.57%), error:       984.86377, best error:       882.49493 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 123.6956176758s, input_fired_time: 1.5612981319, output_fired_time: 1.3578536510, propagate_forward_time: 44.6109962463, propagate_backward_time: 72.8122406006, weight_update_time: 0.1484055966, other_time: 3.3532257080
epoch time: 10.7511196136s, input_fired_time: 0.2020889074, output_fired_time: 0.0000000000, propagate_forward_time: 9.9352788925, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6137514114
validation[          , genome  6937] predictions:    9718/  10000 (97.18%), best:    9757/10000 (97.57%), error:       945.77118, best error:       882.49493 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 123.4892501831s, input_fired_time: 2.5653851032, output_fired_time: 1.3577806950, propagate_forward_time: 46.4129257202, propagate_backward_time: 69.7997207642, weight_update_time: 0.1476279795, other_time: 3.3534393311
epoch time: 13.1477022171s, input_fired_time: 0.2662568390, output_fired_time: 0.0000000000, propagate_forward_time: 12.0877485275, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7936964035
validation[          , genome  6937] predictions:    9582/  10000 (95.82%), best:    9757/10000 (97.57%), error:      1366.28760, best error:       882.49493 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 133.0368347168s, input_fired_time: 1.6955907345, output_fired_time: 1.4971662760, propagate_forward_time: 50.0699729919, propagate_backward_time: 76.1850128174, weight_update_time: 0.1572698504, other_time: 3.5890960693
epoch time: 15.7804689407s, input_fired_time: 0.2847505808, output_fired_time: 0.0000000000, propagate_forward_time: 14.5797319412, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9159860611
validation[          , genome  6937] predictions:    9690/  10000 (96.90%), best:    9757/10000 (97.57%), error:      1068.29443, best error:       882.49493 on epoch:    52, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 123.9628982544s, input_fired_time: 2.5676043034, output_fired_time: 1.3825869560, propagate_forward_time: 44.6245841980, propagate_backward_time: 71.9532089233, weight_update_time: 0.1572511047, other_time: 3.4349136353
epoch time: 11.0276317596s, input_fired_time: 0.2093338668, output_fired_time: 0.0000000000, propagate_forward_time: 10.2003574371, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6179409027
validation[          , genome  6937] predictions:    9659/  10000 (96.59%), best:    9757/10000 (97.57%), error:      1191.89624, best error:       882.49493 on epoch:    52, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 135.2644653320s, input_fired_time: 1.7781430483, output_fired_time: 1.4910387993, propagate_forward_time: 53.1069602966, propagate_backward_time: 75.2226791382, weight_update_time: 0.1745050102, other_time: 3.6656417847
epoch time: 11.1735696793s, input_fired_time: 0.2379994243, output_fired_time: 0.0000000000, propagate_forward_time: 10.2483177185, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6872529984
validation[          , genome  6937] predictions:    9731/  10000 (97.31%), best:    9757/10000 (97.57%), error:       941.16992, best error:       882.49493 on epoch:    52, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 123.6958847046s, input_fired_time: 1.5606834888, output_fired_time: 1.3526434898, propagate_forward_time: 46.1863250732, propagate_backward_time: 71.2867126465, weight_update_time: 0.1462294012, other_time: 3.3095169067
epoch time: 9.4998970032s, input_fired_time: 0.1982336044, output_fired_time: 0.0000000000, propagate_forward_time: 8.6946525574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6070108414
validation[          , genome  6937] predictions:    9660/  10000 (96.60%), best:    9757/10000 (97.57%), error:      1133.23987, best error:       882.49493 on epoch:    52, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 122.9356689453s, input_fired_time: 1.5525941849, output_fired_time: 1.3591331244, propagate_forward_time: 45.1865501404, propagate_backward_time: 70.4666976929, weight_update_time: 0.1471036822, other_time: 4.3706893921
epoch time: 10.7537603378s, input_fired_time: 0.2004131526, output_fired_time: 0.0000000000, propagate_forward_time: 9.9544887543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5988588333
validation[          , genome  6937] predictions:    9667/  10000 (96.67%), best:    9757/10000 (97.57%), error:      1129.09290, best error:       882.49493 on epoch:    52, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 124.3898849487s, input_fired_time: 1.5747665167, output_fired_time: 1.3702940941, propagate_forward_time: 45.8569869995, propagate_backward_time: 72.2311477661, weight_update_time: 0.1484251618, other_time: 3.3566894531
epoch time: 12.1488676071s, input_fired_time: 0.2442962229, output_fired_time: 0.0000000000, propagate_forward_time: 11.2045793533, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6999921799
validation[          , genome  6937] predictions:    9755/  10000 (97.55%), best:    9755/10000 (97.55%), error:       857.10834, best error:       857.10834 on epoch:    61, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 143.9607238770s, input_fired_time: 1.7820100784, output_fired_time: 1.6093654633, propagate_forward_time: 52.1754684448, propagate_backward_time: 84.5639343262, weight_update_time: 0.1923449039, other_time: 3.8299484253
epoch time: 9.7730207443s, input_fired_time: 0.2044858783, output_fired_time: 0.0000000000, propagate_forward_time: 8.9459495544, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6225852966
validation[          , genome  6937] predictions:    9670/  10000 (96.70%), best:    9755/10000 (97.55%), error:      1134.51538, best error:       857.10834 on epoch:    61, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 129.8530426025s, input_fired_time: 1.6458296776, output_fired_time: 1.4115793705, propagate_forward_time: 48.5302391052, propagate_backward_time: 74.7756423950, weight_update_time: 0.1581315845, other_time: 3.4897537231
epoch time: 9.3453493118s, input_fired_time: 0.1949715018, output_fired_time: 0.0000000000, propagate_forward_time: 8.5646781921, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5857000351
validation[          , genome  6937] predictions:    9726/  10000 (97.26%), best:    9755/10000 (97.55%), error:       944.28516, best error:       857.10834 on epoch:    61, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 122.8055191040s, input_fired_time: 1.5642784834, output_fired_time: 1.3658394814, propagate_forward_time: 48.2813453674, propagate_backward_time: 68.2614822388, weight_update_time: 0.1466462612, other_time: 3.3325729370
epoch time: 10.6950817108s, input_fired_time: 0.2079171836, output_fired_time: 0.0000000000, propagate_forward_time: 8.8583326340, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6288318634
validation[          , genome  6937] predictions:    9696/  10000 (96.96%), best:    9755/10000 (97.55%), error:      1037.29773, best error:       857.10834 on epoch:    61, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 122.6502685547s, input_fired_time: 1.6012594700, output_fired_time: 1.3570489883, propagate_forward_time: 44.4532051086, propagate_backward_time: 71.7689971924, weight_update_time: 0.1482051611, other_time: 3.4697570801
epoch time: 10.5438709259s, input_fired_time: 0.2059173137, output_fired_time: 0.0000000000, propagate_forward_time: 9.7361669540, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6017866135
validation[          , genome  6937] predictions:    9730/  10000 (97.30%), best:    9755/10000 (97.55%), error:       931.51642, best error:       857.10834 on epoch:    61, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 123.6536407471s, input_fired_time: 1.5714412928, output_fired_time: 1.3706438541, propagate_forward_time: 45.5197296143, propagate_backward_time: 71.7995071411, weight_update_time: 0.1493531466, other_time: 3.3923187256
epoch time: 9.4323072433s, input_fired_time: 0.1979232430, output_fired_time: 0.0000000000, propagate_forward_time: 8.6465950012, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5877885818
validation[          , genome  6937] predictions:    9594/  10000 (95.94%), best:    9755/10000 (97.55%), error:      1320.01514, best error:       857.10834 on epoch:    61, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 133.4777679443s, input_fired_time: 1.6133370399, output_fired_time: 1.4293216467, propagate_forward_time: 49.3819770813, propagate_backward_time: 77.4694061279, weight_update_time: 0.1470625401, other_time: 3.5837249756
epoch time: 10.5983591080s, input_fired_time: 0.2140263319, output_fired_time: 0.0000000000, propagate_forward_time: 9.7919445038, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5923881531
validation[          , genome  6937] predictions:    9745/  10000 (97.45%), best:    9755/10000 (97.55%), error:       915.41986, best error:       857.10834 on epoch:    61, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 122.5579986572s, input_fired_time: 1.5739412308, output_fired_time: 1.3639787436, propagate_forward_time: 46.2819366455, propagate_backward_time: 69.9484024048, weight_update_time: 0.1486289203, other_time: 3.3897399902
epoch time: 9.3212051392s, input_fired_time: 0.1972391158, output_fired_time: 0.0000000000, propagate_forward_time: 8.5253171921, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5986490250
validation[          , genome  6937] predictions:    9648/  10000 (96.48%), best:    9755/10000 (97.55%), error:      1119.96899, best error:       857.10834 on epoch:    61, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 131.3494873047s, input_fired_time: 1.6280086040, output_fired_time: 1.4411944151, propagate_forward_time: 48.1522903442, propagate_backward_time: 76.5110473633, weight_update_time: 0.1549045593, other_time: 3.6169509888
epoch time: 9.2403678894s, input_fired_time: 0.1989245415, output_fired_time: 0.0000000000, propagate_forward_time: 8.4531383514, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5883045197
validation[          , genome  6937] predictions:    9740/  10000 (97.40%), best:    9755/10000 (97.55%), error:       890.16357, best error:       857.10834 on epoch:    61, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 130.1968078613s, input_fired_time: 1.5993025303, output_fired_time: 1.4253391027, propagate_forward_time: 45.5904922485, propagate_backward_time: 78.1297073364, weight_update_time: 0.1492441744, other_time: 3.4519653320
epoch time: 9.3825626373s, input_fired_time: 0.1985873878, output_fired_time: 0.0000000000, propagate_forward_time: 8.5921897888, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5917854309
validation[          , genome  6937] predictions:    9750/  10000 (97.50%), best:    9755/10000 (97.55%), error:       899.64056, best error:       857.10834 on epoch:    61, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 134.7135467529s, input_fired_time: 1.6925240755, output_fired_time: 1.5104255676, propagate_forward_time: 48.6334190369, propagate_backward_time: 78.2416152954, weight_update_time: 0.1524353027, other_time: 4.6355667114
epoch time: 10.4694766998s, input_fired_time: 0.2017346025, output_fired_time: 0.0000000000, propagate_forward_time: 8.6594667435, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6082754135
validation[          , genome  6937] predictions:    9719/  10000 (97.19%), best:    9755/10000 (97.55%), error:       943.11554, best error:       857.10834 on epoch:    61, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 124.7897262573s, input_fired_time: 1.5827443600, output_fired_time: 1.3894124031, propagate_forward_time: 45.1683387756, propagate_backward_time: 73.2628402710, weight_update_time: 0.1481646299, other_time: 3.3863906860
epoch time: 9.5561733246s, input_fired_time: 0.2066259682, output_fired_time: 0.0000000000, propagate_forward_time: 8.7422389984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6073083878
validation[          , genome  6937] predictions:    9693/  10000 (96.93%), best:    9755/10000 (97.55%), error:      1052.97742, best error:       857.10834 on epoch:    61, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 125.9863739014s, input_fired_time: 1.5793224573, output_fired_time: 2.3985433578, propagate_forward_time: 48.2066230774, propagate_backward_time: 70.3917770386, weight_update_time: 0.1509420276, other_time: 3.4101028442
epoch time: 9.3598880768s, input_fired_time: 0.1967860907, output_fired_time: 0.0000000000, propagate_forward_time: 8.5381879807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6249141693
validation[          , genome  6937] predictions:    9663/  10000 (96.63%), best:    9755/10000 (97.55%), error:      1122.51221, best error:       857.10834 on epoch:    61, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 129.2378387451s, input_fired_time: 1.6244629622, output_fired_time: 1.4147516489, propagate_forward_time: 47.2857246399, propagate_backward_time: 74.3244781494, weight_update_time: 0.1674915254, other_time: 4.5884246826
epoch time: 9.6154117584s, input_fired_time: 0.2062658072, output_fired_time: 0.0000000000, propagate_forward_time: 8.7982921600, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6108541489
validation[          , genome  6937] predictions:    9725/  10000 (97.25%), best:    9755/10000 (97.55%), error:       926.71936, best error:       857.10834 on epoch:    61, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 125.8961257935s, input_fired_time: 1.6590696573, output_fired_time: 1.3808423281, propagate_forward_time: 45.6029014587, propagate_backward_time: 72.8140029907, weight_update_time: 0.1495857984, other_time: 4.4393081665
epoch time: 11.0419960022s, input_fired_time: 0.2105423957, output_fired_time: 0.0000000000, propagate_forward_time: 10.1966915131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6347618103
validation[          , genome  6937] predictions:    9745/  10000 (97.45%), best:    9755/10000 (97.55%), error:       882.27850, best error:       857.10834 on epoch:    61, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 123.9672546387s, input_fired_time: 1.5736660957, output_fired_time: 1.3838565350, propagate_forward_time: 44.5942955017, propagate_backward_time: 73.0084762573, weight_update_time: 0.1484339088, other_time: 3.4069595337
epoch time: 11.1018171310s, input_fired_time: 0.2097995728, output_fired_time: 0.0000000000, propagate_forward_time: 10.2635135651, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6285037994
validation[          , genome  6937] predictions:    9729/  10000 (97.29%), best:    9755/10000 (97.55%), error:       929.19043, best error:       857.10834 on epoch:    61, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 124.2321853638s, input_fired_time: 1.5854332447, output_fired_time: 1.3818987608, propagate_forward_time: 46.6851043701, propagate_backward_time: 71.1141662598, weight_update_time: 0.1489328891, other_time: 3.4655838013
epoch time: 9.3812198639s, input_fired_time: 0.2025213689, output_fired_time: 0.0000000000, propagate_forward_time: 8.5514554977, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6272430420
validation[          , genome  6937] predictions:    9684/  10000 (96.84%), best:    9755/10000 (97.55%), error:      1064.30164, best error:       857.10834 on epoch:    61, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 124.4599227905s, input_fired_time: 1.5762187243, output_fired_time: 1.3581476212, propagate_forward_time: 45.6693496704, propagate_backward_time: 72.4105377197, weight_update_time: 0.1562167555, other_time: 3.4456710815
epoch time: 9.3867874146s, input_fired_time: 0.2004625946, output_fired_time: 0.0000000000, propagate_forward_time: 8.5803127289, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6060123444
validation[          , genome  6937] predictions:    9684/  10000 (96.84%), best:    9755/10000 (97.55%), error:      1073.99670, best error:       857.10834 on epoch:    61, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 132.0495910645s, input_fired_time: 1.6470834017, output_fired_time: 1.4497010708, propagate_forward_time: 50.5038414001, propagate_backward_time: 74.9124374390, weight_update_time: 0.1495285928, other_time: 3.5365219116
epoch time: 9.4291248322s, input_fired_time: 0.2027589232, output_fired_time: 0.0000000000, propagate_forward_time: 8.6296520233, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5967140198
validation[          , genome  6937] predictions:    9720/  10000 (97.20%), best:    9755/10000 (97.55%), error:       924.80951, best error:       857.10834 on epoch:    61, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 132.8342590332s, input_fired_time: 1.7393900156, output_fired_time: 1.4692918062, propagate_forward_time: 50.2826004028, propagate_backward_time: 75.7083892822, weight_update_time: 0.1491655707, other_time: 3.6345748901
epoch time: 11.1325683594s, input_fired_time: 0.2233804464, output_fired_time: 0.0000000000, propagate_forward_time: 10.2273302078, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6818580627
validation[          , genome  6937] predictions:    9719/  10000 (97.19%), best:    9755/10000 (97.55%), error:       943.13885, best error:       857.10834 on epoch:    61, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 123.2523422241s, input_fired_time: 1.5969721079, output_fired_time: 2.3744997978, propagate_forward_time: 44.4037628174, propagate_backward_time: 70.3772125244, weight_update_time: 0.1504068375, other_time: 4.4999008179
epoch time: 9.4371557236s, input_fired_time: 0.2009209543, output_fired_time: 0.0000000000, propagate_forward_time: 8.6190671921, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6171674728
validation[          , genome  6937] predictions:    9722/  10000 (97.22%), best:    9755/10000 (97.55%), error:       960.32233, best error:       857.10834 on epoch:    61, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 122.1137008667s, input_fired_time: 1.5698937178, output_fired_time: 1.3532428741, propagate_forward_time: 47.0436668396, propagate_backward_time: 68.7983016968, weight_update_time: 0.1472458839, other_time: 3.3485946655
epoch time: 10.3577976227s, input_fired_time: 0.2026651055, output_fired_time: 0.0000000000, propagate_forward_time: 9.5547990799, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6003332138
validation[          , genome  6937] predictions:    9666/  10000 (96.66%), best:    9755/10000 (97.55%), error:      1089.10962, best error:       857.10834 on epoch:    61, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 122.6204528809s, input_fired_time: 1.5712804794, output_fired_time: 1.3722243309, propagate_forward_time: 44.1105766296, propagate_backward_time: 72.1717987061, weight_update_time: 0.1481778771, other_time: 3.3945770264
epoch time: 9.3080892563s, input_fired_time: 0.2011667490, output_fired_time: 0.0000000000, propagate_forward_time: 8.4573488235, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6495733261
validation[          , genome  6937] predictions:    9724/  10000 (97.24%), best:    9755/10000 (97.55%), error:       952.82947, best error:       857.10834 on epoch:    61, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 124.6202850342s, input_fired_time: 1.5753697157, output_fired_time: 1.3749210835, propagate_forward_time: 46.5697517395, propagate_backward_time: 71.6958999634, weight_update_time: 0.1540945917, other_time: 3.4043350220
epoch time: 9.3118877411s, input_fired_time: 0.2020557374, output_fired_time: 0.0000000000, propagate_forward_time: 8.5061616898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6036701202
validation[          , genome  6937] predictions:    9689/  10000 (96.89%), best:    9755/10000 (97.55%), error:      1053.02759, best error:       857.10834 on epoch:    61, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 122.6717224121s, input_fired_time: 2.5798168182, output_fired_time: 1.3729603291, propagate_forward_time: 47.0624618530, propagate_backward_time: 68.2189712524, weight_update_time: 0.1481564343, other_time: 3.4375076294
epoch time: 10.6255226135s, input_fired_time: 0.2092380971, output_fired_time: 0.0000000000, propagate_forward_time: 9.7798452377, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6364393234
validation[          , genome  6937] predictions:    9669/  10000 (96.69%), best:    9755/10000 (97.55%), error:      1109.01685, best error:       857.10834 on epoch:    61, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 124.8841476440s, input_fired_time: 1.6019327641, output_fired_time: 1.3835268021, propagate_forward_time: 44.8928146362, propagate_backward_time: 73.4786758423, weight_update_time: 0.1501389295, other_time: 3.5271911621
epoch time: 11.2954998016s, input_fired_time: 0.2301996946, output_fired_time: 0.0000000000, propagate_forward_time: 10.4123382568, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6529617310
validation[          , genome  6937] predictions:    9719/  10000 (97.19%), best:    9755/10000 (97.55%), error:      1022.29291, best error:       857.10834 on epoch:    61, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 123.1792144775s, input_fired_time: 1.5827286243, output_fired_time: 1.3703986406, propagate_forward_time: 46.5484924316, propagate_backward_time: 70.1907806396, weight_update_time: 0.1500701010, other_time: 3.4868164063
epoch time: 9.3583230972s, input_fired_time: 0.2074557990, output_fired_time: 0.0000000000, propagate_forward_time: 8.5069828033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6438846588
validation[          , genome  6937] predictions:    9737/  10000 (97.37%), best:    9755/10000 (97.55%), error:       938.31421, best error:       857.10834 on epoch:    61, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 127.3192672729s, input_fired_time: 1.6170974970, output_fired_time: 1.4101914167, propagate_forward_time: 45.6802711487, propagate_backward_time: 75.0043487549, weight_update_time: 0.1535272598, other_time: 3.6073608398
epoch time: 9.1385717392s, input_fired_time: 0.1961209327, output_fired_time: 0.0000000000, propagate_forward_time: 8.3068866730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6355638504
validation[          , genome  6937] predictions:    9723/  10000 (97.23%), best:    9755/10000 (97.55%), error:       969.88452, best error:       857.10834 on epoch:    61, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 125.1880340576s, input_fired_time: 1.6319987774, output_fired_time: 1.4005388021, propagate_forward_time: 47.1540603638, propagate_backward_time: 71.3908462524, weight_update_time: 0.1570969671, other_time: 3.6105957031
epoch time: 10.6287403107s, input_fired_time: 0.2080290616, output_fired_time: 0.0000000000, propagate_forward_time: 9.7681570053, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6525545120
validation[          , genome  6937] predictions:    9684/  10000 (96.84%), best:    9755/10000 (97.55%), error:      1060.96997, best error:       857.10834 on epoch:    61, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 128.6531982422s, input_fired_time: 1.6899995804, output_fired_time: 1.4223892689, propagate_forward_time: 46.9464950562, propagate_backward_time: 74.9000015259, weight_update_time: 0.1543879360, other_time: 3.6943130493
epoch time: 10.5106906891s, input_fired_time: 0.2108082175, output_fired_time: 0.0000000000, propagate_forward_time: 9.6612768173, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6386060715
validation[          , genome  6937] predictions:    9722/  10000 (97.22%), best:    9755/10000 (97.55%), error:       947.39386, best error:       857.10834 on epoch:    61, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 122.3354339600s, input_fired_time: 2.6096992493, output_fired_time: 1.3640079498, propagate_forward_time: 45.0882987976, propagate_backward_time: 69.7416305542, weight_update_time: 0.1500027627, other_time: 3.5318069458
epoch time: 10.9027805328s, input_fired_time: 0.2109133005, output_fired_time: 0.0000000000, propagate_forward_time: 9.9996833801, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6921834946
validation[          , genome  6937] predictions:    9701/  10000 (97.01%), best:    9755/10000 (97.55%), error:      1009.33191, best error:       857.10834 on epoch:    61, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 122.5670471191s, input_fired_time: 1.6021231413, output_fired_time: 1.3620324135, propagate_forward_time: 46.0658035278, propagate_backward_time: 68.9089660645, weight_update_time: 0.1508388668, other_time: 4.6281280518
epoch time: 9.4237022400s, input_fired_time: 0.2057424337, output_fired_time: 0.0000000000, propagate_forward_time: 8.5920209885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6259384155
validation[          , genome  6937] predictions:    9721/  10000 (97.21%), best:    9755/10000 (97.55%), error:       947.03644, best error:       857.10834 on epoch:    61, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 122.9093933105s, input_fired_time: 2.5994238853, output_fired_time: 1.3747953176, propagate_forward_time: 45.2974395752, propagate_backward_time: 70.0258102417, weight_update_time: 0.1511903107, other_time: 3.6119232178
epoch time: 10.4372577667s, input_fired_time: 0.2028469145, output_fired_time: 0.0000000000, propagate_forward_time: 9.5945177078, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6398935318
validation[          , genome  6937] predictions:    9713/  10000 (97.13%), best:    9755/10000 (97.55%), error:       996.84412, best error:       857.10834 on epoch:    61, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 122.9814224243s, input_fired_time: 1.5978790522, output_fired_time: 1.3720374107, propagate_forward_time: 46.1159172058, propagate_backward_time: 70.3279800415, weight_update_time: 0.1511808783, other_time: 3.5676040649
epoch time: 10.6362628937s, input_fired_time: 0.2085386962, output_fired_time: 0.0000000000, propagate_forward_time: 9.7842540741, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6434698105
validation[          , genome  6937] predictions:    9716/  10000 (97.16%), best:    9755/10000 (97.55%), error:       940.55499, best error:       857.10834 on epoch:    61, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 123.1180877686s, input_fired_time: 1.5957767963, output_fired_time: 1.3935931921, propagate_forward_time: 46.3973159790, propagate_backward_time: 70.1347503662, weight_update_time: 0.1508018374, other_time: 3.5966491699
epoch time: 9.3328371048s, input_fired_time: 0.2039107233, output_fired_time: 0.0000000000, propagate_forward_time: 8.5085067749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6204195023
validation[          , genome  6937] predictions:    9719/  10000 (97.19%), best:    9755/10000 (97.55%), error:       991.49719, best error:       857.10834 on epoch:    61, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 124.7406921387s, input_fired_time: 1.6452485323, output_fired_time: 1.3880015612, propagate_forward_time: 44.6881942749, propagate_backward_time: 72.4153213501, weight_update_time: 0.1528635621, other_time: 4.6039276123
epoch time: 9.7262802124s, input_fired_time: 0.2121683061, output_fired_time: 0.0000000000, propagate_forward_time: 8.8859720230, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6281394958
validation[          , genome  6937] predictions:    9674/  10000 (96.74%), best:    9755/10000 (97.55%), error:      1108.44958, best error:       857.10834 on epoch:    61, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 122.2748565674s, input_fired_time: 1.6096919775, output_fired_time: 1.3643488884, propagate_forward_time: 44.1969947815, propagate_backward_time: 71.5516586304, weight_update_time: 0.1513631493, other_time: 3.5521621704
epoch time: 10.6195011139s, input_fired_time: 0.2052742392, output_fired_time: 0.0000000000, propagate_forward_time: 9.7544479370, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6597785950
validation[          , genome  6937] predictions:    9751/  10000 (97.51%), best:    9755/10000 (97.55%), error:       871.70294, best error:       857.10834 on epoch:    61, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 130.0019073486s, input_fired_time: 2.5925998688, output_fired_time: 1.4456003904, propagate_forward_time: 47.8727378845, propagate_backward_time: 74.4358367920, weight_update_time: 0.1509272754, other_time: 3.6551361084
epoch time: 10.5763168335s, input_fired_time: 0.2058103085, output_fired_time: 0.0000000000, propagate_forward_time: 9.7530565262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6174497604
validation[          , genome  6937] predictions:    9714/  10000 (97.14%), best:    9755/10000 (97.55%), error:       991.00372, best error:       857.10834 on epoch:    61, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 125.2632980347s, input_fired_time: 1.6664355993, output_fired_time: 1.3711555004, propagate_forward_time: 48.2296981812, propagate_backward_time: 70.2076110840, weight_update_time: 0.1568711251, other_time: 3.7883987427
epoch time: 10.5113935471s, input_fired_time: 0.2111200392, output_fired_time: 0.0000000000, propagate_forward_time: 9.6632461548, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6370277405
validation[          , genome  6937] predictions:    9726/  10000 (97.26%), best:    9755/10000 (97.55%), error:       951.37476, best error:       857.10834 on epoch:    61, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 128.5804901123s, input_fired_time: 1.6698900461, output_fired_time: 1.4351752996, propagate_forward_time: 49.3390502930, propagate_backward_time: 72.5269088745, weight_update_time: 0.1542847604, other_time: 3.6094665527
epoch time: 10.5953283310s, input_fired_time: 0.2071381658, output_fired_time: 0.0000000000, propagate_forward_time: 9.7286176682, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6595726013
validation[          , genome  6937] predictions:    9738/  10000 (97.38%), best:    9755/10000 (97.55%), error:       907.76245, best error:       857.10834 on epoch:    61, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 52.3164329529s, input_fired_time: 1.9899736643, output_fired_time: 0.0000000000, propagate_forward_time: 46.8447685242, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4816894531
best training[          , genome  6937] predictions:   49364/  50000 (98.73%), best:    9755/10000 (97.55%), error:      2325.31982, best error:       857.10834 on epoch:    61, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 10.3901796341s, input_fired_time: 0.1920115501, output_fired_time: 0.0000000000, propagate_forward_time: 9.5942535400, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6039142609
   testing[          , genome  6937] predictions:    9775/  10000 (97.75%), best:    9755/10000 (97.55%), error:       756.23761, best error:       857.10834 on epoch:    61, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
05:40:44 (6932): called boinc_finish(0)

</stderr_txt>
]]>